Need an expert of SCREAMING FROG

I need to get some pages from a domain. I am using the Screaming Frog app. But the site is so big, more than 2 million pages inside, so my computer and RAM memory collapses when I'm tracking the 400,000 pages, without finish my work.

For this reason, I need to do a more specific search: the correct result is no more than 50 thousand valid pages. So I need the correct expressions in the "exclude" function to do it.

On the site there are "user profiles" like this:

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]



[url removed, login to view]

This is what I need, I need to crawl all of these URLs. I'm going to export in an excel file all of these usersprofile URL.

But ... from each profile I received more than 5 results like this ... But I'm only interested in the result a). The a) is the URL that I need, the b) the result is a folder, I suppose, and the rest are subfolders. I dont need any of the results since b)

a) [url removed, login to view]

b) [url removed, login to view]

c) [url removed, login to view]

d) [url removed, login to view]

e) [url removed, login to view]

f) [url removed, login to view]

For example, for the case c) I tried to do it using an exclusion expression like:

EXCLUDE * Following. *

EXCLUDE [url removed, login to view]*

EXCLUDE [url removed, login to view]*/following.*

[url removed, login to view]

The URL [url removed, login to view] did not crawl ... THIS IS CORRECT! But the URL [url removed, login to view] was not tracked either. THIS IS NOT CORRECT.

The domain is [url removed, login to view]

I need an expert with Screaming Frog who can help me with the correct expressions to track in my application.


So. I need someone who has SEO SCREAMING FROG app to test the expression before send me.

Taidot: hakukoneoptimointi, Web Crawling, Tietojen kaavinta verkosta

Näytä lisää: Re-design this site: We need a full-width layout, Re-design this site: We need a full-width layout Same logo Color scheme can change Remo, Re-design this website: We need a full-width layout Same logo in top left of header, We need to redesign this website:, We are setting up our website and need a design for this., We are setting up our website and need a design for this. We need a clean, fresh, smart 2017 looking webs, Re-design and need a new design for this., Re-design and need a new design for this, i need to create website like http www bahwantravels com, http www jeraiflora com my need php, http www bestbuy com site misc expert service unbeatable price pcmcat345300050032 c id pcmcat34530c0050032, need expert blog commenting, need expert seo, need expert, need expert ebay selling, need expert web seo freelance help iweb, need expert php, need expert microsoft word program, need expert photoshop, need expert php flash consultant, need expert software cracks, need expert delphi programmer years experience, need expert volusion coder, need expert java, http www pornhub com view video

Tietoa työnantajasta:
( 0 arvostelua ) Gran Buenos Aires, Argentina

Projektin tunnus: #16175396

6 freelanceria on tarjonnut keskimäärin %project_bid_stats_avg_sub_26% %project_currencyDetails_sign_sub_27% tähän työhön

$100 USD 1 päivässä
(104 arvostelua)

from the screaming frog page screamingfrog co uk/seo-spider/user-guide/general/#crawling You may notice some URLs which are not within the /blog/ sub folder are crawled as well by default. This will be due to the Lisää

$25 USD 1 päivässä
(15 arvostelua)
$25 USD 1 päivässä
(11 arvostelua)

I scrap many websites on daily basis. I love automating and scraping for my clients and personal use.

$20 USD 1 päivässä
(0 arvostelua)

Project Milestonei am expert is many work,Web Development,Logo Design,woldpress,Graphic Design,HTML,

$25 USD 1 päivässä
(0 arvostelua)

RegEx can easily handle this problem! (Image below) [login to view URL] Regular Expressions

$35 USD 1 päivässä
(0 arvostelua)