Need an expert of SCREAMING FROG

I need to get some pages from a domain. I am using the Screaming Frog app. But the site is so big, more than 2 million pages inside, so my computer and RAM memory collapses when I'm tracking the 400,000 pages, without finish my work.

For this reason, I need to do a more specific search: the correct result is no more than 50 thousand valid pages. So I need the correct expressions in the "exclude" function to do it.

On the site there are "user profiles" like this:

[login to view URL]

[login to view URL]

[login to view URL]



[login to view URL]

This is what I need, I need to crawl all of these URLs. I'm going to export in an excel file all of these usersprofile URL.

But ... from each profile I received more than 5 results like this ... But I'm only interested in the result a). The a) is the URL that I need, the b) the result is a folder, I suppose, and the rest are subfolders. I dont need any of the results since b)

a) [login to view URL]

b) [login to view URL]

c) [login to view URL]

d) [login to view URL]

e) [login to view URL]

f) [login to view URL]

For example, for the case c) I tried to do it using an exclusion expression like:

EXCLUDE * Following. *

EXCLUDE [login to view URL]*

EXCLUDE [login to view URL]*/following.*

[login to view URL]

The URL [login to view URL] did not crawl ... THIS IS CORRECT! But the URL [login to view URL] was not tracked either. THIS IS NOT CORRECT.

The domain is [login to view URL]

I need an expert with Screaming Frog who can help me with the correct expressions to track in my application.


So. I need someone who has SEO SCREAMING FROG app to test the expression before send me.

Taidot: hakukoneoptimointi, Web Crawling, Tietojen kaavinta verkosta

Näytä lisää: Re-design this site: We need a full-width layout, Re-design this site: We need a full-width layout Same logo Color scheme can change Remo, Re-design this website: We need a full-width layout Same logo in top left of header, We need to redesign this website:, We are setting up our website and need a design for this., We are setting up our website and need a design for this. We need a clean, fresh, smart 2017 looking webs, Re-design and need a new design for this., Re-design and need a new design for this, i need to create website like http www bahwantravels com, http www jeraiflora com my need php, http www bestbuy com site misc expert service unbeatable price pcmcat345300050032 c id pcmcat34530c0050032, need expert blog commenting, need expert seo, need expert, need expert ebay selling, need expert web seo freelance help iweb, need expert php, need expert microsoft word program, need expert photoshop, need expert php flash consultant

Tietoa työnantajasta:
( 0 arvostelua ) Gran Buenos Aires, Argentina

Projektin tunnus: #16175396

5 freelanceria on tarjonnut keskimäärin %project_bid_stats_avg_sub_26% %project_currencyDetails_sign_sub_27% tähän työhön

$25 USD 1 päivässä
(54 arvostelua)
$100 USD 1 päivässä
(109 arvostelua)

from the screaming frog page screamingfrog co uk/seo-spider/user-guide/general/#crawling You may notice some URLs which are not within the /blog/ sub folder are crawled as well by default. This will be due to the Lisää

$25 USD 1 päivässä
(16 arvostelua)

I scrap many websites on daily basis. I love automating and scraping for my clients and personal use.

$20 USD 1 päivässä
(0 arvostelua)

RegEx can easily handle this problem! (Image below) [login to view URL] Regular Expressions

$35 USD 1 päivässä
(0 arvostelua)