Crawling a website with redirects
-
Hi,
I started a campaign for a website which uses multiple redirects before showing the real content. in the crawling report only one page is crawled.
Is there a way to let the crawler pass the redirects to get usefull reports?
The website is www.cegeka.be
Thank you
-
Hi Peter
It would be helpful to know how you are redirecting these pages (301 etc) and for what reason?
Also whether any of your pages are blocked in your robots.txt file - perhaps to prevent duplicate content?