Rogerbot did not crawl my site ! What might be the problem?
-
When I saw the new crawl for my site I wondered why there are no errors, no warning and 0 notices anymore.
Then I saw that only 1 page was crawled. There are no Error Messages or webmasters Tools also did not report anything about crawling problems.
What might be the problem?
thanks for any tips!
Holger -
Hi! Here are some common reasons why only one page is crawled. If this doesn't solve it, opening a ticket with the help desk would be the next step.
-
Thanks Keri,
But its not about these common problems, because Rogerbot crawled the properly before. May be a ticked will help to find the cause.
Holger
-
Hi there,
Thanks for reaching out! I went ahead and started a ticket for you to do some digging. I will run a few tests on my end to see where it is causing the issue. I will get in touch you ASAP

Thanks again for reaching, hope I could talk to you soon!
Best,
-
I am running into this problem as well. Does anyone have an answer. I was a customer a year ago and had no problems. Stopped for a while and then came back, my site was never able to be crawled again. A few months later I did make a few changes on my site, and just tried again today, but it only gets 1 page. Once before they told it had to do with something like http 1.0/1.1 which makes no sense. Not sure why google, bing and the rest can crawl the site, but this service can't. Hopefully someone has an answer. I looked at that link that is mentioned and I do not feel that any of those are causing the issues.