Website not crawled

Dhinesh

i added website www.nsale.in in add campaign, it shows only 1 page crawled. but its working fine for other sites, any idea why it failed ?

Bryan_Loconto

How long has it been up? Also, did you add the site from its root?

Dhinesh

its from day one. i have other domains on the same server www.litetab.in, its crawling properly. not sure why www.nsale.in alone doesnt work.

jesse-landry

That's one of the bigger robots files I've seen in awhile..

You sure that crawl delay isn't messing things up? Not sure but that'd be my first guess.

jesse-landry

just looked at the other site you say is working... it has a much simpler robots file and no delay. just sayin' //

KeriMorgret

This page references several reasons why only one page may be crawled. If it isn't any of these reasons, please contact our help desk. Thanks!

Welcome to the Q&A Forum