Website Indexing Issues - Search Bots will only crawl Homepage of Website, Help!

[MarketingChimp10]

Hello Moz World,

I am stuck on a problem, and wanted to get some insight. When I attempt to use Screaming Spider or SEO Powersuite, the software is only crawling the homepage of my website. I have 17 pages associated with the main domain i.e. example.com/home, example.com/sevices, etc. I've done a bit of investigating, and I have found that my client's website does not have Robot.txt file or a site map. However, under Google Search Console, all of my client's website pages have been indexed.

My questions, Why is my software not crawling all of the pages associated with the website? If I integrate a Robot.txt file & sitemap will that resolve the issue?

Thanks ahead of time for all of the great responses.

B/R

Will H.

[LoganRay]

Hi Will,

It'd be impossible to find a solution to the problem without having the domain. If you want to message me the URL, I can take a quick look for ya.

A lack of either of those files shouldn't create any crawl issues. Setting up those files won't fix your problem, but you should add them both anyway.