Welcome to the Q&A Forum

Hi, Try using any other crawler to see if they provide you with the same message (ScreamingFrog), in some cases it could mean that the site is overloaded and will start blocking the crawler. We're doing something similar for ours as we have a lot of scrapers but exclude the 'good' sites. Martijn.

Hi, Can I ask what leads you to believe search engines aren't crawling/indexing the site? When I search site:www.bugsanonymousil.com in Google, I'm seeing 62 pages from the site showing up in the index. One BIG problem with the site, though, is it looks like when someone requests an estimate, a webpage is generated for them - and these pages are being indexed with customers' names, addresses, email, and phone numbers. You should definitely remove those URLs from the index in Google Search Console, and update the site so that those pages aren't crawlable/indexable.