The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Web Design
    4. Website not crawling

    Website not crawling

    Web Design
    2 2 45
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • PrimeMediaConsulting
      PrimeMediaConsulting last edited by

      This post is deleted!
      1 Reply Last reply Reply Quote 0
      • RuthBurrReedy
        RuthBurrReedy last edited by

        Hi,

        Can I ask what leads you to believe search engines aren't crawling/indexing the site? When I search site:www.bugsanonymousil.com in Google, I'm seeing 62 pages from the site showing up in the index.

        One BIG problem with the site, though, is it looks like when someone requests an estimate, a webpage is generated for them - and these pages are being indexed with customers' names, addresses, email, and phone numbers. You should definitely remove those URLs from the index in Google Search Console, and update the site so that those pages aren't crawlable/indexable.

        1 Reply Last reply Reply Quote 1
        • 1 / 1
        • First post
          Last post
        • Is there a way to host my website.com/BLOG URL PATH from a different host than my main website.com host?
          ThompsonPaul
          ThompsonPaul
          0
          6
          53

        • Why is google still crawling my old website pages?
          Ian_Lewis
          Ian_Lewis
          0
          2
          193

        • Any second opinions as to why our organic search website traffic hasn't recovered from website rebrand (domain change, website redesign)?
          nick49
          nick49
          0
          10
          212

        • New Website
          ThomasHarvey
          ThomasHarvey
          0
          2
          104

        • Spanish website indexed in English, redirect to spanish or english version if i do a new website design?
          OlegKorneitchouk
          OlegKorneitchouk
          0
          2
          280

        • I've set up my own site which is still fairly new but I'm a bit concerned that there is a bloackage SEO wise somewhere because when I try to crawl the site on SEOmoz it only crawls one page.
          JoshED
          JoshED
          0
          7
          219

        • Does disabling the "View Source" functionality prevent Google from crawling a website?
          irvingw
          irvingw
          0
          3
          423

        • Google Penalizing Websites that Have Contact Forms at Top of Website Page?
          JustDucky
          JustDucky
          1
          6
          628

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy