The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Web Design
    4. Website not crawling

    Website not crawling

    Web Design
    2 2 45
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • PrimeMediaConsulting
      PrimeMediaConsulting last edited by

      This post is deleted!
      1 Reply Last reply Reply Quote 0
      • RuthBurrReedy
        RuthBurrReedy last edited by

        Hi,

        Can I ask what leads you to believe search engines aren't crawling/indexing the site? When I search site:www.bugsanonymousil.com in Google, I'm seeing 62 pages from the site showing up in the index.

        One BIG problem with the site, though, is it looks like when someone requests an estimate, a webpage is generated for them - and these pages are being indexed with customers' names, addresses, email, and phone numbers. You should definitely remove those URLs from the index in Google Search Console, and update the site so that those pages aren't crawlable/indexable.

        1 Reply Last reply Reply Quote 1
        • 1 / 1
        • First post
          Last post
        • I'm doing a crawl analysis for a website and finding all these duplicate URLs with "null" being added to them and have no clue what could be causing this.
          seanginnaw
          seanginnaw
          0
          2
          27

        • Any second opinions as to why our organic search website traffic hasn't recovered from website rebrand (domain change, website redesign)?
          nick49
          nick49
          0
          10
          212

        • Spanish website indexed in English, redirect to spanish or english version if i do a new website design?
          OlegKorneitchouk
          OlegKorneitchouk
          0
          2
          280

        • Parallax Websites
          evolvingSEO
          evolvingSEO
          0
          5
          123

        • Google Penalizing Websites that Have Contact Forms at Top of Website Page?
          JustDucky
          JustDucky
          1
          6
          628

        • Website platform
          KnutDSvendsen
          KnutDSvendsen
          0
          5
          572

        • Recommendations for our website
          speedracersydney
          speedracersydney
          0
          3
          603

        • How to work with US Website and UK Website?
          SteveOllington
          SteveOllington
          0
          2
          690

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy