The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Web Design
    4. Website not crawling

    Website not crawling

    Web Design
    2 2 45
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • PrimeMediaConsulting
      PrimeMediaConsulting last edited by

      This post is deleted!
      1 Reply Last reply Reply Quote 0
      • RuthBurrReedy
        RuthBurrReedy last edited by

        Hi,

        Can I ask what leads you to believe search engines aren't crawling/indexing the site? When I search site:www.bugsanonymousil.com in Google, I'm seeing 62 pages from the site showing up in the index.

        One BIG problem with the site, though, is it looks like when someone requests an estimate, a webpage is generated for them - and these pages are being indexed with customers' names, addresses, email, and phone numbers. You should definitely remove those URLs from the index in Google Search Console, and update the site so that those pages aren't crawlable/indexable.

        1 Reply Last reply Reply Quote 1
        • 1 / 1
        • First post
          Last post
        • Does redirecting the existing URLs in the website without reducing our current rankings? The new website runs on the bubble, so it seems there is no provisions to redirect the existing URLs to this platform?
          0
          1
          51

        • I'm doing a crawl analysis for a website and finding all these duplicate URLs with "null" being added to them and have no clue what could be causing this.
          seanginnaw
          seanginnaw
          0
          2
          27

        • Website usability
          Smileworks_Liverpool
          Smileworks_Liverpool
          0
          5
          66

        • Why is google still crawling my old website pages?
          Ian_Lewis
          Ian_Lewis
          0
          2
          193

        • New Website
          ThomasHarvey
          ThomasHarvey
          0
          2
          104

        • Spanish website indexed in English, redirect to spanish or english version if i do a new website design?
          OlegKorneitchouk
          OlegKorneitchouk
          0
          2
          280

        • Parallax Websites
          evolvingSEO
          evolvingSEO
          0
          5
          123

        • I've set up my own site which is still fairly new but I'm a bit concerned that there is a bloackage SEO wise somewhere because when I try to crawl the site on SEOmoz it only crawls one page.
          JoshED
          JoshED
          0
          7
          219

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy