The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Why is my site not getting crawled by google?

    Why is my site not getting crawled by google?

    Intermediate & Advanced SEO
    4 4 162
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • en-gageinc
      en-gageinc last edited by

      Hi Moz Community,

      I have an escort directory website that is built out of ajax. We basically followed all the recommendations like implementing the escaped fragment code so Google would be able to see the content. Problem is whenever I submit my sitemap on Google webmastertool it always 700 had been submitted and only 12 static pages had been indexed. I did the site query and only a number of pages where indexed.

      Does it have anything to do with my site being on HTTPS and not on HTTP?

      My site is under HTTPS and all my content is ajax based.

      Thanks

      1 Reply Last reply Reply Quote 0
      • AlanMosley
        AlanMosley last edited by

        Why build it with Ajax, ajax is good for functionally that needs to load seamlessly but not good for content.
        Using escaped fragment seems to not work well as many are having problems getting indexed.

        Does your content have to be loaded via ajax? why not load it on the page? would be much simpler

        1 Reply Last reply Reply Quote 0
        • evolvingSEO
          evolvingSEO last edited by

          Hi There

          As Alan mentioned HTML is going to be a much more guaranteed way to get indexed. The HTTPS alone shouldn't be affecting anything. But do you have a different robots.txt for https and http? Is the https one blocking crawlers? Do you have the https version of the site registered in webmaster tools? When you go to crawl stats, how many pages does it show that they are crawling?

          -Dan

          1 Reply Last reply Reply Quote 0
          • DonnaDuncan
            DonnaDuncan last edited by

            Sean, What is the URL for your site?

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • Google Mobile site crawl returns poorer results on 100% responsive site
              WebQuest
              WebQuest
              0
              4
              37

            • Trying to get Google to stop indexing an old site!
              Martijn_Scheijbeler
              Martijn_Scheijbeler
              0
              6
              103

            • Will my site get google penguin slapped?
              Nigel_Carr
              Nigel_Carr
              0
              2
              73

            • In Google Search Results ....Is it a site link or what? How to get this?
              MikeRoberts
              MikeRoberts
              0
              4
              80

            • Start a new site to get out of Google penalties?
              TheDude
              TheDude
              0
              3
              190

            • My site shows 503 error to Google bot, but can see the site fine. Not indexing in Google. Help
              Everett
              Everett
              0
              3
              733

            • Google crawl errors & serps [adult site]
              Ramp
              Ramp
              0
              6
              799

            • Working out exactly how Google is crawling my site if I have loooots of pages
              wazza1985
              wazza1985
              0
              3
              875

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy