The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. WEBMASTER console: increase in the number of URLs we were blocked from crawling due to authorization permission errors.

    WEBMASTER console: increase in the number of URLs we were blocked from crawling due to authorization permission errors.

    Technical SEO Issues
    21 3 835
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • odmsoft
      odmsoft @BlueprintMarketing last edited by

      Sure,

      Here it is http://www.davidandsonsjewelers.com/.

      Thank you!

      BlueprintMarketing 2 Replies Last reply Reply Quote 0
      • BlueprintMarketing
        BlueprintMarketing @odmsoft last edited by

        I will run the audit now sorry for the delay

        1 Reply Last reply Reply Quote 0
        • BlueprintMarketing
          BlueprintMarketing @odmsoft last edited by

          some of you are links are really not supposed to be there

          http://crawl.blueprintmarketing.com/report_grid/page/215533/all_pages/baf4035a9366e9c99559f1f51f42df1475a0c13f?tab=Internal Links Out

          Here is your report please use the URL below to navigate the entire report.

          All of you are URLs are relative to the most part that should be fixed. You have a Java redirect that definitely needs to be fixed.

          • http://crawl.blueprintmarketing.com/projects/reports/215533?ro=75ad0c6e4afacc428b553d449dfd281f82ec2ad6

          PDF & XML outline

          1. http://cl.ly/d6Sv/www.davidandsonsjewelers.com_http-www-davidandsonsjewelers-com-_13-09-2015_overview_215533.pdf
          2. http://cl.ly/d6S7/public-report_files-215533-www.davidandsonsjewelers.com_http-www-davidandsonsjewelers-com-_13-09-2015_overview_215533.xls

          https://varvy.com/

          You have roughly 108 indexed URLs according to Google

          https://marketing.grader.com/report/www.davidandsonsjewelers.com/overall

          you do not have an XML site map unfortunately I found that out in the first five minutes but you can also find out if these things using

          https://moz.com/researchtools/crawl-test

          upon a quick check with another tool I found

          http://i.imgur.com/Y60WnIc.png

          I love deepcrawl however your site is not large you can learn a lot about it with

          http://www.screamingfrog.co.uk/seo-spider/  free

          I hope this is a help, with analytics access and webmaster tool like this I cannot obviously give you a much better picture.

          Tom

          U6mS1O6.png fxGWwXI.png Y60WnIc.png

          1 Reply Last reply Reply Quote 0
          • BlueprintMarketing
            BlueprintMarketing last edited by

            and switch everything to WordPress

            view-source:http://www.davidandsonsjewelers.com/

            1 Reply Last reply Reply Quote 0
            • BlueprintMarketing
              BlueprintMarketing last edited by

              As you are showing certain URLs that are definitely Pharma hack  their are certain things Sucuri is unable to detect because of it being a front-end tool not the PHP tool that would be needed for the  two-part WordPress and PHP version of your site.

              Just type this into Google

              • ?page_name=Cheap+Viagra+Gold+Online&id=471
              • ?page_name=Cheapest+Viagra+Us+Licensed+Pharmacies&id=1603

              http://www.pearsonified.com/2010/04/wordpress-pharma-hack.php

              https://blog.sucuri.net/2010/07/understanding-and-cleaning-the-pharma-hack-on-wordpress.html

              https://sitecheck.sucuri.net/results/www.davidandsonsjewelers.com/articles/author/carole/

              https://majestic.com/reports/neighbourhood-checker?d=http%3A%2F%2Fwww.davidandsonsjewelers.com%2Farticles%2Fauthor%2Fcarole%2F&IndexDataSource=H

              https://www.virustotal.com/en/ip-address/216.120.237.225/information/

              http://dnsbl.inps.de/query.cgi?lang=en&ip=216.120.237.225&action=check&quick=0

              odmsoft 2 Replies Last reply Reply Quote 0
              • odmsoft
                odmsoft @BlueprintMarketing last edited by

                Hi Thomas,

                I really appreciate your help! Can you advise me what i should do? I see all these reports but i don't know how i need to clean the site.

                Thank you!

                BlueprintMarketing 1 Reply Last reply Reply Quote 0
                • odmsoft
                  odmsoft @BlueprintMarketing last edited by

                  Also, do you say that the mobile site is blocked? Also, how do you see that the site doesn't have XML? What tool shows you all this info?

                  Thanks

                  BlueprintMarketing 2 Replies Last reply Reply Quote 0
                  • BlueprintMarketing
                    BlueprintMarketing @odmsoft last edited by

                    If I were you I would look at my site structure make sure that it was built in a certain manner for the right reasons.

                    If your traffic is all right you really do not want to change the site that much. If you do change the site change it slowly.

                    ( A great example of this is how FireHost.com it is becoming Armor.com)

                    the tools I used to find out whether or not you had a site map primarily was deepcrawl.com

                    to detect mobile issues

                    https://varvy.com/mobile/ & https://varvy.com/tools/

                    See here: http://crawl.blueprintmarketing.com/projects/reports/215533?ro=75ad0c6e4afacc428b553d449dfd281f82ec2ad6

                    http://i.imgur.com/W7BDaq7.png

                    http://www.screamingfrog.co.uk/seo-spider/

                    http://i.imgur.com/LbCBmmW.png

                    I used screaming  frog to create a XML site map for you here

                    http://d.pr/f/15Ouy

                    I would definitely add an XML site map.

                    Sincerely,

                    Thomas

                    W7BDaq7.png LbCBmmW.png

                    1 Reply Last reply Reply Quote 0
                    • BlueprintMarketing
                      BlueprintMarketing @odmsoft last edited by

                      detect mobile issues

                      https://varvy.com/mobile/ & https://varvy.com/tools/

                      1 Reply Last reply Reply Quote 0
                      • BlueprintMarketing
                        BlueprintMarketing @odmsoft last edited by

                        No site map from checking multiple configurations of XML site maps and coming up with nothing no redirects either e.g. /sitemap_index.xml might exist separately or redirect to  /sitemap.xml

                        http://www.davidandsonsjewelers.com/sitemap.xml shows a 404

                        Tool's

                        deepcrawl.com https://varvy.com/mobile/ & https://varvy.com/tools/

                        http://i.imgur.com/fxGWwXI.png

                        fxGWwXI.png

                        odmsoft 1 Reply Last reply Reply Quote 0
                        • odmsoft
                          odmsoft @BlueprintMarketing last edited by

                          Hello Thomas,

                          I really appreciate your help! You said i can look at your site's structure. What is your site address?

                          Unfortunately, i still don't know what i need to do in order to remove those pharma hack from my site. If you know where to point me to get the answer, i'll be very grateful.

                          Also, what tool you used to generate this report http://crawl.blueprintmarketing.com/projects/reports/215533?ro=75ad0c6e4afacc428b553d449dfd281f82ec2ad6 ?

                          Also, what tool you used to create XML site map?

                          Thanks

                          BlueprintMarketing 1 Reply Last reply Reply Quote 0
                          • BlueprintMarketing
                            BlueprintMarketing @odmsoft last edited by

                            Hi

                            to removed  any chance of infection and I am not telling you that I am 100% sure it's  infected

                            You must be certain that the regional infection was removed. If it was not and you had links created by a third party other than yourself you are better off getting it completely cleaned

                            use Sucuri.net to remove any  chance of a hack.

                            Just type this into Google

                            • ?page_name=Cheap+Viagra+Gold+Online&id=471
                            • ?page_name=Cheapest+Viagra+Us+Licensed+Pharmacies&id=1603

                            http://www.pearsonified.com/2010/04/wordpress-pharma-hack.php

                            https://blog.sucuri.net/2010/07/understanding-and-cleaning-the-pharma-hack-on-wordpress.html

                            https://sitecheck.sucuri.net/results/www.davidandsonsjewelers.com/articles/author/carole/

                            i used  deepcrawl.com  to create the audit I you referenced.

                            &

                            Screaming frog SEO to create the site map

                            I hope that helps,

                            Tom

                            odmsoft 1 Reply Last reply Reply Quote 0
                            • odmsoft
                              odmsoft @BlueprintMarketing last edited by

                              Thank you Tom!

                              1 Reply Last reply Reply Quote 0
                              • 1
                              • 2
                              • 1 / 2
                              • First post
                                Last post
                              • Increase in Crawl Errors
                                abisti2
                                abisti2
                                0
                                5
                                80

                              • Where are the crawled URLS in webmaster tools coming from?
                                CleverPhD
                                CleverPhD
                                0
                                4
                                202

                              • Odd URL errors upon crawl
                                Matt1
                                Matt1
                                0
                                6
                                157

                              • Ajax Crawling | Blocked URLs Spike
                                smarties954
                                smarties954
                                0
                                2
                                163

                              • Webmaster tools...URL Errors
                                ChrisHolgate
                                ChrisHolgate
                                0
                                2
                                202

                              • Increase in authorization permission errors error after site switch
                                ebowdublin
                                ebowdublin
                                0
                                3
                                1.4k

                              • Google Webmaster Showing Crawl Errors to URLs that don't exist?
                                raylau
                                raylau
                                0
                                4
                                604

                              • How to remove crawl errors in google webmaster tools
                                Nick_Ker
                                Nick_Ker
                                0
                                2
                                925

                              Get started with Moz Pro!

                              Unlock the power of advanced SEO tools and data-driven insights.

                              Start my free trial
                              Products
                              • Moz Pro
                              • Moz Local
                              • Moz API
                              • Moz Data
                              • STAT
                              • Product Updates
                              Moz Solutions
                              • SMB Solutions
                              • Agency Solutions
                              • Enterprise Solutions
                              • Digital Marketers
                              Free SEO Tools
                              • Domain Authority Checker
                              • Link Explorer
                              • Keyword Explorer
                              • Competitive Research
                              • Brand Authority Checker
                              • Local Citation Checker
                              • MozBar Extension
                              • MozCast
                              Resources
                              • Blog
                              • SEO Learning Center
                              • Help Hub
                              • Beginner's Guide to SEO
                              • How-to Guides
                              • Moz Academy
                              • API Docs
                              About Moz
                              • About
                              • Team
                              • Careers
                              • Contact
                              Why Moz
                              • Case Studies
                              • Testimonials
                              Get Involved
                              • Become an Affiliate
                              • MozCon
                              • Webinars
                              • Practical Marketer Series
                              • MozPod
                              Connect with us

                              Contact the Help team

                              Moz logo
                              © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                              • Accessibility
                              • Terms of Use
                              • Privacy