The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. API
    4. 10/14 Mozscape Index Update Details

    10/14 Mozscape Index Update Details

    API
    19 9 995
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • DonnaDuncan
      DonnaDuncan last edited by

      Before I comment, I want to say I am a loyal member of and contributor to the Moz community. In my opinion, it's unprecedented in it's openness, honesty and willingness to help others.

      But I also want to express frustration cause I think I'm probably not alone in feeling it. While I understand and appreciate there are issues and Moz is doing everything it possibly can to address them, updates keep slipping and notifications are only given after the fact. We only know if there's going to be an update delay when the deadline passes and there's no change to API data.

      Remember Scotty on the original Star Trek series? Chief engineer Montgomery "Scotty" Scott had a reputation for being a miracle worker because he routinely padded his estimates. I see the next updated scheduled for November 14 and am worried.

      jennita randfish 2 Replies Last reply Reply Quote 2
      • jennita
        jennita @DonnaDuncan last edited by

        Hi Donna,

        I think it's fair to feel that way, it's definitely frustrating on all ends. While we do try hard to be as open and upfront as we can with information, we can most definitely work harder on getting it out sooner. I also very much appreciate the kind words about the community, and that you took the time to leave your thoughts. I'm sure many folks feel the same way. I'll let Rand (or others) jump in and respond as well, but I wanted to say thanks!

        Jen

        1 Reply Last reply Reply Quote 2
        • randfish
          randfish @DonnaDuncan last edited by

          Hi Donna - you are most certainly not alone in your frustration. I would call my own feelings bordering on  desperation. I'm frustrated, angry, nervous, guilty, and overwhelmed with a sense of powerlessness. It seems that every time we think we've identified a problem at the root of our Mozscape issues, things just get worse and new problems we never imagined arise.

          On the padding issue, I have good news and depressing news. The good news is that we pad every estimate by nearly 2X. In a normal, problem-free index cycle, we can get it done in 12-14 days.... And yet, we never estimate less than 30-31 days for an index release. In the early part of this year, you might recall that we had a number of indices released back to back in that 2-3 week window. Then things took a turn for the worse and we've been struggling ever since.

          I want to be honest - my belief is that we are going to get better, but the evidence of the last 6 months is against me. I want to believe my team and I know they are trying hard and doing everything they can to get this fixed. However, I think it's wise to have skepticism given the trajectory of the recent past.

          Hope that's helpful and thank you for the comment.

          1 Reply Last reply Reply Quote 3
          • JosephGourvenec
            JosephGourvenec last edited by

            Hi Team Moz,

            I have a lot of respect for Team Moz and all the efforts behind the senses you must do to deliver a what has been a great service.

            The only issue I have now, is that I've paid for two months subscription and still nothing new to report to my clients and it is:

            1, Making me look foolish "like i have the wrong provider" 
            2. You look not so credible "because I tell clients where we get our data from and explained last month, the last time an index update didn't happen in full was years ago"
            3. Me out of pocket 
                a. From subscription 
                b. Staffing for data analysts to ensure we maximise the new data gained from Moz each "4 to 6 weeks" update.

            At the end of the day we pay a fee for the data in OSE expecting a reasonable level information to be delivered for the fee we pay.

            Rand sometimes honesty is good but "Then things took a turn for the worse and we've been struggling ever since." and your other comments isn't filling me with confidence that the next OSE release is going to be an improvement on the last.

            As much as I respect you, the Moz team, the service, historic data, past efforts and overall community. I pay my subscription for credible, relevant and up to data data from OSE to support my digital activities and strategies which I've not received for the last two months.

            I'm sure things will improve because up is the only way from here I feel and it needs to be too, you can't expect customers to continue to pay for the core service Moz is known for and offer; that the SEO community rely on to perform and deliver on their client expectations.

            I purposely don't use other suppliers for this type of data from starting out in SEO to this day running my own company, because I feel a certain amount of loyalty to Moz just as Donna does and the rest of the community most likely do. But there does become a point when options need to be revised.

            I hope this message hasn't come across in a disrespectful manner to you or the team at Moz, I just want the best data and to deliver on the expectations I have set my clients; based on that I tell them we only use the best data provider and market leader in the world which is your company.

            I look forward to seeing an improvement on the next update.

            Cheers,
            Joseph

            randfish 1 Reply Last reply Reply Quote 1
            • randfish
              randfish @JosephGourvenec last edited by

              Hi Joseph - you'll get no arguments from me on any of these fronts. I think if you've been using Moz exclusively or primarily for the link data component, you should request a refund by emailing help@moz.com (they'll be happy to provide one). Totally concur that our service the past 60 days on the link data front has not been acceptable.

              1 Reply Last reply Reply Quote 1
              • MFCommunications
                MFCommunications last edited by

                Hi Rand

                Firstly I have considered MOZ to be the best SEO information gathering tool of its kind for some years now; and whenever I have taken on a new client or role have recommended to those companies not already using it, to set up an account with MOZ.

                I started a new digital marketing role in July which comes with six month KPIs.  I've been given a budget to improve SERPs & external inbound links; and right now I'm feeling pretty frustrated and embarrassed as, similar to Joseph I feel the lack of quality data from MOZ over the past few months has left me with egg on my face and having to prove my worth.

                I need the next index, which is suggested to be 14 November, to feel me with confidence and my reports with valid data or I will be forced to look elsewhere.  I hope it doesn't come to that.

                randfish 1 Reply Last reply Reply Quote 0
                • RobertFisher
                  RobertFisher last edited by

                  I have read the comments and the frustrations associated with the recent issues and would like to suggest that with any software such as this there will be glitches from time to time. We currently use roughly 30 to 40 SaaS providers of many different types and I cannot think of one that hasn't had an issue at one time or another. Having been with Moz for over 5 years I will say that the issues are few and the response is always transparent with frequent updates. (I cannot say that for most other providers).

                  I would suggest to anyone who is doing client work that as soon as you can afford to have more than one service provider you do so. There are two basic reasons: if there is an issue you always have back up and second, you get the benefit of being able to compare data. Personally, I find this invaluable for client work. I do not feel disloyal to Moz, I just know that every piece of software has its own limitations.

                  Good luck to all with the current travails.

                  1 Reply Last reply Reply Quote 7
                  • randfish
                    randfish @MFCommunications last edited by

                    We are both in the same boat there. I, too, desperately need this next index to get us on track and provide excellent value. If not, I think we're going to lose a lot of customers, and I'm not sure people will trust us for a long time on link data.

                    You have my deep and sincere apologies for the frustration and professional challenge Moz has caused. We have an obligation to do better, and I damn sure hope the team is up to delivering on that obligation.

                    1 Reply Last reply Reply Quote 1
                    • NordicClick_Interactive
                      NordicClick_Interactive last edited by

                      Hi Rand,

                      We have noticed among many of our clients that there has been a drastic drop in inbound links since the update to the Mozscape index. Our DA/PA have stayed the same, but links have dropped approximatey 60-70% across the boards. We have looked into the issue by looking in Google Webmaster Tools and have found that we have quite a few more links than are showing up in Moz. Could you explain why this might be happening?

                      Thanks!

                      IanWatson randfish RandyMilanovic 3 Replies Last reply Reply Quote 0
                      • IanWatson
                        IanWatson @NordicClick_Interactive last edited by

                        Hey There,

                        Sorry this wasn't called out, but the number of links in this index is quite a bit lower than our previous releases, due to some of the technical issues Rand calls out here and in the September post (https://moz.com/community/q/september-s-mozscape-update-broke-we-re-building-a-new-index). The next release will remedy the issues you are currently seeing, as we have identified and fixed the bugs that caused the issues. Sorry again for any confusion here.

                        1 Reply Last reply Reply Quote 0
                        • randfish
                          randfish @NordicClick_Interactive last edited by

                          There are a variety of reasons that include:

                          1. This index is somewhat smaller in total links crawled and URLs included
                          2. We may have biased the crawlers towards sites/pages that are less likely to feature links from your site (this is particularly possible if the linking sites were on Chinese, Palau, or several other TLD extensions that we had previously over-indexed)
                          3. The links we previously crawled may have been on relatively low MozRank pages that this index didn't crawl b/c we found fewer links to them (and thus lower MozRank - we tend to crawl in roughly descending MozRank order across the web).

                          As noted, the next index should see better coverage, fresher data, and better metrics, too. Please let us know if the problem persists and maybe we can compare your WM Tools links vs. our index to see what could be happening. Thanks and apologies.

                          RandyMilanovic 1 Reply Last reply Reply Quote 0
                          • RandyMilanovic
                            RandyMilanovic @NordicClick_Interactive last edited by

                            This post is deleted!
                            1 Reply Last reply Reply Quote 0
                            • RandyMilanovic
                              RandyMilanovic @randfish last edited by

                              Rand, I've sent info and s/s to Kevin (at Moz) in an attempt to find some commonality between GSC, MOZ and HubSpot. 3rd party tools are showing more links that OSE, and are more in line with GSC. For example, Majestic shows 5x the linking domains that OSE does (on the root, not the www). Kevin points at this thread and cites the present OSE data. I'm trying to figure out why redirected/GWT 'moved' domains don't add up links, or even if they are supposed to? I suspect he's powerless. Who/what can I trust?

                              randfish 1 Reply Last reply Reply Quote 0
                              • randfish
                                randfish @RandyMilanovic last edited by

                                That doesn't surprise me - Majestic has a larger index than Moz (theirs is actually the largest among active 3rd party indices, then Ahrefs, then us).

                                https://moz.com/blog/big-data-big-problems-link-indexes-compared this is a pretty good resource comparing the strengths and weaknesses of the various indices, and https://builtvisible.com/comparing-link-data-tools/ is also a good, third-party review of the three. There are strengths and weaknesses to each, but if raw link coverage is your goal, I recommend Majestic.

                                1 Reply Last reply Reply Quote 1
                                • JosephGourvenec
                                  JosephGourvenec last edited by

                                  Hi Rand,

                                  I hope you're well and life is good.

                                  I was wondering if you can shed some light on the upcoming OSE update scheduled for the 17th of November.

                                  In an earlier post you said "The good news is that we pad every estimate by nearly 2X. In a normal, problem-free index cycle, we can get it done in 12-14 days."

                                  This would indicate you have potentially / already run an update and reviewing the data to ensure it it correct and relevant to the masses, before making a general release.

                                  Can you advise if the trial update has been run, a success or not, if not do you think you'll have the issue solved for the 17th of November 2015?

                                  I'm very eager to report back to my clients with credible insight using the data you provide.

                                  Cheers,
                                  Joseph Gourvenec

                                  jennita randfish 2 Replies Last reply Reply Quote 2
                                  • jennita
                                    jennita @JosephGourvenec last edited by

                                    Hi Joseph! I'm sure Rand will chime in as well, but I know our engineers are currently working on a write-up that explains the future of the index, plus some of the issues of the past. They're trying to get all the details in there, and hopefully we can get that published by early next week. What I know so far, is that they've fixed some issues and this index is looking much better. I'll let the engineers explain what that means though. 🙂

                                    1 Reply Last reply Reply Quote 1
                                    • randfish
                                      randfish @JosephGourvenec last edited by

                                      Hi Joseph - yes, I can answer that. We took ~14 days to process this latest index, which is very good news. However, we are having some trouble with the uploading process again - our technical operations team is working with the big data team to try and uncover the source of these problems. If we can get it fixed and working (in the past, the upload step took ~12 hours, now it's taking us 3-4 days), we should have much more regular index releases.

                                      Right now, we are feeling confident about Nov. 17th, and once we complete the upload we'll have a good picture about data quality and whether we might be able to release early (which we think is quite possible IF quality looks good and these upload issues get sorted).

                                      1 Reply Last reply Reply Quote 2
                                      • JosephGourvenec
                                        JosephGourvenec last edited by

                                        Thank you Jennita and Rand for your quick responses. 

                                        Great, lets keep our fingers crossed all goes well and I'm confident the Moz team can deliver it. 🙂

                                        We all take a ride on the ebb and flow roller coaster from time to time, its what makes us learn more and overcome challenges.

                                        Have a great day

                                        Cheers,
                                        Joseph

                                        1 Reply Last reply Reply Quote 0
                                        • 1 / 1
                                        • First post
                                          Last post
                                        • Mozscape API Updates (Non-updates!) - becoming a joke!
                                          randfish
                                          randfish
                                          2
                                          5
                                          762

                                        • /index.php causing a few issues
                                          ATP
                                          ATP
                                          0
                                          8
                                          180

                                        • March 2nd Mozscape Index Update is Live!
                                          Christy-Correll
                                          Christy-Correll
                                          7
                                          5
                                          586

                                        • Still not got any index update data.
                                          AndreaBiffle
                                          AndreaBiffle
                                          0
                                          3
                                          325

                                        • January’s Mozscape Index Release Date has Been Pushed Back to Jan. 29th
                                          AHC_SEO
                                          AHC_SEO
                                          2
                                          4
                                          422

                                        • Oct 14 2015 MOZScape update: none of DA are changed?
                                          DmitriiK
                                          DmitriiK
                                          2
                                          7
                                          348

                                        • August 3rd Mozscape Index Update (our largest index, but nearly a monthly late)
                                          Sticky
                                          Sticky
                                          8
                                          13
                                          1.6k

                                        • Lost many links and keyword ranks since moz index update
                                          jameskais
                                          jameskais
                                          0
                                          3
                                          413

                                        Get started with Moz Pro!

                                        Unlock the power of advanced SEO tools and data-driven insights.

                                        Start my free trial
                                        Products
                                        • Moz Pro
                                        • Moz Local
                                        • Moz API
                                        • Moz Data
                                        • STAT
                                        • Product Updates
                                        Moz Solutions
                                        • SMB Solutions
                                        • Agency Solutions
                                        • Enterprise Solutions
                                        • Digital Marketers
                                        Free SEO Tools
                                        • Domain Authority Checker
                                        • Link Explorer
                                        • Keyword Explorer
                                        • Competitive Research
                                        • Brand Authority Checker
                                        • Local Citation Checker
                                        • MozBar Extension
                                        • MozCast
                                        Resources
                                        • Blog
                                        • SEO Learning Center
                                        • Help Hub
                                        • Beginner's Guide to SEO
                                        • How-to Guides
                                        • Moz Academy
                                        • API Docs
                                        About Moz
                                        • About
                                        • Team
                                        • Careers
                                        • Contact
                                        Why Moz
                                        • Case Studies
                                        • Testimonials
                                        Get Involved
                                        • Become an Affiliate
                                        • MozCon
                                        • Webinars
                                        • Practical Marketer Series
                                        • MozPod
                                        Connect with us

                                        Contact the Help team

                                        Join our newsletter
                                        Moz logo
                                        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                                        • Accessibility
                                        • Terms of Use
                                        • Privacy