Welcome to the Q&A Forum

Happy Index Release Day!

For the second month in a row, our hard-working, supremely dedicated Big Data team has delivered our Index Update EARLY! Beyond being punctual, the May Index is one of our most comprehensive and largest update of the year for Moz.

Let’s dig into the details:

• 162,225,495,455 (162 billion) URLs.

• 1,135,327,420 (1.1 billion) subdomains.

• 194,346,505 (194 million) root domains.

• 1,168,465,575,815 (1.1 Trillion) links.

• Followed vs nofollowed links

• 2.84% of all links found were nofollowed

• 65.80% of nofollowed links are internal

• 34.20% are external

• Rel canonical: 28.89% of all pages employ the rel=canonical tag

• The average page has 92 links on it

• 76 internal links on average.

• 16 external links on average..

Go have fun with your new data!

PS - For any questions about DA/PA fluctuations (or non-fluctuations) check out this Q&A thread from Rand: https://moz.com/community/q/da-pa-fluctuations-how-to-interpret-apply-understand-these-ml-based-scores

Hey There,

Unfortunately Keywords Data is not available via the Mozscape API. The Mozscape API houses the data from our Index, which is centered around Links Data and our Metrics derived from that data (Domain Authority, Page Authority, MozRank, etc). We do have a Keywords API that is not yet up on our website, however there is no Free Access for it at this time.

If you have any other questions about the Mozscape or Keywords API, feel free to reach out to me at IanW@Moz.com.

Cheers!

Ian Watson - Moz APIs

Don’t adjust your monitors, or think this is an elaborate April Fool’s joke, we are actually releasing our April Index Update EARLY! We had planned to release our April Index Update on the 6th, but processing went incredibly smoothly and left us the ability to get it up today.

Let’s dig into the details of the April Index Release:

• 138,919,156,028 (139 billion) URLs.

• 746,834,537 (747 million) subdomains.

• 190,170,132 (190 million) root domains.

• 1,116,945,451,603 (1.1 Trillion) links.

• Followed vs nofollowed links

• 3.02% of all links found were nofollowed

• 61.79% of nofollowed links are internal

• 38.21% are external

• Rel canonical: 28.14% of all pages employ the rel=canonical tag

• The average page has 90 links on it

• 73 internal links on average.

• 17 external links on average.

Don’t let me hold you up, go dive into the data!

PS - For any questions about DA/PA fluctuations (or non-fluctuations) check out this Q&A thread from Rand:https://moz.com/community/q/da-pa-fluctuations-how-to-interpret-apply-understand-these-ml-based-scores

Hey There,

Happy to help answer your questions regarding our API. Our Free API Access will not lead to any charges unless you reach out to us and ask for additional rows to be added to your account. So there should be zero surprise charges from the API product.

What happens when I get near my usage limit? - Usage can be monitored here - https://moz.com/products/mozscape/usage
What happens when I just hit the limit? Once you pull 25k rows for the month, your account will be suspended until the following month. 
**What happens when I past the limit? **Unless you reach out and ask for additional rows, your account will be suspended until the following month, where you will get another 25k rows to use.

Let me know if you have any other questions about the API.

Ian W.

We are excited to announce that our March 2^nd Index Update is complete and it is looking great! We grew the number of subdomains and root domains indexed, and our correlations are looking solid across the board. Run, don’t walk, to your nearest computer and check out the sweet new data!

Here is a look at the finer details:

• 141,626,596,068 (141 billion) URLs

• 1,685,594,701 (1 billion) subdomains

• 193,444,117 (193 million) root domains

• 1,124,641,982,250 (1.1 Trillion) links

• Followed vs nofollowed links

• 3.09% of all links found were nofollowed

• 62.41% of nofollowed links are internal

• 37.59% are external

• Rel canonical: 27.46% of all pages employ the rel=canonical tag

• The average page has 92 links on it

• 74 internal links on average

• 18 external links on average

Thanks again!

PS - For any questions about DA/PA fluctuations (or non-fluctuations) check out this Q&A thread from Rand:https://moz.com/community/q/da-pa-fluctuations-how-to-interpret-apply-understand-these-ml-based-scores

With the changes coming to our Free Mozscape access, and many of you asking for a lower priced API tier, we will now be offering an Entry Level plan. This plan will be priced at $250 per month for 120,000 rows of data, and $20 per 10,000 rows of overage. Here are some more details:

Entry Level Mozscape API Access
$250 - Per month
Overages:
$20 per additional 10,000 rows
Included Calls:
URL Metrics
Links
Top Pages
Anchor Text
Rows per Month:
120,000
Rate Limit:
200 requests per second

The new Entry Level plan is not yet up on our Pricing Page, however if you are interested, reach out to me directly and I can help you get set up.

Ian Watson - IanW@Moz.com

Hey Mathias,

That is an odd one. Have you double checked that your code is still working as it should? I now you mentioned you have not touched the code, but bugs can seemingly arise out of nowhere. There is also a chance that the sites you are requesting data on have not yet been crawled and do currently rank as 0s. Would you mind sharing a URL that returns that data? Feel free to email me directly - IanW@moz.com

Cheers!

Ian

Hey Dmitrii,

We actually are in the process of getting our Keywords API out into the wild. Reach out directly if you would like to know more or give it a test run.

IanW@Moz.com

• Ian

With a new year brings new challenges. Unfortunately for all of us, one of those challenges manifested itself as a hardware issue within one of the Mozscape disc drives. Our team’s attempts to recover the data from the faulty drive only lead to finding corrupted files within the Index. Due to this issue we had to push the January Mozscape Index release date back to the 29^th.

This is not at all how we anticipated starting 2016, however hardware failures like this are an occasional reality and are also not something we see being a repeated hurdle moving forward. Our Big Data team has the new index processing and everything is looking great for the January 29^th update.

We never enjoy delivering bad news to our faithful community and are doing everything in our power to lessen these occurrences. Reach out with any questions or concerns.

Happy to announce to you all that our new Mozscape Index is fully live. We were so excited to beat our target date two months in a row and deliver the update early. Unfortunately, we ran into some minor crawl hang-ups towards the end and a now-identified upload issue -- that being said we are still very pleased with this most recent index, albeit being a day or so late.

The December release has nearly 181 billion URLs, 5.5 billion subdomains and just over 1.25 trillion links*. Best of all, the crawl issues of previous months appear to be a dust in the wind and we are looking solid as ever on the backend.

We hope the work we are doing helps better reflect the hard work you all are putting in to grow your clients and your own websites. Looking forward to another successful release a month from now!

Happy Holidays!

*More in-depth details on the index can be found here: December 15, 2015 Index Update

**If you have seen any  Domain Authority and Page Authority drops since the index release, please see Rand's post on DA/PA fluctuation for more

Hey There,

The new index went up last night, so you should start seeing some changes to your metrics. Sorry for any inconvenience here!

• Ian W.

Hey John,

I recently wrote a post for Moz/Blog that goes more in depth on integrating our data into reporting dashboards (the post focuses on Klipfolio, a Tableau alternative). Your best bet would be to integrate our Mozscape API with Tableau on the backend. Tableau doesn't have a stable of easy integrations,  however they do make API integration possible with their Web Data Collector tool.

Hope this helped! Reach out with any Moz API questions - IanW@moz.com

• Ian

Hey There,

Currently the only way to know when you have reached your row limit is to monitor the API Dashboard - https://moz.com/products/mozscape/usage . You would then want to cease from pulling more rows for that month, or risk overage charges of $10.00 per 10k rows. Let me know if there are any other questions on this. I am the API Account Manager, so feel free to reach out directly - IanW@Moz.com

Cheers!

Ian

Hey There,

Sorry this wasn't called out, but the number of links in this index is quite a bit lower than our previous releases, due to some of the technical issues Rand calls out here and in the September post (https://moz.com/community/q/september-s-mozscape-update-broke-we-re-building-a-new-index). The next release will remedy the issues you are currently seeing, as we have identified and fixed the bugs that caused the issues. Sorry again for any confusion here.