How long does the Seomoz crawl cache last?

[Brian-H]

I set the seomoz bot on a crawl of the site yesterday andit identified several broken links and duplicate content.

I fixed them and wanted to make sure it was done correctly so I sent it on another crawl of the same domain. The same results came back so I presume the old pages were cached.

How long do I need to leave between each run?

[KeriMorgret]

We crawl once a week, but you can do a separate crawl of any site (up to 3000 URLs) at http://pro.seomoz.org/tools/crawl-test. That should help you check things between crawls.

[Brian-H]

Hi Keri,

It's the manual crawl that has given me old data. Do you know how long is the cache on the manual crawl?

[KeriMorgret]

Woops, so sorry that I misunderstood/misread. I'll assign this question to the help team and they should be responding to you tomorrow.

Keri

[Brian-H]

Thanks

[Brian-H]

Hi,

Is there an update to this? I'm trying to help eliminate duplicated on a development site before it goes live.

I did my first manual crawl Submitted 4:31pm GMTJan 22nd 2013 and the web developers acted on my recommendations and I need to run another crawl to see if anything still needs to be done. I just ran a crawl Submitted 9:01am GMTJan 24th 2013 and it came back with the same 103 pages of duplicate but a spot test shows that the duplicate doesn't exist anymore.

I don't want to have to do this 103 times so if someone can tell me how long the cache time is I can work out when to run the second test.

Thanks

[SamWeber]

Thanks for the question. I'm going to have to take a deeper look into this. I'll set up a support ticket with you as the requester and we can continue the conversation there. Just look for a message from help@seomoz.org.

Sam

[dweisburd]

Any updates on this issue?

[Brian-H]

Yes. Sam was able to confirm for me that the programmers have a 48 hour crawl cache so to repeat crawls with a 2 day delay to get fresh results.