Crawl Errors when I have noindex in the meta tag?

[zspace]

Hello!

I have a page with name="robots" content="noindex, follow"> on it because it's just a form page with no SEO value, but Moz is still reporting it as a crawl error for not having a meta description.

Is there something I'm missing?  Or should I wait until the next Moz Crawl to see if it drops off?

[ChiarynMiranda]

Sorry for the confusion here!

Our crawler is pretty rudimentary, so we will crawl a page until we hit the "noindex, nofollow" tags in the source code and any information we have already collected about that page will be included in the crawl report. This means we report on very limited information about these pages, so the will show up under errors such as "missing meta description" or "duplicate content."

The best way to prevent our crawler from accessing a page in its entirety and removing it from the crawl reports all together would be to block our crawler, Rogerbot from accessing those pages using the robot.txt file for the site.

I apologize for the inconvenience this causes! Please let me know if I can help you with anything else.

[zspace]

Ok I understand.  Thank you for the response Chiaryn.  I will use our robots.txt to clear the pages in question from the crawl error report.

Sean