Questions
-
Crawl Diagnostics - unexpected results
Hi Nordichouse, Sorry it took awhile for me to get back to you on this. I agree with the SEOmoz techs, it doesn't matter if it is a crawler or a actual person, if you go to an invalid url you should be redirected as 301 to the actual page. If the product doesn't exist it should not allow for superfluous urls. So basically what you should have is if the product exist then the site redirects to the correct URL. If it doesn't exist then send any query for that product to the same page and display the oscommerce product not found message. By doing this you prevent the system from creating upteenthousand urls for each product. If you want to test what I mean you can visit our store a www.rubberstore.com/catalog and try a few urls like: catalog/nipple-clips-p-1000.html we don't have a product with the id of 1000 so you'll get redirected to the not found message and the root page -p-1000.html however if you try: catalog/a-fake-url-p-29.html you'll get redirected to our actual product page matching this product id. Hope that makes since. All this is done with the .htaccess url re-writter I posted above.
Moz Pro | | donford0