Blocked by meta-robots

[panda32]

This post is deleted!

[donford]

Hi Panda,

You have 2 folders that are blocked by your robots.txt file. Those are wp-admin and wp-includes if your site links to any pages inside these folders the bots are being told to not crawl them. This is perfectly acceptable provided there is not pages in those folders that should be crawled. The "blocked by meta-robots" is a warning and not an error. You should know about it, but only worry if pages in these directories need to be crawled.

Your robots.txt file is located at http://www.hostmansaving.com/robots.txt
Google on robots.txt

Additional pages can have a meta tag called robots that can block pages on a individual basis. This tag acts just like an entry in the robots.txt file.

Hope that helps

[panda32]

Hi, thanks for that.

I also have another issue, i have a few pages where the page title in the url is to long. over 70

Whats the best thing to do with this? do i just shorten the url and make sure the internel links are changed on the site. internal linking etc

Or do i setup a 301 redirect ?

[donford]

HI again Panda,

Long URL and Long Title are 2 different issues. I think you're referring to the long title since you mentioned 70.

Over 70 characters is again another warning. What that is advising you of is anything over 70 characters gets cut off which can leave for unattended titles.

Like

How can you get hats, shoes, dresses, belts for the character doll assassin's creed 3

Gets cut off to..

How can you get hats, shoes, dresses, belts for the character doll ass

You simply need to review the title and reword as needed.

If you have long urls, that again is just a warning, just look at your url if they make sense as they are there is no harm, ideally a url is descriptive and precise. Today most sites run on some sort of CMS (Joomla, WP, OSC, Magento) which create the urls for you. Just make sure you use any tools available to you to make the urls as attractive as possible.

Hope that helps.

[panda32]

Thanks doford again for your answer, yes that makes sense.

I wonder if i can pick your brains on this.

I did make another post here on this..

http://www.seomoz.org/q/weird-404-error

you can remove mywebsite.com and replace it with mine if that helps?

Regards

[panda32]

Thanks doford again for your answer, yes that makes sense.

I wonder if i can pick your brains on this.

I did make another post here on this..

http://www.seomoz.org/q/weird-404-error

you can remove mywebsite.com and replace it with mine if that helps?

Regards