Sitemap issues 19 warnings

[edward-may]

This post is deleted!

[edward-may]

This post is deleted!

[Bob_van_Biezen]

Hi Justin,

Thanks for the screenshots. Dirk's suggestion about screaming frog should be really helpful. This should give you an insight in the true 404 errors that a bot can encounter while crawling through your internal site structure.

Based on what I see I think your main problem is the manual updated sitemap. Whenever you change a page, add a new one or mix up some categories those changes won't apply to your sitemap. This creates a 404 error while those pages aren't linked to from your website and (without a sitemap) wouldn't give any 404 error messages in Google Webmaster Tools.

I saw you were using SEO by Yoast already, I suggest using their sitemap functionality. That should resolve the problem and save you work in the future since there is no need to manually update your sitemap again.

Let me know if this works!

[DirkC]

Yep - you'll have to upload the file to the server first.

Bob's suggestion to generate the sitemap via the Yoast plugin is an excellent idea.

rgds

Dirk

[edward-may]

Hi Bob

Thanks alot for your response!

That makes a lot of sense.  We use Wordpress only for the blog, but the main site is custom built and doesn't have an yoast plugin.

So I'm not sure how that will work, when I create the site map with screaming frog do I need to include the blog pages in screaming frog if I'm using the yoast plugin?

Thanks again for your help!

[edward-may]

Thanks a lot Dirk, your help has been tremendous to my SEO efforts!!!

[Bob_van_Biezen]

Hi Justin,

In that case I would ask your developer to make the sitemap on the website update automatically (or generate a new one every day). And submit that link to webmaster tools. If he's a real genius he could add your blog pages from Wordpress to this sitemap aswell but I'm not sure if Wordpress has a hook for this.

Alternative options:

1. Let him make the automatically updated sitemap for the custom part of the website and use this combined with the sitemap from the yoast plugin. You can upload both separated in Google Webmaster Tools. Make sure both got their own URL. In this case it’s all automated and is just as good as the previous method.
2. Keep on updating your sitemap manually. Just make sure you don't use the yoast sitemap and include the blogposts in your sitemap from screaming frog since this would give double input. If you choose to refresh your sitemap manually I would disable the sitemap within the Yoast plugin and use the Screaming frog sitemap which should include your blog pages aswell.

Good luck and let me know if this works for you!

[edward-may]

Oh you are a genius yourself Bob Thanks for the great information!

I will look into this and let you know how I go, thanks a bunch you have really helped me move this along and weed out all the confusion!

[Bob_van_Biezen]

This post is deleted!

[Bob_van_Biezen]

Glad it was useful!