Subfolder ranks worse than the rest of the site

[karasd]

I have been treating them as separate entities. I've focused on testing the blog, and fixed everything I could find - it had no effect. I've voraciously pursued scrapers with takedown orders etc, it had no effect.

I'm reaching out now, because I'm out of ideas, done everything I could, and nothing has worked. We are considering abandoning SEO entirely because there seems to be nothing we can do to get our rank to improve. I'm hoping someone in here can help me figure out what the problem is before we abandon ship

[MonicaOConnor]

I think that it could just be that the key terms are extremely competitive. I would advise actually having someone take a look at the site in depth. Anything someone says without actually seeing the site is just speculation and maybes. I'm sorry I can't be more help!

[evolvingSEO]

Hi - this was an interesting one! But I think I have found some of the issues.

1. I'd really let Google crawl the categories. They are currently blocked from crawling in robots.txt - http://www.lifeionizers.com/robots.txt - this is an issue because I suspected part of the problem may be due to crawl efficiency. One reason I say this, is because Google has yet to index a blog post from about 2-3 days ago.
2. This is a small thing, but link to the 200 OK version of the blog from your main menu. Right now, it links to /blog but then redirects to /blog/ with the trailing slash. Any little bit friction you can reduce the better.
3. Because you have a lot of things in that robots.txt file - I would definitely perform some fetch and render tests in webmaster tools. Here's the thing, Google has said if you block CSS or JS from being crawled it will harm your sites ranking - so definitely do fetch and render and make sure that's not the case.
4. The order of "Recent Articles" in the main content area in the blog homepage: http://www.lifeionizers.com/blog/ - don't seem to be "recent" at all. At least they are not in chronological order. This is confusing for me (and others users probably) so likely very confusing for Google. Most would expect the /blog/ homepage to list the most recent posts by published date. Especially since it is labled "recent". If these are supposed to be maybe "popular" I would label it as such.
5. Lastly, with this much old content I would do a thorough content audit (directions here or here) of your blog. You should prune old, poor, outdated, low-traffic content just like you'd prune a plant - this will certainly help user metrics signals and keep your indexed:trafficked ratio healthy!

Those are just some of the immediate things I saw. I'd start there.

[evolvingSEO]

I just want to add for record, one thing that was really interesting. That is this page: http://www.lifeionizers.com/blog/health-more/benefits-alkaline-water-hair-loss

Was cached in Google but not indexed - which is odd. And to me a sign that Google is not crawling and processing the blog correctly. I've attached screenshots since they may very well index the page shortly.

Cache - http://screencast.com/t/cZcGbIHb

Site: search not indexed - http://screencast.com/t/IJQbyMhd

[karasd]

We recently deleted that page. It was ranked at ~1000 in SERPs, so that indicated to us that Google had a major problem with it. Since we couldn't figure it out, we got rid of the page.

[evolvingSEO]

Do you reactivate it? It's still live:

http://www.lifeionizers.com/blog/health-more/benefits-alkaline-water-hair-loss

[karasd]

My mistake, we deleted a page with a similar URL. That page was published on Dec 9th. Three days is not an uncommon lag for Google to index a new blog post. WMT shows that we are only indexed to the 7th of December. Google appears to re-index our site once per week:

Lastest index 12/7

Previous index 11/30

Previous index 11/23

Is this unusual? And thanks for your help! This has been a very frustrating problem!

[evolvingSEO]

Hi - I wouldn't focus too much on that - I would take the suggestions made in my first answer and start with those! You really don't want to block crawling of categories!

[karasd]

I've unblocked the categories in Wordpress. Let's keep our fingers crossed!

[karasd]

You were right about the Fetch and Render. I found tons of scripts and images that were blocked. We're unblocking them all. I'm still working on your other suggestions, we do have a lot of old content. My plan is to leave all the evergreen content, and purge everything else

[evolvingSEO]

Great! So glad it's helped so far, please keep us updated

[karasd]

Got to work on those blocked scripts. It turns out they are all outside resources:

• Hubspot
• Zopim Live Chat

According to Google, if outside resources are blocked, you have to contact the vendor about unblocking them. I contacted both Hubspot and Zopim, they will get back to us in about 2 days. Thankfully, we didn't have any of our scripts/CSS blocked.

I'm also working on that redirect. It turns out that if I shut it down, and redirect to the 200 OK page, that the blog will then render search result pages that will be indexed. That will give us a massive duplication problem. Its because of this that we did the redirect in the first place.

We're considering getting a Wordpress pro to come in and fix it right. Any suggestions?

[evolvingSEO]

I would definitely check out the list on Clarity: https://clarity.fm/browse/technology/wordpress - and for developers it's often best to look in your own network - so I'd ask friends / colleagues for referrals, or you can search your LinkedIn connections as well.

[karasd]

UPDATE: Organic traffic to the blog has doubled in the last few days. It started going up about 4 days after I unblocked the categories from being crawled. I'm not certain that it's all Google organic traffic, but it sure looks encouraging since the blog hasn't responded to any SEO fixes for nearly two years!

[evolvingSEO]

Awesome! Thanks for the update.