Welcome to the Q&A Forum
Browse the forum for helpful insights and fresh discussions about all things SEO.
All the links are in javascript - and Mozbot doesn't crawl javascript (Google does however). Try visiting your site with javascript disabled - all you see is a blank page.
There is a similar question herethat may be can help you finding a solution - try also this post on AJAX & crawlability
Hope this helps
Dirk
I guess it's related to the keyword + location. If you do a tooth whitening site:yoursite - the tooth whitening pages appear first - if you repeat the query with the location - the homepage gets the first result. You could try to add the location on the title / metadescription / H1 / url of the detailed pages - to make it more obvious that the page is not only about tooth whitening but about tooth whitening in your city.
Also check what is more popular - you mention teeth whitening as example - the article however talk about tooth whitening - Google knows it's similar - but I would go for the more popular term.
rgds,
Dirk
Hi,
1 Given the fairly small amount of url's the easiest way to check is to do a site:yourdomain.com & see which url is missing (normally you should see 23 results here).
2. Google works in mysterious ways - quite possible that the page in the other language is dropped next week, or just remains in the index
3. Probably Google decided that this particular page wasn't interesting enough or considered it a duplicate of another page of your site.
4. Improve the content on the pages is probably the best way to get pages in the index. Must say that most sites don't get to 100% index ratio of the url's in their sitemaps. It's quite possible that the page that is dropped is something like a 'contact us' or "disclaimer' page which has no value for search.
In general, the number of url's of the sitemap that are indexed is just giving an indication how good your site is indexed. Being in the index is just the first step, it's the ranking & especially the search traffic that count. For one url dropped I would not put too much effort in figuring out which one it is.
Hope this helps,
Dirk
Off course internal links would help. It would also help if you could enrich your content with data/content that Zillow is not providing. Video's could be indeed a good idea, floor plan, more info on the neighbourhood, schools, ...etc would be great.
As most people are not searching for individual homes, but rather for homes in a certain neighbourhood) - you could try to focus on enriching the content on these pages (if you check http://www.zillow.com/oxford-oh/ - it's not really rich in content - you could use your knowledge of this specific region to enrich your homepage. You already do this on your homepage - but it's very long, with few images and trying to tackle all kind of questions. Consider splitting this page in smaller chunks. You regional pages are better - but could still be enriched with more images, put links to other useful sources (schools,...), statistics about people who live there (average age, income,...). The video's you put are very static - and the one I checked had no sound. On your homepage you mention that Esplanade Ridge is the preferred area for alumni, parents of students - however on the detail page you mention nothing about this but rather a dry, almost technical description of the area.
Dirk
Here is an example of a mark-up for multiple currencies:
itemtype="http://schema.org/Offer">
itemtype="http://schema.org/Offer">
The example is coming from a reliable source
With this mark-up Google should be perfectly able to show the correct price in the SERP's, depending on the country of origin of the user.
Hope this helps,
Dirk
Hi,
Point 1 - you mix relative & absolute links in your source code. Example on your homepage - line 429 - you put which leads to https://compleetverkleed.nl/www.compleetverkleed.nl - I guess it's the same thing on these other pages.
[Point 2 - these sitemaps are probably generated by the Yoast SEO plugin - see https://compleetverkleed.nl/sitemap_index.xml You will have to check the configuration of the sitemap module of Yoast - it could also be related to this Bug https://github.com/Yoast/wordpress-seo/issues/2172
rgds,
Dirk](www.compleetverkleed.nl)
Your robots.txt renders in a browser - but from technical perspective it generates a 403: Forbidden (check http://www.cartronix.com/robots.txt with web-sniffer.net)
Moz will not crawl if your robots.txt is returning a 403 (see answer from Chiaryn Miranda / Moz on https://moz.com/community/q/without-robots-txt-no-crawling
Quote: "The only commands from the http responses that we consider to block our crawler from accessing a site would be a 403: Forbidden error or a 5xx error."
Dirk
Hi,
You can find a good checklist here: https://moz.com/blog/web-site-migration-guide-tips-for-seos and you can find a bunch of other useful links here: https://moz.com/blog/achieving-an-seo-friendly-domain-migration-the-infographic - the lists are for migration of domains, but big chunks are also valid if you are just changing design/url structure.
The process described in the first list is (more or less) the one I use for site and/or design migrations.
If your current homepage is currently your principal landing page - I would try to make sure that it's doesn't change to much in terms of content & links to other sections. Also make sure that you check the performance of your homepage (it's also mentioned in the migration checklist) - I prefer to use webpagetest.org rather than pingdom.com - also check the page with Google page speed analyser.
Hope this helps,
Dirk
It will not affect the normal search - most sites use stockphoto's, and you see the same pictures appearing on hundreds of sites.
For image search, these new sites will compete with the existing site. If you're current site looks like iStockphoto or similar, these new sites will probably outrank the existing one as the textual context of the images will be much richer than the standard tags you find on a typical stock photo site. This is not necessarily a bad thing, if you manage to get your potential customers to the main site to buy the images.
You could also consider to integrate the new content as a blog on the main domain. It's better to reinforce an existing domain with new interesting content, rather than to start different new smaller domains and this way you won't have any traffic cannibalisation.
Hope this helps,
Dirk
Could you share an actual url? Can you see in the crawl which pages are linking to these strange url's? You could try to replicate the crawl locally (with Screaming Frog) to see if the problem is replicated
Did you check your url rewriting? Maybe you're trying to clean your url structure & the parameter is translated the wrong way?
Dirk
Hi Darcy,
If you apply the strict definition of Google, you are "inserting text or keywords into a page only when the User-agent requesting the page is a search engine, not a human visitor" - even if you don't do it with the intention to trick search engines (the inserted text = text which is invisible for non-registered users).
Is there a way to show the same content to both bots & humans, and still keeping the page
It's difficult to guess the level of risk you're running - but once penalised, traffic drop is huge & recovery takes normally a long time (with no guarantee of full recovery)
rgds
Dirk
Hi,
There seem to be some technical issues with your site:
site speed - even though the webpagetest result is not that bad - every page I visited on your site seemed to load very slow (http://www.webpagetest.org/result/150423_8J_1E1E/). Screaming Frog indicate that 30% of your pages needs more than 3 sec's to load (and Screaming Frog is normally very soft in judging site speed)
Google insights for speed: again the score is not great but not really bad either - but if you see the number of blocking .js & .css files it's a bit terrifying (https://developers.google.com/speed/pagespeed/insights/?url=http%3A%2F%2Fchokeonajoke.com%2Fjokes%2Fbest-jokes%2Fgood-jokes%2F&tab=mobile)
most pages call a css file that doesn't exist: http://chokeonajoke.com/wp-content/plugins/all-sub-categories/catstyle.css?ver=4.1.2
on some pages example http://chokeonajoke.com/jokes/best-jokes/good-jokes/ (same for /jokes/death-humor) I was unable to load them in Chrome - in Firefox I got the message: non-responsive script: Script: http://chokeonajoke.com/wp-con…/jquery-2.1.3.min.js?ver=2.1.3:2\. Checking w3c validator indicates line 1627, Column 8: Stray start tag script. (http://validator.w3.org/check?uri=http%3A%2F%2Fchokeonajoke.com%2Fjokes%2Fdeath-humor%2F&charset=(detect+automatically)&doctype=Inline&group=0)
6% of your content is >10 clicks from the homepage
If I were you I'd hire a good css/html/js programmer & ask him to clean your code. For a rather simple site you seem to use an awful lot of javascript. Cleaning the code & working on performance will probably solve most of the problems. It can take sometime however before you regain your initial search traffic.
rgds,
Dirk
Even when the index is updated - it still no guarantee that your links are going to show up. The Moz index is huge - but still only 25% (or less) of the Google index.
Check https://moz.com/help/guides/research-tools/open-site-explorer -
"Just so you know, here's how we compile our index:
Other tools may have different approaches - this is why it's a good idea to combine different sources to get a better idea of which links you gained (ahrefs, semrush, moz,...and so on)
Dirk
Hi Pete,
No need to worry about the duplicate links - to quote Matt Cutts (https://www.youtube.com/watch?v=6ybpXU0ckKQ) - nothing to worry about (as long as it's not 5000 internal links with over optimised anchor)
266 links on the home is a lot - but not an amount of links that is surprisingly high for an average e-commerce site (especially with the duplicates). Regarding the number of links I would rather think about usability than SEO. If having this much links on the page is making it easier for your visitors to go through your site - keep them. If this number of links is making them confused - try to reorganise & regroup the links. A small user test with a few people not too familiar with your site can learn you a lot about the usability factor and how many people are actually using the links to navigate (vs just using the internal search function)
Hope this helps,
Dirk
If performance decreased dramatically between the old & the new site it can have a very strong impact on search results. You're in a competitive area, and most of the jokes published on your site also exist on other sites, so the content is not really unique. It's difficult to say post-launch if it is the only reason why your site dropped. I assume you redirected all the old pages to the new one & did a change of domain in WMT?
Did you see changes in google analytics (like increased bounce rate, lower time on page, ...) the moment you changed the site?
Page speed improved - but Time to first byte is still quite high. You might want to check out this article on how to optimise your WP site: http://www.webpagetest.org/forums/showthread.php?tid=13520
rgds,
Dirk
It's caused by the way you have build your site. If you click on redken.com - you get the choice of language. If you select "USA" you're redirected with 302 to redken.com/USA - then with 302 to redken.com/?country=USA then with 302 to redken.com I guess for browsers you store this somewhere (cookie?) - however for a simple bot (like Moz - but I have the same with Screaming Frog) - you just go back where you started = redken.com which again will start the same loop.
So - only 4 url's can be crawled. The other countries are on different url's so will not be included in the crawl.
Google bot is smarter and acts more like a real browser so will crawl the site - but Mozbot can't do that.
rgds
Dirk
Update - I actually forgot one redirect - redken.com first is redirected with 302 to redken.com/international
PS The site is horribly slow as well - and the redirect chain is certainly not helping.
Hi,
In the specific example you give it's doesn't really matter - as all the pages of the pagination have a canonical pointing to the homepage.
On top of that - the site indicates on every page that the alternate url for lang=es is the homepage as well.
If this is your site, I would correct this - make the canonical self referencing & do the same for the alternate url (or just drop the alternate url if the site is only available in Spanish)
To answer your question the link pointing to the next page is a plain html link: 2 so can be indexed by Google without major issues.
On endless scrolling & pagination with Ajax in general - there is an interesting article on Google Webmaster Central: http://googlewebmastercentral.blogspot.be/2014/02/infinite-scroll-search-friendly.html
rgds,
Dirk
Hi,
I did a site:www.greatcleanjokes.com/ and sampled a few of the url's - all of them seem to redirect to the appropriate page on the new site. To be sure - I tested a few of them with web-sniffer.org, and it returned a proper 301 status. The cached version of the results is also showing the version of the new site.
A site:chokeonajoke.com returned slightly more results (probably new content you added) - so on first sight not really an issue
To be honest - I don't think the problem is related to the redirect. You could double check - download the 1000 most popular pages from the old site & crawl these using Screaming Frog to see if the redirects are ok (you can do this in the free version - no need to buy the licence if you use list mode).
Did the number of pageviews/visit decrease or increase after migration. Longer time on page is normally a good sign, could also indicate however that people struggle to find the info they are looking for (which I doubt is the case on your site)
rgds,
Dirk
If you're talking about Moz Analytics: Moz crawls your site once/week - check here: https://moz.com/help/guides/moz-pro-overview/crawl-diagnostics:
'When you set up your campaign Roger Mozbot does a Starter Crawl of your site within two hours, crawling up to 250 pages. After that, he does a full crawl of your site (up to your page limit) and continues to do a full crawl once a week'
Dirk
Probably the easiest solution is to buy a licence from Screaming Frog & to crawl your site locally. The tool can do a lot of useful stuff to audit sites and will show you not only the full list of 4xx errors but also the pages that link to them.
There is also a free version but that allows you to crawl only 500 pages - which in your case is probably not sufficient but it would allow you to see how it works.
Hope this helps,
Dirk