Welcome to the Q&A Forum

Hey Ariel, Here's a couple lists of bots that some people are blocking - you should probably review your server data to see which bots are visiting you that you want to block: http://www.rhyolite.com/anti-spam/badbots.html http://searchenginewatch.com/robots.txt In addition to the moz resource Chris referenced, here are a couple more pages that might be useful for you: http://stackoverflow.com/questions/10793906/how-to-allow-known-web-crawlers-and-block-spammers-and-harmful-robots-from-scann http://www.distilled.net/u/robots-txt/ Good luck!

First thing would be to 301 redirect old to new so the new pages have the chance to rank. If you don't you might also run into keyword cannibalisation issues where both old and new try to rank for the same keywords. In Magento I believe if you disable the old category, it will also be removed the in sitemap.xml it generates for you. If you're generating the sitemap manually then yes definitely remove them from the sitemap after the redirects.

Hi, Sorry I'm late - I must have missed the notification on this one. I recommend against using any redirects that pass link equity so long as there's a manual penalty on the site. I have seen penalties transfer - usually Panda or Penguin will only be re-applied on the refresh, but if the signal is fairly strong or the penalty is manual the penalty can transfer within days. Sometimes the penalty doesn't transfer, and it's usually because either the content is significantly different from what was penalized (in which case the links just don't count) or because the new site has a bunch of good links to balance things out. If I were you, I'd keep marketing the new site, build some awareness, and avoid passing link equity until the old site is clean.

Typically the meta tagged elements won't display...but, that line in your code is NOT the one you want to show on the page anyway. It's just for the search engines to use to display in the search results. Your embedded object should show the thumbnail and allow you to play it.  Go very carefully through the <embed> code and look for every instance where a file is referred to:  the swf file (there should be TWO instances of this). It's also possible that your player needs to run some javascript as well and that's either not working or not included.

Also Mike, you may want to have a look a Ahrefs.com.  I have just checked it and there are alot more backlinks showing up you need to look at.  If you google for a coupon, you can get it half price, or just get a refund within 7 days.  It can be useful for these sort of situations, even though Moz does alot more analytics etc.

2-3 days isn't that bad IMHO. I'm sure you already created/submitted a sitemmap in webmaster tools, ping/RSS and you already shared the url to social media. As your site ages and you accrue more and more backlinks, these new pages will get indexed faster. Sounds like you are doing fine though!

One thing I have suspected, but not confirmed is that Google has multiple crawlers. It seems that they one that extracts structured data takes a lot longer than the regular one. I have about 20 clients who I have implemented structured product data and offer data with, it usually takes a month or so before it starts showing up.

I would imagine that Google is still crawling these unindexed pages. Personally, I have never used the disavow tool, but if they are particularly spammy looking sites you will lose nothing by dissavowing them.  Whats more, getting ridding of these spammy links may even benefit you if they are subject to penalties or are in a bad neighbourhood etc.

Googlebot don't come only from Mountain View... Said that I would hide those links behind Ajax: that way you avoid any risk; that way you don't evaporate Link Equity

I had similar question, but I found this discussion so won’t send my questions as a new one. My questions was that is it a SEO (link juice) problem when we did 301 redirects from http://www.example.com/folder to http://www.anotherdomain.com/folder/#rdr=oldsite We added the hash / parameter to get stats how many visits do we get from the old site now and in the future, and with the help of hash in url we can get this information from our analytics tool. After reading Mike’s answer, I believe I found my answer and understand that this is not a problem, but if anyone have other comments then please respond. Thanks!

Thanks again Devanur, same to you!

Hi Rich, Physically having the H2 above the H1 is fine. Like Schwaab and Chris say, you won't be penalized for it - it is more a matter of logical hierarchy on your page. I am guessing you are doing this because you don't have access to the CSS or do not want to modify the stylesheet and you like the look/design of a page with the H2 above the H1 - this is fine, just not best practice necessarily. Typically your page should be structured like: - most important - headline for the page - second most important - sub heading for sections, related to - third most important - headline for sections, related to etc... implementing - tags where correct semantically. You don't "need" to have an on every page if it doesn't make sense (for instance if one page was just a continued section or whatever). If you wanted, you could use the and not include the . Hope this helps. Mike

agree to that... rel="prev" & rel="next" will help

Access .htaccess via Cpanel > File Manager (select view hidden files) or use and FTP program. Don;t rely on yoast. Not everyone uses Wordpress or yoast. Also Yoast can break with wp updates.

I think this would be the same as adding the same backlink twice to a site. If so, Google will only give credit for one. I just noticed I am answering a question from 2011, but got here trying to answer a question of my own about backlinks. Hopefully, Marty has already figured this out, but I am fairly certain I am correct about the link juice passed. It only counts once.

OK, unsure at the moment. A colleague actually did the "disavow" file, my WMT is restricted to some extent. I'll get admin access and find out. Although we've not seen any messages in WMT, we have seen organic traffic drop significantly (70%-80%) and as our site is fairly new I would imagine Google doesn't give you the benefit of the doubt when 70k links suddenly point at your site. I suppose this will take a while to get back to this level again?

If your motive is to support the main site with backlinks, I suggest you take it off. Google even penalized this arrangement in 2009 I suppose. Regards

Hi, If there already is a canonical link then you can edit it using the layout update code I first mentioned. If you do not need to canonical to another page you can just leave it as it is (self referencing). As to if you want to do it or not, this really depends on how big of a problem it is for your search efforts and how many cats/products you will need to manually adjust. I would think that if you keep track of them in an excel and remember to check when you are updating that with a couple of hundred categories/products (of which only maybe a couple dozen or less might have to be manually edited?) then you should be able to manage it ok. Good luck!

Guys, Thanks for your valuable replies. I want 1 more suggestions from you. Should i give 301 redirection to Old IP to New IP.? It's good practice or not?

The higher up the better. Some times Google doesn't crawl the full page, but definitely starts from top to bottom.  The higher you can get the meat of the content, ie top links, keyword phrases, breadcrumbs, the better! Hope this helps