Welcome to the Q&A Forum

Exactly Matt , thanks for detailing on this.

Like Brad said, just try to retain the URL structures as much as possible unless you are really aiming to make it more seo friendly. Do the migration quickly and make sure to minimise broken pages. It'll usually affect your rankings, but you'll recover. Just do cleanup quickly and have your linking plan ready

Thanks Sheldon ! fingers crossed some one answers with more coding knowledge , I've not be able to find much info on goggle

Neat tool. I granted access with a site that was affected by these updates. Seem to correlate well, but not perfectly. Great find!

After diving deeper, it looks like it is a matter of breadcrumbs and other types of navigation. Here is an example of how different pages are linking to /Mens_Bags-600/: /Electric_Goggles_and_Electric_Sunglasses~65 links once via the top navigation /Surfdome_Mens_Bags-600/132 links twice via the top navigation and the breadcrumb /Bags-372/ links three times via the top navigation, left navigation, and in as in-line text as MENS BAGS> As you can see, depending on the page, the linking structure can vary greatly on your site. I didn't dive extremely deep into your site, so there definitely could be other instances of other types of linking structures on different page layouts. This would definitely explain why some of your pages have MANY in links, while others don't. I hope this helps; otherwise, like I said, Screaming Frog can pinpoint exactly where your in links are coming from, which can help you figure out the entire linking structure of your site. Hope this helps. Mike

Thank you Peter, I got your ticket reply. That makes perfect sense, and as Dr. Peter pointed out on a different thread: http://www.seomoz.org/q/why-seomoz-bot-consider-these-as-duplicate-pages I was discussing this issue further, I was confused by your report. Thank you again for your help and I hope you will improve your report interface to avoid such confusion related issues in the future. Best, Fabrizio

Thank you, that was what I thought, but I needed someone else opinion to be sure that I wouldn't get penalized because of that. Thanks for the link also! I appreciated your help. Fabrizio

I am pretty sure the SEOmoz toolbar uses the same metrics as Open Site Explorer, which is only updated a few times per month. In any case, creating a new page means you are starting off with little or no authority PA:1; however, once you include 301 redirects to that page, internal linking structure, and links from external websites, that authority will grow. As for your other page being at the same Google position as before, that is good; however, that is not always the case. You are correct in stating that a 301 helps transfer the link juice from one page to another, but it is not a 1:1 transfer... which means that in some cases you could lose traction in your current Google position. All of that being said, it sounds like you have everything set up correctly with your 301 sending link juice and traffic from your old page to your new page. It will take a couple weeks (typically) for SEOmoz to update Open Site Explorer and the SEOmoz toolbar to reflect these changes. Also, it can take some time for Google to rank your new page accordingly, as it must built some trust and authority with Google. Hope this helps. Mike

it's normal for it to happen for sites that have overoptimised keywords. Your main keywords wont rank but the others will. It's one of those weird scenarios. Take a look at the page. Was you homepage ranking before or an inner page? If it's an inner page, then it makes things a whole lot easier. Then, check for your current "ranking" page (meaning, you are in the 50's or 100's range depending on your type of penalty) if it's a different page and keeps on changing to other pages, then you need to start cleaning up your links.

Hi Hermski, You're welcome! We did not have any warnings in GWT. No messages, nothing. So it's my humble opinion that it is valuable to check the detox tool regardless of whether or not there are warnings. I was pretty surprised at what I found there. Good luck and keep us posted!

Hi there, First of all, penalties are eventually passed along with redirects, so you won't do yourself any favors by setting up a new domain and redirecting the old site. Second, I highly highly doubt that categories are your problem here. It's far more likely that one of the following occurred: You lost some good, authoritative links Google devalued some of the links you had Penguin update Panda update Low-quality EMD update Take a look at the date that traffic dropped and see if it coincides with one of the updates we know about. It looks like the link profile could justify Penguin, but my guess would be Panda/EMD, both of which are referred to as "page quality' updates. If I'm right, you need to keep people from bouncing back to Google.

Hi Letty, That is also a great idea. I've already sent the client my recommendations. If they insist on doing it their way, then I will definitely suggest they split test the two pages, and go with the winner. Thanks!

Thanks for the responses. Much appreciated!

It seems you might be asking two different questions here, Larry. You ask which URLs are blocked by your robots file. You then answered your own question by listing the entries in your robots file which are the actual URLs that it is blocking. If in fact what you want to know is which pages exist on your website but are not currently indexed, that's a much bigger question and requires a lot more work to answer. There is no way Webmaster Tools can give you that answer, because if it was aware of the URL it would already be indexing it. HOWEVER! It is possible to do it if you are willing to do some of the work on your own to collect and manipulate data using several tools. Essentially, you have to do it in three steps: create a list of all the URLs that Google says are indexed. (This info comes from Google's SERPs.) then create a separate list of all of the URLs that actually exist on your website. (This must come from a 3rd-party tool you run against your site yourself.) From there, you will use Excel to subtract the indexed URLs from the known URLs, leaving a list of non-indexed URLS, which is what you asked for. I actually laid out this process step-by-step in response to an earlier question, so you can read the process there http://www.seomoz.org/q/how-to-determine-which-pages-are-not-indexed Is that what you were looking for? Paul

it's almost never a good idea to use Google UTM tagged URLs internally, Cyto. Doing so really screws up your analytics for a number of reasons. (not to mention triggering the warning you're seeing) if you need to track activity on internal links, the correct way to do it is with event tracking. In addition, often the In-Page Analytics section of the Content area in Google Analytics can be useful as well. Paul

Hi Tom, Thanks for the reply.  What do you mean by Social Signals? Andrew

just make sure your redirects are good. Fix those asap and make sure the site doesnt have any crawl issues. Check out your page speed since you just moved to a new platform. Get the onpage stuff done asap to start getting the traffic back

Ok thanks. Sam.

Thanks for this link & to break this MYTH that google accept that "first indexed is original"

my take from my experience: if you are already ranking for that key term, then you redirect it to a related topic, you'll rank on that spot within a week. lasting on that position is a different story especially if you stop linking. You can drop within a month or 3 months down the road or you can stay put for years. Not really something I can predict as it is a keyword to keyword, niche to niche basis.