Welcome to the Q&A Forum

Hi Thompson, Thanks for your input, so I'm planning on eventually do the 301 for everyone. I'm re-designing  a big website and not everything is done, but I want users that are looking for the content that I already completed to land in the new site. (because the new site has a much higher conversion rate). In other hand I have 30% of my traffic in my old site coming from direct visitors, I dont want those visitors to be send to other URL because it would be confusing. however I want people coming from google to go my new site... Do you think I should sacrifice usability, so I don't risk Google to think I'm trying to do some kind of black hat, strategy.

Thank you EGOL and Chris Menke. Very helpful. Much appreciated.

hmmm.... Thanks for your inputs...

We've found the solution. We needed make each meta title unique, so we added the country dynamicall to each meta title.

I would just use cross domain canonical and look into the other issues with your website that have triggered Panda.

Been indeed working on this almost all day hehe. I found that I set a redirect for /bankstellen to /bankstellen.html which caused all the links to become /bankstellen.html/u or whatever it should be. What I did not find is what you just mentioned here above. Thanks for the answer, will for sure look into this!

There are sites that Google visits way more often than that. For example, you'll see Q&A questions on Moz indexed within minutes.

Awesome, any thoughts on what I can check or do to see if there are any other potential issues with Google.  I'm a bit concerned that there is a penalty on this site. -jack

Awesome! Thank you so much for your help. You rock!

Thanks for the good advice, Jesse!

Thank you, Mr. Young.  I believed this to be the case (that it wasn't the robots.txt file) but I could think of nothing else.  I have since been indexed.

Yes, this is what I was thinking. I guess I'll just let the old WMT account for product.com just deactivate itself once it notices that validation file is no longer there.... Just feels a bit weird "not telling Google what we've done" through WMT....

I tend to follow the rule of thumb that states, if you have a close match to a page being removed, then setup a 301 there. If not, it is better to remove it altogether and give it a 410 (Gone) rather than a 404 (Not Found). I hope that helps a little. -Andy

Thanks Bill for you reply. We have people actually doing research to make sure we're only presenting pertinent suggestions to entrepreneurs and no malicious sites. Regards,

Can I use the same content? Website is new, only 1 month old.

I don't know.   I have been making websites for a long time.  I've seen google treat subdomains like gold and stack them in the SERPs so that subdomains on a single domain will fill the top ten and push all competitors down.  Then I've seen google treat subdomains like crap, then like gold again. So, don't bet on today's flavor.  Keep in mind that lots of domains have subdomains managed by other people.  Do you think that the actions of those "other people" should make the rest of the domain stink if they are crappy?   If you think that your subdomain should not stink if the rest of the domain is populated by idiots then go ahead and place your big  bet on subdomains being treated equally.  I'm not going to do it.  Do you think that blogspot blogs are treated like a single site?  I vote NO on that.  Do you agree? If you want your collection of content to be guaranteed support for your main site then you better put it in a folder.  I am putting my good content in a folder and staying away from hosts, shopping carts, software, platforms and any service that can't handle putting my content in a folder. Google changes their mind on this type of stuff all of the time.  So bet on what you think is long-term certain and not on what you hear people sayin' even if Matt Cutts is the one who is sayin'.  I remember him posting right here on moz (SEOmoz then) that you could sculpt pagerank with nofollow.  Then Google changed their mind on that and didn't tell anybody. Do what makes long term sense, not what people are sayin'.  I think that smart people are still saying put your  content in a folder.

Let me know if it works Mike. There is actually a third possibility which is; Some page(s) might generate a dynamic URL only upon being visited by a browser/search agent. If that's the case, then you can set up an event tracking through your website in conjuction with Google Analytics and track teh refferer; _gaq.push(['_trackEvent', 'Error', '404', 'page: ' + document.location.pathname + document.location.search + ' ref: ' + document.referrer ]); After you collect some data (Submit your website to Google WMT or wait for next MOZ visit) you can export and run your filter. The alternative to this method could be one of the 2 following; enabling extreme debug/log mode on your programming platform and collect logs for further processing. You can run a small Python script to find the RegEx pattern. I advise to setup a demo copycat of your website on a subdomain and then run this experiment. You can then submit the demo sub domain to Google Webmaster tools and wait for the crawlers. Reconfigure your webserver logging (httpd.conf if using Apache) to log more details. Make sure you turn back into to the normal data collecting configuration to avoid storage consumption. Good luck, Ali

Hi Huey, What I would do is first look in Google to see if they're crawling and indexing all of your products. For example. search Google for this: site:www.domain.com/getproduct.aspx With that search you should see your products getting indexed. If not, then there is an issue. I don't recommend that you use any redirects at all, as Google can crawl and index URLs with parameters in them. That said, you should not be using a 302 redirect as it's only temporary one and Google will NOT change the URL, as they are doing now. If you used a 301 Permanent Redirect Google should then show the full URL. If at all possible, I recommend getting rid of the session IDs and cookies. If you must have them, then those session IDs should not be in the URLs. I would, though, get rid of them for the search engine crawlers at a minimum.

You're welcome. Good luck and you know where to find me if you have any additional questions -Andy

Disable or re-setup according to the new desired settings