Www and non www how to check it.......for sure. No, really, for absolutely sure!!

[RobertFisher]

Ok, I know it has been asked, answered, and re-asked but I am going to ask for a specific reason. As you know, anyone who is a graphic designer or web developer is also an expert in SEO....Right??? 
I am dealing with a client who is clinging to a developer but wants us to do the SEO on a myriad of sites. All connect to his main site via links, etc. The main site was just redeveloped by a developer who claims extensive SEO knowledge. The client who referred me to them is getting over twenty times the organic clients they are and is in a JV with the new client. Soooo, I want to show them once and for all they are wrong on the www. versus non-www.

When I do a Site:NewClient.com in Google I get a total of 13 www.newclient.com url's and 20 newclient.com url's without the www. Oddly, none are dupes of the other. So, where the www.NewClient/toy-boat/ is there, the other might be non www.  NewClient/toy-boat/sailing-green/

Even the contact page is in the www.NewClient/contact versus the non www of NewClient/Contact-us/

But, both pages seem to resolve to the non www. (A note here is that I originally instructed the designer to do non www to www. because the page authority was on the www.NewClient and he did opposite.

With pages that are actually PDF files, if you try to use the www.NewClient/CoolGuy.pdf it comes up 404.

When I check our sites, using Site:We-Build-Better.com ours return all www.We-Build-better/ url's.

So, any other advice on how to insure these correct or incorrect? Oddly, we have discovered that sometimes in OSE, even with a correct canonical redirect it shows one without authority and the other with....we have contacted support.

Come on mozzers, hook a brother up!

[AlanMosley]

Not quite sure I understand what you want to check, but as long as one 301's to the other it does not really matter. it may take some time for SE's to catch up.

Are you saying you want to check if it is resolving correctly?
in IE click F12, and then select Network and start capturing, you will see if its useing a 301, or a useless 302.

If you want to prove to your client that the developer is not on the ball, do a scan with the SEO Toolkit and show the results, if you dont have windows too install it on, i will do one for you.

[ShaMenz]

Hi Robert,

OK, just to clarify...

1. You want to check for sure that newclient.com is 301 redirected to www.newclient.com?
2. You want to check for sure that ALL URL's which have been individually 301'd are redirecting to www.newclient.com/filename?
3. You want to understand why the non www version of pdf files works and the other doesnt?

Right off the top, the definitive way to check whether there is a properly functioning redirect in place is to type the URL into a browser and see whether it resolves to the redirect target :). You can also run Screaming Frog and see what status the pages return, but be aware that this does not always reflect the real situation in the browser (pages can return status that does not match what you see).

On the other questions, I think perhaps what you really want is to first determine what is happening and then, WHY?

So, first things first:

• do you have access to the .htaccess file?
• Can you provide the URL (and .htaccess if you have it)? You can PM this info if you don't want to share it publicly.

Sha

[ChristopherGlaeser]

What is the SEO Toolkit that runs on Windows?

Best,
Christopher

[AlanMosley]

Thwe SEO Toolkit sees the same probnlems as Bing sees, you need windows and you need to install IIS  (add features) first
http://www.iis.net/download/SEOToolkit

[RyanKent]

Hi Robert.

Once you determine which version of a URL you would like to represent your site, the best method to enforce that decision is to use a 301 redirect. For example, direct all non-www traffic to the www version of the URL the same way SEOmoz URLs appear. With this approach, 100% of your URLs will appears as the "www" version in SERPs and there will never be any confusion or conflict.

I've heard people talk about using canonicals or setting the preferred domain in WMT. Neither step is necessary as long as the 301 is in place. The reason I still do both is I like to account for failures in a process. You never know when someone will make an error and modify an .htaccess file incorrectly and wipe out your redirect.

If you have the redirect in place, OSE and similar tools should clearly see the redirect and act appropriately every time. If the tool does not work correctly, I would examine the header tag of the page to ensure the 301 is working properly. If it is, then I would perform the same action you did and report the bug.

If you do not take the proper steps to enforce a "www" or "non-www" structure, you will see the results which you described. Some users will visit and link to each version of the page which will lead to both versions of URLs being indexed. Google will index a version based on which was discovered first or which version it deems more important based on links and other factors. When you perform searches for a site, some URLs will appear with the "www" and some without it. The backlinks will be divided and, as you know, that is bad for SEO. The duplicate content issue will set off alarms for the SEOmoz crawler and similar tools, but Google will still index one version of the page.

I am not sure if this completely answers your question Robert. If I missed anything, feel free to ask.

[RobertFisher]

no .htaccess file access.......hard to even get to site pages to place links to microsites.

I will PM the url. Thanks Sha

You are correct, I want to know did this other developer really do a 301 in the .htaccess file that will allow all weight to inure to one or the other url.

[RobertFisher]

no .htaccess file access.......hard to even get to site pages to place links to microsites.

I will PM the url. Thanks Sha

You are correct, I want to know did this other developer really do a 301 in the .htaccess file that will allow all weight to inure to one or the other url.

[RobertFisher]

no .htaccess file access.......hard to even get to site pages to place links to microsites.

I will PM the url. Thanks Sha

You are correct, I want to know did this other developer really do a 301 in the .htaccess file that will allow all weight to inure to one or the other url.

[RobertFisher]

Unfortunately, the other developer controls all. We develop a set of sites that are essentially micro sites that advertise particular facets of our clients professional practice. With our sites when we have the main site and the micro sites, we make the 301 change in the .htaccess and then set the preference with Google per webmaster tools. We look first to see where the page authority lies and redirect from weak to strong if just for www/non www. With a new TLD, obviously, it is from old to new.

I want a sure way to know this ...person....did what they are telling their client they did. It does not appear so. With ours when we do a site:OurSite we get what we assumed on every page of Google search. With this one it is four pages with the 13 www and 20 non www. Some www urls resolve to the non and some do not. When I look in OSE, I see where there is mention of a redirect from www to non www, and the non www all with PA of 1, DA of 15. With www, PA is 25 for home page.

Is my assumption that if a 301 was done in .htaccess, there should be no www showing in Google Site:?

Thanks

[AlanMosley]

just a point, you dont need to do a 301 in the .htaccess file.

I work with Microsoft Technolgies, and we dont use them, .htacces is a linux appache thing

[AlanMosley]

Sha, what does PM stand for? Am I missing somthing?

[RyanKent]

Well if Robert Private Messages Sha, then you would be missing that message

[AlanMosley]

Private Message Ok, should of been obvious

[RobertFisher]

We are linux on all though. So the .htaccess file is the bomb with a 301 and we follow up with setting preference in Google webmaster tools.

[RobertFisher]

I shot you a PM. Just dont want the other guys info out. If it was my site and I had full control would tell all. Sha got one too. Thanks

[RobertFisher]

I shot you a PM. Just dont want the other guys info out. If it was my site and I had full control would tell all. Sha got one too. Thanks

[AlanMosley]

If you want Robert, if you PM me the url, i will give you a site wide check

[RyanKent]

I want a sure way to know this ...person....did what they are telling their client they did.

Perhaps someone has more creativity then myself but I do not know any means by which you can be 100% certain a sitewide 301 is implemented without seeing the file on the server. The "file" varies based on the server type. As you know, for Apache servers the .htaccess file is the right one.

Even if you saw the .htaccess file, it is possible for another file to overwrite the command. The way I always have verified is by looking at the site itself. Check the home page and a few other pages. If they are all 301'd properly, then I presume the developer performed their job correctly. It would actually be a lot more work for the developer to attempt to fool you by 301'ing part of the site but not all.

I also suggest ensuring your site's www or non-www standard appears correctly in your crawl report.

Is my assumption that if a 301 was done in .htaccess, there should be no www showing in Google Site:?

That is not necessarily true. If you have a site which shows mixed URL results, then overtime the results from a site: search will be standardized, but it will take time as Google needs to crawl each and every page of the site and see the 301. Also if any page is blocked by robots.txt for example, then Google may not see the 301 for that page and still list the old url.

If you changed the Google WMT preferred domain setting, then it is true you will only see one version of the URL. I would specifically advise you NOT to change that setting in this case as it may cover up the developer's issue which you are trying to locate. As for now, you can wait 30 days and perform a site: search. Investigate any bad URLs you find.

[RobertFisher]

Thanks for this Alan, I use Linux / Apache but having the IE info is a big help. Usually have Chrome or Firefox up, but some real estate sites here only use IE.