Questions
-
Subdomain vs root which is better for SEO
This might shed a little more light on the subject. The sites are per video game. So they could be completely different from one another. I like the way a subdomain looks and for this purpose, I've seen other sites doing it this way for a long time. From where I sit subdomains seem to be the "right" way to go about this but if sub-dirs are going to be BETTER for SEO then I want to do that. I don't mind SEOing multiple sites and I would somewhat prefer to keep things separated out like that. I guess what I really want to know is, Is this a personal preference thing if workload isn't my concern? Or is one going to be objectively better than the other. Thanks for the replies so far. Much appreciated.
Intermediate & Advanced SEO | | DisMedia0 -
How do you block development servers with robots.txt?
Added X robots tag into our headers on our development sites. Just a note - if you use apache and have mod_pagespeed installed , it wall conflict and pagespeed will remove the X robots tag. Begin Bad Bot Blocking BrowserMatchNoCase Googlebot bad_bot BrowserMatchNoCase bingbot bad_bot BrowserMatchNoCase OmniExplorer_Bot/6.11.1 bad_bot BrowserMatchNoCase omniexplorer_bot bad_bot BrowserMatchNoCase Baiduspider bad_bot BrowserMatchNoCase Baiduspider/2.0 bad_bot BrowserMatchNoCase yandex bad_bot BrowserMatchNoCase yandeximages bad_bot BrowserMatchNoCase Spinn3r bad_bot BrowserMatchNoCase sogou bad_bot BrowserMatchNoCase Sogouwebspider/3.0 bad_bot BrowserMatchNoCase Sogouwebspider/4.0 bad_bot BrowserMatchNoCase sosospider+ bad_bot BrowserMatchNoCase jikespider bad_bot BrowserMatchNoCase ia_archiver bad_bot BrowserMatchNoCase PaperLiBot bad_bot BrowserMatchNoCase ahrefsbot bad_bot BrowserMatchNoCase ahrefsbot/1.0 bad_bot BrowserMatchNoCase SiteBot/0.1 bad_bot BrowserMatchNoCase DNS-Digger/1.0 bad_bot BrowserMatchNoCase DNS-Digger-Explorer/1.0 bad_bot BrowserMatchNoCase boardreader bad_bot BrowserMatchNoCase radian6 bad_bot BrowserMatchNoCase R6_FeedFetcher bad_bot BrowserMatchNoCase R6_CommentReader bad_bot BrowserMatchNoCase ScoutJet bad_bot BrowserMatchNoCase ezooms bad_bot BrowserMatchNoCase CC-rget/5.818 bad_bot BrowserMatchNoCase libwww-perl/5.813 bad_bot BrowserMatchNoCase magpie-crawler 1.1 bad_bot BrowserMatchNoCase jakarta bad_bot BrowserMatchNoCase discobot/1.0 bad_bot BrowserMatchNoCase MJ12bot bad_bot BrowserMatchNoCase MJ12bot/v1.2.0 bad_bot BrowserMatchNoCase MJ12bot/v1.2.5 bad_bot BrowserMatchNoCase SemrushBot/0.9 bad_bot BrowserMatchNoCase MLBot bad_bot BrowserMatchNoCase butterfly bad_bot BrowserMatchNoCase SeznamBot/3.0 bad_bot BrowserMatchNoCase HuaweiSymantecSpider bad_bot BrowserMatchNoCase Exabot/2.0 bad_bot BrowserMatchNoCase netseer/0.1 bad_bot BrowserMatchNoCase NetSeer crawler/2.0 bad_bot BrowserMatchNoCase NetSeer/Nutch-0.9 bad_bot BrowserMatchNoCase psbot/0.1 bad_bot BrowserMatchNoCase Moreoverbot/x.00 bad_bot BrowserMatchNoCase moreoverbot/5.0 bad_bot BrowserMatchNoCase Jakarta Commons-HttpClient/3.0 bad_bot BrowserMatchNoCase SocialSpider-Finder/0.2 bad_bot BrowserMatchNoCase MaxPointCrawler/Nutch-1.1 bad_bot BrowserMatchNoCase willow bad_bot Order Deny,Allow Deny from env=bad_bot End Bad Bot Blocking Header set X-Robots-Tag "noindex, nofollow" Begin Bad Bot Blocking BrowserMatchNoCase Googlebot bad_bot BrowserMatchNoCase bingbot bad_bot BrowserMatchNoCase OmniExplorer_Bot/6.11.1 bad_bot BrowserMatchNoCase omniexplorer_bot bad_bot BrowserMatchNoCase Baiduspider bad_bot BrowserMatchNoCase Baiduspider/2.0 bad_bot BrowserMatchNoCase yandex bad_bot BrowserMatchNoCase yandeximages bad_bot BrowserMatchNoCase Spinn3r bad_bot BrowserMatchNoCase sogou bad_bot BrowserMatchNoCase Sogouwebspider/3.0 bad_bot BrowserMatchNoCase Sogouwebspider/4.0 bad_bot BrowserMatchNoCase sosospider+ bad_bot BrowserMatchNoCase jikespider bad_bot BrowserMatchNoCase ia_archiver bad_bot BrowserMatchNoCase PaperLiBot bad_bot BrowserMatchNoCase ahrefsbot bad_bot BrowserMatchNoCase ahrefsbot/1.0 bad_bot BrowserMatchNoCase SiteBot/0.1 bad_bot BrowserMatchNoCase DNS-Digger/1.0 bad_bot BrowserMatchNoCase DNS-Digger-Explorer/1.0 bad_bot BrowserMatchNoCase boardreader bad_bot BrowserMatchNoCase radian6 bad_bot BrowserMatchNoCase R6_FeedFetcher bad_bot BrowserMatchNoCase R6_CommentReader bad_bot BrowserMatchNoCase ScoutJet bad_bot BrowserMatchNoCase ezooms bad_bot BrowserMatchNoCase CC-rget/5.818 bad_bot BrowserMatchNoCase libwww-perl/5.813 bad_bot BrowserMatchNoCase magpie-crawler 1.1 bad_bot BrowserMatchNoCase jakarta bad_bot BrowserMatchNoCase discobot/1.0 bad_bot BrowserMatchNoCase MJ12bot bad_bot BrowserMatchNoCase MJ12bot/v1.2.0 bad_bot BrowserMatchNoCase MJ12bot/v1.2.5 bad_bot BrowserMatchNoCase SemrushBot/0.9 bad_bot BrowserMatchNoCase MLBot bad_bot BrowserMatchNoCase butterfly bad_bot BrowserMatchNoCase SeznamBot/3.0 bad_bot BrowserMatchNoCase HuaweiSymantecSpider bad_bot BrowserMatchNoCase Exabot/2.0 bad_bot BrowserMatchNoCase netseer/0.1 bad_bot BrowserMatchNoCase NetSeer crawler/2.0 bad_bot BrowserMatchNoCase NetSeer/Nutch-0.9 bad_bot BrowserMatchNoCase psbot/0.1 bad_bot BrowserMatchNoCase Moreoverbot/x.00 bad_bot BrowserMatchNoCase moreoverbot/5.0 bad_bot BrowserMatchNoCase Jakarta Commons-HttpClient/3.0 bad_bot BrowserMatchNoCase SocialSpider-Finder/0.2 bad_bot BrowserMatchNoCase MaxPointCrawler/Nutch-1.1 bad_bot BrowserMatchNoCase willow bad_bot Order Deny,Allow Deny from env=bad_bot End Bad Bot Blocking Header set X-Robots-Tag "noindex, nofollow"
On-Page / Site Optimization | | JustinTaylor880