Welcome to the Q&A Forum

I have fixed robots.txt, have submitted fresh sitemap to the webmaster. the problem still exists.

Also, when i look for webmaster >> Google Index >> Index Status >> Total indexed are 896 and Blocked by Robots are 626. The numbers have got better, but very slow. I don't think pages are blocked by Robots any more. Not sure what can be done about it.

Hi,

one of my clients is receiving the following error in SERP - "A description of the page is not available because of this site's robots.txt".

The site is built on WordPress and I realized that by default, the settings were checked to blocks bots from crawling the site. So, I turned it off, fixed robots.txt and submitted the sitemap again. Since, then it's been almost 10 days, the problem still exists.

Can anyone tell me what should be done to fix it or if there's a way to get Google to recrawl the pages again.

Hi guys,

I have a domain name XYZ.com which hosts the site of a technology service company as of now. The company however didn't do well and shut down a few years ago.

Now, that company wants to launch a new set of technology products and wants to use the same domain name. Is it a good idea. The issues that I can see here are:

1. Google has previous pages indexed

2. There are a couple of subdomains totally irrelevant to the business. like employees.xyz.com there.

3. Can the previous indexing be completely undone.

Regards,

Mayank

Hi Moosa,

I don't think sub directories can be hosted on different servers. Individual hosting is one of the most critical factors to consider when choosing between a subdomain and a sub directory structure. You will have to bring the blog to the same server as the primary domain.

Let's see what other tech guys have to say on this.

Regards,

Mayank

Hi Christina,

When I compare it with generic CMSs, like WordPress and Drupal, the advantage that Tag Manager gives is the way it streamlines all the tags. When dealing with multiple scripts, I find it very convenient. Secondly, you get the scripts of all the clients from one account.

I believe, it has been setup for organizations, where marketers are different from developers. So, with Google Tag Manager, marketers will not have to contact developers or site administrators for adding scripts.

Hi Christina,

Have been using Google Tag Manager since its launch. It is completely focused on making marketers's tasks free from the involvement of developers. It achieves the objective to a great extent.

I like it for the following reasons:

1. Once you have added Tag Manager script to the site, you do not need to go again to the HTML source for adding a script. It's pretty smooth at that function

2. It's a long term approach and can prove a great time saver for teams working on active campaigns.

3. Account management is easier - more like Google Analytics. You can handle scripts for different sites or campaign from a single platform

Hi Philip,

I did a lot of research on a similar issue a few months back. I am certain that Google recommends canonical tag to resolve the issue of duplicate content. That should be the way to go about it.

It's easy to implement and works just perfect.

Hope it helps. !!!

I have moved a site to a new location. There are a number of pages that date back to 2012 and 2011 and we do not want them anymore. Is there a way to ask Google to remove these pages entirely.

Fetch as Google tool is not the same as the submit URL tool that I have mentioned.

In the pages that are not indexed yet, there might be some accessibility issues. In such a case, you will be able to see the URLs in Issues and Warnings report from Webmaster.

If your site is a WordPress site, you can install a plugin - BWP GXS. This plugin automatically sets the ping frequency for each section. It helps in getting the site indexed quickly.

Another solution is to share your site's URL on social media platforms or update the site with fresh information daily. Once, Google bots identifies a site as a static site, it will take sometime to increase crawl and indexing frequency. So, make sure that you keep updating content on the site for next few days on a regular basis.

I think you should do the following things:

1. Go to yourwebsite.com/sitemap.xml

2. Check if all the xml files are accessible properly.

3. Check Google Webmaster dashboard about issues with sitemap. Most probably, Google will be able to report if there are major issues in your sitemap due to which robots are not able to access it.

4. When you add new pages to the site, use Google's submit URL tool. Here's the URL https://www.google.com/webmasters/tools/submit-url

This allows Google to identify that you have added a new URL and needs to be crawled.

Another thing, are you sure that Google has not indexed your pages. If you are not sure, do a google search for site:yourwebsite.com.

Hope this helps

Hi Philip,

I did a lot of research on a similar issue a few months back. I am certain that Google recommends canonical tag to resolve the issue of duplicate content. That should be the way to go about it.

It's easy to implement and works just perfect.

Hope it helps. !!!

Hi Christina,

Have been using Google Tag Manager since its launch. It is completely focused on making marketers's tasks free from the involvement of developers. It achieves the objective to a great extent.

I like it for the following reasons:

1. Once you have added Tag Manager script to the site, you do not need to go again to the HTML source for adding a script. It's pretty smooth at that function

2. It's a long term approach and can prove a great time saver for teams working on active campaigns.

3. Account management is easier - more like Google Analytics. You can handle scripts for different sites or campaign from a single platform

Hi Moosa,

I don't think sub directories can be hosted on different servers. Individual hosting is one of the most critical factors to consider when choosing between a subdomain and a sub directory structure. You will have to bring the blog to the same server as the primary domain.

Let's see what other tech guys have to say on this.

Regards,

Mayank