Is my robots.txt file working?

[Nightwing]

Greetings from medieval York UK

Everytime to you enter my name & Liz this page is returned in Google:
 http://www.davidclick.com/web_page/al_liz.htm

But i have the following robots txt file which has been in place a few weeks

User-agent: *
Disallow: /york_wedding_photographer_advice_pre_wedding_photoshoot.htm
Disallow: /york_wedding_photographer_advice.htm
Disallow: /york_wedding_photographer_advice_copyright_free_wedding_photography.htm
Disallow: /web_page/prices.htm
Disallow: /web_page/about_me.htm
Disallow: /web_page/thumbnails4.htm
Disallow: /web_page/thumbnails.html
Disallow: /web_page/al_liz.htm
Disallow: /web_page/york_wedding_photographer_advice.htm
Allow: /

So my question is please...

"Why is this page appearing in the SERPS when its blocked in the robots txt file e.g.:
 Disallow: /web_page/al_liz.htm"

ANy insights welcome

[Resultify]

Hi David

How long have you had the robots.txt file? Preventeing Google from indexing the page would not automatically remove it if its already indexed. That would take some time.

You could try using the removal tool:

https://www.google.com/webmasters/tools/removals

If its urgent you could check the header and do a 301 redirect if the user comes from Google. But I think it should sort itself out within not too long.

Fredrik

[RobertFisher]

Nightwing

Frederick gives some good pointers and here is a little trick to try: Fetch as Google from GWMT

1. On the Webmaster Tools Home page, click the site you want.
2. On the Dashboard, under Health, click Fetch as Google.
3. In the text box, type the path to the page you want to check.
4. In the dropdown list, select the type of fetch you want. To see what our web crawler Googlebot sees, select Web. To see what our mobile crawler Googlebot-Mobile sees, select cHTML (this is used mainly for Japanese web sites) or Mobile XHTML/WML.
5. Click Fetch.

This will likely give you a quick re index and you will know whassup...

Best,

Robert

[Nightwing]

Brill answers guys thanks

case_closed.jpg

[Resultify]

Glad we could help

Fredrik

PS Dont forget to mark as answered