Unable to submit sitemap in GWM.. Error

[xplodeguru]

I recently published new EMD and installed WP on their. Now i installed the Plugin called Yoast <acronym title="Search Engine Optimization">SEO</acronym> and XML Sitemap. Now whenever i am trying to submit sitemap it shows "URL restricted by robots.txt" but you can see my robots file line written below:

User-agent: *
Disallow: /cgi-bin/
Disallow: /wp-admin/

But still it is showing same error.. i deactivate plugin and resubmit the sitemap but still no luck.. please help

[OlegKorneitchouk]

Are those two separate plugins? I know Yoast has a sitemap plugin built in so you don't need another sitemap plugin.

I've never had any issues with it. Make sure your blog setting is set to 'Allow search engines to index this site.' (Settings > Privacy). Reset your cache (if you have one).

[xplodeguru]

Yes.. first i use Yoast sitemap feature so this problem happened than i installed xml sitemap plugin again the same problem. Setting is correct. You can check my domain robot here - http://freepapertextures.com/robots.txt

[OlegKorneitchouk]

first i use Yoast sitemap feature so this problem happened than i installed xml sitemap

Uninstall the XML sitemap plugin.. Yoast plugin has a built in XML sitemap which is even better.

Yoast sitemap looks like this: http://www.backlinkbuild.com/blog/sitemap_index.xml

Yours returns a 404: http://www.freepapertextures.com/sitemap_index.xml

Make sure you adjust the WP settings: SEO > XML Sitemaps > Check this box to enable XML sitemap functionality.

and submit this url: http://www.freepapertextures.com/sitemap_index.xml

[xplodeguru]

I uninstalled the xml sitemap plugin.. In Yoast that feature is already enabled but now i untick and tick that feature and click save so now it is no more showing 404 error. Second when i submit sitemap_index.xml link .. google still unable to detect and showing same problem.. you can see the screenshot here - http://prntscr.com/g57h7

[OlegKorneitchouk]

Clear your W3 Total Cache. Your robots.txt looks fine but my spider is picking the sitemap up as "noindex, follow" as well.

[xplodeguru]

Still still still same problem.. I cleared all cache through W3.. but still google not detecting sitemap. grrrrrrrrrrr... ..Now google also indexed the page which clearly written robots problem - site:http://www.freepapertextures.com

PLEASE HELP

[OlegKorneitchouk]

Hmm.. maybe you are blocking robots through htaccess?

[xplodeguru]

Here is the .htaccess file

BEGIN W3TC Browser Cache         BrowserMatch ^Mozilla/4 gzip-only-text/html        BrowserMatch ^Mozilla/4.0[678] no-gzip        BrowserMatch \bMSIE !no-gzip !gzip-only-text/html        BrowserMatch \bMSI[E] !no-gzip !gzip-only-text/html         Header append Vary User-Agent env=!dont-vary         AddOutputFilterByType DEFLATE text/css application/x-javascript text/x-component text/html text/richtext image/svg+xml text/plain text/xsd text/xsl text/xml image/x-icon <filesmatch ".(css|js|htc|css|js|htc)$"=""></filesmatch>    FileETag None          Header set X-Powered-By "W3 Total Cache/0.9.2.4" <filesmatch ".(html|htm|rtf|rtx|svg|svgz|txt|xsd|xsl|xml|html|htm|rtf|rtx|svg|svgz|txt|xsd|xsl|xml)$"=""></filesmatch>    FileETag None          Header set X-Powered-By "W3 Total Cache/0.9.2.4" <filesmatch ".(asf|asx|wax|wmv|wmx|avi|bmp|class|divx|doc|docx|eot|exe|gif|gz|gzip|ico|jpg|jpeg|jpe|mdb|mid|midi|mov|qt|mp3|m4a|mp4|m4v|mpeg|mpg|mpe|mpp|otf|odb|odc|odf|odg|odp|ods|odt|ogg|pdf|png|pot|pps|ppt|pptx|ra|ram|svg|svgz|swf|tar|tif|tiff|ttf|ttc|wav|wma|wri|xla|xls|xlsx|xlt|xlw|zip|asf|asx|wax|wmv|wmx|avi|bmp|class|divx|doc|docx|eot|exe|gif|gz|gzip|ico|jpg|jpeg|jpe|mdb|mid|midi|mov|qt|mp3|m4a|mp4|m4v|mpeg|mpg|mpe|mpp|otf|odb|odc|odf|odg|odp|ods|odt|ogg|pdf|png|pot|pps|ppt|pptx|ra|ram|svg|svgz|swf|tar|tif|tiff|ttf|ttc|wav|wma|wri|xla|xls|xlsx|xlt|xlw|zip)$"=""></filesmatch>    FileETag None          Header set X-Powered-By "W3 Total Cache/0.9.2.4" # END W3TC Browser Cache # BEGIN W3TC Page Cache core    RewriteEngine On    RewriteBase /    RewriteRule ^(./)?w3tc_rewrite_test$ $1?w3tc_rewrite_test=1 [L]    RewriteCond %{HTTPS} =on    RewriteRule . - [E=W3TC_SSL:_ssl]    RewriteCond %{SERVER_PORT} =443    RewriteRule .* - [E=W3TC_SSL:_ssl]    RewriteCond %{HTTP:Accept-Encoding} gzip    RewriteRule .* - [E=W3TC_ENC:gzip]    RewriteCond %{REQUEST_METHOD} !=POST    RewriteCond %{QUERY_STRING} =""    RewriteCond %{HTTP_HOST} =www.freepapertextures.com    RewriteCond %{REQUEST_URI} /$ [OR]    RewriteCond %{REQUEST_URI} (sitemap(index)?.xml(.gz)?|[a-z0-9-]+-sitemap([0-9]+)?.xml(.gz)?) [NC]    RewriteCond %{REQUEST_URI} !(/wp-admin/|/xmlrpc.php|/wp-(app|cron|login|register|mail).php|/feed/|wp-.*.php|index.php) [NC,OR]    RewriteCond %{REQUEST_URI} (wp-comments-popup.php|wp-links-opml.php|wp-locations.php) [NC]    RewriteCond %{HTTP_COOKIE} !(comment_author|wp-postpass|wordpress[a-f0-9]+|wordpress_logged_in) [NC]    RewriteCond %{HTTP_USER_AGENT} !(W3\ Total\ Cache/0.9.2.4) [NC]    RewriteCond "%{DOCUMENT_ROOT}/wp-content/w3tc/pgcache/%{REQUEST_URI}/_index%{ENV:W3TC_UA}%{ENV:W3TC_REF}%{ENV:W3TC_SSL}.html%{ENV:W3TC_ENC}" -f    RewriteRule .* "/wp-content/w3tc/pgcache/%{REQUEST_URI}/_index%{ENV:W3TC_UA}%{ENV:W3TC_REF}%{ENV:W3TC_SSL}.html%{ENV:W3TC_ENC}" [L]# END W3TC Page Cache core# BEGIN WordPressRewriteEngine OnRewriteBase /RewriteRule ^index.php$ - [L]RewriteCond %{REQUEST_FILENAME} !-fRewriteCond %{REQUEST_FILENAME} !-dRewriteRule . /index.php [L] # END WordPress

[OlegKorneitchouk]

don't see a problem there. Looks like the sitemap is now being indexed though (according to my spider). Try resubmitting.

[xplodeguru]

Now google accepted sitemap like for tags and images but now it is showing another error in post_sitemap.xml file .. Check this screenshot - http://i47.tinypic.com/5lxlwj.jpg