Why bing is not indexing our website?

[showme]

We are up almost a six month already, google indexed 46,900 pages.

We have decent traffic and a lot of real external links to us.

No single page has been indexed by bing or yahoo.

I have submitted sitemap to bing's webmaster tool two weeks ago and still it is in Pending stage.

here is our address: www.showme.com

and here is site map: http://www.showme.com/sitemapxml.php

What can be the reason of that?

Thanks for your help.

Karen Bdoyan

[AlanMosley]

2 things.

your site map takes for ever to load,

and the links in site map have a trailing "/" but then 301 redirect to a non traling "/" url
http://www.showme.com/careers/ redirects to http://www.showme.com/careers

also Duane Forester from bing states , you should not places every url into your site map, nut only the most important pages, he also states that if your sitemap is not acurate Bing will ignore it.

but anyhow in bing WMT you can submit pages directly to the index, in the index section look for submit urls.

[ShaMenz]

Hi Karen,

There are a long list of URLs in your site which, although they do (eventually) load in a browser, appear to be returning a Status of 0 - Connection Timeout.

It is well recognized that Bing crawlers are very sensitive to URLs in sitemaps that return significant numbers of errors. In this case it appears that the crawler may be encountering pages in the site that it sees as unfetchable.

The majority of these URLs are in the following format - http://www.showme.com/sh/?i=36999 (this is one of them), although this one also returns the same result http://www.showme.com/topic/Geography

If you download the Screaming Frog tool from screamingfrog.com and run it, you will see the list of files that are returning this status.

It appears that the amount of time these pages are taking to load is causing a problem for some crawlers.

Hope that helps,

Sha

[showme]

Thank you for responses,

Now I have very simple static SiteMap : http://www.showme.com/sitemap.xml

And as far as I checked with Screaming Frog tool, there is no urls with 301 redirections

Still no single page been indexed by Bing, I also added manually few pages... no result, There is just 0 files indexed for our domain.

What can be the reason of such strike by bing?

[AlanMosley]

I found 115,029 301 redirects, i have software from Bing that shows the same violations as Bing sees.,
most are trailing slash issues from “/” to without trailing slash
Here is a sample
The link to "http://www.showme.com/learn/" has resulted in HTTP redirection to "http://www.showme.com/learn".
Each page I check has a huge number of requests mostly to js files and files from other domains
this page for instance Subtracting Negative Numbers
http://www.showme.com/sh/?i=47657
Resulted in all the request you see below, nott that besides js files of wich you have way too many, they ar alomost all from other domains.

I cant say what bing thinks, but its not normal when you look at it, there is not much content that does not come from other domains, it may be that bing sees this as a thin site, an affiliate site or some sort of spam.

URL Method Result Type Received Taken Initiator Wait?? Start?? Request?? Response?? Cache read?? Gap??
http://www.showme.com/sh/?i=47657 GET 200 text/html 17.10 KB 2.40 s click 0 15 2340 47 0 78516
http://cdn.optimizely.com/js/6084057.js GET 304 text/javascript 276 B < 1 ms

[BlueprintMarketing]

GET 200 = All good

GET 304 =

<a id="sec10.3.5">10.3.5</a> 304 Not Modified

If the client has performed a conditional GET request and access is allowed, but the document has not been modified, the server SHOULD respond with this status code. The 304 response MUST NOT contain a message-body, and thus is always terminated by the first empty line after the header fields.

The response MUST include the following header fields:

      - Date, unless its omission is required by section 14.18.1

If a clockless origin server obeys these rules, and proxies and clients add their own Date to any response received without one (as already specified by [RFC 2068], section 14.19), caches will operate correctly.

      - ETag and/or Content-Location, if the header would have been sent
        in a 200 response to the same request

  - Expires, Cache-Control, and/or Vary, if the field-value might
    differ from that sent in any previous response for the same
    variant

If the conditional GET used a strong cache validator (see section 13.3.3), the response SHOULD NOT include other entity-headers. Otherwise (i.e., the conditional GET used a weak validator), the response MUST NOT include other entity-headers; this prevents inconsistencies between cached entity-bodies and updated headers.

If a 304 response indicates an entity not currently cached, then the cache MUST disregard the response and repeat the request without the conditional.

If a cache uses a received 304 response to update a cache entry, the cache MUST update the entry to reflect any new field values given in the response.

Hope I helped,

Info http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html

Thomas