Welcome to the Q&A Forum

Hi!

It is possible to get an indication of this by using tools like Link Explorer > Inbound links (https://analytics.moz.com/pro/link-explorer/inbound-links). Looking at the linking domain in question and then looking at the "Spam score" column, might help you see if this is good or bad for you.

Best regards,
Anders

Hi!

One way to get around this one is making use of pre-rendering. So if you setup your site/server to pre-render your pages either for all user agents, or specifically for MozBot and other bots not capable of crawling through JavaScript then it might work.

Facing the same issue for us now, but will try this at least.

Best regards,
Anders

Hi!

It can be a great many things that casues the rankings to be different. Perhaps some of these are fitting to your site:

• Your site gives a better experience than your competitors on mobile
• Your site has a greater CTR from organic search results than your competitors
• (Mobile) page speed
• Font setup on mobile vs dekstop (readability and user experience)

I found this article on SearchEngingWatch that could be of interest to you.

Best regards,
Anders

Hi!

Are you using clientside or serverside redirects? Since you talk about 301, I assume you use serverside redirects. I think if the rewrite rule is setup correct, then it should preserve the referrer info. But if this is added as e.g. utm_source parameters to the URL, then perhaps you can experiment with the flags set for the redirect rule?

Assuming you are working with an Apache server: Looking at https://httpd.apache.org/docs/current/rewrite/flags.html#flag_qsa, it looks as if parameters can be kept/appended to the target URL. Else, the setting [L,R=301] should probably work OK with regards to keeping the referrer.

Hope this helps

Best regards,
Anders

Hi!

I guess that really depends on what you are trying to accomplish. If it is relevant for usert to have a link back, or if the text on the help-page dictates that a link to the product page gives value and meaning, then I would absolutely add a link back.

From an SEO perspective It could also be valuable if it helps mapping out the site hierarchy and distribute "link juice". However - I would ask myself if this gives value for my user, not only worring about technical SEO. But if if gives value for your visitors, then you should absolutely go ahead and link between the pages.

Some more info can be found at https://moz.com/learn/seo/internal-link and https://blog.kissmetrics.com/commandments-of-internal-linking/ (and https://support.google.com/webmasters/answer/35769?hl=en)

Hope this helps

Best regards,
Anders

Hi Bimal,

I think you actually don't need the Allow: / portion as it is open by default. So that line can probably be removed. The next 3 lines will disallow all bots to access the directories you have listed.

The last section of your robots txt will block all bots from your entire site, so that should probably not be there unless you really want all bots and spiders to stay out of your site

Some more info can be found here: http://www.robotstxt.org/robotstxt.html

Hope this helps,

Best regards,
Anders

Hi Andrew,

Is it possible for you to have your hosting provider or domain registrar setup a redirect from the old subdomains to the current domain in use?

Best regards,
Anders

Hi,

This can occur if Google's crawlers for some reason is not able to reach some of your pages. It could be related to some network issues, or temporary server issues. A few things to look at:

• Do you see any increased loading times for your pages?
• When looking at the page with firebug or chrome's inspector tools - do you see any 404 errors returned
• What result do you get if using the Fetch as Googlebot tool?

Hope this helps

Best regards,Anders

Hi Sarwan,

It could be that this will not work because you use a CDN for serving both images and video content. According to https://support.google.com/webmasters/answer/178636?hl=en you have to prove ownership to the CDN hosting site before this will be allowed. Perhpas this is the same with video, as it talks about having to verify the CDN hosting site in Search Console before being indexed/crawled.

Good luck with this!

Anders

Hi Sarwan!

The rel canonical will not change the URL opened in a browser. It will only be a signal to the search engines to count links for docbeans.com/index as links to docbeans.com and to threat them as a single URL in regards to ranking.

Also, doing the 301 redirect shouldn't really have an impact with load times, as the redirects happens before loading any content. As they both load the same content, I guess this is because the docbean.com is really an alias for docbean.com/index.

Hope this helps.

Anders

Hi!

With the rel=canonical in place, this is a stronge hint to the search enignes that docbeans.com is the one that should be indexed. Is it possible for you to do a 301 redirect from docbeans.com/index to docbeans.com (or the other way around), then that would probably be even better(?). Are there any particular reasons for you to keep both, then this has to be taken into the equation.

Have you had the change to look at this page: https://moz.com/blog/301-redirect-or-relcanonical-which-one-should-you-use. It could be of some value for you to decide whether to just keep the canonical or to do a 301.

Hope this helps!

Anders

Hi!

Are all pages available for GoogleBot, or are they perhaps blocked by robots.txt or a meta tag?

Do you have a URL for the website so we can take a look?

Anders

Hi Sander!

According to https://moz.com/local-search-ranking-factors it could be of some value to have some sort of geographic keyword in the URL, but I guess it would also be of value to have this as part of the onpage copy, in the title, meta description etc if it is possible to add i a ntural way, without making it look spammy.

If you have some contact information on the page, it could also be valueable to mark it up according to schema.org (same goes for the product information if not already done).

If you are changing the URL, also make sure to 301 redirect from the old URL to the new one.

My 2 cents. Hope this helps

Anders

Hi!

From what I could tell, your sitemap entries are missing at least one tag. Alle entries should have a or <video:player_loc></video:player_loc>tag according to https://developers.google.com/webmasters/videosearch/sitemaps

Hope this helps

Anders

Hi!

There is one link to this category from http://www.ebuyer.com/store/Home-Appliances/cat/Health-&-Beauty in the category text on the top. The text is not styled in anyway, but the link text is "hair grooming kits for men".

Chris' suggestion for Screaming frog is one way about it. OpenSiteExplorer also does the trick, looking for inbound links, and perhaps narrowing to internal links.

Hope this helps

Anders

Hi Maureen!

It seems that your pages all have the following code inside the :
<meta content="<a class="attribute-value">noindex,follow</a>" name="<a class="attribute-value">robots</a>">
It will effectively block all your pages from being indexed, and should be removed (or changed into <meta content="<a class="attribute-value">index,follow</a>" name="<a class="attribute-value">robots</a>"> )

Also, you should update the robots.txt to reference the full URL for the XML sitemap? I think the specifications for referenging this demands full URL's.

Hope this helps
Anders

I agree - i probably would ignore everything after the "#".

But have you tried added a <link rel="canonical" href="http://example.com/page-url" /> to your pages and see if this will update it? Also: Add the sitemap to your robots.txt if not allready done.

Regarding indexing pages - have you restricted crawl frequency in Google Search Console, or is it set to be determined by GoogleBot? Any other warnings or messages in Search Console?

Best regards,
Anders

Hi!

In addition, you could try visisting the old URLs with Firebug or some other tool activated to verify that your server is actually serving a 301 redirect (not 302 or nothing at all). If everything is OK it could just be a matter of time before the old pages are reindexed and the redirect is discovered.

Hi!

I don't think this is really SEO-related, but more about user experience. It has been more and more common to let the user decide what is supposed to be happening when clicking links, not making the decissions for her/him.

My 2 cents

Anders

Hi!

Have a look at this video: https://www.youtube.com/watch?v=eFJZXpnsRsc

According to Matt Cutts here, you will not do anything wrong with disavowing the links.
My 2 cents...

Good luck, hope this helps!

Anders