Questions
-
Some bots excluded from crawling client's domain
The main reason it's not good is that Google crawl from different data-centers around the world. So one day they may think the site is up, then the next they may think the site is gone and down Typically you use a user-agent lance to pierce these kinds of setups. Screaming Frog for example, you can pre-select from a variety of user-agents (including 'googlebot' and Chrome) but you can also author or write your own user-agent Write a long one that looks like an encryption key. Tell your client the user agent you have defined, let them create and exemption for it within their spam-defense system. Insert the user-agent (which no one else has or uses) into Screaming Frog, use it to allow the crawler to pierce the defense grid Typically you would want to exempt 'Googlebot' (as a user agent) from these defense systems, but it comes with a risk. Anyone with basic scripting knowledge or who knows how to install Chrome extensions, can alter the user-agent of their script (or web browser, it's under the user's control) with ease and it is widely known that many sites make an exception for 'Googlebot' - thus it becomes a common vulnerability. For example, lots of publishers create URLs which Google can access and index, yet if you are a bog standard user they ask you to turn off ad-blockers or pay a fee Download the Chrome User-Agent extension, set your user-agent to "googlebot" and sail right through. Not ideal from a defense perspective For this reason I have often wished (and I am really hoping someone from Google might be reading) that in Search Console, you could tell Google a custom user-agent string and give it to them. You could then exempt that, safe in the knowledge that no one else knows it, and Google would use your own custom string to identify themselves when accessing your site and content. Then everyone could be safe, indexable and happy We're not there yet
Technical SEO Issues | | effectdigital0 -
Software "card" carousel results
OP is talking about the content boxed in green: https://d.pr/i/qdGFze.png (screenshot) not the ads (boxed in red). I am pretty sure there's no ad type like the carousel of tiles boxed in green, so I don't think Google Ads is the answer (could be wrong though)
Intermediate & Advanced SEO | | effectdigital0 -
Hreflang in country specific XML Sitemaps?
Hey SimpleSearch–yes, you'll need to indicate these alternate URLs in your sitemap. Google claims that you can use hreflang or sitemaps to indicate international content, but I typically find that being thorough is best (you can always test whether your updated sitemap has made a difference through log file analysis before and after you execute this change). Here is Google's writeup on indicating alternate pages via sitemap: https://support.google.com/webmasters/answer/189077?hl=en
Technical SEO Issues | | zeehj1 -
Schema for Knowledge Graph Card
This should be able to be edited in Google My Business. If you have the login information for the account this is linked to the Google Maps citation you are seeing, you should be able to login and edit the categories under the "Info" Tab. If you do not have the login information for it, search the business name in Google Maps, go to "Suggest An Edit" and click on the category listed, it should cross it out and then you can suggest a new category for Google to review. This way does not guarantee it will change, but is worth a shot if you don't have the information to login to their GMB account. Best of success!
Intermediate & Advanced SEO | | NickW8161