Historic issue with incomplete indexing

[ianparryuk]

Hi there

We run quite a big site in the UK in the commercial real-estate space.

Historically we have always had a challenge getting our "primary" landing pages indexed, which are location based property result pages.

e.g. https://realla.co/to-rent/commercial-property/oxford

For example, for the "towns" category we have 8,549 submitted in our xml sitemap, with only 3,171 indexed.  This is a general issue across all our sitemaps. 120k submitted, 80k indexed.  Our pages are linked through breadcrumbs, and nearby links.

In the new search console these pages are reported as "crawled - currently not indexed"

These all sit under the folder:

site:https://realla.co/to-rent/commercial-property/*

site:https://realla.co/to-rent/office/*

We have done extensive work to optimise performance, including AMP pages.

Each location page has many details pages for individual properties e.g.

https://realla.co/to-rent/details/0ffbbd0a1a1147edb8847c5ce6179509

One action we have remaining is to nest the details under the locations pages, which may help.  These details pages are indexed fully.

Any feedback much appreciated

[Vijay-Gaur]

Hi Ian,

I have analyzed the website in detail, the problem seems to be that you are not giving any differentiation to search engine bots between important category/sub-category(in your case different locations) pages compared to product pages (in your case property details page). The location pages URL structure and their sitemap submission strategy can be re-worked to get the desired results.

Another scope of improvement is in URL structure for property details page  **For example, **

https://realla.co/to-rent/details/0ffbbd0a1a1147edb8847c5ce6179509 should be https://realla.co/to-rent/details/Office-to-let-John-Eccles-House-Robert Robinson-Avenue-Oxford-Science-Park-Oxford-OX4-4GP

Your site structure is huge, and it must be getting dynamic links generated or removed, you need to be careful with the site structure and how often to submit sitemap.

I hope this helps. Let me know if you have further queries, I will be happy to help.

Regards,

Vijay

[ianparryuk]

Thanks for your reply

We are just about to nest the "details" pages under the results path e.g. /to-rent/commercial-property/newbury/details/1294321739712973129 etc so it sits under the right location.

I think this is in line with your recommendation.

We have alot of individual sitemap files, should these be consolidated?

[Vijay-Gaur]

Hi Ian,

The details URL should ideally have keywords in it, getting property name in details page URL would be of great help, like : https://realla.co/to-rent/details/Office-to-let-John-Eccles-House-Robert Robinson-Avenue-Oxford-Science-Park-Oxford-OX4-4GP

About the category (locations in your case), you are submitting too many of them, your URL structure needs to re-structured, there is work to be done there and sitemap updated according to that. For example:

https://realla.co/to-rent/commercial-property/

can be changed to

https://realla.co/commercial-property-to-rent/

I hope this helps, let me know if you have further queries.

Regards,

Vijay