Mapping ALL search data for a broad topic

[d.bird]

Hi All

As our company becomes a bigger and bigger entity I'm trying to figure out how I can create more autonomy.

One of the key areas that needs fixing is briefing the writers on articles based on keywords. We're not just trying to go after the low hanging fruit or the big money keywords but actually comprehensively cover every topic and provide actual good quality up to date info (surprisingly rare in a competitive niche) and eventually cover pretty much every topic there is.

We generally work on a 3 tier system on a folder level, topics and then sub-topics. The challenge is getting an agency to:

a) be able to pull all of the data without being knowledgeable in our specific industry. We're specialists and, thus, target people that need specialist expertise as well as more mainstream stuff (the stuff that run of the mill people wouldn't know about).

b) know where it all fits topically as we kind of organise the content on a heirarchy basis. And we generally cover multiple smaller topics within articles.

Am I asking for the impossible here? It's the one area of the business I feel the most nervous about creating autonomy with. Can we become be as extensive and comprehensive as a wiki-type website without having somebody within the business that knows it providing the keyword research.

I did a searh for all data using the main two seed keywords for this subject on ahrefs and it came up with 168000 lines of spreadsheet data. Obviously this went way beyond the maximum I was allowed to export.

Interested in feedback and, if any agencies are up for the challenge, do let me know! I've been using moz pro for a long time but have never posted and apologise if what I'm describing is being explained badly here.

Requirements

• Keywords to cover all (broad niche) related queries in the UK, no relevant uk (broad niche) keywords will be missed
• Organised in a way that can be interpreted as article brief and folder structure instructions.

Questions

• How would you ensure you cover every single keyword?
• Assuming no specialist X knowledge, how will you be able to map content and know which search queries belong in which topics and in what order. Also (where there is keyword leakage from other regions) how will you know which are UK terms and which aren’t?
• With minimal X knowledge – how will you know whether you’ve missed an opportunity or not (what you don’t know you don’t know)
• What specific resources will you require from us in order for this to work?
• What format will the data be provided to us in - how will you present the finished work so that it can be turned into article briefs?