Welcome to the Q&A Forum

I've bought and am using Screaming Frog successfully. Thanks for the direction, Eli.

Thanks, Chiaryn —  I'm considering deleting my geo-based national keywords and adding non-geo local ones. Do I understand correctly that I will be able to view historical visibility and ranking for the old keywords and new visibility and ranking starting with when the new keyword phrases are added – but not both at the same time? Thanks! Bill

Glad to hear it's working now! Thank you for following up to let us know.

Thanks, Tawny, If you look at Duplicate titles, check the first one (https://needquest.com/place_tag/autism-spectrum-disorder/). All the URLs with a duplicate title have /page/ in them. I will suggest they move the Allow statement and see if that helps.

Thanks, Alick300 — unfortunately, the slash doesn't appear like that in the URLs on this site: they look like this www.domain.com/page.html?Page= ......... In running through an online robots.txt tester, all three versions in my original question seem to work. Until proven otherwise, I'm using the first one because it's the simplest.