Welcome to the Q&A Forum

Hello, Best and common practice would be to keep the better ranking pages and remove the ones are not. Also put 301 redirects to the ones you removed towards the kept ones. hope that helps.

Hi Yoseph, Here are some of the common reasons why only a page or two might be crawled. https://seomoz.zendesk.com/entries/409821-why-isn-t-my-site-being-crawled-you-re-not-crawling-all-my-pages If that doesn't solve your problem, an email to the help desk (help@seomoz.org) will be able to fix things. Keri

Hi Please look at this : http://www.seomoz.org/learn-seo/duplicate-content

Only bad if those 404 pages are resulting from pages in your own site.  ( For example, the page that has the 404 is being linked to by another page on yoru site) Not from external sites.  That being said, fix them.  It's easy.  If the page actually doesn't exist then remove them from your sitemap and them remove url like I mentioned before.  If the page exists (like example.com/page but the 404 is for example.com/page.html) you can 301 pages or fix your site extensions.  I know Joomla has a SEF URL setting.

500 errors could be caused by a mulitude of reasons, and for the non-technical they can be very hard to track down and fix. The first thing I would look at is if it's a repeating problem in Google Webmasters Tools, or a one-time issue. These errors will show up in GWT for a long time - but if it's not a repeating problem it probably is nothing you need to worry about. Wait, I assumed you found the problems in GWT, when you may have possibly found them using the SEOmoz crawl report. Either way, you should probably log into  Google Webmaster Crawl Errors report and see if Google is experiencing the same problems. Sometimes 500 errors are caused by over-aggressive robots and/or improperly configured servers that can't handle the load. In this case, a simple crawl delay directive in your robots.txt file may do the trick. It would look something like this: User-agent: * Crawl-delay: 5 This would request that robots wait at least 5 seconds between page requests. But note, this doesn't necessarly solve the problem of why your server was returning 500s in the first place. You may need to consult your hosting provider for advice. For example, Bluehost has this excellent article on dealing with 500 errors from their servers: https://my.bluehost.com/cgi/help/594 Hope this helps! Best of luck with your SEO.

Hi Yoseph, the first question I usually ask myself when starting planning a content strategy around a keyword is - "What information would I be looking for if I entered that search term?" So, for example, someone searching for an online wildlife biology degree is probably interested in course content, structure, accreditation, price etc. Make sure you include these basic elements. Then I'd use keyword research to help shape other content ideas (FAQs, keywords optimised around specific modules and topics etc.). Google auto-suggest in searches and the Adwords keywords tool and two basic places to start. I'd measure the audience's response to this content carefully in Analytics  - which pages are most popular; where are readers spending longest; if you have a site search, what words are readers searching for; if you have a sales funnel, whereis it leaking. This data will inform your content strategy for providing content that will match your cusomters' needs. Good luck..

The only possible way I can think of is if the other person's site has an xml sitemap that is accurate, complete, and was generated by the website's system itself. (As is often created by plugins on WordPress sites, for example) You could then pull the URLs from the xml into the spreadsheet as indicated above, add the URLs from the "follow link" crawl and continue from there. If a site has an xml sitemap it's usually located at www.website.com/sitemap.xml. Alternately, it's location may be specified in the site's robots.txt file. The only way this can be done accurately is if you can get a list of all URLs natively created by the website itself. Any third-party tool/search engine is only going to be able to find pages by following links. And the very definition of the pages you're looking for is that they've never been linked. Hence the challenge. Paul

Hi Yoseph, If you liked the broken link checker Chrome plugin then you could check out another Chrome plugin that the company I work for created. It's called Redirect Path and I use it all the time. It's a handy header and redirect checker that flags up any 301, 302, 404 & 500 errors on any page you visit. Hope that helps!

George,  do you still remember to reply to  me?