Screaming Frog SEO Spider (For Mac & PC) is a crawl tool for analyzing the structure of a website.
It’s a tool for search engine optimizers, website managers, and web developers. SF spiders a site in a similar way any search engine spider would. As search engine optimisation tools go, you’ll need to understand technical SEO and have a firm grasp of HTML to get the most from this tool.
It is an excellent program to audit your website from a technical point of view, and with it can promptly collect a lot of the necessary information you need to help optimise your site.
This program is available for PC and Mac. As a Mac user, I’m often confronted with software that slows my mac down a little, so it was a pleasure to see this thing run in the background in a quiet, efficient manner.
Run the spider and it will grab information on your pages. Links, page titles, redirects, 404s, heading tags, status codes, attribute lengths, anchor text, alt text and numbers of internal backlinks, numbers of external links on each page. Quickly identify click depth, see canonical link information or meta-refresh directives. And more.
You can also output this report to CSV.
Screaming Frog spider comes highly recommended for SEO and web designers everywhere. I have used it on small and enormous websites (using a cloud computer to maximise its efficiency).
SF is just about the best SEO software you can buy in 2017 to investigate site structure and for quick log file analysis, IF you are technically minded.
Get a free version too to test it out, before you buy it.