What is DeepCrawl?
Billed as the number one website crawling tool, DeepCrawl was built with the mission to improve the web by giving webmasters the data and tools to make their websites more accessible, relevant and effective.
DeepCrawl is a cloud-based crawler that runs on your browser, rather than other desktop crawlers that need to be installed onto your computer and using your memory and CPU.
An All-In-One Solution
DeepCrawl bills itself as a comprehensive SEO solution. It’s not designed to fix just one problem or address a single need. It’s meant to help you with a variety of search-related issues. If you’re looking to migrate a site, perform automated audits, learn more about your website architecture, recover from a penalty, improve the user experience, or learn more about your competitors, DeepCrawl has you covered. The only thing it doesn’t do is windows. As someone has well said: “DeepCrawl is Screaming Frog on steroids.” I can’t think of a better description. In the next several sections, I’ll go over each of the tool’s features individually.
What does DeepCrawl do?
In simple terms, DeepCrawl ‘crawls’ your website in much the same way a search engine crawler would do. It then provides a comprehensive overview of your website, helping you identify opportunities, areas for improvement and potential issues.
Monitor site health
DeepCrawl can be used to monitor the health of your site over time, as it makes it easy to view historical data so you can identify trends and issues and monitor your SEO progress.
You can schedule crawls to run hourly, daily, weekly, fortnightly or monthly basis, helping you stay on top of things like indexation issues and server response codes across your domain.
Website migration
Migrating a website is always a stressful time for an SEO, with the risk of massive ranking and traffic drops if anything is overlooked.
When migrating a website, you can use DeepCrawl’s staging vs live comparison feature to visualise the differences between the two versions of your website. You can also run regular comparison crawls as you work on the new site and chart your progress as your bring it closer to the current version.
You can also use DeepCrawl to test your new XML Sitemap before you set it live, helping you to iron out any problems and make sure no important pages are missing.
Site architecture
We all know that site architecture is important to SEO, and with DeepCrawl you can easily visualise the click depths of your pages (i.e. how many clicks they are away from the homepage). This gives you a useful overview of how users and search bots see and interact with your site.
Google penalty recovery
If you’ve been hit by Google’s Panda update (or suspect that you have), then DeepCrawl really comes into it’s own as a powerful and intuitive crawler.
For Panda problems, you can sync your Analytics data to examine the engagement rates of your content and identify thin content. DeepCrawl will also help you locate any duplicate titles, meta descriptions and content on your site, and also identify the ‘canonical’ version of the content so you can fix any stray canonical tags.
Who Uses DeepCrawl?
There are a variety of companies from different industries that use DeepCrawl to help with SEO. Take Made.com, for example. Back in 2016, that company noticed a decrease in traffic and revenue from organic search. So SEO Manager Sam Hurley enlisted the aid of DeepCrawl. Here’s what the tool uncovered:
- Diluted Authority – Subpar internal linking was throwing off mixed signals to Google.
- Inefficient Navigation – Filtering and navigation wasn’t optimized for common queries.
- Security Issues – The site was still using HTTP instead of HTTPS.
- International Issues – The site lacked proper hreflang configuration.
After making the necessary changes, Made.com saw noticeable improvements in search visibility, organic traffic, and revenue growth. DeepCrawl also delivered significant benefits to Hotter, the UK’s largest shoe manufacturer. Hotter’s SEO and CRO eCommerce Specialist, Niall Brooke, wanted to move the site from HTTP to HTTPS. That way, customers could trust the site when it came time to enter sensitive info. Brooke used DeepCrawl to ensure a smooth migration. DeepCrawl helped by uncovering a variety of issues before the official cutover. The tool found that some HTTP pages weren’t redirecting to HTTPS. Additionally, DeepCrawl identified mixed (non-secure and secure) content on several pages. Brooke tasked the team developer to take care of those problems before the site went live. The end result was a spectacular success:
- 39% growth in revenue
- 37% increase in transactions
- 30% uplift in sessions
How much does DeepCrawl cost?
There are three different pricing packages for DeepCrawl: Starter, Consultant and Corporate.
Starter – £55 per month
The Starter package allows you to track up to 100,000 URLs across five projects.
Consultant – £149 per month
The Consultant package allows you to track up to 500,000 URLs across ten project
PROS
- The most granular and comprehensive website crawling tool we tested.
- On-page SEO recommendations.
- Responsive modern interface.
- Google Analytics integration.
- Backlink tracking.
- Desktop/mobile breakdown.
CONS
- Site crawling is all it does.
- No keyword research, position monitoring, or web-wide indexing features.
- Depth of crawled data can be overwhelming if you don't know what you're looking for.
