Logo SEO Data Report SEO Data Report

Download Crawler SDR

Crawler SDR combines technical crawling, JavaScript rendering, HTML reports, XLSX exports, and comparisons with Google Search Console, GA4, PageSpeed Insights, CrUX, and server logs.

During the BETA phase, you can access the PRO version to validate complete audits before the commercial launch.

Download

Crawler SDR

Detailed features

  • Clickable KPI panel and area tabs: links, titles, meta, H1/H2, content, images, canonicals, hreflang, AMP, structured data, sitemaps, and JavaScript
  • Technical and indexability audit: HTTP codes, redirects, robots.txt, meta/X-Robots, canonical, noindex, and hreflang
  • Warnings and errors audit with final URL detail, issue source, and XLSX export per issue
  • Downloadable HTML report with executive summary, KPIs, warning/error types, and every crawl tab
  • Internal/external link analysis: inlinks, outlinks, depth, discovery sources, and broken links
  • Duplicates and quality: duplicate titles/meta/H1, thin content, near-duplicates, readability, and text ratio
  • Save/load crawls, Excel export per tab, and dedicated internal links export
  • Disk safety control: pauses the crawl if less than 10 GB is free to protect the computer
  • URL limit per project 100 URLs
  • Advanced configuration: scope, depth, delay, resource types, parameter filters, and normalization
  • Adaptive JavaScript rendering, dynamic URL extraction, and dedicated workers
  • Crawl vs Google Search Console and Crawl vs GA4 comparisons for HTML URLs only
  • PageSpeed Insights and CrUX for selected URLs with Core Web Vitals metrics
  • Server log import to cross real bot crawling with crawl URLs
  • Configurable visible fields, warning/error rules, and custom extractions

Personal use and testing

Download

Crawler SDR Pro

Detailed features

  • Clickable KPI panel and area tabs: links, titles, meta, H1/H2, content, images, canonicals, hreflang, AMP, structured data, sitemaps, and JavaScript
  • Technical and indexability audit: HTTP codes, redirects, robots.txt, meta/X-Robots, canonical, noindex, and hreflang
  • Warnings and errors audit with final URL detail, issue source, and XLSX export per issue
  • Downloadable HTML report with executive summary, KPIs, warning/error types, and every crawl tab
  • Internal/external link analysis: inlinks, outlinks, depth, discovery sources, and broken links
  • Duplicates and quality: duplicate titles/meta/H1, thin content, near-duplicates, readability, and text ratio
  • Save/load crawls, Excel export per tab, and dedicated internal links export
  • Disk safety control: pauses the crawl if less than 10 GB is free to protect the computer
  • URL limit per project Ilimitado*
  • Advanced configuration: scope, depth, delay, resource types, parameter filters, and normalization
  • Adaptive JavaScript rendering, dynamic URL extraction, and dedicated workers
  • Crawl vs Google Search Console and Crawl vs GA4 comparisons for HTML URLs only
  • PageSpeed Insights and CrUX for selected URLs with Core Web Vitals metrics
  • Server log import to cross real bot crawling with crawl URLs
  • Configurable visible fields, warning/error rules, and custom extractions

Crawler SDR PRO in BETA

Get PRO license

Conditions and estimates for unlimited crawling

Supported operating systems

  • Windows 10 64-bit or later
  • Windows 11 64-bit recommended
  • Not available for macOS, Linux, iOS, or Android

Minimum requirements

  • RAM: 8 GB minimum, 16 GB recommended, and 32 GB for large crawls with JavaScript
  • Disk: SSD with at least 10 GB free; the crawler pauses the analysis if it drops below that threshold
  • CPU: 4 cores minimum, 8 cores recommended for JavaScript rendering
  • Connection: stable and low-latency

Recommended usage

  • Free version: spot checks and small sites with a 100 URL limit per project
  • PRO license in beta: full audits, no internal depth limit, JavaScript rendering, HTML/XLSX exports, and advanced integrations
  • Unlimited crawling depends on the computer, free disk space, connection, robots.txt, and the response of the audited server

Estimated crawl time

Base configuration: domain scope, unlimited depth in PRO, robots.txt compliance, disk safety control, pause/resume, and configurable resource type.

HTML only

  • Up to 1,000 URLs: ~5–12 min
  • 10,000 URLs: ~1–3 h
  • 100,000 URLs: ~12–30 h

All resources (HTML + JS/CSS/images, etc.)

  • The number of rows can increase 2×–6× when including JS, CSS, images, and other resources
  • Times increase proportionally

If you enable “Render JS”

Time can increase 5×–15× depending on the site, configured workers, and the amount of JavaScript-generated content.

PRO integrations and enrichment

GSC and GA4 support up to 25,000 URLs per comparison. PageSpeed and CrUX are limited to 150 URLs per query. No query can exceed the number of crawled HTML URLs.