crawlie
github.com/spronta/crawlieCrawlie crawls websites for technical SEO and GEO analysis, with an open-source codebase.
Looking for something like Screaming Frog SEO Spider? Here are 24 alternatives, ranked by how closely they match it on purpose, features and platforms. Of these, 1 are free or have a free plan and 13 are open source.
Crawl websites for SEO audits on Windows, macOS and Ubuntu using the Screaming Frog SEO Spider.
| # | Alternative | Pricing | Open source | Platforms |
|---|---|---|---|---|
| 1 | crawlie | — | Not stated | — |
| 2 | Seodity | — | Not stated | Android, iOS, Web |
| 3 | SiteAnalyzer | — | Not stated | Web |
| 4 | LibreCrawl | — | Not stated | Web |
| 5 | Sitebulb | Free trial | Not stated | Web |
| 6 | tech-seo-audit-skill | — | Yes | — |
| 7 | Screpy | — | Not stated | Web |
| 8 | Python SEO Analyzer | — | Not stated | — |
| 9 | linkinator | — | Yes | — |
| 10 | Seo-Promt-Master | — | Yes | — |
Crawlie crawls websites for technical SEO and GEO analysis, with an open-source codebase.
Analyze websites with SEO tools that include a site crawler, keyword research and backlink analysis.
Crawl websites and run technical SEO audits with SiteAnalyzer, which supports multiple interface languages.
Crawl websites for SEO audits with this free, open-source tool, which supports JavaScript rendering and unlimited URLs.
Crawl websites for SEO audits with desktop or cloud software that checks technical site structure.
Analyze crawl data and identify technical SEO issues with this audit skill for Claude.
Audit websites for technical SEO issues, page content, links and images with Screpy's analysis tools.
Crawl a website, count page text and analyze site structure for technical SEO issues with this Python tool.
Crawl websites, documentation and local files to find broken links and invalid URLs with this link checker.
Use Google's SEO documentation as an AI prompt skill and run a tool to map routes and audit pages.
Generate technical SEO audit reports for individual pages with reusable skills for AI agents.
Use an SEO agent skill to audit, diagnose and plan website optimization across Google, Bing and AI search.
Scan websites for broken links and technical SEO issues, then export reports to Excel with SEOMacroscope.
30x-seo packages 23 Claude Code skills for technical SEO, content optimization, keyword research, backlink analysis, and AI visibility monitoring.
Add technical SEO and answer engine optimization features to Nuxt projects with this Nuxt SEO module.
This Claude Code plugin provides SEO workflows, including a project wiki, DataForSEO tasks, content briefs, and technical SEO.
EcommerceTools offers Python data science utilities for e-commerce, marketing science, and technical SEO analysis and modeling.
Codex SEO is a skill suite for SEO workflows, with agents and integrations for data, search, site performance, schema, and reporting.
Claude SEO provides workflows for technical SEO, schema, AI search optimization, backlinks, local search, and reporting.
This Claude Code project uses DataForSEO for keyword research, rank tracking, backlink audits, technical crawls, competitor analysis, and PDF reports.
Crawl and analyze websites for SEO, security, accessibility and performance with this cross-platform tool.
Cited By AI audits how often websites appear in answers from ChatGPT, Perplexity, Claude, Gemini, and Copilot.
Audit websites and generate SEO reports with SEOnaut, an open-source tool for checking crawlability.
CognitiveSEO provides backlink analysis, content audits, and rank tracking for websites.
Alternatives are suggested from the purpose and features described in our listings. Different pages for the same product appear once. Read each description to check whether it fits your task. How we choose alternatives · Suggest an alternative