Crawly extracts structured content from websites by crawling pages across a site.

crawly.diffbot.com
Crawly homepage screenshot

About Crawly

Crawly is a web-based crawler by Diffbot that extracts structured content from websites. A user inputs a website, and the tool crawls pages across the site to extract article fields such as title, text, date, author, images, and publisher information. Results can be downloaded as CSV or JSON.

Key features

  • Crawls pages across a website from one input
  • Extracts article title, text, HTML, comments, and date
  • Extracts author name, author URL, and entity tags
  • Extracts images, videos, publisher name, country, and language
  • Downloads extracted data as CSV or JSON
Best for: People who need structured article data from websites for use as CSV or JSON.
Good for
  • Crawls pages across a site from one website input
  • Extracts multiple article fields including text, date, and media
  • Provides CSV and JSON download options

Crawly at a glance

Type
Website
Pricing
Not confirmed. Check the site
Platforms
Web
Open source
Not stated
Last checked
Oct 5, 2026 · Online when checked
Listed
Oct 5, 2026

Crawly alternatives

Tools and sites you could use instead, ranked by how closely they match.

All 7 alternatives

Popular in Everyday Web Utilities

Well-known listings from the same topic.

All 50

Crawly FAQ

What input does Crawly need?
A website address to crawl and extract.
What article data does it extract?
Title, text, HTML, comments, date, entity tags, author, author URL, images, videos, publisher country, publisher name, and language.
How can results be saved?
Extracted data can be downloaded in a CSV or as JSON.
Is something wrong or out of date?

Tell us and an editor will check it.

Own this website?

Claim the listing and suggest updates yourself. An editor checks every claim first.

Claim this listing