Monolith saves complete web pages as a single HTML file through a command-line tool and library.
Open source
24 alternativesSuckIT
SuckIT recursively downloads website content for offline navigation, with options for delays, multithreading, and saved crawl state.
About SuckIT
SuckIT is an open-source command-line tool, written in Rust, that recursively visits a website and writes its content to disk so the pages can be navigated offline. Crawling is configurable through options for recursion depth, regex filters on which pages are visited or saved, HTTP basic authentication credentials, cookies, custom user agents, retry counts, and delays between downloads, including an added random delay. It supports multithreading and saves application state when stopped with CTRL-C so a crawl can be picked up later. According to the README, it does not work on Windows, and installing it requires Rust.
Key features
- Recursively downloads a website's content to disk for offline navigation
- Multithreaded crawling with a configurable number of concurrent jobs
- Base and random delays between downloads to reduce IP banning risk
- Saves application state on CTRL-C for a later pickup
- Regex include and exclude filters for visiting and downloading pages
- Separate recursion depth limits for internal and external domains
Best for: Developers and researchers on Linux or other non-Windows systems who want a configurable command-line crawler for saving a site for offline browsing.
Good for
- Distributed under both the MIT and Apache-2.0 licenses
- Crawl behavior is adjustable via depth, filter, delay, thread and retry options
- Supports HTTP basic authentication, cookies and custom user agents
Watch out for
- Does not work on Windows as of the README
- Installing requires having Rust installed
- Default settings are one thread and zero delay, so options may need tuning
SuckIT at a glance
- Website
- github.com/skallwar/suckit
- Category
- Search & Reference › Web Archives
- Type
- Open-source project
- Pricing
- Not confirmed. Check the site
- Open source
- Yes · Source code
- Language
- English
- Last checked
- Oct 6, 2026 · Online when checked
- Listed
- Oct 5, 2026
SuckIT alternatives
Tools and sites you could use instead, ranked by how closely they match.
The Internet Archival Bot repository contains a Discord bot project related to Internet Archive, with its source on GitHub.
DownloadNet evolved into Tree Document Format, a web collection format captured by Tree Grower and replayed with Tree Player.
The Internet Archive title describes a digital library with borrowable books, movies, music, and the Wayback Machine.
Pick
24 alternatives
Check whether cached versions of a web page are available through Google, Bing, or web archive services.
The official HTTrack repository contains source code for the website copier, which saves website content locally for offline use.
Open source
24 alternativesPopular in Web Archives
Well-known listings from the same topic.
Wayback Machineweb.archive.orgHTTrackhttrack.comArchiveWeb.pagearchiveweb.pageArchiveBoxarchivebox.ioArchivematicaarchivematica.orgWebrecorderwebrecorder.net
SuckIT FAQ
Does SuckIT run on Windows?
No. The README states that as of right now SuckIT does not work on Windows.
How do I install SuckIT?
With Rust installed, run cargo install --git https://github.com/skallwar/suckit. On Arch Linux it can also be installed from AUR packages with an AUR helper.
Can an interrupted crawl be resumed?
Yes. SuckIT saves application state on CTRL-C so the crawl can be picked up later.
Is something wrong or out of date?
Tell us and an editor will check it.
Own this website?
Claim this listing
Claim the listing and suggest updates yourself. An editor checks every claim first.