Crawlee
A framework for building web crawlers and scrapers.
What it does
A framework for building web crawlers and scrapers.
When it fits
Collecting webpage data with request management and browser integration.
Other options in this category
- AdonisJS — Building a backend with established conventions and integrated tooling.
- H3 — Writing composable request handlers across supported JavaScript runtimes.
- Hono — Implementing compact APIs with web-standard request and response objects.
- Shovel — Writing portable request handlers for Node.js, Bun, and Cloudflare Workers.
- ws — Adding bidirectional realtime communication to a server application.
Source
Editorial overview reviewed on October 24, 2026. Follow the source for current setup, compatibility, and licensing.