TiloBox
Back to directory
Crawlee project preview

Crawlee

A web scraping and browser automation library for Node.js and TypeScript.

LicenseApache-2.0
GitHub stars15.5k
Last commit1 weeks ago
Tags6 topics
NodejsCrawlerProxy RotationWeb ScrapingHeadless BrowserTypescript
Overview

Why consider Crawlee?

Crawlee is an open-source web scraping and browser automation library for Node.js by Apify. It manages proxy rotation, request queues, anti-blocking fingerprints, and headless browser clusters.

Guided learning

Learn Crawlee by building

Practical setup notes, real use cases, and copy-ready examples in one focused guide.

1 min read 2 sections
In this guide2 sections

Overview of Crawlee

Crawlee builds resilient crawlers in JavaScript/TypeScript with automatic retry logic, session pooling, and full integration with Playwright, Puppeteer, and Cheerio.

Quickstart

bash
1npx crawlee create my-crawler
2cd my-crawler
3npm start

Crawlee is licensed under the Apache License Version 2.0.

Related tools

More options with a similar category or technology profile.

Crawlee FAQs

Crawlee is listed as a Developer Tools tool on TiloBox. Review the overview, features, and official documentation on this page to decide whether it solves your specific workflow.

Start with the project's GitHub repository and official website for supported installation and deployment instructions. Test the setup with representative data or a small project before rolling it out more widely.

Crawlee is listed under the Apache-2.0 license. Read the complete license text and the project's notices before using, modifying, or distributing the software.

Production readiness depends on your requirements. Review maintenance activity, security practices, documentation, backup and upgrade procedures, and compatibility with your stack; then validate it in a non-production environment.

Crawlee is listed as an alternative to ParseHub. Compare the core workflow, deployment model, integrations, and licensing against your must-have requirements before switching.