⚑ Native Rust CLI for Web Extraction

Turn Any Website Into Clean LLM Markdown

High-performance native command-line tool and agent interface for the Firecrawl v2 API. Scrape single pages, run asynchronous crawls, map sitemaps, and search the web with sub-5ms cold starts.

$cargo install --git https://github.com/SpaceCorps/Firecrawl-Cli --locked
πŸ“„

Single URL Scraping

Extract clean markdown, HTML, or raw HTML from dynamic JavaScript web pages with automatic ad-blocking, mobile viewport emulation, and tag filtering.

πŸ•·οΈ

Multi-Page Crawling

Initiate asynchronous crawls across full domains or regex paths. Poll status and download thousands of extracted pages with one command.

πŸ—ΊοΈ

Sitemap & Link Mapping

Quickly discover and rank all indexable links on any domain using search filters, subdomain controls, and smart sitemap discovery.

πŸ”Ž

Deep Web Search

Search the web and simultaneously extract full markdown content for the top results directly into your terminal pipeline.

πŸ€–

LLM Agent Ready

Default clean YAML output for terminal readability, deterministic --json mode for agent tool loops, and structured error envelopes on stderr.

πŸ”’

Native OS Keystores

Zero plaintext token leakage. API keys are encrypted directly in macOS Keychain, Windows DPAPI, or Linux Secret Service with multi-account isolation.

Command Reference

Straightforward, predictable syntax designed for both human developers and autonomous AI coding agents.

Command Description Example Usage
firecrawl scrape Extract content from a single web page firecrawl scrape https://example.com --formats markdown,html
firecrawl crawl start Initiate an asynchronous website crawl firecrawl crawl start https://docs.rs --limit 100 --max-depth 2
firecrawl crawl status Query progress and get scraped pages for a crawl firecrawl crawl status 550e8400-e29b-41d4-a716-446655440000
firecrawl crawl cancel Cancel an in-progress crawl job firecrawl crawl cancel 550e8400-e29b-41d4-a716-446655440000
firecrawl map Discover and filter all URLs across a website firecrawl map https://example.com --search "blog"
firecrawl search Search web and retrieve extracted page contents firecrawl search "Rust web frameworks" --limit 5
firecrawl login Authenticate with Firecrawl dashboard via browser firecrawl login [account_name]
firecrawl accounts Manage multiple accounts and API keys in keystore firecrawl accounts add work --api-key fc-xxx
firecrawl agent-readme Print embedded operating manual for LLM agents firecrawl agent-readme --json