Free playground is rate-limited & ephemeral — self-host in 30s for unlimited use.
Open Source · MIT One binary · $5/mo ~200ms static

Turn any website into LLM-ready markdown in 200ms

Self-hosted Firecrawl alternative. Smart static → dynamic fallback, readability cleaning, and parallel crawling — without the per-token bill.

Run with Docker Star on GitHub Try playground free · limited

No signup · No API key for self-host · Playground is just a preview

terminal
git clone https://github.com/Michael-Obele/tomoshibi.git && cd tomoshibi
docker compose up -d
All 5 services on 7431–7435

560 req/s p50 11ms vs Firecrawl self-hosted 1.9 req/s p50 5.4s — ~300× throughput. Same $0. See benchmark

GitHub GitHub stars Go 1.25+ · Gin + Chromedp + Colly MIT · No telemetry tomoshi CLI npm version
Why self-host?

Stop paying per scrape

Hosted APIs charge by the token and throttle you. Tomoshibi runs on your metal.

Paying $0.01–0.10 per scrape

Rate limits, quotas, and surprise bills when you scale RAG.

$0 self-hosted — one binary, hobby-tier RAM
500ms Chrome spawn per request

Spawning a browser per scrape kills throughput.

Shared allocator + recycled tabs → ~200ms
JS SPAs return empty HTML

Static scrapers miss React/Vue content.

Smart mode: static first, Chromedp fallback
Noisy HTML
Nav/ads/footer pollute the LLM context. → Readability + ad block → clean markdown.
Crawl needs a fleet
Separate worker fleet per container. → Monolith: Gin + Asynq in one process.
Search costs extra
Another API, another bill. → Built-in SearXNG, 560 req/s.

Free playground vs self-hosted

The hosted playground is a preview — rate-limited, ephemeral, and shared. For anything real, run it yourself.

Free playground
Preview only

Try it in the browser — no install.

Rate-limited & shared
No crawl / batch / monitor without Redis
Data not persisted
Best for quick tests
Open playground
Recommended · Most Popular
Self-hosted
$0 + $5/mo infra

Unlimited, private, and fast — your infra, your data.

Unlimited scrape / crawl / batch / search
All 5 services + SearXNG + Redis
Private — no data leaves your VPC
512MB–1GB hobby tier · Fly / Render / Docker
Docker Compose

One command · Ports 7431–7435 · No clash with 3000/8080

From zero to markdown in 30 seconds

No SDK, no dashboard, no API key dance.

1

Clone & up

docker compose up -d

API 7431 · Web 7432 · MCP 7433 · Redis 7434 · SearXNG 7435

2

Scrape anything

POST /v1/scrape {url}

Smart mode auto-picks static or Chromedp

3

Get LLM-ready data

Markdown + metadata + links + optional screenshot

Crawl, batch, search, monitor — same API

Read quick start API reference

Keep Tomoshibi free & open

Tomoshibi is MIT-licensed and built in the open. Sponsorship funds Chromedp upkeep, SearXNG tuning, and hobby-tier performance work — so self-hosting stays $0.

Sponsor on GitHub Star the repo

Stars drive discovery · Sponsors fund maintenance · Both keep the free tier alive

Self-host Tomoshibi today

One binary, one compose file, no vendor lock-in. Your data never leaves your machine.

docker compose up -d View on GitHub
MIT License Docker Hub & GHCR tomoshi CLI on npm