diff --git a/README.md b/README.md index 75e9016..91dd1ba 100644 --- a/README.md +++ b/README.md @@ -1,28 +1,60 @@

- +

TRAWL

-## **Welcome** to **TRAWL**! 👋 +## **Welcome** to **TRAWL**! 👋 -Self-hosted web scraping engine with adaptive tier execution. Solves Cloudflare challenges natively using [Camoufox](https://github.com/daijro/camoufox) Firefox. Returns cached results in under 500ms. Drop-in FlareSolverr v2 replacement. +Self-hosted web scraping engine that bypasses any JS challenge & captcha.\ +Support for: Cloudflare, Turnstile, Interstitial, reCAPTCHA, hCaptcha, GeeTest, Imperva (experimental).\ +Much faster and more reliable FlareSolverr & Byparr alternative and drop-in replacement for your \*arr stack. ## Features -- **4-tier execution** — plain HTTP → cached session → fresh CF solve → residential proxy -- **Native captcha solving** — CF Turnstile, reCAPTCHA v2 (free STT), hCaptcha, GeeTest v4 Slide -- **Camoufox Firefox** — fingerprint-patched at the C++/Juggler level; indistinguishable from a real browser -- **Session cache** — `cf_clearance` cookies stored in Redis; repeat requests to the same domain return in ~500ms -- **FlareSolverr v2 compatible** — works with Prowlarr, Jackett, Sonarr, Radarr, and the full \*arr ecosystem out of the box -- **No external APIs** — reCAPTCHA audio transcription uses Google's free STT endpoint by default; everything else is local +- **2-6x faster** - compared to FlareSolverr or Byparr it returns much faster with higher success rate +- **4-tier execution** - plain HTTP fetch → cached browser session → fresh CF solve → residential proxy +- **Native captcha solving** - Cloudflare Turnstile/Interstitial, reCAPTCHA v2 (free STT), hCaptcha, GeeTest v4 Slide +- **Camoufox Firefox** - anti-detect; fingerprint-patched at the C++/Juggler level; indistinguishable from a real browser +- **Session cache** - captcha/challenge cookies stored in Redis; repeat requests to the same domain return in ~500ms +- **FlareSolverr v2 compatible** - works with Prowlarr, Jackett, Sonarr, Radarr, and the full \*arr ecosystem out of the box +- **No external APIs** - reCAPTCHA audio transcription uses Google's free STT endpoint by default; everything else is local + +## Sponsors + +
+ View/Collapse All + + + + + + +
+ + nodemaven + + + NodeMaven - The most reliable proxy provider with the Highest Quality IP on the market.
+ Best solution for automation, web scraping, SEO research, and social media management.

+ Why NodeMaven?
+ • 99.9% uptime
+ • Sticky sessions up to 7 days
+ • IP filtering: all proxies have fraud score <97%
+ • No KYC required
+ • Cashback on traffic - burn GB and earn up to 10% back

+ Special codes for TRAWL users:
+ • TRAWL35 - 35% off to Mobile and Residential Proxies
+ • TRAWL40 - 40% off to ISP (Static) Proxies +
+
## Quick start ```bash # Clone and configure -git clone https://github.com/germondai/trawl.git +git clone https://github.com/germondai/git cd trawl cp .env.example .env