Arachne
Jun 03, 2026
First tests with Crawl4AI — Sidecar and Docker
Experimenting with Crawl4AI in Arachne: Docker Sidecar, Python SDK, comparison with Trafilatura, and the decision to use automatic fallback between engines.
Continue reading →
crawl4ai
3 posts
Browse by tags
debugging58security55testing54arachne52seguranca47dogwalk44automation43lifelog42portfolio42capivara42tatuengine40react38lessons38estudos38descobertas36studies34reliability32fastapi30watchdog28yurumi28refactoring22performance22rag22astro16python16quality16ssm16learning16llm16memory16false-positive16pipeline16css14observability14agents14frontend14embeddings14api14validation14ci-cd12ollama12e2e12nextjs12cache12qdrant12ci12process11architecture10ai10integrity10
Arachne
Jun 03, 2026
Arachne Was Born from Frustration — Broken Scrapers and Lost Data
Tired of scrapers that broke out of nowhere and expensive third-party services, I decided to build my own data extraction platform.
Continue reading →
Arachne
Jun 01, 2026
Arachne — the Scraper That Became a Platform
The real story of how a 200-line Python scraper became a platform with 740+ files, RAG, visual pipelines and 36 ReAct tools.
Continue reading →