Documentation
Everything is also in the repository’s README and docs folder; this site organises it by task and keeps the reference tables in sync with the code.
Getting started
Install Arachnide, run your first crawl in two minutes and read the dashboard.
The interface
Every tab of the interface, from the overview to the specialised tables, and the keyboard shortcuts.
Crawl configuration
Every crawl option with its default value - limits, speed, robots.txt, rendering, scope, extraction, authentication, list and sitemap modes.
SEO issues and action plan
The issues page, the recommended priority, the fix panel, and the action plan you can work from and track.
Fix in 1 click
AI providers, each CMS connector and its prerequisites, and the safety model - human approval, journal, undo.
Site map and visualisations
The classic site map for reports and the 2D / 3D exploration view - crawl tree, directories, link graph, filters, inspector, exports.
Segments
Audit a large site section by section - rules on 20 fields, first match wins, one segment per directory, score and statistics per segment, global filter.
Google data, scheduled crawls and alerts
PageSpeed Insights and Core Web Vitals, Search Console by API or CSV, Google Analytics 4, scheduled crawls with e-mail alerts.
Client reports
The white-label PDF report in six languages, the comparison between two crawls, and the CSV exports.
AI agents - MCP, REST and OpenAPI
Connect Claude Desktop, Claude Code, claude.ai, ChatGPT or your own agent to Arachnide - three doors, 25 tools, the suggested system prompt and the security model.
Command line
The complete reference of node src/cli.mjs - every option with its default, outputs (NDJSON, CSV, HTML report), comparison, segments, resume, sitemap and extraction.
Large sites
The NDJSON format, the resume journal, list and sitemap modes, the 200 000-page benchmark and the crawl guard-rails added in 3.16 to 3.21.
FAQ
Installation, Chrome and JavaScript rendering, robots.txt in 5xx, old .json files, privacy, responsible use, and where to ask.
Changelog
One entry per version, generated from CHANGELOG.md in the repository. Release notes are written in English.