Crawl API, Workflow Studio, and Forgot Password
Introduces the full Crawl API with SDK support, a visual workflow editor for automations, and the forgot password flow. Also adds scraping benchmarks and docs served as markdown for AI agents.
You can now crawl entire websites with the new POST /v1/crawl endpoint. Progressive depth crawling discovers and scrapes pages automatically, respecting robots.txt. Supports up to 100,000 pages and 50 levels of depth, with billing per page.
Both the Python and Node.js SDKs now include crawl methods. Start a crawl, check status, and retrieve results programmatically with the same familiar SDK interface.
A new visual workflow editor lets you build scraping automations on a drag-and-drop React Flow canvas. Connect scrape, HTTP request, webhook, email, and download nodes to create complex workflows.
New Features
10Crawl API launched
You can now crawl entire websites with the new POST /v1/crawl endpoint. Progressive depth crawling discovers and scrapes pages automatically, respecting robots.txt. Supports up to 100,000 pages and 50 levels of depth, with billing per page.
Crawl support in SDKs
Both the Python and Node.js SDKs now include crawl methods. Start a crawl, check status, and retrieve results programmatically with the same familiar SDK interface.
Crawl playground and demo
The playground now supports crawl mode with a visual config panel, depth slider, and animated multi-page results. The homepage demo shows live page discovery in action.
Crawl billing and cost tracking
Crawl costs appear in your usage breakdown and transaction history. The crawl status page shows per-page cost breakdowns, session totals, and automatic refunds for failed pages.
Visual workflow editor
A new visual workflow editor lets you build scraping automations on a drag-and-drop React Flow canvas. Connect scrape, HTTP request, webhook, email, and download nodes to create complex workflows.
Workflow templates gallery
A curated gallery of workflow templates helps you get started quickly. Browse pre-built templates and customize them for your use case.
Workflow run dashboard
Monitor your workflow executions in real-time with the run dashboard. View execution history, retry failed runs, and track progress.
Forgot password flow
You can now reset your password via email. The new forgot password page and backend flow lets you recover access to your account securely.
Scraping benchmarks page
A new benchmarks page shows real performance data and comparisons, so you can see how AlterLab performs across different website types and protection levels.
Docs available as markdown
Documentation pages are now served as markdown for AI agent consumption, along with a public OpenAPI spec and AI plugin manifest. This makes it easier for LLM-based tools to work with the AlterLab API.
Bug Fixes
1Usage log pagination fixed
Fixed an issue where usage logs paginated by raw database rows instead of top-level entries, causing confusing page counts when crawl jobs were present.
Plus 156 internal changes for stability and performance.