Enhanced Reliability and Analytics
This release focuses on dramatically reducing scraping exhaustion errors and ensuring POST requests execute flawlessly. We have also enhanced our usage analytics accuracy and published comprehensive documentation to streamline your API integrations.
You can now use any HTTP method and include custom request bodies in your scraping tasks. This provides the flexibility needed to interact with complex web applications and authenticated endpoints.
Access 12 new micro-tools directly on our platform, including a JSON validator, HTTP header checker, and robots.txt tester. These utilities help you debug and verify web requests without leaving your browser.
We have optimized our data extraction engine to significantly reduce latency and unblock processing loops. These changes ensure faster response times and higher throughput for your most demanding scraping jobs.
New Features
2Expanded HTTP Method Support
You can now use any HTTP method and include custom request bodies in your scraping tasks. This provides the flexibility needed to interact with complex web applications and authenticated endpoints.
New Free Developer Tool Suite
Access 12 new micro-tools directly on our platform, including a JSON validator, HTTP header checker, and robots.txt tester. These utilities help you debug and verify web requests without leaving your browser.
Improvements
9Worker Performance Optimization
We have optimized our data extraction engine to significantly reduce latency and unblock processing loops. These changes ensure faster response times and higher throughput for your most demanding scraping jobs.
Support for Large Request Payloads
We have removed system limits on request body sizes, allowing you to send payloads larger than 2MB. This enables more complex interactions with enterprise sites that require large data transfers.
Optimized Webhook Delivery
A new concurrency management system ensures that one slow destination endpoint won't delay deliveries to your other webhooks. This provides more predictable and reliable event streaming at high volumes.
Accurate System Health Monitoring
The health check endpoint now provides a real-time status of critical system dependencies rather than a static response. This allows your monitoring tools to receive a more accurate picture of platform availability.
Graceful Job Completion
Improved system shutdown procedures ensure that in-flight scraping jobs and webhooks are given dedicated time to finish gracefully during maintenance. This reduces the risk of interrupted data delivery.
General bug fixes and improvements
Plus 5 internal improvements for better reliability and performance.
Increased browser scraping capacity
We have significantly scaled our backend infrastructure to handle heavy browser-based scraping workloads. You will experience drastically fewer pool exhaustion errors and improved success rates during high-concurrency operations.
Automatic search query retries
Search API requests now feature intelligent exponential backoff when encountering upstream rate limits. This minimizes failed requests and ensures smoother data retrieval without requiring manual retry logic on your end.
Comprehensive API documentation updates
We have expanded our developer documentation to cover essential topics like authenticated scraping, webhooks, and account limits. This includes updated guides for our SDKs and custom proxy configurations to help you build faster.
Bug Fixes
7Improved Geolocation Logic
Your location settings are now correctly applied across all request types, including browser-based scraping. This ensures you receive localized content reliably without being blocked by regional filters.
Reliable Domain Scraping
Fixed routing issues affecting major retail and Q&A platforms that previously caused intermittent failures. These domains now correctly utilize the necessary resources for successful and consistent data extraction.
General Platform Stability
This update resolves several minor issues, including support file upload errors, dashboard filter bugs, and broken shortcut links to the browser extension.
Reliable POST request bodies
POST requests sent through our scraping API now correctly pass the request body payload to the target server. A routing bug that caused payloads to be silently dropped under specific configurations has been fully resolved.
Accurate batch rate limiting
Batch endpoints for scraping and searching now correctly apply rate limits based on the total number of items in the request. This ensures fairer platform resource distribution and consistent performance for all API consumers.
Accurate request failure analytics
Analytics dashboards now correctly categorize rejected requests and handle malformed HTTP methods gracefully. This provides much clearer insights into request failures and ensures your usage metrics load without interruption.
Corrected custom proxy parameters
Custom proxy reordering parameters are now accurately validated as query parameters rather than request body fields. This prevents unexpected validation errors when configuring complex proxy sequences.
Security
2Secure SSL Validation Utility
Enhanced the security of our SSL checking tool by implementing stricter network access controls. These updates prevent unauthorized network probes while maintaining accurate certificate validation for users.
Enhanced SSL checker security
We addressed a vulnerability in our API's SSL checker tool that could have allowed restricted local network addresses to be queried. The tool now strictly filters out all internal IP ranges to ensure secure external operation.
Plus 18 internal changes for stability and performance.