FoxScrape

How do I integrate the web scraping API into my application?

Integrating our web scraping API is simple. We provide a RESTful API that accepts JSON requests and returns structured JSON responses. You can make requests using any HTTP client in your preferred language (Python, JavaScript, PHP, Ruby, etc.). We provide comprehensive API documentation with code examples, and offer official SDKs for Python and JavaScript to make integration even easier. Authentication is done via API key, which you can generate from your dashboard.

What API response formats do you support?

Our scraping API returns data in JSON format by default, which is the industry standard for REST APIs. The JSON response includes the extracted data, metadata about the request (status, credits used, processing time), and any warnings or errors. For AI-powered extraction, you can specify your desired schema, and we'll return the data in that exact structure. We also support custom response transformations and webhooks for asynchronous processing.

Is there a Python or JavaScript SDK for your scraping API?

Yes! We offer official SDKs for both Python and JavaScript/Node.js to make API integration seamless. Our SDKs handle authentication, request formatting, error handling, and retries automatically. You can install them via pip (Python) or npm (JavaScript). The SDKs include TypeScript definitions, comprehensive documentation, and code examples. If you prefer to use the raw REST API endpoints directly, that's supported too with any HTTP client.

What happens if an API request fails?

If an API request fails, you won't be charged any API credits. We have built-in retry logic that automatically attempts to complete your request up to 3 times with exponential backoff. If all attempts fail, the API returns a detailed error response with a specific error code and message explaining what went wrong. You can then adjust your request parameters accordingly. All failed requests are logged in your dashboard for debugging, including the full request/response details.

What is an API Credit?

An API Credit is a unit of measurement for our scraping API usage. Each API request consumes credits based on the complexity of the task. Simple HTTP requests use 1 credit, JavaScript rendering uses 5 credits, AI-powered extraction uses 10 credits, and screenshots use 2 credits. Your plan includes a monthly credit allocation, and you can track your real-time usage via the API or dashboard. Unused credits don't roll over, but you can upgrade or purchase additional credits anytime.

Can the API handle JavaScript-heavy sites and single-page applications?

Absolutely! Our web scraping API includes full JavaScript rendering powered by headless Chrome. Simply enable the 'js_rendering' parameter in your API request to scrape React, Vue, Angular, Next.js, and other modern JavaScript frameworks. You can also execute custom JavaScript code, wait for specific elements, scroll, click buttons, and handle dynamic content. This makes our API perfect for scraping SPAs, infinite-scroll pages, and AJAX-loaded content.