Network intercept
Navigate any website’s network traffic to analyze its communications to outside resources. Optimize your scraping by going for the source of information.
All requests made using the Zyte API with Browser rendering provide access to the network intercept feature in the API debugger. This feature enables you to intercept headers, cookies, and all the requests a website makes to gather content from external sources, such as APIs, other websites, and JSON files.
Intercept patterns after browser actions
The Zyte API includes a powerful headless browser allowing network capture before and after mimicking user actions such as click, scroll, and type.
Replicate requests in your spiders
By understanding how a website sources data, you can directly replicate requests to APIs and external resources in your spiders. This approach saves time and reduces costs associated with browser rendering and screenshots.
Advanced filtering options on intercepted patterns
Utilize advanced filtering options to process only the pattern types that matter, streamlining your network analysis and saving time.
Use this handy tutorial to get started with Zyte API in minutes.
1from base64 import b64decode
2
3import requests
4
5api_response = requests.post(
6 'https://api.zyte.com/v1/extract',
7 auth=('YOUR_API_KEY', ''),
8 json={
9 'url': 'https://toscrape.com',
10 'httpResponseBody': True,
11 },
12)
13http_response_body: bytes = b64decode(
14 api_response.json()['httpResponseBody']
15)We know your projects are unique, we don’t force you into a “package”. Instead, we price Zyte API around you. Below we’ve shown some examples, based on extraction complexity.
Network intercept
Navigate any website’s network traffic to analyze its communications to outside resources. Optimize your scraping by going for the source of information.
All requests made using the Zyte API with Browser rendering provide access to the network intercept feature in the API debugger. This feature enables you to intercept headers, cookies, and all the requests a website makes to gather content from external sources, such as APIs, other websites, and JSON files.
Intercept patterns after browser actions
The Zyte API includes a powerful headless browser allowing network capture before and after mimicking user actions such as click, scroll, and type.
Replicate requests in your spiders
By understanding how a website sources data, you can directly replicate requests to APIs and external resources in your spiders. This approach saves time and reduces costs associated with browser rendering and screenshots.
Advanced filtering options on intercepted patterns
Utilize advanced filtering options to process only the pattern types that matter, streamlining your network analysis and saving time.
Use this handy tutorial to get started with Zyte API in minutes.
1from base64 import b64decode
2
3import requests
4
5api_response = requests.post(
6 'https://api.zyte.com/v1/extract',
7 auth=('YOUR_API_KEY', ''),
8 json={
9 'url': 'https://toscrape.com',
10 'httpResponseBody': True,
11 },
12)
13http_response_body: bytes = b64decode(
14 api_response.json()['httpResponseBody']
15)We know your projects are unique, we don’t force you into a “package”. Instead, we price Zyte API around you. Below we’ve shown some examples, based on extraction complexity.
| Website Tier | Website Distribution | Technology | PAYG | $100* | $200* | $350* | $500* |
|---|---|---|---|---|---|---|---|
| 1 | $0.13 | $0.10 | $0.08 | $0.07 | $0.06 | ||
| 2 | $0.23 | $0.17 | $0.14 | $0.12 | $0.11 | ||
| 3 | $0.43 | $0.32 | $0.26 | $0.22 | $0.21 | ||
| 4 | $0.70 | $0.52 | $0.42 | $0.36 | $0.33 | ||
| 5 | $1.27 | $0.95 | $0.76 | $0.65 | $0.60 |
| Website Tier | Website Distribution | Technology | PAYG | $100* | $200* | $350* | $500* |
|---|---|---|---|---|---|---|---|
| 1 | $1.00 | $0.75 | $0.60 | $0.52 | $0.47 | ||
| 2 | $2.00 | $1.50 | $1.20 | $1.03 | $0.95 | ||
| 3 | $4.00 | $3.00 | $2.40 | $2.06 | $1.89 | ||
| 4 | $7.99 | $5.99 | $4.79 | $4.12 | $3.79 | ||
| 5 | $15.98 | $11.98 | $9.58 | $8.25 | $7.58 |
Data centre proxies
Residential proxies
Compute
PAYG (Pay As You Go - up to $100/month)
*monthly commitment
| Website Tier | Website Distribution | Technology | PAYG | $100* | $200* | $350* | $500* |
|---|---|---|---|---|---|---|---|
| 1 | $0.13 | $0.10 | $0.08 | $0.07 | $0.06 | ||
| 2 | $0.23 | $0.17 | $0.14 | $0.12 | $0.11 | ||
| 3 | $0.43 | $0.32 | $0.26 | $0.22 | $0.21 | ||
| 4 | $0.70 | $0.52 | $0.42 | $0.36 | $0.33 | ||
| 5 | $1.27 | $0.95 | $0.76 | $0.65 | $0.60 |
| Website Tier | Website Distribution | Technology | PAYG | $100* | $200* | $350* | $500* |
|---|---|---|---|---|---|---|---|
| 1 | $1.00 | $0.75 | $0.60 | $0.52 | $0.47 | ||
| 2 | $2.00 | $1.50 | $1.20 | $1.03 | $0.95 | ||
| 3 | $4.00 | $3.00 | $2.40 | $2.06 | $1.89 | ||
| 4 | $7.99 | $5.99 | $4.79 | $4.12 | $3.79 | ||
| 5 | $15.98 | $11.98 | $9.58 | $8.25 | $7.58 |
Data centre proxies
Residential proxies
Compute
PAYG (Pay As You Go - up to $100/month)
*monthly commitment