State of Web Access2026

What's unusual about Chad is not the barrier stack — it's the AI-first robots.txt posture. AI crawlers are the single most-named bot category at 16.9% of sites, ahead of SEO search bots and SEO audit tools alike — an ordering rarely seen elsewhere in the survey.

State of Web Access 2026
Chad · Barrier Profile · 2026

JavaScript and CAPTCHA lead Chad's secondary barriers

JavaScript and CAPTCHA lead Chad's secondary barriers
Value
WAF91.8%
Antibot18%
CAPTCHA24.8%
JavaScript38.3%
Rate Limiting13.3%
TLS18.6%

WAF reaches 91.8% of Chad's 705 surveyed sites. JavaScript (38.3%) leads the secondary stack; CAPTCHA (24.8%) outranks Antibot (18.0%) by 6.8 points, with TLS (18.6%) and Rate Limiting (13.3%) trailing.

705 sites
State of Web Access 2026
Chad · Barrier Adoption · 2026

JavaScript tops Chad's active secondary defences

JavaScript tops Chad's active secondary defences
Value
WAF91.8%
Antibot18%
CAPTCHA24.8%
JavaScript38.3%
Rate Limiting13.3%
TLS18.6%
Has robots.txt78.6%
Blocks AI crawlers14%

WAF is present across 91.8% of Chad's surveyed sites. JavaScript leads secondaries at 38.3%; CAPTCHA (24.8%) and TLS (18.6%) are separated by 6.2 points, with Antibot (18.0%) close behind.

705 sites
State of Web Access 2026
Chad · Barrier Stacking · 2026

One-barrier sites are Chad's most common configuration

One-barrier sites are Chad's most common configuration
% of sites
0 barriers5.5%
1 barrier34.2%
2 barriers30.5%
3 barriers16.9%
4 barriers6.7%
5 barriers5.1%
6 barriers1.1%

34.2% of Chad's sites carry exactly one barrier — the most common count. Two-barrier sites follow at 30.5%. Sites with three or more barriers account for 29.8%; 5.5% present no detectable barrier.

705 sites
State of Web Access 2026
Chad · Recommended Zyte API Tier · 2026

Most Chad sites are Simple to access

Most Chad sites are Simple to access
Mean recommended tier
All sites1.5

A median browser tier of 1 places more than half of Chad's 705 sites in Tier 1. The mean of 1.54 is lifted by the 8.3% of sites at Tier 3 or above.

705 sites
State of Web Access 2026
Chad · Zyte API Tier Distribution · 2026

Nearly six in ten Chad sites are Simple to access

Nearly six in ten Chad sites are Simple to access
% of sites
1 - Simple57.4%
2 - Easy34.3%
3 - Moderate5.4%
4 - Complex2%
5 - Advanced0.9%

Tier 1 accounts for 57.4% of Chad's sites; Tier 2 adds 34.3%, bringing the combined share to 91.7%. Tier 3 takes 5.4%, Tier 4 takes 2.0%, and Tier 5 accounts for 0.9%.

705 sites
State of Web Access 2026
Chad · Bot Category Mentions in <code>robots.txt</code> · 2026 · 705 Sites

AI crawlers top Chad's robots.txt bot categories

AI crawlers top Chad's robots.txt bot categories
% of sites
AI crawlers16.9%
SEO / search indexing12.1%
SEO audit tools14.8%
Commercial scrapers8.9%
Social / content scrapers7.4%
Archive / research crawlers6.1%
Monitoring / uptime bots0.3%

AI crawlers are named in robots.txt by 16.9% of Chad's 705 sites. SEO audit tools (14.8%) rank second — ahead of SEO / search indexing (12.1%) — an ordering that sets Chad apart from many markets.

705 sites
State of Web Access 2026
Chad · <code>robots.txt</code> Rule Posture Types · 2026 · 705 Sites

Uniform rules are Chad's most common robots.txt posture

Uniform rules are Chad's most common robots.txt posture
% of sites
Uniform per-agent rules (no path mixing)37.7%
Path-level mixed rules for same agent34.9%
Allow-only (no disallow rules)3%
Mixed AI posture (block some, allow others)2.6%
Blanket Disallow: /2.7%

21.4% of Chad's sites carry no robots.txt. Of those that do, 37.7% of all sites use uniform per-agent rules and 34.9% use path-level mixed rules — a gap of only 2.8 points.

705 sites
State of Web Access 2026
Chad · AI Agent <code>Disallow</code> vs <code>Allow</code> · 2026 · 705 Sites Surveyed

GPTBot faces the most Disallow rules in Chad's robots.txt

GPTBot faces the most Disallow rules in Chad's robots.txt
DisallowedAllowed (whitelisted)
GPTBot11.1%1.1%
CCBot9.1%0.7%
ClaudeBot9.2%0.6%
Google-Extended9.8%1%
Bytespider7.4%0.3%
meta-externalagent3.3%
ChatGPT-User6.1%2.7%
PerplexityBot6.7%2%
Applebot-Extended5%0.3%
OAI-SearchBot3.7%2.1%
anthropic-ai4.8%0.3%

Of Chad's 705 sites, GPTBot is named in a Disallow rule by 11.1%. ChatGPT-User holds the highest explicit Allow rate at 2.7%, ahead of OAI-SearchBot at 2.1%.

705 sites surveyed · 554 with robots.txt
State of Web Access 2026
Chad · Named-Bot <code>Disallow</code> Rate by Industry · Top 15 · 2026

Multiple Chad sectors all name at least one bot to restrict

Multiple Chad sectors all name at least one bot to restrict
% of sites
Design100%
Entertainment100%
Museums100%
Retail100%
Adult90%
Apparel & Fashion90%
Gambling90%
General90%
Mass Media90%
Newspapers90%
Online Services90%
Publishing90%
Renewable Energy90%
Telecom90%
Sporting Goods83.3%

Design, Entertainment, Museums, and Retail each see every sampled site naming at least one bot to restrict in robots.txt. A further ten sectors in this ranking stand at 90% or above.

Most categories n=10 — each site = 10 percentage points · 705 Chad sites
State of Web Access 2026
Chad · Explicit Bot <code>Allow</code> / Whitelist Rate by Industry · Top 15 · 2026

Museums and Sporting Goods lead Chad's explicit bot Allow rate

Museums and Sporting Goods lead Chad's explicit bot Allow rate
% of sites
Museums83.3%
Sporting Goods83.3%
Airlines70%
Design70%
Photography70%
Retail70%
Travel & Tourism70%
Agriculture66.7%
Advertising & Mktg60%
Architecture60%
Ecology & Environment60%
IT Services60%
Import & Export60%
Publishing60%
Renewable Energy60%

Museums and Sporting Goods are tied at 83.3% for the highest named-bot Allow rate among Chad's industries. Airlines and Design follow at 70% each. Some sectors that heavily block bots also lead in explicit Allow rules.

Most categories n=10 — each site = 10 percentage points · 705 Chad sites
State of Web Access 2026
Chad · Scraping Difficulty by Industry · Top 15 by Mean Tier · 2026

Retail is Chad's hardest sector to access programmatically

Retail is Chad's hardest sector to access programmatically
WAFAntibotCAPTCHAJavaScriptRate LimitTLSrobots.txtBlocks AITier
Retail100%10%0%70%10%10%100%50%Tier 2
Airlines90%10%10%50%20%20%80%20%Tier 2
Consumer Electronics70%40%10%40%10%20%70%20%Tier 2
Human Resources100%50%20%40%30%10%70%0%Tier 2
Sports90%20%20%50%20%10%80%30%Tier 2
Hospitality100%10%10%30%20%20%70%0%Tier 2
Apparel & Fashion100%10%20%40%10%40%90%10%Tier 2
Adult100%20%20%60%10%0%90%20%Tier 2
Transport & Logistics80%40%30%10%10%50%60%10%Tier 2
Travel & Tourism100%10%10%70%40%20%70%30%Tier 2
Automotive80%10%20%20%10%20%70%0%Tier 2
Design100%30%30%30%30%40%100%30%Tier 2
Education100%20%10%40%20%10%80%10%Tier 2
Music100%20%30%60%40%0%80%30%Tier 2
Non-Profit90%0%10%40%10%30%70%10%Tier 2

Retail averages a mean browser tier of 2.50 across Chad's surveyed sites — the highest of any industry. Airlines follows at 2.35, with Consumer Electronics (2.30) next. Human Resources and Sports share the following rank at 2.20.

Top 15 industries by mean Zyte browser tier · 705 sites
State of Web Access 2026
Chad · Scraping Difficulty by Industry · Bottom 15 by Mean Tier · 2026

Healthcare leads Chad's most accessible sectors

Healthcare leads Chad's most accessible sectors
WAFAntibotCAPTCHAJavaScriptRate LimitTLSrobots.txtBlocks AITier
Advertising & Mktg100%40%30%10%0%20%90%0%Tier 2
Beauty & Cosmetics90%20%60%30%30%10%80%10%Tier 2
Distance Learning100%30%50%50%30%10%80%30%Tier 2
Finance80%10%0%20%20%10%70%30%Tier 2
Renewable Energy70%10%20%20%0%10%100%10%Tier 2
Science80%30%20%30%20%10%60%0%Tier 2
Banking100%10%10%20%0%20%80%10%Tier 2
Pharmaceuticals100%20%30%40%20%20%70%0%Tier 2
Photography90%40%40%20%30%80%80%30%Tier 2
Publishing90%30%30%50%20%0%90%40%Tier 2
Legal90%0%10%20%10%10%60%10%Tier 2
Computer & Video Games100%40%30%20%20%20%80%10%Tier 2
Software & Dev80%40%20%10%20%20%70%10%Tier 2
Healthcare100%20%10%50%10%20%90%20%Tier 2
Mail & Delivery71.4%42.9%42.9%14.3%14.3%28.6%42.9%14.3%Tier 1

The lowest mean browser tier in Chad's industry ranking is 1.50, shared by Healthcare, Computer & Video Games, and Software & Dev. All three carry WAF rates of 80% or above while averaging well under Tier 2.

Bottom 15 industries by mean Zyte browser tier · 705 sites