State of Web Access2026

Saudi Arabia's robots.txt posture is more assertive than its technical defences suggest: AI crawlers are the most-named bot category at 15.7% of sites, yet Rate Limiting — at just 11.9% — is the least-deployed active barrier in the set.

State of Web Access 2026
Saudi Arabia · Barrier Profile · 2026

JavaScript is Saudi Arabia's most common secondary barrier

JavaScript is Saudi Arabia's most common secondary barrier
Value
WAF92.8%
Antibot20.6%
CAPTCHA21.4%
JavaScript39.4%
Rate Limiting11.9%
TLS19.3%

WAF reaches 92.8% across Saudi Arabia's 1,104 surveyed sites. Among secondary barriers, JavaScript leads at 39.4%. TLS (19.3%) outpaces Rate Limiting (11.9%), the least-deployed barrier in the set.

1,104 sites
State of Web Access 2026
Saudi Arabia · Barrier Adoption · 2026

JavaScript tops Saudi Arabia's active secondary defences

JavaScript tops Saudi Arabia's active secondary defences
Value
WAF92.8%
Antibot20.6%
CAPTCHA21.4%
JavaScript39.4%
Rate Limiting11.9%
TLS19.3%
Has robots.txt79.8%
Blocks AI crawlers13.9%

WAF is deployed by 92.8% of Saudi Arabia's sites. JavaScript (39.4%) is the strongest secondary barrier, followed by CAPTCHA at 21.4%, Antibot at 20.6%, and TLS at 19.3%. Rate Limiting stands at 11.9%.

1,104 sites
State of Web Access 2026
Saudi Arabia · Barrier Stacking · 2026

Two barriers is the single most common site configuration

Two barriers is the single most common site configuration
% of sites
0 barriers4.9%
1 barrier31.5%
2 barriers34.6%
3 barriers16.1%
4 barriers8.5%
5 barriers3.9%
6 barriers0.5%

4.9% of Saudi Arabia's sites present no barriers. Two barriers is the modal count, covering 34.6% of sites. Sites stacking three or more barriers account for 29.0% of the sample.

1,104 sites
State of Web Access 2026
Saudi Arabia · Recommended Zyte API Tier · 2026

Most Saudi Arabia sites are Easy to access

Most Saudi Arabia sites are Easy to access
Mean recommended tier
All sites1.7

Saudi Arabia's mean recommended browser tier is 1.70; the median sits at Tier 2. The gap between mean and median reflects a tail of harder sites pulling the mean below 2.

1,104 sites
State of Web Access 2026
Saudi Arabia · Zyte API Tier Distribution · 2026

More than eight in ten sites are Simple or Easy to access

More than eight in ten sites are Simple or Easy to access
% of sites
1 - Simple46.8%
2 - Easy39.7%
3 - Moderate10.6%
4 - Complex2.2%
5 - Advanced0.7%

Tier 1 covers 46.8% of Saudi Arabia's sites; Tier 2 a further 39.7%. Tier 3 accounts for 10.6% of sites. Tier 4 and Tier 5 together make up the remaining 2.9%.

1,104 sites
State of Web Access 2026
Saudi Arabia · Bot Category Mentions in <code>robots.txt</code> · 2026 · 1,104 Sites

AI crawlers are the most-cited bot category in robots.txt

AI crawlers are the most-cited bot category in robots.txt
% of sites
AI crawlers15.7%
SEO / search indexing12.9%
SEO audit tools13.8%
Commercial scrapers8.4%
Social / content scrapers6.2%
Archive / research crawlers4.5%
Monitoring / uptime bots0.5%

AI crawlers are named by 15.7% of Saudi Arabia's 1,104 sites — the highest of the seven bot categories measured. SEO audit tools follow at 13.8%, ahead of SEO / search indexing at 12.9%.

1,104 sites
State of Web Access 2026
Saudi Arabia · <code>robots.txt</code> Rule Posture Types · 2026 · 1,104 Sites

Uniform per-agent rules are the most common robots.txt posture

Uniform per-agent rules are the most common robots.txt posture
% of sites
Uniform per-agent rules (no path mixing)40.9%
Path-level mixed rules for same agent33.5%
Allow-only (no disallow rules)2.6%
Mixed AI posture (block some, allow others)2.6%
Blanket Disallow: /2.6%

40.9% of Saudi Arabia's 1,104 sites use uniform per-agent rules. Path-level mixed rules account for 33.5%. The 20.2% of sites with no robots.txt are the implicit complement of the 79.8% that have one.

1,104 sites
State of Web Access 2026
Saudi Arabia · AI Agent <code>Disallow</code> vs <code>Allow</code> · 2026 · 1,104 Sites Surveyed

GPTBot leads both Disallow and explicit Allow rates

GPTBot leads both Disallow and explicit Allow rates
DisallowedAllowed (whitelisted)
GPTBot11.2%2.8%
CCBot8.8%1.1%
ClaudeBot8.4%1.4%
Google-Extended8.1%1.4%
Bytespider7%0.4%
meta-externalagent3%0.2%
ChatGPT-User6.2%2.6%
PerplexityBot5.6%2.1%
Applebot-Extended4.9%0.5%
OAI-SearchBot4.3%1.9%
anthropic-ai5.1%0.7%

GPTBot is named in a Disallow rule by 11.2% of Saudi Arabia's sites and in an Allow rule by 2.8% — the highest rates for any AI agent on both measures. CCBot is blocked by 8.8% of sites.

1,104 sites surveyed · 881 with robots.txt
State of Web Access 2026
Saudi Arabia · Named-Bot <code>Disallow</code> Rate by Industry · Top 15 · 2026

Seven sectors have every site naming at least one bot to restrict

Seven sectors have every site naming at least one bot to restrict
% of sites
Computer & Video Games100%
Consumer Electronics100%
Design100%
Entertainment100%
Retail100%
Telecom100%
Visual Art100%
Adult90%
Agriculture90%
Automotive90%
Civil Engineering90%
Comics & Animation90%
General90%
Healthcare90%
Insurance90%

Computer & Video Games, Consumer Electronics, Design, Entertainment, Retail, Telecom, and Visual Art each show 100% of their sites naming at least one bot to restrict. The next tier of sectors stands at 90%.

Most categories n=10 — each site = 10 percentage points · 1,104 Saudi Arabia sites
State of Web Access 2026
Saudi Arabia · Explicit Bot <code>Allow</code> / Whitelist Rate by Industry · Top 15 · 2026

Airlines and Retail lead explicit bot Allow rules

Airlines and Retail lead explicit bot Allow rules
% of sites
Airlines80%
Retail80%
Photography70%
Publishing70%
Telecom70%
Travel & Tourism70%
Architecture60%
Automotive60%
Graphic Design60%
Non-Profit60%
Public Policy60%
Science60%
Software & Dev60%
Sporting Goods60%
Sports60%

Airlines and Retail both record 80% of their sites naming at least one bot in an explicit Allow rule — the highest Allow rates in Saudi Arabia. Photography, Publishing, Telecom, and Travel & Tourism follow at 70%.

Most categories n=10 — each site = 10 percentage points · 1,104 Saudi Arabia sites
State of Web Access 2026
Saudi Arabia · Scraping Difficulty by Industry · Top 15 by Mean Tier · 2026

Hospitality and Jewellery & Luxury share the highest mean scraping difficulty

Hospitality and Jewellery & Luxury share the highest mean scraping difficulty
WAFAntibotCAPTCHAJavaScriptRate LimitTLSrobots.txtBlocks AITier
Hospitality90%20%0%60%30%40%50%10%Tier 3
Jewellery & Luxury100%20%10%30%30%50%70%10%Tier 3
Furniture100%50%30%30%20%70%70%10%Tier 3
Real Estate100%30%30%50%30%30%60%30%Tier 3
Equipment & Supplies90%30%20%50%20%10%70%20%Tier 3
Retail100%10%0%70%10%10%100%50%Tier 2
Apparel & Fashion100%20%30%60%20%30%80%10%Tier 2
Computer Hardware90%20%0%30%20%20%70%10%Tier 2
Medical Devices100%0%10%30%10%0%100%0%Tier 2
Beauty & Cosmetics90%20%10%40%30%20%80%10%Tier 2
Human Resources100%70%60%50%40%20%80%10%Tier 2
Wholesalers90%20%40%60%40%30%70%10%Tier 2
Banking100%20%20%30%10%10%70%0%Tier 2
Crafts100%30%30%50%20%10%80%20%Tier 2
Maritime90%10%10%30%10%30%90%10%Tier 2

Hospitality and Jewellery & Luxury both record a mean recommended browser tier of 2.90 — the highest of any Saudi Arabia industry. Furniture follows at 2.70, with Real Estate at 2.60.

Top 15 industries by mean Zyte browser tier · 1,104 sites
State of Web Access 2026
Saudi Arabia · Scraping Difficulty by Industry · Bottom 15 by Mean Tier · 2026

Five sectors share the most accessible floor

Five sectors share the most accessible floor
WAFAntibotCAPTCHAJavaScriptRate LimitTLSrobots.txtBlocks AITier
Restaurants80%30%20%50%30%10%60%10%Tier 2
TV & Film100%40%20%50%20%10%70%10%Tier 2
Food & Beverages100%40%40%60%40%0%70%20%Tier 2
Consumer Electronics80%20%10%30%10%50%100%10%Tier 2
Design100%20%30%40%20%30%100%30%Tier 2
Insurance80%30%0%10%0%10%100%0%Tier 2
Mail & Delivery70%40%10%10%0%20%80%0%Tier 2
Public Safety100%40%40%60%20%40%90%10%Tier 2
Sporting Goods90%10%20%40%30%30%70%0%Tier 2
Transport & Logistics70%40%10%10%0%20%80%0%Tier 2
Adult100%40%30%80%10%20%90%10%Tier 2
Automotive80%10%10%30%20%50%90%10%Tier 2
Customer Services100%10%30%30%10%30%70%0%Tier 2
Manufacturing90%10%20%40%0%40%80%0%Tier 2
Recruitment & Staffing100%40%50%40%0%20%70%20%Tier 2

Adult, Automotive, Customer Services, Manufacturing, and Recruitment & Staffing all record mean tier 1.90 — the lowest in Saudi Arabia's industry ranking. All five sit at a Tier 2 median.

Bottom 15 industries by mean Zyte browser tier · 1,104 sites