State of Web Access2026

AI crawlers are the most-named bot category in Kenya's robots.txt files — yet only 13.1% of sites actually block them. The posture is less wall and more watchlist: many sites name AI agents to allow as often as to restrict.

State of Web Access 2026
Kenya · Barrier Profile · 2026

JavaScript is Kenya's most common secondary barrier

JavaScript is Kenya's most common secondary barrier
Value
WAF93.3%
Antibot22.4%
CAPTCHA23.3%
JavaScript42.7%
Rate Limiting14.3%
TLS19%

WAF covers 93.3% of Kenya's 1,108 surveyed sites. JavaScript leads non-WAF barriers at 42.7%. CAPTCHA (23.3%) and Antibot (22.4%) are within one percentage point of each other in the secondary barrier profile.

1,108 sites
State of Web Access 2026
Kenya · Barrier Adoption · 2026

JavaScript tops Kenya's active secondary defences

JavaScript tops Kenya's active secondary defences
Value
WAF93.3%
Antibot22.4%
CAPTCHA23.3%
JavaScript42.7%
Rate Limiting14.3%
TLS19%
Has robots.txt79.5%
Blocks AI crawlers13.1%

WAF stands at 93.3% across Kenya's 1,108 surveyed sites. JavaScript leads non-WAF barriers at 42.7%. CAPTCHA (23.3%) and Antibot (22.4%) are the closest-paired secondary barriers in Kenya's profile.

1,108 sites
State of Web Access 2026
Kenya · Barrier Stacking · 2026

Two-barrier sites are Kenya's most common configuration

Two-barrier sites are Kenya's most common configuration
% of sites
0 barriers4.2%
1 barrier28.9%
2 barriers34.5%
3 barriers18.1%
4 barriers9.2%
5 barriers4.4%
6 barriers0.6%

4.2% of Kenya's sites deploy no detectable barrier. Two barriers is the modal outcome at 34.5%. Sites stacking three or more account for 32.3% — a substantial high-barrier segment.

1,108 sites
State of Web Access 2026
Kenya · Recommended Zyte API Tier · 2026

Most Kenya sites are Simple to access

Most Kenya sites are Simple to access
Mean recommended tier
All sites1.7

Kenya's median browser tier is 2 — fewer than half of its 1,108 sites (44.2%) fall at Tier 1. The mean of 1.73 reflects a broad Tier 2 block at 42.1%, with Tiers 3–5 accounting for 13.7%.

1,108 sites
State of Web Access 2026
Kenya · Zyte API Tier Distribution · 2026

Most Kenya sites are Simple or Easy to access

Most Kenya sites are Simple or Easy to access
% of sites
1 - Simple44.2%
2 - Easy42.1%
3 - Moderate10.5%
4 - Complex2.6%
5 - Advanced0.6%

Kenya's Tier 1 share of 44.2% and Tier 2 share of 42.1% are closer than in most surveyed markets, giving a combined 86.3%. Tier 3 accounts for 10.5%, Tier 4 for 2.6%, Tier 5 for 0.6%.

1,108 sites
State of Web Access 2026
Kenya · Bot Category Mentions in <code>robots.txt</code> · 2026 · 1,108 Sites

AI crawlers top Kenya's robots.txt bot categories

AI crawlers top Kenya's robots.txt bot categories
% of sites
AI crawlers15%
SEO / search indexing11.5%
SEO audit tools13.3%
Commercial scrapers8.1%
Social / content scrapers5.8%
Archive / research crawlers4.1%
Monitoring / uptime bots0.5%

AI crawlers are mentioned by 15.0% of Kenya's 1,108 sites — the most of any category. SEO audit tools rank second at 13.3%, ahead of SEO / search indexing at 11.5%. All figures include sites with no robots.txt.

1,108 sites
State of Web Access 2026
Kenya · <code>robots.txt</code> Rule Posture Types · 2026 · 1,108 Sites

Uniform rules are Kenya's most common robots.txt posture

Uniform rules are Kenya's most common robots.txt posture
% of sites
Uniform per-agent rules (no path mixing)40.8%
Path-level mixed rules for same agent33%
Allow-only (no disallow rules)2.8%
Mixed AI posture (block some, allow others)2.2%
Blanket Disallow: /2.7%

Uniform per-agent rules account for 40.8% of all 1,108 Kenya sites. Path-mixed rules follow at 33.0% — a 7.8-point gap. Blanket Disallow: / covers 2.7%. The remaining 20.5% have no robots.txt.

1,108 sites
State of Web Access 2026
Kenya · AI Agent <code>Disallow</code> vs <code>Allow</code> · 2026 · 1,108 Sites Surveyed

GPTBot faces the most Disallow rules in Kenya's robots.txt

GPTBot faces the most Disallow rules in Kenya's robots.txt
DisallowedAllowed (whitelisted)
GPTBot10.6%2.1%
CCBot8.5%1.3%
ClaudeBot7.8%1%
Google-Extended7.9%1.5%
Bytespider7.2%0.4%
meta-externalagent2.6%
ChatGPT-User5.7%2.4%
PerplexityBot5.7%1.8%
Applebot-Extended4.7%0.5%
OAI-SearchBot4.1%1.8%
anthropic-ai5.1%0.5%

GPTBot is named in a Disallow rule by 10.6% of Kenya's 1,108 sites. CCBot follows at 8.5%. ChatGPT-User holds the highest explicit Allow rate at 2.4%, ahead of OAI-SearchBot and PerplexityBot, both at 1.8%.

1,108 sites surveyed · 881 with robots.txt
State of Web Access 2026
Kenya · Named-Bot <code>Disallow</code> Rate by Industry · Top 15 · 2026

Multiple Kenya sectors all name at least one bot to restrict

Multiple Kenya sectors all name at least one bot to restrict
% of sites
Computer & Video Games100%
Consumer Electronics100%
Design100%
Retail100%
Visual Art100%
Adult90%
Comics & Animation90%
Entertainment90%
Foreign Language90%
General90%
Mass Media90%
Medical Devices90%
Newspapers90%
Online Services90%
Printing90%

Five sectors — Computer & Video Games, Consumer Electronics, Design, Retail, and Visual Art — each show a 100% named-bot Disallow rate: every site in those sectors names at least one bot to restrict. Ten further sectors sit at 90%.

Most categories n=10 — each site = 10 percentage points · 1,108 Kenya sites
State of Web Access 2026
Kenya · Explicit Bot <code>Allow</code> / Whitelist Rate by Industry · Top 15 · 2026

Kenya's leading sectors explicitly allow crawlers

Kenya's leading sectors explicitly allow crawlers
% of sites
Airlines70%
Photography70%
Publishing70%
Retail70%
Science70%
Telecom70%
Architecture60%
Automotive60%
Foreign Language60%
Graphic Design60%
IT Services60%
Investment60%
Public Policy60%
Software & Dev60%
Training & Cert.60%

Airlines, Photography, Publishing, Retail, Science, and Telecom each show a 70% explicit bot Allow rate — the highest in Kenya's survey. Nine further sectors follow at 60%. Retail appears in both the block and allow rankings.

Most categories n=10 — each site = 10 percentage points · 1,108 Kenya sites
State of Web Access 2026
Kenya · Scraping Difficulty by Industry · Top 15 by Mean Tier · 2026

Furniture and Jewellery & Luxury are Kenya's hardest sectors to access

Furniture and Jewellery & Luxury are Kenya's hardest sectors to access
WAFAntibotCAPTCHAJavaScriptRate LimitTLSrobots.txtBlocks AITier
Furniture100%40%10%30%20%40%60%0%Tier 3
Jewellery & Luxury100%10%10%30%30%60%60%10%Tier 3
Real Estate100%10%10%60%60%20%50%20%Tier 3
Hospitality90%30%0%60%20%40%60%10%Tier 3
Equipment & Supplies90%30%20%50%20%10%70%20%Tier 3
Retail100%10%0%70%10%10%100%50%Tier 2
Human Resources100%80%60%50%40%20%70%10%Tier 2
Beauty & Cosmetics80%30%20%30%40%40%80%10%Tier 2
Computer Hardware90%20%0%30%20%20%70%10%Tier 2
Consumer Electronics80%10%20%60%10%50%100%10%Tier 2
Customer Services100%10%20%50%30%20%50%0%Tier 2
Insurance90%30%20%40%20%10%80%0%Tier 2
Medical Devices90%10%10%40%10%10%100%0%Tier 2
Restaurants90%40%20%50%30%10%60%10%Tier 2
Automotive100%20%0%40%40%30%70%20%Tier 2

Furniture and Jewellery & Luxury share mean tier 2.80 — the highest in Kenya — and both carry a median tier of 3. Real Estate follows at 2.70. Industries ranked by mean recommended browser tier.

Top 15 industries by mean Zyte browser tier · 1,108 sites
State of Web Access 2026
Kenya · Scraping Difficulty by Industry · Bottom 15 by Mean Tier · 2026

Banking is Kenya's most accessible sector

Banking is Kenya's most accessible sector
WAFAntibotCAPTCHAJavaScriptRate LimitTLSrobots.txtBlocks AITier
Food & Beverages100%50%30%50%30%0%80%30%Tier 2
Apparel & Fashion100%20%30%60%20%30%80%10%Tier 2
Maritime90%10%10%40%10%30%90%10%Tier 2
Sporting Goods90%10%20%50%30%30%60%0%Tier 2
Wholesalers90%10%40%60%30%30%80%10%Tier 2
Ceramics & Pottery90%0%30%40%0%0%80%0%Tier 2
Crafts100%30%20%60%30%10%60%10%Tier 2
Design100%20%30%40%20%30%100%30%Tier 2
Import & Export100%30%30%50%0%30%80%10%Tier 2
Mail & Delivery70%40%10%10%0%20%80%0%Tier 2
Pharmaceuticals100%40%20%50%30%20%70%0%Tier 2
Reference90%60%30%40%20%10%60%40%Tier 2
Transport & Logistics70%40%10%10%0%20%80%0%Tier 2
Wine & Spirits100%50%20%50%30%0%80%30%Tier 2
Banking100%50%10%30%10%20%80%0%Tier 2

Banking records a mean browser tier of 1.90 — the lowest among Kenya's bottom-15 industries. Nine sectors share a mean tier of 2.00, including Design, Import & Export, and Pharmaceuticals.

Bottom 15 industries by mean Zyte browser tier · 1,108 sites