State of Web Access2026

Nigeria's robots.txt files name AI crawlers more often than any other bot category — 15.9% of all sites target them by name. Yet the active bot-control stack is near-global norms: antibot appears on just 20.9% of sites, and JavaScript leads the secondary barriers at 41.9%.

State of Web Access 2026
Nigeria · Barrier Profile · 2026

JavaScript is Nigeria's most common secondary barrier

JavaScript is Nigeria's most common secondary barrier
Value
WAF93.7%
Antibot20.9%
CAPTCHA22.8%
JavaScript41.9%
Rate Limiting13.3%
TLS18.3%

WAF covers 93.7% of Nigeria's 1,111 surveyed sites. Among the remaining five barriers, JavaScript is the furthest ahead at 41.9% — roughly double the CAPTCHA (22.8%) and Antibot (20.9%) rates below it.

1,111 sites
State of Web Access 2026
Nigeria · Barrier Adoption · 2026

Four of Nigeria's five secondary barriers cluster well below JavaScript

Four of Nigeria's five secondary barriers cluster well below JavaScript
Value
WAF93.7%
Antibot20.9%
CAPTCHA22.8%
JavaScript41.9%
Rate Limiting13.3%
TLS18.3%
Has robots.txt81.7%
Blocks AI crawlers14.4%

After WAF at 93.7%, JavaScript stands at 41.9%. The four remaining barriers — CAPTCHA 22.8%, Antibot 20.9%, TLS 18.3%, and Rate Limiting 13.3% — all fall below 25%, leaving a clear gap between JavaScript and the rest.

1,111 sites
State of Web Access 2026
Nigeria · Barrier Stacking · 2026

Two-barrier sites are Nigeria's most common configuration

Two-barrier sites are Nigeria's most common configuration
% of sites
0 barriers4%
1 barrier29.8%
2 barriers34.6%
3 barriers19.1%
4 barriers8.6%
5 barriers3.6%
6 barriers0.4%

4.0% of Nigeria's sites carry no detectable barrier. Two barriers is the single most common configuration at 34.6%. Sites carrying three or more barriers collectively account for 31.7% of the sample.

1,111 sites
State of Web Access 2026
Nigeria · Recommended Zyte API Tier · 2026

Most Nigeria sites are Simple to access

Most Nigeria sites are Simple to access
Mean recommended tier
All sites1.7

A mean of 1.72 and median of 2 place Nigeria in the Easy tier range overall. Tier 1 accounts for 45.2% of sites — just short of a majority. The 13.5% at Tiers 3–5 pull the mean above the median.

1,111 sites
State of Web Access 2026
Nigeria · Zyte API Tier Distribution · 2026

Most Nigeria sites are Simple or Easy to access

Most Nigeria sites are Simple or Easy to access
% of sites
1 - Simple45.2%
2 - Easy41.3%
3 - Moderate10.2%
4 - Complex2.5%
5 - Advanced0.8%

Tier 1 covers 45.2% of sites; Tier 2 adds 41.3%. Tier 3 accounts for 10.2%, Tier 4 for 2.5%, and Tier 5 for 0.8% — a long but thin tail of harder-to-access sites.

1,111 sites
State of Web Access 2026
Nigeria · Bot Category Mentions in <code>robots.txt</code> · 2026 · 1,111 Sites

AI crawlers are the most-named bot category in Nigeria's robots.txt files

AI crawlers are the most-named bot category in Nigeria's robots.txt files
% of sites
AI crawlers15.9%
SEO / search indexing11.9%
SEO audit tools14.1%
Commercial scrapers8.3%
Social / content scrapers6.5%
Archive / research crawlers4.1%
Monitoring / uptime bots0.5%

AI crawlers are mentioned by 15.9% of Nigeria's 1,111 sites — the largest share of any bot category. SEO audit tools follow at 14.1% and SEO / search indexing at 11.9%. Figures cover all sites, including those without robots.txt.

1,111 sites
State of Web Access 2026
Nigeria · <code>robots.txt</code> Rule Posture Types · 2026 · 1,111 Sites

Uniform per-agent rules are Nigeria's most common robots.txt posture

Uniform per-agent rules are Nigeria's most common robots.txt posture
% of sites
Uniform per-agent rules (no path mixing)42.2%
Path-level mixed rules for same agent34%
Allow-only (no disallow rules)2.8%
Mixed AI posture (block some, allow others)2.7%
Blanket Disallow: /2.5%

18.3% of Nigeria's sites publish no robots.txt. Of those that do, 42.2% of all sites use uniform per-agent rules. Path-level mixed rules account for 34.0%. Blanket Disallow: / is present on 2.5% of all sites.

1,111 sites
State of Web Access 2026
Nigeria · AI Agent <code>Disallow</code> vs <code>Allow</code> · 2026 · 1,111 Sites Surveyed

GPTBot faces the most Disallow rules in Nigeria's robots.txt

GPTBot faces the most Disallow rules in Nigeria's robots.txt
DisallowedAllowed (whitelisted)
GPTBot11.6%2.3%
CCBot9%1.2%
ClaudeBot8.7%1.2%
Google-Extended8.8%1.7%
Bytespider7.7%0.5%
meta-externalagent3.3%0.2%
ChatGPT-User6.1%2.8%
PerplexityBot6.1%2.1%
Applebot-Extended5.1%0.4%
OAI-SearchBot4.3%2%
anthropic-ai5.5%1%

GPTBot is Disallowed by 11.6% of Nigeria's 1,111 sites and explicitly Allowed by 2.3%. ChatGPT-User carries the highest explicit Allow rate at 2.8%. All figures include sites without robots.txt.

1,111 sites surveyed · 908 with robots.txt
State of Web Access 2026
Nigeria · Named-Bot <code>Disallow</code> Rate by Industry · Top 15 · 2026

Multiple Nigeria sectors all name at least one bot to restrict

Multiple Nigeria sectors all name at least one bot to restrict
% of sites
Apparel & Fashion100%
Consumer Electronics100%
Design100%
Entertainment100%
Telecom100%
Adult90%
Banking90%
Beauty & Cosmetics90%
Civil Engineering90%
Comics & Animation90%
Computer & Video Games90%
Foreign Language90%
General90%
Investment90%
Mass Media90%

Apparel & Fashion, Consumer Electronics, Design, Entertainment, and Telecom each have every surveyed site naming at least one bot to restrict in robots.txt. A further ten sectors stand at 90%.

Most categories n=10 — each site = 10 percentage points · 1,111 Nigeria sites
State of Web Access 2026
Nigeria · Explicit Bot <code>Allow</code> / Whitelist Rate by Industry · Top 15 · 2026

Nigeria's Airlines and Science sites lead in explicitly allowing crawlers

Nigeria's Airlines and Science sites lead in explicitly allowing crawlers
% of sites
Airlines80%
Science80%
Investment70%
Photography70%
Publishing70%
Retail70%
Travel & Tourism70%
Apparel & Fashion60%
Architecture60%
Farms & Ranches60%
Foreign Language60%
Graphic Design60%
Hospitality60%
Pharmaceuticals60%
Real Estate60%

Airlines and Science share the top position — 80% of sites in each sector name at least one bot in an explicit Allow rule. Investment, Photography, Publishing, Retail, and Travel & Tourism follow at 70%.

Most categories n=10 — each site = 10 percentage points · 1,111 Nigeria sites
State of Web Access 2026
Nigeria · Scraping Difficulty by Industry · Top 15 by Mean Tier · 2026

Jewellery & Luxury is Nigeria's hardest sector to access programmatically

Jewellery & Luxury is Nigeria's hardest sector to access programmatically
WAFAntibotCAPTCHAJavaScriptRate LimitTLSrobots.txtBlocks AITier
Jewellery & Luxury100%10%0%30%50%50%60%10%Tier 3
Furniture100%30%10%40%10%60%80%10%Tier 3
Real Estate100%10%10%50%50%30%60%20%Tier 3
Retail100%10%0%70%20%10%90%50%Tier 3
Equipment & Supplies90%40%20%50%20%10%70%20%Tier 3
Apparel & Fashion90%0%20%50%10%40%100%10%Tier 2
Customer Services100%20%30%60%40%10%50%0%Tier 2
Hospitality90%30%0%60%20%40%70%20%Tier 2
Human Resources100%80%60%50%40%20%70%10%Tier 2
Computer Hardware90%20%0%30%20%20%70%10%Tier 2
Medical Devices80%10%10%40%10%10%90%0%Tier 2
Beauty & Cosmetics80%20%20%40%40%20%90%10%Tier 2
Consumer Electronics80%10%20%50%10%50%100%20%Tier 2
Sporting Goods90%10%10%30%30%30%60%0%Tier 2
Telecom90%10%20%60%0%40%100%20%Tier 2

Jewellery & Luxury posts the highest mean browser tier at 3.10 across Nigeria's surveyed sites. Furniture follows at 2.95, and Real Estate at 2.70. All 15 industries in this chart average above 2.0.

Top 15 industries by mean Zyte browser tier · 1,111 sites
State of Web Access 2026
Nigeria · Scraping Difficulty by Industry · Bottom 15 by Mean Tier · 2026

Eight Nigeria sectors share the most accessible floor

Eight Nigeria sectors share the most accessible floor
WAFAntibotCAPTCHAJavaScriptRate LimitTLSrobots.txtBlocks AITier
Wine & Spirits100%50%20%40%40%0%80%20%Tier 2
Food & Beverages100%40%30%70%40%0%70%30%Tier 2
Insurance80%20%20%30%10%20%90%0%Tier 2
Public Safety100%30%50%60%20%30%90%10%Tier 2
Restaurants90%30%30%60%40%10%50%20%Tier 2
Textiles & Nonwovens100%0%20%30%0%20%100%10%Tier 2
Wholesalers80%20%40%40%30%30%80%10%Tier 2
Automotive100%10%10%20%30%20%60%20%Tier 2
Construction90%0%20%30%20%0%60%0%Tier 2
Design100%20%30%40%20%30%100%30%Tier 2
Events100%10%10%80%30%0%70%0%Tier 2
Mail & Delivery80%40%10%10%0%20%90%0%Tier 2
Public Policy100%50%50%30%20%30%90%20%Tier 2
Recruitment & Staffing100%50%60%20%10%30%70%20%Tier 2
Reference90%60%30%40%20%10%60%40%Tier 2

The most accessible industries in Nigeria average mean tier 2.00 — a floor shared by eight sectors including Automotive, Construction, Design, Events, Mail & Delivery, Public Policy, Recruitment & Staffing, and Reference.

Bottom 15 industries by mean Zyte browser tier · 1,111 sites