State of Web Access2026

AI crawlers are the most-named bot category in Senegal's robots.txt files at 14.6% — yet only 12.7% of all sites actually block them. Much of that attention is permissive rather than restrictive.

State of Web Access 2026
Senegal · Barrier Profile · 2026

JavaScript is Senegal's most common secondary barrier

JavaScript is Senegal's most common secondary barrier
Value
WAF92.5%
Antibot19.6%
CAPTCHA24.5%
JavaScript41.5%
Rate Limiting11.9%
TLS17.3%

WAF reaches 92.5% of Senegal's 1,053 sites. Among secondary barriers, JavaScript leads at 41.5%, followed by CAPTCHA at 24.5%. Rate Limiting is the lowest secondary barrier at 11.9%.

1,053 sites
State of Web Access 2026
Senegal · Barrier Adoption · 2026

JavaScript tops Senegal's active secondary defences

JavaScript tops Senegal's active secondary defences
Value
WAF92.5%
Antibot19.6%
CAPTCHA24.5%
JavaScript41.5%
Rate Limiting11.9%
TLS17.3%
Has robots.txt78.4%
Blocks AI crawlers12.7%

WAF is present on 92.5% of Senegal sites. JavaScript renders 41.5% inaccessible to non-rendering crawlers. CAPTCHA applies to 24.5%, while Rate Limiting at 11.9% is the least-deployed secondary barrier.

1,053 sites
State of Web Access 2026
Senegal · Barrier Stacking · 2026

Two-barrier sites are Senegal's largest single group

Two-barrier sites are Senegal's largest single group
% of sites
0 barriers4.9%
1 barrier31.1%
2 barriers33.1%
3 barriers18.4%
4 barriers7.9%
5 barriers4.3%
6 barriers0.3%

4.9% of Senegal sites carry no access barriers. Sites with exactly two barriers form the largest group at 33.1%, narrowly ahead of one-barrier sites at 31.1%. Sites with three or more barriers total 30.9%.

1,053 sites
State of Web Access 2026
Senegal · Recommended Zyte API Tier · 2026

Most Senegal sites are Simple to access

Most Senegal sites are Simple to access
Mean recommended tier
All sites1.6

The median recommended tier for Senegal's 1,053 sites is Tier 1, meaning the majority are accessible via HTTP alone. The mean of 1.64 indicates a meaningful minority requiring browser-level retrieval.

1,053 sites
State of Web Access 2026
Senegal · Zyte API Tier Distribution · 2026

Most Senegal sites are Simple or Easy to access

Most Senegal sites are Simple or Easy to access
% of sites
1 - Simple52%
2 - Easy35.5%
3 - Moderate9.7%
4 - Complex1.9%
5 - Advanced0.9%

Tier 1 covers 52.0% of Senegal sites and Tier 2 a further 35.5%. Tier 3 applies to 9.7% — more than one site in ten — while Tiers 4 and 5 together account for 2.8%.

1,053 sites
State of Web Access 2026
Senegal · Bot Category Mentions in <code>robots.txt</code> · 2026 · 1,053 Sites

AI crawlers top Senegal's robots.txt bot categories

AI crawlers top Senegal's robots.txt bot categories
% of sites
AI crawlers14.6%
SEO / search indexing13%
SEO audit tools13%
Commercial scrapers6.5%
Social / content scrapers6.4%
Archive / research crawlers5.6%
Monitoring / uptime bots0.6%

AI crawlers are named in robots.txt by 14.6% of all Senegal sites. SEO/search indexing and SEO audit tools each reach 13.0% — the only two categories to share an equal mention rate.

1,053 sites
State of Web Access 2026
Senegal · <code>robots.txt</code> Rule Posture Types · 2026 · 1,053 Sites

More than one in five Senegal sites publishes no robots.txt

More than one in five Senegal sites publishes no robots.txt
% of sites
Uniform per-agent rules (no path mixing)40.3%
Path-level mixed rules for same agent33.1%
Allow-only (no disallow rules)2.3%
Mixed AI posture (block some, allow others)1.9%
Blanket Disallow: /2.6%

40.3% of Senegal sites use uniform per-agent rules and 33.1% use path-level mixed rules. 21.6% of all sites have no robots.txt file at all — the implicit largest uncategorised segment.

1,053 sites
State of Web Access 2026
Senegal · AI Agent <code>Disallow</code> vs <code>Allow</code> · 2026 · 1,053 Sites Surveyed

GPTBot draws the most Disallow rules in Senegal

GPTBot draws the most Disallow rules in Senegal
DisallowedAllowed (whitelisted)
GPTBot10.2%1.8%
CCBot7.7%0.8%
ClaudeBot7%1%
Google-Extended7.5%0.9%
Bytespider6.4%0.2%
meta-externalagent3.1%0.4%
ChatGPT-User5.7%2.3%
PerplexityBot5.3%1.7%
Applebot-Extended3.6%0.1%
OAI-SearchBot3.3%1.5%
anthropic-ai3.9%0.8%

GPTBot appears in a Disallow directive on 10.2% of all Senegal sites. ChatGPT-User receives the most explicit Allow entries, at 2.3% of sites.

1,053 sites surveyed · 826 with robots.txt
State of Web Access 2026
Senegal · Named-Bot <code>Disallow</code> Rate by Industry · Top 15 · 2026

Multiple Senegal sectors all name at least one bot to restrict

Multiple Senegal sectors all name at least one bot to restrict
% of sites
Computer & Video Games100%
Design100%
Entertainment100%
Retail100%
Warehousing100%
Adult90%
Automotive90%
Foreign Language90%
General90%
Investment90%
Manufacturing90%
Mass Media90%
Newspapers90%
Online Services90%
Printing90%

Computer & Video Games, Design, Entertainment, Retail, and Warehousing each have 100% of their sites naming at least one bot in a Disallow rule — the highest rate in Senegal.

Most categories n=10 — each site = 10 percentage points · 1,053 Senegal sites
State of Web Access 2026
Senegal · Explicit Bot <code>Allow</code> / Whitelist Rate by Industry · Top 15 · 2026

Market Research and Publishing top Senegal's explicit bot Allow rate

Market Research and Publishing top Senegal's explicit bot Allow rate
% of sites
Market Research80%
Publishing80%
Automotive70%
Photography70%
Retail70%
Sporting Goods70%
Writing & Editing70%
Airlines60%
Architecture60%
Biotech60%
Comics & Animation60%
Foreign Language60%
Healthcare60%
Import & Export60%
Mental Health60%

Market Research and Publishing each have 80.0% of their sites naming at least one bot in an explicit Allow rule — the highest rates among all Senegal sectors.

Most categories n=10 — each site = 10 percentage points · 1,053 Senegal sites
State of Web Access 2026
Senegal · Scraping Difficulty by Industry · Top 15 by Mean Tier · 2026

Jewellery & Luxury is Senegal's hardest sector to access programmatically

Jewellery & Luxury is Senegal's hardest sector to access programmatically
WAFAntibotCAPTCHAJavaScriptRate LimitTLSrobots.txtBlocks AITier
Jewellery & Luxury100%30%10%60%50%40%70%10%Tier 3
Furniture100%40%20%60%30%30%70%10%Tier 3
Hospitality100%30%0%70%20%30%60%10%Tier 3
Real Estate90%10%0%50%20%20%60%40%Tier 3
Beauty & Cosmetics90%30%20%50%30%30%80%10%Tier 3
Computer Hardware80%10%0%20%10%30%70%0%Tier 3
Retail100%10%0%70%10%10%100%50%Tier 2
Consumer Electronics80%20%20%50%20%40%80%20%Tier 2
Automotive90%10%10%30%20%40%90%20%Tier 2
Food & Beverages100%20%30%60%30%10%60%0%Tier 2
Apparel & Fashion90%10%20%40%20%40%80%10%Tier 2
Equipment & Supplies90%50%20%70%40%10%70%10%Tier 2
Human Resources100%70%60%50%40%20%80%10%Tier 2
Mail & Delivery70%30%10%20%0%10%80%0%Tier 2
Airlines90%20%0%70%10%20%70%30%Tier 2

Jewellery & Luxury records a mean recommended tier of 2.80 and a median of Tier 3 — the highest-difficulty position in Senegal's top-15. Furniture follows at 2.70, also with a Tier 3 median.

Top 15 industries by mean Zyte browser tier · 1,053 sites
State of Web Access 2026
Senegal · Scraping Difficulty by Industry · Bottom 15 by Mean Tier · 2026

Six Senegal sectors share the most accessible floor

Six Senegal sectors share the most accessible floor
WAFAntibotCAPTCHAJavaScriptRate LimitTLSrobots.txtBlocks AITier
Banking100%20%10%10%10%10%80%20%Tier 2
Crafts90%10%30%30%10%10%70%0%Tier 2
Design100%20%30%40%20%30%100%30%Tier 2
Manufacturing80%10%20%40%0%50%90%10%Tier 2
Maritime90%20%0%50%10%30%90%10%Tier 2
Sporting Goods80%20%30%20%40%40%80%0%Tier 2
Transport & Logistics70%40%10%20%0%20%80%0%Tier 2
Recruitment & Staffing100%50%50%40%0%20%90%10%Tier 2
Reference70%60%30%30%20%10%40%20%Tier 2
Biotech100%20%30%50%10%20%90%20%Tier 2
Computers & Electronics90%10%30%20%0%40%90%10%Tier 2
Events90%10%10%70%20%20%60%0%Tier 2
Import & Export100%30%30%50%0%30%80%10%Tier 2
Libraries100%0%10%60%0%0%90%0%Tier 2
Music100%40%30%60%20%20%90%10%Tier 2

Biotech, Computers & Electronics, Events, Import & Export, Libraries, and Music all record a mean tier of 1.80 — the lowest value across Senegal's bottom 15 sectors.

Bottom 15 industries by mean Zyte browser tier · 1,053 sites