State of Web Access2026

Liberia's technical barriers are thin — Rate Limiting appears on just 11.9% of sites — yet AI crawlers are the single most-named bot category in robots.txt, cited on 14.9% of sites. The policy posture is more assertive than the infrastructure.

State of Web Access 2026
Liberia · Barrier Profile · 2026

JavaScript is Liberia's most common secondary barrier

JavaScript is Liberia's most common secondary barrier
Value
WAF92.9%
Antibot19%
CAPTCHA22.9%
JavaScript37.6%
Rate Limiting11.9%
TLS17.7%

WAF is near-universal at 92.9%. JavaScript is the most-deployed secondary barrier at 37.6%, ahead of CAPTCHA at 22.9%, Antibot at 19.0%, TLS at 17.7%, and Rate Limiting at 11.9%.

827 sites
State of Web Access 2026
Liberia · Barrier Adoption · 2026

JavaScript leads Liberia's secondary barriers well clear of all others

JavaScript leads Liberia's secondary barriers well clear of all others
Value
WAF92.9%
Antibot19%
CAPTCHA22.9%
JavaScript37.6%
Rate Limiting11.9%
TLS17.7%
Has robots.txt82.2%
Blocks AI crawlers13.5%

WAF reaches 92.9% across Liberia's 827 sites. JavaScript is the leading secondary barrier at 37.6% — 14.7 points ahead of CAPTCHA at 22.9%. Antibot (19.0%), TLS (17.7%), and Rate Limiting (11.9%) follow.

827 sites
State of Web Access 2026
Liberia · Barrier Stacking · 2026

Single-barrier sites are Liberia's most common configuration

Single-barrier sites are Liberia's most common configuration
% of sites
0 barriers4.5%
1 barrier33.9%
2 barriers32.8%
3 barriers16.9%
4 barriers8.6%
5 barriers3%
6 barriers0.4%

4.5% of Liberia's sites present no detectable barriers. One barrier is the modal count at 33.9%. Sites carrying three or more barriers account for 28.9% of the total.

827 sites
State of Web Access 2026
Liberia · Recommended Zyte API Tier · 2026

Most Liberia sites are Simple to access

Most Liberia sites are Simple to access
Mean recommended tier
All sites1.6

A browser median of 1 places the majority of Liberia's 827 sites at Tier 1. The mean of 1.55 reflects a tail of harder sites: 6.8% at Tier 3, 1.5% at Tier 4, and 0.5% at Tier 5.

827 sites
State of Web Access 2026
Liberia · Zyte API Tier Distribution · 2026

Nine in ten Liberia sites are Simple or Easy to access

Nine in ten Liberia sites are Simple or Easy to access
% of sites
1 - Simple56%
2 - Easy35.3%
3 - Moderate6.8%
4 - Complex1.5%
5 - Advanced0.5%

Tier 1 accounts for 56.0% of Liberia's sites; Tier 2 adds 35.3%, giving a combined Tier 1+2 share of 91.3%. Tier 3 covers 6.8%, Tier 4 covers 1.5%, and Tier 5 covers 0.5%.

827 sites
State of Web Access 2026
Liberia · Bot Category Mentions in <code>robots.txt</code> · 2026 · 827 Sites

AI crawlers are the most-named bot category in Liberia's robots.txt

AI crawlers are the most-named bot category in Liberia's robots.txt
% of sites
AI crawlers14.9%
SEO / search indexing11.4%
SEO audit tools13.4%
Commercial scrapers6.8%
Social / content scrapers6.7%
Archive / research crawlers4.1%
Monitoring / uptime bots0.2%

AI crawlers appear in robots.txt on 14.9% of Liberia's 827 sites — the highest of any category. SEO audit tools follow at 13.4%, and SEO / search indexing at 11.4%. All figures are percentages of all surveyed sites.

827 sites
State of Web Access 2026
Liberia · <code>robots.txt</code> Rule Posture Types · 2026 · 827 Sites

Uniform per-agent rules are Liberia's leading robots.txt posture

Uniform per-agent rules are Liberia's leading robots.txt posture
% of sites
Uniform per-agent rules (no path mixing)44.3%
Path-level mixed rules for same agent32.3%
Allow-only (no disallow rules)3%
Mixed AI posture (block some, allow others)2.2%
Blanket Disallow: /2.4%

17.8% of Liberia's sites carry no robots.txt. Of all 827 sites, 44.3% use uniform per-agent rules and 32.3% use path-level mixed rules. Blanket Disallow: / is applied by 2.4%.

827 sites
State of Web Access 2026
Liberia · AI Agent <code>Disallow</code> vs <code>Allow</code> · 2026 · 827 Sites Surveyed

GPTBot faces the most Disallow rules in Liberia's robots.txt

GPTBot faces the most Disallow rules in Liberia's robots.txt
DisallowedAllowed (whitelisted)
GPTBot11.1%1.9%
CCBot8.1%1%
ClaudeBot8.9%1%
Google-Extended8.8%1.2%
Bytespider7%0.8%
meta-externalagent4%0.4%
ChatGPT-User5.8%1.9%
PerplexityBot6%1.6%
Applebot-Extended4.8%0.6%
OAI-SearchBot4%1.7%
anthropic-ai4.6%0.8%

Of 827 surveyed sites, GPTBot is named in a Disallow rule by 11.1% — the highest of any AI agent. ClaudeBot follows at 8.9% and Google-Extended at 8.8%. GPTBot also leads explicit allows at 1.9%.

827 sites surveyed · 680 with robots.txt
State of Web Access 2026
Liberia · Named-Bot <code>Disallow</code> Rate by Industry · Top 15 · 2026

Multiple Liberia sectors all name at least one bot to restrict

Multiple Liberia sectors all name at least one bot to restrict
% of sites
Adult100%
Beauty & Cosmetics100%
Design100%
Newspapers100%
Retail100%
Airlines90%
Consumer Electronics90%
Entertainment90%
General90%
Libraries90%
Mass Media90%
Online Services90%
Publishing90%
Telecom90%
Sporting Goods88.9%

Adult, Beauty & Cosmetics, Design, Newspapers, and Retail each have a 100% named-bot Disallow rate — every site in these sectors names at least one bot to restrict. The next ranked sectors stand at 90%.

Most categories n=10 — each site = 10 percentage points · 827 Liberia sites
State of Web Access 2026
Liberia · Explicit Bot <code>Allow</code> / Whitelist Rate by Industry · Top 15 · 2026

Liberia's Retail sites sites lead in explicitly allowing crawlers

Liberia's Retail sites sites lead in explicitly allowing crawlers
% of sites
Retail80%
Airlines70%
Museums70%
Photography70%
Publishing70%
Sporting Goods66.7%
Architecture60%
Hospitality60%
Import & Export60%
Non-Profit60%
Real Estate60%
Science60%
Software & Dev60%
Telecom60%
Travel & Tourism60%

Retail has the highest named-bot Allow rate in Liberia at 80% of sites. Airlines, Museums, Photography, and Publishing each reach 70%. Figures reflect sites naming at least one bot in an explicit Allow rule.

Most categories n=10 — each site = 10 percentage points · 827 Liberia sites
State of Web Access 2026
Liberia · Scraping Difficulty by Industry · Top 15 by Mean Tier · 2026

Retail is Liberia's hardest sector to access programmatically

Retail is Liberia's hardest sector to access programmatically
WAFAntibotCAPTCHAJavaScriptRate LimitTLSrobots.txtBlocks AITier
Retail100%10%0%70%10%10%100%50%Tier 2
Computer Hardware90%30%0%20%10%10%80%0%Tier 2
Human Resources100%50%40%40%40%20%80%0%Tier 2
Apparel & Fashion90%10%20%60%10%50%70%10%Tier 2
Automotive90%30%0%50%40%40%70%30%Tier 2
Consumer Electronics80%20%20%40%10%40%90%20%Tier 2
Airlines80%10%10%30%30%20%90%20%Tier 2
Design100%20%30%40%20%30%100%30%Tier 2
Hospitality90%30%20%50%10%20%60%0%Tier 2
Real Estate100%10%0%70%30%20%80%0%Tier 2
Recruitment & Staffing100%20%20%50%0%10%70%0%Tier 2
Science100%40%30%50%40%10%70%10%Tier 2
Travel & Tourism100%40%10%60%30%10%80%20%Tier 2
Sporting Goods88.9%11.1%33.3%11.1%11.1%33.3%88.9%11.1%Tier 2
Military50%0%0%33.3%0%0%50%0%Tier 2

Retail tops Liberia's difficulty ranking with a mean browser tier of 2.50. Computer Hardware and Human Resources both follow at 2.30. All 15 industries share tier median 2, with the mean distinguishing their relative difficulty.

Top 15 industries by mean Zyte browser tier · 827 sites
State of Web Access 2026
Liberia · Scraping Difficulty by Industry · Bottom 15 by Mean Tier · 2026

Beauty & Cosmetics and Manufacturing are Liberia's most accessible sectors

Beauty & Cosmetics and Manufacturing are Liberia's most accessible sectors
WAFAntibotCAPTCHAJavaScriptRate LimitTLSrobots.txtBlocks AITier
Adult100%30%30%60%0%20%100%20%Tier 2
Mail & Delivery70%30%20%10%10%30%90%0%Tier 2
Publishing90%30%30%50%20%0%90%60%Tier 2
Telecom90%10%20%60%0%20%90%30%Tier 2
Transport & Logistics80%30%20%20%10%20%90%0%Tier 2
Biotech100%10%20%50%10%20%90%30%Tier 2
Distance Learning100%40%60%40%30%10%70%30%Tier 2
Healthcare100%10%10%10%0%0%100%20%Tier 2
Import & Export90%30%10%10%10%20%80%0%Tier 2
Maritime90%10%0%30%10%20%90%20%Tier 2
Non-Profit90%20%20%40%10%0%80%10%Tier 2
Photography90%30%50%20%20%90%80%30%Tier 2
Customer Services100%16.7%16.7%50%33.3%16.7%66.7%0%Tier 2
Beauty & Cosmetics100%25%50%25%12.5%37.5%100%0%Tier 2
Manufacturing100%25%37.5%50%12.5%37.5%75%0%Tier 2

The most accessible industries in Liberia are Beauty & Cosmetics and Manufacturing, each averaging a mean browser tier of 1.62. Customer Services at 1.67 is the next most accessible.

Bottom 15 industries by mean Zyte browser tier · 827 sites