State of Web Access2026

AI crawlers are the most-named bot category in Belgium's robots.txt files — yet GPTBot is only blocked on 11.2% of all sites. The awareness is there; the enforcement is selective.

State of Web Access 2026
Belgium · Barrier Profile · 2026

JavaScript is Belgium's most common secondary barrier

JavaScript is Belgium's most common secondary barrier
Value
WAF92.8%
Antibot20%
CAPTCHA22.3%
JavaScript43.3%
Rate Limiting12.2%
TLS17.7%

WAF stands at 92.8%, just below the 93.1% global rate. JavaScript (43.3%) leads secondary barriers and sits above the 41.3% global norm. CAPTCHA (22.3%), Antibot (20.0%), TLS (17.7%), and Rate Limiting (12.2%) are all close to global levels. Sample: 1,111 sites.

1,111 sites
State of Web Access 2026
Belgium · Barrier Adoption · 2026

JavaScript tops Belgium's active secondary defences

JavaScript tops Belgium's active secondary defences
Value
WAF92.8%
Antibot20%
CAPTCHA22.3%
JavaScript43.3%
Rate Limiting12.2%
TLS17.7%
Has robots.txt81%
Blocks AI crawlers13.8%

WAF is deployed on 92.8% of Belgian sites. JavaScript leads among secondary barriers at 43.3%, followed by CAPTCHA at 22.3%. Antibot reaches 20.0%, TLS stands at 17.7%, and Rate Limiting at 12.2%.

1,111 sites
State of Web Access 2026
Belgium · Barrier Stacking · 2026

Most Belgian sites carry at least two barriers

Most Belgian sites carry at least two barriers
% of sites
0 barriers5%
1 barrier30%
2 barriers34.2%
3 barriers18.2%
4 barriers8.5%
5 barriers3.9%
6 barriers0.4%

5.0% of sites carry no barriers. The modal count is two at 34.2%. Sites with three or more barriers account for 31.0% combined: 18.2% at three, 8.5% at four, and 4.3% at five or six.

1,111 sites
State of Web Access 2026
Belgium · Recommended Zyte API Tier · 2026

Most Belgian sites are Easy to access

Most Belgian sites are Easy to access
Mean recommended tier
All sites1.6

The median recommended retrieval tier is 2, meaning fewer than half of sites are reachable via plain HTTP. The mean tier is 1.64.

1,111 sites
State of Web Access 2026
Belgium · Zyte API Tier Distribution · 2026

Nearly nine in ten Belgian sites are Simple or Easy to access

Nearly nine in ten Belgian sites are Simple or Easy to access
% of sites
1 - Simple49.3%
2 - Easy39.5%
3 - Moderate9.3%
4 - Complex1.6%
5 - Advanced0.3%

Tier 1 holds 49.3% of sites and Tier 2 holds 39.5%, a combined 88.8%. Tier 3 stands at 9.3%, Tier 4 at 1.6%, and Tier 5 at 0.3%.

1,111 sites
State of Web Access 2026
Belgium · Bot Category Mentions in <code>robots.txt</code> · 2026 · 1,111 Sites

AI crawlers top Belgium's robots.txt bot categories

AI crawlers top Belgium's robots.txt bot categories
% of sites
AI crawlers15.4%
SEO / search indexing13.2%
SEO audit tools14.5%
Commercial scrapers8.3%
Social / content scrapers5.7%
Archive / research crawlers5.8%
Monitoring / uptime bots0.5%

Across all 1,111 Belgium sites, 15.4% name at least one AI crawler. SEO audit tools appear in 14.5%, SEO/search indexing in 13.2%. Commercial scrapers reach 8.3%, archive crawlers 5.8%, and social scrapers 5.7%.

1,111 sites
State of Web Access 2026
Belgium · <code>robots.txt</code> Rule Posture Types · 2026 · 1,111 Sites

Uniform rules are Belgium's most common robots.txt posture

Uniform rules are Belgium's most common robots.txt posture
% of sites
Uniform per-agent rules (no path mixing)43.3%
Path-level mixed rules for same agent32.7%
Allow-only (no disallow rules)2.4%
Mixed AI posture (block some, allow others)2.3%
Blanket Disallow: /2.5%

19.0% of sites have no robots.txt. Uniform per-agent rules are most common at 43.3% of all sites, followed by path-mixed rules at 32.7%. Blanket Disallow: / applies to 2.5% of all sites; mixed-AI posture to 2.3%.

1,111 sites
State of Web Access 2026
Belgium · AI Agent <code>Disallow</code> vs <code>Allow</code> · 2026 · 1,111 Sites Surveyed

GPTBot faces the most Disallow rules in Belgium's robots.txt

GPTBot faces the most Disallow rules in Belgium's robots.txt
DisallowedAllowed (whitelisted)
GPTBot11.2%2.3%
CCBot8.5%1%
ClaudeBot8.2%1.2%
Google-Extended7.9%1.2%
Bytespider6.7%0.3%
meta-externalagent2.9%0.2%
ChatGPT-User6.3%2.5%
PerplexityBot5.5%2%
Applebot-Extended4.7%0.5%
OAI-SearchBot3.8%1.7%
anthropic-ai4.6%0.8%

GPTBot appears in Disallow rules on 11.2% of all 1,111 Belgium sites. CCBot is second at 8.5%. On the allow side, ChatGPT-User leads at 2.5%, followed by PerplexityBot at 2.0%.

1,111 sites surveyed · 900 with robots.txt
State of Web Access 2026
Belgium · Named-Bot <code>Disallow</code> Rate by Industry · Top 15 · 2026

Five Belgium sectors all name at least one bot to restrict

Five Belgium sectors all name at least one bot to restrict
% of sites
Computer & Video Games100%
Design100%
Entertainment100%
Retail100%
Visual Art100%
Adult90%
Agriculture90%
Apparel & Fashion90%
Automotive90%
Beauty & Cosmetics90%
Civil Engineering90%
Comics & Animation90%
Crafts90%
Fishery90%
General90%

Computer & Video Games, Design, Entertainment, Retail, and Visual Art each reach 100% — every site names at least one bot to restrict in a Disallow rule. Ten further sectors stand at 90%.

Most categories n=10 — each site = 10 percentage points · 1,111 Belgium sites
State of Web Access 2026
Belgium · Explicit Bot <code>Allow</code> / Whitelist Rate by Industry · Top 15 · 2026

Belgium's Airlines, Photography, and Publishing sectors lead in allowing crawlers

Belgium's Airlines, Photography, and Publishing sectors lead in allowing crawlers
% of sites
Airlines70%
Photography70%
Publishing70%
Retail70%
Science70%
Sports70%
Agriculture60%
Automotive60%
Crafts60%
Graphic Design60%
Healthcare60%
Investment60%
Oil & Gas60%
Public Policy60%
Real Estate60%

Six sectors — Airlines, Photography, Publishing, Retail, Science, and Sports — all reach 70%, the highest rate in Belgium, for sites naming at least one bot to allow in an Allow rule. Nine further sectors stand at 60%.

Most categories n=10 — each site = 10 percentage points · 1,111 Belgium sites
State of Web Access 2026
Belgium · Scraping Difficulty by Industry · Top 15 by Mean Tier · 2026

Jewellery & Luxury is Belgium's hardest sector to access programmatically

Jewellery & Luxury is Belgium's hardest sector to access programmatically
WAFAntibotCAPTCHAJavaScriptRate LimitTLSrobots.txtBlocks AITier
Jewellery & Luxury100%20%20%30%40%60%60%0%Tier 3
Automotive100%10%10%40%20%20%90%0%Tier 2
Beauty & Cosmetics90%30%20%30%20%30%90%10%Tier 2
Customer Services100%10%20%60%30%20%60%0%Tier 2
Furniture100%30%20%60%30%10%60%10%Tier 2
Hospitality90%20%0%60%20%40%70%20%Tier 2
Human Resources100%60%60%50%50%30%80%10%Tier 2
Real Estate100%20%20%60%40%20%60%20%Tier 2
Food & Beverages100%30%20%60%30%0%80%20%Tier 2
Apparel & Fashion90%10%20%50%20%40%90%10%Tier 2
Retail100%0%0%60%20%20%100%50%Tier 2
Computer Hardware90%10%0%30%10%30%80%10%Tier 2
Consumer Electronics80%20%10%40%20%30%80%10%Tier 2
Wine & Spirits100%40%20%50%20%10%70%50%Tier 2
Design100%20%30%40%20%30%100%30%Tier 2

Jewellery & Luxury posts the highest mean recommended tier at 2.70. Automotive and Beauty & Cosmetics follow at 2.40. A broad mid-table cluster from Customer Services down to Design spans 2.00–2.30.

Top 15 industries by mean Zyte browser tier · 1,111 sites
State of Web Access 2026
Belgium · Scraping Difficulty by Industry · Bottom 15 by Mean Tier · 2026

Nine Belgian sectors share the most accessible floor

Nine Belgian sectors share the most accessible floor
WAFAntibotCAPTCHAJavaScriptRate LimitTLSrobots.txtBlocks AITier
Equipment & Supplies90%30%10%50%30%20%60%10%Tier 2
Machinery90%10%0%60%0%0%90%10%Tier 2
Mail & Delivery70%40%10%10%0%20%80%0%Tier 2
Maritime90%10%0%40%10%30%90%10%Tier 2
Medical Devices100%0%10%60%10%0%100%10%Tier 2
Restaurants90%40%20%80%40%20%70%10%Tier 2
Sporting Goods80%30%40%20%40%30%70%0%Tier 2
Textiles & Nonwovens100%0%30%30%10%20%90%0%Tier 2
Transport & Logistics70%50%10%20%0%20%80%0%Tier 2
Crafts100%20%20%40%10%10%90%20%Tier 2
Manufacturing80%10%10%30%0%40%70%0%Tier 2
Printing100%20%20%20%0%10%100%0%Tier 2
Public Safety100%40%40%30%10%10%90%10%Tier 2
Reference90%60%30%50%30%10%60%40%Tier 2
Visual Art100%30%20%30%0%20%100%20%Tier 2

Equipment & Supplies, Machinery, Mail & Delivery, Maritime, Medical Devices, Restaurants, Sporting Goods, Textiles & Nonwovens, and Transport & Logistics all share the lowest mean tier of 2.00. Crafts, Manufacturing, Printing, Public Safety, Reference, and Visual Art follow at 1.90.

Bottom 15 industries by mean Zyte browser tier · 1,111 sites