State of Web Access2026

AI crawlers are the most-named bot category in Réunion's robots.txt files, yet only 12.9% of sites actually block them. The signal is more ambiguous than hostile — many of those mentions are accommodating rather than restrictive.

State of Web Access 2026
Réunion · Barrier Profile · 2026

JavaScript and CAPTCHA lead Réunion's secondary barriers

JavaScript and CAPTCHA lead Réunion's secondary barriers
Value
WAF94.5%
Antibot19.1%
CAPTCHA23.1%
JavaScript40.6%
Rate Limiting11.9%
TLS17.1%

WAF covers 94.5% of Réunion's 996 surveyed sites. JavaScript leads secondary barriers at 40.6%, with CAPTCHA at 23.1% and Antibot at 19.1% closely grouped below.

996 sites
State of Web Access 2026
Réunion · Barrier Adoption · 2026

JavaScript tops Réunion's active secondary defences

JavaScript tops Réunion's active secondary defences
Value
WAF94.5%
Antibot19.1%
CAPTCHA23.1%
JavaScript40.6%
Rate Limiting11.9%
TLS17.1%
Has robots.txt81.4%
Blocks AI crawlers12.9%

After WAF at 94.5%, JavaScript stands alone at 40.6% as the most-deployed secondary barrier. CAPTCHA (23.1%), Antibot (19.1%), TLS (17.1%), and Rate Limiting (11.9%) form a tighter cluster below.

996 sites
State of Web Access 2026
Réunion · Barrier Stacking · 2026

Two barriers is Réunion's modal configuration

Two barriers is Réunion's modal configuration
% of sites
0 barriers3.5%
1 barrier31.1%
2 barriers36%
3 barriers18.6%
4 barriers6.8%
5 barriers3.5%
6 barriers0.4%

3.5% of Réunion's sites carry no detectable barrier. Two barriers is the most common configuration at 36.0% of sites. Sites with three or more barriers together account for 29.3% of the sample.

996 sites
State of Web Access 2026
Réunion · Recommended Zyte API Tier · 2026

Most Réunion sites are Simple to access

Most Réunion sites are Simple to access
Mean recommended tier
All sites1.6

With a median of 1 and mean of 1.57, Réunion's sites lean toward Simple access. 56.2% of sites sit at Tier 1 — a majority. The 10.6% at Tiers 3–5 pull the mean above 1.

996 sites
State of Web Access 2026
Réunion · Zyte API Tier Distribution · 2026

Nine in ten Réunion sites are Simple or Easy to access

Nine in ten Réunion sites are Simple or Easy to access
% of sites
1 - Simple56.2%
2 - Easy33.1%
3 - Moderate8.7%
4 - Complex1.5%
5 - Advanced0.4%

Tier 1 is the largest group at 56.2% of Réunion's sites. Tier 2 adds 33.1%, reaching 89.3% combined. Tier 3 accounts for 8.7%, Tier 4 for 1.5%, and Tier 5 for 0.4%.

996 sites
State of Web Access 2026
Réunion · Bot Category Mentions in <code>robots.txt</code> · 2026 · 996 Sites

AI crawlers top Réunion's robots.txt bot categories

AI crawlers top Réunion's robots.txt bot categories
% of sites
AI crawlers15.5%
SEO / search indexing12.4%
SEO audit tools14.4%
Commercial scrapers6.9%
Social / content scrapers6.3%
Archive / research crawlers5.4%
Monitoring / uptime bots0.3%

AI crawlers are named in 15.5% of Réunion's 996 sites — the top category. SEO audit tools follow closely at 14.4%, with SEO / search indexing at 12.4%. Figures cover all sites including those without robots.txt.

996 sites
State of Web Access 2026
Réunion · <code>robots.txt</code> Rule Posture Types · 2026 · 996 Sites

Uniform rules are Réunion's most common robots.txt posture

Uniform rules are Réunion's most common robots.txt posture
% of sites
Uniform per-agent rules (no path mixing)40.6%
Path-level mixed rules for same agent35.4%
Allow-only (no disallow rules)2.4%
Mixed AI posture (block some, allow others)2.2%
Blanket Disallow: /2.9%

18.6% of Réunion's sites publish no robots.txt. Uniform per-agent rules account for 40.6% of all sites; path-level mixed rules for 35.4%. Blanket Disallow: / applies to 2.9% of all sites.

996 sites
State of Web Access 2026
Réunion · AI Agent <code>Disallow</code> vs <code>Allow</code> · 2026 · 996 Sites Surveyed

GPTBot faces the most Disallow rules in Réunion's robots.txt

GPTBot faces the most Disallow rules in Réunion's robots.txt
DisallowedAllowed (whitelisted)
GPTBot10.2%2%
CCBot7.6%0.8%
ClaudeBot7.2%1.2%
Google-Extended7.6%1.2%
Bytespider6.4%0.2%
meta-externalagent3.1%0.3%
ChatGPT-User5.6%2.7%
PerplexityBot5.2%2.1%
Applebot-Extended4.3%0.2%
OAI-SearchBot3.1%1.9%
anthropic-ai3.9%0.5%

GPTBot is Disallowed by 10.2% of Réunion's 996 sites and explicitly Allowed by 2.0%. ChatGPT-User carries the highest explicit Allow rate at 2.7%. All figures include sites without robots.txt.

996 sites surveyed · 811 with robots.txt
State of Web Access 2026
Réunion · Named-Bot <code>Disallow</code> Rate by Industry · Top 15 · 2026

Multiple Réunion sectors all name at least one bot to restrict

Multiple Réunion sectors all name at least one bot to restrict
% of sites
Agriculture100%
Biotech100%
Civil Engineering100%
Computer & Video Games100%
Design100%
Entertainment100%
Military100%
Museums100%
Newspapers100%
Publishing100%
Retail100%
Adult90%
Aerospace & Defence90%
Beauty & Cosmetics90%
Foreign Language90%

Agriculture, Biotech, Civil Engineering, Computer & Video Games, Design, Entertainment, Military, Museums, Newspapers, Publishing, and Retail all have every surveyed site naming at least one bot to restrict in robots.txt.

Most categories n=10 — each site = 10 percentage points · 996 Réunion sites
State of Web Access 2026
Réunion · Explicit Bot <code>Allow</code> / Whitelist Rate by Industry · Top 15 · 2026

Réunion's Graphic Design sites lead in explicitly allowing crawlers

Réunion's Graphic Design sites lead in explicitly allowing crawlers
% of sites
Graphic Design71.4%
Airlines70%
Biotech70%
Import & Export70%
Mental Health70%
Photography70%
Publishing70%
Retail70%
Writing & Editing66.7%
Civil Engineering62.5%
Accounting & Auditing60%
Architecture60%
Consulting60%
Customer Services60%
Market Research60%

Graphic Design has the highest named-bot Allow rate in Réunion at 71.4% of sites in that sector. Airlines, Biotech, Import & Export, Mental Health, Photography, Publishing, and Retail follow at 70%.

Most categories n=10 — each site = 10 percentage points · 996 Réunion sites
State of Web Access 2026
Réunion · Scraping Difficulty by Industry · Top 15 by Mean Tier · 2026

Hospitality is Réunion's hardest sector to access programmatically

Hospitality is Réunion's hardest sector to access programmatically
WAFAntibotCAPTCHAJavaScriptRate LimitTLSrobots.txtBlocks AITier
Hospitality100%10%0%40%20%40%70%20%Tier 3
Jewellery & Luxury90%40%10%40%30%60%70%10%Tier 2
Apparel & Fashion90%20%30%60%30%40%80%10%Tier 2
Beauty & Cosmetics100%40%20%60%40%10%90%10%Tier 2
Consumer Electronics70%10%10%30%10%40%80%10%Tier 2
Furniture100%40%20%40%20%10%60%10%Tier 2
Human Resources100%50%50%60%40%10%70%0%Tier 2
Retail100%0%0%60%20%20%100%50%Tier 2
Sporting Goods80%20%40%20%20%30%70%0%Tier 2
Computer Hardware90%0%0%20%0%50%90%0%Tier 2
Transport & Logistics80%30%10%30%10%30%80%0%Tier 2
Automotive100%10%0%50%40%20%90%0%Tier 2
Design100%20%30%40%20%30%100%30%Tier 2
Food & Beverages100%10%30%50%10%20%80%0%Tier 2
Mail & Delivery80%20%20%20%20%30%70%0%Tier 2

Hospitality has the highest mean browser tier at 2.30 and is the only industry with a median of 3, placing it at the top of Réunion's difficulty ranking. Jewellery & Luxury and seven others follow at mean 2.20.

Top 15 industries by mean Zyte browser tier · 996 sites
State of Web Access 2026
Réunion · Scraping Difficulty by Industry · Bottom 15 by Mean Tier · 2026

Réunion's most accessible sectors share a floor mean tier of 1.80

Réunion's most accessible sectors share a floor mean tier of 1.80
WAFAntibotCAPTCHAJavaScriptRate LimitTLSrobots.txtBlocks AITier
Real Estate100%30%20%80%30%10%90%20%Tier 2
Recruitment & Staffing100%50%40%40%0%10%80%0%Tier 2
Manufacturing100%20%20%50%20%30%90%0%Tier 2
Pharmaceuticals100%40%20%50%10%10%60%0%Tier 2
Science100%40%30%40%20%20%80%10%Tier 2
Textiles & Nonwovens90%0%20%40%10%20%80%0%Tier 2
Airlines100%20%10%70%20%20%80%30%Tier 2
Banking90%20%0%0%0%0%70%10%Tier 2
Libraries100%20%0%50%10%10%90%20%Tier 2
Maritime100%40%10%60%30%30%90%20%Tier 2
Music100%40%30%60%20%20%90%10%Tier 2
Publishing100%20%30%40%10%0%100%40%Tier 2
Restaurants100%30%30%60%30%10%50%0%Tier 2
Travel & Tourism100%30%10%70%10%10%70%30%Tier 2
Visual Art100%50%20%30%10%20%80%10%Tier 2

The lowest mean browser tier in Réunion is 1.80, shared by 15 sectors including Airlines, Banking, Libraries, Maritime, Music, Publishing, Restaurants, Travel & Tourism, and Visual Art.

Bottom 15 industries by mean Zyte browser tier · 996 sites