Overview
CAPTCHA outranks Antibot in French Guiana secondary barriers
| Value | |
|---|---|
| WAF | 93.8% |
| Antibot | 18.1% |
| CAPTCHA | 21.1% |
| JavaScript | 38.5% |
| Rate Limiting | 12.2% |
| TLS | 15% |
WAF reaches 93.8%. JavaScript leads secondary barriers at 38.5%. CAPTCHA (21.1%) and Antibot (18.1%) outrank TLS (15.0%). Rate Limiting is lowest at 12.2%.
Barrier Landscape
JavaScript outranks Antibot — above the typical ordering
| Value | |
|---|---|
| WAF | 93.8% |
| Antibot | 18.1% |
| CAPTCHA | 21.1% |
| JavaScript | 38.5% |
| Rate Limiting | 12.2% |
| TLS | 15% |
| Has robots.txt | 79.3% |
| Blocks AI crawlers | 14.5% |
WAF leads at 93.8%. JavaScript reaches 38.5%. CAPTCHA (21.1%) exceeds Antibot (18.1%) by three percentage points. TLS (15.0%) and Rate Limiting (12.2%) are the two lowest secondary barriers.
One and two barriers are virtually tied as most common configurations
| % of sites | |
|---|---|
| 0 barriers | 4.2% |
| 1 barrier | 34.1% |
| 2 barriers | 35.1% |
| 3 barriers | 16.7% |
| 4 barriers | 5.6% |
| 5 barriers | 3.9% |
| 6 barriers | 0.4% |
35.1% of sites carry two barriers and 34.1% carry one — separated by just one percentage point. 4.2% have zero. 26.6% deploy three or more, with 0.4% using all six.
Most French Guiana sites are Simple to access
| Mean recommended tier | |
|---|---|
| All sites | 1.6 |
Mean recommended tier is 1.58 with a median of 1, indicating that more than 50% of French Guiana sites resolve at Tier 1. The mean is lifted by a minority of higher-tier sites.
Most French Guiana sites are Simple or Easy to access
| % of sites | |
|---|---|
| 1 - Simple | 57.4% |
| 2 - Easy | 30.7% |
| 3 - Moderate | 9.2% |
| 4 - Complex | 2.2% |
| 5 - Advanced | 0.6% |
Tier 1 accounts for 57.4% of sites and Tier 2 for 30.7% — 88.1% combined. Tier 3 reaches 9.2%, Tier 4 is 2.2%, and Tier 5 is 0.6%.
robots.txt
AI crawlers lead the bot category mentions in robots.txt
| % of sites | |
|---|---|
| AI crawlers | 17.6% |
| SEO / search indexing | 12.8% |
| SEO audit tools | 14.8% |
| Commercial scrapers | 7.9% |
| Social / content scrapers | 6.7% |
| Archive / research crawlers | 6.4% |
| Monitoring / uptime bots | 0.3% |
17.6% of all sites name at least one AI crawler in robots.txt — the highest category. SEO audit tools follow at 14.8%, SEO/search indexing at 12.8%. Archive/research crawlers (6.4%) nearly match Social/content scrapers (6.7%).
Uniform and path-mixed postures differ by only six points
| % of sites | |
|---|---|
| Uniform per-agent rules (no path mixing) | 40.1% |
| Path-level mixed rules for same agent | 34.2% |
| Allow-only (no disallow rules) | 2.2% |
| Mixed AI posture (block some, allow others) | 2.8% |
| Blanket Disallow: / | 2.5% |
40.1% of all sites use uniform per-agent rules and 34.2% use path-level mixed rules — separated by just 5.9 points. Mixed AI posture (2.8%), Blanket Disallow (2.5%), and Allow-only (2.2%) each sit below 3%.
GPTBot faces the most Disallow rules in French Guiana's robots.txt
| Disallowed | Allowed (whitelisted) | |
|---|---|---|
| GPTBot | 11.2% | 1.5% |
| CCBot | 8.8% | 0.5% |
| ClaudeBot | 8.5% | 0.6% |
| Google-Extended | 8.9% | 0.9% |
| Bytespider | 7.1% | 0.3% |
| meta-externalagent | 4.1% | 0.4% |
| ChatGPT-User | 6.5% | 2.9% |
| PerplexityBot | 6.7% | 2.4% |
| Applebot-Extended | 4.2% | — |
| OAI-SearchBot | 3.6% | 2% |
| anthropic-ai | 4.3% | 0.6% |
GPTBot is Disallowed by 11.2% of all sites — the top blocked agent. Google-Extended (8.9%) and CCBot (8.8%) follow. ChatGPT-User receives the highest explicit Allow rate at 2.9%.
Five sectors unanimously name at least one bot to restrict
| % of sites | |
|---|---|
| Design | 100% |
| Entertainment | 100% |
| Performing Arts | 100% |
| Publishing | 100% |
| Retail | 100% |
| Adult | 90% |
| Computer & Video Games | 90% |
| Computer Hardware | 90% |
| Food & Beverages | 90% |
| Gambling | 90% |
| General | 90% |
| Machinery | 90% |
| Mass Media | 90% |
| Newspapers | 90% |
| Online Services | 90% |
Design, Entertainment, Performing Arts, Publishing, and Retail each show 100% of sites naming at least one bot in a Disallow rule. Nine further sectors sit at 90%, including Adult, Computer & Video Games, Computer Hardware, Food & Beverages, and Gambling.
Retail leads sectors on explicit bot Allow rules
| % of sites | |
|---|---|
| Retail | 80% |
| Photography | 70% |
| Import & Export | 62.5% |
| Airlines | 60% |
| Beauty & Cosmetics | 60% |
| Computer Hardware | 60% |
| Machinery | 60% |
| Museums | 60% |
| Publishing | 60% |
| Software & Dev | 60% |
| Sports | 60% |
| Travel & Tourism | 60% |
| Wellness | 60% |
| Events | 55.6% |
| Foreign Language | 55.6% |
Retail shows 80% of sites naming at least one bot in an Allow rule — the highest rate. Photography follows at 70%. Import & Export reaches 62.5%. Airlines, Beauty & Cosmetics, Computer Hardware, Machinery, Museums, Publishing, Software & Dev, Sports, Travel & Tourism, and Wellness all sit at 60%.
Industry Patterns
Sporting Goods is the hardest sector to access programmatically
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Sporting Goods | 90% | 30% | 30% | 10% | 20% | 40% | 60% | 0% | Tier 3 |
| Computer Hardware | 90% | 10% | 0% | 20% | 0% | 40% | 100% | 10% | Tier 3 |
| Apparel & Fashion | 80% | 20% | 30% | 50% | 20% | 30% | 90% | 10% | Tier 2 |
| Airlines | 100% | 10% | 10% | 50% | 30% | 20% | 90% | 30% | Tier 2 |
| Consumer Electronics | 80% | 10% | 10% | 20% | 10% | 40% | 90% | 20% | Tier 2 |
| Food & Beverages | 100% | 30% | 20% | 70% | 20% | 0% | 90% | 20% | Tier 2 |
| Retail | 100% | 0% | 0% | 50% | 20% | 20% | 100% | 50% | Tier 2 |
| Transport & Logistics | 90% | 30% | 20% | 30% | 30% | 30% | 50% | 0% | Tier 2 |
| Design | 100% | 20% | 30% | 40% | 20% | 30% | 100% | 30% | Tier 2 |
| Education | 100% | 20% | 10% | 20% | 10% | 10% | 70% | 10% | Tier 2 |
| Hospitality | 100% | 10% | 0% | 70% | 10% | 20% | 70% | 20% | Tier 2 |
| Human Resources | 100% | 30% | 30% | 40% | 30% | 10% | 80% | 0% | Tier 2 |
| Publishing | 100% | 10% | 30% | 40% | 10% | 0% | 100% | 40% | Tier 2 |
| Real Estate | 100% | 30% | 10% | 80% | 20% | 10% | 80% | 20% | Tier 2 |
| Science | 100% | 20% | 0% | 30% | 20% | 10% | 70% | 0% | Tier 2 |
Sporting Goods leads with a median tier of 3 and a mean of 2.60. Computer Hardware also reaches median tier 3 with a mean of 2.50. The remaining 13 sectors all sit at median tier 2, ranging from mean 2.30 (Apparel & Fashion) down to 2.00.
Five sectors share French Guiana's most accessible floor
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Recruitment & Staffing | 100% | 30% | 30% | 40% | 0% | 0% | 80% | 0% | Tier 2 |
| Automotive | 100% | 10% | 0% | 60% | 30% | 0% | 80% | 10% | Tier 2 |
| Banking | 100% | 30% | 0% | 20% | 10% | 0% | 60% | 10% | Tier 2 |
| Furniture | 100% | 20% | 30% | 40% | 30% | 0% | 70% | 0% | Tier 2 |
| Mail & Delivery | 90% | 30% | 30% | 10% | 40% | 30% | 30% | 0% | Tier 2 |
| Sports | 100% | 10% | 10% | 50% | 0% | 10% | 100% | 70% | Tier 2 |
| Travel & Tourism | 100% | 20% | 10% | 50% | 30% | 10% | 80% | 30% | Tier 2 |
| Maritime | 100% | 42.9% | 42.9% | 28.6% | 14.3% | 28.6% | 85.7% | 0% | Tier 2 |
| Construction | 80% | 0% | 10% | 40% | 10% | 10% | 70% | 10% | Tier 2 |
| Music | 100% | 40% | 30% | 50% | 20% | 20% | 100% | 0% | Tier 2 |
| Adult | 100% | 40% | 40% | 70% | 10% | 20% | 90% | 10% | Tier 2 |
| Advertising & Mktg | 100% | 10% | 40% | 40% | 0% | 20% | 100% | 10% | Tier 2 |
| Computer & Video Games | 100% | 20% | 20% | 50% | 10% | 10% | 100% | 20% | Tier 2 |
| Finance | 80% | 20% | 10% | 30% | 0% | 10% | 60% | 10% | Tier 2 |
| Wholesalers | 100% | 30% | 0% | 60% | 20% | 10% | 90% | 30% | Tier 2 |
The most accessible sectors reach a mean tier of 1.70. Adult, Advertising & Mktg, Computer & Video Games, Finance, and Wholesalers all share this floor — each with a median of 2.