Overview
CAPTCHA is Saint Barthélemy's most elevated secondary barrier
| Value | |
|---|---|
| WAF | 92.4% |
| Antibot | 16.6% |
| CAPTCHA | 28.9% |
| JavaScript | 37.9% |
| Rate Limiting | 10.5% |
| TLS | 15.2% |
WAF sits at 92.4% across 277 Saint Barthélemy domains. CAPTCHA at 28.9% is markedly above the 23.1% global rate. Antibot (16.6%) and Rate Limiting (10.5%) both fall below their global benchmarks.
Barrier Landscape
CAPTCHA is Saint Barthélemy's most distinctive secondary barrier
| Value | |
|---|---|
| WAF | 92.4% |
| Antibot | 16.6% |
| CAPTCHA | 28.9% |
| JavaScript | 37.9% |
| Rate Limiting | 10.5% |
| TLS | 15.2% |
| Has robots.txt | 79.4% |
| Blocks AI crawlers | 14.4% |
WAF leads at 92.4%. CAPTCHA at 28.9% is the most elevated secondary barrier, well above its global rate. JavaScript (37.9%) and Antibot (16.6%) are below typical. Rate Limiting (10.5%) and TLS (15.2%) are the lightest layers.
Most Saint Barthélemy sites carry a single barrier
| % of sites | |
|---|---|
| 0 barriers | 4.7% |
| 1 barrier | 34.3% |
| 2 barriers | 32.9% |
| 3 barriers | 14.8% |
| 4 barriers | 10.5% |
| 5 barriers | 2.2% |
| 6 barriers | 0.7% |
One-barrier sites are the mode at 34.3%, followed by two-barrier at 32.9%. Only 4.7% carry no barriers. Three or more barriers apply to 28.0% of sites.
Most Saint Barthélemy sites are Simple to access
| Mean recommended tier | |
|---|---|
| All sites | 1.5 |
Browser-based median recommended tier is 1, with 61.0% of sites retrievable at Tier 1 — the highest Tier 1 share in this group. The mean of 1.52 reflects the prevalence of simpler sites. No Tier 5 sites were recorded.
Most Saint Barthélemy sites are Simple or Easy to access
| % of sites | |
|---|---|
| 1 - Simple | 61% |
| 2 - Easy | 28.5% |
| 3 - Moderate | 7.2% |
| 4 - Complex | 3.2% |
| 5 - Advanced | 0% |
Tier 1 covers 61.0% of sites and Tier 2 a further 28.5% — 89.5% combined. Tier 3 accounts for 7.2% and Tier 4 for 3.2%. No sites required Tier 5.
robots.txt
AI crawlers top Saint Barthélemy's robots.txt bot categories
| % of sites | |
|---|---|
| AI crawlers | 18.1% |
| SEO / search indexing | 13.7% |
| SEO audit tools | 14.4% |
| Commercial scrapers | 10.8% |
| Social / content scrapers | 9% |
| Archive / research crawlers | 6.1% |
| Monitoring / uptime bots | 0% |
AI crawlers appear in 18.1% of all Saint Barthélemy sites’ robot policies. SEO audit tools follow at 14.4% and SEO/search indexing at 13.7%. Commercial scrapers (10.8%) and social crawlers (9.0%) also feature.
Uniform rules are Saint Barthélemy's most common robots.txt posture
| % of sites | |
|---|---|
| Uniform per-agent rules (no path mixing) | 38.6% |
| Path-level mixed rules for same agent | 33.2% |
| Allow-only (no disallow rules) | 2.5% |
| Mixed AI posture (block some, allow others) | 2.9% |
| Blanket Disallow: / | 5.1% |
Uniform per-agent rules cover 38.6% of all sites and path-level mixed rules 33.2%. Blanket Disallow: / affects 5.1% of sites — higher than most territories in this group. Mixed-AI posture accounts for 2.9%.
GPTBot faces the most Disallow rules in Saint Barthélemy's robots.txt
| Disallowed | Allowed (whitelisted) | |
|---|---|---|
| GPTBot | 12.6% | 1.8% |
| CCBot | 7.2% | 0.4% |
| ClaudeBot | 11.2% | 1.4% |
| Google-Extended | 9.4% | 1.8% |
| Bytespider | 7.2% | 0.4% |
| meta-externalagent | 5.8% | 1.1% |
| ChatGPT-User | 7.6% | 5.1% |
| PerplexityBot | 9.4% | 4.3% |
| Applebot-Extended | 5.4% | — |
| OAI-SearchBot | 5.1% | 3.6% |
| anthropic-ai | 4.7% | 1.4% |
GPTBot appears in Disallow rules on 12.6% of all sites; ClaudeBot follows at 11.2%. ChatGPT-User (5.1%) and PerplexityBot (4.3%) lead Allow rules.
Retail sites in Saint Barthélemy all name at least one bot
| % of sites | |
|---|---|
| Retail | 100% |
| General | 90% |
| Mass Media | 90% |
| Newspapers | 90% |
| Online Services | 90% |
| Sporting Goods | 80% |
| Sports | 80% |
| Travel & Tourism | 80% |
| Entertainment | 77.8% |
| Real Estate | 75% |
| Airlines | 70% |
| Government | 70% |
| Software & Dev | 70% |
| Renewable Energy | 62.5% |
| Automotive | 60% |
Retail reaches 100% — every site names at least one bot in a Disallow rule. General, Mass Media, Newspapers, and Online Services follow at 90%. The top-15 list spans a relatively narrow 60–100% range.
Saint Barthélemy's Retail sites lead in explicitly allowing crawlers
| % of sites | |
|---|---|
| Retail | 80% |
| Airlines | 60% |
| Sporting Goods | 60% |
| Travel & Tourism | 60% |
| Automotive | 50% |
| General | 50% |
| Mass Media | 50% |
| Newspapers | 50% |
| Online Services | 50% |
| Real Estate | 50% |
| Software & Dev | 50% |
| Sports | 50% |
| Computer & Video Games | 42.9% |
| Government | 40% |
| Hospitality | 40% |
Retail tops the allowlist at 80% — eight in ten sites name at least one bot in an Allow rule. Airlines, Sporting Goods, and Travel & Tourism follow at 60%.
Industry Patterns
Retail is the most demanding sector to crawl in Saint Barthélemy
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Retail | 100% | 10% | 20% | 50% | 20% | 0% | 100% | 30% | Tier 2 |
| Automotive | 100% | 10% | 10% | 70% | 30% | 10% | 60% | 0% | Tier 2 |
| Travel & Tourism | 100% | 50% | 40% | 50% | 40% | 20% | 90% | 40% | Tier 2 |
| Computer & Video Games | 100% | 0% | 0% | 42.9% | 0% | 0% | 71.4% | 14.3% | Tier 2 |
| Finance | 90% | 20% | 10% | 10% | 0% | 20% | 70% | 10% | Tier 2 |
| Government | 80% | 10% | 10% | 20% | 0% | 10% | 70% | 0% | Tier 2 |
| Real Estate | 100% | 25% | 37.5% | 50% | 12.5% | 12.5% | 75% | 25% | Tier 1 |
| Sporting Goods | 90% | 20% | 60% | 20% | 10% | 10% | 90% | 10% | Tier 1 |
| Airlines | 90% | 40% | 60% | 30% | 0% | 0% | 80% | 20% | Tier 1 |
| General | 100% | 0% | 50% | 50% | 10% | 40% | 90% | 40% | Tier 1 |
| Mass Media | 100% | 0% | 50% | 50% | 10% | 40% | 90% | 40% | Tier 1 |
| Newspapers | 100% | 0% | 20% | 40% | 0% | 20% | 100% | 50% | Tier 1 |
| Online Services | 100% | 0% | 50% | 50% | 10% | 40% | 90% | 40% | Tier 1 |
| Sports | 100% | 30% | 70% | 20% | 20% | 20% | 100% | 0% | Tier 1 |
| Banking | 70% | 10% | 0% | 10% | 0% | 0% | 50% | 0% | Tier 1 |
Retail leads with a mean recommended tier of 2.20 at median Tier 2. Most other sectors cluster at median Tier 1 or 2 with means between 1.40 and 2.00, reflecting the territory’s generally light crawl difficulty.
Education and Telecom sites are Saint Barthélemy's most accessible programmatically
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Software & Dev | 80% | 10% | 10% | 30% | 10% | 20% | 70% | 10% | Tier 1 |
| Computers & Electronics | 100% | 0% | 40% | 0% | 0% | 0% | 80% | 0% | Tier 1 |
| Hospitality | 100% | 60% | 50% | 70% | 20% | 20% | 70% | 10% | Tier 1 |
| IT Services | 90% | 0% | 0% | 50% | 0% | 10% | 60% | 0% | Tier 1 |
| Renewable Energy | 87.5% | 37.5% | 37.5% | 37.5% | 25% | 37.5% | 75% | 0% | Tier 1 |
| Entertainment | 88.9% | 0% | 33.3% | 55.6% | 11.1% | 0% | 77.8% | 44.4% | Tier 1 |
| Education | 100% | 0% | 16.7% | 0% | 0% | 0% | 66.7% | 0% | Tier 1 |
| Telecom | 100% | 0% | 0% | 66.7% | 0% | 0% | 50% | 0% | Tier 1 |
Education and Telecom both record a mean recommended tier of 1.17 — the floor across Saint Barthélemy’s sector set. Several other sectors cluster just above at means of 1.33–1.40.