Overview
Antibot is unusually low among Falkland Islands secondary barriers
| Value | |
|---|---|
| WAF | 95.3% |
| Antibot | 13.3% |
| CAPTCHA | 17.5% |
| JavaScript | 38.9% |
| Rate Limiting | 9% |
| TLS | 16.1% |
WAF reaches 95.3%. JavaScript is the strongest secondary barrier at 38.9%. Antibot sits at 13.3% — below both CAPTCHA (17.5%) and TLS (16.1%). Rate Limiting is lowest at 9.0%.
Barrier Landscape
JavaScript outranks Antibot — an inversion of the typical ordering
| Value | |
|---|---|
| WAF | 95.3% |
| Antibot | 13.3% |
| CAPTCHA | 17.5% |
| JavaScript | 38.9% |
| Rate Limiting | 9% |
| TLS | 16.1% |
| Has robots.txt | 83.9% |
| Blocks AI crawlers | 15.2% |
WAF leads at 95.3%. JavaScript reaches 38.9%. TLS (16.1%) exceeds Antibot (13.3%), reversing the more common ordering where Antibot exceeds TLS. Rate Limiting is the lowest secondary barrier at 9.0%.
Two barriers is the most common site configuration
| % of sites | |
|---|---|
| 0 barriers | 1.9% |
| 1 barrier | 35.5% |
| 2 barriers | 42.7% |
| 3 barriers | 11.4% |
| 4 barriers | 7.6% |
| 5 barriers | 0.9% |
| 6 barriers | 0% |
42.7% of sites carry exactly two barriers — the most common count. Just 1.9% have zero. 19.9% deploy three or more, and no site reaches six barriers.
Most Falkland Islands sites are Simple to access
| Mean recommended tier | |
|---|---|
| All sites | 1.5 |
Mean recommended tier is 1.5 with a median of 1, indicating that more than 50% of Falkland Islands sites resolve at Tier 1. Mean is pulled above 1.5 by a minority of harder sites.
Most Falkland Islands sites are Simple or Easy to access
| % of sites | |
|---|---|
| 1 - Simple | 57.3% |
| 2 - Easy | 35.5% |
| 3 - Moderate | 6.6% |
| 4 - Complex | 0.5% |
| 5 - Advanced | 0% |
Tier 1 accounts for 57.3% of sites and Tier 2 for 35.5% — 92.8% combined. Tier 3 reaches 6.6%, Tier 4 just 0.5%. No site requires Tier 5 retrieval.
robots.txt
Commercial scrapers are unusually prominent in robots.txt
| % of sites | |
|---|---|
| AI crawlers | 16.1% |
| SEO / search indexing | 11.4% |
| SEO audit tools | 13.7% |
| Commercial scrapers | 10.4% |
| Social / content scrapers | 8.5% |
| Archive / research crawlers | 4.3% |
| Monitoring / uptime bots | 0% |
16.1% of all sites name at least one AI crawler — the top category. SEO audit tools follow at 13.7%, SEO/search indexing at 11.4%. Commercial scrapers appear at 10.4%. Monitoring bots are named by 0% of sites.
Uniform per-agent rules cover nearly half of all sites
| % of sites | |
|---|---|
| Uniform per-agent rules (no path mixing) | 46.4% |
| Path-level mixed rules for same agent | 29.9% |
| Allow-only (no disallow rules) | 2.4% |
| Mixed AI posture (block some, allow others) | 4.3% |
| Blanket Disallow: / | 3.3% |
46.4% of all sites use uniform per-agent rules. Path-level mixed rules account for 29.9%. Mixed AI posture (4.3%) exceeds both Allow-only (2.4%) and Blanket Disallow (3.3%).
GPTBot faces the most Disallow rules in Falkland Islands's robots.txt
| Disallowed | Allowed (whitelisted) | |
|---|---|---|
| GPTBot | 12.8% | 2.4% |
| CCBot | 10% | 0.9% |
| ClaudeBot | 11.4% | 0.9% |
| Google-Extended | 11.8% | 0.9% |
| Bytespider | 8.1% | — |
| meta-externalagent | 5.7% | — |
| ChatGPT-User | 9% | 4.3% |
| PerplexityBot | 10.4% | 1.4% |
| Applebot-Extended | 6.6% | — |
| OAI-SearchBot | 5.2% | 1.4% |
| anthropic-ai | 6.6% | — |
GPTBot is Disallowed by 12.8% of all sites. Google-Extended (11.8%) and ClaudeBot (11.4%) follow closely. ChatGPT-User receives the highest explicit Allow rate at 4.3%.
Mass Media and Newspapers sites all block every named bot
| % of sites | |
|---|---|
| Mass Media | 100% |
| Newspapers | 100% |
| General | 90% |
| Online Services | 90% |
| Publishing | 80% |
| Retail | 80% |
| Software & Dev | 80% |
| Non-Profit | 71.4% |
| Education | 70% |
| IT Services | 70% |
| Entertainment | 66.7% |
| Government | 60% |
| Airlines | 50% |
| Computer & Video Games | 50% |
| Ecology & Environment | 50% |
Mass Media and Newspapers both show 100% of sites naming at least one bot in a Disallow rule. General and Online Services follow at 90%. Publishing, Retail, and Software & Dev each reach 80%.
Mass Media leads sectors on explicit bot Allow rules
| % of sites | |
|---|---|
| Mass Media | 70% |
| Education | 60% |
| General | 60% |
| Online Services | 60% |
| Non-Profit | 57.1% |
| Airlines | 50% |
| Entertainment | 50% |
| IT Services | 50% |
| Publishing | 50% |
| Software & Dev | 50% |
| Travel & Tourism | 50% |
| Retail | 40% |
| Science | 33.3% |
| Computer & Video Games | 30% |
| Government | 30% |
Mass Media shows 70% of sites naming at least one bot in an Allow rule. Education, General, and Online Services follow at 60%. Non-Profit reaches 57.1%, and six sectors share 50%.
Industry Patterns
Publishing is the hardest sector to access programmatically
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Publishing | 100% | 40% | 20% | 40% | 40% | 10% | 80% | 10% | Tier 2 |
| Government | 70% | 10% | 10% | 30% | 0% | 20% | 90% | 0% | Tier 2 |
| Retail | 90% | 0% | 10% | 50% | 10% | 20% | 90% | 10% | Tier 2 |
| Airlines | 90% | 0% | 0% | 50% | 0% | 0% | 90% | 10% | Tier 2 |
| Science | 100% | 33.3% | 0% | 33.3% | 33.3% | 0% | 50% | 0% | Tier 2 |
| General | 100% | 0% | 30% | 50% | 10% | 30% | 90% | 40% | Tier 2 |
| Software & Dev | 100% | 20% | 0% | 30% | 0% | 10% | 80% | 10% | Tier 2 |
| Education | 90% | 10% | 0% | 50% | 0% | 10% | 80% | 20% | Tier 2 |
| Mass Media | 100% | 0% | 40% | 60% | 10% | 30% | 100% | 50% | Tier 2 |
| Online Services | 100% | 0% | 30% | 50% | 10% | 30% | 90% | 40% | Tier 2 |
| Travel & Tourism | 90% | 30% | 0% | 30% | 10% | 0% | 80% | 10% | Tier 2 |
| Entertainment | 83.3% | 0% | 33.3% | 50% | 0% | 16.7% | 83.3% | 16.7% | Tier 1 |
| Newspapers | 100% | 0% | 20% | 20% | 0% | 40% | 100% | 40% | Tier 1 |
| IT Services | 100% | 0% | 0% | 40% | 0% | 20% | 80% | 20% | Tier 1 |
| Computer & Video Games | 100% | 30% | 30% | 70% | 30% | 10% | 70% | 0% | Tier 1 |
Publishing is the hardest sector with a median tier of 2 and a mean of 2.20. Government and Retail follow at mean 1.90. Travel & Tourism and Entertainment share a mean of 1.50. Newspapers, IT Services, and Computer & Video Games reach median tier 1.
Agriculture reaches the most accessible floor at Falkland Islands
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Non-Profit | 100% | 28.6% | 14.3% | 28.6% | 0% | 14.3% | 100% | 28.6% | Tier 1 |
| Ecology & Environment | 100% | 10% | 30% | 30% | 0% | 10% | 80% | 20% | Tier 1 |
| Agriculture | 100% | 0% | 0% | 20% | 0% | 40% | 80% | 20% | Tier 1 |
Three sectors form the accessible end of the distribution. Agriculture achieves a mean tier of 1.00 — the floor. Ecology & Environment follows at 1.10, and Non-Profit at 1.14. All three have a median of 1.