Overview
JavaScript is Montserrat's leading secondary barrier
| Value | |
|---|---|
| WAF | 93.6% |
| Antibot | 16.2% |
| CAPTCHA | 23% |
| JavaScript | 44.1% |
| Rate Limiting | 11.3% |
| TLS | 18.6% |
WAF reaches 93.6% across Montserrat’s 204 domains. JavaScript at 44.1% is the top secondary barrier. TLS (18.6%) sits above its global rate. CAPTCHA (23.0%) is near-typical, while Antibot (16.2%) is below the global average.
Barrier Landscape
JavaScript tops Montserrat's active secondary defences
| Value | |
|---|---|
| WAF | 93.6% |
| Antibot | 16.2% |
| CAPTCHA | 23% |
| JavaScript | 44.1% |
| Rate Limiting | 11.3% |
| TLS | 18.6% |
| Has robots.txt | 79.9% |
| Blocks AI crawlers | 20.6% |
WAF leads at 93.6% and JavaScript follows at 44.1%. CAPTCHA (23.0%), TLS (18.6%), and Antibot (16.2%) form a mid-tier cluster. Rate Limiting at 11.3% is the least-deployed barrier.
Most Montserrat sites carry at least two barriers
| % of sites | |
|---|---|
| 0 barriers | 4.9% |
| 1 barrier | 21.6% |
| 2 barriers | 45.6% |
| 3 barriers | 20.1% |
| 4 barriers | 5.4% |
| 5 barriers | 2.5% |
| 6 barriers | 0% |
Two-barrier sites account for 45.6% of Montserrat’s domains — the modal category by a clear margin. Single-barrier sites follow at 21.6%. Sites with no barriers are 4.9%, and three-or-more total 28.0%.
Most Montserrat sites are Simple to access
| Mean recommended tier | |
|---|---|
| All sites | 1.6 |
Browser-based median recommended tier is 1, meaning over half of Montserrat’s domains are retrievable at Tier 1 (Simple). The mean of 1.64 confirms most sites cluster at the lowest tiers.
Most Montserrat sites are Simple or Easy to access
| % of sites | |
|---|---|
| 1 - Simple | 52.9% |
| 2 - Easy | 33.8% |
| 3 - Moderate | 10.8% |
| 4 - Complex | 1.5% |
| 5 - Advanced | 1% |
Tier 1 covers 52.9% of sites and Tier 2 a further 33.8% — 86.7% combined. Tier 3 accounts for 10.8%. Tiers 4 and 5 together affect only 2.5% of domains.
robots.txt
AI crawlers top Montserrat's robots.txt bot categories
| % of sites | |
|---|---|
| AI crawlers | 23% |
| SEO / search indexing | 15.2% |
| SEO audit tools | 14.7% |
| Commercial scrapers | 12.3% |
| Social / content scrapers | 9.3% |
| Archive / research crawlers | 3.4% |
| Monitoring / uptime bots | 0% |
AI crawlers are named in 23.0% of all Montserrat sites — the highest bot-category rate in this group. SEO/search indexing (15.2%) and SEO audit tools (14.7%) follow. Commercial scrapers reach 12.3%.
Uniform rules are Montserrat's most common robots.txt posture
| % of sites | |
|---|---|
| Uniform per-agent rules (no path mixing) | 41.2% |
| Path-level mixed rules for same agent | 34.3% |
| Allow-only (no disallow rules) | 2% |
| Mixed AI posture (block some, allow others) | 4.4% |
| Blanket Disallow: / | 2% |
Uniform per-agent rules cover 41.2% of all Montserrat sites and path-level mixed rules 34.3%. Mixed-AI posture — blocking some agents, allowing others — applies to 4.4% of sites. Blanket Disallow: / affects 2.0%.
GPTBot faces the most Disallow rules in Montserrat's robots.txt
| Disallowed | Allowed (whitelisted) | |
|---|---|---|
| GPTBot | 17.6% | 2.9% |
| CCBot | 15.7% | 1.5% |
| ClaudeBot | 14.2% | — |
| Google-Extended | 15.2% | 1.5% |
| Bytespider | 14.2% | — |
| meta-externalagent | 7.8% | — |
| ChatGPT-User | 11.8% | 6.4% |
| PerplexityBot | 12.7% | 4.9% |
| Applebot-Extended | 9.3% | — |
| OAI-SearchBot | 5.4% | 3.4% |
| anthropic-ai | 8.3% | 1% |
GPTBot is named in Disallow rules on 17.6% of all Montserrat sites; CCBot follows at 15.7% and Google-Extended at 15.2%. ChatGPT-User (6.4%) earns the most explicit Allow rules.
Newspapers and several Montserrat sectors all name at least one bot
| % of sites | |
|---|---|
| Newspapers | 87.5% |
| Apparel & Fashion | 80% |
| Finance | 80% |
| Mass Media | 80% |
| Publishing | 80% |
| Software & Dev | 80% |
| Travel & Tourism | 80% |
| Hospitality | 71.4% |
| Airlines | 70% |
| General | 70% |
| Retail | 70% |
| Jewellery & Luxury | 66.7% |
| Banking | 60% |
| Government | 60% |
| IT Services | 60% |
Newspapers tops Montserrat’s sector rankings at 87.5% — nearly every site names at least one bot in a Disallow rule. Apparel & Fashion, Finance, Mass Media, Publishing, Software & Dev, and Travel & Tourism all sit at 80%.
Montserrat's Travel and Tourism sector leads in explicitly allowing crawlers
| % of sites | |
|---|---|
| Travel & Tourism | 80% |
| Software & Dev | 70% |
| Newspapers | 62.5% |
| Mass Media | 60% |
| Publishing | 60% |
| Airlines | 50% |
| General | 50% |
| Hospitality | 42.9% |
| Government | 40% |
| IT Services | 40% |
| Online Services | 40% |
| Retail | 40% |
| Jewellery & Luxury | 33.3% |
| Education | 30% |
| Finance | 30% |
Travel & Tourism tops the allowlist table at 80%. Software & Dev follows at 70% and Newspapers at 62.5%. Mass Media and Publishing both reach 60%.
Industry Patterns
Apparel and Fashion is Montserrat's most demanding sector for crawlers
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Apparel & Fashion | 100% | 0% | 20% | 40% | 40% | 40% | 80% | 0% | Tier 2 |
| Jewellery & Luxury | 100% | 33.3% | 16.7% | 16.7% | 33.3% | 33.3% | 83.3% | 0% | Tier 2 |
| Retail | 90% | 0% | 0% | 50% | 30% | 30% | 70% | 30% | Tier 2 |
| Hospitality | 100% | 28.6% | 0% | 42.9% | 14.3% | 28.6% | 85.7% | 0% | Tier 2 |
| Travel & Tourism | 90% | 20% | 10% | 50% | 30% | 20% | 90% | 20% | Tier 2 |
| Government | 100% | 20% | 10% | 60% | 0% | 30% | 80% | 10% | Tier 2 |
| Airlines | 90% | 20% | 20% | 60% | 20% | 0% | 80% | 20% | Tier 2 |
| Finance | 90% | 40% | 0% | 30% | 20% | 10% | 80% | 20% | Tier 2 |
| Banking | 100% | 30% | 0% | 30% | 10% | 10% | 70% | 0% | Tier 1 |
| Software & Dev | 80% | 20% | 10% | 50% | 10% | 10% | 80% | 10% | Tier 1 |
| Education | 100% | 40% | 30% | 30% | 0% | 10% | 60% | 20% | Tier 1 |
| IT Services | 100% | 10% | 10% | 60% | 0% | 10% | 70% | 0% | Tier 1 |
| Publishing | 90% | 0% | 30% | 50% | 0% | 10% | 90% | 40% | Tier 1 |
| General | 100% | 10% | 50% | 40% | 10% | 40% | 70% | 40% | Tier 1 |
| Mass Media | 90% | 0% | 50% | 40% | 10% | 30% | 80% | 40% | Tier 1 |
Apparel & Fashion leads with a mean recommended tier of 2.70. Jewellery & Luxury follows at 2.25 and Retail at 2.20. All 15 hardest sectors carry a median Tier 2, with means ranging from 1.40 to 2.70.
Newspapers is Montserrat's most accessible sector for crawlers
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Online Services | 90% | 0% | 40% | 40% | 0% | 30% | 60% | 30% | Tier 1 |
| Newspapers | 87.5% | 0% | 37.5% | 50% | 0% | 25% | 87.5% | 75% | Tier 1 |
Newspapers records the lowest mean recommended tier at 1.12. Only two sectors appear in the bottom list — Online Services at mean 1.40 — reflecting Montserrat’s shallow sector spread at small sample size.