Overview
Monaco sites run most barriers modestly above global rates
| Value | |
|---|---|
| WAF | 94.5% |
| Antibot | 21.3% |
| CAPTCHA | 24.3% |
| JavaScript | 43.6% |
| Rate Limiting | 14.6% |
| TLS | 18.5% |
WAF adoption (94.5%) is above the 93.1% global norm. All secondary barriers exceed their global benchmarks: JavaScript (43.6% vs 41.3%), antibot (21.3% vs 20.2%), CAPTCHA (24.3% vs 23.1%), rate limiting (14.6% vs 12.9%), and TLS (18.5% vs 17.7%).
Barrier Landscape
CAPTCHA and JavaScript are Monaco's leading secondary barriers
| Value | |
|---|---|
| WAF | 94.5% |
| Antibot | 21.3% |
| CAPTCHA | 24.3% |
| JavaScript | 43.6% |
| Rate Limiting | 14.6% |
| TLS | 18.5% |
| Has robots.txt | 81.1% |
| Blocks AI crawlers | 13.8% |
WAF adoption stands at 94.5%. Among secondary barriers, JavaScript (43.6%) and CAPTCHA (24.3%) lead, both above their global averages. Antibot (21.3%), rate limiting (14.6%), and TLS (18.5%) follow.
Most Monaco sites carry two barriers
| % of sites | |
|---|---|
| 0 barriers | 3.2% |
| 1 barrier | 28.2% |
| 2 barriers | 35.3% |
| 3 barriers | 20.5% |
| 4 barriers | 7.9% |
| 5 barriers | 4.3% |
| 6 barriers | 0.5% |
3.2% of Monaco sites carry no barriers — the lowest among this group. The modal count is two, applying to 35.3% of sites. Three or more barriers account for 33.2% of the total.
Most Monaco sites are Simple to access
| Mean recommended tier | |
|---|---|
| All sites | 1.6 |
The median recommended retrieval tier is 1, meaning over half of sites are accessible without JavaScript rendering. The mean tier is 1.65.
Nearly nine in ten Monaco sites are Simple or Easy to access
| % of sites | |
|---|---|
| 1 - Simple | 51.3% |
| 2 - Easy | 35.9% |
| 3 - Moderate | 9.3% |
| 4 - Complex | 2.6% |
| 5 - Advanced | 0.8% |
Tier 1 and Tier 2 combined account for 87.2% of sites. Tier 3 applies to 9.3%, Tier 4 to 2.6%, and Tier 5 to 0.8%.
robots.txt
AI crawlers top Monaco's robots.txt bot categories
| % of sites | |
|---|---|
| AI crawlers | 16.6% |
| SEO / search indexing | 14.4% |
| SEO audit tools | 14.7% |
| Commercial scrapers | 7.6% |
| Social / content scrapers | 6.5% |
| Archive / research crawlers | 5.2% |
| Monitoring / uptime bots | 0.5% |
Across all 910 Monaco sites, 16.6% name at least one AI crawler. SEO audit tools follow at 14.7% and SEO/search indexing bots at 14.4%. Archive/research crawlers appear in 5.2% of files.
Uniform rules are Monaco's most common robots.txt posture
| % of sites | |
|---|---|
| Uniform per-agent rules (no path mixing) | 40.7% |
| Path-level mixed rules for same agent | 36.2% |
| Allow-only (no disallow rules) | 2% |
| Mixed AI posture (block some, allow others) | 2.6% |
| Blanket Disallow: / | 2.1% |
18.9% of Monaco sites have no robots.txt. Uniform per-agent rules lead at 40.7%, followed by path-level mixed rules at 36.2%. Blanket Disallow: / covers 2.1% and mixed-AI posture 2.6%.
GPTBot faces the most Disallow rules in Monaco's robots.txt
| Disallowed | Allowed (whitelisted) | |
|---|---|---|
| GPTBot | 10.9% | 2.7% |
| CCBot | 9.1% | 1.2% |
| ClaudeBot | 8.8% | 1.2% |
| Google-Extended | 7.8% | 1.3% |
| Bytespider | 6.4% | 0.2% |
| meta-externalagent | 3.5% | 0.3% |
| ChatGPT-User | 6.5% | 3.1% |
| PerplexityBot | 6.4% | 1.9% |
| Applebot-Extended | 4.5% | 0.2% |
| OAI-SearchBot | 4.4% | 2% |
| anthropic-ai | 4.4% | 1% |
GPTBot carries a Disallow rule on 10.9% of all 910 Monaco sites. ChatGPT-User appears in an Allow rule on 3.1% of sites.
Five Monaco sectors all name at least one bot to restrict
| % of sites | |
|---|---|
| Computer & Video Games | 100% |
| Design | 100% |
| Entertainment | 100% |
| Religion & Belief | 100% |
| Retail | 100% |
| Adult | 90% |
| Advertising & Mktg | 90% |
| Architecture | 90% |
| Automotive | 90% |
| Consumer Electronics | 90% |
| Food & Beverages | 90% |
| General | 90% |
| Machinery | 90% |
| Mass Media | 90% |
| Newspapers | 90% |
Computer & Video Games, Design, Entertainment, Religion & Belief, and Retail each reach 100%: every site in those sectors names at least one bot to restrict in a Disallow rule. Nine further sectors sit at 90%.
Monaco's Consulting sites lead in explicitly allowing crawlers
| % of sites | |
|---|---|
| Consulting | 83.3% |
| Advertising & Mktg | 70% |
| Architecture | 70% |
| Chemicals | 70% |
| Furniture | 70% |
| Photography | 70% |
| Publishing | 70% |
| Retail | 70% |
| Wellness | 70% |
| Market Research | 62.5% |
| Accounting & Auditing | 60% |
| Airlines | 60% |
| Automotive | 60% |
| Beauty & Cosmetics | 60% |
| Mental Health | 60% |
Consulting leads by a clear margin: 83% of sites in this industry explicitly allow at least one named crawler, reflecting commercial demand for indexing and aggregation. Advertising & Mktg follows at 70%.
Industry Patterns
Jewellery & Luxury is Monaco's hardest sector to access programmatically
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Jewellery & Luxury | 100% | 30% | 20% | 20% | 40% | 60% | 60% | 0% | Tier 3 |
| Real Estate | 100% | 20% | 20% | 70% | 40% | 20% | 60% | 30% | Tier 3 |
| Furniture | 100% | 40% | 40% | 60% | 30% | 30% | 80% | 10% | Tier 3 |
| Hospitality | 100% | 20% | 0% | 80% | 30% | 20% | 60% | 10% | Tier 2 |
| Human Resources | 100% | 50% | 30% | 60% | 40% | 20% | 90% | 0% | Tier 2 |
| Retail | 100% | 10% | 0% | 60% | 20% | 20% | 100% | 40% | Tier 2 |
| Apparel & Fashion | 90% | 10% | 20% | 50% | 20% | 40% | 80% | 10% | Tier 2 |
| Automotive | 100% | 0% | 10% | 20% | 30% | 30% | 90% | 0% | Tier 2 |
| Consumer Electronics | 70% | 20% | 0% | 30% | 10% | 40% | 100% | 20% | Tier 2 |
| Adult | 100% | 40% | 30% | 80% | 20% | 20% | 90% | 10% | Tier 2 |
| Beauty & Cosmetics | 100% | 40% | 40% | 40% | 50% | 40% | 80% | 10% | Tier 2 |
| Mail & Delivery | 80% | 30% | 10% | 20% | 20% | 20% | 70% | 0% | Tier 2 |
| Manufacturing | 100% | 20% | 0% | 60% | 10% | 30% | 70% | 10% | Tier 2 |
| Restaurants | 90% | 30% | 20% | 50% | 50% | 30% | 70% | 0% | Tier 2 |
| Sporting Goods | 80% | 20% | 30% | 10% | 10% | 40% | 70% | 0% | Tier 2 |
Jewellery & Luxury tops the hardest-sectors ranking with a mean tier of 2.80 and a median of 3. Real Estate (2.60) and Furniture (2.50) also carry a median of 3. A mid-table cluster from Hospitality to Sporting Goods spans mean tiers of 2.10–2.40.
Three Monaco sectors share the most accessible tier floor
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Transport & Logistics | 80% | 40% | 10% | 30% | 0% | 20% | 90% | 0% | Tier 2 |
| Food & Beverages | 100% | 40% | 50% | 60% | 30% | 0% | 90% | 40% | Tier 2 |
| Computer Hardware | 90% | 20% | 0% | 40% | 20% | 40% | 80% | 10% | Tier 2 |
| Design | 100% | 20% | 30% | 40% | 20% | 30% | 100% | 30% | Tier 2 |
| Events | 80% | 0% | 0% | 80% | 50% | 0% | 30% | 0% | Tier 2 |
| Reference | 90% | 50% | 10% | 40% | 10% | 20% | 80% | 40% | Tier 2 |
| Banking | 100% | 20% | 0% | 20% | 0% | 0% | 80% | 20% | Tier 2 |
| Computers & Electronics | 90% | 30% | 40% | 50% | 20% | 10% | 80% | 0% | Tier 2 |
| Healthcare | 90% | 40% | 30% | 30% | 20% | 10% | 70% | 20% | Tier 2 |
| Non-Profit | 90% | 20% | 10% | 30% | 20% | 30% | 70% | 0% | Tier 2 |
| Telecom | 90% | 10% | 10% | 70% | 0% | 10% | 90% | 10% | Tier 2 |
| Customer Services | 100% | 16.7% | 33.3% | 50% | 33.3% | 16.7% | 83.3% | 0% | Tier 2 |
| Airlines | 100% | 20% | 0% | 70% | 20% | 20% | 80% | 30% | Tier 2 |
| Construction | 80% | 0% | 30% | 30% | 20% | 0% | 70% | 0% | Tier 2 |
| Education | 100% | 20% | 10% | 30% | 10% | 10% | 70% | 10% | Tier 2 |
Airlines, Construction, and Education all share the lowest mean tier of 1.80 among Monaco sectors in this group.