Overview
JavaScript is Mayotte's most common secondary barrier
| Value | |
|---|---|
| WAF | 92.2% |
| Antibot | 19.6% |
| CAPTCHA | 22% |
| JavaScript | 38.4% |
| Rate Limiting | 13.3% |
| TLS | 17% |
WAF reaches 92.2% of Mayotte sites. Among secondary barriers, JavaScript leads at 38.4%, followed by CAPTCHA at 22.0%, Antibot at 19.6%, TLS at 17.0%, and Rate Limiting at 13.3%.
Barrier Landscape
JavaScript tops Mayotte's active secondary defences
| Value | |
|---|---|
| WAF | 92.2% |
| Antibot | 19.6% |
| CAPTCHA | 22% |
| JavaScript | 38.4% |
| Rate Limiting | 13.3% |
| TLS | 17% |
| Has robots.txt | 76.2% |
| Blocks AI crawlers | 13% |
WAF covers 92.2% of sites. JavaScript ranks first among the five secondary barriers at 38.4% — nearly double CAPTCHA (22.0%) and Antibot (19.6%). Rate Limiting is the least-deployed secondary barrier at 13.3%.
One-barrier sites are Mayotte's most common configuration
| % of sites | |
|---|---|
| 0 barriers | 5.2% |
| 1 barrier | 33.4% |
| 2 barriers | 32.3% |
| 3 barriers | 17.8% |
| 4 barriers | 6.2% |
| 5 barriers | 4.5% |
| 6 barriers | 0.7% |
33.4% of Mayotte sites carry exactly one barrier — the largest single group. Two barriers accounts for 32.3%. Sites with three or more barriers total 29.2%. Only 5.2% carry none.
Most Mayotte sites are Simple to access
| Mean recommended tier | |
|---|---|
| All sites | 1.6 |
A median of 1 indicates more than half of Mayotte's 601 sites are retrievable at Tier 1 (Simple). The mean of 1.6 reflects a tail of harder sites pulling the average above the median floor.
More than half of Mayotte sites are Simple to access
| % of sites | |
|---|---|
| 1 - Simple | 54.1% |
| 2 - Easy | 35.8% |
| 3 - Moderate | 7.5% |
| 4 - Complex | 1.8% |
| 5 - Advanced | 0.8% |
54.1% of Mayotte sites sit at Tier 1 (Simple) and 35.8% at Tier 2 (Easy) — 89.9% combined. Tier 3 (Moderate) holds 7.5%. Tiers 4 and 5 together account for just 2.6%.
robots.txt
AI crawlers top Mayotte's robots.txt bot categories
| % of sites | |
|---|---|
| AI crawlers | 16.1% |
| SEO / search indexing | 13.6% |
| SEO audit tools | 15.5% |
| Commercial scrapers | 7.7% |
| Social / content scrapers | 6.7% |
| Archive / research crawlers | 6.8% |
| Monitoring / uptime bots | 0.8% |
AI crawlers are named in rules on 16.1% of all 601 Mayotte sites — the highest category rate. SEO audit tools follow at 15.5% and SEO/search indexing at 13.6%.
Nearly one in four Mayotte sites publishes no robots.txt
| % of sites | |
|---|---|
| Uniform per-agent rules (no path mixing) | 38.1% |
| Path-level mixed rules for same agent | 32.6% |
| Allow-only (no disallow rules) | 1.5% |
| Mixed AI posture (block some, allow others) | 3.5% |
| Blanket Disallow: / | 3.8% |
38.1% of sites use uniform per-agent rules; 32.6% use path-level mixed rules. Sites with no robots.txt account for 23.8% of all 601 Mayotte sites — the largest no-robots share in this group.
GPTBot faces the most Disallow rules in Mayotte's robots.txt
| Disallowed | Allowed (whitelisted) | |
|---|---|---|
| GPTBot | 10.3% | 2% |
| CCBot | 8.2% | 1% |
| ClaudeBot | 8% | 1% |
| Google-Extended | 8.5% | 1.2% |
| Bytespider | 6.5% | 0.7% |
| meta-externalagent | 3.7% | 0.7% |
| ChatGPT-User | 6.2% | 3.3% |
| PerplexityBot | 6.8% | 2.2% |
| Applebot-Extended | 5% | 0.5% |
| OAI-SearchBot | 3.7% | 2.5% |
| anthropic-ai | 4.5% | 0.8% |
GPTBot is blocked by Disallow on 10.3% of all Mayotte sites. ChatGPT-User receives the most explicit Allow rules, appearing on 3.3% of sites — the highest allow rate of any AI agent here.
Multiple Mayotte sectors all name at least one bot to restrict
| % of sites | |
|---|---|
| Adult | 100% |
| Agriculture | 100% |
| Design | 100% |
| Furniture | 100% |
| Newspapers | 100% |
| Retail | 100% |
| Apparel & Fashion | 90% |
| Beauty & Cosmetics | 90% |
| Computer & Video Games | 90% |
| Computer Hardware | 90% |
| Consumer Electronics | 90% |
| Entertainment | 90% |
| General | 90% |
| Legal | 90% |
| Mass Media | 90% |
Adult, Agriculture, Design, Furniture, Newspapers, and Retail each have every sampled site naming at least one bot in a Disallow rule. The next tier falls to 90%, across nine further sectors.
Mayotte's Agriculture sites sites lead in explicitly allowing crawlers
| % of sites | |
|---|---|
| Agriculture | 80% |
| Furniture | 71.4% |
| Legal | 70% |
| Retail | 70% |
| Science | 70% |
| Beauty & Cosmetics | 60% |
| Hospitality | 60% |
| Museums | 60% |
| Newspapers | 60% |
| Publishing | 60% |
| Software & Dev | 60% |
| Textiles & Nonwovens | 60% |
| Airlines | 50% |
| Apparel & Fashion | 50% |
| Computer Hardware | 50% |
Agriculture tops explicit Allow rules at 80% of sector sites. Furniture follows at 71.4%. Legal, Retail, and Science each reach 70%. Agriculture and Retail also appear in the top-6 block list.
Industry Patterns
Sporting Goods is Mayotte's hardest sector to access programmatically
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Sporting Goods | 80% | 40% | 30% | 20% | 30% | 30% | 60% | 0% | Tier 2 |
| Retail | 90% | 10% | 0% | 50% | 20% | 30% | 100% | 30% | Tier 2 |
| Automotive | 90% | 10% | 0% | 60% | 30% | 20% | 60% | 10% | Tier 2 |
| Hospitality | 100% | 40% | 10% | 70% | 10% | 20% | 70% | 20% | Tier 2 |
| Sports | 90% | 10% | 30% | 30% | 20% | 10% | 80% | 20% | Tier 2 |
| Adult | 100% | 30% | 10% | 60% | 10% | 10% | 100% | 20% | Tier 2 |
| Apparel & Fashion | 90% | 20% | 20% | 50% | 20% | 30% | 90% | 10% | Tier 2 |
| Real Estate | 90% | 20% | 20% | 80% | 30% | 10% | 60% | 20% | Tier 2 |
| Travel & Tourism | 100% | 40% | 0% | 70% | 10% | 30% | 70% | 20% | Tier 2 |
| Beauty & Cosmetics | 90% | 20% | 30% | 40% | 20% | 30% | 90% | 0% | Tier 2 |
| Consumer Electronics | 70% | 40% | 10% | 10% | 10% | 30% | 90% | 10% | Tier 2 |
| Non-Profit | 83.3% | 16.7% | 33.3% | 33.3% | 16.7% | 0% | 66.7% | 0% | Tier 2 |
| Transport & Logistics | 70% | 20% | 20% | 0% | 30% | 60% | 30% | 0% | Tier 2 |
| Telecom | 90% | 0% | 0% | 50% | 0% | 10% | 90% | 10% | Tier 2 |
| Advertising & Mktg | 100% | 20% | 40% | 30% | 0% | 10% | 80% | 0% | Tier 2 |
Sporting Goods leads Mayotte's difficulty ranking with a mean recommended tier of 2.55. Retail follows at 2.30, then Automotive, Hospitality, and Sports all share a mean of 2.20. All top-15 sectors sit at median tier 2.
Five Mayotte sectors share the most accessible floor
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Airlines | 80% | 50% | 10% | 70% | 10% | 10% | 60% | 20% | Tier 2 |
| Food & Beverages | 100% | 10% | 20% | 50% | 20% | 0% | 90% | 0% | Tier 2 |
| Government | 90% | 30% | 20% | 30% | 20% | 0% | 60% | 0% | Tier 2 |
| Publishing | 90% | 30% | 30% | 40% | 10% | 20% | 90% | 30% | Tier 2 |
| Computer Hardware | 90% | 30% | 30% | 30% | 10% | 20% | 90% | 10% | Tier 2 |
| Construction | 90% | 20% | 40% | 60% | 30% | 10% | 80% | 10% | Tier 2 |
| Photography | 90% | 30% | 30% | 20% | 20% | 50% | 80% | 30% | Tier 2 |
| Computers & Electronics | 87.5% | 37.5% | 25% | 25% | 0% | 12.5% | 62.5% | 0% | Tier 2 |
| Computer & Video Games | 90% | 30% | 20% | 30% | 10% | 20% | 100% | 30% | Tier 2 |
| Distance Learning | 100% | 20% | 20% | 40% | 20% | 20% | 80% | 40% | Tier 2 |
| Banking | 90% | 20% | 0% | 10% | 0% | 10% | 50% | 10% | Tier 2 |
| Software & Dev | 80% | 40% | 20% | 10% | 20% | 20% | 70% | 10% | Tier 2 |
| Education | 100% | 30% | 20% | 40% | 20% | 10% | 80% | 10% | Tier 2 |
| Finance | 80% | 30% | 10% | 20% | 0% | 10% | 60% | 20% | Tier 2 |
| Wellness | 100% | 30% | 50% | 70% | 40% | 10% | 70% | 0% | Tier 2 |
Banking, Software & Dev, Education, Finance, and Wellness each record a mean recommended tier of 1.50 — the lowest in Mayotte's bottom-15 group. All bottom-15 sectors have a median tier of 2.