Overview
JavaScript is Saint Martin's most common secondary barrier
| Value | |
|---|---|
| WAF | 93.6% |
| Antibot | 18.6% |
| CAPTCHA | 21.7% |
| JavaScript | 39.9% |
| Rate Limiting | 14.6% |
| TLS | 15.5% |
WAF reaches 93.6% across Saint Martin sites. JavaScript (39.9%) leads secondary barriers, followed by CAPTCHA (21.7%) and Antibot (18.6%). Rate Limiting (14.6%) and TLS (15.5%) are lowest.
Barrier Landscape
JavaScript tops Saint Martin's active secondary defences
| Value | |
|---|---|
| WAF | 93.6% |
| Antibot | 18.6% |
| CAPTCHA | 21.7% |
| JavaScript | 39.9% |
| Rate Limiting | 14.6% |
| TLS | 15.5% |
| Has robots.txt | 80.5% |
| Blocks AI crawlers | 16.1% |
WAF covers 93.6% of Saint Martin's 676 domains. JavaScript reaches 39.9%, CAPTCHA 21.7%, Antibot 18.6%, Rate Limiting 14.6%, and TLS 15.5%.
Most Saint Martin sites carry at least two barriers
| % of sites | |
|---|---|
| 0 barriers | 4.1% |
| 1 barrier | 32.4% |
| 2 barriers | 35.1% |
| 3 barriers | 17.3% |
| 4 barriers | 6.1% |
| 5 barriers | 4.7% |
| 6 barriers | 0.3% |
35.1% of Saint Martin sites carry exactly two barriers. Single-barrier sites account for 32.4%. Zero-barrier sites reach 4.1%, while 28.4% of sites stack three or more.
Most Saint Martin sites are Simple to access
| Mean recommended tier | |
|---|---|
| All sites | 1.6 |
Browser median tier is 1, meaning more than half of Saint Martin's 676 sites are retrievable at plain HTTP. Mean is 1.61 — among the lowest in this batch.
Most Saint Martin sites are Simple or Easy to access
| % of sites | |
|---|---|
| 1 - Simple | 54.3% |
| 2 - Easy | 34.6% |
| 3 - Moderate | 7.4% |
| 4 - Complex | 2.8% |
| 5 - Advanced | 0.9% |
54.3% of sites sit at Tier 1 (Simple) and 34.6% at Tier 2 (Easy), covering 88.9% combined. Tier 3 accounts for 7.4%, Tier 4 for 2.8%, and Tier 5 for 0.9%.
robots.txt
AI crawlers top Saint Martin's robots.txt bot categories
| % of sites | |
|---|---|
| AI crawlers | 19.1% |
| SEO / search indexing | 11.8% |
| SEO audit tools | 15.7% |
| Commercial scrapers | 9.2% |
| Social / content scrapers | 7.5% |
| Archive / research crawlers | 5.8% |
| Monitoring / uptime bots | 0.6% |
19.1% of all Saint Martin sites name at least one AI crawler in a robots.txt rule — the top category. SEO audit tools follow at 15.7%, SEO/search indexing at 11.8%, and commercial scrapers at 9.2%.
Uniform rules are Saint Martin's most common robots.txt posture
| % of sites | |
|---|---|
| Uniform per-agent rules (no path mixing) | 39.8% |
| Path-level mixed rules for same agent | 35.8% |
| Allow-only (no disallow rules) | 1.6% |
| Mixed AI posture (block some, allow others) | 3.7% |
| Blanket Disallow: / | 3% |
39.8% of all Saint Martin sites use uniform per-agent rules and 35.8% use path-level mixed rules. 3.0% carry a blanket Disallow: / and 3.7% hold a mixed AI posture. 19.5% have no robots.txt.
GPTBot faces the most Disallow rules in Saint Martin's robots.txt
| Disallowed | Allowed (whitelisted) | |
|---|---|---|
| GPTBot | 12.4% | 2.4% |
| CCBot | 8.3% | 0.9% |
| ClaudeBot | 9.6% | 1.3% |
| Google-Extended | 10.7% | 1.2% |
| Bytespider | 7.1% | 0.3% |
| meta-externalagent | 4.1% | 0.7% |
| ChatGPT-User | 7.7% | 4.1% |
| PerplexityBot | 7.8% | 3.1% |
| Applebot-Extended | 4.4% | — |
| OAI-SearchBot | 4.9% | 3% |
| anthropic-ai | 4.7% | 0.9% |
GPTBot appears in Disallow rules on 12.4% of Saint Martin sites, Google-Extended on 10.7%, ClaudeBot on 9.6%, and CCBot on 8.3%. ChatGPT-User leads Allow rules at 4.1%.
Multiple Saint Martin sectors all name at least one bot to restrict
| % of sites | |
|---|---|
| Design | 100% |
| Entertainment | 100% |
| Metals & Mining | 100% |
| Recruitment & Staffing | 100% |
| Retail | 100% |
| Adult | 90% |
| Computer Hardware | 90% |
| Consumer Electronics | 90% |
| Food & Beverages | 90% |
| General | 90% |
| Human Resources | 90% |
| Jewellery & Luxury | 90% |
| Mass Media | 90% |
| Newspapers | 90% |
| Online Services | 90% |
Every site in Design, Entertainment, Metals & Mining, Recruitment & Staffing, and Retail names at least one bot in a Disallow rule. Adult, Computer Hardware, Consumer Electronics, Food & Beverages, General, Human Resources, Jewellery & Luxury, Mass Media, Newspapers, and Online Services each reach 90%.
Saint Martin's Publishing and Retail sectors lead in explicitly allowing crawlers
| % of sites | |
|---|---|
| Publishing | 80% |
| Recruitment & Staffing | 80% |
| Retail | 80% |
| Travel & Tourism | 80% |
| Hospitality | 70% |
| Photography | 70% |
| Sporting Goods | 70% |
| Oil & Gas | 62.5% |
| Airlines | 60% |
| Apparel & Fashion | 60% |
| Computer Hardware | 60% |
| Consumer Electronics | 60% |
| Design | 60% |
| Healthcare | 60% |
| Real Estate | 60% |
Publishing, Recruitment & Staffing, Retail, and Travel & Tourism each reach 80% for explicit bot Allow rules. Hospitality, Photography, and Sporting Goods follow at 70%.
Industry Patterns
Apparel and Fashion is Saint Martin's most demanding sector for crawlers
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Apparel & Fashion | 80% | 0% | 20% | 40% | 10% | 50% | 90% | 20% | Tier 3 |
| Music | 100% | 40% | 30% | 60% | 40% | 10% | 80% | 10% | Tier 3 |
| Hospitality | 90% | 20% | 20% | 60% | 40% | 20% | 70% | 30% | Tier 2 |
| Retail | 100% | 10% | 0% | 60% | 10% | 10% | 100% | 60% | Tier 2 |
| Computer Hardware | 100% | 10% | 10% | 40% | 10% | 40% | 90% | 10% | Tier 2 |
| Real Estate | 100% | 30% | 20% | 60% | 30% | 20% | 90% | 30% | Tier 2 |
| Automotive | 100% | 0% | 10% | 40% | 30% | 0% | 60% | 20% | Tier 2 |
| Consumer Electronics | 90% | 20% | 20% | 30% | 20% | 50% | 90% | 10% | Tier 2 |
| Science | 90% | 20% | 0% | 50% | 20% | 10% | 60% | 0% | Tier 2 |
| Printing | 100% | 33.3% | 33.3% | 33.3% | 16.7% | 16.7% | 66.7% | 0% | Tier 2 |
| Food & Beverages | 100% | 40% | 40% | 70% | 40% | 0% | 90% | 20% | Tier 2 |
| Adult | 100% | 40% | 30% | 70% | 20% | 20% | 90% | 10% | Tier 2 |
| Airlines | 90% | 10% | 10% | 50% | 20% | 10% | 70% | 30% | Tier 2 |
| Wholesalers | 80% | 20% | 30% | 60% | 30% | 10% | 70% | 20% | Tier 2 |
| Sporting Goods | 100% | 20% | 30% | 10% | 10% | 20% | 90% | 10% | Tier 2 |
Apparel & Fashion tops the difficulty ranking with a mean tier of 2.60 and a Tier 3 median. Music and Retail both follow at 2.40 mean. Hospitality sits at 2.50 mean with Tier 2 median.
Software and Dev is Saint Martin's most accessible sector for crawlers
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Banking | 80% | 10% | 0% | 40% | 0% | 20% | 70% | 10% | Tier 2 |
| Design | 100% | 30% | 30% | 20% | 20% | 20% | 100% | 40% | Tier 2 |
| Education | 100% | 20% | 10% | 30% | 10% | 10% | 70% | 10% | Tier 2 |
| Publishing | 90% | 20% | 20% | 30% | 10% | 0% | 90% | 40% | Tier 2 |
| Travel & Tourism | 100% | 10% | 10% | 50% | 40% | 10% | 90% | 50% | Tier 2 |
| Advertising & Mktg | 100% | 20% | 40% | 0% | 10% | 10% | 80% | 10% | Tier 2 |
| Distance Learning | 100% | 40% | 40% | 40% | 20% | 10% | 70% | 40% | Tier 2 |
| Finance | 80% | 20% | 0% | 20% | 20% | 10% | 60% | 30% | Tier 2 |
| Government | 90% | 30% | 20% | 30% | 20% | 0% | 70% | 0% | Tier 2 |
| Telecom | 90% | 0% | 0% | 70% | 0% | 10% | 100% | 10% | Tier 2 |
| Wellness | 100% | 30% | 40% | 40% | 30% | 20% | 80% | 0% | Tier 2 |
| Beauty & Cosmetics | 100% | 30% | 30% | 50% | 50% | 30% | 80% | 20% | Tier 2 |
| Construction | 90% | 0% | 20% | 40% | 20% | 10% | 80% | 10% | Tier 2 |
| Photography | 90% | 50% | 40% | 20% | 30% | 70% | 80% | 40% | Tier 2 |
| Software & Dev | 80% | 40% | 20% | 10% | 20% | 20% | 70% | 10% | Tier 2 |
Software & Dev posts the lowest mean tier at 1.50 — the floor for Saint Martin's bottom-15 sectors. Beauty & Cosmetics, Construction, and Photography sit at 1.60, followed by six sectors at 1.70.