Overview
JavaScript is Saint Vincent's most common active secondary barrier
| Value | |
|---|---|
| WAF | 94.4% |
| Antibot | 20.8% |
| CAPTCHA | 25.6% |
| JavaScript | 39.6% |
| Rate Limiting | 13.2% |
| TLS | 15.8% |
WAF covers 94.4% of Saint Vincent sites. JavaScript (39.6%) leads among secondary barriers, followed by CAPTCHA (25.6%), antibot (20.8%), TLS (15.8%), and rate limiting (13.2%).
Barrier Landscape
JavaScript tops Saint Vincent's active secondary defences
| Value | |
|---|---|
| WAF | 94.4% |
| Antibot | 20.8% |
| CAPTCHA | 25.6% |
| JavaScript | 39.6% |
| Rate Limiting | 13.2% |
| TLS | 15.8% |
| Has robots.txt | 83.6% |
| Blocks AI crawlers | 15.9% |
WAF is present on 94.4% of sites. JavaScript (39.6%) leads the secondary barriers, followed by CAPTCHA (25.6%), antibot (20.8%), TLS (15.8%), and rate limiting (13.2%).
Most Saint Vincent sites carry at least two barriers
| % of sites | |
|---|---|
| 0 barriers | 3.2% |
| 1 barrier | 32.2% |
| 2 barriers | 33.9% |
| 3 barriers | 18.4% |
| 4 barriers | 7.2% |
| 5 barriers | 4.8% |
| 6 barriers | 0.2% |
The modal site carries exactly two barriers (33.9%). Sites with zero barriers represent 3.2%, and those with three or more account for 30.6%.
Most Saint Vincent sites are Simple to access
| Mean recommended tier | |
|---|---|
| All sites | 1.6 |
The browser-based median tier is 1, indicating more than half of sites resolve at Tier 1 (plain HTTP). Tier 1 covers 53.9% of sites and the mean is 1.61.
Most Saint Vincent sites are Simple or Easy to access
| % of sites | |
|---|---|
| 1 - Simple | 53.9% |
| 2 - Easy | 35.2% |
| 3 - Moderate | 7.6% |
| 4 - Complex | 2.2% |
| 5 - Advanced | 1% |
Tier 1 and Tier 2 combined cover 89.1% of sites. Tier 3 accounts for 7.6%, Tier 4 for 2.2%, and Tier 5 for 1.0%.
robots.txt
AI crawlers top Saint Vincent's robots.txt bot categories
| % of sites | |
|---|---|
| AI crawlers | 16.8% |
| SEO / search indexing | 12.2% |
| SEO audit tools | 16.2% |
| Commercial scrapers | 9.1% |
| Social / content scrapers | 7.8% |
| Archive / research crawlers | 5.1% |
| Monitoring / uptime bots | 0.2% |
AI crawlers appear on 16.8% of all sites; SEO audit tools on 16.2% — the two leading categories. SEO/search indexing follows at 12.2%, commercial scrapers at 9.1%, social/content scrapers at 7.8%, and archive crawlers at 5.1%.
Uniform rules are Saint Vincent's most common robots.txt posture
| % of sites | |
|---|---|
| Uniform per-agent rules (no path mixing) | 44.8% |
| Path-level mixed rules for same agent | 33.2% |
| Allow-only (no disallow rules) | 2% |
| Mixed AI posture (block some, allow others) | 2.9% |
| Blanket Disallow: / | 3.2% |
Uniform per-agent rules appear on 44.8% of sites, path-level mixed rules on 33.2%. Blanket Disallow: / covers 3.2%, mixed AI posture 2.9%, and allow-only postures 2.0%.
GPTBot faces the most Disallow rules in Saint Vincent's robots.txt
| Disallowed | Allowed (whitelisted) | |
|---|---|---|
| GPTBot | 13.2% | 1.9% |
| CCBot | 10% | 1.2% |
| ClaudeBot | 10.2% | 0.9% |
| Google-Extended | 10% | 1.1% |
| Bytespider | 8.2% | 0.8% |
| meta-externalagent | 3.4% | 0.5% |
| ChatGPT-User | 6.9% | 2.6% |
| PerplexityBot | 7.4% | 2% |
| Applebot-Extended | 6.2% | 0.6% |
| OAI-SearchBot | 4.4% | 1.9% |
| anthropic-ai | 5.8% | 1% |
GPTBot is named in Disallow rules on 13.2% of sites — the highest in this batch. ClaudeBot follows at 10.2%, CCBot and Google-Extended at 10.0% each. ChatGPT-User leads Allow rules at 2.6%.
Five Saint Vincent sectors all name at least one bot to restrict
| % of sites | |
|---|---|
| Agriculture | 100% |
| Computer & Video Games | 100% |
| Design | 100% |
| Entertainment | 100% |
| Retail | 100% |
| Adult | 90% |
| Apparel & Fashion | 90% |
| General | 90% |
| Healthcare | 90% |
| Libraries | 90% |
| Machinery | 90% |
| Mass Media | 90% |
| Newspapers | 90% |
| Online Services | 90% |
| Printing | 90% |
Agriculture, Computer & Video Games, Design, Entertainment, and Retail each reach 100% — every sampled site names at least one bot in a Disallow rule. Ten sectors follow at 90%, including Healthcare, Mass Media, and Newspapers.
Saint Vincent's Travel and Tourism sector leads in explicitly allowing crawlers
| % of sites | |
|---|---|
| Travel & Tourism | 80% |
| Airlines | 70% |
| Hospitality | 70% |
| Music | 70% |
| Photography | 70% |
| Publishing | 70% |
| Retail | 70% |
| Advertising & Mktg | 60% |
| Architecture | 60% |
| Machinery | 60% |
| Software & Dev | 60% |
| Gambling | 57.1% |
| Market Research | 55.6% |
| Agriculture | 50% |
| Apparel & Fashion | 50% |
Travel & Tourism has 80% of sites naming at least one bot in an Allow rule. Airlines, Hospitality, Music, Photography, Publishing, and Retail follow at 70%. Advertising & Marketing, Architecture, Machinery, and Software & Dev reach 60%.
Industry Patterns
Computer Hardware is Saint Vincent's most demanding sector for crawlers
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Computer Hardware | 90% | 20% | 0% | 20% | 10% | 50% | 80% | 0% | Tier 3 |
| Retail | 100% | 10% | 0% | 70% | 10% | 10% | 100% | 50% | Tier 2 |
| Consumer Electronics | 60% | 30% | 20% | 30% | 10% | 60% | 90% | 10% | Tier 2 |
| Apparel & Fashion | 100% | 0% | 20% | 60% | 30% | 30% | 90% | 10% | Tier 2 |
| Food & Beverages | 100% | 50% | 30% | 50% | 30% | 0% | 70% | 20% | Tier 2 |
| Hospitality | 100% | 10% | 20% | 30% | 10% | 30% | 80% | 0% | Tier 2 |
| Insurance | 80% | 20% | 10% | 30% | 10% | 20% | 80% | 0% | Tier 2 |
| Human Resources | 100% | 42.9% | 42.9% | 28.6% | 42.9% | 28.6% | 57.1% | 14.3% | Tier 2 |
| Mail & Delivery | 70% | 40% | 20% | 20% | 0% | 20% | 80% | 0% | Tier 2 |
| Real Estate | 100% | 40% | 20% | 90% | 10% | 20% | 70% | 20% | Tier 2 |
| Science | 90% | 50% | 20% | 30% | 20% | 30% | 80% | 10% | Tier 2 |
| Transport & Logistics | 70% | 40% | 20% | 20% | 0% | 20% | 80% | 0% | Tier 2 |
| Airlines | 90% | 20% | 10% | 50% | 30% | 10% | 90% | 30% | Tier 2 |
| Beauty & Cosmetics | 100% | 40% | 60% | 50% | 60% | 30% | 70% | 10% | Tier 2 |
| Computers & Electronics | 100% | 20% | 30% | 40% | 20% | 0% | 100% | 0% | Tier 2 |
Computer Hardware leads with a mean tier of 2.40 and a median of 3. Retail (mean 2.50) and Consumer Electronics (2.40) follow, with Apparel & Fashion at 2.30 completing the upper cluster.
Six Saint Vincent sectors share the most accessible floor tier
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Telecom | 90% | 10% | 20% | 60% | 0% | 30% | 90% | 20% | Tier 2 |
| Banking | 100% | 30% | 10% | 20% | 10% | 0% | 70% | 10% | Tier 2 |
| Design | 100% | 30% | 40% | 40% | 30% | 30% | 100% | 40% | Tier 2 |
| Finance | 80% | 10% | 0% | 10% | 10% | 10% | 70% | 30% | Tier 2 |
| Machinery | 100% | 0% | 20% | 10% | 0% | 0% | 90% | 10% | Tier 2 |
| Non-Profit | 90% | 10% | 20% | 40% | 20% | 20% | 70% | 10% | Tier 2 |
| Sporting Goods | 90% | 10% | 0% | 50% | 20% | 10% | 70% | 20% | Tier 2 |
| Travel & Tourism | 100% | 20% | 10% | 50% | 40% | 10% | 90% | 60% | Tier 2 |
| Wellness | 100% | 10% | 20% | 40% | 20% | 20% | 90% | 40% | Tier 2 |
| Adult | 100% | 40% | 40% | 70% | 10% | 20% | 90% | 10% | Tier 2 |
| Automotive | 90% | 20% | 30% | 10% | 20% | 30% | 80% | 30% | Tier 2 |
| Computer & Video Games | 100% | 20% | 20% | 50% | 10% | 10% | 100% | 30% | Tier 2 |
| Healthcare | 100% | 0% | 10% | 30% | 0% | 20% | 100% | 40% | Tier 2 |
| Music | 100% | 30% | 40% | 50% | 10% | 20% | 100% | 30% | Tier 2 |
| Photography | 90% | 30% | 50% | 20% | 20% | 90% | 80% | 30% | Tier 2 |
The floor mean tier is 1.70, shared by Adult, Automotive, Computer & Video Games, Healthcare, Music, and Photography — six sectors all averaging near Tier 1.