Overview
JavaScript leads Aruba's secondary barriers, with CAPTCHA second
| Value | |
|---|---|
| WAF | 93.1% |
| Antibot | 21.7% |
| CAPTCHA | 25.7% |
| JavaScript | 39.5% |
| Rate Limiting | 14.3% |
| TLS | 18.2% |
WAF covers 93.1% of Aruba sites. JavaScript reaches 39.5%, ahead of CAPTCHA at 25.7% and Antibot at 21.7%. TLS at 18.2% and Rate Limiting at 14.3% round out the picture.
Barrier Landscape
JavaScript tops Aruba's active secondary defences
| Value | |
|---|---|
| WAF | 93.1% |
| Antibot | 21.7% |
| CAPTCHA | 25.7% |
| JavaScript | 39.5% |
| Rate Limiting | 14.3% |
| TLS | 18.2% |
| Has robots.txt | 81.4% |
| Blocks AI crawlers | 15.1% |
WAF leads at 93.1%. JavaScript reaches 39.5%, CAPTCHA 25.7%, Antibot 21.7%, TLS 18.2%, and Rate Limiting 14.3% across Aruba's 946 domains.
Most Aruba sites carry at least two barriers
| % of sites | |
|---|---|
| 0 barriers | 4.2% |
| 1 barrier | 31.1% |
| 2 barriers | 32.2% |
| 3 barriers | 18.3% |
| 4 barriers | 9.3% |
| 5 barriers | 4.3% |
| 6 barriers | 0.5% |
32.2% of Aruba sites carry exactly two barriers — the modal count. Single-barrier sites follow at 31.1%. Just 4.2% have no barriers at all, while 32.1% stack three or more.
Most Aruba sites are Simple to access
| Mean recommended tier | |
|---|---|
| All sites | 1.7 |
Browser median tier is 1, meaning more than half of Aruba's 946 sites are retrievable at plain HTTP. Mean sits at 1.66, pulled up by a tail of Tier 3–5 sites.
Most Aruba sites are Simple or Easy to access
| % of sites | |
|---|---|
| 1 - Simple | 52.1% |
| 2 - Easy | 35.2% |
| 3 - Moderate | 8.9% |
| 4 - Complex | 2.4% |
| 5 - Advanced | 1.4% |
52.1% of sites sit at Tier 1 (Simple) and 35.2% at Tier 2 (Easy), together covering 87.3%. Tier 3 accounts for 8.9%, with Tiers 4 and 5 at 2.4% and 1.4% respectively.
robots.txt
AI crawlers top Aruba's robots.txt bot categories
| % of sites | |
|---|---|
| AI crawlers | 16.6% |
| SEO / search indexing | 11.9% |
| SEO audit tools | 14.4% |
| Commercial scrapers | 7.1% |
| Social / content scrapers | 6.2% |
| Archive / research crawlers | 4.3% |
| Monitoring / uptime bots | 0.5% |
16.6% of all Aruba sites name at least one AI crawler in a robots.txt rule — the top category. SEO audit tools follow at 14.4%, SEO/search indexing at 11.9%, and commercial scrapers at 7.1%.
Uniform rules are Aruba's most common robots.txt posture
| % of sites | |
|---|---|
| Uniform per-agent rules (no path mixing) | 43.3% |
| Path-level mixed rules for same agent | 31.9% |
| Allow-only (no disallow rules) | 2.9% |
| Mixed AI posture (block some, allow others) | 2.3% |
| Blanket Disallow: / | 2.9% |
43.3% of all Aruba sites use uniform per-agent rules, and 31.9% use path-level mixed rules. 2.9% carry a blanket Disallow: /, and 2.3% hold a mixed AI posture. 18.6% have no robots.txt.
GPTBot faces the most Disallow rules in Aruba's robots.txt
| Disallowed | Allowed (whitelisted) | |
|---|---|---|
| GPTBot | 12.7% | 1.6% |
| CCBot | 9.6% | 0.7% |
| ClaudeBot | 9% | 0.6% |
| Google-Extended | 9.5% | 1.1% |
| Bytespider | 7.5% | 0.4% |
| meta-externalagent | 3.3% | 0.1% |
| ChatGPT-User | 6.9% | 2.2% |
| PerplexityBot | 6.4% | 1.9% |
| Applebot-Extended | 5.8% | 0.3% |
| OAI-SearchBot | 4.3% | 2.1% |
| anthropic-ai | 4.9% | 0.4% |
GPTBot is named in Disallow rules on 12.7% of all Aruba sites, CCBot on 9.6%, Google-Extended on 9.5%, and ClaudeBot on 9.0%. ChatGPT-User and PerplexityBot lead explicit Allow rules at 2.2% and 1.9%.
Nine Aruba sectors all name at least one bot to restrict
| % of sites | |
|---|---|
| Computer & Video Games | 100% |
| Design | 100% |
| Entertainment | 100% |
| Machinery | 100% |
| Market Research | 100% |
| Recreational Facilities | 100% |
| Retail | 100% |
| Telecom | 100% |
| Veterinary | 100% |
| Adult | 90% |
| Advertising & Mktg | 90% |
| Banking | 90% |
| Consumer Electronics | 90% |
| Food & Beverages | 90% |
| General | 90% |
Computer & Video Games, Design, Entertainment, Machinery, Market Research, Recreational Facilities, Retail, Telecom, and Veterinary all reach 100% — every site in each sector names at least one bot in a Disallow rule.
Aruba's Market Research sites lead in explicitly allowing crawlers
| % of sites | |
|---|---|
| Market Research | 100% |
| Recreational Facilities | 80% |
| Airlines | 70% |
| Non-Profit | 70% |
| Photography | 70% |
| Publishing | 70% |
| Retail | 70% |
| Sporting Goods | 70% |
| Telecom | 70% |
| Advertising & Mktg | 60% |
| Automotive | 60% |
| Education | 60% |
| Healthcare | 60% |
| Human Resources | 60% |
| Real Estate | 60% |
Market Research reaches 100% for explicit bot Allow rules. Recreational Facilities follows at 80%, with Airlines, Non-Profit, Photography, Publishing, Retail, Sporting Goods, and Telecom each at 70%.
Industry Patterns
Hospitality is Aruba's most demanding sector for crawlers
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Hospitality | 90% | 20% | 0% | 50% | 40% | 50% | 60% | 20% | Tier 3 |
| Jewellery & Luxury | 80% | 30% | 20% | 30% | 30% | 40% | 60% | 0% | Tier 3 |
| Maritime | 100% | 50% | 20% | 60% | 40% | 20% | 70% | 10% | Tier 2 |
| Equipment & Supplies | 80% | 50% | 20% | 50% | 40% | 10% | 60% | 10% | Tier 2 |
| Real Estate | 100% | 30% | 20% | 60% | 30% | 10% | 70% | 0% | Tier 2 |
| Sporting Goods | 80% | 10% | 20% | 20% | 40% | 50% | 80% | 10% | Tier 2 |
| Automotive | 90% | 20% | 10% | 40% | 30% | 20% | 70% | 10% | Tier 2 |
| Retail | 100% | 10% | 0% | 60% | 10% | 10% | 100% | 50% | Tier 2 |
| Sports | 100% | 10% | 20% | 70% | 20% | 10% | 80% | 40% | Tier 2 |
| Wholesalers | 90% | 40% | 50% | 80% | 50% | 10% | 70% | 10% | Tier 2 |
| Apparel & Fashion | 90% | 10% | 20% | 60% | 20% | 20% | 70% | 10% | Tier 2 |
| Consumer Electronics | 80% | 10% | 10% | 40% | 10% | 40% | 90% | 20% | Tier 2 |
| Machinery | 80% | 10% | 0% | 50% | 0% | 10% | 100% | 0% | Tier 2 |
| Beauty & Cosmetics | 90% | 40% | 50% | 20% | 30% | 20% | 80% | 20% | Tier 2 |
| Computer Hardware | 100% | 20% | 0% | 40% | 20% | 30% | 80% | 10% | Tier 2 |
Hospitality tops Aruba's sector difficulty ranking with a mean recommended tier of 2.90 and a median of Tier 3. Jewellery & Luxury follows at 2.80. Most remaining top-15 sectors cluster around Tier 2.
Computer & Video Games is Aruba's most accessible sector programmatically
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Design | 100% | 20% | 30% | 40% | 20% | 30% | 100% | 30% | Tier 2 |
| Education | 100% | 20% | 10% | 30% | 10% | 10% | 70% | 10% | Tier 2 |
| Restaurants | 70% | 10% | 30% | 40% | 40% | 40% | 80% | 20% | Tier 2 |
| Science | 100% | 30% | 0% | 30% | 30% | 20% | 70% | 20% | Tier 2 |
| Telecom | 90% | 10% | 10% | 50% | 0% | 40% | 100% | 20% | Tier 2 |
| Food & Beverages | 100% | 20% | 30% | 40% | 10% | 0% | 100% | 40% | Tier 2 |
| Human Resources | 100% | 60% | 50% | 30% | 60% | 20% | 80% | 0% | Tier 2 |
| Mail & Delivery | 80% | 30% | 20% | 20% | 10% | 10% | 80% | 0% | Tier 2 |
| Oil & Gas | 100% | 20% | 50% | 40% | 10% | 20% | 60% | 0% | Tier 2 |
| Transport & Logistics | 80% | 30% | 20% | 20% | 10% | 10% | 80% | 0% | Tier 2 |
| Biotech | 80% | 30% | 40% | 50% | 10% | 20% | 80% | 20% | Tier 2 |
| Museums | 100% | 40% | 40% | 20% | 0% | 20% | 80% | 20% | Tier 2 |
| Reference | 80% | 40% | 10% | 40% | 10% | 20% | 70% | 30% | Tier 2 |
| Renewable Energy | 100% | 10% | 10% | 80% | 10% | 20% | 90% | 0% | Tier 2 |
| Computer & Video Games | 100% | 20% | 20% | 50% | 10% | 10% | 100% | 30% | Tier 2 |
Computer & Video Games posts the lowest mean tier at 1.70 — the floor for Aruba's bottom-15 sectors. Several sectors share values near 1.80, including Renewable Energy, Museums, Biotech, and Reference.