Overview
JavaScript leads secondary barriers across American Samoa sites
| Value | |
|---|---|
| WAF | 95% |
| Antibot | 23% |
| CAPTCHA | 27.3% |
| JavaScript | 40.7% |
| Rate Limiting | 11.4% |
| TLS | 17.4% |
WAF covers 95.0% of American Samoa sites. Among secondary barriers, JavaScript reaches 40.7% — ahead of CAPTCHA (27.3%), Antibot (23.0%), TLS (17.4%), and Rate Limiting (11.4%).
Barrier Landscape
JavaScript and CAPTCHA are the two leading secondary barriers
| Value | |
|---|---|
| WAF | 95% |
| Antibot | 23% |
| CAPTCHA | 27.3% |
| JavaScript | 40.7% |
| Rate Limiting | 11.4% |
| TLS | 17.4% |
| Has robots.txt | 80.6% |
| Blocks AI crawlers | 17.2% |
After WAF at 95.0%, JavaScript is used by 40.7% of sites. CAPTCHA (27.3%) and Antibot (23.0%) follow. TLS sits at 17.4%, and Rate Limiting is the least common secondary barrier at 11.4%.
Most sites carry two or more secondary barriers
| % of sites | |
|---|---|
| 0 barriers | 3.6% |
| 1 barrier | 29.7% |
| 2 barriers | 33.3% |
| 3 barriers | 20.6% |
| 4 barriers | 7.6% |
| 5 barriers | 4.8% |
| 6 barriers | 0.4% |
33.3% of American Samoa sites deploy exactly two barriers. Only 3.6% have none. A substantial 32.8% stack three or more, with 4.8% reaching five barriers and 0.4% deploying all six.
Most American Samoa sites are Simple to access
| Mean recommended tier | |
|---|---|
| All sites | 1.6 |
More than half of American Samoa sites are accessible at Tier 1, giving a median of 1. The mean of 1.61 indicates a spread of harder sites requiring browser rendering or more advanced retrieval methods.
Nine in 10 sites are Simple or Easy to access
| % of sites | |
|---|---|
| 1 - Simple | 53.1% |
| 2 - Easy | 35.3% |
| 3 - Moderate | 9.4% |
| 4 - Complex | 2% |
| 5 - Advanced | 0.2% |
53.1% of American Samoa sites require only Tier 1 retrieval. A further 35.3% resolve at Tier 2 with browser rendering. The remaining 11.6% span Tiers 3–5, with just 0.2% at the most demanding level.
robots.txt
AI crawlers are the most-named bot category in robots.txt
| % of sites | |
|---|---|
| AI crawlers | 19% |
| SEO / search indexing | 13% |
| SEO audit tools | 14.2% |
| Commercial scrapers | 9.6% |
| Social / content scrapers | 8% |
| Archive / research crawlers | 6.8% |
| Monitoring / uptime bots | 0.2% |
19.0% of all American Samoa sites name at least one AI crawler in their robots.txt — the highest bot-category rate. SEO audit tools (14.2%) and SEO/search indexing (13.0%) follow closely behind.
Uniform per-agent rules are the most common posture
| % of sites | |
|---|---|
| Uniform per-agent rules (no path mixing) | 43.1% |
| Path-level mixed rules for same agent | 32.7% |
| Allow-only (no disallow rules) | 1% |
| Mixed AI posture (block some, allow others) | 3.6% |
| Blanket Disallow: / | 3.6% |
43.1% of sites apply uniform per-agent rules. Path-level mixed rules account for 32.7%. Sites with no robots.txt represent 19.4% of the sample. Blanket Disallow and Mixed AI posture each appear at 3.6%.
GPTBot faces the most Disallow rules in American Samoa's robots.txt
| Disallowed | Allowed (whitelisted) | |
|---|---|---|
| GPTBot | 13.8% | 2.6% |
| CCBot | 10.8% | 1.4% |
| ClaudeBot | 12.8% | 1.8% |
| Google-Extended | 10.8% | 1.6% |
| Bytespider | 10.8% | 1.4% |
| meta-externalagent | 5.2% | 0.4% |
| ChatGPT-User | 6.4% | 2.8% |
| PerplexityBot | 8.4% | 3.4% |
| Applebot-Extended | 8.2% | 1.2% |
| OAI-SearchBot | 4% | 2.8% |
| anthropic-ai | 5.8% | 1.2% |
GPTBot is named in a Disallow rule on 13.8% of all American Samoa sites — the most blocked AI agent. PerplexityBot leads explicit Allow rules at 3.4%, ahead of ChatGPT-User at 2.8%.
Consumer Electronics sites all name at least one bot to block
| % of sites | |
|---|---|
| Consumer Electronics | 100% |
| Newspapers | 100% |
| Publishing | 100% |
| Adult | 90% |
| Apparel & Fashion | 90% |
| Banking | 90% |
| Distance Learning | 90% |
| Food & Beverages | 90% |
| General | 90% |
| Mass Media | 90% |
| Online Services | 90% |
| Retail | 90% |
| Travel & Tourism | 90% |
| Wellness | 90% |
| TV & Film | 85.7% |
Every sampled site in Consumer Electronics, Newspapers, and Publishing names at least one bot to restrict. Adult, Apparel & Fashion, Banking, Distance Learning, Food & Beverages, and six other industries all reach 90%.
Architecture leads sectors on explicit bot Allow rules
| % of sites | |
|---|---|
| Architecture | 77.8% |
| Publishing | 70% |
| Airlines | 60% |
| Retail | 60% |
| Travel & Tourism | 60% |
| Banking | 50% |
| Construction | 50% |
| Distance Learning | 50% |
| Food & Beverages | 50% |
| General | 50% |
| Mass Media | 50% |
| Newspapers | 50% |
| Online Services | 50% |
| Software & Dev | 50% |
| Wellness | 50% |
Architecture has the highest explicit bot Allow rate at 77.8% — the only industry above 70%. Publishing follows at 70%. Airlines, Retail, and Travel & Tourism each show 60% of sites naming at least one bot in an Allow rule.
Industry Patterns
Retail is the hardest sector to access programmatically
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Retail | 100% | 20% | 0% | 80% | 20% | 10% | 90% | 30% | Tier 2 |
| Airlines | 70% | 0% | 10% | 30% | 10% | 10% | 70% | 0% | Tier 2 |
| Automotive | 100% | 50% | 50% | 30% | 60% | 40% | 60% | 20% | Tier 2 |
| Hospitality | 100% | 40% | 20% | 60% | 30% | 40% | 70% | 0% | Tier 2 |
| Music | 90% | 40% | 30% | 40% | 30% | 10% | 90% | 20% | Tier 2 |
| Real Estate | 100% | 20% | 10% | 40% | 40% | 10% | 80% | 30% | Tier 2 |
| Adult | 100% | 30% | 30% | 70% | 10% | 10% | 90% | 20% | Tier 2 |
| Healthcare | 100% | 20% | 10% | 40% | 0% | 10% | 90% | 20% | Tier 2 |
| Travel & Tourism | 90% | 40% | 20% | 50% | 30% | 30% | 90% | 20% | Tier 2 |
| Distance Learning | 100% | 30% | 40% | 40% | 10% | 20% | 90% | 50% | Tier 2 |
| Publishing | 100% | 20% | 20% | 60% | 10% | 0% | 100% | 50% | Tier 2 |
| Insurance | 100% | 42.9% | 14.3% | 28.6% | 0% | 28.6% | 71.4% | 14.3% | Tier 2 |
| Apparel & Fashion | 100% | 10% | 30% | 50% | 10% | 20% | 90% | 30% | Tier 2 |
| Entertainment | 90% | 0% | 40% | 50% | 10% | 0% | 80% | 40% | Tier 2 |
| Consumer Electronics | 100% | 42.9% | 42.9% | 28.6% | 14.3% | 28.6% | 100% | 0% | Tier 2 |
Retail records the highest mean recommended tier at 2.30. Five industries — Airlines, Automotive, Hospitality, Music, and Real Estate — cluster at mean tier 2.10. All top-15 industries fall between 1.71 and 2.30.
Six sectors share the most accessible mean tier
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Finance | 80% | 20% | 0% | 10% | 10% | 10% | 80% | 30% | Tier 2 |
| Food & Beverages | 100% | 30% | 20% | 70% | 10% | 20% | 100% | 30% | Tier 2 |
| Government | 100% | 20% | 20% | 50% | 20% | 10% | 90% | 0% | Tier 2 |
| Photography | 80% | 30% | 50% | 30% | 20% | 40% | 60% | 30% | Tier 2 |
| Sports | 100% | 0% | 30% | 60% | 0% | 20% | 100% | 30% | Tier 2 |
| Non-Profit | 90% | 20% | 30% | 50% | 10% | 10% | 80% | 10% | Tier 2 |
| Software & Dev | 70% | 40% | 20% | 10% | 20% | 20% | 60% | 10% | Tier 2 |
| Education | 100% | 20% | 20% | 40% | 20% | 10% | 80% | 30% | Tier 2 |
| Religion & Belief | 100% | 20% | 40% | 50% | 0% | 10% | 90% | 10% | Tier 2 |
| Computers & Electronics | 100% | 40% | 40% | 20% | 10% | 10% | 70% | 10% | Tier 1 |
| TV & Film | 100% | 14.3% | 14.3% | 28.6% | 0% | 14.3% | 85.7% | 14.3% | Tier 1 |
| General | 100% | 0% | 50% | 50% | 10% | 40% | 90% | 40% | Tier 1 |
| Banking | 100% | 60% | 0% | 30% | 0% | 10% | 90% | 10% | Tier 1 |
| Computer & Video Games | 100% | 20% | 10% | 60% | 10% | 0% | 80% | 0% | Tier 1 |
| Mass Media | 100% | 0% | 50% | 50% | 10% | 40% | 90% | 40% | Tier 1 |
Computer & Video Games, Mass Media, General, Banking, Education, Religion & Belief, and Software & Dev all record a mean tier of 1.50 — the lowest observed across American Samoa industries.