Overview
JavaScript leads the secondary barrier profile in Micronesia
| Value | |
|---|---|
| WAF | 93.1% |
| Antibot | 21.6% |
| CAPTCHA | 25.3% |
| JavaScript | 39.8% |
| Rate Limiting | 13% |
| TLS | 17.2% |
WAF reaches 93.1% across Micronesia. JavaScript is the most-deployed secondary barrier at 39.8%. CAPTCHA (25.3%) and Antibot (21.6%) follow, with TLS (17.2%) and Rate Limiting (13.0%) less common.
Barrier Landscape
JavaScript, CAPTCHA, and Antibot form the leading secondary barriers
| Value | |
|---|---|
| WAF | 93.1% |
| Antibot | 21.6% |
| CAPTCHA | 25.3% |
| JavaScript | 39.8% |
| Rate Limiting | 13% |
| TLS | 17.2% |
| Has robots.txt | 80.1% |
| Blocks AI crawlers | 19.3% |
After WAF at 93.1%, JavaScript is used by 39.8% of Micronesia sites. CAPTCHA (25.3%) and Antibot (21.6%) are the next two secondary barriers. TLS (17.2%) and Rate Limiting (13.0%) trail behind.
Two barriers is the most common site configuration
| % of sites | |
|---|---|
| 0 barriers | 3.8% |
| 1 barrier | 32.2% |
| 2 barriers | 33.5% |
| 3 barriers | 17.6% |
| 4 barriers | 6.7% |
| 5 barriers | 5.6% |
| 6 barriers | 0.6% |
33.5% of Micronesia sites deploy exactly two barriers. Only 3.8% have none. 30.5% stack three or more, including 5.6% at five barriers and 0.6% using all six — a notable proportion at the upper end.
Most Micronesia sites are Simple to access
| Mean recommended tier | |
|---|---|
| All sites | 1.6 |
Over half of Micronesia sites are accessible at Tier 1, setting the median at 1. The mean of 1.58 reflects a spread of sites requiring Tier 2 browser rendering or more advanced retrieval methods.
Nearly nine in 10 sites are Simple or Easy to access
| % of sites | |
|---|---|
| 1 - Simple | 56.1% |
| 2 - Easy | 33.3% |
| 3 - Moderate | 7.9% |
| 4 - Complex | 2.1% |
| 5 - Advanced | 0.6% |
56.1% of Micronesia sites are accessible at Tier 1 alone. Tier 2 captures a further 33.3%, bringing combined coverage to 89.4%. The remaining 10.6% span Tiers 3, 4, and 5, with fewer than 1% at the most complex level.
robots.txt
AI crawlers lead the named-bot categories in Micronesia
| % of sites | |
|---|---|
| AI crawlers | 19.7% |
| SEO / search indexing | 10% |
| SEO audit tools | 14.8% |
| Commercial scrapers | 10.5% |
| Social / content scrapers | 9.4% |
| Archive / research crawlers | 4.6% |
| Monitoring / uptime bots | 0.4% |
19.7% of all Micronesia sites name at least one AI crawler — the highest bot category. SEO audit tools are named by 14.8%, Commercial scrapers by 10.5%, and SEO/search indexing by 10.0%.
Uniform and path-mixed postures are nearly equally common
| % of sites | |
|---|---|
| Uniform per-agent rules (no path mixing) | 37.5% |
| Path-level mixed rules for same agent | 37.4% |
| Allow-only (no disallow rules) | 1.7% |
| Mixed AI posture (block some, allow others) | 3.3% |
| Blanket Disallow: / | 3.3% |
Uniform per-agent rules (37.5%) and path-level mixed rules (37.4%) are effectively tied as Micronesia's most common robots.txt postures. Sites with no robots.txt represent 19.9% of the sample.
GPTBot faces the most Disallow rules in Micronesia's robots.txt
| Disallowed | Allowed (whitelisted) | |
|---|---|---|
| GPTBot | 15.7% | 1.3% |
| CCBot | 12.8% | 1.3% |
| ClaudeBot | 13.2% | 1% |
| Google-Extended | 11.3% | 0.8% |
| Bytespider | 10.5% | 1% |
| meta-externalagent | 5.6% | 0.8% |
| ChatGPT-User | 8.2% | 1.5% |
| PerplexityBot | 8.2% | 1.1% |
| Applebot-Extended | 8.2% | 0.8% |
| OAI-SearchBot | 5% | 1.1% |
| anthropic-ai | 7.5% | 0.8% |
GPTBot is named in a Disallow rule on 15.7% of all Micronesia sites. ClaudeBot follows at 13.2% and CCBot at 12.8%. ChatGPT-User leads explicit Allow entries at just 1.5%.
Five sectors unanimously name at least one bot to restrict
| % of sites | |
|---|---|
| Apparel & Fashion | 100% |
| Design | 100% |
| Healthcare | 100% |
| Newspapers | 100% |
| Publishing | 100% |
| Adult | 90% |
| Distance Learning | 90% |
| Entertainment | 90% |
| General | 90% |
| Mass Media | 90% |
| Online Services | 90% |
| Retail | 90% |
| Travel & Tourism | 90% |
| Wellness | 90% |
| Religion & Belief | 85.7% |
Apparel & Fashion, Design, Healthcare, Newspapers, and Publishing each show 100% of sampled sites naming at least one bot to restrict. Adult, Distance Learning, Entertainment, and seven further industries reach 90%.
Micronesia's Travel & Tourism sites lead in explicitly allowing crawlers
| % of sites | |
|---|---|
| Travel & Tourism | 80% |
| Airlines | 70% |
| Photography | 70% |
| Publishing | 70% |
| Social & Charitable | 66.7% |
| Ecology & Environment | 62.5% |
| Healthcare | 60% |
| Import & Export | 60% |
| Non-Profit | 60% |
| Retail | 60% |
| Software & Dev | 60% |
| Wellness | 60% |
| Computer & Video Games | 50% |
| Design | 50% |
| Distance Learning | 50% |
Travel & Tourism has the highest bot Allow rate at 80% — above the next tier. Airlines, Photography, and Publishing each show 70% of their sites naming at least one bot in an explicit Allow rule. Social & Charitable follows at 66.7%.
Industry Patterns
Automotive is the hardest sector to access programmatically
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Automotive | 100% | 60% | 40% | 50% | 60% | 30% | 60% | 10% | Tier 2 |
| Retail | 90% | 20% | 0% | 70% | 20% | 20% | 90% | 30% | Tier 2 |
| Mail & Delivery | 50% | 16.7% | 16.7% | 16.7% | 0% | 33.3% | 83.3% | 0% | Tier 2 |
| Transport & Logistics | 70% | 20% | 10% | 30% | 0% | 40% | 80% | 10% | Tier 2 |
| Non-Profit | 100% | 40% | 10% | 20% | 0% | 10% | 80% | 0% | Tier 2 |
| Airlines | 80% | 10% | 10% | 50% | 20% | 20% | 90% | 30% | Tier 2 |
| Photography | 80% | 40% | 40% | 10% | 30% | 70% | 80% | 40% | Tier 2 |
| Publishing | 100% | 20% | 30% | 40% | 10% | 0% | 100% | 30% | Tier 2 |
| Adult | 100% | 30% | 30% | 60% | 10% | 10% | 90% | 20% | Tier 2 |
| Computer & Video Games | 100% | 30% | 20% | 50% | 20% | 10% | 90% | 0% | Tier 2 |
| Distance Learning | 100% | 30% | 50% | 60% | 20% | 10% | 90% | 60% | Tier 2 |
| Education | 100% | 30% | 30% | 50% | 20% | 10% | 80% | 20% | Tier 2 |
| Travel & Tourism | 90% | 20% | 10% | 60% | 20% | 10% | 90% | 50% | Tier 2 |
| Apparel & Fashion | 100% | 0% | 50% | 33.3% | 0% | 16.7% | 100% | 0% | Tier 2 |
| Advertising & Mktg | 100% | 20% | 40% | 60% | 0% | 30% | 80% | 10% | Tier 2 |
Automotive records the highest mean recommended tier at 2.45, ahead of Retail at 2.40 and Mail & Delivery at 2.33. These three industries sit clearly above the rest of the top 15, which span 1.60 to 2.10.
General, Maritime, and Mass Media share the most accessible tier
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Consumer Electronics | 80% | 40% | 20% | 70% | 10% | 20% | 70% | 20% | Tier 2 |
| Government | 90% | 10% | 10% | 20% | 10% | 20% | 90% | 10% | Tier 2 |
| Sporting Goods | 100% | 30% | 50% | 50% | 10% | 20% | 80% | 10% | Tier 2 |
| Telecom | 90% | 20% | 30% | 50% | 0% | 20% | 50% | 0% | Tier 2 |
| Software & Dev | 80% | 40% | 20% | 10% | 20% | 20% | 70% | 10% | Tier 2 |
| Ecology & Environment | 100% | 25% | 12.5% | 37.5% | 0% | 0% | 87.5% | 12.5% | Tier 2 |
| Customer Services | 100% | 20% | 20% | 40% | 40% | 0% | 60% | 0% | Tier 1 |
| Wholesalers | 100% | 20% | 20% | 40% | 0% | 40% | 60% | 0% | Tier 1 |
| Import & Export | 90% | 30% | 10% | 20% | 10% | 30% | 80% | 20% | Tier 1 |
| Entertainment | 100% | 10% | 50% | 50% | 10% | 10% | 100% | 40% | Tier 1 |
| IT Services | 90% | 0% | 0% | 50% | 10% | 10% | 70% | 0% | Tier 1 |
| Human Resources | 100% | 57.1% | 42.9% | 57.1% | 42.9% | 28.6% | 57.1% | 14.3% | Tier 1 |
| General | 100% | 0% | 50% | 50% | 10% | 40% | 90% | 40% | Tier 1 |
| Maritime | 80% | 20% | 20% | 40% | 10% | 30% | 70% | 10% | Tier 1 |
| Mass Media | 100% | 0% | 50% | 50% | 10% | 40% | 90% | 40% | Tier 1 |
General, Maritime, and Mass Media all record a mean tier of 1.50 — the floor across Micronesia industries. Human Resources sits at 1.57. Six sectors cluster at 1.60, including IT Services, Entertainment, and Consumer Electronics.