Overview
CAPTCHA and JavaScript lead among Guam secondary barriers
| Value | |
|---|---|
| WAF | 92.3% |
| Antibot | 20.7% |
| CAPTCHA | 23.5% |
| JavaScript | 38.3% |
| Rate Limiting | 13.5% |
| TLS | 18% |
WAF reaches 92.3% of Guam sites. Among the remaining barriers, JavaScript (38.3%) and CAPTCHA (23.5%) are the most widely deployed, with Antibot at 20.7%, TLS at 18.0%, and Rate Limiting at 13.5%.
Barrier Landscape
JavaScript is the most common secondary barrier in Guam
| Value | |
|---|---|
| WAF | 92.3% |
| Antibot | 20.7% |
| CAPTCHA | 23.5% |
| JavaScript | 38.3% |
| Rate Limiting | 13.5% |
| TLS | 18% |
| Has robots.txt | 80.1% |
| Blocks AI crawlers | 14.2% |
WAF covers 92.3% of Guam sites. JavaScript (38.3%) is the leading secondary barrier, followed by CAPTCHA (23.5%), Antibot (20.7%), TLS (18.0%), and Rate Limiting (13.5%).
Single-barrier sites are the most common configuration
| % of sites | |
|---|---|
| 0 barriers | 4.6% |
| 1 barrier | 32.5% |
| 2 barriers | 31.9% |
| 3 barriers | 18.7% |
| 4 barriers | 7.8% |
| 5 barriers | 4.2% |
| 6 barriers | 0.3% |
Most Guam sites carry exactly one barrier (32.5%) or two (31.9%). 4.6% of sites carry none at all. Sites with three or more barriers account for 30.5% of the total.
Most Guam sites are Easy to access programmatically
| Mean recommended tier | |
|---|---|
| All sites | 1.7 |
The recommended browser tier for Guam sites has a mean of 1.67 and a median of 2 (Easy), indicating that while Tier 1 is common, a substantial share of sites require Easy-level retrieval.
Nearly nine in 10 sites are Simple or Easy to access
| % of sites | |
|---|---|
| 1 - Simple | 48.1% |
| 2 - Easy | 40.5% |
| 3 - Moderate | 9% |
| 4 - Complex | 1.6% |
| 5 - Advanced | 0.8% |
Tier 1 (Simple) accounts for 48.1% of Guam sites; Tier 2 (Easy) adds a further 40.5%. Tier 3 (Moderate) covers 9.0%, with Tiers 4 and 5 each below 2%.
robots.txt
AI crawlers are the most-cited bot category in robots.txt
| % of sites | |
|---|---|
| AI crawlers | 15.8% |
| SEO / search indexing | 11.3% |
| SEO audit tools | 12.8% |
| Commercial scrapers | 7.7% |
| Social / content scrapers | 6.1% |
| Archive / research crawlers | 4% |
| Monitoring / uptime bots | 0.7% |
Across all 911 Guam sites, 15.8% name at least one AI crawler in a robots.txt rule. SEO audit tools (12.8%) and SEO/search bots (11.3%) are next, ahead of commercial scrapers at 7.7%.
Uniform rules are the most common posture in Guam
| % of sites | |
|---|---|
| Uniform per-agent rules (no path mixing) | 42% |
| Path-level mixed rules for same agent | 31.9% |
| Allow-only (no disallow rules) | 3% |
| Mixed AI posture (block some, allow others) | 2.9% |
| Blanket Disallow: / | 2.7% |
Uniform per-agent rules apply across 42.0% of Guam sites. Path-level mixed rules cover a further 31.9%. No robots.txt is present on approximately 19.9% of sites.
GPTBot is the most widely blocked AI agent in Guam
| Disallowed | Allowed (whitelisted) | |
|---|---|---|
| GPTBot | 12% | 2% |
| CCBot | 8.3% | 1.1% |
| ClaudeBot | 8.3% | 1.1% |
| Google-Extended | 7.7% | 1.3% |
| Bytespider | 6.4% | 0.8% |
| meta-externalagent | 2.9% | 0.1% |
| ChatGPT-User | 5.9% | 3.1% |
| PerplexityBot | 6.1% | 2.5% |
| Applebot-Extended | 5% | 0.5% |
| OAI-SearchBot | 3.8% | 2.6% |
| anthropic-ai | 5.2% | 0.8% |
GPTBot is named in a Disallow rule on 12.0% of all Guam sites. ChatGPT-User appears most often in an Allow rule (3.1%), followed by OAI-SearchBot at 2.6%.
Six sectors unanimously name at least one bot to restrict
| % of sites | |
|---|---|
| Computer & Video Games | 100% |
| Design | 100% |
| Insurance | 100% |
| Retail | 100% |
| Telecom | 100% |
| Writing & Editing | 100% |
| Adult | 90% |
| Airlines | 90% |
| Beauty & Cosmetics | 90% |
| Consumer Electronics | 90% |
| Entertainment | 90% |
| General | 90% |
| Healthcare | 90% |
| Mass Media | 90% |
| Newspapers | 90% |
Computer & Video Games, Design, Insurance, Retail, Telecom, and Writing & Editing each show 100% of their sites naming at least one bot to restrict. Adult, Airlines, and eight other sectors follow at 90%.
Guam's Import & Export sites lead in explicitly allowing crawlers
| % of sites | |
|---|---|
| Import & Export | 80% |
| Renewable Energy | 77.8% |
| Airlines | 70% |
| Insurance | 70% |
| Publishing | 70% |
| Telecom | 70% |
| Architecture | 62.5% |
| Aerospace & Defence | 60% |
| Biotech | 60% |
| Computer Hardware | 60% |
| Design | 60% |
| Manufacturing | 60% |
| Music | 60% |
| Photography | 60% |
| Retail | 60% |
Import & Export sites name at least one bot in an Allow rule on 80.0% of sites, followed by Renewable Energy at 77.8% and Airlines, Insurance, Publishing, and Telecom each at 70.0%.
Industry Patterns
Sporting Goods is the hardest sector to access programmatically
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Sporting Goods | 80% | 10% | 10% | 30% | 30% | 20% | 60% | 20% | Tier 3 |
| Hospitality | 80% | 20% | 0% | 50% | 30% | 40% | 50% | 10% | Tier 3 |
| Computer Hardware | 90% | 0% | 0% | 30% | 0% | 30% | 100% | 0% | Tier 3 |
| Equipment & Supplies | 90% | 40% | 30% | 60% | 20% | 10% | 60% | 0% | Tier 3 |
| Automotive | 90% | 40% | 10% | 30% | 40% | 40% | 70% | 10% | Tier 2 |
| Real Estate | 90% | 30% | 10% | 60% | 50% | 20% | 50% | 0% | Tier 2 |
| Retail | 90% | 30% | 0% | 50% | 10% | 20% | 100% | 20% | Tier 2 |
| Consumer Electronics | 80% | 10% | 20% | 50% | 10% | 40% | 90% | 20% | Tier 2 |
| Transport & Logistics | 80% | 30% | 20% | 20% | 0% | 10% | 90% | 0% | Tier 2 |
| Apparel & Fashion | 100% | 20% | 30% | 70% | 30% | 30% | 80% | 10% | Tier 2 |
| Beauty & Cosmetics | 100% | 40% | 40% | 40% | 30% | 10% | 90% | 10% | Tier 2 |
| Insurance | 90% | 20% | 10% | 30% | 0% | 10% | 100% | 0% | Tier 2 |
| Jewellery & Luxury | 100% | 20% | 30% | 30% | 10% | 30% | 60% | 20% | Tier 2 |
| Mail & Delivery | 70% | 30% | 20% | 10% | 0% | 20% | 80% | 0% | Tier 2 |
| Adult | 100% | 30% | 40% | 80% | 10% | 10% | 90% | 20% | Tier 2 |
Sporting Goods records a mean browser tier of 2.80 (median 3, Moderate) — the hardest sector in Guam. Hospitality (2.70) and Computer Hardware (2.50) follow, both with a Moderate median tier.
Airlines sites are the most accessible sector in Guam
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Human Resources | 100% | 60% | 40% | 30% | 60% | 20% | 70% | 0% | Tier 2 |
| Market Research | 100% | 0% | 50% | 66.7% | 0% | 0% | 83.3% | 16.7% | Tier 2 |
| Food & Beverages | 100% | 50% | 40% | 70% | 50% | 0% | 80% | 50% | Tier 2 |
| Maritime | 90% | 40% | 40% | 50% | 40% | 10% | 70% | 30% | Tier 2 |
| Biotech | 100% | 20% | 40% | 70% | 0% | 10% | 90% | 20% | Tier 2 |
| Libraries | 100% | 20% | 20% | 50% | 0% | 30% | 80% | 0% | Tier 2 |
| Recruitment & Staffing | 70% | 20% | 10% | 20% | 10% | 20% | 70% | 0% | Tier 2 |
| Science | 90% | 30% | 10% | 30% | 20% | 10% | 70% | 0% | Tier 2 |
| Sports | 100% | 10% | 10% | 60% | 10% | 10% | 90% | 30% | Tier 2 |
| Ecology & Environment | 100% | 10% | 10% | 50% | 0% | 10% | 90% | 10% | Tier 2 |
| Non-Profit | 90% | 0% | 10% | 40% | 10% | 0% | 70% | 0% | Tier 2 |
| Travel & Tourism | 100% | 30% | 10% | 60% | 30% | 0% | 80% | 30% | Tier 2 |
| TV & Film | 100% | 50% | 20% | 70% | 40% | 0% | 60% | 10% | Tier 2 |
| Wellness | 100% | 20% | 20% | 40% | 20% | 20% | 90% | 30% | Tier 2 |
| Airlines | 90% | 10% | 10% | 50% | 30% | 20% | 100% | 30% | Tier 2 |
Airlines records the lowest mean browser tier among Guam sectors at 1.70, with a median of 2 (Easy). Five sectors cluster at a mean tier of 1.80.