Overview
JavaScript and CAPTCHA are Puerto Rico's most common secondary barriers
| Value | |
|---|---|
| WAF | 92.7% |
| Antibot | 22.7% |
| CAPTCHA | 22.9% |
| JavaScript | 43.3% |
| Rate Limiting | 16% |
| TLS | 17.8% |
WAF reaches 92.7% across Puerto Rican sites. JavaScript (43.3%) leads secondary barriers, followed by Antibot (22.7%) and CAPTCHA (22.9%). TLS (17.8%) and Rate Limiting (16.0%) are lowest.
Barrier Landscape
JavaScript tops Puerto Rico's active secondary defences
| Value | |
|---|---|
| WAF | 92.7% |
| Antibot | 22.7% |
| CAPTCHA | 22.9% |
| JavaScript | 43.3% |
| Rate Limiting | 16% |
| TLS | 17.8% |
| Has robots.txt | 78.2% |
| Blocks AI crawlers | 13.7% |
WAF reaches 92.7% of sites. JavaScript (43.3%) is the top secondary barrier. CAPTCHA (22.9%) and Antibot (22.7%) are near-identical. Rate Limiting (16.0%) exceeds the global average of 12.9%; TLS sits at 17.8%.
Most Puerto Rican sites carry at least two barriers
| % of sites | |
|---|---|
| 0 barriers | 4.8% |
| 1 barrier | 28.2% |
| 2 barriers | 33.2% |
| 3 barriers | 19.7% |
| 4 barriers | 9.4% |
| 5 barriers | 4.3% |
| 6 barriers | 0.5% |
33.2% of Puerto Rican sites carry exactly two barriers — the modal count. 4.8% have none at all. Sites with three or more barriers account for 33.9% — a substantial proportion reaching across all six tiers.
Puerto Rico's sites sit comfortably in the Easy access band
| Mean recommended tier | |
|---|---|
| All sites | 1.7 |
The median recommended tier is 2 (Easy), meaning fewer than half of sites are retrievable at Tier 1 (Simple). A mean of 1.72 indicates a large share of straightforward sites keeping the average low within Tier 2.
Most Puerto Rican sites are Simple or Easy to access
| % of sites | |
|---|---|
| 1 - Simple | 45.5% |
| 2 - Easy | 40.7% |
| 3 - Moderate | 10.4% |
| 4 - Complex | 2.7% |
| 5 - Advanced | 0.7% |
Tier 1 (Simple) covers 45.5% of sites; Tier 2 (Easy) a further 40.7% — 86.2% combined. Tier 3 (Moderate) applies to 10.4%. Tiers 4 and 5 together account for just 3.4% of Puerto Rican sites.
robots.txt
AI crawlers top Puerto Rico's robots.txt bot categories
| % of sites | |
|---|---|
| AI crawlers | 15.3% |
| SEO / search indexing | 12.3% |
| SEO audit tools | 12.3% |
| Commercial scrapers | 8% |
| Social / content scrapers | 5.6% |
| Archive / research crawlers | 4.4% |
| Monitoring / uptime bots | 0.5% |
AI crawlers appear on 15.3% of all Puerto Rican sites. SEO/search indexing and SEO audit tools are precisely equal at 12.3% each. Commercial scrapers are cited on 8.0% of sites; monitoring bots on 0.5%.
Uniform rules are Puerto Rico's most common robots.txt posture
| % of sites | |
|---|---|
| Uniform per-agent rules (no path mixing) | 40.2% |
| Path-level mixed rules for same agent | 33.3% |
| Allow-only (no disallow rules) | 2% |
| Mixed AI posture (block some, allow others) | 2.5% |
| Blanket Disallow: / | 2.6% |
40.2% of all Puerto Rican sites use uniform per-agent rules and 33.3% apply path-level mixing. Blanket Disallow: / applies to 2.6% of sites. Mixed AI posture accounts for 2.5% and allow-only for 2.0%.
GPTBot faces the most Disallow rules in Puerto Rico's robots.txt
| Disallowed | Allowed (whitelisted) | |
|---|---|---|
| GPTBot | 10.8% | 2% |
| CCBot | 8.5% | 1.1% |
| ClaudeBot | 8.1% | 0.9% |
| Google-Extended | 8.1% | 1.4% |
| Bytespider | 6.9% | 0.5% |
| meta-externalagent | 2.6% | 0.1% |
| ChatGPT-User | 5.6% | 2.2% |
| PerplexityBot | 6% | 1.9% |
| Applebot-Extended | 4.8% | 0.4% |
| OAI-SearchBot | 4.4% | 1.9% |
| anthropic-ai | 5.2% | 0.7% |
GPTBot is named in Disallow rules on 10.8% of all Puerto Rican sites. CCBot (8.5%) and ClaudeBot (8.1%) follow. ChatGPT-User receives the most explicit Allow rules at 2.2%.
Five Puerto Rican sectors all name at least one bot to restrict
| % of sites | |
|---|---|
| Computer & Video Games | 100% |
| Design | 100% |
| Entertainment | 100% |
| Foreign Language | 100% |
| Retail | 100% |
| Adult | 90% |
| Agriculture | 90% |
| Beauty & Cosmetics | 90% |
| General | 90% |
| Healthcare | 90% |
| Insurance | 90% |
| Mass Media | 90% |
| Newspapers | 90% |
| Online Services | 90% |
| Public Safety | 90% |
Computer & Video Games, Design, Entertainment, Foreign Language, and Retail each show 100% of sites naming at least one bot to restrict. Nine further sectors — including Healthcare, Insurance, and Mass Media — sit at 90%.
Puerto Rico's Retail and Science sectors lead in explicitly allowing crawlers
| % of sites | |
|---|---|
| Retail | 80% |
| Science | 80% |
| Photography | 70% |
| Publishing | 70% |
| Wholesalers | 70% |
| Airlines | 60% |
| Architecture | 60% |
| Beauty & Cosmetics | 60% |
| Foreign Language | 60% |
| Insurance | 60% |
| Investment | 60% |
| Renewable Energy | 60% |
| Software & Dev | 60% |
| Telecom | 60% |
| Automotive | 50% |
Retail and Science top the allow rankings with 80% of their sites naming at least one bot in an Allow rule. Photography, Publishing, and Wholesalers follow at 70%. Ten additional sectors — including Insurance and Telecom — sit at 60%.
Industry Patterns
Furniture is Puerto Rico's most demanding sector for crawlers
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Furniture | 100% | 20% | 0% | 30% | 20% | 60% | 70% | 10% | Tier 3 |
| Hospitality | 90% | 20% | 0% | 50% | 40% | 50% | 60% | 20% | Tier 3 |
| Jewellery & Luxury | 100% | 20% | 10% | 30% | 30% | 50% | 60% | 10% | Tier 3 |
| Equipment & Supplies | 90% | 30% | 10% | 60% | 20% | 0% | 60% | 10% | Tier 3 |
| Real Estate | 100% | 10% | 10% | 60% | 60% | 20% | 50% | 10% | Tier 2 |
| Computer Hardware | 90% | 20% | 10% | 20% | 20% | 30% | 80% | 10% | Tier 2 |
| Retail | 100% | 10% | 0% | 60% | 20% | 20% | 100% | 40% | Tier 2 |
| Sporting Goods | 80% | 10% | 10% | 30% | 30% | 30% | 60% | 0% | Tier 2 |
| Food & Beverages | 90% | 40% | 30% | 70% | 40% | 0% | 60% | 40% | Tier 2 |
| Consumer Electronics | 90% | 20% | 20% | 50% | 20% | 40% | 80% | 20% | Tier 2 |
| Customer Services | 100% | 20% | 30% | 60% | 40% | 20% | 60% | 0% | Tier 2 |
| Human Resources | 100% | 70% | 60% | 40% | 40% | 20% | 70% | 10% | Tier 2 |
| Insurance | 80% | 20% | 10% | 30% | 0% | 10% | 90% | 0% | Tier 2 |
| Medical Devices | 100% | 30% | 0% | 60% | 30% | 0% | 80% | 0% | Tier 2 |
| Beauty & Cosmetics | 100% | 50% | 40% | 30% | 40% | 20% | 90% | 30% | Tier 2 |
Furniture records the highest mean recommended tier at 3.15 with a median of 3 (Moderate). Hospitality and Jewellery & Luxury follow at mean 2.90, also with a median of 3. Equipment & Supplies sits at 2.50.
Five Puerto Rican sectors share the most accessible floor tier
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Transport & Logistics | 80% | 40% | 10% | 20% | 0% | 20% | 80% | 0% | Tier 2 |
| Apparel & Fashion | 100% | 20% | 30% | 70% | 30% | 30% | 80% | 10% | Tier 2 |
| Automotive | 100% | 30% | 10% | 30% | 40% | 20% | 60% | 10% | Tier 2 |
| Crafts | 100% | 40% | 40% | 40% | 20% | 20% | 80% | 30% | Tier 2 |
| Mail & Delivery | 80% | 30% | 10% | 10% | 0% | 20% | 80% | 0% | Tier 2 |
| Maritime | 80% | 30% | 10% | 40% | 20% | 30% | 60% | 10% | Tier 2 |
| Renewable Energy | 80% | 0% | 10% | 40% | 10% | 20% | 90% | 0% | Tier 2 |
| Wholesalers | 90% | 10% | 20% | 40% | 30% | 30% | 90% | 10% | Tier 2 |
| Design | 100% | 20% | 30% | 40% | 20% | 30% | 100% | 30% | Tier 2 |
| Restaurants | 90% | 40% | 30% | 60% | 40% | 10% | 50% | 20% | Tier 2 |
| Oil & Gas | 70% | 10% | 20% | 40% | 10% | 10% | 60% | 10% | Tier 2 |
| Printing | 100% | 10% | 20% | 30% | 10% | 10% | 80% | 0% | Tier 2 |
| Public Safety | 90% | 20% | 50% | 70% | 10% | 30% | 90% | 10% | Tier 2 |
| Recruitment & Staffing | 100% | 20% | 50% | 20% | 0% | 10% | 80% | 10% | Tier 2 |
| Reference | 80% | 50% | 30% | 40% | 10% | 10% | 60% | 40% | Tier 2 |
Oil & Gas, Printing, Public Safety, Recruitment & Staffing, and Reference all record a mean recommended tier of 1.90 — the floor of Puerto Rico's accessible-sector group. All carry a median of Tier 2 (Easy).