Overview
TLS and Antibot are elevated among Colombia secondary barriers
| Value | |
|---|---|
| WAF | 93.1% |
| Antibot | 21.3% |
| CAPTCHA | 22.5% |
| JavaScript | 42.9% |
| Rate Limiting | 13.5% |
| TLS | 19.4% |
WAF reaches 93.1%. JavaScript leads secondaries at 42.9%. Antibot (21.3%) and TLS (19.4%) are both higher than most peers in this set. Rate Limiting stands at 13.5% and CAPTCHA at 21.4%.
Barrier Landscape
Antibot and TLS reach elevated levels among secondary barriers
| Value | |
|---|---|
| WAF | 93.1% |
| Antibot | 21.3% |
| CAPTCHA | 22.5% |
| JavaScript | 42.9% |
| Rate Limiting | 13.5% |
| TLS | 19.4% |
| Has robots.txt | 80.6% |
| Blocks AI crawlers | 14.5% |
WAF at 93.1%. JavaScript tops secondary barriers at 42.9%. Antibot (21.3%) and TLS (19.4%) are both higher than most peers in this region. Rate Limiting reaches 13.5%.
Two barriers is the most common site configuration
| % of sites | |
|---|---|
| 0 barriers | 4.9% |
| 1 barrier | 28.2% |
| 2 barriers | 35.4% |
| 3 barriers | 17.6% |
| 4 barriers | 9.3% |
| 5 barriers | 4.3% |
| 6 barriers | 0.4% |
35.4% of sites carry exactly two barriers — the modal count. 4.9% carry none. 31.6% deploy three or more: 17.6% at three, 9.3% at four, 4.3% at five, and 0.4% at all six.
Most Colombia sites are Easy to access programmatically
| Mean recommended tier | |
|---|---|
| All sites | 1.7 |
Mean recommended tier is 1.67; median is 2. 48.2% of sites return at Tier 1 — just short of the majority threshold — with 39.7% at Tier 2.
Nearly nine in 10 Colombia sites are Simple or Easy to access
| % of sites | |
|---|---|
| 1 - Simple | 48.2% |
| 2 - Easy | 39.7% |
| 3 - Moderate | 9.5% |
| 4 - Complex | 1.8% |
| 5 - Advanced | 0.7% |
Tier 1 accounts for 48.2% of sites — below the majority mark — and Tier 2 for 39.7%, together covering 87.9%. Tier 3 reaches 9.5%, Tier 4 stands at 1.8%, and Tier 5 at 0.7%.
robots.txt
AI crawlers are the most-named bot category in robots.txt
| % of sites | |
|---|---|
| AI crawlers | 16.3% |
| SEO / search indexing | 12.2% |
| SEO audit tools | 13.7% |
| Commercial scrapers | 7.7% |
| Social / content scrapers | 5.9% |
| Archive / research crawlers | 4.9% |
| Monitoring / uptime bots | 0.5% |
AI crawlers appear in robots.txt on 16.3% of all sites — the highest bot-category mention rate. SEO audit tools (13.7%) rank above SEO/search indexing (12.2%). Commercial scrapers reach 7.7%; monitoring bots just 0.5%.
Uniform rules are the most common posture in Colombia
| % of sites | |
|---|---|
| Uniform per-agent rules (no path mixing) | 42.6% |
| Path-level mixed rules for same agent | 32.9% |
| Allow-only (no disallow rules) | 2.4% |
| Mixed AI posture (block some, allow others) | 2.7% |
| Blanket Disallow: / | 2.4% |
42.6% of all sites use uniform per-agent rules. Path-level mixed rules account for 32.9%. Mixed AI posture (2.7%), allow-only (2.4%), and blanket Disallow: / (2.4%) each apply to a small share.
GPTBot is the most restricted agent in Colombia
| Disallowed | Allowed (whitelisted) | |
|---|---|---|
| GPTBot | 11.8% | 2.3% |
| CCBot | 9% | 1.2% |
| ClaudeBot | 8.3% | 1.1% |
| Google-Extended | 8.4% | 1.5% |
| Bytespider | 7.1% | 0.3% |
| meta-externalagent | 3.1% | 0.2% |
| ChatGPT-User | 6% | 2.6% |
| PerplexityBot | 6% | 1.9% |
| Applebot-Extended | 4.8% | 0.4% |
| OAI-SearchBot | 4.8% | 2.3% |
| anthropic-ai | 5.2% | 0.7% |
GPTBot carries a Disallow on 11.8% of all sites. CCBot follows at 9.0%, then Google-Extended at 8.4% and ClaudeBot at 8.3%. ChatGPT-User receives the highest explicit Allow rate at 2.6%.
Six sectors unanimously name at least one bot to restrict
| % of sites | |
|---|---|
| Apparel & Fashion | 100% |
| Beauty & Cosmetics | 100% |
| Computer & Video Games | 100% |
| Design | 100% |
| Entertainment | 100% |
| Retail | 100% |
| Adult | 90% |
| Agriculture | 90% |
| Ceramics & Pottery | 90% |
| Comics & Animation | 90% |
| Consumer Electronics | 90% |
| Furniture | 90% |
| General | 90% |
| Healthcare | 90% |
| Insurance | 90% |
Apparel & Fashion, Beauty & Cosmetics, Computer & Video Games, Design, Entertainment, and Retail each show 100% named-bot Disallow rates. Apparel & Fashion is an unusual entrant at this level. Nine further sectors reach 90%.
Automotive tops explicit bot Allow rules in Colombia
| % of sites | |
|---|---|
| Automotive | 90% |
| Photography | 70% |
| Publishing | 70% |
| Retail | 70% |
| Science | 70% |
| Agriculture | 60% |
| Airlines | 60% |
| Architecture | 60% |
| Beauty & Cosmetics | 60% |
| Ceramics & Pottery | 60% |
| Facilities Services | 60% |
| Farms & Ranches | 60% |
| Graphic Design | 60% |
| Investment | 60% |
| Mental Health | 60% |
Automotive names a bot in an Allow rule on 90.0% of sites. Photography, Publishing, Retail, and Science follow at 70.0%. Agriculture appears in both the block and allow rankings — at 90% Disallow and 60% Allow naming rates.
Industry Patterns
Hospitality is the hardest sector to access programmatically in Colombia
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Hospitality | 90% | 20% | 0% | 50% | 40% | 50% | 60% | 20% | Tier 3 |
| Real Estate | 100% | 20% | 0% | 50% | 50% | 10% | 70% | 30% | Tier 3 |
| Equipment & Supplies | 90% | 30% | 20% | 50% | 20% | 10% | 70% | 10% | Tier 3 |
| Jewellery & Luxury | 100% | 10% | 10% | 40% | 60% | 60% | 70% | 0% | Tier 2 |
| Consumer Electronics | 80% | 20% | 20% | 40% | 20% | 40% | 90% | 20% | Tier 2 |
| Retail | 100% | 10% | 0% | 60% | 20% | 20% | 100% | 40% | Tier 2 |
| Computer Hardware | 100% | 30% | 10% | 30% | 30% | 30% | 80% | 10% | Tier 2 |
| Beauty & Cosmetics | 100% | 50% | 40% | 20% | 30% | 50% | 100% | 30% | Tier 2 |
| Customer Services | 100% | 20% | 30% | 50% | 30% | 20% | 60% | 0% | Tier 2 |
| Human Resources | 100% | 50% | 50% | 40% | 30% | 20% | 70% | 10% | Tier 2 |
| Restaurants | 90% | 40% | 30% | 70% | 40% | 20% | 70% | 20% | Tier 2 |
| Transport & Logistics | 70% | 40% | 10% | 20% | 0% | 20% | 80% | 0% | Tier 2 |
| Apparel & Fashion | 90% | 0% | 20% | 50% | 10% | 40% | 100% | 10% | Tier 2 |
| Furniture | 100% | 50% | 50% | 60% | 20% | 30% | 90% | 10% | Tier 2 |
| Public Safety | 100% | 30% | 30% | 60% | 20% | 40% | 90% | 10% | Tier 2 |
Hospitality leads with a median tier of 3 and a mean of 2.90. Real Estate follows at median 3, mean 2.80. Equipment & Supplies completes the top three at median 3, mean 2.50. Jewellery & Luxury reaches mean 2.70 at median 2.
Food & Beverages and similar sectors are Colombia's most accessible sectors
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Sporting Goods | 80% | 20% | 30% | 30% | 30% | 30% | 70% | 0% | Tier 2 |
| Wholesalers | 80% | 10% | 30% | 40% | 30% | 30% | 70% | 10% | Tier 2 |
| Automotive | 100% | 20% | 0% | 20% | 20% | 30% | 90% | 30% | Tier 2 |
| Design | 100% | 20% | 30% | 40% | 20% | 30% | 100% | 30% | Tier 2 |
| Insurance | 90% | 40% | 30% | 20% | 0% | 0% | 90% | 0% | Tier 2 |
| Mail & Delivery | 70% | 40% | 10% | 10% | 0% | 20% | 80% | 0% | Tier 2 |
| Maritime | 90% | 10% | 0% | 50% | 10% | 30% | 90% | 10% | Tier 2 |
| Wine & Spirits | 100% | 30% | 0% | 30% | 30% | 0% | 70% | 30% | Tier 2 |
| Crafts | 100% | 40% | 40% | 50% | 30% | 10% | 70% | 10% | Tier 2 |
| Import & Export | 100% | 30% | 30% | 50% | 0% | 30% | 80% | 10% | Tier 2 |
| Manufacturing | 80% | 10% | 10% | 30% | 0% | 40% | 70% | 0% | Tier 2 |
| Reference | 80% | 50% | 20% | 40% | 20% | 10% | 60% | 40% | Tier 2 |
| Sports | 100% | 0% | 10% | 40% | 20% | 0% | 80% | 50% | Tier 2 |
| Telecom | 80% | 20% | 10% | 50% | 10% | 20% | 90% | 20% | Tier 2 |
| Food & Beverages | 100% | 50% | 30% | 60% | 30% | 0% | 70% | 40% | Tier 2 |
Food & Beverages reaches a mean tier of 1.85 — the lowest in Colombia and the only sector at that level. Six sectors share the next tier at 1.90: Crafts, Import & Export, Manufacturing, Reference, Sports, and Telecom.