Overview
JavaScript is Indonesia's most common secondary barrier
| Value | |
|---|---|
| WAF | 91.9% |
| Antibot | 21.6% |
| CAPTCHA | 23.1% |
| JavaScript | 41.3% |
| Rate Limiting | 13.6% |
| TLS | 18.9% |
WAF sits at 91.9%. TLS at 18.9% and Antibot at 21.6% are both elevated. CAPTCHA at 23.1% and JavaScript at 41.3% are the leading secondary barriers.
Barrier Landscape
JavaScript tops Indonesia's active secondary defences
| Value | |
|---|---|
| WAF | 91.9% |
| Antibot | 21.6% |
| CAPTCHA | 23.1% |
| JavaScript | 41.3% |
| Rate Limiting | 13.6% |
| TLS | 18.9% |
| Has robots.txt | 79.7% |
| Blocks AI crawlers | 14.2% |
WAF leads at 91.9%. JavaScript is the highest secondary barrier at 41.3%, followed closely by CAPTCHA at 23.1%. Antibot reaches 21.6%, TLS 18.9%, and Rate Limiting trails at 13.6%.
Two-barrier sites are Indonesia's most common configuration
| % of sites | |
|---|---|
| 0 barriers | 5.3% |
| 1 barrier | 29.4% |
| 2 barriers | 33.9% |
| 3 barriers | 17.6% |
| 4 barriers | 9.3% |
| 5 barriers | 4.1% |
| 6 barriers | 0.5% |
The most common configuration is two barriers at 33.9% of sites. Single-barrier sites account for 29.4%. Nearly a third of sites (31.5%) deploy three or more barriers. Barrier-free sites are 5.3%.
Most Indonesia sites are Easy to access
| Mean recommended tier | |
|---|---|
| All sites | 1.7 |
The mean recommended browser tier of 1.69 reflects a slight lean toward Tier 1, while the median of 2 confirms that under half of sites are resolved at the simplest level. Both figures sit close to 1.7.
Nearly nine in ten sites are Simple or Easy to access
| % of sites | |
|---|---|
| 1 - Simple | 47.5% |
| 2 - Easy | 39.7% |
| 3 - Moderate | 10.1% |
| 4 - Complex | 1.7% |
| 5 - Advanced | 1% |
Tier 1 covers 47.5% of sites and Tier 2 a further 39.7%, totalling 87.2%. Tier 3 represents 10.1%. Tiers 4 and 5 remain marginal at 1.7% and 1.0% respectively.
robots.txt
AI crawlers lead all bot categories named in robots.txt
| % of sites | |
|---|---|
| AI crawlers | 16% |
| SEO / search indexing | 12.1% |
| SEO audit tools | 13.3% |
| Commercial scrapers | 8.7% |
| Social / content scrapers | 6.8% |
| Archive / research crawlers | 4.5% |
| Monitoring / uptime bots | 0.5% |
AI crawlers are named in robots.txt by 16.0% of all 1,110 Indonesia sites — the top category. SEO audit tools follow at 13.3% and SEO/search indexing bots at 12.1%.
Uniform rules are Indonesia's most common robots.txt posture
| % of sites | |
|---|---|
| Uniform per-agent rules (no path mixing) | 42.4% |
| Path-level mixed rules for same agent | 32.1% |
| Allow-only (no disallow rules) | 2.3% |
| Mixed AI posture (block some, allow others) | 2.5% |
| Blanket Disallow: / | 2.7% |
Uniform per-agent rules are present on 42.4% of all sites. Path-level mixed rules cover 32.1%. The 20.3% of sites with no robots.txt at all outnumber every explicitly managed posture type.
GPTBot faces the most Disallow rules in Indonesia's robots.txt
| Disallowed | Allowed (whitelisted) | |
|---|---|---|
| GPTBot | 11.5% | 2.3% |
| CCBot | 8.6% | 1% |
| ClaudeBot | 8.5% | 1.4% |
| Google-Extended | 8.5% | 1.6% |
| Bytespider | 7.1% | 0.5% |
| meta-externalagent | 3.2% | 0.3% |
| ChatGPT-User | 6.5% | 3.1% |
| PerplexityBot | 6.2% | 2.4% |
| Applebot-Extended | 4.8% | 0.3% |
| OAI-SearchBot | 4.2% | 2.2% |
| anthropic-ai | 5.6% | 1% |
11.5% of all Indonesia sites carry a Disallow for GPTBot. ChatGPT-User receives the most explicit Allow rules at 3.1% — the highest Allow rate for any single agent in this market.
Four Indonesia sectors all name at least one bot to restrict
| % of sites | |
|---|---|
| Computer & Video Games | 100% |
| Design | 100% |
| Entertainment | 100% |
| Retail | 100% |
| Adult | 90% |
| Beauty & Cosmetics | 90% |
| Civil Engineering | 90% |
| Comics & Animation | 90% |
| Consumer Electronics | 90% |
| General | 90% |
| Mass Media | 90% |
| Nanotechnology | 90% |
| Newspapers | 90% |
| Online Services | 90% |
| Publishing | 90% |
Computer & Video Games, Design, Entertainment, and Retail each have every measured site naming at least one bot to restrict. A further eleven sectors — including Adult, Beauty & Cosmetics, and Newspapers — sit at 90%.
Airlines and Travel & Tourism lead explicit bot Allow rules
| % of sites | |
|---|---|
| Airlines | 80% |
| Travel & Tourism | 80% |
| Investment | 70% |
| Photography | 70% |
| Publishing | 70% |
| Real Estate | 70% |
| Retail | 70% |
| Architecture | 60% |
| Automotive | 60% |
| Construction | 60% |
| Graphic Design | 60% |
| Market Research | 60% |
| Science | 60% |
| Software & Dev | 60% |
| Sporting Goods | 60% |
Airlines and Travel & Tourism are the only sectors where 80% of sites name at least one bot in an explicit Allow rule. Investment, Photography, Publishing, Real Estate, and Retail follow at 70%.
Industry Patterns
Hospitality and Jewellery & Luxury are the hardest sectors to access programmatically
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Hospitality | 90% | 30% | 0% | 60% | 30% | 40% | 60% | 10% | Tier 3 |
| Jewellery & Luxury | 100% | 30% | 20% | 30% | 50% | 50% | 60% | 0% | Tier 3 |
| Human Resources | 100% | 70% | 70% | 50% | 40% | 20% | 70% | 10% | Tier 3 |
| Real Estate | 90% | 20% | 20% | 50% | 40% | 20% | 70% | 30% | Tier 2 |
| Equipment & Supplies | 90% | 50% | 30% | 50% | 40% | 0% | 70% | 10% | Tier 2 |
| Retail | 100% | 10% | 0% | 70% | 10% | 10% | 100% | 50% | Tier 2 |
| Apparel & Fashion | 100% | 20% | 30% | 70% | 20% | 20% | 80% | 10% | Tier 2 |
| Beauty & Cosmetics | 100% | 30% | 20% | 40% | 30% | 10% | 90% | 10% | Tier 2 |
| Computer Hardware | 90% | 20% | 0% | 30% | 20% | 30% | 80% | 10% | Tier 2 |
| Warehousing | 100% | 50% | 40% | 70% | 50% | 10% | 60% | 10% | Tier 2 |
| Crafts | 100% | 30% | 30% | 50% | 20% | 10% | 80% | 20% | Tier 2 |
| Customer Services | 100% | 10% | 20% | 40% | 20% | 10% | 70% | 10% | Tier 2 |
| Maritime | 90% | 10% | 0% | 40% | 10% | 30% | 90% | 10% | Tier 2 |
| Medical Devices | 90% | 0% | 0% | 60% | 10% | 0% | 90% | 10% | Tier 2 |
| Public Safety | 100% | 30% | 40% | 60% | 20% | 40% | 90% | 10% | Tier 2 |
Hospitality and Jewellery & Luxury both post a mean recommended tier of 2.80, leading the difficulty table. Human Resources follows at 2.60. The top three sectors all carry a tier median of 3.
Travel & Tourism, Furniture, and Wholesalers share the most accessible floor
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Restaurants | 90% | 40% | 20% | 70% | 40% | 10% | 60% | 20% | Tier 2 |
| Transport & Logistics | 70% | 40% | 10% | 10% | 0% | 30% | 80% | 0% | Tier 2 |
| Wine & Spirits | 100% | 40% | 30% | 50% | 30% | 0% | 80% | 30% | Tier 2 |
| Airlines | 80% | 10% | 10% | 50% | 20% | 20% | 90% | 40% | Tier 2 |
| Automotive | 100% | 10% | 10% | 40% | 40% | 20% | 80% | 20% | Tier 2 |
| Consumer Electronics | 80% | 10% | 10% | 40% | 10% | 30% | 90% | 10% | Tier 2 |
| Design | 100% | 20% | 30% | 40% | 20% | 30% | 100% | 30% | Tier 2 |
| Mail & Delivery | 70% | 40% | 10% | 10% | 0% | 20% | 80% | 0% | Tier 2 |
| Recruitment & Staffing | 100% | 50% | 60% | 30% | 10% | 30% | 60% | 20% | Tier 2 |
| Sporting Goods | 80% | 10% | 20% | 30% | 30% | 40% | 60% | 0% | Tier 2 |
| Food & Beverages | 100% | 40% | 20% | 70% | 40% | 10% | 80% | 30% | Tier 2 |
| Education | 100% | 20% | 20% | 30% | 10% | 10% | 80% | 10% | Tier 2 |
| Furniture | 100% | 40% | 20% | 60% | 10% | 50% | 80% | 10% | Tier 2 |
| Travel & Tourism | 100% | 30% | 10% | 70% | 20% | 10% | 80% | 40% | Tier 2 |
| Wholesalers | 80% | 10% | 20% | 50% | 20% | 30% | 70% | 10% | Tier 2 |
Four sectors cluster at a mean recommended tier of 1.90 — the floor for this sample. Most sectors in this group carry a tier median of 2, indicating Tier 1 accessibility is not universal.