Overview
JavaScript is Kazakhstan's most common secondary barrier
| Value | |
|---|---|
| WAF | 93.1% |
| Antibot | 20.2% |
| CAPTCHA | 23.7% |
| JavaScript | 42.1% |
| Rate Limiting | 13.6% |
| TLS | 17.4% |
WAF reaches 93.1% of Kazakhstan sites. JavaScript rendering is the foremost secondary barrier at 42.1%, ahead of CAPTCHA at 23.7%. Antibot, TLS, and Rate Limiting trail further behind.
Barrier Landscape
CAPTCHA is the second most common secondary barrier after JavaScript
| Value | |
|---|---|
| WAF | 93.1% |
| Antibot | 20.2% |
| CAPTCHA | 23.7% |
| JavaScript | 42.1% |
| Rate Limiting | 13.6% |
| TLS | 17.4% |
| Has robots.txt | 82.1% |
| Blocks AI crawlers | 13.8% |
WAF is present on 93.1% of Kazakhstan domains. JavaScript rendering leads secondary barriers at 42.1%. CAPTCHA follows at 23.7%, with Antibot at 20.2%, TLS at 17.4%, and Rate Limiting at 13.6%.
Two-barrier sites are Kazakhstan's most common configuration
| % of sites | |
|---|---|
| 0 barriers | 4.4% |
| 1 barrier | 29.3% |
| 2 barriers | 35.9% |
| 3 barriers | 17.2% |
| 4 barriers | 9% |
| 5 barriers | 3.9% |
| 6 barriers | 0.4% |
Sites with exactly two barriers represent the largest group at 35.9%. One-barrier sites follow at 29.3%. Just 4.4% of Kazakhstan domains have no barriers at all; 30.5% deploy three or more.
Most Kazakhstan sites are Easy to access
| Mean recommended tier | |
|---|---|
| All sites | 1.7 |
Across 1,106 Kazakhstan domains, the recommended Zyte browser tier has a median of 2 and a mean of 1.68, placing most sites within the two simplest retrieval tiers.
Most Kazakhstan sites are Simple to access
| % of sites | |
|---|---|
| 1 - Simple | 49.5% |
| 2 - Easy | 37.3% |
| 3 - Moderate | 9.9% |
| 4 - Complex | 2.2% |
| 5 - Advanced | 1.2% |
Tier 1 covers 49.5% of Kazakhstan sites; Tier 2 adds 37.3%, bringing 86.8% of domains within the two simplest tiers. Tier 3 accounts for 9.9%; Tiers 4 and 5 together total 3.4%.
robots.txt
AI crawlers lead all bot categories in robots.txt mentions
| % of sites | |
|---|---|
| AI crawlers | 15.6% |
| SEO / search indexing | 13.7% |
| SEO audit tools | 13.3% |
| Commercial scrapers | 8% |
| Social / content scrapers | 6.3% |
| Archive / research crawlers | 4.8% |
| Monitoring / uptime bots | 0.5% |
AI crawlers are named in 15.6% of all Kazakhstan sites. SEO/search indexing follows at 13.7% and SEO audit tools at 13.3%. Monitoring bots appear in just 0.5% of sites.
Uniform rules are Kazakhstan's most common robots.txt posture
| % of sites | |
|---|---|
| Uniform per-agent rules (no path mixing) | 41.3% |
| Path-level mixed rules for same agent | 35.6% |
| Allow-only (no disallow rules) | 1.8% |
| Mixed AI posture (block some, allow others) | 2.9% |
| Blanket Disallow: / | 3% |
Uniform per-agent rules cover 41.3% of all Kazakhstan sites. Path-level mixed rules account for 35.6%. The 17.9% of sites without any robots.txt have no crawl instructions in place.
GPTBot faces the most Disallow rules in Kazakhstan's robots.txt
| Disallowed | Allowed (whitelisted) | |
|---|---|---|
| GPTBot | 11.3% | 2.5% |
| CCBot | 8.6% | 1.1% |
| ClaudeBot | 8% | 1.2% |
| Google-Extended | 8% | 1.4% |
| Bytespider | 6.9% | 0.5% |
| meta-externalagent | 2.8% | 0.1% |
| ChatGPT-User | 5.7% | 2.7% |
| PerplexityBot | 5.4% | 1.9% |
| Applebot-Extended | 5.1% | 0.5% |
| OAI-SearchBot | 3.7% | 2.4% |
| anthropic-ai | 5.2% | 1% |
GPTBot is named in a Disallow rule on 11.3% of all Kazakhstan sites, the highest of any AI agent. ChatGPT-User receives the most explicit Allow coverage at 2.7%.
Five sectors have every site naming at least one bot to restrict
| % of sites | |
|---|---|
| Civil Engineering | 100% |
| Design | 100% |
| Entertainment | 100% |
| Medical Devices | 100% |
| Veterinary | 100% |
| Adult | 90% |
| Agriculture | 90% |
| Apparel & Fashion | 90% |
| Automotive | 90% |
| Beauty & Cosmetics | 90% |
| Computer & Video Games | 90% |
| Foreign Language | 90% |
| General | 90% |
| Insurance | 90% |
| Machinery | 90% |
Civil Engineering, Design, Entertainment, Medical Devices, and Veterinary each show 100% of their robots.txt sites naming at least one bot to restrict. Ten further sectors sit at 90%, including Adult and Agriculture.
Farms & Ranches leads explicit bot Allow rules
| % of sites | |
|---|---|
| Farms & Ranches | 80% |
| Airlines | 70% |
| Architecture | 70% |
| Automotive | 70% |
| Banking | 70% |
| Non-Profit | 70% |
| Pharmaceuticals | 70% |
| Photography | 70% |
| Publishing | 70% |
| Science | 70% |
| Travel & Tourism | 70% |
| Construction | 60% |
| Graphic Design | 60% |
| Import & Export | 60% |
| Investment | 60% |
Farms & Ranches tops the allow list with 80% of its robots.txt sites naming at least one bot in an Allow directive. Airlines, Architecture, Automotive, Banking, and seven other sectors follow at 70%.
Industry Patterns
Jewellery & Luxury and Real Estate share the highest mean scraping difficulty
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Jewellery & Luxury | 100% | 20% | 20% | 30% | 50% | 60% | 60% | 0% | Tier 3 |
| Real Estate | 100% | 10% | 10% | 40% | 40% | 20% | 60% | 30% | Tier 3 |
| Hospitality | 90% | 20% | 0% | 60% | 30% | 40% | 60% | 10% | Tier 3 |
| Computer Hardware | 90% | 10% | 0% | 20% | 20% | 30% | 80% | 0% | Tier 3 |
| Retail | 100% | 0% | 10% | 70% | 20% | 10% | 90% | 40% | Tier 2 |
| Beauty & Cosmetics | 80% | 30% | 20% | 40% | 30% | 40% | 90% | 20% | Tier 2 |
| Insurance | 90% | 30% | 20% | 40% | 10% | 30% | 90% | 0% | Tier 2 |
| Automotive | 100% | 20% | 0% | 30% | 40% | 20% | 90% | 10% | Tier 2 |
| Equipment & Supplies | 90% | 30% | 30% | 40% | 20% | 0% | 80% | 10% | Tier 2 |
| Human Resources | 100% | 70% | 60% | 50% | 40% | 20% | 80% | 10% | Tier 2 |
| Recruitment & Staffing | 100% | 40% | 70% | 20% | 10% | 20% | 90% | 20% | Tier 2 |
| Restaurants | 90% | 40% | 40% | 40% | 30% | 30% | 60% | 10% | Tier 2 |
| Apparel & Fashion | 90% | 20% | 30% | 60% | 20% | 40% | 90% | 10% | Tier 2 |
| Consumer Electronics | 80% | 10% | 0% | 30% | 10% | 30% | 80% | 10% | Tier 2 |
| Medical Devices | 90% | 30% | 20% | 30% | 20% | 20% | 100% | 20% | Tier 2 |
Jewellery & Luxury and Real Estate jointly lead with a mean recommended tier of 2.80. Hospitality follows at 2.70 and Computer Hardware at 2.65. Human Resources is notable for 70% antibot adoption at tier_mean 2.20.
Four sectors share the most accessible floor
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Public Safety | 100% | 20% | 50% | 60% | 10% | 30% | 90% | 20% | Tier 2 |
| Airlines | 100% | 10% | 10% | 60% | 20% | 20% | 90% | 30% | Tier 2 |
| Customer Services | 100% | 40% | 30% | 50% | 30% | 30% | 70% | 10% | Tier 2 |
| Design | 100% | 20% | 30% | 40% | 20% | 30% | 100% | 30% | Tier 2 |
| Import & Export | 100% | 30% | 30% | 40% | 0% | 30% | 80% | 10% | Tier 2 |
| Mail & Delivery | 70% | 30% | 10% | 10% | 0% | 20% | 80% | 0% | Tier 2 |
| Maritime | 80% | 20% | 0% | 30% | 10% | 30% | 70% | 10% | Tier 2 |
| Sporting Goods | 90% | 10% | 20% | 30% | 30% | 20% | 70% | 0% | Tier 2 |
| Transport & Logistics | 70% | 40% | 10% | 20% | 0% | 20% | 80% | 0% | Tier 2 |
| Wholesalers | 90% | 20% | 40% | 50% | 30% | 30% | 80% | 10% | Tier 2 |
| Food & Beverages | 100% | 50% | 40% | 60% | 30% | 10% | 80% | 40% | Tier 2 |
| Adult | 100% | 40% | 30% | 80% | 10% | 20% | 90% | 10% | Tier 2 |
| Machinery | 80% | 10% | 10% | 40% | 10% | 20% | 90% | 0% | Tier 2 |
| Reference | 90% | 60% | 30% | 50% | 30% | 10% | 60% | 30% | Tier 2 |
| Social & Charitable | 100% | 30% | 40% | 50% | 0% | 10% | 90% | 10% | Tier 2 |
Adult, Machinery, Reference, and Social & Charitable organisations each record a mean tier of 1.90, the lowest in the bottom-industries group. Food & Beverages sits just above at 1.95.