Overview
JavaScript is Azerbaijan's most common secondary barrier
| Value | |
|---|---|
| WAF | 92.8% |
| Antibot | 20% |
| CAPTCHA | 23% |
| JavaScript | 41.9% |
| Rate Limiting | 12.7% |
| TLS | 17.3% |
WAF covers 92.8% of 1,084 surveyed sites. JavaScript leads secondary barriers at 41.9%. CAPTCHA (23.0%) ranks second among secondary barriers, running 3 percentage points ahead of Antibot (20.0%).
Barrier Landscape
JavaScript tops Azerbaijan's active secondary defences
| Value | |
|---|---|
| WAF | 92.8% |
| Antibot | 20% |
| CAPTCHA | 23% |
| JavaScript | 41.9% |
| Rate Limiting | 12.7% |
| TLS | 17.3% |
| Has robots.txt | 80.9% |
| Blocks AI crawlers | 13% |
WAF leads at 92.8% across 1,084 surveyed sites. JavaScript (41.9%) is the dominant secondary barrier. CAPTCHA (23.0%) edges Antibot (20.0%) for second place among non-WAF barriers. Rate Limiting (12.7%) is the least-deployed.
Two-barrier sites are Azerbaijan's most common configuration
| % of sites | |
|---|---|
| 0 barriers | 4.6% |
| 1 barrier | 30.4% |
| 2 barriers | 34.7% |
| 3 barriers | 17.6% |
| 4 barriers | 8.9% |
| 5 barriers | 3.6% |
| 6 barriers | 0.3% |
4.6% of sites present no detectable barriers. Two-barrier sites are the modal configuration at 34.7%. Sites deploying three or more barriers account for 30.4% of the surveyed set.
Most Azerbaijan sites are Simple to access
| Mean recommended tier | |
|---|---|
| All sites | 1.7 |
Mean recommended tier is 1.67, median is 2. Tier 1 (Simple) covers 49.0% of sites — one percentage point below a majority. The remaining 51.0% require at least Easy-level browser-based retrieval.
Nearly nine in ten sites are Simple or Easy to access
| % of sites | |
|---|---|
| 1 - Simple | 49% |
| 2 - Easy | 39.4% |
| 3 - Moderate | 8.3% |
| 4 - Complex | 2.2% |
| 5 - Advanced | 1.1% |
Tier 1 (Simple) covers 49.0% of sites; Tier 2 (Easy) adds 39.4%, for a combined 88.4%. Tier 3 (Moderate) accounts for 8.3%, Tier 4 for 2.2%, and Tier 5 for 1.1%.
robots.txt
AI crawlers top Azerbaijan's robots.txt bot categories
| % of sites | |
|---|---|
| AI crawlers | 14.7% |
| SEO / search indexing | 13% |
| SEO audit tools | 12.6% |
| Commercial scrapers | 8.2% |
| Social / content scrapers | 6.1% |
| Archive / research crawlers | 4.4% |
| Monitoring / uptime bots | 0.6% |
AI crawlers appear in robots.txt at 14.7% of all 1,084 surveyed sites. SEO / search indexing (13.0%) ranks second, just ahead of SEO audit tools (12.6%) — a reversed order from the other two categories in the secondary tier.
Uniform rules are Azerbaijan's most common robots.txt posture
| % of sites | |
|---|---|
| Uniform per-agent rules (no path mixing) | 41% |
| Path-level mixed rules for same agent | 34.6% |
| Allow-only (no disallow rules) | 2.5% |
| Mixed AI posture (block some, allow others) | 2.6% |
| Blanket Disallow: / | 2.7% |
19.1% of sites have no robots.txt. Uniform per-agent rules is the most common posture at 41.0% of all sites. Path-level mixed rules apply to 34.6%. Blanket Disallow: / covers 2.7%.
GPTBot faces the most Disallow rules in Azerbaijan's robots.txt
| Disallowed | Allowed (whitelisted) | |
|---|---|---|
| GPTBot | 10.3% | 2.1% |
| CCBot | 8.1% | 0.9% |
| ClaudeBot | 7.6% | 1.1% |
| Google-Extended | 7.5% | 1.4% |
| Bytespider | 6.8% | 0.4% |
| meta-externalagent | 2.3% | 0.1% |
| ChatGPT-User | 5.4% | 2.7% |
| PerplexityBot | 5.2% | 1.8% |
| Applebot-Extended | 4.5% | 0.5% |
| OAI-SearchBot | 3.8% | 2.2% |
| anthropic-ai | 4.7% | 0.8% |
GPTBot is named in a Disallow rule by 10.3% of all surveyed sites — the highest of any AI agent. ChatGPT-User holds the highest explicit Allow rate at 2.7%, followed by OAI-SearchBot at 2.2%.
Six Azerbaijan sectors all name at least one bot to restrict
| % of sites | |
|---|---|
| Agriculture | 100% |
| Civil Engineering | 100% |
| Design | 100% |
| Entertainment | 100% |
| Facilities Services | 100% |
| Printing | 100% |
| Accounting & Auditing | 90% |
| Adult | 90% |
| Apparel & Fashion | 90% |
| Automotive | 90% |
| Computer & Video Games | 90% |
| Furniture | 90% |
| General | 90% |
| Mass Media | 90% |
| Medical Devices | 90% |
Agriculture, Civil Engineering, Design, Entertainment, Facilities Services, and Printing each show a 100% named-bot Disallow rate — every site names at least one bot to restrict in robots.txt. Nine additional sectors sit at 90%.
Nanotechnology leads explicit bot Allow rules
| % of sites | |
|---|---|
| Nanotechnology | 85.7% |
| Automotive | 80% |
| Airlines | 70% |
| Photography | 70% |
| Publishing | 70% |
| Retail | 70% |
| Textiles & Nonwovens | 70% |
| Travel & Tourism | 70% |
| Apparel & Fashion | 60% |
| Architecture | 60% |
| Biotech | 60% |
| Comics & Animation | 60% |
| Construction | 60% |
| Customer Services | 60% |
| Furniture | 60% |
Nanotechnology has the highest explicit bot Allow rate at 85.7% — above the 80% threshold reached by Automotive in second place. Airlines, Photography, Publishing, Retail, Textiles & Nonwovens, and Travel & Tourism follow at 70%.
Industry Patterns
Jewellery & Luxury is the hardest sector at Moderate-plus mean difficulty
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Jewellery & Luxury | 100% | 20% | 20% | 20% | 50% | 60% | 60% | 10% | Tier 3 |
| Hospitality | 90% | 30% | 0% | 60% | 30% | 40% | 60% | 10% | Tier 3 |
| Computer Hardware | 90% | 10% | 0% | 20% | 20% | 20% | 70% | 0% | Tier 3 |
| Real Estate | 100% | 10% | 10% | 50% | 50% | 20% | 60% | 30% | Tier 3 |
| Equipment & Supplies | 90% | 30% | 10% | 60% | 40% | 10% | 70% | 20% | Tier 3 |
| Apparel & Fashion | 90% | 10% | 20% | 50% | 20% | 40% | 90% | 10% | Tier 2 |
| Consumer Electronics | 70% | 30% | 20% | 40% | 20% | 40% | 80% | 10% | Tier 2 |
| Retail | 100% | 10% | 0% | 70% | 20% | 10% | 90% | 40% | Tier 2 |
| Furniture | 100% | 50% | 20% | 60% | 20% | 20% | 90% | 10% | Tier 2 |
| Human Resources | 100% | 80% | 60% | 50% | 40% | 20% | 70% | 10% | Tier 2 |
| Automotive | 100% | 10% | 0% | 50% | 40% | 30% | 90% | 20% | Tier 2 |
| Beauty & Cosmetics | 80% | 30% | 30% | 50% | 30% | 20% | 80% | 10% | Tier 2 |
| Recruitment & Staffing | 100% | 40% | 60% | 20% | 0% | 10% | 80% | 20% | Tier 2 |
| Maritime | 80% | 20% | 0% | 40% | 10% | 30% | 80% | 10% | Tier 2 |
| Medical Devices | 90% | 0% | 0% | 50% | 10% | 10% | 90% | 10% | Tier 2 |
Jewellery & Luxury averages a mean recommended tier of 3.10 — the highest in the surveyed set — with a median of 3. Hospitality follows at 2.80 and Computer Hardware at 2.75. Industries ranked by mean recommended browser tier.
Advertising & Marketing is the most accessible sector
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Restaurants | 90% | 40% | 40% | 40% | 20% | 20% | 70% | 20% | Tier 2 |
| Customer Services | 100% | 10% | 40% | 60% | 20% | 20% | 70% | 10% | Tier 2 |
| Design | 100% | 20% | 30% | 40% | 20% | 30% | 100% | 30% | Tier 2 |
| Mail & Delivery | 80% | 40% | 10% | 10% | 0% | 20% | 90% | 0% | Tier 2 |
| Renewable Energy | 70% | 0% | 20% | 50% | 10% | 20% | 100% | 0% | Tier 2 |
| Transport & Logistics | 80% | 50% | 10% | 20% | 0% | 20% | 90% | 0% | Tier 2 |
| Food & Beverages | 100% | 30% | 30% | 70% | 20% | 0% | 80% | 40% | Tier 2 |
| Adult | 100% | 40% | 30% | 80% | 10% | 20% | 90% | 10% | Tier 2 |
| Events | 100% | 0% | 0% | 90% | 30% | 0% | 70% | 0% | Tier 2 |
| Manufacturing | 80% | 20% | 20% | 40% | 0% | 40% | 80% | 10% | Tier 2 |
| Oil & Gas | 70% | 0% | 10% | 30% | 0% | 10% | 90% | 10% | Tier 2 |
| Reference | 80% | 60% | 30% | 30% | 20% | 10% | 50% | 20% | Tier 2 |
| Visual Art | 100% | 20% | 30% | 50% | 0% | 0% | 100% | 30% | Tier 2 |
| Wholesalers | 70% | 10% | 20% | 40% | 20% | 30% | 70% | 10% | Tier 2 |
| Advertising & Mktg | 100% | 20% | 40% | 50% | 0% | 30% | 90% | 10% | Tier 2 |
Advertising & Marketing averages the lowest mean recommended tier at 1.80. Seven sectors cluster just above at a mean tier of 1.90. Industries are ranked by mean recommended browser-based retrieval tier.