Overview
Italian sites run TLS and CAPTCHA slightly above global rates
| Value | |
|---|---|
| WAF | 93.1% |
| Antibot | 20.1% |
| CAPTCHA | 24% |
| JavaScript | 41.5% |
| Rate Limiting | 12.2% |
| TLS | 18.8% |
WAF (93.1%) matches the global benchmark exactly. TLS (18.8%) is 1.1 points above global — Italy's largest individual deviation. CAPTCHA (24.0%) is 0.9 points above its benchmark. All others within 0.7 points.
Barrier Landscape
Italian sites deploy more CAPTCHA than Antibot as a secondary barrier
| Value | |
|---|---|
| WAF | 93.1% |
| Antibot | 20.1% |
| CAPTCHA | 24% |
| JavaScript | 41.5% |
| Rate Limiting | 12.2% |
| TLS | 18.8% |
| Has robots.txt | 80.6% |
| Blocks AI crawlers | 13.2% |
WAF (93.1%) matches the global average exactly. Among secondary barriers: JavaScript (41.5%), CAPTCHA (24.0%), Antibot (20.1%), TLS (18.8%), Rate Limiting (12.2%). The 3.9-point gap between CAPTCHA and Antibot is wider than the global 2.9-point gap between those two barriers.
Most Italian sites carry two barriers
| % of sites | |
|---|---|
| 0 barriers | 4.9% |
| 1 barrier | 29.1% |
| 2 barriers | 35.1% |
| 3 barriers | 18.6% |
| 4 barriers | 7.5% |
| 5 barriers | 4.5% |
| 6 barriers | 0.4% |
Only 4.9% of Italian sites present no detectable barriers. The modal outcome is two barriers (35.1%), most commonly WAF plus JavaScript. Sites at three or more barriers account for 31%.
More than half of Italian sites are Simple to access
| Mean recommended tier | |
|---|---|
| All sites | 1.6 |
A median of 1 and mean of 1.64 confirm that more than half of Italian sites are accessible via plain HTTP. The 11.8% at Tier 3 or above pulls the mean upward but does not shift the median.
Most Italian sites are Simple or Easy to access
| % of sites | |
|---|---|
| 1 - Simple | 51% |
| 2 - Easy | 36.8% |
| 3 - Moderate | 9.5% |
| 4 - Complex | 2.3% |
| 5 - Advanced | 0.5% |
Tier 1 (51.0%) and Tier 2 (36.8%) together cover 87.8% of the sample. Tier 3 stands at 9.5%, Tier 4 at 2.3%, and Tier 5 at 0.5%.
robots.txt
AI crawlers top Italy's robots.txt bot categories
| % of sites | |
|---|---|
| AI crawlers | 14.9% |
| SEO / search indexing | 12.6% |
| SEO audit tools | 14% |
| Commercial scrapers | 7.3% |
| Social / content scrapers | 5.9% |
| Archive / research crawlers | 4.8% |
| Monitoring / uptime bots | 0.5% |
14.9% of all 1,111 Italian sites name at least one AI crawler. SEO audit tools (14.0%) and SEO/search indexers (12.6%) follow closely. Commercial scrapers reach 7.3%. Monitoring bots (0.5%) are effectively absent.
Uniform rules are Italy's most common robots.txt posture
| % of sites | |
|---|---|
| Uniform per-agent rules (no path mixing) | 43.1% |
| Path-level mixed rules for same agent | 32.4% |
| Allow-only (no disallow rules) | 2.3% |
| Mixed AI posture (block some, allow others) | 2.3% |
| Blanket Disallow: / | 2.6% |
19.4% of sites publish no robots.txt. Uniform posture (43.1%) leads, ahead of path-mixed (32.4%). Blanket Disallow: / stands at 2.6% and Mixed-AI at 2.3%.
GPTBot faces the most Disallow rules in Italy's robots.txt
| Disallowed | Allowed (whitelisted) | |
|---|---|---|
| GPTBot | 10.8% | 2% |
| CCBot | 8.2% | 0.8% |
| ClaudeBot | 7.9% | 1% |
| Google-Extended | 8.3% | 1.1% |
| Bytespider | 7.5% | 0.3% |
| meta-externalagent | 3.3% | 0.1% |
| ChatGPT-User | 5.4% | 2.5% |
| PerplexityBot | 5.7% | 2% |
| Applebot-Extended | 4.9% | 0.4% |
| OAI-SearchBot | 3.8% | 1.8% |
| anthropic-ai | 4.4% | 0.6% |
Values are percentages of all 1,111 Italian sites. GPTBot (10.8%) leads all agents on the block side. Google-Extended (8.3%) ranks second, ahead of CCBot (8.2%) and ClaudeBot (7.9%). ChatGPT-User attracts the highest allow rate at 2.5%.
Every Italian Automotive site names at least one bot to restrict
| % of sites | |
|---|---|
| Automotive | 100% |
| Computer & Video Games | 100% |
| Design | 100% |
| Plastics & Polymers | 100% |
| Retail | 100% |
| Visual Art | 100% |
| Adult | 90% |
| Apparel & Fashion | 90% |
| Beauty & Cosmetics | 90% |
| Ceramics & Pottery | 90% |
| Comics & Animation | 90% |
| Consumer Electronics | 90% |
| Entertainment | 90% |
| Food & Beverages | 90% |
| Foreign Language | 90% |
Automotive reaches 100% — every sampled Italian Automotive site names at least one crawler in a Disallow rule. Ceramics & Pottery (90%) and Foreign Language (90%) are Italy-specific appearances in the top 15.
Italy's Healthcare, Automotive and Publishing sites lead in allowing crawlers
| % of sites | |
|---|---|
| Automotive | 80% |
| Healthcare | 80% |
| Publishing | 80% |
| Airlines | 70% |
| Crafts | 70% |
| Photography | 70% |
| Real Estate | 70% |
| Retail | 70% |
| Science | 70% |
| Architecture | 60% |
| Beauty & Cosmetics | 60% |
| Food & Beverages | 60% |
| Graphic Design | 60% |
| Mental Health | 60% |
| Non-Profit | 60% |
Healthcare (80%), Automotive (80%), and Publishing (80%) all lead. Automotive also appears in the top-15 Disallow chart — some sites in the sector simultaneously name bots to restrict while others explicitly allow them.
Industry Patterns
Jewellery & Luxury is Italy's hardest sector to access programmatically
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Jewellery & Luxury | 100% | 20% | 20% | 30% | 40% | 60% | 60% | 0% | Tier 3 |
| Hospitality | 90% | 20% | 0% | 50% | 30% | 50% | 70% | 20% | Tier 3 |
| Real Estate | 100% | 20% | 20% | 50% | 30% | 20% | 70% | 30% | Tier 2 |
| Computer Hardware | 90% | 20% | 10% | 20% | 20% | 30% | 80% | 10% | Tier 2 |
| Consumer Electronics | 90% | 10% | 20% | 40% | 20% | 40% | 90% | 20% | Tier 2 |
| Human Resources | 100% | 80% | 60% | 50% | 40% | 20% | 70% | 10% | Tier 2 |
| Apparel & Fashion | 90% | 20% | 20% | 60% | 20% | 30% | 90% | 10% | Tier 2 |
| Furniture | 100% | 30% | 20% | 50% | 30% | 40% | 80% | 10% | Tier 2 |
| Retail | 100% | 0% | 0% | 50% | 20% | 20% | 100% | 40% | Tier 2 |
| Automotive | 100% | 0% | 10% | 40% | 20% | 20% | 100% | 20% | Tier 2 |
| Beauty & Cosmetics | 100% | 40% | 40% | 30% | 20% | 40% | 100% | 20% | Tier 2 |
| Customer Services | 100% | 10% | 30% | 50% | 30% | 10% | 60% | 0% | Tier 2 |
| Public Safety | 100% | 30% | 40% | 60% | 20% | 40% | 90% | 10% | Tier 2 |
| Recruitment & Staffing | 100% | 50% | 60% | 30% | 0% | 10% | 70% | 20% | Tier 2 |
| Design | 100% | 20% | 30% | 40% | 20% | 30% | 100% | 30% | Tier 2 |
Jewellery & Luxury (2.70) leads, ahead of Hospitality and Real Estate which share 2.50. Computer Hardware, Consumer Electronics, and Human Resources all follow at 2.40. The bottom of the top 15 reaches down to Design at 2.00.
Advertising & Marketing is Italy's most accessible sector programmatically
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Mail & Delivery | 70% | 40% | 10% | 10% | 0% | 20% | 80% | 0% | Tier 2 |
| Manufacturing | 80% | 10% | 20% | 40% | 0% | 40% | 80% | 0% | Tier 2 |
| Maritime | 90% | 10% | 10% | 50% | 10% | 30% | 90% | 10% | Tier 2 |
| Medical Devices | 100% | 0% | 10% | 60% | 10% | 0% | 100% | 10% | Tier 2 |
| Renewable Energy | 100% | 20% | 30% | 60% | 20% | 20% | 90% | 10% | Tier 2 |
| Textiles & Nonwovens | 100% | 0% | 40% | 40% | 10% | 30% | 90% | 0% | Tier 2 |
| Transport & Logistics | 70% | 50% | 10% | 20% | 0% | 20% | 80% | 0% | Tier 2 |
| Education | 100% | 20% | 10% | 20% | 10% | 10% | 70% | 10% | Tier 2 |
| Food & Beverages | 100% | 50% | 30% | 60% | 10% | 20% | 90% | 30% | Tier 2 |
| Import & Export | 100% | 30% | 40% | 50% | 0% | 30% | 80% | 10% | Tier 2 |
| Machinery | 90% | 0% | 10% | 60% | 0% | 0% | 90% | 10% | Tier 2 |
| Sporting Goods | 80% | 20% | 30% | 20% | 40% | 40% | 70% | 0% | Tier 2 |
| Visual Art | 100% | 30% | 20% | 30% | 0% | 20% | 100% | 20% | Tier 2 |
| Wholesalers | 70% | 10% | 30% | 40% | 10% | 30% | 70% | 0% | Tier 2 |
| Advertising & Mktg | 100% | 20% | 40% | 50% | 0% | 30% | 90% | 10% | Tier 2 |
Advertising & Marketing (1.80) is the floor. Above it, seven sectors cluster at a mean tier of 1.90. Maritime appears at 2.00 at the top of this accessible group.