Overview
Finnish sites carry barriers close to global norms
| Value | |
|---|---|
| WAF | 93.5% |
| Antibot | 19.9% |
| CAPTCHA | 22.4% |
| JavaScript | 43.7% |
| Rate Limiting | 12% |
| TLS | 17.1% |
WAF adoption is 93.5%, slightly above the global 93.1%. JavaScript rendering applies to 43.7% of sites versus a global 41.3%. Antibot (19.9%), CAPTCHA (22.4%), rate limiting (12.0%), and TLS (17.1%) are all near global benchmarks.
Barrier Landscape
JavaScript tops Finland's active secondary defences
| Value | |
|---|---|
| WAF | 93.5% |
| Antibot | 19.9% |
| CAPTCHA | 22.4% |
| JavaScript | 43.7% |
| Rate Limiting | 12% |
| TLS | 17.1% |
| Has robots.txt | 81% |
| Blocks AI crawlers | 14.3% |
WAF adoption stands at 93.5%. Among secondary barriers, JavaScript leads at 43.7%, above the global 41.3%. CAPTCHA is the second-highest secondary barrier at 22.4%.
Most Finnish sites carry at least two barriers
| % of sites | |
|---|---|
| 0 barriers | 4.7% |
| 1 barrier | 29.3% |
| 2 barriers | 34.8% |
| 3 barriers | 19% |
| 4 barriers | 8.5% |
| 5 barriers | 3.3% |
| 6 barriers | 0.4% |
4.7% of Finnish sites carry no barriers. The modal count is two barriers, at 34.8% of sites. Sites with three or more barriers account for 31.2% combined.
Most Finnish sites are Easy to access
| Mean recommended tier | |
|---|---|
| All sites | 1.6 |
The median recommended retrieval tier is 2, meaning fewer than half of sites are accessible via plain HTTP. The mean tier is 1.65.
Nearly nine in ten Finnish sites are Simple or Easy to access
| % of sites | |
|---|---|
| 1 - Simple | 49.9% |
| 2 - Easy | 38.2% |
| 3 - Moderate | 9.8% |
| 4 - Complex | 1.5% |
| 5 - Advanced | 0.6% |
Tier 1 accounts for 49.9% of sites and Tier 2 for 38.2%, giving a combined Tier 1–2 rate of 88.1%. Tier 3 covers 9.8%, Tier 4 1.5%, and Tier 5 0.6%.
robots.txt
AI crawlers top Finland's robots.txt bot categories
| % of sites | |
|---|---|
| AI crawlers | 15.5% |
| SEO / search indexing | 12.1% |
| SEO audit tools | 13.7% |
| Commercial scrapers | 8% |
| Social / content scrapers | 5.8% |
| Archive / research crawlers | 4.1% |
| Monitoring / uptime bots | 0.3% |
Across all 1,103 Finnish sites, 15.5% name at least one AI crawler. SEO audit tools are named by 13.7% and SEO / search indexing bots by 12.1%.
Uniform rules are Finland's most common robots.txt posture
| % of sites | |
|---|---|
| Uniform per-agent rules (no path mixing) | 42.1% |
| Path-level mixed rules for same agent | 32.9% |
| Allow-only (no disallow rules) | 3% |
| Mixed AI posture (block some, allow others) | 2% |
| Blanket Disallow: / | 2.8% |
19.0% of Finnish sites have no robots.txt. Among the rest, uniform per-agent rules account for 42.1%, path-level mixed rules for 32.9%, blanket Disallow: / for 2.8%, and mixed-AI posture for 2.0%.
GPTBot faces the most Disallow rules in Finland's robots.txt
| Disallowed | Allowed (whitelisted) | |
|---|---|---|
| GPTBot | 12.1% | 1.8% |
| CCBot | 8.9% | 0.9% |
| ClaudeBot | 8.3% | 0.9% |
| Google-Extended | 8.5% | 1.2% |
| Bytespider | 7.3% | 0.4% |
| meta-externalagent | 3.2% | — |
| ChatGPT-User | 6.1% | 2.1% |
| PerplexityBot | 5.7% | 1.5% |
| Applebot-Extended | 5.2% | 0.5% |
| OAI-SearchBot | 4.4% | 1.6% |
| anthropic-ai | 5.3% | 0.6% |
GPTBot appears in a Disallow rule on 12.1% of all Finnish sites. ChatGPT-User is the most explicitly allowed, appearing in an Allow rule on 2.1% of all sites.
Five Finnish sectors all name at least one bot to restrict
| % of sites | |
|---|---|
| Computer & Video Games | 100% |
| Design | 100% |
| Entertainment | 100% |
| Retail | 100% |
| Sporting Goods | 100% |
| Adult | 90% |
| Apparel & Fashion | 90% |
| Beauty & Cosmetics | 90% |
| Comics & Animation | 90% |
| Crafts | 90% |
| Customer Services | 90% |
| Food & Beverages | 90% |
| General | 90% |
| Mass Media | 90% |
| Medical Devices | 90% |
Computer & Video Games, Design, Entertainment, Retail, and Sporting Goods all reach 100% — every site in each sector names at least one bot to restrict in a Disallow rule.
Finland's Sporting Goods sector leads in explicitly allowing crawlers
| % of sites | |
|---|---|
| Sporting Goods | 80% |
| Airlines | 70% |
| Civil Engineering | 70% |
| Photography | 70% |
| Public Relations | 70% |
| Publishing | 70% |
| Retail | 70% |
| Science | 70% |
| Warehousing | 70% |
| Automotive | 60% |
| Crafts | 60% |
| Graphic Design | 60% |
| Investment | 60% |
| Nanotechnology | 60% |
| Non-Profit | 60% |
Sporting Goods is the top-ranked sector, with 80.0% of sites naming at least one bot to allow in an Allow rule. Airlines and Civil Engineering follow at 70.0%.
Industry Patterns
Jewellery & Luxury is Finland's hardest sector to access programmatically
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Jewellery & Luxury | 100% | 30% | 20% | 30% | 40% | 50% | 70% | 0% | Tier 3 |
| Hospitality | 100% | 20% | 0% | 50% | 30% | 50% | 70% | 10% | Tier 3 |
| Real Estate | 90% | 10% | 20% | 40% | 30% | 10% | 60% | 20% | Tier 3 |
| Computer Hardware | 100% | 20% | 0% | 30% | 30% | 20% | 80% | 10% | Tier 2 |
| Equipment & Supplies | 90% | 40% | 20% | 60% | 40% | 0% | 60% | 10% | Tier 2 |
| Beauty & Cosmetics | 90% | 30% | 20% | 50% | 30% | 20% | 90% | 20% | Tier 2 |
| Human Resources | 100% | 70% | 60% | 40% | 40% | 20% | 70% | 10% | Tier 2 |
| Apparel & Fashion | 90% | 10% | 20% | 50% | 20% | 30% | 90% | 10% | Tier 2 |
| Consumer Electronics | 90% | 10% | 20% | 60% | 10% | 30% | 80% | 20% | Tier 2 |
| Medical Devices | 100% | 0% | 0% | 50% | 20% | 0% | 100% | 10% | Tier 2 |
| Retail | 100% | 0% | 0% | 60% | 20% | 20% | 100% | 50% | Tier 2 |
| Recruitment & Staffing | 100% | 50% | 50% | 50% | 0% | 20% | 80% | 20% | Tier 2 |
| Design | 100% | 20% | 30% | 40% | 20% | 30% | 100% | 30% | Tier 2 |
| Import & Export | 100% | 30% | 30% | 50% | 0% | 30% | 80% | 10% | Tier 2 |
| Mail & Delivery | 70% | 30% | 10% | 10% | 0% | 20% | 80% | 0% | Tier 2 |
Jewellery & Luxury records the highest mean recommended tier at 2.80. Hospitality and Real Estate follow at 2.60, with Computer Hardware at 2.45.
Airlines, Banking, and Civil Engineering are Finland's most accessible sectors
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Oil & Gas | 90% | 20% | 30% | 70% | 20% | 30% | 80% | 10% | Tier 2 |
| Reference | 90% | 60% | 30% | 40% | 20% | 10% | 60% | 30% | Tier 2 |
| Textiles & Nonwovens | 100% | 0% | 30% | 40% | 0% | 10% | 100% | 10% | Tier 2 |
| Transport & Logistics | 70% | 40% | 10% | 20% | 0% | 30% | 80% | 0% | Tier 2 |
| Adult | 100% | 40% | 30% | 80% | 10% | 20% | 90% | 10% | Tier 2 |
| Automotive | 100% | 20% | 0% | 40% | 30% | 30% | 90% | 10% | Tier 2 |
| Crafts | 100% | 20% | 20% | 40% | 10% | 10% | 90% | 30% | Tier 2 |
| Manufacturing | 80% | 10% | 10% | 30% | 0% | 40% | 70% | 0% | Tier 2 |
| Plastics & Polymers | 90% | 20% | 30% | 40% | 0% | 20% | 90% | 0% | Tier 2 |
| Restaurants | 100% | 30% | 30% | 80% | 40% | 10% | 80% | 20% | Tier 2 |
| Telecom | 90% | 10% | 10% | 70% | 0% | 20% | 90% | 20% | Tier 2 |
| Visual Art | 100% | 30% | 10% | 30% | 0% | 20% | 100% | 20% | Tier 2 |
| Airlines | 100% | 20% | 10% | 70% | 20% | 20% | 80% | 30% | Tier 2 |
| Banking | 90% | 30% | 10% | 50% | 10% | 20% | 70% | 0% | Tier 2 |
| Civil Engineering | 100% | 20% | 30% | 50% | 10% | 20% | 100% | 10% | Tier 2 |
Airlines, Banking, and Civil Engineering all record a mean recommended tier of 1.80 — the lowest in the bottom-industries list for Finland.