Overview
JavaScript and Antibot are Norway's leading secondary barriers
| Value | |
|---|---|
| WAF | 93.3% |
| Antibot | 22% |
| CAPTCHA | 22.8% |
| JavaScript | 44.7% |
| Rate Limiting | 13.2% |
| TLS | 18.4% |
WAF adoption is 93.3%, near the global 93.1%. JavaScript (44.7%) is 3.4 points above the global 41.3% and Antibot (22.0%) exceeds the global 20.2%. TLS (18.4%) is slightly above the global 17.7%.
Barrier Landscape
JavaScript and Antibot lead Norway's active secondary barriers
| Value | |
|---|---|
| WAF | 93.3% |
| Antibot | 22% |
| CAPTCHA | 22.8% |
| JavaScript | 44.7% |
| Rate Limiting | 13.2% |
| TLS | 18.4% |
| Has robots.txt | 79.7% |
| Blocks AI crawlers | 13.9% |
WAF is present on 93.3% of Norway sites. JavaScript (44.7%) ranks highest among secondary barriers, followed by Antibot at 22.0% and CAPTCHA at 22.8%. Rate Limiting (13.2%) is near the global average of 12.9%.
Most Norway sites carry two barriers
| % of sites | |
|---|---|
| 0 barriers | 4.3% |
| 1 barrier | 27.4% |
| 2 barriers | 35.9% |
| 3 barriers | 18.8% |
| 4 barriers | 9% |
| 5 barriers | 4.2% |
| 6 barriers | 0.3% |
Two barriers is the modal count at 35.9% of sites. One barrier accounts for 27.4%; zero-barrier sites are 4.3%. Sites carrying three or more barriers total 32.3%.
Most Norway sites need Easy-tier access to retrieve content
| Mean recommended tier | |
|---|---|
| All sites | 1.7 |
The median recommended tier is 2, meaning fewer than half of sites are fully accessible via plain HTTP. The mean tier is 1.66 across 1,105 sites.
Nearly nine in ten Norway sites are Simple or Easy to access
| % of sites | |
|---|---|
| 1 - Simple | 49.2% |
| 2 - Easy | 38.4% |
| 3 - Moderate | 9.9% |
| 4 - Complex | 1.8% |
| 5 - Advanced | 0.7% |
Tier 1 accounts for 49.2% and Tier 2 for 38.4%, combining to 87.6%. Tier 3 is 9.9%, Tier 4 is 1.8%, and Tier 5 is 0.7%.
robots.txt
AI crawlers top Norway's robots.txt bot categories
| % of sites | |
|---|---|
| AI crawlers | 15.6% |
| SEO / search indexing | 11.7% |
| SEO audit tools | 13.3% |
| Commercial scrapers | 8% |
| Social / content scrapers | 6.1% |
| Archive / research crawlers | 4.8% |
| Monitoring / uptime bots | 0.5% |
Across all 1,105 Norway sites, 15.6% name at least one AI crawler, 13.3% name an SEO audit tool, and 11.7% name an SEO/search indexing bot. Commercial scrapers appear on 8.0% of sites.
Uniform rules are Norway's most common robots.txt posture
| % of sites | |
|---|---|
| Uniform per-agent rules (no path mixing) | 41.8% |
| Path-level mixed rules for same agent | 33.2% |
| Allow-only (no disallow rules) | 1.9% |
| Mixed AI posture (block some, allow others) | 2.4% |
| Blanket Disallow: / | 2.6% |
Uniform per-agent rules cover 41.8% of all sites; path-level mixed rules 33.2%. 20.3% of sites have no robots.txt. Blanket Disallow: / applies to 2.6% and mixed-AI posture to 2.4%.
GPTBot faces the most Disallow rules in Norway's robots.txt
| Disallowed | Allowed (whitelisted) | |
|---|---|---|
| GPTBot | 11.5% | 2.4% |
| CCBot | 8.6% | 0.7% |
| ClaudeBot | 8% | 0.9% |
| Google-Extended | 8% | 1.2% |
| Bytespider | 7% | 0.4% |
| meta-externalagent | 2.8% | 0.1% |
| ChatGPT-User | 6.1% | 2.9% |
| PerplexityBot | 5.7% | 1.9% |
| Applebot-Extended | 5% | 0.4% |
| OAI-SearchBot | 4.1% | 2.2% |
| anthropic-ai | 5.1% | 0.8% |
GPTBot is named in a Disallow rule on 11.5% of all Norway sites, the highest block rate of any AI agent. ChatGPT-User is the most-allowed agent at 2.9% of all sites.
Six Norway sectors all name at least one bot to restrict
| % of sites | |
|---|---|
| Computer & Video Games | 100% |
| Design | 100% |
| Entertainment | 100% |
| Retail | 100% |
| Sporting Goods | 100% |
| Visual Art | 100% |
| Adult | 90% |
| Automotive | 90% |
| Beauty & Cosmetics | 90% |
| Comics & Animation | 90% |
| Construction | 90% |
| Food & Beverages | 90% |
| General | 90% |
| Machinery | 90% |
| Mass Media | 90% |
Computer & Video Games, Design, Entertainment, Retail, Sporting Goods, and Visual Art each reach 100%: every site in those sectors names at least one bot to restrict in a Disallow rule. Nine further sectors reach 90%.
Norway's Automotive sites lead in explicitly allowing crawlers
| % of sites | |
|---|---|
| Automotive | 80% |
| Airlines | 70% |
| Non-Profit | 70% |
| Oil & Gas | 70% |
| Photography | 70% |
| Publishing | 70% |
| Retail | 70% |
| Science | 70% |
| Sporting Goods | 70% |
| Construction | 60% |
| Food & Beverages | 60% |
| Graphic Design | 60% |
| Investment | 60% |
| Public Relations | 60% |
| Public Utility | 60% |
Automotive tops the allowlist chart at 80%, meaning 80% of sites name at least one bot to allow in an Allow rule. Eight further sectors — including Airlines, Non-Profit, Publishing, and Science — reach 70%.
Industry Patterns
Jewellery & Luxury is Norway's hardest sector to access programmatically
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Jewellery & Luxury | 100% | 20% | 10% | 30% | 30% | 50% | 60% | 0% | Tier 3 |
| Equipment & Supplies | 90% | 40% | 10% | 60% | 30% | 0% | 70% | 10% | Tier 3 |
| Hospitality | 90% | 20% | 0% | 50% | 30% | 50% | 70% | 20% | Tier 3 |
| Real Estate | 100% | 30% | 30% | 60% | 50% | 10% | 60% | 30% | Tier 2 |
| Retail | 100% | 0% | 0% | 60% | 30% | 20% | 100% | 40% | Tier 2 |
| Computer Hardware | 100% | 20% | 0% | 30% | 30% | 20% | 80% | 10% | Tier 2 |
| Medical Devices | 100% | 20% | 0% | 50% | 30% | 0% | 90% | 0% | Tier 2 |
| Human Resources | 100% | 70% | 60% | 60% | 40% | 20% | 70% | 10% | Tier 2 |
| Apparel & Fashion | 90% | 10% | 20% | 40% | 30% | 50% | 80% | 10% | Tier 2 |
| Beauty & Cosmetics | 80% | 40% | 20% | 40% | 30% | 30% | 90% | 20% | Tier 2 |
| Automotive | 100% | 20% | 0% | 30% | 30% | 40% | 90% | 10% | Tier 2 |
| Consumer Electronics | 90% | 10% | 10% | 50% | 20% | 30% | 70% | 10% | Tier 2 |
| Customer Services | 100% | 20% | 20% | 60% | 30% | 20% | 60% | 0% | Tier 2 |
| Sporting Goods | 90% | 20% | 10% | 40% | 30% | 30% | 100% | 0% | Tier 2 |
| Design | 100% | 20% | 30% | 40% | 20% | 30% | 100% | 30% | Tier 2 |
Jewellery & Luxury has the highest mean tier at 2.80, followed by Equipment & Supplies at 2.60 and Hospitality at 2.50. Real Estate and Retail are also at 2.50, with Computer Hardware at 2.45.
Nine Norway sectors share the most accessible tier floor
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Import & Export | 100% | 30% | 30% | 50% | 0% | 30% | 80% | 10% | Tier 2 |
| Mail & Delivery | 70% | 40% | 10% | 10% | 0% | 20% | 80% | 0% | Tier 2 |
| Maritime | 90% | 20% | 10% | 60% | 10% | 20% | 80% | 10% | Tier 2 |
| Transport & Logistics | 70% | 50% | 10% | 20% | 0% | 20% | 80% | 0% | Tier 2 |
| Food & Beverages | 100% | 40% | 30% | 60% | 20% | 0% | 90% | 40% | Tier 2 |
| Pharmaceuticals | 100% | 30% | 40% | 70% | 50% | 20% | 50% | 0% | Tier 2 |
| Adult | 100% | 40% | 30% | 80% | 10% | 20% | 90% | 10% | Tier 2 |
| Crafts | 100% | 30% | 30% | 60% | 20% | 10% | 70% | 20% | Tier 2 |
| Education | 100% | 20% | 10% | 30% | 10% | 10% | 70% | 10% | Tier 2 |
| Furniture | 100% | 40% | 40% | 60% | 10% | 40% | 60% | 10% | Tier 2 |
| Manufacturing | 80% | 10% | 10% | 30% | 0% | 40% | 70% | 0% | Tier 2 |
| Recruitment & Staffing | 100% | 50% | 50% | 50% | 0% | 20% | 80% | 30% | Tier 2 |
| Reference | 90% | 50% | 20% | 30% | 10% | 10% | 70% | 40% | Tier 2 |
| Restaurants | 90% | 40% | 20% | 70% | 40% | 20% | 80% | 10% | Tier 2 |
| Textiles & Nonwovens | 100% | 0% | 20% | 20% | 10% | 20% | 90% | 10% | Tier 2 |
Adult, Crafts, Education, Furniture, Manufacturing, Recruitment & Staffing, Reference, Restaurants, and Textiles & Nonwovens all record a mean tier of 1.90, the lowest in the bottom-sector group.