Overview
JavaScript leads secondary barriers well ahead of the rest
| Value | |
|---|---|
| WAF | 93.1% |
| Antibot | 21.1% |
| CAPTCHA | 22% |
| JavaScript | 42.3% |
| Rate Limiting | 13.9% |
| TLS | 17.6% |
WAF reaches 93.1% of Lebanon sites. Among secondary barriers, JavaScript rendering leads at 42.3%, followed by CAPTCHA at 22.0% and Antibot at 21.1%. TLS sits at 17.6% and Rate Limiting at 13.9%.
Barrier Landscape
JavaScript tops Lebanon's active secondary defences
| Value | |
|---|---|
| WAF | 93.1% |
| Antibot | 21.1% |
| CAPTCHA | 22% |
| JavaScript | 42.3% |
| Rate Limiting | 13.9% |
| TLS | 17.6% |
| Has robots.txt | 80.3% |
| Blocks AI crawlers | 13.4% |
WAF is present on 93.1% of Lebanon domains. JavaScript rendering is the leading secondary barrier at 42.3%, ahead of CAPTCHA (22.0%), Antibot (21.1%), TLS (17.6%), and Rate Limiting (13.9%).
Two-barrier sites are Lebanon's most common configuration
| % of sites | |
|---|---|
| 0 barriers | 4.7% |
| 1 barrier | 29.5% |
| 2 barriers | 35.3% |
| 3 barriers | 17.3% |
| 4 barriers | 8.2% |
| 5 barriers | 4.4% |
| 6 barriers | 0.5% |
Sites with exactly two barriers form the largest group at 35.3%. One-barrier sites follow at 29.5%. Just 4.7% of Lebanon domains have no barriers. 30.4% carry three or more.
Most Lebanon sites are Easy to access
| Mean recommended tier | |
|---|---|
| All sites | 1.7 |
Across 1,080 Lebanon domains, the recommended Zyte browser tier has a median of 2 and a mean of 1.67, placing the majority of sites within the two simplest retrieval tiers.
Most Lebanon sites are Simple to access
| % of sites | |
|---|---|
| 1 - Simple | 49.3% |
| 2 - Easy | 37.9% |
| 3 - Moderate | 10% |
| 4 - Complex | 2.2% |
| 5 - Advanced | 0.6% |
Tier 1 covers 49.3% of Lebanon sites; Tier 2 adds 37.9%, bringing 87.2% of domains within the two simplest retrieval modes. Tier 3 accounts for 10.0%; Tiers 4 and 5 together reach 2.8%.
robots.txt
AI crawlers top Lebanon's robots.txt bot categories
| % of sites | |
|---|---|
| AI crawlers | 15.3% |
| SEO / search indexing | 14.4% |
| SEO audit tools | 13.8% |
| Commercial scrapers | 7.9% |
| Social / content scrapers | 6.3% |
| Archive / research crawlers | 5.1% |
| Monitoring / uptime bots | 0.6% |
AI crawlers are named in 15.3% of all Lebanon sites, with SEO/search indexing close behind at 14.4%. SEO audit tools follow at 13.8%. Monitoring bots appear in just 0.6% of sites.
Uniform rules are Lebanon's most common robots.txt posture
| % of sites | |
|---|---|
| Uniform per-agent rules (no path mixing) | 41.2% |
| Path-level mixed rules for same agent | 34.5% |
| Allow-only (no disallow rules) | 1.9% |
| Mixed AI posture (block some, allow others) | 2.6% |
| Blanket Disallow: / | 2.4% |
Uniform per-agent rules apply to 41.2% of all Lebanon sites. Path-level mixed rules cover 34.5%. The 19.7% of sites without a robots.txt file have no crawl instructions at all.
ChatGPT-User receives the highest explicit Allow rate among AI agents
| Disallowed | Allowed (whitelisted) | |
|---|---|---|
| GPTBot | 10.8% | 2.4% |
| CCBot | 8.2% | 1% |
| ClaudeBot | 7.9% | 1.2% |
| Google-Extended | 7.4% | 1.5% |
| Bytespider | 6.3% | 0.2% |
| meta-externalagent | 2.3% | 0.1% |
| ChatGPT-User | 5.9% | 2.9% |
| PerplexityBot | 5.6% | 1.9% |
| Applebot-Extended | 4.5% | 0.4% |
| OAI-SearchBot | 4.1% | 2.2% |
| anthropic-ai | 4.9% | 0.8% |
GPTBot is blocked on 10.8% of all Lebanon sites, the highest Disallow rate of any AI agent. ChatGPT-User receives the most explicit Allow directives at 2.9%, ahead of OAI-SearchBot at 2.2%.
Multiple Lebanon sectors all name at least one bot to restrict
| % of sites | |
|---|---|
| Computer & Video Games | 100% |
| Design | 100% |
| Entertainment | 100% |
| Telecom | 100% |
| Adult | 90% |
| Agriculture | 90% |
| Apparel & Fashion | 90% |
| Automotive | 90% |
| Civil Engineering | 90% |
| Consumer Electronics | 90% |
| Food & Beverages | 90% |
| General | 90% |
| Mass Media | 90% |
| Newspapers | 90% |
| Online Services | 90% |
Computer & Video Games, Design, Entertainment, and Telecom each show 100% of their robots.txt sites naming at least one bot to restrict. Adult, Agriculture, Apparel & Fashion, and eight other sectors sit at 90%.
Science leads explicit bot Allow rules
| % of sites | |
|---|---|
| Science | 80% |
| Photography | 70% |
| Publishing | 70% |
| Retail | 70% |
| Sports | 70% |
| Telecom | 70% |
| Airlines | 60% |
| Architecture | 60% |
| Automotive | 60% |
| Investment | 60% |
| Market Research | 60% |
| Mental Health | 60% |
| Non-Profit | 60% |
| Pharmaceuticals | 60% |
| Real Estate | 60% |
Science tops the allow list with 80% of its robots.txt sites naming at least one bot in an Allow directive. Photography, Publishing, Retail, Sports, and Telecom follow at 70%.
Industry Patterns
Computer Hardware is the hardest sector to access programmatically
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Computer Hardware | 90% | 10% | 10% | 10% | 20% | 30% | 80% | 0% | Tier 3 |
| Jewellery & Luxury | 100% | 20% | 10% | 30% | 30% | 50% | 60% | 0% | Tier 3 |
| Hospitality | 90% | 20% | 0% | 60% | 30% | 40% | 60% | 20% | Tier 3 |
| Real Estate | 100% | 10% | 10% | 40% | 40% | 20% | 60% | 30% | Tier 3 |
| Equipment & Supplies | 90% | 30% | 10% | 50% | 20% | 10% | 70% | 20% | Tier 3 |
| Furniture | 90% | 20% | 10% | 30% | 20% | 30% | 70% | 10% | Tier 3 |
| Apparel & Fashion | 90% | 10% | 20% | 60% | 10% | 30% | 90% | 10% | Tier 2 |
| Automotive | 100% | 10% | 0% | 30% | 30% | 20% | 90% | 10% | Tier 2 |
| Retail | 100% | 10% | 0% | 70% | 20% | 10% | 90% | 40% | Tier 2 |
| Restaurants | 90% | 40% | 30% | 40% | 40% | 40% | 70% | 10% | Tier 2 |
| Human Resources | 100% | 70% | 60% | 60% | 40% | 20% | 70% | 10% | Tier 2 |
| Food & Beverages | 100% | 60% | 50% | 50% | 30% | 0% | 90% | 40% | Tier 2 |
| Beauty & Cosmetics | 100% | 30% | 20% | 50% | 40% | 20% | 80% | 20% | Tier 2 |
| Consumer Electronics | 80% | 30% | 20% | 30% | 20% | 50% | 90% | 10% | Tier 2 |
| Customer Services | 100% | 0% | 20% | 40% | 20% | 10% | 70% | 10% | Tier 2 |
Computer Hardware leads Lebanon's top industries with a mean recommended tier of 2.85. Jewellery & Luxury follows at 2.80. Six industries hold a tier_median of 3, the highest in this cluster.
Computers & Electronics and Crafts share the most accessible floor
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Construction | 80% | 10% | 20% | 40% | 40% | 0% | 50% | 0% | Tier 2 |
| Maritime | 90% | 10% | 0% | 40% | 10% | 30% | 90% | 10% | Tier 2 |
| Recruitment & Staffing | 100% | 50% | 60% | 40% | 10% | 20% | 70% | 20% | Tier 2 |
| Sporting Goods | 80% | 30% | 40% | 20% | 40% | 30% | 70% | 0% | Tier 2 |
| Wine & Spirits | 100% | 20% | 20% | 30% | 10% | 0% | 70% | 20% | Tier 2 |
| Design | 100% | 20% | 30% | 40% | 20% | 30% | 100% | 30% | Tier 2 |
| Mail & Delivery | 80% | 40% | 10% | 10% | 0% | 20% | 90% | 0% | Tier 2 |
| Transport & Logistics | 80% | 50% | 10% | 20% | 0% | 30% | 90% | 0% | Tier 2 |
| Banking | 100% | 20% | 10% | 30% | 10% | 0% | 80% | 0% | Tier 2 |
| Ceramics & Pottery | 100% | 20% | 40% | 70% | 20% | 10% | 80% | 0% | Tier 2 |
| Renewable Energy | 90% | 10% | 10% | 60% | 10% | 40% | 90% | 0% | Tier 2 |
| Textiles & Nonwovens | 100% | 0% | 10% | 30% | 10% | 30% | 90% | 10% | Tier 2 |
| Wholesalers | 80% | 20% | 30% | 40% | 30% | 20% | 60% | 10% | Tier 2 |
| Computers & Electronics | 90% | 10% | 30% | 30% | 0% | 20% | 70% | 0% | Tier 2 |
| Crafts | 100% | 40% | 30% | 60% | 30% | 10% | 70% | 30% | Tier 2 |
Computers & Electronics and Crafts each record a mean recommended tier of 1.80, the lowest in the bottom-industries group. Banking, Ceramics & Pottery, Renewable Energy, Textiles, and Wholesalers sit at 1.90.