State of Web Access2026

Jordan's barrier profile tracks closely to global norms, but its robots.txt data tells a different story: AI crawlers are the most-cited bot category, named on 16.3% of sites — more than SEO bots, audit tools, or commercial scrapers.

State of Web Access 2026
Jordan · Barrier Profile · 2026

JavaScript is Jordan's most common secondary barrier

JavaScript is Jordan's most common secondary barrier
Value
WAF92.6%
Antibot21.3%
CAPTCHA22.6%
JavaScript40.4%
Rate Limiting13.5%
TLS18.2%

WAF covers 92.6% of Jordan's 1,093 surveyed sites. JavaScript leads secondary barriers at 40.4%, ahead of CAPTCHA at 22.6%, Antibot at 21.3%, TLS at 18.2%, and Rate Limiting at 13.5%.

1,093 sites
State of Web Access 2026
Jordan · Barrier Adoption · 2026

JavaScript tops Jordan's active secondary defences

JavaScript tops Jordan's active secondary defences
Value
WAF92.6%
Antibot21.3%
CAPTCHA22.6%
JavaScript40.4%
Rate Limiting13.5%
TLS18.2%
Has robots.txt79.9%
Blocks AI crawlers14.5%

WAF is present on 92.6% of Jordan's sites. Of the five secondary barriers, JavaScript is the most widely deployed at 40.4%, followed by CAPTCHA at 22.6% and Antibot at 21.3%.

1,093 sites
State of Web Access 2026
Jordan · Barrier Stacking · 2026

Two-barrier stacking is the most common configuration

Two-barrier stacking is the most common configuration
% of sites
0 barriers4.9%
1 barrier30.7%
2 barriers33.5%
3 barriers17.5%
4 barriers8.8%
5 barriers4%
6 barriers0.5%

4.9% of Jordan sites carry no detectable barriers. Two barriers is the modal outcome at 33.5% of sites. Sites with three or more barriers account for 30.8%.

1,093 sites
State of Web Access 2026
Jordan · Recommended Zyte API Tier · 2026

Most Jordan sites are Easy to access

Most Jordan sites are Easy to access
Mean recommended tier
All sites1.7

A browser median of 2 and mean of 1.67 characterise Jordan's access difficulty. Tier 1 covers 48.0% of sites and Tier 2 a further 39.4%, giving 87.4% at Tiers 1–2.

1,093 sites
State of Web Access 2026
Jordan · Zyte API Tier Distribution · 2026

Nearly nine in ten sites are Simple or Easy to access

Nearly nine in ten sites are Simple or Easy to access
% of sites
1 - Simple48%
2 - Easy39.4%
3 - Moderate10.1%
4 - Complex1.8%
5 - Advanced0.6%

Tier 1 accounts for 48.0% of Jordan's sites; Tier 2 adds 39.4%. Tier 3 covers 10.1%, Tier 4 1.8%, and Tier 5 0.6%.

1,093 sites
State of Web Access 2026
Jordan · Bot Category Mentions in <code>robots.txt</code> · 2026 · 1,093 Sites

AI crawlers are the most-cited bot category in robots.txt

AI crawlers are the most-cited bot category in robots.txt
% of sites
AI crawlers16.3%
SEO / search indexing12.8%
SEO audit tools13%
Commercial scrapers8.5%
Social / content scrapers6.5%
Archive / research crawlers4.9%
Monitoring / uptime bots0.5%

AI crawlers are mentioned in 16.3% of Jordan's 1,093 surveyed sites — the most of any bot category. SEO audit tools follow at 13.0%, then SEO / search indexing at 12.8%. Figures include sites without robots.txt.

1,093 sites
State of Web Access 2026
Jordan · <code>robots.txt</code> Rule Posture Types · 2026 · 1,093 Sites

Uniform rules are the most common robots.txt posture

Uniform rules are the most common robots.txt posture
% of sites
Uniform per-agent rules (no path mixing)42.1%
Path-level mixed rules for same agent32.2%
Allow-only (no disallow rules)2.7%
Mixed AI posture (block some, allow others)2.3%
Blanket Disallow: /2.7%

20.1% of Jordan's sites have no robots.txt. Uniform per-agent rules is the most prevalent posture at 42.1% of all sites, followed by path-level mixed rules at 32.2%. Blanket Disallow: / covers 2.7%.

1,093 sites
State of Web Access 2026
Jordan · AI Agent <code>Disallow</code> vs <code>Allow</code> · 2026 · 1,093 Sites Surveyed

GPTBot faces the most Disallow rules

GPTBot faces the most Disallow rules
DisallowedAllowed (whitelisted)
GPTBot11.9%1.9%
CCBot9.2%0.8%
ClaudeBot9.1%0.8%
Google-Extended8.8%1.5%
Bytespider7.6%0.3%
meta-externalagent3.2%
ChatGPT-User6%2.4%
PerplexityBot6%1.8%
Applebot-Extended5.2%0.3%
OAI-SearchBot4.6%1.9%
anthropic-ai5.5%0.8%

Of Jordan's 1,093 sites, GPTBot is Disallowed by 11.9% and explicitly Allowed by 1.9%. ChatGPT-User has the highest explicit Allow rate at 2.4%. All values include sites without robots.txt.

1,093 sites surveyed · 873 with robots.txt
State of Web Access 2026
Jordan · Named-Bot <code>Disallow</code> Rate by Industry · Top 15 · 2026

Seven sectors name bots on every site

Seven sectors name bots on every site
% of sites
Computer & Video Games100%
Consumer Electronics100%
Design100%
Entertainment100%
Retail100%
Visual Art100%
Warehousing100%
Adult90%
Automotive90%
Banking90%
Civil Engineering90%
Comics & Animation90%
Facilities Services90%
General90%
Healthcare90%

Computer & Video Games, Consumer Electronics, Design, Entertainment, Retail, Visual Art, and Warehousing all show 100% named-bot Disallow rates — every site in each sector names at least one bot to restrict in robots.txt. Eight further sectors stand at 90%.

Most categories n=10 — each site = 10 percentage points · 1,093 Jordan sites
State of Web Access 2026
Jordan · Explicit Bot <code>Allow</code> / Whitelist Rate by Industry · Top 15 · 2026

Retail leads explicit bot Allow rules

Retail leads explicit bot Allow rules
% of sites
Retail80%
Airlines70%
Architecture70%
Automotive70%
Photography70%
Publishing70%
Science70%
Travel & Tourism70%
Civil Engineering60%
Graphic Design60%
Investment60%
Non-Profit60%
Plastics & Polymers60%
Public Relations60%
Real Estate60%

Retail tops Jordan's explicit bot Allow rankings at 80% of sites in that sector naming at least one bot in an Allow rule. Airlines, Architecture, Automotive, Photography, Publishing, Science, and Travel & Tourism each follow at 70%.

Most categories n=10 — each site = 10 percentage points · 1,093 Jordan sites
State of Web Access 2026
Jordan · Scraping Difficulty by Industry · Top 15 by Mean Tier · 2026

Hospitality and Jewellery & Luxury are the hardest sectors to access programmatically

Hospitality and Jewellery & Luxury are the hardest sectors to access programmatically
WAFAntibotCAPTCHAJavaScriptRate LimitTLSrobots.txtBlocks AITier
Hospitality90%20%0%60%30%40%60%10%Tier 3
Jewellery & Luxury100%10%10%30%40%60%60%10%Tier 3
Real Estate100%10%10%40%40%10%60%20%Tier 3
Beauty & Cosmetics90%30%20%50%40%10%70%10%Tier 3
Equipment & Supplies90%30%20%50%20%10%70%20%Tier 3
Retail100%10%0%70%10%10%100%50%Tier 2
Human Resources100%70%60%40%50%30%80%10%Tier 2
Computer Hardware90%20%0%30%20%30%80%10%Tier 2
Customer Services100%10%20%50%30%20%60%10%Tier 2
Recruitment & Staffing90%40%60%10%0%20%80%30%Tier 2
Sporting Goods80%10%10%20%30%20%50%0%Tier 2
Apparel & Fashion100%20%30%70%30%30%80%10%Tier 2
Consumer Electronics80%10%20%50%10%40%100%20%Tier 2
Maritime90%20%10%50%20%30%80%10%Tier 2
Food & Beverages100%50%40%80%40%0%70%50%Tier 2

Hospitality and Jewellery & Luxury share the highest mean recommended tier at 2.70 among Jordan's industries, each with a median of 3. Real Estate follows with a mean of 2.60.

Top 15 industries by mean Zyte browser tier · 1,093 sites
State of Web Access 2026
Jordan · Scraping Difficulty by Industry · Bottom 15 by Mean Tier · 2026

Wholesalers is the most accessible sector

Wholesalers is the most accessible sector
WAFAntibotCAPTCHAJavaScriptRate LimitTLSrobots.txtBlocks AITier
Automotive100%10%0%10%20%30%90%20%Tier 2
Design100%20%30%40%20%30%100%30%Tier 2
Mail & Delivery80%40%10%10%0%20%90%0%Tier 2
Medical Devices90%10%10%40%20%10%80%20%Tier 2
Reference80%60%30%40%20%10%50%30%Tier 2
Restaurants80%40%30%60%30%10%50%20%Tier 2
Adult100%40%30%80%10%20%90%10%Tier 2
Crafts100%30%30%70%20%10%60%20%Tier 2
Furniture100%30%20%30%10%30%50%20%Tier 2
Machinery80%10%10%40%20%20%70%0%Tier 2
Manufacturing80%10%10%30%0%40%70%0%Tier 2
Public Safety100%30%50%50%10%30%90%10%Tier 2
Transport & Logistics80%50%10%20%0%20%90%0%Tier 2
Visual Art100%30%20%30%0%20%100%20%Tier 2
Wholesalers80%10%30%50%20%30%70%10%Tier 2

Wholesalers has the lowest mean recommended tier in Jordan's bottom-15 ranking at 1.90, tied with eight other sectors.

Bottom 15 industries by mean Zyte browser tier · 1,093 sites