State of Web Access2026

AI crawlers are the most-cited bot category in Brunei's robots.txt files — yet only 13.0% of sites actually name GPTBot in a Disallow rule. The policy signal is there; the enforcement is selective.

State of Web Access 2026
Brunei · Barrier Profile · 2026

JavaScript leads the secondary barrier mix in Brunei

JavaScript leads the secondary barrier mix in Brunei
Value
WAF93.1%
Antibot20.7%
CAPTCHA24.1%
JavaScript39.5%
Rate Limiting12.2%
TLS18.9%

WAF coverage sits at 93.1%. Among secondary barriers, JavaScript (39.5%) leads by a clear margin. CAPTCHA (24.1%) and Antibot (20.7%) follow, while Rate Limiting is the lightest layer at 12.2%.

999 sites
State of Web Access 2026
Brunei · Barrier Adoption · 2026

CAPTCHA is the leading secondary barrier

CAPTCHA is the leading secondary barrier
Value
WAF93.1%
Antibot20.7%
CAPTCHA24.1%
JavaScript39.5%
Rate Limiting12.2%
TLS18.9%
Has robots.txt80.4%
Blocks AI crawlers14.9%

JavaScript leads secondary barriers at 39.5%, well ahead of CAPTCHA (24.1%) and Antibot (20.7%). Rate Limiting (12.2%) is deployed on fewer than a third as many Brunei sites as JavaScript.

999 sites
State of Web Access 2026
Brunei · Barrier Stacking · 2026

Two-barrier sites are the most common configuration

Two-barrier sites are the most common configuration
% of sites
0 barriers4.1%
1 barrier31.2%
2 barriers34.2%
3 barriers17.9%
4 barriers7.8%
5 barriers4.3%
6 barriers0.4%

34.2% of Brunei sites carry exactly two barriers. One-barrier sites follow at 31.2%. Fewer than 5% deploy five or more, and only 0.4% run the full set of six.

999 sites
State of Web Access 2026
Brunei · Recommended Zyte API Tier · 2026

Most Brunei sites are Easy to access

Most Brunei sites are Easy to access
Mean recommended tier
All sites1.6

A majority of Brunei sites resolve without elevated browser access. The mean of 1.63 is pulled up by Tier 3 and above sites, which together account for just over 11% of domains.

999 sites
State of Web Access 2026
Brunei · Zyte API Tier Distribution · 2026

More than half of sites are Simple to access

More than half of sites are Simple to access
% of sites
1 - Simple51%
2 - Easy37.9%
3 - Moderate8.6%
4 - Complex1.8%
5 - Advanced0.7%

Just over half of Brunei domains need only Basic browser retrieval. Tier 2 adds 37.9%, meaning 88.9% of sites are reachable within the first two tiers. Tier 5 accounts for just 0.7%.

999 sites
State of Web Access 2026
Brunei · Bot Category Mentions in <code>robots.txt</code> · 2026 · 999 Sites

AI crawlers are the most-cited bot category

AI crawlers are the most-cited bot category
% of sites
AI crawlers16.9%
SEO / search indexing12.8%
SEO audit tools13.9%
Commercial scrapers7.4%
Social / content scrapers6.3%
Archive / research crawlers4.7%
Monitoring / uptime bots0.3%

AI crawlers are named in rules on 16.9% of all Brunei sites, ahead of SEO audit tools (13.9%) and SEO/search bots (12.8%). Monitoring bots are cited on fewer than 0.5% of sites.

999 sites
State of Web Access 2026
Brunei · <code>robots.txt</code> Rule Posture Types · 2026 · 999 Sites

Uniform per-agent rules are the dominant robots.txt posture

Uniform per-agent rules are the dominant robots.txt posture
% of sites
Uniform per-agent rules (no path mixing)43%
Path-level mixed rules for same agent32.1%
Allow-only (no disallow rules)2.3%
Mixed AI posture (block some, allow others)2.7%
Blanket Disallow: /2.7%

43.0% of sites apply uniform per-agent rules with no path variation. Path-level mixing appears on 32.1%. Blanket Disallow: / and mixed AI posture each remain below 3%.

999 sites
State of Web Access 2026
Brunei · AI Agent <code>Disallow</code> vs <code>Allow</code> · 2026 · 999 Sites Surveyed

GPTBot is the most blocked agent

GPTBot is the most blocked agent
DisallowedAllowed (whitelisted)
GPTBot13%3%
CCBot8.8%1.3%
ClaudeBot9.1%2%
Google-Extended8.6%2.1%
Bytespider7%0.6%
meta-externalagent3.2%0.3%
ChatGPT-User6.1%3.1%
PerplexityBot5.9%2.9%
Applebot-Extended4.9%0.6%
OAI-SearchBot4.1%2.5%
anthropic-ai5.4%1.3%

GPTBot leads Disallow entries at 13.0%, followed by ClaudeBot at 9.1%. ChatGPT-User receives the most explicit Allow coverage at 3.1% of all Brunei sites.

999 sites surveyed · 803 with robots.txt
State of Web Access 2026
Brunei · Named-Bot <code>Disallow</code> Rate by Industry · Top 15 · 2026

Six Brunei sectors all name at least one bot to restrict

Six Brunei sectors all name at least one bot to restrict
% of sites
Computer & Video Games100%
Design100%
Entertainment100%
Newspapers100%
Retail100%
Telecom100%
Adult90%
Automotive90%
Beauty & Cosmetics90%
Consulting90%
Consumer Electronics90%
Food & Beverages90%
Foreign Language90%
General90%
Healthcare90%

Computer & Video Games, Design, Entertainment, Newspapers, Retail and Telecom each report a 100% named-bot Disallow rate. Nine further sectors hold 90%.

Most categories n=10 — each site = 10 percentage points · 999 Brunei sites
State of Web Access 2026
Brunei · Explicit Bot <code>Allow</code> / Whitelist Rate by Industry · Top 15 · 2026

Airlines leads explicit bot Allow rules

Airlines leads explicit bot Allow rules
% of sites
Airlines80%
Mental Health80%
Public Relations80%
Investment70%
Photography70%
Publishing70%
Retail70%
Science70%
Telecom70%
Travel & Tourism70%
Graphic Design62.5%
Market Research60%
Real Estate60%
Software & Dev60%
Sports60%

Those three sectors each show an 80% explicit Allow rate. Seven industries follow at 70%.

Most categories n=10 — each site = 10 percentage points · 999 Brunei sites
State of Web Access 2026
Brunei · Scraping Difficulty by Industry · Top 15 by Mean Tier · 2026

Jewellery & Luxury is the hardest sector to access programmatically

Jewellery & Luxury is the hardest sector to access programmatically
WAFAntibotCAPTCHAJavaScriptRate LimitTLSrobots.txtBlocks AITier
Hospitality100%30%0%70%30%30%60%0%Tier 3
Equipment & Supplies90%20%20%60%20%10%60%20%Tier 3
Jewellery & Luxury100%20%20%30%50%50%70%0%Tier 2
Retail100%10%0%70%10%10%100%50%Tier 2
Computer Hardware90%20%10%20%20%30%80%10%Tier 2
Insurance90%20%10%30%10%40%80%0%Tier 2
Beauty & Cosmetics70%20%10%30%40%40%90%10%Tier 2
Consumer Electronics80%20%20%30%20%40%90%10%Tier 2
Human Resources100%70%70%30%60%30%60%10%Tier 2
Mail & Delivery60%20%10%10%0%30%60%0%Tier 2
Real Estate100%30%30%50%50%10%90%40%Tier 2
Sporting Goods70%10%10%20%40%40%60%0%Tier 2
Wholesalers70%20%40%50%40%30%60%10%Tier 2
Food & Beverages100%60%40%60%40%0%90%50%Tier 2
Apparel & Fashion100%20%30%60%20%30%80%10%Tier 2

Hospitality leads with a Tier 3 median and a mean of 2.80. Equipment & Supplies also holds a Tier 3 median at a mean of 2.60.

Top 15 industries by mean Zyte browser tier · 999 sites
State of Web Access 2026
Brunei · Scraping Difficulty by Industry · Bottom 15 by Mean Tier · 2026

Aerospace & Defence is the most accessible sector

Aerospace & Defence is the most accessible sector
WAFAntibotCAPTCHAJavaScriptRate LimitTLSrobots.txtBlocks AITier
Recruitment & Staffing90%20%30%20%10%30%60%10%Tier 2
Transport & Logistics60%20%10%10%0%20%70%0%Tier 2
Design100%20%30%40%20%30%100%30%Tier 2
Manufacturing70%10%10%20%0%50%80%10%Tier 2
Reference80%50%20%40%20%10%50%30%Tier 2
Restaurants100%20%30%70%40%10%60%0%Tier 2
Automotive100%10%0%10%30%10%90%30%Tier 2
Biotech90%20%50%40%10%20%80%20%Tier 2
Education100%20%10%30%10%10%80%10%Tier 2
Libraries100%10%10%60%0%0%70%10%Tier 2
Science100%20%10%40%30%10%80%10%Tier 2
Telecom90%10%0%60%0%10%100%10%Tier 2
Adult100%40%40%70%10%20%90%10%Tier 2
Advertising & Mktg100%30%40%60%0%30%90%10%Tier 2
Aerospace & Defence90%20%30%20%0%30%90%10%Tier 2

Three sectors share the floor tier mean of 1.70: Adult, Advertising & Mktg, and Aerospace & Defence. Six further sectors cluster at 1.80.

Bottom 15 industries by mean Zyte browser tier · 999 sites