State of Web Access2026

Public Safety is the lowest AI-blocking sector in the Public Sector cohort — just 6% of sites name an AI crawler in a Disallow rule. The technical stack is equally light: antibot appears on only 12% of sites, well below the global average.

State of Web Access 2026
Public Safety · Barrier Profile · 2026

JavaScript leads Public Safety's secondary barrier stack above the norm

JavaScript leads Public Safety's secondary barrier stack above the norm
Value
WAF94%
Antibot12%
CAPTCHA25%
JavaScript44%
Rate Limiting18%
TLS14%

WAF at 94% is the dominant barrier. JavaScript (44%) leads secondary coverage. The remaining barriers sit materially lower, giving Public Safety a narrow but defined secondary layer.

100 sites
State of Web Access 2026
Public Safety · Access Barrier Adoption · 2026

WAF leads Public Safety at 94% — JavaScript is the main secondary layer

WAF leads Public Safety at 94% — JavaScript is the main secondary layer
Value
WAF94%
Antibot12%
CAPTCHA25%
JavaScript44%
Rate Limiting18%
TLS14%
Has robots.txt74%
Blocks AI crawlers6%

WAF dominates at 94%. JavaScript (44%) leads active secondary barriers, followed by CAPTCHA (25%). The remaining three barriers all sit at or below 18% — a concentrated rather than broadly stacked profile.

100 sites
State of Web Access 2026
Public Safety · Barrier Count Distribution · 2026

Public Safety's barrier counts are spread — no single configuration dominates

Public Safety's barrier counts are spread — no single configuration dominates
% of sites
0 barriers6%
1 barrier31%
2 barriers30%
3 barriers21%
4 barriers8%
5 barriers3%
6 barriers1%

Barrier counts vary widely across Public Safety sites. Single-barrier configurations are the modal count at 31%, but the distribution is broad. 33% of sites carry three or more.

100 sites
State of Web Access 2026
Public Safety · Recommended Scraping Tier · 2026

Public Safety sites are predominantly Simple to access

Public Safety sites are predominantly Simple to access
Mean recommended tier
All sites1.26

A mean recommended tier of 1.26 and a median of Simple place Public Safety among the most accessible sectors surveyed. 83% of sites are Simple to access; 5% require Moderate or above.

100 sites
State of Web Access 2026
Public Safety · Tier Distribution · 2026

Simple tier covers more than three-quarters of Public Safety sites

Simple tier covers more than three-quarters of Public Safety sites
% of sites
1 - Simple83%
2 - Easy12%
3 - Moderate3%
4 - Complex0%
5 - Advanced2%

Simple (83%) is the most common tier. Simple and Easy together account for 95% of sites, while 3% land at Moderate and 2% at Complex or Advanced.

100 sites
State of Web Access 2026
Public Safety · robots.txt Coverage · 2026

Around three-quarters of Public Safety sites publish a robots.txt

Around three-quarters of Public Safety sites publish a robots.txt
% of sites
Publish a valid robots.txt74%

74% of Public Safety sites have a valid robots.txt. The remaining 26% leave crawl policy entirely undefined — a meaningful gap for a sector of this scale.

100 sites
State of Web Access 2026
Public Safety · Named Agents in robots.txt · 2026

Most Public Safety sites name one bot or none in their robots.txt

Most Public Safety sites name one bot or none in their robots.txt
% of sites
037%
145%
2–45%
5–96%
10–151%
16+6%

37% of Public Safety sites name zero agents and 45% name one. A mean of 3.1 is pulled up by a small number of sites with extensive policies, while the median stays at 1.

100 sites
State of Web Access 2026
Public Safety · Bot Category Mentions in robots.txt · 2026

SEO audit tools lead Public Safety's robots.txt mentions ahead of AI crawlers

SEO audit tools lead Public Safety's robots.txt mentions ahead of AI crawlers
% of sites
AI crawlers6%
SEO / search indexing5%
SEO audit tools11%
Commercial scrapers3%
Social / content scrapers0%
Archive / research crawlers3%
Monitoring / uptime bots0%

SEO audit tools are mentioned by 11% of Public Safety sites — the leading bot category, ahead of AI crawlers at 6%. Figures are percentages of all 100 sites surveyed.

100 sites
State of Web Access 2026
Public Safety · robots.txt Rule Posture Types · 2026

Uniform per-agent rules dominate Public Safety robots.txt files

Uniform per-agent rules dominate Public Safety robots.txt files
% of sites
Uniform per-agent rules44%
Path-level mixed rules27%
Allow-only (no Disallow rules)2%
Mixed AI posture0%
Blanket Disallow: /1%

Uniform per-agent rules lead at 44%, with path-level mixed rules at 27%. Mixed AI posture (0%) and blanket Disallow (1%) are minimal.

100 sites
State of Web Access 2026
Public Safety · Bot Agent Disallow vs Allow · 2026

AhrefsBot leads named Disallow rules in Public Safety robots.txt

AhrefsBot leads named Disallow rules in Public Safety robots.txt
DisallowedAllowed (whitelisted)
*61%29%
AhrefsBot8%
AhrefsSiteAudit5%
Nutch5%
adsbot-google5%
GPTBot5%
Bytespider4%
anthropic-ai4%
BLEXBot4%
SEOkicks-Robot4%
CCBot3%
FacebookBot3%
MJ12bot3%
meta-externalagent2%
ChatGPT-User2%
Google-Extended2%
ImagesiftBot2%
0082%
QuerySeekerSpider2%
Vagabondo2%
WBSearchBot2%
proximic2%
SemrushBot2%
Baiduspider2%
Yandex2%

Values are percentages of all 100 Public Safety sites surveyed. The wildcard (*) leads at 61% Disallow. Among named agents, AhrefsBot, AhrefsSiteAudit, Nutch are the most frequently targeted — focused on non-AI crawlers.

100 sites surveyed · 74 with robots.txt
State of Web Access 2026
Public Sector · Access Barriers · 2026

Public Safety lags the Public Sector cohort on AI-blocking policy

Public Safety lags the Public Sector cohort on AI-blocking policy
WAFAntibotCAPTCHAJavaScriptRate LimitTLSrobots.txtBlocks AITier
Government80%10%8%33%15%12%64%10%Tier 2
Military77%11%16%21%19%17%62%7%Tier 1
Political Organizations97%13%23%47%16%9%79%6%Tier 1
Public Policy96%9%9%28%11%9%86%8%Tier 1
Public Safety94%12%25%44%18%14%74%6%Tier 1

Public Safety's 6% AI-blocking rate is the lowest in the Public Sector cohort. WAF (94%) and JavaScript (44%) are in line with cohort peers on technical barriers.

11,100 landing pages