State of Web Access2026

A sector that manages information for a living has almost no technical interest in controlling who reads its own sites. Public Relations logs the lowest AI-blocking rate in the entire Media & Publishing cohort at just 6%, and antibot at 10% runs well below the global average.

State of Web Access 2026
Public Relations · Barrier Profile · 2026

Public Relations sites run almost entirely on WAF — secondary barriers are thin

Public Relations sites run almost entirely on WAF — secondary barriers are thin
Value
WAF95%
Antibot10%
CAPTCHA14%
JavaScript25%
Rate Limiting14%
TLS14%

WAF at 95% dominates. No secondary barrier exceeds 25%, leaving Public Relations with one of the narrowest active-barrier profiles across all surveyed sectors.

100 sites
State of Web Access 2026
Public Relations · Access Barrier Adoption · 2026

WAF leads Public Relations at 95% — JavaScript is the main secondary layer

WAF leads Public Relations at 95% — JavaScript is the main secondary layer
Value
WAF95%
Antibot10%
CAPTCHA14%
JavaScript25%
Rate Limiting14%
TLS14%
Has robots.txt76%
Blocks AI crawlers6%

WAF dominates at 95%. JavaScript (25%) leads active secondary barriers, followed by Rate Limiting (14%). The remaining three barriers all sit at or below 14% — a concentrated rather than broadly stacked profile.

100 sites
State of Web Access 2026
Public Relations · Barrier Count Distribution · 2026

Single-barrier configurations dominate Public Relations — mostly WAF alone

Single-barrier configurations dominate Public Relations — mostly WAF alone
% of sites
0 barriers3%
1 barrier56%
2 barriers20%
3 barriers10%
4 barriers9%
5 barriers2%
6 barriers0%

56% of Public Relations sites carry exactly one barrier — almost always WAF. Two-barrier stacks add 20%. Just 21% of sites layer three or more defences.

100 sites
State of Web Access 2026
Public Relations · Recommended Scraping Tier · 2026

Nearly all Public Relations sites are Simple to access programmatically

Nearly all Public Relations sites are Simple to access programmatically
Mean recommended tier
All sites1.07

A mean recommended tier of 1.07 and a median of Simple place Public Relations among the most accessible sectors surveyed. 94% of sites are Simple to access; 1% require Moderate or above.

100 sites
State of Web Access 2026
Public Relations · Tier Distribution · 2026

Simple tier covers more than three-quarters of Public Relations sites

Simple tier covers more than three-quarters of Public Relations sites
% of sites
1 - Simple94%
2 - Easy5%
3 - Moderate1%
4 - Complex0%
5 - Advanced0%

Simple (94%) is the most common tier. Simple and Easy together account for 99% of sites, while 1% land at Moderate and 0% at Complex or Advanced.

100 sites
State of Web Access 2026
Public Relations · robots.txt Coverage · 2026

Around three-quarters of Public Relations sites publish a robots.txt

Around three-quarters of Public Relations sites publish a robots.txt
% of sites
Publish a valid robots.txt76%

76% of Public Relations sites have a valid robots.txt. The remaining 24% leave crawl policy entirely undefined — a meaningful gap for a sector of this scale.

100 sites
State of Web Access 2026
Public Relations · Named Agents in robots.txt · 2026

Most Public Relations sites name one bot or none in their robots.txt

Most Public Relations sites name one bot or none in their robots.txt
% of sites
036%
143%
2–414%
5–93%
10–150%
16+4%

36% of Public Relations sites name zero agents and 43% name one. A mean of 3.0 is pulled up by a small number of sites with extensive policies, while the median stays at 1.

100 sites
State of Web Access 2026
Public Relations · Bot Category Mentions in robots.txt · 2026

AI crawlers draw the most robots.txt attention in Public Relations

AI crawlers draw the most robots.txt attention in Public Relations
% of sites
AI crawlers10%
SEO / search indexing4%
SEO audit tools5%
Commercial scrapers0%
Social / content scrapers0%
Archive / research crawlers2%
Monitoring / uptime bots0%

AI crawlers are named in 10% of Public Relations robots.txt files, followed by SEO audit tools at 5%. All figures are percentages of all 100 sites including those with no robots.txt.

100 sites
State of Web Access 2026
Public Relations · robots.txt Rule Posture Types · 2026

Uniform per-agent rules dominate Public Relations robots.txt files

Uniform per-agent rules dominate Public Relations robots.txt files
% of sites
Uniform per-agent rules43%
Path-level mixed rules29%
Allow-only (no Disallow rules)4%
Mixed AI posture1%
Blanket Disallow: /0%

Uniform per-agent rules lead at 43%, with path-level mixed rules at 29%. Mixed AI posture (1%) and blanket Disallow (0%) are minimal.

100 sites
State of Web Access 2026
Public Relations · Bot Agent Disallow vs Allow · 2026

Yandex and GPTBot lead named Disallow rules in Public Relations robots.txt

Yandex and GPTBot lead named Disallow rules in Public Relations robots.txt
DisallowedAllowed (whitelisted)
*59%33%
Yandex5%2%
GPTBot5%2%
AhrefsBot4%
GoogleBot2%2%
Google-Extended2%2%
PetalBot3%
Bytespider2%1%
BLEXBot2%
Exabot2%
SemrushBot2%
TurnitinBot2%
dotbot2%
ia_archiver2%
ChatGPT-User1%1%
MJ12bot2%
AI2Bot1%1%
AdsBot-Google1%1%
AdsBot-Google-Mobile1%1%
AdsBot-Google-Mobile-Apps1%1%
Ai2Bot-Dolma1%1%
Amazonbot1%1%
Applebot-Extended1%1%
CCBot1%1%
ClaudeBot1%1%

Values are percentages of all 100 Public Relations sites surveyed. The wildcard (*) leads at 59% Disallow. Among named agents, Yandex and GPTBot tie at the top of the Disallow list, each named by 5% of sites.

100 sites surveyed · 76 with robots.txt
State of Web Access 2026
Media & Publishing · Access Barriers · 2026

Public Relations lags the Media & Publishing cohort on AI-blocking policy

Public Relations lags the Media & Publishing cohort on AI-blocking policy
WAFAntibotCAPTCHAJavaScriptRate LimitTLSrobots.txtBlocks AITier
Advertising & Marketing97%23%32%31%21%14%87%6%Tier 1
Mass Media98%12%21%49%16%8%92%43%Tier 2
Newspapers96%8%21%36%15%10%90%64%Tier 2
Public Relations95%10%14%25%14%14%76%6%Tier 1
Publishing95%16%24%45%21%11%92%49%Tier 2
Writing & Editing98%14%33%31%11%6%79%11%Tier 1

Public Relations's 6% AI-blocking rate is the lowest in the Media & Publishing cohort. WAF (95%) and JavaScript (25%) are in line with cohort peers on technical barriers.

11,100 landing pages