State of Web Access2026

Philippines sites are more focused on naming AI crawlers in robots.txt than any other bot category — 15.8% of all sites cite one, ahead of SEO audit tools and search indexing bots. The active barrier stack is otherwise close to global norms, with JavaScript the clear secondary leader at 43.1%.

State of Web Access 2026
Philippines · Barrier Profile · 2026

JavaScript heads a tightly bunched secondary barrier set

JavaScript heads a tightly bunched secondary barrier set
Value
WAF92.8%
Antibot22.4%
CAPTCHA21.5%
JavaScript43.1%
Rate Limiting14.3%
TLS18.6%

WAF is deployed by 92.8% of Philippines sites. Among secondary barriers, JavaScript leads at 43.1%, followed by Antibot (22.4%), CAPTCHA (21.5%), TLS (18.6%), and Rate Limiting (14.3%) — a span of under 29 points across all five.

1,111 sites
State of Web Access 2026
Philippines · Barrier Adoption · 2026

Antibot edges past CAPTCHA among secondary barriers

Antibot edges past CAPTCHA among secondary barriers
Value
WAF92.8%
Antibot22.4%
CAPTCHA21.5%
JavaScript43.1%
Rate Limiting14.3%
TLS18.6%
Has robots.txt79.6%
Blocks AI crawlers14.1%

WAF dominates at 92.8%. JavaScript is the clear secondary leader at 43.1%. Antibot (22.4%) narrowly exceeds CAPTCHA (21.5%). TLS stands at 18.6% and Rate Limiting at 14.3%, the least-deployed secondary.

1,111 sites
State of Web Access 2026
Philippines · Barrier Stacking · 2026

Two-barrier sites are Philippines's most common configuration

Two-barrier sites are Philippines's most common configuration
% of sites
0 barriers4.9%
1 barrier28.7%
2 barriers33.7%
3 barriers18.7%
4 barriers10%
5 barriers3.7%
6 barriers0.4%

33.7% of sites carry exactly two barriers — the most frequent count. Sites with three or more barriers account for 32.8% in total. Only 4.9% of sites have no barriers at all.

1,111 sites
State of Web Access 2026
Philippines · Recommended Zyte API Tier · 2026

Most Philippines sites are Easy to access

Most Philippines sites are Easy to access
Mean recommended tier
All sites1.7

The browser-based median recommended tier is 2 and the mean is 1.73. Tier 1 and Tier 2 together cover 86.3% of sites. Fewer than one in seven sites requires more than standard browser-based retrieval.

1,111 sites
State of Web Access 2026
Philippines · Zyte API Tier Distribution · 2026

Easy sites account for more than four in ten sites

Easy sites account for more than four in ten sites
% of sites
1 - Simple44.2%
2 - Easy42.1%
3 - Moderate10.9%
4 - Complex2.3%
5 - Advanced0.5%

44.2% of sites are Tier 1 (Simple). Tier 2 (Easy) is unusually large at 42.1%. Tier 3 covers 10.9%, with Tier 4 at 2.3% and Tier 5 at just 0.5% of sites.

1,111 sites
State of Web Access 2026
Philippines · Bot Category Mentions in <code>robots.txt</code> · 2026 · 1,111 Sites

AI crawlers are the most-cited bot category in robots.txt

AI crawlers are the most-cited bot category in robots.txt
% of sites
AI crawlers15.8%
SEO / search indexing11.9%
SEO audit tools13.5%
Commercial scrapers7.8%
Social / content scrapers5.9%
Archive / research crawlers4.5%
Monitoring / uptime bots0.5%

15.8% of all 1,111 Philippines domains name an AI crawler in their robots.txt — the highest of any bot category. SEO audit tools follow at 13.5% and SEO/search indexing bots at 11.9%. Monitoring bots are named by only 0.5%.

1,111 sites
State of Web Access 2026
Philippines · <code>robots.txt</code> Rule Posture Types · 2026 · 1,111 Sites

Uniform per-agent rules are the dominant robots.txt pattern

Uniform per-agent rules are the dominant robots.txt pattern
% of sites
Uniform per-agent rules (no path mixing)42.4%
Path-level mixed rules for same agent32.2%
Allow-only (no disallow rules)2.2%
Mixed AI posture (block some, allow others)2.7%
Blanket Disallow: /2.6%

42.4% of all sites use uniform per-agent rules with no path mixing. A further 32.2% apply path-level mixed rules. 20.4% publish no robots.txt. Blanket Disallow: / and mixed AI posture each apply to around 2.6–2.7%.

1,111 sites
State of Web Access 2026
Philippines · AI Agent <code>Disallow</code> vs <code>Allow</code> · 2026 · 1,111 Sites Surveyed

GPTBot is blocked by more sites than any other AI agent

GPTBot is blocked by more sites than any other AI agent
DisallowedAllowed (whitelisted)
GPTBot11.4%2.6%
CCBot8.7%1.3%
ClaudeBot8.3%1.2%
Google-Extended8.2%1.9%
Bytespider7.3%0.4%
meta-externalagent3.1%0.1%
ChatGPT-User5.9%2.7%
PerplexityBot6.1%2.4%
Applebot-Extended4.8%0.4%
OAI-SearchBot4.6%2.1%
anthropic-ai5.3%1%

11.4% of all Philippines sites name GPTBot in a Disallow rule — the highest rate of any agent. CCBot follows at 8.7% and ClaudeBot at 8.3%. ChatGPT-User is the most explicitly allowed at 2.7%.

1,111 sites surveyed · 884 with robots.txt
State of Web Access 2026
Philippines · Named-Bot <code>Disallow</code> Rate by Industry · Top 15 · 2026

Seven sectors have every site naming at least one bot to restrict

Seven sectors have every site naming at least one bot to restrict
% of sites
Computer & Video Games100%
Consumer Electronics100%
Design100%
Entertainment100%
Retail100%
Telecom100%
Visual Art100%
Adult90%
Airlines90%
Civil Engineering90%
Comics & Animation90%
General90%
Healthcare90%
Insurance90%
Machinery90%

Computer & Video Games, Consumer Electronics, Design, Entertainment, Retail, Telecom, and Visual Art all reach 100% — every site in each sector names at least one bot in a Disallow rule. Eight further sectors reach 90%.

Most categories n=10 — each site = 10 percentage points · 1,111 Philippines sites
State of Web Access 2026
Philippines · Explicit Bot <code>Allow</code> / Whitelist Rate by Industry · Top 15 · 2026

Eight sectors reach the top explicit bot Allow rate

Eight sectors reach the top explicit bot Allow rate
% of sites
Airlines70%
Architecture70%
Automotive70%
Photography70%
Publishing70%
Retail70%
Science70%
Wholesalers70%
Agriculture60%
Graphic Design60%
Outsourcing60%
Real Estate60%
Renewable Energy60%
Software & Dev60%
Telecom60%

Airlines, Architecture, Automotive, Photography, Publishing, Retail, Science, and Wholesalers each see 70% of their sites name at least one bot in an explicit Allow rule. A further seven sectors reach 60%.

Most categories n=10 — each site = 10 percentage points · 1,111 Philippines sites
State of Web Access 2026
Philippines · Scraping Difficulty by Industry · Top 15 by Mean Tier · 2026

Hospitality and Jewellery & Luxury share the hardest access profile

Hospitality and Jewellery & Luxury share the hardest access profile
WAFAntibotCAPTCHAJavaScriptRate LimitTLSrobots.txtBlocks AITier
Hospitality90%30%0%60%30%40%60%10%Tier 3
Jewellery & Luxury100%20%10%30%30%50%60%0%Tier 3
Furniture100%50%20%20%20%40%70%10%Tier 3
Equipment & Supplies90%30%10%50%20%10%70%20%Tier 3
Beauty & Cosmetics90%40%20%30%40%20%80%20%Tier 3
Medical Devices90%20%0%50%20%0%80%0%Tier 3
Real Estate100%20%20%60%50%20%60%20%Tier 2
Retail100%10%0%70%10%10%100%50%Tier 2
Human Resources100%70%60%40%50%30%80%10%Tier 2
Computer Hardware90%20%0%30%20%20%70%10%Tier 2
Insurance80%20%0%30%0%20%90%0%Tier 2
Restaurants90%40%30%60%40%10%60%20%Tier 2
Apparel & Fashion100%20%30%70%30%30%80%10%Tier 2
Consumer Electronics80%10%20%50%10%40%100%20%Tier 2
Customer Services100%20%30%60%30%10%60%0%Tier 2

Hospitality and Jewellery & Luxury both record a mean recommended tier of 2.80 — the highest in the Philippines. Furniture follows at 2.70. Equipment & Supplies sits at 2.60. Beauty & Cosmetics, Medical Devices, Real Estate, and Retail all share a mean of 2.50.

Top 15 industries by mean Zyte browser tier · 1,111 sites
State of Web Access 2026
Philippines · Scraping Difficulty by Industry · Bottom 15 by Mean Tier · 2026

Recruitment & Staffing anchors the most accessible sector group

Recruitment & Staffing anchors the most accessible sector group
WAFAntibotCAPTCHAJavaScriptRate LimitTLSrobots.txtBlocks AITier
Sporting Goods90%10%20%50%30%30%60%0%Tier 2
Textiles & Nonwovens100%0%30%60%0%10%100%10%Tier 2
Transport & Logistics70%40%10%10%0%20%80%0%Tier 2
Wine & Spirits100%50%20%70%30%10%80%40%Tier 2
Food & Beverages100%30%20%60%30%0%70%30%Tier 2
Crafts100%30%30%60%20%10%70%20%Tier 2
Design100%20%30%40%20%30%100%30%Tier 2
Mail & Delivery70%40%10%10%0%20%80%0%Tier 2
Telecom90%10%20%60%0%30%100%20%Tier 2
Adult100%40%40%80%20%20%90%10%Tier 2
Healthcare100%10%10%30%0%10%100%40%Tier 2
Manufacturing80%10%10%30%0%40%70%0%Tier 2
Maritime100%10%10%40%10%30%100%10%Tier 2
Plastics & Polymers90%10%20%40%0%10%80%0%Tier 2
Recruitment & Staffing100%50%70%20%10%30%80%30%Tier 2

Recruitment & Staffing has the lowest mean tier at 1.90, alongside Adult, Healthcare, Manufacturing, Maritime, and Plastics & Polymers. Despite high CAPTCHA (70%) deployment, Recruitment & Staffing remains among the easiest sectors to access.

Bottom 15 industries by mean Zyte browser tier · 1,111 sites