Overview
CAPTCHA outranks Antibot among Solomon Islands secondary barriers
| Value | |
|---|---|
| WAF | 93.6% |
| Antibot | 20.6% |
| CAPTCHA | 24.6% |
| JavaScript | 37.5% |
| Rate Limiting | 11.8% |
| TLS | 17.6% |
WAF leads at 93.6%. CAPTCHA at 24.6% exceeds Antibot at 20.6%. JavaScript is the second most prevalent secondary barrier at 37.5%. Rate Limiting at 11.8% sits below all other secondary barriers.
Barrier Landscape
JavaScript is the strongest secondary barrier in Solomon Islands
| Value | |
|---|---|
| WAF | 93.6% |
| Antibot | 20.6% |
| CAPTCHA | 24.6% |
| JavaScript | 37.5% |
| Rate Limiting | 11.8% |
| TLS | 17.6% |
| Has robots.txt | 81.5% |
| Blocks AI crawlers | 15.3% |
WAF reaches 93.6%. JavaScript follows at 37.5%. CAPTCHA (24.6%) outpaces Antibot (20.6%). TLS at 17.6% and Rate Limiting at 11.8% form a lower tier of secondary adoption.
Single- and two-barrier sites are nearly equal
| % of sites | |
|---|---|
| 0 barriers | 3.3% |
| 1 barrier | 33.6% |
| 2 barriers | 33.3% |
| 3 barriers | 18.4% |
| 4 barriers | 6.9% |
| 5 barriers | 4.2% |
| 6 barriers | 0.3% |
3.3% of sites carry no barrier. One-barrier sites lead fractionally at 33.6%, matched almost exactly by two-barrier sites at 33.3%. Sites with three or more barriers total 29.8%, with 0.3% at the full six.
Most Solomon Islands sites are Simple to access
| Mean recommended tier | |
|---|---|
| All sites | 1.6 |
Median recommended tier is 1, with 55.8% of sites requiring only simple HTTP retrieval. A mean of 1.59 places this country toward the accessible end. Tier 3 accounts for 7.6% and Tiers 4–5 for 3.0%.
Nearly nine in 10 sites are Simple or Easy to access
| % of sites | |
|---|---|
| 1 - Simple | 55.8% |
| 2 - Easy | 33.6% |
| 3 - Moderate | 7.6% |
| 4 - Complex | 1.9% |
| 5 - Advanced | 1.1% |
Tier 1 at 55.8% and Tier 2 at 33.6% together reach 89.4% — a strong two-tier majority. Tier 3 stands at 7.6%. Tiers 4 and 5 are marginal at 1.9% and 1.1%.
robots.txt
SEO audit tools barely edge SEO search indexing in robots.txt
| % of sites | |
|---|---|
| AI crawlers | 17.3% |
| SEO / search indexing | 13.6% |
| SEO audit tools | 13.7% |
| Commercial scrapers | 7.3% |
| Social / content scrapers | 6.9% |
| Archive / research crawlers | 5.1% |
| Monitoring / uptime bots | 0.2% |
AI crawlers are named by 17.3% of all sites. SEO audit tools (13.7%) and SEO / search indexing (13.6%) are almost level — a 0.1-point difference. Commercial scrapers are cited by 7.3% of sites.
Blanket blocks and Allow-only postures are tied at a rare level
| % of sites | |
|---|---|
| Uniform per-agent rules (no path mixing) | 44.4% |
| Path-level mixed rules for same agent | 31.9% |
| Allow-only (no disallow rules) | 2.5% |
| Mixed AI posture (block some, allow others) | 3.1% |
| Blanket Disallow: / | 2.5% |
Uniform per-agent rules apply at 44.4% of sites. Path-level mixed rules account for 31.9%. Blanket Disallow: / and Allow-only posture are level at 2.5% each. Mixed AI posture sits at 3.1%.
ChatGPT-User has the highest Allow rate among agents
| Disallowed | Allowed (whitelisted) | |
|---|---|---|
| GPTBot | 12.3% | 2.5% |
| CCBot | 10.4% | 1.1% |
| ClaudeBot | 9.2% | 0.9% |
| Google-Extended | 9.7% | 1.4% |
| Bytespider | 7.6% | 0.8% |
| meta-externalagent | 3.4% | 0.3% |
| ChatGPT-User | 7.3% | 3.4% |
| PerplexityBot | 6.9% | 3% |
| Applebot-Extended | 5.1% | 0.5% |
| OAI-SearchBot | 3.9% | 2.2% |
| anthropic-ai | 5.3% | 1.2% |
GPTBot tops the block list at 12.3% of all sites. On the allow side, ChatGPT-User leads at 3.4%, followed by PerplexityBot at 3.0% — both higher than GPTBot's allow rate of 2.5%.
Apparel, Architecture, Retail, and Sporting Goods all block every named bot
| % of sites | |
|---|---|
| Apparel & Fashion | 100% |
| Architecture | 100% |
| Retail | 100% |
| Sporting Goods | 100% |
| Advertising & Mktg | 90% |
| Computer & Video Games | 90% |
| Consumer Electronics | 90% |
| Design | 90% |
| General | 90% |
| Government | 90% |
| Mass Media | 90% |
| Newspapers | 90% |
| Online Services | 90% |
| Publishing | 90% |
| Real Estate | 90% |
Four sectors — Apparel & Fashion, Architecture, Retail, and Sporting Goods — each have every sampled site naming at least one bot in a Disallow rule. Ten further sectors register 90% restriction rates.
Machinery and Publishing jointly lead on explicit bot Allow rules
| % of sites | |
|---|---|
| Machinery | 80% |
| Publishing | 80% |
| Advertising & Mktg | 70% |
| Computer & Video Games | 70% |
| Photography | 70% |
| Travel & Tourism | 70% |
| Architecture | 66.7% |
| Food & Beverages | 66.7% |
| Social & Charitable | 66.7% |
| Apparel & Fashion | 60% |
| Computers & Electronics | 60% |
| Construction | 60% |
| Import & Export | 60% |
| Retail | 60% |
| Software & Dev | 60% |
Machinery and Publishing both top the explicit bot Allow ranking at 80% of sites naming at least one bot to permit. Advertising & Mktg and Computer & Video Games follow at 70% each.
Industry Patterns
Automotive is the hardest sector to access programmatically
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Automotive | 90% | 30% | 30% | 30% | 40% | 30% | 70% | 30% | Tier 3 |
| Retail | 90% | 20% | 0% | 60% | 10% | 20% | 100% | 30% | Tier 2 |
| Travel & Tourism | 100% | 20% | 20% | 60% | 40% | 30% | 80% | 30% | Tier 2 |
| Apparel & Fashion | 100% | 0% | 40% | 40% | 0% | 0% | 100% | 0% | Tier 2 |
| Consumer Electronics | 80% | 20% | 30% | 40% | 20% | 60% | 90% | 10% | Tier 2 |
| Computer Hardware | 80% | 20% | 10% | 30% | 10% | 30% | 70% | 0% | Tier 2 |
| Market Research | 100% | 33.3% | 33.3% | 66.7% | 16.7% | 0% | 66.7% | 0% | Tier 2 |
| Non-Profit | 90% | 0% | 10% | 40% | 0% | 30% | 70% | 0% | Tier 2 |
| Sports | 100% | 0% | 20% | 50% | 20% | 20% | 80% | 30% | Tier 2 |
| Computer & Video Games | 100% | 20% | 10% | 50% | 20% | 20% | 100% | 0% | Tier 2 |
| Education | 100% | 20% | 10% | 20% | 10% | 10% | 80% | 10% | Tier 2 |
| Hospitality | 90% | 10% | 10% | 50% | 10% | 40% | 70% | 10% | Tier 2 |
| Music | 100% | 20% | 30% | 50% | 20% | 10% | 80% | 30% | Tier 2 |
| Science | 90% | 20% | 10% | 20% | 20% | 20% | 70% | 0% | Tier 2 |
| Adult | 100% | 40% | 40% | 60% | 20% | 20% | 70% | 10% | Tier 2 |
Automotive stands apart as the only sector reaching median recommended tier 3, with a mean of 3.10. The next hardest sectors — Retail and Travel & Tourism — have median tier 2 and means of 2.30. The remaining 13 sectors all cluster below 2.30.
Finance is the most accessible sector in Solomon Islands
| WAF | Antibot | CAPTCHA | JavaScript | Rate Limit | TLS | robots.txt | Blocks AI | Tier | |
|---|---|---|---|---|---|---|---|---|---|
| Banking | 100% | 50% | 0% | 40% | 0% | 10% | 90% | 0% | Tier 2 |
| Distance Learning | 100% | 60% | 50% | 20% | 30% | 10% | 80% | 60% | Tier 2 |
| Real Estate | 100% | 10% | 10% | 50% | 30% | 10% | 90% | 40% | Tier 2 |
| Telecom | 90% | 0% | 10% | 60% | 0% | 20% | 100% | 20% | Tier 2 |
| Airlines | 90% | 40% | 10% | 60% | 30% | 20% | 70% | 10% | Tier 2 |
| Design | 100% | 40% | 40% | 20% | 20% | 20% | 100% | 20% | Tier 2 |
| Photography | 90% | 40% | 50% | 30% | 40% | 70% | 70% | 40% | Tier 2 |
| Publishing | 90% | 20% | 20% | 50% | 10% | 0% | 90% | 40% | Tier 2 |
| Gambling | 100% | 25% | 25% | 62.5% | 37.5% | 0% | 62.5% | 12.5% | Tier 2 |
| Advertising & Mktg | 100% | 20% | 40% | 10% | 0% | 10% | 100% | 10% | Tier 2 |
| Ecology & Environment | 100% | 20% | 10% | 70% | 10% | 10% | 70% | 10% | Tier 2 |
| Healthcare | 100% | 30% | 30% | 40% | 20% | 10% | 90% | 30% | Tier 2 |
| Finance | 80% | 20% | 10% | 30% | 10% | 10% | 60% | 30% | Tier 2 |
| Mail & Delivery | 80% | 40% | 40% | 40% | 0% | 20% | 60% | 0% | Tier 1 |
| Transport & Logistics | 70% | 30% | 30% | 30% | 0% | 10% | 60% | 0% | Tier 1 |
Finance records the lowest mean recommended tier at 1.50, with a median of 2. Transport & Logistics (median 1, mean 1.90) and Mail & Delivery (median 1, mean 2.20) are also among the least demanding sectors for retrieval.