Agent Skill · Oxylabs

oxylabs-web-unblocker

Bypasses anti-bot protections using Oxylabs Web Unblocker, an AI-powered proxy that handles fingerprinting, JavaScript rendering, and retries automatically. Use when the user needs to scrape protected websites, bypass CAPTCHAs, access blocked content, or when regular proxies fail due to anti-bot measures.

Provider: Oxylabs Path in repo: skills/web-unblocker/SKILL.md

Skill body

Oxylabs Web Unblocker

AI-powered proxy solution that automatically manages fingerprinting, headers, retries, and JavaScript rendering.

Endpoint

https://unblock.oxylabs.io:60000

Authentication

HTTP Basic Auth via proxy credentials:

curl -k -x "https://unblock.oxylabs.io:60000" \
  -U "$OXYLABS_USERNAME:$OXYLABS_PASSWORD" \
  "https://example.com"

Quick Start

Basic request:

curl -k -x "https://unblock.oxylabs.io:60000" \
  -U "$OXYLABS_USERNAME:$OXYLABS_PASSWORD" \
  "https://ip.oxylabs.io/headers"

With JavaScript rendering:

curl -k -x "https://unblock.oxylabs.io:60000" \
  -U "$OXYLABS_USERNAME:$OXYLABS_PASSWORD" \
  -H "x-oxylabs-render: html" \
  "https://example.com/spa-page"

Headers

Header Description
x-oxylabs-render html for rendered HTML, png for screenshot
X-Oxylabs-Session-Id Reuse same IP across requests (any random string)
X-Oxylabs-Geo-Location Target country (e.g., Germany, United States)
x-oxylabs-force-headers: 1 Enable custom header passthrough
X-Oxylabs-Successful-Status-Codes Define custom success codes to prevent retries

Session Persistence

Reuse the same IP across multiple requests:

curl -k -x "https://unblock.oxylabs.io:60000" \
  -U "$OXYLABS_USERNAME:$OXYLABS_PASSWORD" \
  -H "X-Oxylabs-Session-Id: my-session-123" \
  "https://example.com/page1"

Geo-Location Targeting

curl -k -x "https://unblock.oxylabs.io:60000" \
  -U "$OXYLABS_USERNAME:$OXYLABS_PASSWORD" \
  -H "X-Oxylabs-Geo-Location: Germany" \
  "https://example.com"

When to Use Web Unblocker vs Regular Proxies

Scenario Use
Sites with anti-bot protection Web Unblocker
CAPTCHAs, fingerprint detection Web Unblocker
JavaScript-heavy SPAs Web Unblocker with x-oxylabs-render: html
Simple requests, no protection Regular Proxies
High volume, price sensitive Regular Proxies

Key Guidelines

For code examples in Python, Node.js, PHP, Go, Java, and C#, see examples.md.