Scraper protection

Protect pages from Python requests, Selenium, Playwright, and headless browsers.

Lightweight scraper protection for sites that need crawler friction without a heavy enterprise security migration.

scraper protectionPython requests blockerSelenium detectionPlaywright bot detection

Catch common scraper clients

Voidek recognizes Python requests, curl, wget, axios, node-fetch, Selenium, Playwright, Puppeteer, HeadlessChrome, and bare Chromium patterns.

Verify real browsers

The browser snippet collects lightweight proof such as language, timezone, webdriver, plugins, screen, and token continuity so middleware can separate static fetches from real browser sessions.

Measure before blocking

Use decision logs and usage summaries to see which user agents, paths, and actions are most common before turning on stricter blocking rules.

Detection proof

Scraper Protection signals Voidek can separate before content is served.

Use these examples as rollout checks: start in monitor mode, confirm the log rows, then enforce only the classes that match your protected routes.

Script clientpython-requests, curl, ScrapyScore as scraper pressure
AutomationSelenium, Playwright, PuppeteerChallenge or block when confidence is high
Normal browserComplete browser headers and proofAllow while preserving logs

Rollout path

Start with one protected site, one test request, and one Analytics row.

Voidek is meant to start quietly: save the runtime key, run a controlled test, then raise friction only where live logs support it.

01

Add one protected site

Create a personal account on the Free plan, add one protected site, and save the runtime key before turning on scraper protection.

02

Run the test decision

Copy the test request, export VOIDEK_API_KEY, then confirm the GPTBot row appears in Analytics with path, action, and score.

03

Enforce by route

Add the decision API at middleware or backend boundaries, then tune Selenium detection after live rows look clean.

FAQ

Questions site owners ask before turning on crawler defense.

Can scrapers spoof their user agent?

Yes, so Voidek does not rely only on user-agent strings. It combines user-agent classification with browser signals, headers, route patterns, and recent request pressure.

Is Voidek a CAPTCHA?

No. Voidek is a crawler and scraper decision layer. It can challenge suspicious traffic, but its main job is to classify, log, and block automated requests before protected content is served.

First setup

Set up one protected site before the next crawl spike.

Create a personal account, add one protected site, copy the runtime key, and run one test decision before enforcing scraper protection.