AI crawler blocker

Block AI crawlers without buying an enterprise WAF.

A low-cost AI crawler defense layer for site owners who need visibility, logging, challenge, and block controls before content is served.

Start setupOpen quickstart
AI crawler blockerAI bot blockerblock AI crawlersClaudeBot blocker

Designed for AI crawler pressure

AI crawlers often arrive as known user agents, bare HTTP clients, headless browsers, or high-rate path probes. Voidek scores those signals before your protected route returns content.

Keep search engines separate

Known search engines can be tagged separately from AI crawlers, so site owners can allow Googlebot while blocking or challenging unwanted model-training and content-copying traffic.

Start in monitor mode

Use monitor mode to see which crawlers are hitting your site, then switch specific traffic classes to challenge or block when the decision logs look clean.

Detection proof

AI Crawler Blocker signals Voidek can separate before content is served.

Use these examples as rollout checks: start in monitor mode, confirm the log rows, then enforce only the classes that match your protected routes.

AI crawler UAGPTBot, ClaudeBot, PerplexityBotLog first, then block or challenge
Search crawlerGooglebotTag separately and allow by default
Unknown fetcherBare HTTP client on protected contentScore with route and header context

Rollout path

Start with one protected site, one test request, and one Analytics row.

Voidek is meant to start quietly: save the runtime key, run a controlled test, then raise friction only where live logs support it.

01

Add one protected site

Create a personal account on the Free plan, add one protected site, and save the runtime key before turning on AI crawler blocker.

02

Run the test decision

Copy the test request, export VOIDEK_API_KEY, then confirm the GPTBot row appears in Analytics with path, action, and score.

03

Enforce by route

Add the decision API at middleware or backend boundaries, then tune block AI crawlers after live rows look clean.

Related crawler defense pages
ProofPublic proof matrixReplay evidence, decisions, and limits.GuideGPTBot Blockerblock GPTBot · GPTBot robots.txt alternativeGuideScraper ProtectionPython requests blocker · Selenium detectionGuideCrawler Defensecrawler protection · crawler blocking APIGuideWebsite Crawler Blockerblock website crawlers · crawler blocker for website

FAQ

Questions site owners ask before turning on crawler defense.

Can Voidek block GPTBot and ClaudeBot?

Yes. Voidek detects common AI crawler user agents and combines them with browser, header, route, and rate signals before returning allow, log, challenge, or block.

Will this block Googlebot?

Voidek tags known search-engine traffic separately so Googlebot can remain allowed while AI crawlers and scraper tooling are challenged or blocked.

First setup

Set up one protected site before the next crawl spike.

Create a personal account, add one protected site, copy the runtime key, and run one test decision before enforcing AI crawler blocker.

Start protected site setupOpen quickstart