📦

io.github.sharozdawa/robotstxt-ai

Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.

0 installs

Trust: 37 — Low

Scraping

Ask AI about io.github.sharozdawa/robotstxt-ai

Powered by Claude · Grounded in docs

I know everything about io.github.sharozdawa/robotstxt-ai. Ask me about installation, configuration, usage, or troubleshooting.

0/500

Documentation

No README available