Skip to content
All systems operational0 AI providers monitored, polled every 2 minutes
Live status

Does huggingface.co allow AI crawlers?

Live robots.txt, llms.txt, and ai.txt verdict for huggingface.co. We report stated policy, not enforcement.

Machine-readable JSON/api/ai-crawler-access/site?domain=huggingface.co

FAQ

Does huggingface.co block GPTBot?
The verdict above reads huggingface.co's live robots.txt for OpenAI's GPTBot. We report the stated policy in robots.txt, not whether the bot honors it. Compliance is voluntary.
What does "partial" mean?
Partial means huggingface.co disallows the bot from some paths but not the site root. Blocked means the root is disallowed. Unknown means the robots.txt could not be read.
How fresh is this?
TensorFeed re-crawls each tracked domain on a weekly rolling cadence. The last-checked time is shown with the verdict.