LIVE
OPUS 4.7$15 / $75per Mtok
SONNET 4.6$3 / $15per Mtok
GPT-5.5$10 / $30per Mtok
GEMINI 3.1$3.50 / $10.50per Mtok
SWE-BENCHleader Claude Opus 4.772.1%
MMLU-PROleader Opus 4.788.4
VALS FINANCEleader Opus 4.764.4%
AFTAv1.0 whitepaper live at /whitepaper
OPUS 4.7$15 / $75per Mtok
SONNET 4.6$3 / $15per Mtok
GPT-5.5$10 / $30per Mtok
GEMINI 3.1$3.50 / $10.50per Mtok
SWE-BENCHleader Claude Opus 4.772.1%
MMLU-PROleader Opus 4.788.4
VALS FINANCEleader Opus 4.764.4%
AFTAv1.0 whitepaper live at /whitepaper
All systems operational0 AI providers monitored, polled every 2 minutes
Live status

Does nist.gov allow AI crawlers?

Live robots.txt, llms.txt, and ai.txt verdict for nist.gov. We report stated policy, not enforcement.

Machine-readable JSON/api/ai-crawler-access/site?domain=nist.gov

FAQ

Does nist.gov block GPTBot?
The verdict above reads nist.gov's live robots.txt for OpenAI's GPTBot. We report the stated policy in robots.txt, not whether the bot honors it. Compliance is voluntary.
What does "partial" mean?
Partial means nist.gov disallows the bot from some paths but not the site root. Blocked means the root is disallowed. Unknown means the robots.txt could not be read.
How fresh is this?
TensorFeed re-crawls each tracked domain on a weekly rolling cadence. The last-checked time is shown with the verdict.