Does australia.gov.au allow AI crawlers?
Live robots.txt, llms.txt, and ai.txt verdict for australia.gov.au. We report stated policy, not enforcement.
Machine-readable JSON/api/ai-crawler-access/site?domain=australia.gov.auFAQ
- Does australia.gov.au block GPTBot?
- The verdict above reads australia.gov.au's live robots.txt for OpenAI's GPTBot. We report the stated policy in robots.txt, not whether the bot honors it. Compliance is voluntary.
- What does "partial" mean?
- Partial means australia.gov.au disallows the bot from some paths but not the site root. Blocked means the root is disallowed. Unknown means the robots.txt could not be read.
- How fresh is this?
- TensorFeed re-crawls each tracked domain on a weekly rolling cadence. The last-checked time is shown with the verdict.