w.org
As of Nov 6, 2026, w.org's robots.txt allows GPTBot, ClaudeBot, anthropic-ai, Google-Extended, and 4 more.
Checked daily since Oct 31, 2026. JSON. Link to this check. Run this site? Remove or correct this report.
Checked Nov 6, 2026, 23:28 UTC
| File | Status | What the robot saw | Same since |
|---|---|---|---|
| ads.txt | NOT_FOUND | Not found. The site answered 404. | 2026-10-31, first check |
| app-ads.txt | NOT_FOUND | Not found. The site answered 404. | 2026-11-03, first check |
| sellers.json | NOT_FOUND | Not found. The site answered 404. | 2026-11-05, first check |
| robots.txt | SUCCESS | 8 rules for 8 AI crawlers. Allows GPTBot, ClaudeBot, anthropic-ai, Google-Extended, and 4 more. | 2026-11-06, first check |
| llms.txt | SUCCESS | Published. Title: WordPress. | 2026-11-06, first check |
| DMARC | SUCCESS | p=. Reports off. | 2026-11-06, first check |
| MTA-STS | UNAVAILABLE | The check failed. No good check yet. UNAVAILABLE, NOT AN ABSENCE | |
| BIMI | SUCCESS | Logo record published. | 2026-11-06, first check |
| security.txt | SUCCESS | Contact: https://hackerone.com/wordpress. Expires 2027-06-30. | 2026-11-06, first check |
These are the site's own public files, as fetched, with the date. The robot reports what is published. It does not judge compliance, approval, or intent. A failed fetch is a failed fetch, never a missing file.
Not checked: anything behind a login, account settings, or private feeds. Whether crawlers obey robots.txt. Business deals: a file line is not a contract.
Changed today
| pubnation.com | REMOVED | Dropped sellers.json seller: feb71e8078a7a2dcafa5ea96508db9c7 | 00:23 UTC |
| pubnation.com | REMOVED | Dropped sellers.json seller: de19f85f85a92b2807a2275defe5fa14 | 00:23 UTC |
| pubnation.com | REMOVED | Dropped sellers.json seller: db9421d59c7e562a0d62e0f948652a8e | 00:23 UTC |
| pubnation.com | REMOVED | Dropped sellers.json seller: cedde47a50b13a568f084530a0f983b1 | 00:23 UTC |