pornhub.org
As of Nov 6, 2026, pornhub.org's robots.txt blocks Anthropic-ai, CCBot, Amazonbot, and Bytespider.
Checked daily since Oct 31, 2026. JSON. Link to this check. Run this site? Remove or correct this report.
Checked Nov 6, 2026, 17:23 UTC
| File | Status | What the robot saw | Same since |
|---|---|---|---|
| ads.txt | NOT_FOUND | Not found. The site answered 404. | 2026-10-31, first check |
| app-ads.txt | NOT_FOUND | Not found. The site answered 404. | 2026-11-03, first check |
| sellers.json | NOT_FOUND | Not found. The site answered 404. | 2026-11-05, first check |
| robots.txt | SUCCESS | 16 rules for 4 AI crawlers. Blocks Anthropic-ai, CCBot, Amazonbot, and Bytespider. | 2026-11-06, first check |
| llms.txt | NOT_FOUND | Not found. The site answered 404. | 2026-11-06, first check |
| DMARC | NOT_FOUND | No DMARC record. | 2026-11-06, first check |
| MTA-STS | NOT_FOUND | No MTA-STS record. | 2026-11-06, first check |
| BIMI | NOT_FOUND | No BIMI record. | 2026-11-06, first check |
| security.txt | NOT_FOUND | Not found. The site answered 404. | 2026-11-06, first check |
These are the site's own public files, as fetched, with the date. The robot reports what is published. It does not judge compliance, approval, or intent. A failed fetch is a failed fetch, never a missing file.
Not checked: anything behind a login, account settings, or private feeds. Whether crawlers obey robots.txt. Business deals: a file line is not a contract.