threads.com
As of Nov 6, 2026, threads.com's robots.txt blocks GPTBot, ClaudeBot, Google-Extended, PerplexityBot, and 2 more.
Checked daily since Nov 6, 2026. JSON. Link to this check. Run this site? Remove or correct this report.
Checked Nov 6, 2026, 16:57 UTC
| File | Status | What the robot saw | Same since |
|---|---|---|---|
| ads.txt | RESTRICTED | The site turned the robot away. No good check yet. | |
| app-ads.txt | RESTRICTED | The site turned the robot away. No good check yet. | |
| sellers.json | RESTRICTED | The site turned the robot away. No good check yet. | |
| robots.txt | SUCCESS | 6 rules for 6 AI crawlers. Blocks GPTBot, ClaudeBot, Google-Extended, PerplexityBot, and 2 more. | 2026-11-06, first check |
| llms.txt | RESTRICTED | The site turned the robot away. No good check yet. | |
| DMARC | NOT_FOUND | No DMARC record. | 2026-11-06, first check |
| MTA-STS | NOT_FOUND | No MTA-STS record. | 2026-11-06, first check |
| BIMI | NOT_FOUND | No BIMI record. | 2026-11-06, first check |
| security.txt | RESTRICTED | The site turned the robot away. No good check yet. |
These are the site's own public files, as fetched, with the date. The robot reports what is published. It does not judge compliance, approval, or intent. A failed fetch is a failed fetch, never a missing file.
Not checked: anything behind a login, account settings, or private feeds. Whether crawlers obey robots.txt. Business deals: a file line is not a contract.
Changed today
| otzads.net | ADDED | New sellers.json seller: zta3nre-t4ih5t90bmyogw308o0ir1d7c4sf | 00:15 UTC |
| otzads.net | ADDED | New sellers.json seller: zpaiqtj621u3l4pi2hs39b6l8eyxtnlx8-8r | 00:15 UTC |
| otzads.net | ADDED | New sellers.json seller: zJNjg7w-dsEe9Xn0BhfCoFOa62GyrQZc | 00:15 UTC |
| otzads.net | ADDED | New sellers.json seller: z06u0e991a1dn2hduh0bdc5v-l67hpneyzga | 00:15 UTC |