Government web census · gap lists · census 2026-09-30 · JSON (top 50) · feed
.gov domains blocking both ChatGPT-User and Claude-User
365 of the 16,783 .gov domains in the census list (2.2%; 2.8% of the 13,060 reachable over HTTPS), as fetched on 2026-09-30.
On this list
365
of 16,783 .gov domains
Share of the list
2.2%
2.8% of reachable sites
States
41
largest: Minnesota (65)
Full list
1.00 USDC
x402, per file; first 50 rows free
What this gap means
robots.txt disallows both ChatGPT-User and Claude-User for the whole site, so neither assistant will open its pages for a user who asks.
Control: robots.txt verdicts for ChatGPT-User and Claude-User. Rule: blocks_assistants over the census record (reachable sites only). Who buys this: AI-visibility vendors and digital agencies: these sites are closed to ChatGPT and Claude users.
This list maps to no legal obligation in this census; it is a gap in published practice.
By state
41 states with at least one .gov domain on this list; "of the state" is the share of its .gov domains in the census list. One state as CSV: 0.25 USDC (x402).
| State | On this list | Of the state | CSV (x402) |
|---|---|---|---|
| Minnesota (report) | 65 | 10.8% | https://gov.agentexchange.work/leads/blocks-assistants/state/MN.csv · card $9 |
| District of Columbia (report) | 32 | 3.4% | https://gov.agentexchange.work/leads/blocks-assistants/state/DC.csv · card $9 |
| New York (report) | 30 | 2.2% | https://gov.agentexchange.work/leads/blocks-assistants/state/NY.csv · card $9 |
| Wisconsin (report) | 29 | 3.6% | https://gov.agentexchange.work/leads/blocks-assistants/state/WI.csv · card $9 |
| Florida (report) | 15 | 2.8% | https://gov.agentexchange.work/leads/blocks-assistants/state/FL.csv · card $9 |
| Michigan (report) | 12 | 1.9% | https://gov.agentexchange.work/leads/blocks-assistants/state/MI.csv · card $9 |
| Texas (report) | 12 | 1.7% | https://gov.agentexchange.work/leads/blocks-assistants/state/TX.csv · card $9 |
| Iowa (report) | 11 | 5.2% | https://gov.agentexchange.work/leads/blocks-assistants/state/IA.csv · card $9 |
| North Carolina (report) | 11 | 2.8% | https://gov.agentexchange.work/leads/blocks-assistants/state/NC.csv · card $9 |
| New Jersey (report) | 10 | 3.2% | https://gov.agentexchange.work/leads/blocks-assistants/state/NJ.csv · card $9 |
| Oregon (report) | 8 | 2.8% | https://gov.agentexchange.work/leads/blocks-assistants/state/OR.csv · card $9 |
| Pennsylvania (report) | 8 | 2.1% | https://gov.agentexchange.work/leads/blocks-assistants/state/PA.csv · card $9 |
| California (report) | 6 | 0.7% | https://gov.agentexchange.work/leads/blocks-assistants/state/CA.csv · card $9 |
| North Dakota (report) | 6 | 11.8% | https://gov.agentexchange.work/leads/blocks-assistants/state/ND.csv · card $9 |
| Vermont (report) | 6 | 6.7% | https://gov.agentexchange.work/leads/blocks-assistants/state/VT.csv · card $9 |
| Colorado (report) | 5 | 1.8% | https://gov.agentexchange.work/leads/blocks-assistants/state/CO.csv · card $9 |
| Maine (report) | 5 | 3.9% | https://gov.agentexchange.work/leads/blocks-assistants/state/ME.csv · card $9 |
| Illinois (report) | 4 | 0.9% | https://gov.agentexchange.work/leads/blocks-assistants/state/IL.csv · card $9 |
| New Hampshire (report) | 4 | 2.0% | https://gov.agentexchange.work/leads/blocks-assistants/state/NH.csv · card $9 |
| Ohio (report) | 4 | 0.6% | https://gov.agentexchange.work/leads/blocks-assistants/state/OH.csv · card $9 |
| Tennessee (report) | 4 | 1.1% | https://gov.agentexchange.work/leads/blocks-assistants/state/TN.csv · card $9 |
| Utah (report) | 4 | 1.0% | https://gov.agentexchange.work/leads/blocks-assistants/state/UT.csv · card $9 |
| Washington (report) | 4 | 1.6% | https://gov.agentexchange.work/leads/blocks-assistants/state/WA.csv · card $9 |
| Alabama (report) | 3 | 1.2% | https://gov.agentexchange.work/leads/blocks-assistants/state/AL.csv · card $9 |
| Arkansas (report) | 3 | 0.8% | https://gov.agentexchange.work/leads/blocks-assistants/state/AR.csv · card $9 |
| Arizona (report) | 3 | 1.3% | https://gov.agentexchange.work/leads/blocks-assistants/state/AZ.csv · card $9 |
| Georgia (report) | 3 | 0.9% | https://gov.agentexchange.work/leads/blocks-assistants/state/GA.csv · card $9 |
| Idaho (report) | 3 | 3.1% | https://gov.agentexchange.work/leads/blocks-assistants/state/ID.csv · card $9 |
| Massachusetts (report) | 3 | 0.9% | https://gov.agentexchange.work/leads/blocks-assistants/state/MA.csv · card $9 |
| Maryland (report) | 3 | 1.2% | https://gov.agentexchange.work/leads/blocks-assistants/state/MD.csv · card $9 |
| Missouri (report) | 3 | 0.9% | https://gov.agentexchange.work/leads/blocks-assistants/state/MO.csv · card $9 |
| Oklahoma (report) | 3 | 1.1% | https://gov.agentexchange.work/leads/blocks-assistants/state/OK.csv · card $9 |
| South Dakota (report) | 3 | 4.7% | https://gov.agentexchange.work/leads/blocks-assistants/state/SD.csv · card $9 |
| Virginia (report) | 3 | 1.0% | https://gov.agentexchange.work/leads/blocks-assistants/state/VA.csv · card $9 |
| Kentucky (report) | 2 | 0.9% | https://gov.agentexchange.work/leads/blocks-assistants/state/KY.csv · card $9 |
| Louisiana (report) | 2 | 1.6% | https://gov.agentexchange.work/leads/blocks-assistants/state/LA.csv · card $9 |
| Montana (report) | 2 | 1.5% | https://gov.agentexchange.work/leads/blocks-assistants/state/MT.csv · card $9 |
| Rhode Island (report) | 2 | 3.4% | https://gov.agentexchange.work/leads/blocks-assistants/state/RI.csv · card $9 |
| Connecticut (report) | 1 | 0.5% | https://gov.agentexchange.work/leads/blocks-assistants/state/CT.csv · card $9 |
| New Mexico (report) | 1 | 0.9% | https://gov.agentexchange.work/leads/blocks-assistants/state/NM.csv · card $9 |
| South Carolina (report) | 1 | 0.7% | https://gov.agentexchange.work/leads/blocks-assistants/state/SC.csv · card $9 |
Free: the first 50 of 365 (alphabetical)
| Domain | Level of government | State | Census record |
|---|---|---|---|
| america.gov Department of State | Federal - Executive | DC | HTTP 403 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked |
| bondpro.gov Department of the Treasury | Federal - Executive | DC | HTTP 200 · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked |
| congress.gov Library of Congress | Federal - Legislative | DC | HTTP 403 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| dfafacts.gov Department of State | Federal - Executive | DC | HTTP 200 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked |
| ecfr.gov Government Publishing Office | Federal - Legislative | DC | HTTP 200 via unblock.federalregister.gov · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked |
| federalinvestments.gov Department of the Treasury | Federal - Executive | DC | HTTP 200 · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked |
| federalregister.gov Government Publishing Office | Federal - Legislative | DC | HTTP 200 via unblock.federalregister.gov · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked |
| fedinvest.gov Department of the Treasury | Federal - Executive | DC | HTTP 200 via treasurydirect.gov · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked |
| fgdc.gov Department of the Interior | Federal - Executive | DC | HTTP 200 · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked |
| fsd.gov General Services Administration | Federal - Executive | DC | HTTP 200 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked |
| fsgb.gov Department of State | Federal - Executive | DC | HTTP 200 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked |
| grantsolutions.gov Department of Health and Human Services | Federal - Executive | DC | HTTP 200 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked |
| hudhomestore.gov Department of Housing and Urban Development | Federal - Executive | DC | HTTP 200 · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked |
| iat.gov Department of the Interior | Federal - Executive | ID | HTTP 200 · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked |
| jimmycarterlibrary.gov National Archives and Records Administration | Federal - Executive | MD | HTTP 200 · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked |
| juntos.gov Department of Homeland Security | Federal - Executive | DC | HTTP 200 · HSTS yes · security.txt none · privacy no · accessibility yes · GPTBot blocked |
| max.gov Executive Office of the President | Federal - Executive | DC | HTTP 200 via portal.max.gov · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked |
| medicalcountermeasures.gov Department of Health and Human Services | Federal - Executive | Washington | HTTP 200 · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked |
| nicsezcheckfbi.gov Department of Justice | Federal - Executive | DC | HTTP 200 · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked |
| ppdcecc.gov United States House of Representatives | Federal - Legislative | DC | HTTP 200 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked |
| realestatesales.gov General Services Administration | Federal - Executive | DC | HTTP 200 · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked |
| savingsbond.gov Department of the Treasury | Federal - Executive | DC | HTTP 200 · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked |
| savingsbonds.gov Department of the Treasury | Federal - Executive | DC | HTTP 200 via treasurydirect.gov · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked |
| savingsbondwizard.gov Department of the Treasury | Federal - Executive | DC | HTTP 200 · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked |
| sciencebase.gov Department of the Interior | Federal - Executive | DC | HTTP 200 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked |
| slgs.gov Department of the Treasury | Federal - Executive | DC | HTTP 200 · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked |
| taaps.gov Department of the Treasury | Federal - Executive | DC | HTTP 200 · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked |
| together.gov Department of Homeland Security | Federal - Executive | DC | HTTP 200 · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked |
| treasuryauctions.gov Department of the Treasury | Federal - Executive | DC | HTTP 200 · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked |
| treasurydirect.gov Department of the Treasury | Federal - Executive | DC | HTTP 200 · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked |
| treasuryhunt.gov Department of the Treasury | Federal - Executive | DC | HTTP 200 via www.treasurydirect.gov · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked |
| treasuryscams.gov Department of the Treasury | Federal - Executive | DC | HTTP 200 via treasurydirect.gov · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked |
| uscongress.gov Library of Congress | Federal - Legislative | DC | HTTP 403 via www.congress.gov · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| vote.gov Election Assistance Commission | Federal - Executive | DC | HTTP 403 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| wizard.gov Department of the Treasury | Federal - Executive | DC | HTTP 200 via treasurydirect.gov · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked |
| alabamabuys.gov Purchasing Division of the Department of Finance | State or territory | AL | HTTP 200 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked |
| azarts.gov Arizona Commission on the Arts | State or territory | AZ | HTTP 200 · HSTS no · security.txt none · privacy yes · accessibility yes · GPTBot blocked |
| coda18.gov "Office of the District Attorney | State or territory | HTTP 200 via arapahoeco.gov · HSTS no · security.txt none · privacy no · accessibility yes · GPTBot blocked | |
| connectingcolorado.gov Colorado Department of Labor and Employment | State or territory | CO | HTTP 200 via myservices.connectingcolorado.gov · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| devazdot.gov Arizona Department of Transportation | State or territory | AZ | HTTP 200 · HSTS yes · security.txt none · privacy no · accessibility yes · GPTBot blocked |
| employnv.gov "State of Nevada | State or territory | Carson City | HTTP 200 · HSTS yes · security.txt none · privacy no · accessibility yes · GPTBot blocked |
| fdacs.gov Florida Department of Agriculture and Consumer Services | State or territory | FL | HTTP 200 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked |
| flcourts.gov Office of Information Technology | State or territory | FL | HTTP 200 · HSTS yes · security.txt none · privacy yes · accessibility yes · GPTBot blocked |
| fldoah.gov Florida Division of Administrative Hearings | State or territory | FL | HTTP 200 · HSTS no · security.txt none · privacy no · accessibility yes · GPTBot blocked |
| floridalobbyist.gov Office of Legislative Information Technology Services | State or territory | FL | HTTP 200 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked |
| frames.gov University of Idaho | State or territory | ID | HTTP 200 · HSTS no · security.txt none · privacy no · accessibility yes · GPTBot blocked |
| hireacoloradovet.gov Colorado Dept Labor and Employment | State or territory | CO | HTTP 200 · HSTS no · security.txt none · privacy no · accessibility no · GPTBot blocked |
| iowasexoffender.gov OCIO - State of Iowa | State or territory | IA | HTTP 200 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked |
| iowaworks.gov State of Iowa - OCIO | State or territory | IA | HTTP 200 · HSTS yes · security.txt none · privacy no · accessibility yes · GPTBot blocked |
| iowaworksforveterans.gov State of Iowa - OCIO | State or territory | IA | HTTP 200 · HSTS yes · security.txt none · privacy no · accessibility no · GPTBot blocked |
The same rows as JSON: blocks-assistants.top.json (CORS open, cached one day).
Get the full list: 365 rows, 1.00 USDC
x402 on Base, paid per file, no account or key. GET https://gov.agentexchange.work/leads/blocks-assistants.csv or GET https://gov.agentexchange.work/leads/blocks-assistants.json answers 402 Payment Required with the terms (scheme exact, USDC on Base, maxAmountRequired 1000000, payTo 0xc91cE6291eDC0713ec753BAFBA002506ffb2b95c); an x402 client signs the EIP-3009 authorization and resends the same request with X-PAYMENT; the file comes back with a PAYMENT-RESPONSE header. HEAD gets the same 402. One state: GET https://gov.agentexchange.work/leads/blocks-assistants/state/<code>.csv, 0.25 USDC (codes in the table above).
curl -sS -D - https://gov.agentexchange.work/leads/blocks-assistants.csv # 402 with the x402 terms; pay and resend with X-PAYMENT
Columns (18): domain, name, type, city, state, reachable, http_only, https_status, final_host, hsts, security_txt, privacy_link, accessibility_link, robots_gptbot, robots_chatgpt_user, robots_claude_user, llms_txt, title. CSV: header row, every cell quoted, yes/no for booleans. JSON: { list, title, count, by_state, columns, rows[][] }. Sizes: CSV 64 KB, JSON 65 KB. The same facts are in the free CC BY 4.0 dumps: the price buys the filtered, state-sliceable file built from the 2026-09-30 census, not exclusive data. Settlement is final; no refunds. Prices in /.well-known/x402 equal the challenges. Terms · pricing.
Card checkout
Pay with a card through Stripe and get the file on the next page: Full list CSV, $29 · JSON, $29 · one state $9 (links in the table below) · all 8 lists, $79. Agents pay less with x402 (see above).
Monitor this list (free)
Atom feed: .gov domains that entered or left this list according to the live re-checks (every 6 hours a rotating slice, each domain at most once per 14 days; each entry says which way it moved and which field changed). blocks-assistants.top.json: the first 50 rows and the counts by state as JSON, CORS open. Fields watched: robots, robots.ChatGPT-User, robots.Claude-User.
Membership reflects the homepage and well-known files as fetched on 2026-09-30: a control that exists but was not found where the census looked counts as missing, and sites answering 403 to our one polite request count as reachable. Every domain links to its record with what to fix, a JSON twin, a badge and a changes feed. Data licence CC BY 4.0. Not legal advice.