Census fetched 2026-09-30 · population: CISA dotgov-data current-full.csv (all registered .gov domains) · datasets (CC BY 4.0) · live changes
The government web census, September 2026: what 16,783 .gov domains publish for people, security researchers and AI agents
Every registered .gov domain in CISA's public list (16,783 domains: federal, state, county, city, tribal, school and special districts) was fetched once over HTTPS on 2026-09-30, with robots.txt, security.txt (both locations), llms.txt and the A2A agent card. 13,060 answered with a website; the rest are registered for email or internal use, are not yet live, or blocked our one polite request.
Reachable over HTTPS
77.8%
13,060 of 16,783 .gov domains
security.txt
2.6%
343 of reachable sites; 150 complete and current
Accessibility statement linked
43.3%
5,660 homepages
Privacy policy linked
34.5%
4,501 homepages
Block GPTBot
524
396 block ChatGPT-User; 504 ClaudeBot
llms.txt
718
1 publish an A2A agent card
What we found
- security.txt: 343 of 13,060 reachable sites (2.6%) publish one; 150 are complete and current (a Contact line and an unexpired Expires line, RFC 9116); 63 have expired; 29 serve it only at /security.txt instead of /.well-known/security.txt.
- Accessibility: 43.3% of reachable sites link an accessibility statement from the homepage.
- Privacy: 34.5% link a privacy policy from the homepage; 8.1% link FOIA or public-records information.
- HTTPS: 13,060 of 16,783 domains (77.8%) answered over HTTPS; 739 answer only over plain HTTP; 36.3% of reachable sites send HSTS; 679 homepages redirect to a different domain.
- AI crawlers and assistants: 9,777 sites serve a robots.txt; 524 block GPTBot, 504 ClaudeBot and 396 ChatGPT-User; 361 disallow every bot; 888 name an AI crawler explicitly; 126 carry a Content-Signal line.
- Machine-readable surfaces: 718 publish an llms.txt and 1 an A2A agent card; 2,845 homepages carry schema.org structured data.
Live re-checks
Since 2026-10-01 this host has re-checked 10,905 .gov domains (a rotating slice every 6 hours, each domain at most once per 14 days; last run 2026-10-25 18:27 UTC) and recorded 3,531 changes against the census records. What changed · Atom feed · live.json.
By level of government
| Level of government | In list | Reachable | security.txt | valid | privacy link | accessibility link | HSTS | blocks GPTBot | blocks ChatGPT-User | llms.txt | agent card |
|---|---|---|---|---|---|---|---|---|---|---|---|
| City | 9,467 | 7,667 (81.0%) | 166 (2.2%) | 69 | 32.2% | 43.3% | 28.9% | 314 | 235 | 436 | 0 |
| County | 3,016 | 2,291 (76.0%) | 25 (1.1%) | 13 | 30.2% | 44.8% | 30.4% | 105 | 77 | 127 | 1 |
| State or territory | 1,483 | 992 (66.9%) | 58 (5.8%) | 20 | 38.0% | 41.4% | 44.4% | 43 | 34 | 34 | 0 |
| Federal | 1,317 | 992 (75.3%) | 74 (7.5%) | 41 | 55.5% | 51.0% | 88.2% | 43 | 41 | 18 | 0 |
| Special district | 1,102 | 858 (77.9%) | 13 (1.5%) | 5 | 41.4% | 40.4% | 47.4% | 13 | 6 | 88 | 0 |
| Tribal | 293 | 191 (65.2%) | 2 (1.0%) | 1 | 18.3% | 12.6% | 37.2% | 4 | 1 | 14 | 0 |
| School district | 74 | 43 (58.1%) | 5 (11.6%) | 1 | 34.9% | 48.8% | 55.8% | 2 | 2 | 1 | 0 |
| Other | 31 | 26 (83.9%) | 0 (0.0%) | 0 | 38.5% | 30.8% | 30.8% | 0 | 0 | 0 | 0 |
One page per level of government with its domains: https://gov.agentexchange.work/by-level-of-government.
By state
States with at least 20 .gov domains in the list; percentages are of reachable sites.
| State | In list | Reachable | security.txt | accessibility link | blocks GPTBot |
|---|---|---|---|---|---|
| New York | 1,367 | 1,174 (85.9%) | 16 | 35.1% | 42 |
| District of Columbia | 937 | 699 (74.6%) | 49 | 51.6% | 38 |
| California | 868 | 648 (74.7%) | 14 | 50.5% | 17 |
| Wisconsin | 811 | 655 (80.8%) | 11 | 52.5% | 33 |
| Texas | 690 | 552 (80.0%) | 8 | 54.9% | 17 |
| Ohio | 643 | 470 (73.1%) | 18 | 30.4% | 8 |
| Michigan | 631 | 496 (78.6%) | 4 | 27.0% | 27 |
| Minnesota | 601 | 520 (86.5%) | 1 | 46.0% | 68 |
| Florida | 534 | 409 (76.6%) | 7 | 62.1% | 19 |
| Illinois | 434 | 327 (75.3%) | 10 | 33.3% | 8 |
| Utah | 400 | 361 (90.3%) | 7 | 44.9% | 14 |
| North Carolina | 391 | 311 (79.5%) | 6 | 48.9% | 17 |
| Pennsylvania | 380 | 292 (76.8%) | 6 | 32.5% | 13 |
| Arkansas | 374 | 228 (61.0%) | 18 | 35.1% | 5 |
| Tennessee | 351 | 267 (76.1%) | 8 | 40.1% | 7 |
| Massachusetts | 350 | 287 (82.0%) | 5 | 67.2% | 3 |
| Georgia | 345 | 279 (80.9%) | 9 | 41.2% | 9 |
| Missouri | 330 | 238 (72.1%) | 7 | 34.5% | 4 |
| New Jersey | 312 | 240 (76.9%) | 3 | 44.2% | 12 |
| Virginia | 309 | 220 (71.2%) | 10 | 46.8% | 6 |
| Oregon | 290 | 227 (78.3%) | 6 | 46.7% | 18 |
| Colorado | 278 | 209 (75.2%) | 7 | 67.9% | 5 |
| Oklahoma | 264 | 156 (59.1%) | 4 | 48.7% | 4 |
| Alabama | 252 | 178 (70.6%) | 1 | 25.8% | 4 |
| Washington | 249 | 198 (79.5%) | 6 | 54.0% | 9 |
| Maryland | 247 | 208 (84.2%) | 5 | 49.5% | 7 |
| Arizona | 229 | 196 (85.6%) | 7 | 32.7% | 4 |
| Kansas | 227 | 174 (76.7%) | 6 | 35.6% | 3 |
| Kentucky | 222 | 165 (74.3%) | 2 | 21.2% | 5 |
| Iowa | 211 | 160 (75.8%) | 30 | 43.1% | 11 |
| New Hampshire | 204 | 164 (80.4%) | 3 | 39.0% | 5 |
| Connecticut | 182 | 144 (79.1%) | 2 | 55.6% | 2 |
| West Virginia | 155 | 104 (67.1%) | 1 | 24.0% | 1 |
| Nebraska | 151 | 122 (80.8%) | 1 | 25.4% | 0 |
| Indiana | 148 | 105 (70.9%) | 0 | 49.5% | 1 |
| South Carolina | 143 | 112 (78.3%) | 1 | 34.8% | 2 |
| Montana | 135 | 102 (75.6%) | 5 | 50.0% | 2 |
| Maine | 129 | 108 (83.7%) | 0 | 37.0% | 5 |
| Mississippi | 128 | 74 (57.8%) | 1 | 20.3% | 1 |
| Louisiana | 124 | 86 (69.4%) | 2 | 39.5% | 3 |
| New Mexico | 107 | 93 (86.9%) | 1 | 33.3% | 2 |
| Idaho | 97 | 68 (70.1%) | 5 | 36.8% | 3 |
| Vermont | 90 | 79 (87.8%) | 0 | 41.8% | 9 |
| Wyoming | 79 | 56 (70.9%) | 0 | 39.3% | 1 |
| South Dakota | 64 | 50 (78.1%) | 2 | 18.0% | 3 |
| Alaska | 62 | 45 (72.6%) | 0 | 26.7% | 3 |
| Rhode Island | 58 | 48 (82.8%) | 2 | 41.7% | 2 |
| North Dakota | 51 | 38 (74.5%) | 5 | 52.6% | 6 |
| Nevada | 49 | 38 (77.6%) | 0 | 50.0% | 0 |
| Delaware | 23 | 19 (82.6%) | 1 | 63.2% | 0 |
Ranked table and one page per state with its domains: https://gov.agentexchange.work/by-state.
Named lists
Federal domains without a security.txt (first 60 of 400)
acus.gov · arctic.gov · goldwaterinternship.gov · afrh.gov · arc.gov · ffiec.gov · access-board.gov · abmc.gov · fbiic.gov · whistleblower.gov · billetes.gov · americorps.gov · joinamericorps.gov · nationalservice.gov · mlkday.gov · goldwaterscholarship.gov · fedpartnership.gov · federalreserve.gov · cia.gov · smartcheck.gov · cftc.gov · asc.gov · mentor.gov · serve.gov · dnfsb.gov · aicenter.gov · presidentialserviceawards.gov · anchorit.gov · recalls.gov · aiexports.gov · saferproducts.gov · eda.gov · aviationweather.gov · pandemicoversight.gov · heat.gov · oasis.gov · dietaryguidelines.gov · nafri.gov · ars-grin.gov · usda.gov · farmerfairness.gov · symbols.gov · myplate.gov · safetyvideos.gov · bea.gov · mbda.gov · climate.gov · csb.gov · nwcg.gov · coldcaserecords.gov · uscurrency.gov · saferproduct.gov · firstnet.gov · lcacommons.gov · rural.gov · federalreserveconsumerhelp.gov · mgi.gov · xd.gov · poolsafely.gov · edison.gov
Federal domains with an expired security.txt (21)
cpsc.gov · atvsafety.gov · drywallresponse.gov · seguridadconsumidor.gov · hanford.gov · healthypeople.gov · healthfinder.gov · bsee.gov · boem.gov · anstaskforce.gov · fws.gov · rivers.gov · vets.gov · va.gov · ecpic.gov · fmi.gov · faca.gov · gsa.gov · sftool.gov · pbrb.gov · usccr.gov
Sites publishing an llms.txt (first 60 of 718)
adriantownshipwi.gov · adriantwpmi.gov · alberttwpmi.gov · almacenterwi.gov · abitaspringsla.gov · amalgautah.gov · altontownshipil.gov · alvo.gov · argonnewi.gov · barringtontwpil.gov · annettatx.gov · aspinwallpa.gov · ashtonid.gov · arroyopr.gov · bearriverwy.gov · beavertwp-oh.gov · belgiumwi.gov · auburnmi.gov · beechgrove.gov · assyriatwpmi.gov · birchlaketownshipmn.gov · ausabletwp-mi.gov · bishophillil.gov · bluefieldwv.gov · bethelparkpa.gov · arcadami.gov · bloomingdaletownshipmi.gov · bloomingdalevillagemi.gov · bogotanj.gov · bogotapolicenj.gov · blanding-ut.gov · bloomingdale-ga.gov · brackettvilletx.gov · bradfordme.gov · bridgeportne.gov · brinkhaven.gov · bristoltownshipohio.gov · brooklyntownwashburnwi.gov · bucklinmo.gov · burnham-il.gov · caledoniaoh.gov · camptontownshipil.gov · camdenairportar.gov · cantontwp-oh.gov · carlisletwpoh.gov · cavaliernd.gov · charlestonar.gov · centerpolicebcpa.gov · charlestontn.gov · chesterfieldny.gov · chimneyrockvillagenc.gov · childresstexas.gov · chestnuthilltwp-pa.gov · cityofbullshoals.gov · cityofchinagrovetx.gov · cityofcasa.gov · cityofconcordga.gov · cityofdiamondheadar.gov · cityofeuporams.gov · cityofcharlottetn.gov
Sites publishing an A2A agent card (1)
Sites telling ChatGPT-User and Claude-User not to open pages for users (first 60 of 300)
aftonmn.gov · alton-tx.gov · appletonmn.gov · booneiowa.gov · atwatermn.gov · baraboowi.gov · belgradecitymn.gov · averytx.gov · belleplaineiowa.gov · beloitwi.gov · blackbrookwi.gov · bolingbrook.gov · brahammn.gov · bethlehemnj.gov · bradentonfl.gov · brockwaytwpmn.gov · braselton.gov · brunswickmd.gov · brysoncitync.gov · camarillo.gov · byesvilleoh.gov · canyonlakeca.gov · cedarpointnc.gov · charlestownri.gov · chattahoocheefl.gov · centralcityia.gov · cedartowngeorgia.gov · chathamnewyork.gov · chiltonwi.gov · circlepinesmn.gov · cityofbensonmn.gov · cityofbyronmn.gov · cityofclaremontmn.gov · cityofclearlakemn.gov · cityofcorningny.gov · cityofclevelandmn.gov · cityofguttenbergia.gov · cityofkenyon.gov · cityoflagrangemo.gov · cityofmarionwi.gov · cityoflisbon-ia.gov · cityofottawail.gov · cityofoneontany.gov · cityofnisswa.gov · cityofredding.gov · cityofpinerivermn.gov · cityofnewlondonmn.gov · cityofroyaltonmn.gov · cityofsheridanar.gov · cityofsalemsd.gov · cityofstboni.gov · cityofwanamingo.gov · cityofvalleyspringssd.gov · cityofwarrenpa.gov · clearwatercitymn.gov · cliffsideparknj.gov · coldspringmn.gov · columbiaheightsmn.gov · columbusmn.gov · covingtonwa.gov
Homepages that redirect to another domain (first 60 of 300)
abitaspringsla.gov → www.townofabitasprings.com · annettatx.gov → www.annettatx.org · ansoniahousing.gov → www.ansoniahousing.com · ashtonid.gov → cityofashton.com · alpharettaga.gov → www.alpharetta.ga.us · athelstanewiclerk.gov → www.athelstanewi.com · arkansascityks.gov → www.arkcity.org · alachuapd.gov → www.cityofalachua.com · apexnc.gov → www.apexnc.org · applevalleyca.gov → applevalley.org · acushnet.gov → acushnet.ma.us · annapolismo.gov → www.annapolismo.com · ancramny.gov → www.ancramny.org · beckermn.gov → ci.becker.mn.us · bedfordboroughpa.gov → www.bedboro.com · argosin.gov → www.townofargos.com · beechgrove.gov → www.beechgrove.com · barnesvillega.gov → www.cityofbarnesville.com · averytx.gov → averytx.com · athenstn.gov → cityofathenstn.com · bedfordtwppa.gov → bedfordtwppagov.com · ballgroundga.gov → cityofballground.com · barnesvilleohio.gov → barnesvilleohio.com · bettendorf.gov → www.bettendorf.org · bellinghamwa.gov → cob.org · bellefontepa.gov → bellefonte.net · bentonwi.gov → bentonwi.us · bethlehemny.gov → www.townofbethlehem.org · berlintwphcoh.gov → www.berlintownshipohio.com · boerne-tx.gov → www.ci.boerne.tx.us · bluespringsmo.gov → www.bluespringsgov.com · bethlehemnj.gov → bethlehemnj.org · bozrahct.gov → townofbozrah.org · blythega.gov → cityofblythega.com · bradentonfl.gov → cityofbradenton.com · bridgetonmo.gov → www.bridgetonmo.com · brightonvt.gov → brightonvt.org · brightonnypolice.gov → crimewatch.net · brookfieldcitymo.gov → brookfieldcity.com · burrillvilleri.gov → www.burrillville.org · calabasasca.gov → www.cityofcalabasas.com · burtchvillemi.gov → burtchville.org · carpentersvilleil.gov → www.cville.org · carbondaleil.gov → www.explorecarbondale.com · cavecityarkansas.gov → www.cavecity.us · buchanantwpmi.gov → www.buchanantownship.net · chambleega.gov → www.chambleega.com · carterlake-ia.gov → cityofcarterlake.com · centralsquareny.gov → www.villageofcentralsquare.org · childresstexas.gov → www.cityofchildress.com · cityofalachua.gov → www.cityofalachua.com · cityofaventura.gov → www.cityofaventura.com · cityofbristowok.gov → www.cityofbristowok.org · cityofbowiemd.gov → www.cityofbowie.org · cityofbrunswick-ga.gov → www.brunswickga.org · cityofchetek-wi.gov → cityofchetekwi.us · cityofellisks.gov → ellis.ks.us · cityofengland.gov → cityofengland.com · cityofdelawareoh.gov → www.delawareohio.net · chathamtownship-nj.gov → chathamtownship.org
Sites with a Content-Signal line in robots.txt (first 60 of 100)
boonesmillva.gov · beechgrove.gov · belleislefl.gov · arthur-il.gov · bethelparkpa.gov · camdenairportar.gov · canbyoregon.gov · charlestontn.gov · cityofbayardnm.gov · cityofbullshoals.gov · cityofconcordga.gov · cityofcrosslake.gov · cityofcharlottetn.gov · cityofeuclid.gov · cityofforistellmo.gov · cityofhomer-ak.gov · cityofhornell.gov · cityofsanaugustinetx.gov · corvallisoregon.gov · cutlerbay-fl.gov · dawsonville-ga.gov · dodgevillewi.gov · digginsmo.gov · edgewood-fl.gov · exeternh.gov · farmington-mo.gov · fortrecoveryohio.gov · glencoeil.gov · hermiston.gov · hickorycreek-tx.gov · hillsborova.gov · hollandpatentny.gov · hudsontwplenaweemi.gov · ketchumok.gov · kirbyvt.gov · kpl.gov · lagrangeky.gov · langleyok.gov · lansingtownny.gov · leadingtonmo.gov · leavenworthks.gov · leroyil.gov · leonvalleytexas.gov · lincolnil.gov · lockhavenpa.gov · louisvilleny.gov · lunenburg-gilmanvt.gov · lowelloregon.gov · masspkny.gov · mcminnvilleoregon.gov · medina-wa.gov · markesanwi.gov · mercerisland.gov · marionny.gov · millswy.gov · milton-freewater-or.gov · oakleyut.gov · palmyramo.gov · paradiseca.gov · petersburgak.gov
Gap lists for vendors: who is missing which control
Each list is the .gov domains whose 2026-09-30 record lacks one control, with counts by state, the first 50 rows free, an Atom feed of who enters or leaves it, and the full CSV or JSON for 1.00 USDC (x402). All gap lists.
| List | .gov domains | Of the list | Who buys this |
|---|---|---|---|
| .gov domains without a security.txt | 12,717 | 75.8% | Security teams, vulnerability-disclosure and attack-surface vendors, MSPs serving state and local government. |
| .gov domains with an expired security.txt | 63 | 0.4% | Security teams and vulnerability-disclosure vendors: a lapsed file is a specific, verifiable conversation opener. |
| .gov domains without an accessibility statement on the homepage | 7,400 | 44.1% | Accessibility vendors and agencies (audits, remediation, statements) and government web platform vendors with WCAG offerings, while the ADA Title II deadlines run. |
| .gov domains without a privacy policy link on the homepage | 8,559 | 51.0% | Privacy-compliance vendors and agencies that write notices for public bodies. |
| .gov domains without HSTS | 8,322 | 49.6% | Security teams, MSPs and hosting or CDN vendors serving government sites. |
| .gov domains blocking both ChatGPT-User and Claude-User | 365 | 2.2% | AI-visibility vendors and digital agencies: these sites are closed to ChatGPT and Claude users. |
| .gov domains answering only over plain HTTP | 739 | 4.4% | MSPs, hosting and web agencies serving small governments: sites still without working HTTPS. |
| .gov domains whose homepage redirects to another domain | 1,492 | 8.9% | Web agencies and domain-consolidation vendors, security teams checking .gov names that point elsewhere. |
What .gov domains are expected to publish
- CISA BOD 20-01: vulnerability disclosure policy and security.txt: Federal civilian executive-branch agencies must publish a vulnerability disclosure policy and a security.txt file on their .gov domains (Binding Operational Directive 20-01, September 2020). The census reads /.well-known/security.txt and /security.txt and checks the Contact and Expires lines that RFC 9116 requires. Source
- ADA Title II web rule (WCAG 2.1 Level AA): State and local governments must make their web content and mobile apps conform to WCAG 2.1 Level AA: public entities serving 50,000 or more people from April 24, 2026, smaller entities and special districts from April 26, 2027 (28 CFR Part 35, subpart H). The census checks only whether the homepage links an accessibility statement. Source
- HTTPS and HSTS on federal websites (OMB M-15-13): Federal agencies must serve public websites over HTTPS and send HSTS (OMB memorandum M-15-13, June 2015). The census records HSTS on the final response of the homepage fetch and counts domains that answer only over plain HTTP. Source
- Freedom of Information Act (5 U.S.C. 552): Federal agencies must make records available on request and post frequently requested records online; FOIA.gov lists every agency's request contact. The census counts a homepage link or text mentioning FOIA; state and local public-records laws vary. Source
- 21st Century IDEA and OMB M-23-22: Federal executive agencies' public websites must be accessible, mobile friendly, consistent, searchable and secure (21st Century Integrated Digital Experience Act, 2018; OMB M-23-22 guidance, September 2023). Source
- RFC 9116 security.txt: The security.txt standard (April 2022) defines the /.well-known/security.txt location and requires Contact and Expires fields. The census marks a file complete when both are present and the Expires date has not passed. Source
Look up any .gov domain
Questions
How many .gov websites publish a security.txt?
343 of the 13,060 reachable .gov websites (2.6%) publish a security.txt; 150 are complete and current and 63 have expired. Federal figures are in the table by level of government.
How many .gov sites block AI crawlers?
524 block GPTBot, 504 block ClaudeBot and 396 block ChatGPT-User in robots.txt; 361 disallow every bot. 888 name at least one AI crawler explicitly and 126 carry a Content-Signal line. Blocking is a choice, not a defect; each domain page shows the verdict per agent.
Do government websites link an accessibility statement?
43.3% of reachable .gov homepages link an accessibility statement and 34.5% link a privacy policy. The ADA Title II web rule applies to public entities serving 50,000 or more people from April 24, 2026 and to smaller entities from April 26, 2027.
Where does the list of .gov domains come from?
From CISA's public dotgov-data repository (current-full.csv), which lists every registered .gov domain with its type, organization, city and state: 16,783 domains on 2026-09-30. Domains registered only for email or internal use appear as unreachable.
Can I reuse the data?
Yes. The findings, the CSV and every per-domain JSON record are published under CC BY 4.0; cite Agent Exchange and link the report.
Method and limits
Population: CISA dotgov-data current-full.csv (all registered .gov domains) with each domain's type, organization, city and state as registered.. Fetch: one HTTPS request to the apex (then www.), following redirects, 8-second timeout, user agent agentexchange-census/1.0; then robots.txt, /.well-known/security.txt, /security.txt, /llms.txt and /.well-known/agent-card.json on the final host. "Reachable" means any HTTP response over HTTPS, including 403s from bot protection. Homepage links are detected from anchor targets and visible text, so a policy that exists but is not linked from the homepage is not counted. A robots.txt "blocked" verdict means the agent's own group (or the * group) disallows the whole site; "partly blocked" means some paths are disallowed. One snapshot per domain; slow sites and sites that block automated requests are counted as unreachable or reachable-with-error as the server answered. Live re-checks: every 6 hours this host re-fetches the homepage, robots.txt, security.txt and llms.txt of a rotating slice of up to 120 domains (each domain at most once per 14 days, same rules and user agent) and records any difference from the census record on the domain page and in the changes list; a 403, 429 or 503 to our request is recorded as inconclusive, not as a change. Per-domain records: lookup; downloads: CSV, NDJSON and JSON (CC BY 4.0).
Run one of these sites?
$49 full report or $99 monthly monitoring · Hosted accessibility feedback and privacy request desk
Other censuses
World government web census · Top 100,000 websites census · US bank web census · US credit union web census · US college web census · US school district web census · World university web census · Every Agent Exchange property (network map) · Agent-readiness grade and fix guides · Compliance Desk: hosted request processes · MCP registry integrity report · Agent Economy Index (daily x402 and MCP census) · Agent Exchange directory (x402 store)