Government web census

Census fetched 2026-09-30 · population: CISA dotgov-data current-full.csv (all registered .gov domains) · datasets (CC BY 4.0) · live changes

The government web census, September 2026: what 16,783 .gov domains publish for people, security researchers and AI agents

Every registered .gov domain in CISA's public list (16,783 domains: federal, state, county, city, tribal, school and special districts) was fetched once over HTTPS on 2026-09-30, with robots.txt, security.txt (both locations), llms.txt and the A2A agent card. 13,060 answered with a website; the rest are registered for email or internal use, are not yet live, or blocked our one polite request.

Reachable over HTTPS

77.8%

13,060 of 16,783 .gov domains

security.txt

2.6%

343 of reachable sites; 150 complete and current

Accessibility statement linked

43.3%

5,660 homepages

Privacy policy linked

34.5%

4,501 homepages

Block GPTBot

524

396 block ChatGPT-User; 504 ClaudeBot

llms.txt

718

1 publish an A2A agent card

What we found

Live re-checks

Since 2026-10-01 this host has re-checked 10,905 .gov domains (a rotating slice every 6 hours, each domain at most once per 14 days; last run 2026-10-25 18:27 UTC) and recorded 3,531 changes against the census records. What changed · Atom feed · live.json.

By level of government

Level of governmentIn listReachablesecurity.txtvalidprivacy linkaccessibility linkHSTSblocks GPTBotblocks ChatGPT-Userllms.txtagent card
City9,4677,667 (81.0%)166 (2.2%)6932.2%43.3%28.9%3142354360
County3,0162,291 (76.0%)25 (1.1%)1330.2%44.8%30.4%105771271
State or territory1,483992 (66.9%)58 (5.8%)2038.0%41.4%44.4%4334340
Federal1,317992 (75.3%)74 (7.5%)4155.5%51.0%88.2%4341180
Special district1,102858 (77.9%)13 (1.5%)541.4%40.4%47.4%136880
Tribal293191 (65.2%)2 (1.0%)118.3%12.6%37.2%41140
School district7443 (58.1%)5 (11.6%)134.9%48.8%55.8%2210
Other3126 (83.9%)0 (0.0%)038.5%30.8%30.8%0000

One page per level of government with its domains: https://gov.agentexchange.work/by-level-of-government.

By state

States with at least 20 .gov domains in the list; percentages are of reachable sites.

StateIn listReachablesecurity.txtaccessibility linkblocks GPTBot
New York1,3671,174 (85.9%)1635.1%42
District of Columbia937699 (74.6%)4951.6%38
California868648 (74.7%)1450.5%17
Wisconsin811655 (80.8%)1152.5%33
Texas690552 (80.0%)854.9%17
Ohio643470 (73.1%)1830.4%8
Michigan631496 (78.6%)427.0%27
Minnesota601520 (86.5%)146.0%68
Florida534409 (76.6%)762.1%19
Illinois434327 (75.3%)1033.3%8
Utah400361 (90.3%)744.9%14
North Carolina391311 (79.5%)648.9%17
Pennsylvania380292 (76.8%)632.5%13
Arkansas374228 (61.0%)1835.1%5
Tennessee351267 (76.1%)840.1%7
Massachusetts350287 (82.0%)567.2%3
Georgia345279 (80.9%)941.2%9
Missouri330238 (72.1%)734.5%4
New Jersey312240 (76.9%)344.2%12
Virginia309220 (71.2%)1046.8%6
Oregon290227 (78.3%)646.7%18
Colorado278209 (75.2%)767.9%5
Oklahoma264156 (59.1%)448.7%4
Alabama252178 (70.6%)125.8%4
Washington249198 (79.5%)654.0%9
Maryland247208 (84.2%)549.5%7
Arizona229196 (85.6%)732.7%4
Kansas227174 (76.7%)635.6%3
Kentucky222165 (74.3%)221.2%5
Iowa211160 (75.8%)3043.1%11
New Hampshire204164 (80.4%)339.0%5
Connecticut182144 (79.1%)255.6%2
West Virginia155104 (67.1%)124.0%1
Nebraska151122 (80.8%)125.4%0
Indiana148105 (70.9%)049.5%1
South Carolina143112 (78.3%)134.8%2
Montana135102 (75.6%)550.0%2
Maine129108 (83.7%)037.0%5
Mississippi12874 (57.8%)120.3%1
Louisiana12486 (69.4%)239.5%3
New Mexico10793 (86.9%)133.3%2
Idaho9768 (70.1%)536.8%3
Vermont9079 (87.8%)041.8%9
Wyoming7956 (70.9%)039.3%1
South Dakota6450 (78.1%)218.0%3
Alaska6245 (72.6%)026.7%3
Rhode Island5848 (82.8%)241.7%2
North Dakota5138 (74.5%)552.6%6
Nevada4938 (77.6%)050.0%0
Delaware2319 (82.6%)163.2%0

Ranked table and one page per state with its domains: https://gov.agentexchange.work/by-state.

Named lists

Federal domains without a security.txt (first 60 of 400)

Federal domains with an expired security.txt (21)

Sites publishing an llms.txt (first 60 of 718)

Sites publishing an A2A agent card (1)

Sites telling ChatGPT-User and Claude-User not to open pages for users (first 60 of 300)

Homepages that redirect to another domain (first 60 of 300)

Sites with a Content-Signal line in robots.txt (first 60 of 100)

Gap lists for vendors: who is missing which control

Each list is the .gov domains whose 2026-09-30 record lacks one control, with counts by state, the first 50 rows free, an Atom feed of who enters or leaves it, and the full CSV or JSON for 1.00 USDC (x402). All gap lists.

List.gov domainsOf the listWho buys this
.gov domains without a security.txt12,71775.8%Security teams, vulnerability-disclosure and attack-surface vendors, MSPs serving state and local government.
.gov domains with an expired security.txt630.4%Security teams and vulnerability-disclosure vendors: a lapsed file is a specific, verifiable conversation opener.
.gov domains without an accessibility statement on the homepage7,40044.1%Accessibility vendors and agencies (audits, remediation, statements) and government web platform vendors with WCAG offerings, while the ADA Title II deadlines run.
.gov domains without a privacy policy link on the homepage8,55951.0%Privacy-compliance vendors and agencies that write notices for public bodies.
.gov domains without HSTS8,32249.6%Security teams, MSPs and hosting or CDN vendors serving government sites.
.gov domains blocking both ChatGPT-User and Claude-User3652.2%AI-visibility vendors and digital agencies: these sites are closed to ChatGPT and Claude users.
.gov domains answering only over plain HTTP7394.4%MSPs, hosting and web agencies serving small governments: sites still without working HTTPS.
.gov domains whose homepage redirects to another domain1,4928.9%Web agencies and domain-consolidation vendors, security teams checking .gov names that point elsewhere.

What .gov domains are expected to publish

Look up any .gov domain

Questions

How many .gov websites publish a security.txt?

343 of the 13,060 reachable .gov websites (2.6%) publish a security.txt; 150 are complete and current and 63 have expired. Federal figures are in the table by level of government.

How many .gov sites block AI crawlers?

524 block GPTBot, 504 block ClaudeBot and 396 block ChatGPT-User in robots.txt; 361 disallow every bot. 888 name at least one AI crawler explicitly and 126 carry a Content-Signal line. Blocking is a choice, not a defect; each domain page shows the verdict per agent.

Do government websites link an accessibility statement?

43.3% of reachable .gov homepages link an accessibility statement and 34.5% link a privacy policy. The ADA Title II web rule applies to public entities serving 50,000 or more people from April 24, 2026 and to smaller entities from April 26, 2027.

Where does the list of .gov domains come from?

From CISA's public dotgov-data repository (current-full.csv), which lists every registered .gov domain with its type, organization, city and state: 16,783 domains on 2026-09-30. Domains registered only for email or internal use appear as unreachable.

Can I reuse the data?

Yes. The findings, the CSV and every per-domain JSON record are published under CC BY 4.0; cite Agent Exchange and link the report.

Method and limits

Population: CISA dotgov-data current-full.csv (all registered .gov domains) with each domain's type, organization, city and state as registered.. Fetch: one HTTPS request to the apex (then www.), following redirects, 8-second timeout, user agent agentexchange-census/1.0; then robots.txt, /.well-known/security.txt, /security.txt, /llms.txt and /.well-known/agent-card.json on the final host. "Reachable" means any HTTP response over HTTPS, including 403s from bot protection. Homepage links are detected from anchor targets and visible text, so a policy that exists but is not linked from the homepage is not counted. A robots.txt "blocked" verdict means the agent's own group (or the * group) disallows the whole site; "partly blocked" means some paths are disallowed. One snapshot per domain; slow sites and sites that block automated requests are counted as unreachable or reachable-with-error as the server answered. Live re-checks: every 6 hours this host re-fetches the homepage, robots.txt, security.txt and llms.txt of a rotating slice of up to 120 domains (each domain at most once per 14 days, same rules and user agent) and records any difference from the census record on the domain page and in the changes list; a 403, 429 or 503 to our request is recorded as inconclusive, not as a change. Per-domain records: lookup; downloads: CSV, NDJSON and JSON (CC BY 4.0).

Run one of these sites?

$49 full report or $99 monthly monitoring · Hosted accessibility feedback and privacy request desk

Other censuses

World government web census · Top 100,000 websites census · US bank web census · US credit union web census · US college web census · US school district web census · World university web census · Every Agent Exchange property (network map) · Agent-readiness grade and fix guides · Compliance Desk: hosted request processes · MCP registry integrity report · Agent Economy Index (daily x402 and MCP census) · Agent Exchange directory (x402 store)