System Atlas

Sources catalog

Each upstream source: what it gives, how often it refreshes, its license and last refresh.

In short

Where the registry's rows come from. Each row in the files names its source in upstream (the keys below) and, when that source's license asks for it, carries the words to credit it in attribution. Slice any dataset by one of them at /data.

Catalog

Wikidatawikidata

Organizations, their websites, industries, countries and identifiers in other registers.

License
CC0 1.0
Attribution
Not required
Cadence
Weekly
Last refresh
Not run on this server yet

US public filers: company facts (revenue, employees, assets), segments and new annual and current reports.

Attribution
Not required
Cadence
Every 6 hours
Last refresh
Not run on this server yet
GLEIFgleif

Legal Entity Identifiers (LEI): legal names, jurisdictions, direct and ultimate parents.

License
CC0 1.0
Attribution
Not required
Cadence
Weekly
Last refresh
Not run on this server yet

US tax-exempt organizations: EIN, classification, revenue and assets.

License
Public domain (US government work)
Attribution
Not required
Cadence
Monthly
Last refresh
Not run on this server yet

Research organizations: names, types, countries, websites, relations.

License
CC0 1.0
Attribution
Not required
Cadence
Monthly
Last refresh
Not run on this server yet
OpenAlexopenalex

Research output of institutions: works, citations, h-index.

License
CC0 1.0
Attribution
Not required
Cadence
Weekly
Last refresh
Not run on this server yet
USAspending.govusaspending

Recipients of US federal awards: UEI, award totals for the last 12 months.

Attribution
Not required
Cadence
Weekly
Last refresh
Not run on this server yet

US government organizations and the .gov domains they hold.

License
CC0 1.0
Attribution
Not required
Cadence
Weekly
Last refresh
Not run on this server yet

Organizations registered to lobby the EU: lobbying costs, people involved, policy interests, representation.

Attribution
Source: EU Transparency Register, © European Union
Cadence
Weekly
Last refresh
Not run on this server yet
Surveillance Watchsurveillance-watch

Companies and agencies behind surveillance technology: types, countries, funders, affiliations and the reporting each listing cites.

Attribution
Source: Surveillance Watch (surveillancewatch.io)
Cadence
Weekly
Last refresh
Not run on this server yet

Establishments, employees and payroll per industry (on the industry pages).

License
Public domain (US government work)
Attribution
Not required
Cadence
Yearly
Last refresh
Not run on this server yet

Findings our research read on organizations' own sites, filings and press, each with the page and at most one quoted sentence.

Attribution
Not required
Cadence
Daily
Last refresh
Not run on this server yet

Freshness

The feed engine runs each source on its cadence (backing off after an error); the bulk files are rebuilt every night from what the registry holds then. The time of the last build is in the manifest and on /data.

SourceCadenceLast refresh
WikidataWeeklyNot yet
SEC EDGAREvery 6 hoursNot yet
GLEIFWeeklyNot yet
IRS Exempt Organizations Business Master FileMonthlyNot yet
ROR, the Research Organization RegistryMonthlyNot yet
OpenAlexWeeklyNot yet
USAspending.govWeeklyNot yet
.gov registry (CISA)WeeklyNot yet
EU Transparency RegisterWeeklyNot yet
Surveillance WatchWeeklyNot yet
US Census County Business PatternsYearlyNot yet