System Atlas

Data overview

The registry as files: datasets, formats, slices, tiers, license and how to cite.

In short

Everything public in the registry is published as files every night: seven datasets, each as gzipped CSV and gzipped JSON lines, listed with their row counts, sizes and sha256 in /data/manifest.json. Any dataset can also be cut to one industry or one upstream source on demand. Download from /data, with systatlas download, or over HTTP.

Datasets

DatasetA row isAccess
organizationsOne public organization: name, website, kind, industry, region, claimed, counts.Open
identifiersOne identifier of an organization in an outside register (Wikidata, LEI, CIK, EIN, ROR …).Open
organization_linksOne stated relation between two organizations: direct or ultimate parent, funded by.Open
industriesOne node of the industry ontology, with its parent, standard and code.Open
componentsOne public part of an organization's map (a component), with its primitive, layer, confidence and source.Member (slices: free account)
valuesOne public figure on a part (revenue, employees, a count), with its period, confidence and source.Member (slices: free account)
sourcesOne source a public part or figure rests on: the page, its kind and when it was read.Member (slices: free account)

Rows join on ids: components.organization_id, values.component_id, identifiers.organization_id, organization_links.from_organization_id, and organizations.industry_key to industries.key. Every field is on the data model page.

What is in the files, and what never is

  • Organizations of the public registry: those with public parts or a verified claim.
  • Parts, figures and links that are public or published, never private or shared; never one the organization disputed, one taken down, or one rejected in review. A figure also needs its part to be public.
  • Sources that a public part or figure cites. A client's own documents and interview notes never leave, not even as a link on the row that cites them.

Formats

  • CSV (.csv.gz): UTF-8, a header row, RFC 4180 quoting. Lists join with ; , JSON fields are JSON text. A text cell that starts with =, +, @ or - (not a number) gets a leading ' so a spreadsheet never runs it.
  • JSON lines (.jsonl.gz): one object per line, values as they are.
  • Times are UTC ISO 8601 (2026-11-03T03:00:00Z), dates YYYY-MM-DD. Rows are ordered by id, so two runs diff cleanly.
Parquet
No Parquet file yet: the light Parquet writers for Node hold a whole column in memory, and the files are generated with memory held to one batch of rows. DuckDB turns a file into Parquet in one statement (see examples).

Slices

A slice is one dataset for an industry (the node and everything under it in the ontology, on an organization's primary or secondary placement) or for one source (the rows that source gave us, with its attribution). Slices stream from the database as they are downloaded, in the same formats and columns as the bulk files.

Who can download what

TierBulk filesSlices
Not signed inDirectory files: organizations, identifiers, links, industriesDirectory datasets, up to 1,000 rows a file
Free accountSame as not signed inEvery dataset, up to 10,000 rows a file
Member and TerminalEvery file, parts, figures and sources includedEvery dataset, no cap

Every download goes through a signed link that lasts 5 minutes. Ask for one with your session or an API key; links are rate-limited per account (per address when signed out).

A signed link
curl -s "https://systematlas.org/api/data/link?dataset=values&industry=naics_6212&format=csv" \
  -H "Authorization: Bearer sa_…"
# { "data": { "url": "https://systematlas.org/data/dl?t=…&cap=10000&exp=…&sig=…",
#             "name": "values-industry-naics_6212.csv.gz", "rows_cap": 10000, … } }

The manifest

/data/manifest.json lists the files of the latest run with rows, bytes, sha256 and the time each was written, its access, and the rows each upstream source contributed with that source's license and attribution. The run before stays downloadable until the next night.

{
  "version": 1,
  "generated_at": "2026-11-03T03:00:00.000Z",
  "license": { "name": "CC BY 4.0", "attribution": "System Atlas (systematlas.org)", … },
  "upstreams": [{ "key": "gleif", "license": "CC0 1.0", "attribution": null, … }, …],
  "files": [
    {
      "dataset": "organizations",
      "format": "csv",
      "name": "organizations.csv.gz",
      "rows": 110412,
      "bytes": 9811034,
      "sha256": "4f1c…",
      "generated_at": "2026-11-03T03:00:04.112Z",
      "access": "open",
      "license": "CC BY 4.0",
      "upstreams": [],
      "download": "/api/data/link?dataset=organizations&format=csv"
    }
  ]
}

License and attribution

The compilation (which organizations, how they are mapped, the parts and figures we found) is ours, under CC BY 4.0: use it for anything, name System Atlas and link systematlas.org.

Rows from an upstream whose license asks for attribution carry it in an attribution column, and name their source in upstream: keep both with the rows you reuse. CC0 and public-domain sources need none.

SourceLicenseAttribution
WikidataCC0 1.0Not required
SEC EDGARPublic domain (US government work)Not required
GLEIFCC0 1.0Not required
IRS Exempt Organizations Business Master FilePublic domain (US government work)Not required
ROR, the Research Organization RegistryCC0 1.0Not required
OpenAlexCC0 1.0Not required
USAspending.govPublic domain (US government work; API data CC0)Not required
.gov registry (CISA)CC0 1.0Not required
EU Transparency RegisterCC BY 4.0 (Commission reuse decision 2011/833/EU)Source: EU Transparency Register, © European Union
Surveillance WatchSurveillance Watch terms (public API for integration); attribution requiredSource: Surveillance Watch (surveillancewatch.io)
US Census County Business PatternsPublic domain (US government work)Not required
Open web (research)Our compilation license; the quoted words belong to their publisherNot required

Quoted words in quote belong to the page they were read from; we keep one sentence at most, with its link.

How to cite

Name the run you used (its date is in the manifest):

System Atlas registry (2026-11-03). systematlas.org/data. Licensed CC BY 4.0.