Database

This page lists the datasets published by Japan Open Data Lab. Each card states the contents, format and size, license, and where to obtain the dataset. All datasets listed here are available free of charge.

No datasets match the selected conditions.

Available

Competition Knowledge Vault — Sourced ML Techniques

Competition Knowledge Vault(Hugging Face)

A structured knowledge vault of machine learning papers and articles, distilled into a three-line summary, key technical points, and notes on applying each technique in competitions. Every entry carries a source URL. The vault currently holds 150 entries and is updated on an ongoing basis.

Format & size
CSV / JSONL, currently 150 rows × 14 columns
License
CC BY 4.0 (applies to the summaries and editorial content; rights in the original works remain with their authors)

Get it on Hugging Face ↗

Available

Competition Knowledge Vault — Sample Code (GitHub)

japan-opendata-lab/competition-knowledge-vault

Sample code and a README for loading the Competition Knowledge Vault published on Hugging Face (currently 150 entries, updated on an ongoing basis). The dataset itself is not included in this repository.

Format & size
Python sample code + README (the dataset itself is published on HF: currently 150 entries, CC BY 4.0)
License
MIT (code; the dataset itself is CC BY 4.0)

View on GitHub ↗

In preparation

Competition Knowledge Vault — Sourced ML Papers

Competition Knowledge Vault(Kaggle)

The Kaggle edition of the knowledge vault. The contents are identical to the Hugging Face edition, currently 150 entries (updated on an ongoing basis), with a source URL on every entry.

Format & size
Parquet / CSV, currently 150 rows × 14 columns
License
CC BY 4.0 (applies to the summaries and application notes)

In preparation for publication on Kaggle

Scheduled for release on November 28, 2026

Prefecture Behavior & Consumption Master — Free Sample

Japan Prefecture Behavior & Consumption Master — Free Sample

A cleansed dataset of behavior and consumption statistics for Japan's 47 prefectures, covering food, spending, commuting, sleep, learning, and more. It includes a column definition document and a quality report describing how the data was verified. Only columns confirmed as cleared for commercial use are included.

Format & size
CSV / JSONL, 47 rows × 18 columns (no missing values)
License
CC BY 4.0 (editorial and definition content). The underlying statistics may be used with attribution under the Government of Japan Standard Terms of Use and similar terms. Commercial use permitted
Where to obtain
To be distributed on Hugging Face and GitHub on the release date

Note: The Family Income and Expenditure Survey columns are values for the prefectural capital cities (households with two or more persons); the Survey on Time Use and Leisure Activities and Housing and Land Survey columns are prefecture-wide values.

A link will be added to this page on the release date, November 28, 2026

Open Data Around the World

This section lists entry points to the official data portals of countries around the world and of international organizations. Our focus remains Japanese data, but we provide this section so that world data is also within easy reach. The data itself is available on each provider's website; we do not redistribute data on this page.

International Organizations

World Bank Open Data ↗

A database covering development indicators such as population, GDP, poverty, and education for countries worldwide. A useful starting point for comparing countries.

CSV / API · Indicator data under CC BY 4.0 (attribution required)

OECD Data Explorer ↗

A database of economic and social statistics centered on advanced economies. Useful for comparing Japan with other countries.

Tables / CSV · Attribution required under the OECD terms of use

UNdata ↗

A database of official statistics compiled by the United Nations Statistics Division, covering areas such as population and trade.

CSV / API · Available with attribution

IMF Data ↗

The official entry point for IMF macroeconomic data, including International Financial Statistics and the World Economic Outlook (WEO).

CSV / API · Attribution required under the IMF terms of use

Eurostat ↗

The database of Eurostat, the statistical office of the EU. Statistics on population, economy, and environment for European countries can be searched in one place.

CSV / API · Policy equivalent to CC BY 4.0 (attribution required)

data.europa.eu ↗

The official open data portal of the EU. Data from EU institutions and member states can be searched across the board.

Various formats · Many datasets under CC BY 4.0 or similar; check the terms for each dataset

National Portals

data.gov (United States) ↗

The central open data catalog of the U.S. federal government, one of the largest of its kind in the world.

Various formats · Mostly public domain; check each dataset

data.gov.uk (United Kingdom) ↗

The open data portal of the UK government, a leading example of a country with advanced public-sector data disclosure.

Various formats · Open Government Licence (attribution required; commercial use permitted)

data.gouv.fr (France) ↗

The open data portal of the French government. It also brings together a large amount of local government data.

Various formats · Licence Ouverte (reuse permitted with attribution)

GovData (Germany) ↗

The open data portal for Germany's federal, state, and local governments.

Various formats · Datenlizenz Deutschland (the attribution version is common)

Open Government Portal (Canada) ↗

The open data entry point of the Government of Canada, bringing together federal and provincial data.

Various formats · Open Government Licence – Canada (attribution required)

data.gov.au (Australia) ↗

The open data portal of the Australian Government.

Various formats · Mostly CC BY (as labeled for each dataset)

Public Data Portal (South Korea) ↗

South Korea's central portal for public-sector data, with a rich set of datasets available via API.

CSV / API · Check the terms for each dataset

Practitioner Favorites

Our World in Data ↗

A site publishing long-term world statistics as charts and downloadable data.

CSV / Charts · CC BY (attribution required)

Kaggle Datasets ↗

A collection of datasets used by data competition practitioners. Useful when looking for data to work with.

Various formats · Licenses vary by dataset; check each one

Hugging Face Datasets ↗

A collection of datasets for machine learning. Many can be loaded directly from Python.

Various formats · Licenses are labeled for each dataset; check each one

A World Data API, covering data from around the world, is also in preparation. For details, see the World Data API (in preparation) page.

Japan Regional Data API — In Preparation

We are preparing an API that serves cleansed regional statistics for Japan. The release date has not been set, and we are currently measuring demand. If you would like to be notified when it is released, please register on the sign-up page (a dedicated list for the API, separate from our newsletter).

Get notified about the API release

A confirmation email will be sent after registration (double opt-in). The confirmation email may land in your spam folder.

This page collects our published materials. We do not sell data at this time. Please check the terms shown on each card and at the source for the conditions of use for each dataset.