Difference between revisions of "Open Risk Data Providers"

From Open Risk Manual
(Created page with "== Open Risk Data Provider List == The table below organizes available Open Risk Data providers. === Criteria for inclusion === The objective of the list is to identify...")
 
(No difference)

Latest revision as of 11:00, 14 January 2020

Open Risk Data Provider List

The table below organizes available Open Risk Data providers.

Criteria for inclusion

The objective of the list is to identify as far as possible direct sources of open data sets. Yet there might be significant overlap among the various data repositories as various institutions share and republish open data.

At present the list does not attempt to evaluate the degree of "openness" of the various data sources.

Legend

The first entry per record is a general identifier of the data provider. The second entry is the general type of data provided. Large data repositories may include multiple types of data. The URL is a web link where actual data can be accessed, potentially requiring registration. Format/API is an indication how the data can be retrieved, keeping in mind that large repositories may be providing data in multiple formats / channels.

Table

Data Provider Type URL Format/API Comments
Supra-national statistics and macro data
United Nations Data General http://data.un.org/ SDMX
European Union Open Data Portal General https://open-data.europa.eu/en/data/ Various
European Data Portal General http://www.europeandataportal.eu/ Various
openAfrica General https://africaopendata.org/ Various
African Development Bank Group General http://dataportal.afdb.org/default.aspx Various
World Bank General http://data.worldbank.org/ Various
IMF Data General http://data.imf.org Various
Eurostat General http://ec.europa.eu/eurostat SDMX
OECD Data General https://data.oecd.org/ Various
ECB Statistical Data Warehouse Macroeconomic http://sdw.ecb.europa.eu/ SDMX/REST
Select National Statistics / Macro Data Warehouses
FRED Economic Data Macroeconomic http://research.stlouisfed.org/fred2/ FRED® API
Euro Area Business Cycle Network Macroeconomic http://www.eabcn.org/page/european-data-sources
Bank of England Statistics Macroeconomic https://www.bankofengland.co.uk/boeapps/database/ Online Browser / CSV Download
Bank of Canada Sovereign Default Data Credit Events https://www.bankofcanada.ca/wp-content/uploads/2018/07/crag-database-update-13-07-18.xlsx XLSX Download
Regulatory Disclosures
BIS Statistics Banking System Statistics http://stats.bis.org/bis-stats-tool/org.bis.stats.ui.StatsApplication/StatsApplication.html Various
European Banking Authority Risk Dashboard European Banking System Statistics http://www.c-ebs.org/web/guest/risk-analysis-and-data/risk-dashboard XLS
Market Data
SEC Market Data Market Structure Data https://www.sec.gov/data CSV
Bloomberg SDR Swap Data http://www.bloombergsdr.com/slicefiles CSV
Depository Trust & Clearing Corp. (DTCC) SDR Swap Data https://rtdata.dtcc.com/gtr/dashboard.do ZIP/CSV
Zillow Real Estate https://www.zillow.com/research/data/ ZIP/CSV
Corporate Data
Open Corporates Corporate Web Addresses https://opencorporates.com/ JSON/XML/REST
UK Companies House UK Corporate Accounts Data http://download.companieshouse.gov.uk/en_monthlyaccountsdata.html XBRL
Consumer Data
Fannie Mae Single Family Loan Performance Data https://loanperformancedata.fanniemae.com/lppub/index.html#Portfolio ZIP/CSV Account Required
Freddie Mac Single Family Loan-Level Dataset http://www.freddiemac.com/news/finance/sf_loanlevel_dataset.html ZIP/CSV Account Required
Lending Club Portfolio Performance Data https://www.lendingclub.com/info/download-data.action ZIP/CSV
UCI Machine Learning Repository German Credit Data https://archive.ics.uci.edu/ml/datasets/Statlog+%28German+Credit+Data%29 CSV 1000 records (Donated in 1994)
UCI Machine Learning Repository Taiwan Credit Card Data https://archive.ics.uci.edu/ml/datasets/default+of+credit+card+clients CSV 30000 records
IT Risk Incidents
Wikipedia List of publicly known data breaches wikipedia:List of data breaches Wikitable ~300 records
Verison VERIS Community Database github repository json files

Issues and Challenges

  • Sometimes data providers do not explicitly identify the applicable type of license
  • Accessibility of data (formats, API's) and overall Data Quality may vary greatly

Contributors to this article

» Wiki admin