Open Risk Data Providers
From Open Risk Manual
Revision as of 14:54, 17 November 2020 by Wiki admin (talk | contribs)
Contents
Open Risk Data Provider List
The table below organizes available Open Risk Data providers.
Criteria for inclusion
The objective of the list is to identify as far as possible direct sources of open data sets. Yet there might be significant overlap among the various data repositories as various institutions share and republish open data.
At present the list does not attempt to evaluate the degree of "openness" of the various data sources.
Legend
The first entry per record is a general identifier of the data provider. The second entry is the general type of data provided. Large data repositories may include multiple types of data. The URL is a web link where actual data can be accessed, potentially requiring registration. Format/API is an indication how the data can be retrieved, keeping in mind that large repositories may be providing data in multiple formats / channels.
Table
| Data Provider | Type | URL | Format/API | Comments |
| Supra-national statistics and macro data | ||||
| United Nations Data | General | http://data.un.org/ | SDMX | |
| European Union Open Data Portal | General | https://open-data.europa.eu/en/data/ | Various | |
| European Data Portal | General | http://www.europeandataportal.eu/ | Various | |
| openAfrica | General | https://africaopendata.org/ | Various | |
| African Development Bank Group | General | http://dataportal.afdb.org/default.aspx | Various | |
| World Bank | General | http://data.worldbank.org/ | Various | |
| IMF Data | General | http://data.imf.org | Various | |
| Eurostat | General | http://ec.europa.eu/eurostat | SDMX | |
| OECD Data | General | https://data.oecd.org/ | Various | |
| ECB Statistical Data Warehouse | Macroeconomic | http://sdw.ecb.europa.eu/ | SDMX/REST | |
| Select National Statistics / Macro Data Warehouses | ||||
| FRED Economic Data | Macroeconomic | http://research.stlouisfed.org/fred2/ | FRED® API | |
| Euro Area Business Cycle Network | Macroeconomic | http://www.eabcn.org/page/european-data-sources | ||
| Bank of England Statistics | Macroeconomic | https://www.bankofengland.co.uk/boeapps/database/ | Online Browser / CSV Download | |
| Bank of Canada Sovereign Default Data | Credit Events | https://www.bankofcanada.ca/wp-content/uploads/2018/07/crag-database-update-13-07-18.xlsx | XLSX Download | |
| Regulatory Disclosures | ||||
| BIS Statistics | Banking System Statistics | http://stats.bis.org/bis-stats-tool/org.bis.stats.ui.StatsApplication/StatsApplication.html | Various | |
| European Banking Authority Risk Dashboard | European Banking System Statistics | http://www.c-ebs.org/web/guest/risk-analysis-and-data/risk-dashboard | XLS | |
| Market Data | ||||
| SEC Market Data | Market Structure Data | https://www.sec.gov/data | CSV | |
| Bloomberg SDR | Swap Data | http://www.bloombergsdr.com/slicefiles | CSV | |
| Depository Trust & Clearing Corp. (DTCC) SDR | Swap Data | https://rtdata.dtcc.com/gtr/dashboard.do | ZIP/CSV | |
| Zillow | Real Estate | https://www.zillow.com/research/data/ | ZIP/CSV | |
| Corporate Data | ||||
| Open Corporates | Corporate Web Addresses | https://opencorporates.com/ | JSON/XML/REST | |
| UK Companies House | UK Corporate Accounts Data | http://download.companieshouse.gov.uk/en_monthlyaccountsdata.html | XBRL | |
| Consumer Financial Data | ||||
| Fannie Mae | Single Family Loan Performance Data | https://loanperformancedata.fanniemae.com/lppub/index.html#Portfolio | ZIP/CSV | Account Required |
| Freddie Mac | Single Family Loan-Level Dataset | http://www.freddiemac.com/news/finance/sf_loanlevel_dataset.html | ZIP/CSV | Account Required |
| Lending Club | Portfolio Performance Data | https://www.lendingclub.com/info/download-data.action | ZIP/CSV | |
| UCI Machine Learning Repository | German Credit Data | https://archive.ics.uci.edu/ml/datasets/Statlog+%28German+Credit+Data%29 | CSV | 1000 records (Donated in 1994) |
| UCI Machine Learning Repository | Taiwan Credit Card Data | https://archive.ics.uci.edu/ml/datasets/default+of+credit+card+clients | CSV | 30000 records |
| Mobility Data | ||||
| Google Community Mobility Reports | Mobile Location Data | https://www.google.com/covid19/mobility/ | CSV | 3mln+ records |
| Apple Mobility Trends Reports | Mobile Location Data | https://covid19.apple.com/mobility | CSV | |
| IT Risk Incidents | ||||
| Wikipedia | List of publicly known data breaches | wikipedia:List of data breaches | Wikitable | ~300 records |
| Verison | VERIS Community Database | github repository | json files | |
| Privacy Rights Clearinghouse | Chronology of Data Breaches | Download page | xlsx | US only, Collected from various sources |
| Sustainability Risk Data | ||||
| Global Forest Watch | Forest Monitoring | Website | ||
| Aqueduct | Water Risk | Website | ||
| Climate Watch | Climate Risk | Website | ||
| Resource Watch | Diverse sustainability datasets | Website | ||
| Landmark | Database of Indigenous and Community Lands | Website | ||
| World Bank Climate Change Knowledge Portal | Historical and future climate data | Website | ||
| US Government Climate Data Portal | Various climate risk related datasets | Website | ||
Issues and Challenges
- Sometimes data providers do not explicitly identify the applicable type of license
- Accessibility of data (formats, API's) and overall Data Quality may vary greatly
