Difference between revisions of "Open Risk Data"

From Open Risk Manual
(3 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
== Definition ==  
 
== Definition ==  
'''Open Risk Data''' is any dataset that has direct or indirect applications in Risk Management and is released under an [https://en.wikipedia.org/wiki/Open_data Open Data] license. Broadly speaking, Open Data are freely available to everyone to use and republish as they wish, without restrictions from copyright, patents or other mechanisms of control.
+
'''Open Risk Data''' is any dataset that has direct or indirect applications in [[Risk Management]] and is released under an [https://en.wikipedia.org/wiki/Open_data Open Data] license. Broadly speaking, Open Data are freely available to everyone to use and republish as they wish, without restrictions from copyright, patents or other mechanisms of control.
 +
 
 +
== Resources ==
 +
This entry organizes the information about open risk data available in the manual.
  
 
* [[Open Risk Data Classification]]
 
* [[Open Risk Data Classification]]
* [[Open Risk Data Providers]]
+
* External [[Open Risk Data Providers]]
 
+
* Open Risk Data hosted in the [https://www.openriskmanual.org/data Manual] as part of the Wikibase universe
== Open Data Provider List ==
 
The table below organizes available Open Risk Data providers.
 
 
 
=== Criteria for inclusion ===
 
The objective of the list is to identify as far as possible ''direct sources'' of open data sets. Yet there might be significant overlap among the various data repositories as various institutions share and republish open data.
 
 
 
'''At present the list does not attempt to evaluate the degree of "openness" of the various data sources.'''
 
 
 
=== Legend ===
 
The first entry per record is a general identifier of the data provider. The second entry is the general type of data provided. Large data repositories may include multiple types of data. The URL is a web link where actual data can be accessed, potentially requiring registration. Format/API is an indication how the data can be retrieved, keeping in mind that large repositories may be providing data in multiple formats / channels.
 
 
 
=== Table ===
 
 
 
{| class="wikitable"
 
| '''Data Provider'''
 
| '''Type'''
 
| '''URL'''
 
| '''Format/API'''
 
| '''Comments'''
 
|-
 
| colspan="4"|  '''Supra-national statistics and macro data'''
 
|-
 
| United Nations Data
 
| General
 
| http://data.un.org/
 
| SDMX
 
|
 
|-
 
| European Union Open Data Portal
 
| General
 
| https://open-data.europa.eu/en/data/
 
| Various
 
|
 
|-
 
| European Data Portal
 
| General
 
| http://www.europeandataportal.eu/
 
| Various
 
|
 
|-
 
| openAfrica
 
| General
 
| https://africaopendata.org/
 
| Various
 
|
 
|-
 
| African Development Bank Group
 
| General
 
| http://dataportal.afdb.org/default.aspx
 
| Various
 
|
 
|-
 
| World Bank
 
| General
 
| http://data.worldbank.org/
 
| Various
 
|
 
|-
 
| IMF Data
 
| General
 
| http://data.imf.org
 
| Various
 
|
 
|-
 
| Eurostat
 
| General
 
| http://ec.europa.eu/eurostat
 
| SDMX
 
|
 
|-
 
| OECD Data
 
| General
 
| https://data.oecd.org/
 
| Various
 
|
 
|-
 
| ECB Statistical Data Warehouse
 
| Macroeconomic
 
| http://sdw.ecb.europa.eu/
 
| SDMX/REST
 
|
 
|-
 
| colspan="4"| '''Select National Statistics / Macro Data Warehouses'''
 
|-
 
| FRED Economic Data
 
| Macroeconomic
 
| http://research.stlouisfed.org/fred2/
 
| FRED® API
 
|
 
|-
 
| Euro Area Business Cycle Network
 
| Macroeconomic
 
| http://www.eabcn.org/page/european-data-sources
 
|
 
|
 
|-
 
| Bank of England Statistics
 
| Macroeconomic
 
| https://www.bankofengland.co.uk/boeapps/database/
 
| Online Browser / CSV Download
 
|
 
|-
 
| Bank of Canada Sovereign Default Data
 
| Credit Events
 
| https://www.bankofcanada.ca/wp-content/uploads/2018/07/crag-database-update-13-07-18.xlsx
 
| XLSX Download
 
|
 
|-
 
| colspan="4"| '''Regulatory Disclosures'''
 
|-
 
| BIS Statistics
 
| Banking System Statistics
 
| http://stats.bis.org/bis-stats-tool/org.bis.stats.ui.StatsApplication/StatsApplication.html
 
| Various
 
|
 
|-
 
| European Banking Authority Risk Dashboard
 
| European Banking System Statistics
 
| http://www.c-ebs.org/web/guest/risk-analysis-and-data/risk-dashboard
 
| XLS
 
|
 
|-
 
| colspan="4"| '''Market Data'''
 
|-
 
| SEC Market Data
 
| Market Structure Data
 
| https://www.sec.gov/data
 
| CSV
 
|
 
|-
 
| Bloomberg SDR
 
| Swap Data
 
| http://www.bloombergsdr.com/slicefiles
 
| CSV
 
|
 
|-
 
| Depository Trust & Clearing Corp. (DTCC) SDR
 
| Swap Data
 
| https://rtdata.dtcc.com/gtr/dashboard.do
 
| ZIP/CSV
 
|-
 
| Zillow
 
| Real Estate
 
| https://www.zillow.com/research/data/
 
| ZIP/CSV
 
|
 
|-
 
| colspan="4"| '''Corporate Data'''
 
|-
 
|-
 
| Open Corporates
 
| Corporate Web Addresses
 
| https://opencorporates.com/
 
| JSON/XML/REST
 
|
 
|-
 
| UK Companies House
 
| UK Corporate Accounts Data
 
| http://download.companieshouse.gov.uk/en_monthlyaccountsdata.html
 
| XBRL
 
|
 
|-
 
| colspan="4"| '''Consumer Data'''
 
|-
 
| Fannie Mae
 
| Single Family Loan Performance Data
 
| https://loanperformancedata.fanniemae.com/lppub/index.html#Portfolio
 
| ZIP/CSV
 
| Account Required
 
|-
 
| Freddie Mac
 
| Single Family Loan-Level Dataset
 
| http://www.freddiemac.com/news/finance/sf_loanlevel_dataset.html
 
| ZIP/CSV
 
| Account Required
 
|-
 
| Lending Club
 
| Portfolio Performance Data
 
| https://www.lendingclub.com/info/download-data.action
 
| ZIP/CSV
 
|
 
|-
 
| UCI Machine Learning Repository
 
| German Credit Data
 
| https://archive.ics.uci.edu/ml/datasets/Statlog+%28German+Credit+Data%29
 
| CSV
 
| 1000 records (Donated in 1994)
 
|-
 
| UCI Machine Learning Repository
 
| Taiwan Credit Card Data
 
| https://archive.ics.uci.edu/ml/datasets/default+of+credit+card+clients
 
| CSV
 
| 30000 records
 
|-
 
| colspan="4"| '''IT Risk Incidents'''
 
|-
 
| Wikipedia
 
| List of publicly known data breaches
 
| [[wikipedia:List of data breaches]]
 
| Wikitable
 
| ~300 records
 
|-
 
| Verison
 
| VERIS Community Database
 
| [https://github.com/vz-risk/VCDB github repository]
 
| json files
 
|
 
|}
 
 
 
== Issues and Challenges == 
 
 
 
* Sometimes data providers do not explicitly identify the applicable type of license
 
* Accessibility of data (formats, API's) and overall [[Data Quality]] may vary greatly
 
  
 
[[Category:Open Data]]
 
[[Category:Open Data]]
[[Category:Open Source]]
 
 
[[Category:Risk Data]]
 
[[Category:Risk Data]]

Revision as of 12:05, 14 January 2020

Definition

Open Risk Data is any dataset that has direct or indirect applications in Risk Management and is released under an Open Data license. Broadly speaking, Open Data are freely available to everyone to use and republish as they wish, without restrictions from copyright, patents or other mechanisms of control.

Resources

This entry organizes the information about open risk data available in the manual.

Contributors to this article

» Wiki admin