Healthsheet: Development of a Transparency Artifact for Health Datasets

by   Negar Rostamzadeh, et al.

Machine learning (ML) approaches have demonstrated promising results in a wide range of healthcare applications. Data plays a crucial role in developing ML-based healthcare systems that directly affect people's lives. Many of the ethical issues surrounding the use of ML in healthcare stem from structural inequalities underlying the way we collect, use, and handle data. Developing guidelines to improve documentation practices regarding the creation, use, and maintenance of ML healthcare datasets is therefore of critical importance. In this work, we introduce Healthsheet, a contextualized adaptation of the original datasheet questionnaire  <cit.> for health-specific applications. Through a series of semi-structured interviews, we adapt the datasheets for healthcare data documentation. As part of the Healthsheet development process and to understand the obstacles researchers face in creating datasheets, we worked with three publicly-available healthcare datasets as our case studies, each with different types of structured data: Electronic health Records (EHR), clinical trial study data, and smartphone-based performance outcome measures. Our findings from the interviewee study and case studies show 1) that datasheets should be contextualized for healthcare, 2) that despite incentives to adopt accountability practices such as datasheets, there is a lack of consistency in the broader use of these practices 3) how the ML for health community views datasheets and particularly Healthsheets as diagnostic tool to surface the limitations and strength of datasets and 4) the relative importance of different fields in the datasheet to healthcare concerns.


page 1

page 2

page 3

page 4


Machine learning in healthcare – a system's perspective

A consequence of the fragmented and siloed healthcare landscape is that ...

Development and Validation of ML-DQA – a Machine Learning Data Quality Assurance Framework for Healthcare

The approaches by which the machine learning and clinical research commu...

AutoML in The Wild: Obstacles, Workarounds, and Expectations

Automated machine learning (AutoML) is envisioned to make ML techniques ...

CMS Sematrix: A Tool to Aid the Development of Clinical Quality Measures (CQMs)

As part of the effort to improve quality and to reduce national healthca...

Advancing Community Engaged Approaches to Identifying Structural Drivers of Racial Bias in Health Diagnostic Algorithms

Much attention and concern has been raised recently about bias and the u...

A Dynamic System Model for Personalized Healthcare Delivery and Managed Individual Health Outcomes

The current healthcare system is facing an unprecedented chronic disease...

Machine Learning Applications In Healthcare: The State Of Knowledge and Future Directions

Detection of easily missed hidden patterns with fast processing power ma...

Please sign up or login with your details

Forgot password? Click here to reset