The paradox of the artificial intelligence system development process: the use case of corporate wellness programs using smart wearables

Angelucci, Alessandra ORCID: 0000-0001-8266-9346, Li, Ziyue ORCID: 0000-0003-4983-9352, Stoimenova, Niya and Canali, Stefano ORCID: 0000-0002-5948-3874 . The paradox of the artificial intelligence system development process: the use case of corporate wellness programs using smart wearables. AI Soc.. NEW YORK: SPRINGER. ISSN 1435-5655

Full text not available from this repository.

DOI:10.1007/s00146-022-01562-4

Abstract

Artificial intelligence (AI) systems have been widely applied to various contexts, including high-stake decision processes in healthcare, banking, and judicial systems. Some developed AI models fail to offer a fair output for specific minority groups, sparking comprehensive discussions about AI fairness. We argue that the development of AI systems is marked by a central paradox: the less participation one stakeholder has within the AI system's life cycle, the more influence they have over the way the system will function. This means that the impact on the fairness of the system is in the hands of those who are less impacted by it. However, most of the existing works ignore how different aspects of AI fairness are dynamically and adaptively affected by different stages of AI system development. To this end, we present a use case to discuss fairness in the development of corporate wellness programs using smart wearables and AI algorithms to analyze data. The four key stakeholders throughout this type of AI system development process are presented. These stakeholders are called service designer, algorithm designer, system deployer, and end-user. We identify three core aspects of AI fairness, namely, contextual fairness, model fairness, and device fairness. We propose a relative contribution of the four stakeholders to the three aspects of fairness. Furthermore, we propose the boundaries and interactions between the four roles, from which we make our conclusion about the possible unfairness in such an AI developing process.

Item Type:

Journal Article

Creators:

Creators	Email	ORCID	ORCID Put Code
Angelucci, Alessandra	UNSPECIFIED	orcid.org/0000-0001-8266-9346	UNSPECIFIED
Li, Ziyue	UNSPECIFIED	orcid.org/0000-0003-4983-9352	UNSPECIFIED
Stoimenova, Niya	UNSPECIFIED	UNSPECIFIED	UNSPECIFIED
Canali, Stefano	UNSPECIFIED	orcid.org/0000-0002-5948-3874	UNSPECIFIED