Designing Trustworthy AI: A Human-Machine Teaming Framework to Guide Development

  • 2019-10-08 16:19:49
  • Carol J. Smith
  • 1

Abstract

Artificial intelligence (AI) holds great promise to empower us with knowledgeand augment our effectiveness. We can -- and must -- ensure that we keep humanssafe and in control, particularly with regard to government and public sectorapplications that affect broad populations. How can AI development teamsharness the power of AI systems and design them to be valuable to humans?Diverse teams are needed to build trustworthy artificial intelligent systems,and those teams need to coalesce around a shared set of ethics. There are manydiscussions in the AI field about ethics and trust, but there are fewframeworks available for people to use as guidance when creating these systems.The Human-Machine Teaming (HMT) Framework for Designing Ethical AI Experiencesdescribed in this paper, when used with a set of technical ethics, will guideAI development teams to create AI systems that are accountable, de-risked,respectful, secure, honest, and usable. To support the team's efforts,activities to understand people's needs and concerns will be introduced alongwith the themes to support the team's efforts. For example, usability testingcan help determine if the audience understands how the AI system works andcomplies with the HMT Framework. The HMT Framework is based on reviews ofexisting ethical codes and best practices in human-computer interaction andsoftware development. Human-machine teams are strongest when human users cantrust AI systems to behave as expected, safely, securely, and understandably.Using the HMT Framework to design trustworthy AI systems will provide supportto teams in identifying potential issues ahead of time and making greatexperiences for humans.

 

Quick Read (beta)

loading the full paper ...