Abstract
Knowledge can't be disentangled from people. As AI knowledge systems minevast volumes of work-related data, the knowledge that's being extracted andsurfaced is intrinsically linked to the people who create and use it. Whenpredictive algorithms that learn from data are used to link knowledge andpeople, inaccuracies in knowledge extraction and surfacing can lead todisproportionate harms, influencing how individuals see each other and how theysee themselves at work. In this paper, we present a reflective analysis oftransparency requirements and impacts in this type of systems. We conduct amultidisciplinary literature review to understand the impacts of transparencyin workplace settings, introducing the looking-glass metaphor to conceptualizeAI knowledge systems as systems that reflect and distort, expanding our view ontransparency requirements, implications and challenges. We formulatetransparency as a key mediator in shaping different ways of seeing, includingseeing into the system, which unveils its capabilities, limitations andbehavior, and seeing through the system, which shapes workers' perceptions oftheir own contributions and others within the organization. Recognizing thesociotechnical nature of these systems, we identify three transparencydimensions necessary to realize the value of AI knowledge systems, namelysystem transparency, procedural transparency and transparency of outcomes. Wediscuss key challenges hindering the implementation of these forms oftransparency, bringing to light the wider sociotechnical gap and highlightingdirections for future Computer-supported Cooperative Work (CSCW) research.