Expl(AI)ned: The Impact of Explainable Artificial Intelligence on Users’ Information Processing

2023 | Information Systems Research | Citations: 0

Authors: Bauer, Kevin; von Zahn, Moritz; Hinz, Oliver

Abstract: Because of a growing number of initiatives and regulations, predictions of moder ... Expand

Abstract: Because of a growing number of initiatives and regulations, predictions of modern artificial intelligence (AI) systems increasingly come with explanations about why they behave the way they do. In this paper, we explore the impact of feature-based explanations on users’ information processing. We designed two complementary empirical studies where participants either made incentivized decisions on their own, with the aid of opaque predictions, or with explained predictions. In Study 1, laypeople engaged in the deliberately abstract investment game task. In Study 2, experts from the real estate industry estimated listing prices for real German apartments. Our results indicate that the provision of feature-based explanations paves the way for AI systems to reshape users’ sense making of information and understanding of the world around them. Specifically, explanations change users’ situational weighting of available information and evoke mental model adjustments. Crucially, mental model adjustments are subject to the confirmation bias so that misconceptions can persist and even accumulate, possibly leading to suboptimal or biased decisions. Additionally, mental model adjustments create spillover effects that alter user behavior in related yet disparate domains. Overall, this paper provides important insights into potential downstream consequences of the broad employment of modern explainable AI methods. In particular, side effects of mental model adjustments present a potential risk of manipulating user behavior, promoting discriminatory inclinations, and increasing noise in decision making. Our findings may inform the refinement of current efforts of companies building AI systems and regulators that aim to mitigate problems associated with the black-box nature of many modern AI systems. History: Alessandro Acquisti, senior editor; Jason Chan, associate editor. Funding: This work was supported by the Deutsche Forschungsgemeinschaft (DFG) (Projek 449023539), Volkswagen Foundation (ML2MT), and LeibnizInstitute for Financial Research SAFE. Supplemental Material: The online appendix is available at https://doi.org/10.1287/isre.2023.1199. Collapse

Topics: explainable artificial intelligence artificial intelligence shapley additive explanation local interpretable model agnostic explanation decision making

Methods: F-test regression analysis method experiment field study robustness check

Learning with Digital Agents: An Analysis based on the Activity Theory

2023 | Journal of Management Information Systems | Citations: 0

Authors: Dolata, Mateusz; Katsiuba, Dzmitry; Wellnhammer, Natalie; Schwabe, Gerhard

Abstract: Digital agents are considered a general-purpose technology. They spread quickly ... Expand

Abstract: Digital agents are considered a general-purpose technology. They spread quickly in private and organizational contexts, including education. Yet, research lacks a conceptual framing to describe interaction with such agents in a holistic manner. While focusing on the interaction with a pedagogical agent, that is, a digital agent capable of natural-language interaction with a learner, we propose a model of learning activity based on activity theory. We use this model and a review of prior research on digital agents in education to analyze how various characteristics of the activity, including features of a pedagogical agent or learner, influence learning outcomes. The analysis leads to identification of information systems research directions and guidance for developers of pedagogical agents and digital agents in general. We conclude by extending the activity theory-based model beyond the context of education and show how it helps designers and researchers ask the right questions when creating a digital agent. Collapse

Topics: online learning system artificial intelligence website human AI collaboration human computer interaction

Methods: literature study design artifact literature sample experiment structured literature research

Theories: activity theory socio technical theory theory of intentionality

Orchestrating distributed data governance in open social innovation

2023 | Information and Organization | Citations: 0

Authors: Gegenhuber, Thomas; Mair, Johanna; Lührsen, René; Thäter, Laura

Abstract: Open Social Innovation (OSI) involves the collaboration of multiple stakeholders ... Expand

Abstract: Open Social Innovation (OSI) involves the collaboration of multiple stakeholders to generate ideas, and develop and scale solutions to make progress on societal challenges. In an OSI project, stakeholders share data and information, utilize it to better understand a problem, and combine data with digital technologies to create digitally-enabled solutions. Consequently, data gover­ nance is essential for orchestrating an OSI project to facilitate the coordination of innovation. Because OSI brings multiple stakeholders together, and each stakeholder participates voluntarily, data governance in OSI has a distributed nature. In this essay we put forward a framework consisting of three dimensions allowing an inquiry into the effectiveness of such distributed data governance: (1) openness (i.e., freely sharing data and information), (2) accountability (i.e., willingness to be held responsible and provide justifications for one's conduct) and (3) power (i.e., resourceful actors' ability to impact other stakeholder's actions). We apply this framework to reflect on the OSI project #WirVsVirus (“We versus virus” in English), to illustrate the challenges in organizing effective distributed data governance, and derive implications for research and practice. Collapse

Topics: data governance societal challenge innovation management business model information exchange

Methods: theory development

Threefold Sustainable Neighborhood Energy Systems: Depicting Social Criteria in Decision Support Systems

2023 | Americas Conference on Information Systems | Citations: 0

Authors: Hart, Maria; Eckhoff, Sarah; Schäl, Ann-Kristin; Breitner, Michael H.

Abstract: Despite the consensus that considering social factors is as important as econom ... Expand

Abstract: Despite the consensus that considering social factors is as important as economic and environmental dimensions for long-term successful, sustainable energy development projects, there is a lack of quantifiable assessments in multi-energy simulation decision support systems. Therefore, we applied a design science research approach to develop an energy system simulator that includes all three dimensions of sustainability. Based on a rigorous literature review and expert interviews, we establish a framework for assessing social sustainability. We then implement the derived criteria and indicators in the open-access software NESSI and validate it in an applicability check for a Madagasi neighborhood. With our framework, we aim to provide guidance to researchers and stakeholders on incorporating the social sustainability dimension into their approaches, tools, and decision-making process. The user-friendly, web-based simulation software enables various stakeholders to explore the interrelationships of threefold sustainability in specific energy systems. KeywordsSocial sustainability, multi-energy system simulation, decision support system, design science research, sustainable development goals. Collapse

Topics: energy information system decision support system open access usability IT security threat

Methods: literature study qualitative interview design science literature sample applicability check

The social dilemma of big data: Donating personal data to promote social welfare

2023 | Information and Organization | Citations: 0

Authors: Hillebrand, Kirsten; Hornuf, Lars; Müller, Benjamin; Vrankar, Daniel

Abstract: When using digital devices and services, individuals provide their personal data ... Expand

Abstract: When using digital devices and services, individuals provide their personal data to organizations in exchange for gains in various domains of life. Organizations use these data to run technologies such as smart assistants, augmented reality, and robotics. Most often, these organizations seek to make a profit. Individuals can, however, also provide personal data to public databases that enable nonprofit organizations to promote social welfare if sufficient data are contributed. Reg­ ulators have therefore called for efficient ways to help the public collectively benefit from its own data. By implementing an online experiment among 1696 US citizens, we find that individuals would donate their data even when at risk of getting leaked. The willingness to provide personal data depends on the perceived risk level of a data leak but not on a realistic impact of the data on social welfare. Individuals are less willing to donate their data to the private industry than to academia or the government. Finally, individuals are not sensitive to whether the data are pro­ cessed by a human-supervised or a self-learning smart assistant. Collapse

Topics: database system economic surplus IS economics health information system data breach

Methods: archival research experiment nonparametric test Kruskal Wallis test computational algorithm

Theories: prospect theory privacy calculus theory

Digital Social Enterprise for Sustainable Development: Insights from the Case Study in Nepal

2023 | HICSS | Citations: 0

Authors: Karki, Yashoda

Abstract: It is generally agreed that digital social enterprises (DSE) through the digital ... Expand

Abstract: It is generally agreed that digital social enterprises (DSE) through the digitalization process can contribute to sustainable development. However, there are a few theoretical and empirical studies in this research stream. To address this knowledge gap, we conducted a qualitative interpretive case study in Nepal. Applying the theory of affordances as an analytical tool, we identified five digital affordances: transactability, communicability, accessibility, manageability, and digitizability. By actualizing these affordances, DSEs can contribute to access to market and finance, social engagement, waste management, and digitized information. We also identified various challenges such as lack of awareness about digital affordances and capabilities to actualize those affordances, lack of digital culture, and poor mapping system that can inhibit the actualization of the affordances and showed the facilitating conditions that can address these challenges. Finally, we suggest future research avenues. Collapse

Topics: affordance user experience usability research and development mobile phone

Methods: qualitative interview case study qualitative content analysis design artifact

Theories: theory of affordance

Digitally Transforming in a Traditional Industry: A Senior Management Perspective

2023 | HICSS | Citations: 0

Authors: Torto, Malaika; Kristofersson, Amanda

Abstract: Digital transformation (DT) continuously reshapes and disrupts established indus ... Expand

Abstract: Digital transformation (DT) continuously reshapes and disrupts established industries. While DT has become a buzzworthy trend, many firms still struggle to advance their DT journeys. As such, we explore the drivers of DT, and the challenges managers encounter as DT is manifested in practice in traditional industries. By adopting a qualitative approach, we gain insight into senior managers’ perspectives on DT in the context of the Swedish forestry industry. Our results reveal that the drivers of DT in traditional industries hinge on organizational structures, innovation direction, and organizational identity being changed to prevail. Our study extends research on DT in traditional industries and highlights probable areas of concern that industry practitioners can probe during their organizations’ transformation journeys. Collapse

Topics: digital transformation innovation management organization structure IT manager IT skill

Methods: qualitative interview single case study case study personal interview design artifact

Shaping a Smart Transportation System for Sustainable Value Co-Creation

2023 | Information Systems Frontiers | Citations: 0

Authors: Zhang, Jun; Li, Shuyang; Wang, Yichuan

Abstract: The smart transportation system (STS) leverages ubiquitous and networked computi ... Expand

Abstract: The smart transportation system (STS) leverages ubiquitous and networked computing to improve the efficiency of urban mobility. Whilst existing IS work has explored various factors influencing STS development, there is a lack of consideration of how value can be created for building a more sustainable STS. Drawing upon the value co-creation theory and stakeholder theory, we seek to understand the socio-technical shaping of the STS ecosystem and how government, firms and citizens collaboratively create sustainable value for designing and implementing STS initiatives. To reach this aim, we carry out a longitudinal case study over 2016–2018 in Shijiazhuang, China. We offer both theoretical and practical explanations on (i) key value facets with regard to sustainable STS design and implementation; and (ii) a holistic view of iterative value co-creation process pushed by key stakeholders. This study makes particular contributions to the IS, marketing and transportation literature by offering a critical understanding of the social dynamics for shaping a big data-driven STS ecosystem. Collapse

Topics: participatory design smart city big data marketing management innovation management

Methods: design methodology longitudinal research qualitative interview longitudinal case study design process

Theories: stakeholder theory socio technical theory

Deriving Facilitators for Electronic Health Record Implementation: A Systematic Literature Review of Opportunities and Challenges

2022 | European Conference On Information Systems | Citations: 0

Authors: Amend, Julia; Eymann, Torsten; Kauffmann, Anna; Münch, Tobias; Troglauer, Patrick

Abstract: Electronic Health Records aim to remove information asymmetries between healthc ... Expand

Abstract: Electronic Health Records aim to remove information asymmetries between healthcare providers and contribute to improved healthcare quality and safety. Nevertheless, the successful and comprehensive implementation remains challenging and complex. Recently, increased interest of patients in their healthcare and enhanced technological opportunities led to new challenges and an emerging amount of research. To achieve an overarching overview of facilitators for EHR implementation, the perspectives of relevant stakeholders were considered. Therefore, we conducted a multidisciplinary systematic literature review involving five databases from public health, information systems, and interdisciplinary research. As a result, we first identified opportunities and challenges according to the stakeholder groups, environmental context, and implementation stages. Second, we derived five facilitators (individual stakeholder readiness, change management, accessibility and ownership, EHR structure, and external factors). Therefore, we lay a state-of-the-art foundation for EHR implementation for scientific studies and development activities in practice with our research. Collapse

Topics: change management database system electronic health record organizational transformation technological change

Methods: structured literature research literature sample design artifact natural language processing literature study

Algorithmic Assortative Matching on a Digital Social Medium

2022 | Information Systems Research | Citations: 0

Authors: López Vargas, Kristian; Runge, Julian; Zhang, Ruizhi

Abstract: Humans are increasingly interacting in and operating their daily lives through s ... Expand

Abstract: Humans are increasingly interacting in and operating their daily lives through structured digital and virtual environments, mainly through apps that provide media for sharing photos, messaging, gaming, collaborating, or video watching. Most of these digital environments are offered under “freemium” pricing to facilitate adoption and network effects. In these settings, users’ early social interaction and experience often have a substantial impact on their longer term behavior. On this background, we study the impact of an algorithmic system that matches new users to existing communities in an assortative manner. We devise a machine learning–based matching system that identifies users with high expected value and provides them the option to join highly active, in terms of engagement and expenditure, teams. We deploy this mechanism experimentally in a digital social game and find that it significantly increases user engagement, spending, and socialization. This finding holds for more active communities and overall. Teams matched with low-activity new users are negatively impacted, leading to an overall more segregated social environment. We argue that social experience and social behavior in groups are likely mechanisms that drive the impact of the matching system. History: This paper has been accepted for the Information Systems Research Special Section on Market Design and Analytics. Supplemental Material: The online appendix is available at https://doi.org/10.1287/isre.2022.1135. Collapse

Topics: mobile application manufacturing information system social media price management productivity

Methods: experiment pilot experiment field experiment regression analysis method mediation analysis