Impact of Anxiety on Information Processing Among Young Adults: An Exploratory Eye-tracking Study

2023 | HICSS | Citations: 0

Authors: Alrefaei, Doaa; Sankar, Gaayathri; Norouzi Nia, Javad; Djamasbi, Soussan; Liu, Shichao; Strauss, Sarah; Gbetonmasse, Somasse

Abstract: Anxiety, one of the most common mental illnesses among American adults, is often ... Expand

Abstract: Anxiety, one of the most common mental illnesses among American adults, is often assessed via self-reported measures. While self-reported measures provide an efficient step in capturing health symptoms from patients’ point of view, by their mere nature self-reported measures provide only a narrow interpretation of health symptoms. Capturing eye movements unobtrusively during self-reports, when patients summarize their experience of anxiety by choosing a single option among a set of alternatives, can provide invaluable insight about patients’ information processing and decision behavior. Because anxiety impacts how we attended to information that we use to select options, the objective moment-to-moment eye-movement data can substantially enrich the information that is typically provided by patients as single scores representing their anxiety levels. Supporting this point of view, our results indicate that eye movements may serve as valuable objective information complementing the subjective self-reported anxiety measures to enable more effective assessment and treatment of anxiety. Collapse

Topics: decision making innovation management

Methods: oculometry self reported survey regression analysis method survey experiment

Does additional audio really work? A study on users' cognitive behavior with audio-visual dual-channel in panoramic digital museum

2023 | Information & Management | Citations: 0

Authors: He, Xiaoyang; Wu, Dan

Abstract: Multi-channel human-computer interaction offers a new perspective for optimizati ... Expand

Abstract: Multi-channel human-computer interaction offers a new perspective for optimization research in the digital museum, though there is no empirical evidence on how these factors affect cognition. This paper conducted a controlled experiment using the audio guide as a breakthrough point, aiming to determine the cognitive changes before and after the audio-visual dual-channel interaction. The results demonstrate that adding the auditory channel brought more cognitive load but not better cognitive outcomes. This paper evaluated the reasons behind it and noted that designing channels based solely on technical feasibility is undesirable, with suggestions pro­ posed for museum practitioners and platform developers. Collapse

Topics: mobile system usability human computer interaction virtual reality computer hardware

Methods: oculometry experiment parametric test descriptive statistic survey

Webcam Eye Tracking for Desktop and Mobile Devices: A Systematic Review

2023 | HICSS | Citations: 0

Authors: Heck, Melanie; Becker, Christian; Deutscher, Viola

Abstract: Building the Internet of Behaviors (IOB) obviously requires capturing human beha ... Expand

Abstract: Building the Internet of Behaviors (IOB) obviously requires capturing human behavior. Sensor input from eye tracking has been widely used for profiling in market research, adaptive user interfaces, and other smart systems, but requires dedicated hardware. The wide spread of webcams in consumer devices like phones, tablets, notebooks, and smart TVs has fostered eye tracking with commodity cameras. In this paper, we present a systematic review across the IEEE and ACM databases -- complemented by snowballing and input from eye tracking experts at CHI 2021 -- to list and characterize publicly available webcam eye trackers that estimate the point-of-regard on devices with no additional hardware. Information from articles was supplemented by searching author websites and code repositories, and contacting authors. 16 eye trackers were found that can be used. The restrictions regarding license terms and technical performance are presented, enabling developers to choose an appropriate software for their IoB application. Collapse

Topics: tablet source code database system desktop computer website

Methods: oculometry literature sample structured literature research meta analysis synthesis

IMPACT OF EXPLAINABLE AI ON COGNITIVE LOAD: INSIGHTS FROM AN EMPIRICAL STUDY

2023 | European Conference On Information Systems | Citations: 0

Authors: Herm, Lukas-Valentin

Abstract: While the emerging research field of explainable artificial intelligence (XAI) ... Expand

Abstract: While the emerging research field of explainable artificial intelligence (XAI) claims to address the lack of explainability in high-performance machine learning models, in practice, XAI targets developers rather than actual end-users. Unsurprisingly, end-users are often unwilling to use XAI-based decision support systems. Similarly, there is limited interdisciplinary research on end-users' behavior during XAI explanations usage, rendering it unknown how explanations may impact cognitive load and further affect end-user performance. Therefore, we conducted an empirical study with 271 prospective physicians, measuring their cognitive load, task performance, and task time for distinct implementationindependent XAI explanation types using a COVID-19 use case. We found that these explanation types strongly influence end-users' cognitive load, task performance, and task time. Further, we contextualized a mental efficiency metric, ranking local XAI explanation types best, to provide recommendations for future applications and implications for sociotechnical XAI research. Collapse

Topics: explainable artificial intelligence task productivity artificial intelligence decision support system shapley additive explanation

Methods: descriptive statistic statistical hypothesis test literature study machine learning survey

Theories: theory of abduction

IoT and Wearable Devices-Enhanced Information Provision of AR Glasses: A Multi-Modal Analysis in Aviation Industry

2023 | International Conference on Information Systems | Citations: 0

Authors: Han, Xuewen; Li, Ting; Xu, Sean Xin; Yang, Zherui; Yin, Zhitao; Zhang, Kunpeng

Abstract: While Augmented Reality (AR) glasses are now instrumental in industries for del ... Expand

Abstract: While Augmented Reality (AR) glasses are now instrumental in industries for delivering work-related information, the current one-size-fits-all information provision of AR glasses fails to cater to diverse workers' needs and environmental conditions. We propose a framework for harnessing Internet of thing (IoT) and wearable technology to improve the adaptability and customization of information provision by AR. As a preliminary exploration, this short paper develops a multi-modal data processing system for work performance classification in the aviation industry. Using machine learning algorithms for multi-modal feature extraction and classifier construction, this framework provides a more objective and consistent evaluation of work performance compared to singlemodal approaches. The proposed analytics architecture can provide valuable insights for other industries struggling to implement IoT and mixed reality. Collapse

Topics: smart wearable device mobile system internet of things individual characteristic ergonomics

Methods: oculometry machine learning support vector machine lasso regression robustness check

How do consumers perceive and process online overall vs. individual text-based reviews? Behavioral and eye-tracking evidence

2023 | Information & Management | Citations: 0

Authors: Jin, Jia; Wang, Ailian; Wang, Cuicui; Ma, Qingguo

Abstract: Building on the Heuristic-Systematic model, we use a survey and two eye-tracking ... Expand

Abstract: Building on the Heuristic-Systematic model, we use a survey and two eye-tracking experiments to investigate consumers’ perceived usefulness of overall and individual text-based reviews (OTRs vs. ITRs) for search vs. experience products, and the information processing features. Results indicate that OTRs show higher usefulness than ITRs, regardless of product type. ITRs are perceived to be more useful for experience products than for search products. Furthermore, two eye-tracking studies confirm these results from a physiological standpoint and reveal the attentional allocation during information processing. OTRs affect subjects’ processing of ITRs infor­ mation differently in purchase search and experience products. Collapse

Topics: perceived usefulness online review electronic commerce user-generated content web page

Methods: oculometry experiment survey parametric test ANOVA

Theories: information processing theory

Embracing brain and behaviour: Designing programs of complementary neurophysiological and behavioural studies

2023 | Information Systems Journal | Citations: 3

Authors: Kirwan, C. Brock; Vance, Anthony; Jenkins, Jeffrey L.; Anderson, Bonnie Brinton

Abstract: NeuroIS—the methods and knowledge of neuroscience applied to the information sys ... Expand

Abstract: NeuroIS—the methods and knowledge of neuroscience applied to the information systems (IS) domain—has become an established research field within the IS discipline. A key advantage of NeuroIS is its ability to provide insights into human cognition beyond those obtained using behavioural techniques alone. Nevertheless, in neuroscience, there is renewed interest in examining behaviour together with neurophysiological methods to better inform our understanding of neural processes. In this research opinion article, we argue that in the field of NeuroIS, there is an opportunity for hybrid programs of study that combine neurophysiological and behavioural methods in a complementary manner. We outline four strategies for designing complementary neurophysiological and behavioural experiments in a research program: (1) observe the relationship between neural processes and behavioural change; (2) combine neurophysiological and behavioural methods to enhance internal, external, and ecological validity; (3) extend, rather than replicate, experiments based on theory; and (4) use neurophysiological and behavioural experiments together to evaluate IT artefact design. By applying these strategies, researchers can more effectively design programs using complementary neurophysiological and behavioural methods, which, in turn, can help to provide richer insights into the phenomena under study as well as accelerate the advancement of IS knowledge. Collapse

Topics: marketing management Google+ IT security threat personal computer enterprise resource planning

Methods: experiment NeuroIS neurophysiology oculometry functional magnetic resonance imaging

Understanding the Role of Expert Intuition in Medical Image Annotation: A Cognitive Task Analysis Approach

2023 | HICSS | Citations: 0

Authors: Leiser, F.; Warsinsky, S.; Daum, M.; Schmidt-Kraepelin, M.; Thiebes, S.; Wagner, M.; Sunyaev, A.

Abstract: To improve contemporary machine learning (ML) models, research is increasingly ... Expand

Abstract: To improve contemporary machine learning (ML) models, research is increasingly looking at tapping in and incorporating the knowledge of domain experts. However, expert knowledge often relies on intuition, which is difficult to formalize for incorporation into ML models. Against this backdrop, we investigate the role of intuition in the context of expert medical image annotation. We apply a cognitive task analysis approach, where we observe and interview six expert medical image annotators to gain insights into pertinent decision cues and the role of intuition during annotation. Our results show that intuition plays an important role in various steps of the medical image annotation process, particularly in the appraisals of very easy or very difficult images, and in case purely cognitive appraisals remain inconclusive. Overall, we contribute to a better understanding of expert intuition in medical image annotation and provide possible interfaces to incorporate said intuition into ML models. Collapse

Topics: decision making knowledge representation

Methods: qualitative interview survey self reported survey triangulation cognitive task analysis

Debunking Sustainability Excuses with Instrumentality and Expectancy Visualizations: A Physiological Perspective

2023 | International Conference on Information Systems | Citations: 0

Authors: Li, Zhiyin; Choi, Ben

Abstract: This study advances the IS literature by investigating the effects of visualiza ... Expand

Abstract: This study advances the IS literature by investigating the effects of visualization on promoting sustainability knowledge and pro-environmental behaviors. Specifically, drawing on the visualization literature, we explain how the key visualization features, expectancy illustration, and interactivity affect individuals' understanding of the impact of their behaviors on the environment, encouraging pro-environmental behaviors. Additionally, we draw on the pedagogy literature to explicate that the effects of visualization on learning outcomes and pro-environmental practices can be explained through individuals' psychological responses in their course of interpreting the visualization. Collectively, this study presents our endeavor in understanding the roles of visualization in ecological discourse by integrating the visualization literature and sustainability research. Moreover, by unboxing individuals' psychological processes in interpreting visualization, we offer a fresh perspective to understanding the promises and challenges of using visualization for knowledge acquisition. Collapse

Topics: task productivity knowledge acquisition data literacy

Methods: oculometry parametric test ANOVA simulation experiment

Theories: expectancy theory of motivation

Unlocking Sustainability with Visualizations: Driving the Driven through the Whys and Hows

2023 | International Conference on Information Systems | Citations: 0

Authors: Li, Zhiyin; Choi, Ben

Abstract: ... Expand

Abstract: Collapse

Topics: digital dashboard human computer interaction usability

Methods: simulation oculometry experiment longitudinal research parametric test

Theories: construal level theory