Converging Tides Lift All Boats: Consensus in Evaluation Criteria Boosts Investments in Firms in Nascent Technology Sectors

2023 | Organization Science | Citations: 0

Authors: Shen, Xirong (Subrina); Li, Huisi (Jessica); Tolbert, Pamela S.

Abstract: Although previous studies show that the emergence of evaluation criteria for a n ... Expand

Abstract: Although previous studies show that the emergence of evaluation criteria for a new technology improves the life chances of well-performing firms, we theorize that consensus in such criteria among technology experts increases investments to all firms in the new sector. We provide a variety of supportive evidence for this claim. First, in an experiment with 80 Chinese investors (Study 1), we provide evidence of a causal relation between evaluation consensus and investments. We follow this with a second experiment with 412 U.S. participants (Study 2), showing that evaluation criteria consensus increases participants’ propensity to view a firm as technologically competent and to expect others to favor investing in the firm. Analyses of longitudinal archival data on investment in artificial intelligence technology firms in the United States (Study 3a) and China (Study 3b) support the generalizability of our findings. By exploring the social-cognitive processes that link evaluation criteria consensus to investors’ decisions to invest in firms in nascent technology fields, this paper advances the scholarly understanding of the microfoundations of the institutionalization processes in new market sectors.History: This paper has been accepted for the Organization Science Special Issue on Experiments in Organizational Theory.Funding: This work was supported by Cornell University (Innovation, Entrepreneurship, and Technology Theme Research Grant, Jeffrey S. Lehman Fund for Scholarly Exchange with China).Supplemental Material: The online appendix is available at https://doi.org/10.1287/orsc.2021.1493. Collapse

Topics: evaluation criteria artificial intelligence database system decision making intellectual property

Methods: experiment hazard function archival research survey theory development

The relative importance of service quality dimensions in E-commerce experiences

2018 | International Journal of Information Management | Citations: 0

Authors: Palese, B.; Usai, A.

Abstract: Purpose: The proliferation of socialized data offers an unprecedented opportunity ... Expand

Abstract: Purpose: The proliferation of socialized data offers an unprecedented opportunity for customer service measurement. This paper addresses the problem of adequately measuring service quality using socialized data. Design/methodology/approach: The theoretical basis for the study is the widely used SERVQUAL model and we leverage a dataset uniquely suited for the analysis: the full database of online reviews generated on the website of the leading price comparison engine in Italy. Adopting a weakly supervised topic model, we extract the dimensions of service quality from these reviews. We use a linear regression to compare service quality dimensions between positive and negative opinions. Collapse

Topics: online review service quality user-generated content database system customer service

Methods: topic model computational algorithm natural language processing Gibbs sampling regression analysis method

Theories: SERVQUAL

Relative importance of evaluation criteria for enterprise systems: a conjoint study

2006 | Information Systems Journal | Citations: 74

Authors: Keil, Mark; Tiwana, Amrit

Abstract: While a large body of research exists on the development and implementation of s ... Expand

Abstract: While a large body of research exists on the development and implementation of software, organizations are increasingly acquiring enterprise software packages [e.g. enterprise resource planning (ERP) systems] instead of custom developing their own software applications. To be competitive in the marketplace, software package development firms must manage the three-pronged trade-off between cost, quality and functionality. Surprisingly, prior research has made little attempt to investigate the characteristics of packaged software that influence management information system (MIS) managers’ likelihood of recommending purchase. As a result, both the criteria by which MIS managers evaluate prospective packaged systems and the attributes that lead to commercially competitive ERP software products are poorly understood. This paper examines this understudied issue through a conjoint study. We focus on ERP systems, which are among the largest and most complex packaged systems that are purchased by organizations. In a conjoint study, 1008 evaluation decisions based on hypothetical ERP software package profiles were completed by managers in 126 organizations. The study represents the first empirical investigation of the relative importance that managers ascribe to various factors that are believed to be important in evaluating packaged software. The results provide important insights for both organizations that acquire such systems and those that develop them. The results show that functionality, reliability, cost, ease of use and ease of customization are judged to be important criteria, while ease of implementation and vendor reputation were not found to be significant. Functionality and reliability were found to be the most heavily weighted factors. We conclude the paper with a detailed discussion of the results and their implications for software acquisition and development practice. Collapse

Topics: packaged software enterprise information system ease of use enterprise resource planning IS evaluation

Methods: survey literature study computational algorithm regression analysis method survey design

Enhancing Asynchronous User Communication with Cross Platform and Channel Agnostic Messaging Services

2006 | Americas Conference on Information Systems | Citations: 0

Authors: Muntermann, Jan; Milic, Natasa

Abstract: Choosing an optimal channel for communication has become a difficult task for th ... Expand

Abstract: Choosing an optimal channel for communication has become a difficult task for the user. The number of options continuously increases with new devices and services. For asynchronous communication we nowadays use several mobile messaging services such as Short Message Service (SMS) and Multimedia Message Service (MMS), in addition to ubiquitous e-mail that is available on the desktop and mobile devices. Users face two main difficulties. First, the sender has no information about the recipient’s device status or preferences. Second, the sender may not have access to a messaging client or online messaging service that supports message types the recipient can receive. These challenges represent opportunities for new services that we explore through design science research. We develop a system architecture and client applications for communication across Internet and mobile cellular networks. As the user composes the content of a message, the system recommends the optimal service. Based on the sender’s selection, it constructs the appropriate message type and sends it to the recipient. The paper describes the system architecture and the recommender model and assesses the properties of the system in relation to the system requirements. Collapse

Topics: usability evaluation criteria human computer interaction client-server model ease of use

Methods: design artifact usability testing design science