Promoting Algorithm Adoption in the Presence of Human Experts: A Field Study

41 Pages Posted: 27 May 2020 Last revised: 18 Mar 2021

See all articles by Xue (Jane) Tan

Xue (Jane) Tan

Indiana University - Kelley School of Business

Mochen Yang

University of Minnesota - Twin Cities - Carlson School of Management

Gang Wang

affiliation not provided to SSRN

Date Written: March 17, 2021

Abstract

Promoting the adoption of algorithm-based service in the presence of human-based service is a challenge faced by an increasing number of service providers. We partner with a mobile platform that offers two types of free consulting services to support high school students in China to make college application decisions: a volunteer consulting service provided by college student volunteers and an algorithm consulting tool that provides personalized recommendations. Analyses of clickstream activities suggest that organic adoption of algorithm consulting is low, and students who use volunteer consulting rarely try out algorithm consulting. We then conduct a randomized field experiment to examine how sending facilitating information in the form of call-to-action messages affects algorithm adoption. We design three different messages: a straightforward reminder, a negatively framed message that highlights the inadequacy of volunteer consulting, and a positively framed message that focuses on the unique advantages of algorithm consulting. We show that all three messages significantly enhance algorithm adoption, with the reminder message having the strongest average effect. Moreover, message effectiveness varies across students with different experiences with volunteer consulting. Specifically, the effect of reminder message is stronger for students with more volunteer searches; the positive message is more effective for students who chat with more volunteers; and the negative message has a greater effect for students whose activities are suggestive of unsatisfactory experiences with volunteer consulting. Our work advances the understanding of algorithm adoption in the presence of human experts and demonstrates the effectiveness of call-to-action interventions to promote adoption.

Keywords: algorithms, human experts, service adoption, call-to-action, field experiment, mobile analytics

Suggested Citation

Tan, Xue and Yang, Mochen and Wang, Gang, Promoting Algorithm Adoption in the Presence of Human Experts: A Field Study (March 17, 2021). Available at SSRN: https://ssrn.com/abstract=3566609 or http://dx.doi.org/10.2139/ssrn.3566609

Xue Tan

Indiana University - Kelley School of Business ( email )

1309 East Tenth Street
Indianapolis, IN 47405-1701
United States

Mochen Yang (Contact Author)

University of Minnesota - Twin Cities - Carlson School of Management ( email )

19th Avenue South
Minneapolis, MN 55455
United States

Gang Wang

affiliation not provided to SSRN

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
107
Abstract Views
500
rank
324,734
PlumX Metrics