Algorithmic recommendation technology or human curation? Study of online news outlet suggests both – Phys.org

Click here to sign in with or
Forget Password?
Learn more
share this!
19
Twit
Share
Email
November 27, 2023
This article has been reviewed according to Science X’s editorial process and policies. Editors have highlighted the following attributes while ensuring the content’s credibility:
fact-checked
peer-reviewed publication
trusted source
proofread
by Caitlin Kizielewicz, Carnegie Mellon University
Recommender systems are machine learning applications in online platforms that automate tasks historically done by people. In the news industry, recommender algorithms can assume the tasks of editors who select which news stories people see online, with the goal of increasing the number of clicks by users, but few studies have examined how the two compare.
A new study examined how users of an online news outlet in Germany reacted to automated recommendations versus choices made by human editors. On average, the algorithm outperformed the person, but the person did better under certain conditions. The study’s authors suggest a combination of human curation and automated recommender technology may be best.
The study was conducted by researchers at Carnegie Mellon University (CMU), the University of Lausanne, and Ludwig-Maximilians-Universität (LMU) München. It is published in Management Science.
“Our work highlights a critical tension between detailed yet potentially narrow information available to algorithms and broad but often unscalable information available to humans,” explains Ananya Sen, assistant professor of information systems and economics at CMU’s Heinz College, who coauthored the study. “Algorithmic recommendations personalize at scale using information that tends to be detailed but is often temporally narrow and context-specific, while human experts base recommendations on broad knowledge accumulated over a professional career but cannot make individual recommendations at scale.”
To quantify how companies should use algorithmic recommendation technology relative to human curation, researchers studied users’ reactions to automated recommendations compared to how they reacted to human recommendations at a major online news outlet in Germany from December 2017 to May 2018. The outlet is an ad-supported publisher with more than 20 million monthly visitors and nearly 120 million monthly page impressions.
On average, the algorithmic recommendations outperformed those curated by human editors with respect to users’ clicks. But this result depended on the experience of the human editors (more experienced editors did better than less experienced editors), the amount of personal data available to the algorithm (the algorithm required sufficient volume to perform well), and variation in the external environment that caused variation in demand for articles (humans did better on days with more attention-grabbing news).
The findings suggest that reverting to human curation can mitigate the drawbacks of personalized algorithmic recommendations, the authors say. They also suggest that platforms should defer to human expertise in the absence of user-specific personal data. The optimal combination of human curation and automated recommendation technology can lead to an increase of up to 13% in clicks.
“Based on our experiment, we suggest that managers leverage humans and automatic recommendations together rather than looking at curation as an issue that pits human experts against algorithms,” says Christian Peukert, professor of strategy, globalization, and society at the University of Lausanne’s business school, who co-authored the study.
Among the study’s limitations, the authors say their experiment tested only how one algorithm performed relative to human editors, so their findings may apply only to news media that is supported by ads.
More information: Christian Peukert et al, The Editor and the Algorithm: Recommendation Technology in Online News, Management Science (2023). DOI: 10.1287/mnsc.2023.4954

Journal information: Management Science
Provided by Carnegie Mellon University
Explore further
Facebook
Twitter
Email
Feedback to editors
12 hours ago
0
16 hours ago
0
17 hours ago
0
17 hours ago
0
17 hours ago
0
12 hours ago
12 hours ago
12 hours ago
12 hours ago
12 hours ago
13 hours ago
16 hours ago
16 hours ago
17 hours ago
17 hours ago
13 hours ago
Dec 26, 2023
Dec 25, 2023
Dec 25, 2023
Dec 24, 2023
Dec 23, 2023
More from Art, Music, History, and Linguistics
Jul 10, 2023
Nov 20, 2023
Jul 4, 2018
Feb 1, 2022
Sep 16, 2022
Jun 14, 2023
13 hours ago
Dec 23, 2023
Dec 22, 2023
Dec 21, 2023
Dec 20, 2023
Dec 19, 2023
Use this form if you have come across a typo, inaccuracy or would like to send an edit request for the content on this page. For general inquiries, please use our contact form. For general feedback, use the public comments section below (please adhere to guidelines).
Please select the most appropriate category to facilitate processing of your request
Thank you for taking time to provide your feedback to the editors.
Your feedback is important to us. However, we do not guarantee individual replies due to the high volume of messages.
Your email address is used only to let the recipient know who sent the email. Neither your address nor the recipient’s address will be used for any other purpose. The information you enter will appear in your e-mail message and is not retained by Phys.org in any form.

Get weekly and/or daily updates delivered to your inbox. You can unsubscribe at any time and we’ll never share your details to third parties.
More information Privacy policy
We keep our content available to everyone. Consider supporting Science X’s mission by getting a premium account.
Medical research advances and health news
The latest engineering, electronics and technology advances
The most comprehensive sci-tech news coverage on the web

source

About The Author

admin

See author's posts