Publications
Publications
Show Results For
- All HBS Web
(172)
- Faculty Publications (60)
Page 1 of 60
Results →
- 2025
- Article
Statistical Inference for Heterogeneous Treatment Effects Discovered by Generic Machine Learning in Randomized Experiments
By: Kosuke Imai and Michael Lingzhi Li
Researchers are increasingly turning to machine learning (ML) algorithms to investigate causal heterogeneity in randomized experiments. Despite their promise, ML algorithms may fail to accurately ascertain heterogeneous treatment effects under practical settings with... View Details
- 2024
- Working Paper
Why Most Resist AI Companions
By: Julian De Freitas, Zeliha Oğuz-Uğuralp, Ahmet Kaan Uğuralp and Stefano Puntoni
Chatbots are now able to form emotional relationships with people and alleviate loneliness—a growing public health concern. Behavioral research provides little insight into whether everyday people are likely to use these applications and why. We address this question... View Details
- November 2024
- Case
AlphaGo (A): Birth of a New Intelligence
By: Shikhar Ghosh and Shweta Bagai
This case, the first of a three-part series, traces DeepMind's evolution from its 2010 founding through its acquisition by Google in 2014. Often referred to as the "Apollo project" of artificial intelligence, DeepMind used games as a testing ground to develop AI... View Details
- November 2024 (Revised January 2025)
- Case
MiDAS: Automating Unemployment Benefits
By: Shikhar Ghosh and Shweta Bagai
In 2015, the state of Michigan considered whether to nominate its Michigan Integrated Data Automated System (MiDAS) for a prestigious state technology award. Launched in 2013 amid severe budget pressures, the $47 million automated fraud detection system was designed to... View Details
Keywords: Artificial Intelligence; AI; Machine Learning Models; Algorithmic Data; Decision Making; Automation; Benefits; Compensation; Cost Reduction; Digital Transformation; Employment; Government; Fraud; Government Technology; Public Sector; Systems; Systems Integration; Unemployment Insurance; Waste Heat Recovery; AI and Machine Learning; Government Administration; Information Technology; Insurance; United States
- November–December 2024
- Article
Outcome-Driven Dynamic Refugee Assignment with Allocation Balancing
By: Kirk Bansak and Elisabeth Paulson
This study proposes two new dynamic assignment algorithms to match refugees and asylum seekers to geographic localities within a host country. The first, currently implemented in a multi-year pilot in Switzerland, seeks to maximize the average predicted employment... View Details
- 2024
- Article
Learning Under Random Distributional Shifts
By: Kirk Bansak, Elisabeth Paulson and Dominik Rothenhäusler
Algorithmic assignment of refugees and asylum seekers to locations within host
countries has gained attention in recent years, with implementations in the U.S.
and Switzerland. These approaches use data on past arrivals to generate machine
learning models that can... View Details
- 2024
- Book
Fintech, Small Business & the American Dream: How Technology Is Transforming Lending and Shaping a New Era of Small Business Opportunity
By: Karen G. Mills
The second edition of Fintech, Small Business & the American Dream, builds on the groundbreaking 2019 book with new insights on how technology and artificial intelligence are transforming small business lending. This ambitious view covers the significance of... View Details
- 2024
- Article
Neyman Meets Causal Machine Learning: Experimental Evaluation of Individualized Treatment Rules
By: Michael Lingzhi Li and Kosuke Imai
A century ago, Neyman showed how to evaluate the efficacy of treatment using a randomized experiment under a minimal set of assumptions. This classical repeated sampling framework serves as a basis of routine experimental analyses conducted by today’s scientists across... View Details
- July 2024
- Article
How Artificial Intelligence Constrains Human Experience
By: A. Valenzuela, S. Puntoni, D. Hoffman, N. Castelo, J. De Freitas, B. Dietvorst, C. Hildebrand, Y.E. Huh, R. Meyer, M. Sweeney, S. Talaifar, G. Tomaino and K. Wertenbroch
Many consumption decisions and experiences are digitally mediated. As a consequence, consumer behavior is increasingly the joint product of human psychology and ubiquitous algorithms (Braun et al. 2024; cf. Melumad et al. 2020). The coming of age of Large Language... View Details
- April 2024
- Article
A Machine Learning Algorithm Predicting Risk of Dilating VUR among Infants with Hydronephrosis Using UTD Classification
By: Hsin-Hsiao Scott Wang, Michael Lingzhi Li, Dylan Cahill, John Panagides, Tanya Logvinenko, Jeanne Chow and Caleb Nelson
Backgrounds: Urinary Tract Dilation (UTD) classification has been designed to be a more objective grading system to evaluate antenatal and post-natal UTD. Due to unclear association between UTD classifications to specific anomalies such as vesico-ureteral reflux (VUR),... View Details
- 2024
- Working Paper
The Cram Method for Efficient Simultaneous Learning and Evaluation
By: Zeyang Jia, Kosuke Imai and Michael Lingzhi Li
We introduce the "cram" method, a general and efficient approach to simultaneous learning and evaluation using a generic machine learning (ML) algorithm. In a single pass of batched data, the proposed method repeatedly trains an ML algorithm and tests its empirical... View Details
Keywords: AI and Machine Learning
- 2023
- Working Paper
An Experimental Design for Anytime-Valid Causal Inference on Multi-Armed Bandits
By: Biyonka Liang and Iavor I. Bojinov
Typically, multi-armed bandit (MAB) experiments are analyzed at the end of the study and thus require the analyst to specify a fixed sample size in advance. However, in many online learning applications, it is advantageous to continuously produce inference on the... View Details
- February 26, 2024
- Article
Making Workplaces Safer Through Machine Learning
By: Matthew S. Johnson, David I. Levine and Michael W. Toffel
Machine learning algorithms can dramatically improve regulatory effectiveness. This short article describes the authors' scholarly work that shows how the U.S. Occupational Safety and Health Administration (OSHA) could have reduced nearly twice as many occupational... View Details
- February 2024
- Teaching Note
Data-Driven Denim: Financial Forecasting at Levi Strauss
By: Mark Egan
Teaching Note for HBS Case No. 224-029. Levi Strauss & Co. (“Levi Strauss”) partnered with the IT services company Wipro to incorporate more sophisticated methods, such as machine learning, into their financial forecasting process starting in 2018. The decision to... View Details
- 2024
- Working Paper
Warnings and Endorsements: Improving Human-AI Collaboration Under Covariate Shift
By: Matthew DosSantos DiSorbo and Kris Ferreira
Problem definition: While artificial intelligence (AI) algorithms may perform well on data that are representative of the training set (inliers), they may err when extrapolating on non-representative data (outliers). These outliers often originate from covariate shift,... View Details
- January 2024 (Revised February 2024)
- Case
Data-Driven Denim: Financial Forecasting at Levi Strauss
By: Mark Egan
The case examines Levi Strauss’ journey in implementing machine learning and AI into its financial forecasting process. The apparel company partnered with the IT company Wipro in 2017 to develop a machine learning algorithm that could help Levi Strauss forecast its... View Details
- 2023
- Article
Benchmarking Large Language Models on CMExam—A Comprehensive Chinese Medical Exam Dataset
By: Junling Liu, Peilin Zhou, Yining Hua, Dading Chong, Zhongyu Tian, Andrew Liu, Helin Wang, Chenyu You, Zhenhua Guo, Lei Zhu and Michael Lingzhi Li
Recent advancements in large language models (LLMs) have transformed the field of question answering (QA). However, evaluating LLMs in the medical field is challenging due to the lack of standardized and comprehensive datasets. To address this gap, we introduce CMExam,... View Details
- October 2023 (Revised June 2024)
- Case
ReUp Education: Can AI Help Learners Return to College?
By: Kris Ferreira, Christopher Thomas Ryan and Sarah Mehta
Founded in 2015, ReUp Education helps “stopped out students”—learners who have stopped making progress towards graduation—achieve their college completion goals. The company relies on a team of success coaches to engage with learners and help them reenroll. In 2019,... View Details
- 2023
- Working Paper
In-Context Unlearning: Language Models as Few Shot Unlearners
By: Martin Pawelczyk, Seth Neel and Himabindu Lakkaraju
Machine unlearning, the study of efficiently removing the impact of specific training points on the
trained model, has garnered increased attention of late, driven by the need to comply with privacy
regulations like the Right to be Forgotten. Although unlearning is... View Details
- 2023
- Working Paper
The Impact of Input Inaccuracy on Leveraging AI Tools: Evidence from Algorithmic Labor Scheduling
By: Caleb Kwon, Antonio Moreno and Ananth Raman
Are the inputs used by your AI tool correct and up to date? In this paper, we show that the answer to this question: (i) is frequently a “no” in real business contexts, and (ii) has significant implications on the performance of AI tools. In the context of algorithmic... View Details