Publications
Publications
Show Results For
- All HBS Web
(2,349)
- Faculty Publications (279)
- 2025
- Working Paper
Evaluations Amid Measurement Error: Determining the Optimal Timing for Workplace Interventions
By: Matthew DosSantos DiSorbo, Iavor I. Bojinov and Fiammetta Menchetti
Researchers have embraced factorial experiments to simultaneously evaluate multiple treatments, each with different levels. Typically, in large-scale factorial experiments, the primary objective is identifying the treatment with the largest causal effect, especially... View Details
- May–June 2024
- Article
Setting Gendered Expectations? Recruiter Outreach Bias in Online Tech Training Programs
By: Jacqueline N. Lane, Karim R. Lakhani and Roberto Fernandez
Competence development in digital technologies, analytics, and artificial intelligence is increasingly important to all types of organizations and their workforce. Universities and corporations are investing heavily in developing training programs, at all tenure... View Details
- April 2024
- Article
Pay-As-You-Go Insurance: Experimental Evidence on Consumer Demand and Behavior
By: Raymond Kluender
Pay-as-you-go contracts reduce minimum purchase requirements which may increase market participation. We randomize the introduction and price(s) of a novel pay-as-you-go contract to the California auto insurance market where 17 percent of drivers are uninsured. The... View Details
- 2024
- Working Paper
The Effects of Medical Debt Relief: Evidence from Two Randomized Experiments
By: Raymond Kluender, Neale Mahoney, Francis Wong and Wesley Yin
Two in five Americans have medical debt, nearly half of whom owe at least $2,500. Concerned by this burden, governments and private donors have undertaken large, high-profile efforts to relieve medical debt. We partnered with RIP Medical Debt to conduct two randomized... View Details
- 2025
- Working Paper
Greenlighting Innovative Projects: How Evaluation Format Shapes the Perceived Feasibility of Early-Stage Ideas
By: Jacqueline N. Lane, Simon Friis, Tianxi Cai, Michael Menietti, Griffin Weber and Eva C. Guinan
The evaluation of innovative early-stage projects is essential for allocating limited resources. We
investigate how the evaluation format affects the identification of feasibility issues through a
field experiment at a leading research university. Experts were... View Details
- 2024
- Working Paper
Anytime-Valid Inference in Linear Models and Regression-Adjusted Causal Inference
By: Michael Lindon, Dae Woong Ham, Martin Tingley and Iavor I. Bojinov
Linear regression adjustment is commonly used to analyze randomized controlled experiments due to its efficiency and robustness against model misspecification. Current testing and interval estimation procedures leverage the asymptotic distribution of such estimators to... View Details
- 2024
- Working Paper
Design of Panel Experiments with Spatial and Temporal Interference
By: Tu Ni, Iavor Bojinov and Jinglong Zhao
One of the main practical challenges companies face when running experiments (or A/B tests) over a panel is interference, the setting where one experimental unit's treatment assignment at one time period impacts another's outcomes, possibly at the following time... View Details
Keywords: Research
- 2023
- Working Paper
Design-Based Inference for Multi-arm Bandits
By: Dae Woong Ham, Iavor I. Bojinov, Michael Lindon and Martin Tingley
Multi-arm bandits are gaining popularity as they enable real-world sequential decision-making across application areas, including clinical trials, recommender systems, and online decision-making. Consequently, there is an increased desire to use the available... View Details
- 2021
- Working Paper
Quantifying the Value of Iterative Experimentation
By: Iavor I Bojinov and Jialiang Mao
Over the past decade, most technology companies and a growing number of conventional firms have adopted online experimentation (or A/B testing) into their product development process. Initially, A/B testing was deployed as a static procedure in which an experiment was... View Details
- March 2024
- Article
Human Capital Affects Religious Identity: Causal Evidence from Kenya
By: Livia Alfonsi, Michal Bauer, Julie Chytilová and Edward Miguel
We study how human capital and economic conditions causally affect the choice of religious denomination. We utilize a longitudinal dataset monitoring the religious history of more than 5,000 Kenyans over 20 years, in tandem with a randomized experiment (deworming) that... View Details
- 2024
- Working Paper
Does Pension Automatic Enrollment Increase Debt? Evidence from a Large-Scale Natural Experiment
By: John Beshears, Matthew Blakstad, James J. Choi, Christopher Firth, John Gathergood, David Laibson, Richard Notley, Jesal D. Sheth, Will Sandbrook and Neil Stewart
Does automatic enrollment into retirement saving increase household debt? We study the randomized roll-out of automatic enrollment pensions to ~160,000 employers in the United Kingdom with 2-29 employees. We find that the additional savings generated through automatic... View Details
- 2024
- Working Paper
Platform Information Provision and Consumer Search: A Field Experiment
By: Lu Fang, Yanyou Chen, Chiara Farronato, Zhe Yuan and Yitong Wang
Despite substantial efforts to help consumers search in more intuitive ways, text search remains the predominant tool for product discovery online. In this paper, we explore the effects of visual and textual cues for search refinement on consumer search and purchasing... View Details
- January 2024
- Article
Helping Children Catch Up: Early Life Shocks and the PROGRESA Experiment
By: Achyuta Adhvaryu, Theresa Molina, Anant Nyshadham and Jorge Tamayo
Can investing in children who faced adverse events in early childhood help them catch up? We answer this question using two orthogonal sources of variation – resource availability at birth (local rainfall) and cash incentives for school enrollment – to identify the... View Details
- January 2024
- Article
Population Interference in Panel Experiments
By: Kevin Wu Han, Guillaume Basse and Iavor Bojinov
The phenomenon of population interference, where a treatment assigned to one experimental unit affects another experimental unit’s outcome, has received considerable attention in standard randomized experiments. The complications produced by population interference in... View Details
- 2023
- Working Paper
Money, Time, and Grant Design
By: Kyle Myers and Wei Yang Tham
The design of research grants has been hypothesized to be a useful tool for
influencing researchers and their science. We test this by conducting two thought
experiments in a nationally representative survey of academic researchers. First,
we offer participants a... View Details
- 2023
- Article
Benchmarking Large Language Models on CMExam—A Comprehensive Chinese Medical Exam Dataset
By: Junling Liu, Peilin Zhou, Yining Hua, Dading Chong, Zhongyu Tian, Andrew Liu, Helin Wang, Chenyu You, Zhenhua Guo, Lei Zhu and Michael Lingzhi Li
Recent advancements in large language models (LLMs) have transformed the field of question answering (QA). However, evaluating LLMs in the medical field is challenging due to the lack of standardized and comprehensive datasets. To address this gap, we introduce CMExam,... View Details
- December 2023
- Article
Discerning Saints: Moralization of Intrinsic Motivation and Selective Prosociality at Work
By: Mijeong Kwon, Julia Lee Cunningham and Jon M. Jachimowicz
Intrinsic motivation has received widespread attention as a predictor of positive work outcomes, including employees’ prosocial behavior. In the current research, we offer a more nuanced view by proposing that intrinsic motivation does not uniformly increase prosocial... View Details
- 2023
- Chapter
Malleability Interventions in Intergroup Relations
By: Smadar Cohen-Chen, Amit Goldenberg, James J. Gross and Eran Halperin
One important characteristic of intergroup relations and conflicts is the fact that toxic or violent intergroup relations are often associated with fixed and stable perceptions of various entities, including the ingroup (stable and positive), the outgroup (stable and... View Details
- December 2023
- Article
Save More Today or Tomorrow: The Role of Urgency in Precommitment Design
By: Joseph Reiff, Hengchen Dai, John Beshears, Katherine L. Milkman and Shlomo Benartzi
To encourage farsighted behaviors, past research suggests that marketers may be wise to invite consumers to pre-commit to adopt them “later.” However, the authors propose that people will draw different inferences from different types of pre-commitment offers, and that... View Details
- 2024
- Working Paper
The Uneven Impact of Generative AI on Entrepreneurial Performance
By: Nicholas G. Otis, Rowan Clarke, Solène Delecourt, David Holtz and Rembrand Koning
Scalable and low-cost AI assistance has the potential to improve firm decision-making and economic performance. However, running a business involves a myriad of open-ended problems, making it difficult to know whether recent AI advances can help business owners make... View Details