Publications
Publications
Show Results For
- All HBS Web
(408)
- Faculty Publications (94)
- 2023
- Working Paper
Virtual Water Coolers: A Field Experiment on the Role of Virtual Interactions on Organizational Newcomer Performance
Designing management practices to better onboard organizational newcomers working remotely is a key priority for firms. We report results from a randomized field experiment conducted at a large global firm that estimates the performance effects of different types of... View Details
- Article
Diversity and Team Performance in a Kenyan Organization
By: Benjamin Marx, Vincent Pons and Tavneet Suri
We present the results from a field experiment on team diversity. Individuals working as door-to-door canvassers for a non-profit organization were randomly assigned a teammate, a supervisor, and a list of individuals to canvass. This created random variation within... View Details
- 2021
- Working Paper
Population Interference in Panel Experiments
By: Iavor I Bojinov, Kevin Wu Han and Guillaume Basse
The phenomenon of population interference, where a treatment assigned to one experimental unit affects another experimental unit's outcome, has received considerable attention in standard randomized experiments. The complications produced by population interference in... View Details
- February 2021
- Tutorial
Assessing Prediction Accuracy of Machine Learning Models
By: Michael Toffel and Natalie Epstein
This video describes how to assess the accuracy of machine learning prediction models, primarily in the context of machine learning models that predict binary outcomes, such as logistic regression, random forest, or nearest neighbor models. After introducing and... View Details
- 2023
- Working Paper
Personalized Game Design for Improved User Retention and Monetization in Freemium Games
By: Eva Ascarza, Oded Netzer and Julian Runge
One of the most crucial aspects and significant levers that gaming companies possess in designing
digital games is setting the level of difficulty, which essentially regulates the user’s ability to
progress within the game. This aspect is particularly significant in... View Details
- 2020
- Working Paper
Targeting for Long-Term Outcomes
By: Jeremy Yang, Dean Eckles, Paramveer Dhillon and Sinan Aral
Decision makers often want to target interventions so as to maximize an outcome that is observed only in the long term. This typically requires delaying decisions until the outcome is observed or relying on simple short-term proxies for the long-term outcome. Here we... View Details
- 2020
- Working Paper
(When) Does Appearance Matter? Evidence from a Randomized Controlled Trial
By: Prithwiraj Choudhury, Tarun Khanna, Christos A. Makridis and Subhradip Sarker
While there is evidence about labor market discrimination based on race, religion, and gender, we know little about whether physical appearance leads to discrimination in labor market outcomes. We deploy a randomized experiment on 1,000 respondents in India between... View Details
- 2020
- Working Paper
Design and Analysis of Switchback Experiments
By: Iavor I Bojinov, David Simchi-Levi and Jinglong Zhao
In switchback experiments, a firm sequentially exposes an experimental unit to a random treatment, measures its response, and repeats the procedure for several periods to determine which treatment leads to the best outcome. Although practitioners have widely adopted... View Details
- August 2020
- Article
Do Physician Incentives Increase Patient Medication Adherence?
By: Edward Kong, John Beshears, David Laibson, Brigitte Madrian, Kevin Volpp, George Loewenstein, Jonathan Kolstad and James J. Choi
We conducted a randomized experiment (911 primary care practices and 8,935 nonadherent patients) to test the effect of paying physicians for increasing patient medication adherence in three drug classes: diabetes medication, antihypertensives, and statins. We measured... View Details
- Article
The Importance of Being Causal
By: Iavor I Bojinov, Albert Chen and Min Liu
Causal inference is the study of how actions, interventions, or treatments affect outcomes of interest. The methods that have received the lion’s share of attention in the data science literature for establishing causation are variations of randomized experiments.... View Details
- Summer 2020
- Article
Want to Make Better Decisions? Start Experimenting
By: Michael Luca and Max Bazerman
Four lessons for using randomized controlled experiments to create value for your company and customers View Details
- April 2020
- Article
Field Comparisons of Incentive-Compatible Preference Elicitation Techniques
By: Shawn A. Cole, A. Nilesh Fernando, Daniel Stein and Jeremy Tobacman
Knowledge of consumer demand is important for firms, policy makers, and economists. One common tool for incentive-compatible demand elicitation, the Becker-DeGroot-Marschak (BDM) mechanism, has been widely used in laboratory settings but rarely evaluated for... View Details
- March 24, 2020
- Article
Delayed Negative Effects of Prosocial Spending on Happiness
By: Armin Falk and Thomas Graeber
Does prosocial behavior promote happiness? We test this longstanding hypothesis in a behavioral experiment that extends the scope of previous research. In our Saving a Life paradigm, every participant either saved one human life in expectation by triggering a targeted... View Details
- March 2020
- Article
A Revolution in Economics? It's Just Getting Started...
By: Shawn A. Cole, William Pariente and Anja Sautmann
We have each experienced thrills and pain while supporting the mission of the Abdul Latif Jameel Poverty Action Lab, which facilitated many of the experiments described in the 2019 Nobel Prize citation. J-PAL in many ways seeks to fulfill what Angrist and Pischke... View Details
- 2020
- Book
The Power of Experiments: Decision-Making in a Data-Driven World
By: Michael Luca and Max H. Bazerman
Have you logged into Facebook recently? Searched for something on Google? Chosen a movie on Netflix? If so, you've probably been an unwitting participant in a variety of experiments—also known as randomized controlled trials—designed to test the impact of changes to an... View Details
- Article
Designing Social Networks: Joint Tasks and the Formation and Endurance of Network Ties
By: Sharique Hasan and Rembrand Koning
Can managers influence the formation of organizational networks? In this article, we evaluate the effect of joint tasks on the creation of network ties with data from a novel field experiment with 112 aspiring entrepreneurs. During the study, we randomized individuals... View Details
- 2019
- Article
Time Series Experiments and Causal Estimands: Exact Randomization Tests and Trading
By: Iavor I Bojinov and Neil Shephard
We define causal estimands for experiments on single time series, extending the potential outcome framework to dealing with temporal data. Our approach allows the estimation of a broad class of these estimands and exact randomization based p-values for testing causal... View Details
- May–June 2019
- Article
U-Shaped Conformity in Online Social Networks
By: Monic Sun, Michael Zhang and Feng Zhu
We explore how people balance their needs to belong and to be different from their friends by studying their choices of a virtual-house wall color on a leading Chinese social-networking site. The setting enables us to randomize both the popular color and the adoption... View Details
- April 2019 (Revised January 2025)
- Case
Clear Link Technologies, LLC: Driving Sales with Peer Effects
By: Christopher Stanton, Richard Saouma and Olivia Hull
The importance of a good peer or coworker is widely discussed, but understanding the glue that makes coworkers valuable is less understood. This case sheds light on the importance of peers and the practices and environments that make a group greater than the sum of its... View Details
Keywords: Talent and Talent Management; Interactive Communication; Experience and Expertise; Decision Making; Training; Design; Compensation and Benefits; Knowledge Acquisition; Knowledge Sharing; Human Capital; Working Conditions; Measurement and Metrics; Outcome or Result; Performance; Performance Improvement; Research; Sales; Salesforce Management; Motivation and Incentives; Telecommunications Industry; Utah; United States
- April 2019
- Article
Shooting the Messenger
By: Leslie John, Hayley Blunden and Heidi Liu
Eleven experiments provide evidence that people have a tendency to “shoot the messenger,” deeming innocent bearers of bad news unlikeable. In a preregistered lab experiment, participants rated messengers who delivered bad news from a random drawing as relatively... View Details