Publications
Publications
Show Results For
- All HBS Web
(1,026)
- Faculty Publications (218)
- 2023
- Working Paper
Evaluation and Learning in R&D Investment
By: Alexander P. Frankel, Joshua L. Krieger, Danielle Li and Dimitris Papanikolaou
We examine the role of spillover learning in shaping the value of exploratory versus incremental
R&D. Using data from drug development, we show that novel drug candidates generate more
knowledge spillovers than incremental ones. Despite being less likely to reach... View Details
- 2023
- Working Paper
Auditing Predictive Models for Intersectional Biases
By: Kate S. Boxer, Edward McFowland III and Daniel B. Neill
Predictive models that satisfy group fairness criteria in aggregate for members of a protected class, but do not guarantee subgroup fairness, could produce biased predictions for individuals at the intersection of two or more protected classes. To address this risk, we... View Details
- 2023
- Article
Provable Detection of Propagating Sampling Bias in Prediction Models
By: Pavan Ravishankar, Qingyu Mo, Edward McFowland III and Daniel B. Neill
With an increased focus on incorporating fairness in machine learning models, it becomes imperative not only to assess and mitigate bias at each stage of the machine learning pipeline but also to understand the downstream impacts of bias across stages. Here we consider... View Details
- June 2023
- Article
When Does Uncertainty Matter? Understanding the Impact of Predictive Uncertainty in ML Assisted Decision Making
By: Sean McGrath, Parth Mehta, Alexandra Zytek, Isaac Lage and Himabindu Lakkaraju
As machine learning (ML) models are increasingly being employed to assist human decision
makers, it becomes critical to provide these decision makers with relevant inputs which can
help them decide if and how to incorporate model predictions into their decision... View Details
- May 2023
- Article
Equilibrium Effects of Pay Transparency
By: Zoë B. Cullen and Bobak Pakzad-Hurson
The public discourse around pay transparency has focused on the direct effect: how workers seek
to rectify newly-disclosed pay inequities through renegotiations. The question of how wage-setting
and hiring practices of the firm respond in equilibrium has received... View Details
Keywords: Pay Transparency; Online Labor Market; Privacy; Wage Gap; Corporate Disclosure; Wages; Negotiation
- 2023
- Article
Probabilistically Robust Recourse: Navigating the Trade-offs between Costs and Robustness in Algorithmic Recourse
By: Martin Pawelczyk, Teresa Datta, Johannes van-den-Heuvel, Gjergji Kasneci and Himabindu Lakkaraju
As machine learning models are increasingly being employed to make consequential decisions in real-world settings, it becomes critical to ensure that individuals who are adversely impacted (e.g., loan denied) by the predictions of these models are provided with a means... View Details
- April 12, 2023
- Article
Using AI to Adjust Your Marketing and Sales in a Volatile World
By: Das Narayandas and Arijit Sengupta
Why are some firms better and faster than others at adapting their use of customer data to respond to changing or uncertain marketing conditions? A common thread across faster-acting firms is the use of AI models to predict outcomes at various stages of the customer... View Details
- 2023
- Working Paper
Feature Importance Disparities for Data Bias Investigations
By: Peter W. Chang, Leor Fishman and Seth Neel
It is widely held that one cause of downstream bias in classifiers is bias present in the training data. Rectifying such biases may involve context-dependent interventions such as training separate models on subgroups, removing features with bias in the collection... View Details
- April 2023
- Article
On the Privacy Risks of Algorithmic Recourse
By: Martin Pawelczyk, Himabindu Lakkaraju and Seth Neel
As predictive models are increasingly being employed to make consequential decisions, there is a growing emphasis on developing techniques that can provide algorithmic recourse to affected individuals. While such recourses can be immensely beneficial to affected... View Details
- April 2023
- Article
The Preference Survey Module: A Validated Instrument for Measuring Risk, Time, and Social Preferences
By: Armin Falk, Anke Becker, Thomas Dohmen, David B. Huffman and Uwe Sunde
Incentivized choice experiments are a key approach to measuring preferences in economics but are also costly. Survey measures are a low-cost alternative but can suffer from additional forms of measurement error due to their hypothetical nature. This paper seeks to... View Details
- 2023
- Working Paper
Organizational Responses to Product Cycles
By: Achyuta Adhvaryu, Vittorio Bassi, Anant Nyshadham, Jorge Tamayo and Nicolas Torres
Product cycles entail the mass production of new—and often increasingly complex—products on a regular basis. How do firms manage these changes? We use granular daily data from a leading automobile manufacturer to study the organizational impacts of introducing new... View Details
- 2023
- Working Paper
Complexity and Time
By: Benjamin Enke, Thomas Graeber and Ryan Oprea
We provide experimental evidence that core intertemporal choice anomalies -- including extreme short-run impatience, structural estimates of present bias, hyperbolicity and transitivity violations -- are driven by complexity rather than time or risk preferences. First,... View Details
- March–April 2023
- Article
Market Segmentation Trees
By: Ali Aouad, Adam Elmachtoub, Kris J. Ferreira and Ryan McNellis
Problem definition: We seek to provide an interpretable framework for segmenting users in a population for personalized decision making. Methodology/results: We propose a general methodology, market segmentation trees (MSTs), for learning market... View Details
- January–February 2023
- Article
Forecasting COVID-19 and Analyzing the Effect of Government Interventions
By: Michael Lingzhi Li, Hamza Tazi Bouardi, Omar Skali Lami, Thomas Trikalinos, Nikolaos Trichakis and Dimitris Bertsimas
We developed DELPHI, a novel epidemiological model for predicting detected cases and deaths in the prevaccination era of the COVID-19 pandemic. The model allows for underdetection of infections and effects of government interventions. We have applied DELPHI across more... View Details
- January–February 2023
- Article
Data-Driven COVID-19 Vaccine Development for Janssen
By: Dimitris Bertsimas, Michael Lingzhi Li, Xinggang Liu, Jennings Xu and Najat Khan
The COVID-19 pandemic has spurred extensive vaccine research worldwide. One crucial part of vaccine development is the phase III clinical trial that assesses the vaccine for safety and efficacy in the prevention of COVID-19. In this work, we enumerate the first... View Details
- 2023
- Working Paper
Nailing Prediction: Experimental Evidence on the Value of Tools in Predictive Model Development
By: Daniel Yue, Paul Hamilton and Iavor Bojinov
Predictive model development is understudied despite its centrality in modern artificial
intelligence and machine learning business applications. Although prior discussions
highlight advances in methods (along the dimensions of data, computing power, and
algorithms)... View Details
Keywords: Analytics and Data Science
- 2022
- Article
Efficiently Training Low-Curvature Neural Networks
By: Suraj Srinivas, Kyle Matoba, Himabindu Lakkaraju and Francois Fleuret
Standard deep neural networks often have excess non-linearity, making them susceptible to issues such as low adversarial robustness and gradient instability. Common methods to address these downstream issues, such as adversarial training, are expensive and often... View Details
Keywords: AI and Machine Learning
- 2022
- Article
Which Explanation Should I Choose? A Function Approximation Perspective to Characterizing Post hoc Explanations
By: Tessa Han, Suraj Srinivas and Himabindu Lakkaraju
A critical problem in the field of post hoc explainability is the lack of a common foundational goal among methods. For example, some methods are motivated by function approximation, some by game theoretic notions, and some by obtaining clean visualizations. This... View Details
- 2022
- Article
A Human-Centric Take on Model Monitoring
By: Murtuza Shergadwala, Himabindu Lakkaraju and Krishnaram Kenthapadi
Predictive models are increasingly used to make various consequential decisions in high-stakes domains such as healthcare, finance, and policy. It becomes critical to ensure that these models make accurate predictions, are robust to shifts in the data, do not rely on... View Details
- October–December 2022
- Article
Achieving Reliable Causal Inference with Data-Mined Variables: A Random Forest Approach to the Measurement Error Problem
By: Mochen Yang, Edward McFowland III, Gordon Burtch and Gediminas Adomavicius
Combining machine learning with econometric analysis is becoming increasingly prevalent in both research and practice. A common empirical strategy involves the application of predictive modeling techniques to "mine" variables of interest from available data, followed... View Details