Publications
Publications
Show Results For
- All HBS Web
(854)
- Faculty Publications (429)
- 2022
- Article
Data Poisoning Attacks on Off-Policy Evaluation Methods
By: Elita Lobo, Harvineet Singh, Marek Petrik, Cynthia Rudin and Himabindu Lakkaraju
Off-policy Evaluation (OPE) methods are a crucial tool for evaluating policies in high-stakes domains such as healthcare, where exploration is often infeasible, unethical, or expensive. However, the extent to which such methods can be trusted under adversarial threats... View Details
- 2022
- Article
Fairness via Explanation Quality: Evaluating Disparities in the Quality of Post hoc Explanations
By: Jessica Dai, Sohini Upadhyay, Ulrich Aivodji, Stephen Bach and Himabindu Lakkaraju
As post hoc explanation methods are increasingly being leveraged to explain complex models in high-stakes settings, it becomes critical to ensure that the quality of the resulting explanations is consistently high across all subgroups of a population. For instance, it... View Details
- 2022
- Article
Exploring Counterfactual Explanations Through the Lens of Adversarial Examples: A Theoretical and Empirical Analysis.
By: Martin Pawelczyk, Chirag Agarwal, Shalmali Joshi, Sohini Upadhyay and Himabindu Lakkaraju
As machine learning (ML) models become more widely deployed in high-stakes applications, counterfactual explanations have emerged as key tools for providing actionable model explanations in practice. Despite the growing popularity of counterfactual explanations, a... View Details
- Article
How Much Should We Trust Staggered Difference-In-Differences Estimates?
By: Andrew C. Baker, David F. Larcker and Charles C.Y. Wang
We explain when and how staggered difference-in-differences regression estimators, commonly applied to assess the impact of policy changes, are biased. These biases are likely to be relevant for a large portion of research settings in finance, accounting, and law that... View Details
- 2022
- Article
Probing GNN Explainers: A Rigorous Theoretical and Empirical Analysis of GNN Explanation Methods.
By: Chirag Agarwal, Marinka Zitnik and Himabindu Lakkaraju
As Graph Neural Networks (GNNs) are increasingly employed in real-world applications, it becomes critical to ensure that the stakeholders understand the rationale behind their predictions. While several GNN explanation methods have been proposed recently, there has... View Details
- April 12, 2022
- Article
Evaluation of Individual and Ensemble Probabilistic Forecasts of COVID-19 Mortality in the United States
By: Estee Y. Cramer, Evan L. Ray, Velma K. Lopez, Johannes Bracher, Andrea Brennen, Alvaro J. Castro Rivadeneira, Michael Lingzhi Li and et al.
Short-term probabilistic forecasts of the trajectory of the COVID-19 pandemic in the United States have served as a visible and important communication channel between the scientific modeling community and both the general public and decision-makers. Forecasting models... View Details
- 2022
- Working Paper
A Linear Panel Model with Heterogeneous Coefficients and Variation in Exposure
By: Jesse M. Shapiro and Liyang Sun
Linear panel models featuring unit and time fixed effects appear in many areas of empirical economics. An active literature studies the interpretation of the ordinary least squares estimator of the model, commonly called the two-way fixed effects (TWFE) estimator, in... View Details
- April 2022
- Article
Predictable Financial Crises
Using historical data on post-war financial crises around the world, we show that crises are substantially predictable. The combination of rapid credit and asset price growth over the prior three years, whether in the nonfinancial business or the household sector, is... View Details
- March 2022 (Revised January 2025)
- Technical Note
Linear Regression
By: Iavor I. Bojinov, Michael Parzen and Paul Hamilton
This note provides an overview of linear regression for an introductory data science course. It begins with a discussion of correlation, and explains why correlation does not necessarily imply causation. The note then describes the method of least squares, and how to... View Details
- March 2022 (Revised January 2025)
- Technical Note
Statistical Inference
By: Iavor I. Bojinov, Michael Parzen and Paul Hamilton
This note provides an overview of statistical inference for an introductory data science course. First, the note discusses samples and populations. Next the note describes how to calculate confidence intervals for means and proportions. Then it walks through the logic... View Details
- Article
Eliminating Unintended Bias in Personalized Policies Using Bias-Eliminating Adapted Trees (BEAT)
By: Eva Ascarza and Ayelet Israeli
An inherent risk of algorithmic personalization is disproportionate targeting of individuals from certain groups (or demographic characteristics such as gender or race), even when the decision maker does not intend to discriminate based on those “protected”... View Details
- March 2022
- Article
Estimating the Effectiveness of Permanent Price Reductions for Competing Products Using Multivariate Bayesian Structural Time Series Models
By: Fiammetta Menchetti and Iavor Bojinov
Researchers regularly use synthetic control methods for estimating causal effects when a sub-set of units receive a single persistent treatment, and the rest are unaffected by the change. In many applications, however, units not assigned to treatment are nevertheless... View Details
- March 2022
- Article
Sensitivity Analysis of Agent-based Models: A New Protocol
By: Emanuele Borgonovo, Marco Pangallo, Jan Rivkin, Leonardo Rizzo and Nicolaj Siggelkow
Agent-based models (ABMs) are increasingly used in the management sciences. Though useful, ABMs are often critiqued: it is hard to discern why they produce the results they do and whether other assumptions would yield similar results. To help researchers address such... View Details
- March 2022
- Article
Targeting High Ability Entrepreneurs Using Community Information: Mechanism Design in the Field
Identifying high-growth microentrepreneurs in low-income countries remains a challenge due to a scarcity of verifiable information. With a cash grant experiment in India we demonstrate that community knowledge can help target high-growth microentrepreneurs; while the... View Details
- March 2022
- Article
Where to Locate COVID-19 Mass Vaccination Facilities?
By: Dimitris Bertsimas, Vassilis Digalakis Jr, Alexander Jacquillat, Michael Lingzhi Li and Alessandro Previero
The outbreak of COVID-19 led to a record-breaking race to develop a vaccine. However, the limited vaccine capacity creates another massive challenge: how to distribute vaccines to mitigate the near-end impact of the pandemic? In the United States in particular, the new... View Details
- 2022
- Working Paper
The Disagreement Problem in Explainable Machine Learning: A Practitioner's Perspective
By: Satyapriya Krishna, Tessa Han, Alex Gu, Javin Pombra, Shahin Jabbari, Steven Wu and Himabindu Lakkaraju
As various post hoc explanation methods are increasingly being leveraged to explain complex models in high-stakes settings, it becomes critical to develop a deeper understanding of if and when the explanations output by these methods disagree with each other, and how... View Details
- Article
A Prescriptive Analytics Framework for Optimal Policy Deployment Using Heterogeneous Treatment Effects
By: Edward McFowland III, Sandeep Gangarapu, Ravi Bapna and Tianshu Sun
We define a prescriptive analytics framework that addresses the needs of a constrained decision-maker facing, ex ante, unknown costs and benefits of multiple policy levers. The framework is general in nature and can be deployed in any utility maximizing context, public... View Details
- November 2021
- Article
Panel Experiments and Dynamic Causal Effects: A Finite Population Perspective
By: Iavor Bojinov, Ashesh Rambachan and Neil Shephard
In panel experiments, we randomly assign units to different interventions, measuring their outcomes, and repeating the procedure in several periods. Using the potential outcomes framework, we define finite population dynamic causal effects that capture the relative... View Details
- October 1, 2021
- Article
An Evaluation of Cross-efficiency Methods: With an Application to Warehouse Performance.
By: B.M. Balk, M.R. De Koster, Christian Kaps and J.L. Zofio
Cross-efficiency measurement is an extension of Data Envelopment Analysis that allows for tie-breaking ranking of the Decision Making Units (DMUs) using all the peer evaluations. In this article we examine the theory of cross-efficiency measurement by comparing a... View Details
- September–October 2021
- Article
Frontiers: Can an AI Algorithm Mitigate Racial Economic Inequality? An Analysis in the Context of Airbnb
By: Shunyuan Zhang, Nitin Mehta, Param Singh and Kannan Srinivasan
We study the effect of Airbnb’s smart-pricing algorithm on the racial disparity in the daily revenue earned by Airbnb hosts. Our empirical strategy exploits Airbnb’s introduction of the algorithm and its voluntary adoption by hosts as a quasi-natural experiment. Among... View Details