Publications
Publications
Show Results For
- All HBS Web
(1,959)
- Faculty Publications (554)
- 2023
- Working Paper
Design-Based Inference for Multi-arm Bandits
By: Dae Woong Ham, Iavor I. Bojinov, Michael Lindon and Martin Tingley
Multi-arm bandits are gaining popularity as they enable real-world sequential decision-making across application areas, including clinical trials, recommender systems, and online decision-making. Consequently, there is an increased desire to use the available... View Details
- February 2024
- Article
Fifty Shades of QE: Robust Evidence
By: Brian Fabo, Marina Jančoková, Elisabeth Kempf and Ľuboš Pástor
Fabo et al. (2021) show that papers written by central bank researchers find quantitative easing (QE) to be more effective than papers written by academics. Weale and Wieladek (2022) show that a subset of these results lose statistical significance when OLS regressions... View Details
- 2024
- Working Paper
Bootstrap Diagnostics for Irregular Estimators
By: Isaiah Andrews and Jesse M. Shapiro
Empirical researchers frequently rely on normal approximations in order to summarize and communicate uncertainty about their findings to their scientific audience. When such approximations are unreliable, they can lead the audience to make misguided decisions. We... View Details
- January 2024
- Article
Subset Scanning for Multi-Trait Analysis Using GWAS Summary Statistics
By: Rui Cao, Evan Olawsky, Edward McFowland III, Erin Marcotte, Logan Spector and Tianzhong Yang
Multi-trait analysis has been shown to have greater statistical power than single-trait analysis. Most of the existing multi-trait analysis methods only work with a limited number of traits and usually prioritize high statistical power over identifying relevant traits,... View Details
- 2023
- Article
Balancing Risk and Reward: An Automated Phased Release Strategy
By: Yufan Li, Jialiang Mao and Iavor Bojinov
Phased releases are a common strategy in the technology industry for gradually releasing new products or updates through a sequence of A/B tests in which the number of treated units gradually grows until full deployment or deprecation. Performing phased releases in a... View Details
- 2023
- Article
Post Hoc Explanations of Language Models Can Improve Language Models
By: Satyapriya Krishna, Jiaqi Ma, Dylan Slack, Asma Ghandeharioun, Sameer Singh and Himabindu Lakkaraju
Large Language Models (LLMs) have demonstrated remarkable capabilities in performing complex tasks. Moreover, recent research has shown that incorporating human-annotated rationales (e.g., Chain-of-Thought prompting) during in-context learning can significantly enhance... View Details
- 2023
- Other Article
The Harvard USPTO Patent Dataset: A Large-Scale, Well-Structured, and Multi-Purpose Corpus of Patent Applications
By: Mirac Suzgun, Luke Melas-Kyriazi, Suproteem K. Sarkar, Scott Duke Kominers and Stuart Shieber
Innovation is a major driver of economic and social development, and information about many kinds of innovation is embedded in semi-structured data from patents and patent applications. Though the impact and novelty of innovations expressed in patent data are difficult... View Details
- 2023
- Article
Verifiable Feature Attributions: A Bridge between Post Hoc Explainability and Inherent Interpretability
By: Usha Bhalla, Suraj Srinivas and Himabindu Lakkaraju
With the increased deployment of machine learning models in various real-world applications, researchers and practitioners alike have emphasized the need for explanations of model behaviour. To this end, two broad strategies have been outlined in prior literature to... View Details
- 2023
- Article
Which Models Have Perceptually-Aligned Gradients? An Explanation via Off-Manifold Robustness
By: Suraj Srinivas, Sebastian Bordt and Himabindu Lakkaraju
One of the remarkable properties of robust computer vision models is that their input-gradients are often aligned with human perception, referred to in the literature as perceptually-aligned gradients (PAGs). Despite only being trained for classification, PAGs cause... View Details
- 2023
- Working Paper
Causal Interpretation of Structural IV Estimands
By: Isaiah Andrews, Nano Barahona, Matthew Gentzkow, Ashesh Rambachan and Jesse M. Shapiro
We study the causal interpretation of instrumental variables (IV) estimands of nonlinear, multivariate structural models with respect to rich forms of model misspecification. We focus on guaranteeing that the researcher's estimator is sharp zero consistent, meaning... View Details
Keywords: Mathematical Methods
- September 2023
- Module Note
Live Case Exercise for Financial Reporting
By: Tatiana Sandino and Marshal Herrmann
Harvard Business School employs the case method as a cornerstone of its pedagogy, providing students with opportunities to engage in discussions related to difficult or contentious decisions confronted by real-world organizations. In this “live case,” we depart from... View Details
- September–October 2023
- Article
Interpretable Matrix Completion: A Discrete Optimization Approach
By: Dimitris Bertsimas and Michael Lingzhi Li
We consider the problem of matrix completion on an n × m matrix. We introduce the problem of interpretable matrix completion that aims to provide meaningful insights for the low-rank matrix using side information. We show that the problem can be... View Details
Keywords: Mathematical Methods
- 2023
- Article
On Minimizing the Impact of Dataset Shifts on Actionable Explanations
By: Anna P. Meyer, Dan Ley, Suraj Srinivas and Himabindu Lakkaraju
The Right to Explanation is an important regulatory principle that allows individuals to request actionable explanations for algorithmic decisions. However, several technical challenges arise when providing such actionable explanations in practice. For instance, models... View Details
- July–August 2023
- Article
Demand Learning and Pricing for Varying Assortments
By: Kris Ferreira and Emily Mower
Problem Definition: We consider the problem of demand learning and pricing for retailers who offer assortments of substitutable products that change frequently, e.g., due to limited inventory, perishable or time-sensitive products, or the retailer’s desire to... View Details
- August 2023
- Article
Explaining Machine Learning Models with Interactive Natural Language Conversations Using TalkToModel
By: Dylan Slack, Satyapriya Krishna, Himabindu Lakkaraju and Sameer Singh
Practitioners increasingly use machine learning (ML) models, yet models have become more complex and harder to understand. To understand complex models, researchers have proposed techniques to explain model predictions. However, practitioners struggle to use... View Details
- 2023
- Working Paper
How People Use Statistics
By: Pedro Bordalo, John J. Conlon, Nicola Gennaioli, Spencer Yongwook Kwon and Andrei Shleifer
We document two new facts about the distributions of answers in famous statistical problems: they are i) multi-modal and ii) unstable with respect to irrelevant changes in the problem. We offer a model in which, when solving a problem, people represent each hypothesis... View Details
- July 2023
- Article
Design and Analysis of Switchback Experiments
By: Iavor I Bojinov, David Simchi-Levi and Jinglong Zhao
In switchback experiments, a firm sequentially exposes an experimental unit to a random treatment, measures its response, and repeats the procedure for several periods to determine which treatment leads to the best outcome. Although practitioners have widely adopted... View Details
- June 2023
- Case
Investing in the Climate Transition at Neuberger Berman
By: George Serafeim and Benjamin Maletta
By mid-2023, Neuberger Berman (NB), an active asset manager, had grown its assets under management to about half a trillion dollars and took pride in its client centricity and innovative spirit. Responding to client demand for investment products that integrated... View Details
Keywords: Carbon Emissions; Sustainability; Decarbonization; Performance; Risk Assessment; Opportunities; Environmental Sustainability; Carbon Footprint; Business Analysis; Investing; Regulation; Asset Management; Investment Strategy; Climate Change; Transition; Analysis; Product Positioning; Strategy; Investment Portfolio; Financial Services Industry; Energy Industry
- 2023
- Working Paper
Design-Based Confidence Sequences: A General Approach to Risk Mitigation in Online Experimentation
By: Dae Woong Ham, Michael Lindon, Martin Tingley and Iavor Bojinov
Randomized experiments have become the standard method for companies to evaluate the performance of new products or services. In addition to augmenting managers’ decision-making, experimentation mitigates risk by limiting the proportion of customers exposed to... View Details
- 2023
- Article
Probabilistically Robust Recourse: Navigating the Trade-offs between Costs and Robustness in Algorithmic Recourse
By: Martin Pawelczyk, Teresa Datta, Johannes van-den-Heuvel, Gjergji Kasneci and Himabindu Lakkaraju
As machine learning models are increasingly being employed to make consequential decisions in real-world settings, it becomes critical to ensure that individuals who are adversely impacted (e.g., loan denied) by the predictions of these models are provided with a means... View Details