Publications
Publications
Show Results For
- All HBS Web
(124)
- Faculty Publications (29)
Page 1 of 29
Results →
- 2025
- Working Paper
Trade Within Multinational Boundaries
By: Laura Alfaro, Paola Conconi, Fariha Kamal and Zachary Kroff
We leverage newly linked data from the U.S. Census Bureau and the U.S. Bureau of Economic Analysis to study transactions within U.S. multinational enterprises (MNEs). We show that using administrative data on intrafirm trade allows us to correct for measurement error... View Details
- January 2025
- Technical Note
AI vs Human: Analyzing Acceptable Error Rates Using the Confusion Matrix
By: Tsedal Neeley and Tim Englehart
This technical note introduces the confusion matrix as a foundational tool in artificial intelligence (AI) and large language models (LLMs) for assessing the performance of classification models, focusing on their reliability for decision-making. A confusion matrix... View Details
- 2024
- Working Paper
Finance Without Exotic Risk
By: Pedro Bordalo, Nicola Gennaioli, Rafael La Porta and Andrei Shleifer
We address the joint hypothesis problem in cross-sectional asset pricing by using measured analyst expectations of earnings growth. We construct a firm-level measure of Expectations Based Returns (EBRs) that uses analyst forecast errors and revisions and shuts down any... View Details
- 2025
- Working Paper
Enhancing Treatment Effect Prediction on Privacy-Protected Data: An Honest Post-Processing Approach
By: Ta-Wei Huang and Eva Ascarza
As firms increasingly rely on customer data for personalization, concerns over privacy and regulatory compliance have grown. Local Differential Privacy (LDP) offers strong individual-level protection by injecting noise into data before collection. While... View Details
- 2023
- Working Paper
The Complexity of Economic Decisions
By: Xavier Gabaix and Thomas Graeber
We propose a theory of the complexity of economic decisions. Leveraging a macroeconomic framework of production functions, we conceptualize the mind as a cognitive economy, where a task’s complexity is determined by its composition of cognitive operations. Complexity... View Details
- 2023
- Working Paper
Insufficiently Justified Disparate Impact: A New Criterion for Subgroup Fairness
By: Neil Menghani, Edward McFowland III and Daniel B. Neill
In this paper, we develop a new criterion, "insufficiently justified disparate impact" (IJDI), for assessing whether recommendations (binarized predictions) made by an algorithmic decision support tool are fair. Our novel, utility-based IJDI criterion evaluates false... View Details
- 2023
- Working Paper
PRIMO: Private Regression in Multiple Outcomes
By: Seth Neel
We introduce a new differentially private regression setting we call Private Regression in Multiple Outcomes (PRIMO), inspired the common situation where a data analyst wants to perform a set of l regressions while preserving privacy, where the covariates... View Details
- 2023
- Working Paper
The Limits of Algorithmic Measures of Race in Studies of Outcome Disparities
By: David S. Scharfstein and Sergey Chernenko
We show that the use of algorithms to predict race has significant limitations in measuring and understanding the sources of racial disparities in finance, economics, and other contexts. First, we derive theoretically the direction and magnitude of measurement bias in... View Details
- April 2023
- Article
The Preference Survey Module: A Validated Instrument for Measuring Risk, Time, and Social Preferences
By: Armin Falk, Anke Becker, Thomas Dohmen, David B. Huffman and Uwe Sunde
Incentivized choice experiments are a key approach to measuring preferences in economics but are also costly. Survey measures are a low-cost alternative but can suffer from additional forms of measurement error due to their hypothetical nature. This paper seeks to... View Details
- 2023
- Working Paper
Complexity and Time
By: Benjamin Enke, Thomas Graeber and Ryan Oprea
We provide experimental evidence that core intertemporal choice anomalies -- including extreme short-run impatience, structural estimates of present bias, hyperbolicity and transitivity violations -- are driven by complexity rather than time or risk preferences. First,... View Details
- January–February 2023
- Article
Forecasting COVID-19 and Analyzing the Effect of Government Interventions
By: Michael Lingzhi Li, Hamza Tazi Bouardi, Omar Skali Lami, Thomas Trikalinos, Nikolaos Trichakis and Dimitris Bertsimas
We developed DELPHI, a novel epidemiological model for predicting detected cases and deaths in the prevaccination era of the COVID-19 pandemic. The model allows for underdetection of infections and effects of government interventions. We have applied DELPHI across more... View Details
- 2023
- Working Paper
Nailing Prediction: Experimental Evidence on the Value of Tools in Predictive Model Development
By: Daniel Yue, Paul Hamilton and Iavor Bojinov
Predictive model development is understudied despite its centrality in modern artificial
intelligence and machine learning business applications. Although prior discussions
highlight advances in methods (along the dimensions of data, computing power, and
algorithms)... View Details
Keywords: Analytics and Data Science
- October–December 2022
- Article
Achieving Reliable Causal Inference with Data-Mined Variables: A Random Forest Approach to the Measurement Error Problem
By: Mochen Yang, Edward McFowland III, Gordon Burtch and Gediminas Adomavicius
Combining machine learning with econometric analysis is becoming increasingly prevalent in both research and practice. A common empirical strategy involves the application of predictive modeling techniques to "mine" variables of interest from available data, followed... View Details
- April 12, 2022
- Article
Evaluation of Individual and Ensemble Probabilistic Forecasts of COVID-19 Mortality in the United States
By: Estee Y. Cramer, Evan L. Ray, Velma K. Lopez, Johannes Bracher, Andrea Brennen, Alvaro J. Castro Rivadeneira, Michael Lingzhi Li and et al.
Short-term probabilistic forecasts of the trajectory of the COVID-19 pandemic in the United States have served as a visible and important communication channel between the scientific modeling community and both the general public and decision-makers. Forecasting models... View Details
- February 2021
- Tutorial
Assessing Prediction Accuracy of Machine Learning Models
By: Michael Toffel and Natalie Epstein
This video describes how to assess the accuracy of machine learning prediction models, primarily in the context of machine learning models that predict binary outcomes, such as logistic regression, random forest, or nearest neighbor models. After introducing and... View Details
- 2021
- Working Paper
Real Credit Cycles
By: Pedro Bordalo, Nicola Gennaioli, Andrei Shleifer and Stephen J. Terry
We incorporate diagnostic expectations, a psychologically founded model of overreaction to news, into a workhorse business cycle model with heterogeneous firms and risky debt. A realistic degree of diagnosticity, estimated from the forecast errors of managers of U.S.... View Details
- September–October 2020
- Article
Managing Churn to Maximize Profits
By: Aurelie Lemmens and Sunil Gupta
Customer defection threatens many industries, prompting companies to deploy targeted, proactive customer retention programs and offers. A conventional approach has been to target customers either based on their predicted churn probability or their responsiveness to a... View Details
- August 2020 (Revised September 2020)
- Technical Note
Assessing Prediction Accuracy of Machine Learning Models
The note introduces a variety of methods to assess the accuracy of machine learning prediction models. The note begins by briefly introducing machine learning, overfitting, training versus test datasets, and cross validation. The following accuracy metrics and tools... View Details
- October 2018
- Article
The Operational Value of Social Media Information
By: Ruomeng Cui, Santiago Gallino, Antonio Moreno and Dennis J. Zhang
While the value of using social media information has been established in multiple business contexts, the field of operations and supply chain management have not yet explored the possibilities it offers in improving firms' operational decisions. This study attempts to... View Details
- 2018
- Working Paper
Channeled Attention and Stable Errors -- Previous Working Version
By: Tristan Gagnon-Bartsch, Matthew Rabin and Joshua Schwartzstein
A common critique of models of mistaken beliefs is that people should recognize their error after observations they thought were unlikely. This paper develops a framework for assessing when a given error is likely to be discovered, in the sense that the error-maker... View Details