Filter Results:
(82)
Show Results For
- All HBS Web
(328)
- Faculty Publications (82)
Show Results For
- All HBS Web
(328)
- Faculty Publications (82)
- 2023
- Article
Exploiting Discovered Regression Discontinuities to Debias Conditioned-on-observable Estimators
By: Benjamin Jakubowski, Siram Somanchi, Edward McFowland III and Daniel B. Neill
Regression discontinuity (RD) designs are widely used to estimate causal effects in the absence of a randomized experiment. However, standard approaches to RD analysis face two significant limitations. First, they require a priori knowledge of discontinuities in... View Details
Jakubowski, Benjamin, Siram Somanchi, Edward McFowland III, and Daniel B. Neill. "Exploiting Discovered Regression Discontinuities to Debias Conditioned-on-observable Estimators." Journal of Machine Learning Research 24, no. 133 (2023): 1–57.
- 2023
- Article
Probabilistically Robust Recourse: Navigating the Trade-offs between Costs and Robustness in Algorithmic Recourse
By: Martin Pawelczyk, Teresa Datta, Johannes van-den-Heuvel, Gjergji Kasneci and Himabindu Lakkaraju
As machine learning models are increasingly being employed to make consequential decisions in real-world settings, it becomes critical to ensure that individuals who are adversely impacted (e.g., loan denied) by the predictions of these models are provided with a means... View Details
Pawelczyk, Martin, Teresa Datta, Johannes van-den-Heuvel, Gjergji Kasneci, and Himabindu Lakkaraju. "Probabilistically Robust Recourse: Navigating the Trade-offs between Costs and Robustness in Algorithmic Recourse." Proceedings of the International Conference on Learning Representations (ICLR) (2023).
- 2024
- Working Paper
Using LLMs for Market Research
By: James Brand, Ayelet Israeli and Donald Ngwe
Large language models (LLMs) have rapidly gained popularity as labor-augmenting
tools for programming, writing, and many other processes that benefit from quick text
generation. In this paper we explore the uses and benefits of LLMs for researchers and
practitioners... View Details
Keywords: Large Language Model; Research; AI and Machine Learning; Analysis; Customers; Consumer Behavior; Technology Industry; Information Technology Industry
Brand, James, Ayelet Israeli, and Donald Ngwe. "Using LLMs for Market Research." Harvard Business School Working Paper, No. 23-062, April 2023. (Revised July 2024.)
- 2023
- Working Paper
Feature Importance Disparities for Data Bias Investigations
By: Peter W. Chang, Leor Fishman and Seth Neel
It is widely held that one cause of downstream bias in classifiers is bias present in the training data. Rectifying such biases may involve context-dependent interventions such as training separate models on subgroups, removing features with bias in the collection... View Details
Chang, Peter W., Leor Fishman, and Seth Neel. "Feature Importance Disparities for Data Bias Investigations." Working Paper, March 2023.
- March–April 2023
- Article
Pricing for Heterogeneous Products: Analytics for Ticket Reselling
By: Michael Alley, Max Biggs, Rim Hariss, Charles Herrmann, Michael Lingzhi Li and Georgia Perakis
Problem definition: We present a data-driven study of the secondary ticket market. In particular, we are primarily concerned with accurately estimating price sensitivity for listed tickets. In this setting, there are many issues including endogeneity, heterogeneity in... View Details
Keywords: Price; Demand and Consumers; AI and Machine Learning; Investment Return; Entertainment and Recreation Industry; Entertainment and Recreation Industry
Alley, Michael, Max Biggs, Rim Hariss, Charles Herrmann, Michael Lingzhi Li, and Georgia Perakis. "Pricing for Heterogeneous Products: Analytics for Ticket Reselling." Manufacturing & Service Operations Management 25, no. 2 (March–April 2023): 409–426.
- 2023
- Chapter
Marketing Through the Machine’s Eyes: Image Analytics and Interpretability
By: Shunyuan Zhang, Flora Feng and Kannan Srinivasan
he growth of social media and the sharing economy is generating abundant unstructured image and video data. Computer vision techniques can derive rich insights from unstructured data and can inform recommendations for increasing profits and consumer utility—if only the... View Details
Zhang, Shunyuan, Flora Feng, and Kannan Srinivasan. "Marketing Through the Machine’s Eyes: Image Analytics and Interpretability." Chap. 8 in Artificial Intelligence in Marketing. 20, edited by Naresh K. Malhotra, K. Sudhir, and Olivier Toubia, 217–238. Review of Marketing Research. Emerald Publishing Limited, 2023.
- 2023
- Working Paper
Distributionally Robust Causal Inference with Observational Data
By: Dimitris Bertsimas, Kosuke Imai and Michael Lingzhi Li
We consider the estimation of average treatment effects in observational studies and propose a new framework of robust causal inference with unobserved confounders. Our approach is based on distributionally robust optimization and proceeds in two steps. We first... View Details
Bertsimas, Dimitris, Kosuke Imai, and Michael Lingzhi Li. "Distributionally Robust Causal Inference with Observational Data." Working Paper, February 2023.
- 2023
- Working Paper
Nailing Prediction: Experimental Evidence on the Value of Tools in Predictive Model Development
By: Daniel Yue, Paul Hamilton and Iavor Bojinov
Predictive model development is understudied despite its centrality in modern artificial
intelligence and machine learning business applications. Although prior discussions
highlight advances in methods (along the dimensions of data, computing power, and
algorithms)... View Details
Keywords: Analytics and Data Science
Yue, Daniel, Paul Hamilton, and Iavor Bojinov. "Nailing Prediction: Experimental Evidence on the Value of Tools in Predictive Model Development." Harvard Business School Working Paper, No. 23-029, December 2022. (Revised April 2023.)
- 2022
- Article
Efficiently Training Low-Curvature Neural Networks
By: Suraj Srinivas, Kyle Matoba, Himabindu Lakkaraju and Francois Fleuret
Standard deep neural networks often have excess non-linearity, making them susceptible to issues such as low adversarial robustness and gradient instability. Common methods to address these downstream issues, such as adversarial training, are expensive and often... View Details
Keywords: AI and Machine Learning
Srinivas, Suraj, Kyle Matoba, Himabindu Lakkaraju, and Francois Fleuret. "Efficiently Training Low-Curvature Neural Networks." Advances in Neural Information Processing Systems (NeurIPS) (2022).
- November 2022
- Article
A Language-Based Method for Assessing Symbolic Boundary Maintenance between Social Groups
By: Anjali M. Bhatt, Amir Goldberg and Sameer B. Srivastava
When the social boundaries between groups are breached, the tendency for people to erect and maintain symbolic boundaries intensifies. Drawing on extant perspectives on boundary maintenance, we distinguish between two strategies that people pursue in maintaining... View Details
Keywords: Culture; Machine Learning; Natural Language Processing; Symbolic Boundaries; Organizations; Boundaries; Social Psychology; Interpersonal Communication; Organizational Culture
Bhatt, Anjali M., Amir Goldberg, and Sameer B. Srivastava. "A Language-Based Method for Assessing Symbolic Boundary Maintenance between Social Groups." Sociological Methods & Research 51, no. 4 (November 2022): 1681–1720.
- 2022
- Working Paper
Communicating Corporate Culture in Labor Markets: Evidence from Job Postings
We examine how firms craft their job postings to convey information about their culture and
whether doing so helps attract employees. We utilize state-of-the-art machine learning methods to
develop a comprehensive dictionary of key corporate values across the near... View Details
Keywords: Corporate Culture Significance; Labor Markets; Disclosure; Organizational Culture; Recruitment; Talent and Talent Management
Pacelli, Joseph, Tianshuo Shi, and Yuan Zou. "Communicating Corporate Culture in Labor Markets: Evidence from Job Postings." Working Paper, October 2022.
- October–December 2022
- Article
Achieving Reliable Causal Inference with Data-Mined Variables: A Random Forest Approach to the Measurement Error Problem
By: Mochen Yang, Edward McFowland III, Gordon Burtch and Gediminas Adomavicius
Combining machine learning with econometric analysis is becoming increasingly prevalent in both research and practice. A common empirical strategy involves the application of predictive modeling techniques to "mine" variables of interest from available data, followed... View Details
Keywords: Machine Learning; Econometric Analysis; Instrumental Variable; Random Forest; Causal Inference; AI and Machine Learning; Forecasting and Prediction
Yang, Mochen, Edward McFowland III, Gordon Burtch, and Gediminas Adomavicius. "Achieving Reliable Causal Inference with Data-Mined Variables: A Random Forest Approach to the Measurement Error Problem." INFORMS Journal on Data Science 1, no. 2 (October–December 2022): 138–155.
- June 2022
- Article
The Use and Misuse of Patent Data: Issues for Finance and Beyond
By: Josh Lerner and Amit Seru
Patents and citations are powerful tools for understanding innovation increasingly used in financial economics (and management research more broadly). Biases may result, however, from the interactions between the truncation of patents and citations and the changing... View Details
Lerner, Josh, and Amit Seru. "The Use and Misuse of Patent Data: Issues for Finance and Beyond." Review of Financial Studies 35, no. 6 (June 2022): 2667–2704.
- 2022
- Conference Presentation
Towards the Unification and Robustness of Post hoc Explanation Methods
By: Sushant Agarwal, Shahin Jabbari, Chirag Agarwal, Sohini Upadhyay, Steven Wu and Himabindu Lakkaraju
As machine learning black boxes are increasingly being deployed in critical domains such as healthcare and criminal justice, there has been a growing emphasis on developing techniques for explaining these black boxes in a post hoc manner. In this work, we analyze two... View Details
Keywords: AI and Machine Learning
Agarwal, Sushant, Shahin Jabbari, Chirag Agarwal, Sohini Upadhyay, Steven Wu, and Himabindu Lakkaraju. "Towards the Unification and Robustness of Post hoc Explanation Methods." Paper presented at the 3rd Symposium on Foundations of Responsible Computing (FORC), 2022.
- May 2022
- Article
Coins for Bombs: The Predictive Ability of On-Chain Transfers for Terrorist Attacks
By: Dan Amiram, Evgeny Lyandres and Daniel Rabetti
This study examines whether we can learn from the behavior of blockchain-based transfers to predict the financing of terrorist attacks. We exploit blockchain transaction transparency to map millions of transfers for hundreds of large on-chain service providers. The... View Details
Keywords: Blockchain; Bitcoin; Accounting; AI and Machine Learning; National Security; Governing Rules, Regulations, and Reforms
Amiram, Dan, Evgeny Lyandres, and Daniel Rabetti. "Coins for Bombs: The Predictive Ability of On-Chain Transfers for Terrorist Attacks." Journal of Accounting Research 60, no. 2 (May 2022): 427–466.
- 2022
- Article
Exploring Counterfactual Explanations Through the Lens of Adversarial Examples: A Theoretical and Empirical Analysis.
By: Martin Pawelczyk, Chirag Agarwal, Shalmali Joshi, Sohini Upadhyay and Himabindu Lakkaraju
As machine learning (ML) models become more widely deployed in high-stakes applications, counterfactual explanations have emerged as key tools for providing actionable model explanations in practice. Despite the growing popularity of counterfactual explanations, a... View Details
Keywords: Machine Learning Models; Counterfactual Explanations; Adversarial Examples; Mathematical Methods
Pawelczyk, Martin, Chirag Agarwal, Shalmali Joshi, Sohini Upadhyay, and Himabindu Lakkaraju. "Exploring Counterfactual Explanations Through the Lens of Adversarial Examples: A Theoretical and Empirical Analysis." Proceedings of the International Conference on Artificial Intelligence and Statistics (AISTATS) 25th (2022).
- April–June 2022
- Other Article
Commentary on 'Causal Decision Making and Causal Effect Estimation Are Not the Same... and Why It Matters'
There has been a substantial discussion in various methodological and applied literatures around causal inference; especially in the use of machine learning and statistical models to understand heterogeneity in treatment effects and to make optimal decision... View Details
Keywords: Causal Inference; Treatment Effect Estimation; Treatment Assignment Policy; Human-in-the-loop; Decision Making; Fairness
McFowland III, Edward. "Commentary on 'Causal Decision Making and Causal Effect Estimation Are Not the Same... and Why It Matters'." INFORMS Journal on Data Science 1, no. 1 (April–June 2022): 21–22.
- March 2022 (Revised January 2025)
- Technical Note
Prediction & Machine Learning
This note provides an introduction to machine learning for an introductory data science course. The note begins with a description of supervised, unsupervised, and reinforcement learning. Then, the note provides a brief explanation of the difference between traditional... View Details
Keywords: Machine Learning; Data Science; Learning; Analytics and Data Science; Performance Evaluation; AI and Machine Learning
Bojinov, Iavor I., Michael Parzen, and Paul Hamilton. "Prediction & Machine Learning." Harvard Business School Technical Note 622-101, March 2022. (Revised January 2025.)
- Article
Eliminating Unintended Bias in Personalized Policies Using Bias-Eliminating Adapted Trees (BEAT)
By: Eva Ascarza and Ayelet Israeli
An inherent risk of algorithmic personalization is disproportionate targeting of individuals from certain groups (or demographic characteristics such as gender or race), even when the decision maker does not intend to discriminate based on those “protected”... View Details
Keywords: Algorithm Bias; Personalization; Targeting; Generalized Random Forests (GRF); Discrimination; Customization and Personalization; Decision Making; Fairness; Mathematical Methods
Ascarza, Eva, and Ayelet Israeli. "Eliminating Unintended Bias in Personalized Policies Using Bias-Eliminating Adapted Trees (BEAT)." e2115126119. Proceedings of the National Academy of Sciences 119, no. 11 (March 8, 2022).
- 2022
- Working Paper
The Disagreement Problem in Explainable Machine Learning: A Practitioner's Perspective
By: Satyapriya Krishna, Tessa Han, Alex Gu, Javin Pombra, Shahin Jabbari, Steven Wu and Himabindu Lakkaraju
As various post hoc explanation methods are increasingly being leveraged to explain complex models in high-stakes settings, it becomes critical to develop a deeper understanding of if and when the explanations output by these methods disagree with each other, and how... View Details
Krishna, Satyapriya, Tessa Han, Alex Gu, Javin Pombra, Shahin Jabbari, Steven Wu, and Himabindu Lakkaraju. "The Disagreement Problem in Explainable Machine Learning: A Practitioner's Perspective." Working Paper, 2022.