Publications
Publications
Show Results For
- All HBS Web
(916)
- Faculty Publications (127)
- 2023
- Working Paper
In-Context Unlearning: Language Models as Few Shot Unlearners
By: Martin Pawelczyk, Seth Neel and Himabindu Lakkaraju
Machine unlearning, the study of efficiently removing the impact of specific training points on the
trained model, has garnered increased attention of late, driven by the need to comply with privacy
regulations like the Right to be Forgotten. Although unlearning is... View Details
- 2023
- Working Paper
Navigating the Jagged Technological Frontier: Field Experimental Evidence of the Effects of AI on Knowledge Worker Productivity and Quality
By: Fabrizio Dell'Acqua, Edward McFowland III, Ethan Mollick, Hila Lifshitz-Assaf, Katherine C. Kellogg, Saran Rajendran, Lisa Krayer, François Candelon and Karim R. Lakhani
The public release of Large Language Models (LLMs) has sparked tremendous interest in how humans will use Artificial Intelligence (AI) to accomplish a variety of tasks. In our study conducted with Boston Consulting Group, a global management consulting firm, we examine... View Details
- August 2023
- Supplement
Reimagining Hindustan Unilever (B)
By: Sunil Gupta and Rachna Tahilyani
In April 2023, as the CEO and MD of Hindustan Unilever (HUL), India’s largest fast-moving consumer goods (FMCG) firm, prepared to hand over the firm’s reins to his successor, he proudly reflected on the last decade. His quest to digitally transform HUL into an... View Details
- 2023
- Article
Towards Bridging the Gaps between the Right to Explanation and the Right to Be Forgotten
By: Himabindu Lakkaraju, Satyapriya Krishna and Jiaqi Ma
The Right to Explanation and the Right to be Forgotten are two important principles outlined to regulate algorithmic decision making and data usage in real-world applications. While the right to explanation allows individuals to request an actionable explanation for an... View Details
- 2023
- Working Paper
Insufficiently Justified Disparate Impact: A New Criterion for Subgroup Fairness
By: Neil Menghani, Edward McFowland III and Daniel B. Neill
In this paper, we develop a new criterion, "insufficiently justified disparate impact" (IJDI), for assessing whether recommendations (binarized predictions) made by an algorithmic decision support tool are fair. Our novel, utility-based IJDI criterion evaluates false... View Details
- 2023
- Article
Probabilistically Robust Recourse: Navigating the Trade-offs between Costs and Robustness in Algorithmic Recourse
By: Martin Pawelczyk, Teresa Datta, Johannes van-den-Heuvel, Gjergji Kasneci and Himabindu Lakkaraju
As machine learning models are increasingly being employed to make consequential decisions in real-world settings, it becomes critical to ensure that individuals who are adversely impacted (e.g., loan denied) by the predictions of these models are provided with a means... View Details
- 2023
- Working Paper
Feature Importance Disparities for Data Bias Investigations
By: Peter W. Chang, Leor Fishman and Seth Neel
It is widely held that one cause of downstream bias in classifiers is bias present in the training data. Rectifying such biases may involve context-dependent interventions such as training separate models on subgroups, removing features with bias in the collection... View Details
- 2022
- Article
Efficiently Training Low-Curvature Neural Networks
By: Suraj Srinivas, Kyle Matoba, Himabindu Lakkaraju and Francois Fleuret
Standard deep neural networks often have excess non-linearity, making them susceptible to issues such as low adversarial robustness and gradient instability. Common methods to address these downstream issues, such as adversarial training, are expensive and often... View Details
Keywords: AI and Machine Learning
- November–December 2022
- Article
Can AI Really Help You Sell?: It Can, Depending on When and How You Implement It
By: Jim Dickie, Boris Groysberg, Benson P. Shapiro and Barry Trailer
Many salespeople today are struggling; only 57% of them make their annual quotas, surveys show. One problem is that buying processes have evolved faster than selling processes, and buyers today can access a wide range of online resources that let them evaluate products... View Details
- September 2022
- Technical Note
Addressing Social Determinants of Health in the American Landscape
By: Susanna Gallani and Jacob Riegler
Social determinants of health (SDOH) have gained significant attention in recent years. A growing body of research shows that a person’s health is influenced by a large number of non-genetic factors, most of which operate outside the realm of health care and are... View Details
- 2022
- Article
Towards Robust Off-Policy Evaluation via Human Inputs
By: Harvineet Singh, Shalmali Joshi, Finale Doshi-Velez and Himabindu Lakkaraju
Off-policy Evaluation (OPE) methods are crucial tools for evaluating policies in high-stakes domains such as healthcare, where direct deployment is often infeasible, unethical, or expensive. When deployment environments are expected to undergo changes (that is, dataset... View Details
- February 2022 (Revised January 2023)
- Case
Huazhu: A Chinese Hotel Giant's Journey of Digital Transformation
By: Feng Zhu, Yulin Fang, Bonnie Yining Cao and Duan Yang
Based in Shanghai, China, Huazhu Group, the world’s third-largest hotel operator, was known for its standardized IT system. It helped the company boost efficiency during the COVID-19 pandemic. Chief Digital Officer Xinxin Liu also faced some longer-term challenges:... View Details
- Article
Reliable Post hoc Explanations: Modeling Uncertainty in Explainability
By: Dylan Slack, Sophie Hilgard, Sameer Singh and Himabindu Lakkaraju
As black box explanations are increasingly being employed to establish model credibility in high stakes settings, it is important to ensure that these explanations are accurate and reliable. However, prior work demonstrates that explanations generated by... View Details
- 2021
- Article
ThreeDWorld: A Platform for Interactive Multi-Modal Physical Simulation
By: Chuang Gan, Jeremy Schwartz, Seth Alter, Damian Mrowca, Martin Schrimpf, James Traer, Julian De Freitas, Jonas Kubilius, Abhishek Bhandwaldar, Nick Haber, Megumi Sano, Kuno Kim, Elias Wang, Michael Lingelbach, Aidan Curtis, Kevin Feigelis, Daniel M. Bear, Dan Gutfreund, David Cox, Antonio Torralba, James J. DiCarlo, Joshua B. Tenenbaum, Josh H. McDermott and Daniel L.K. Yamins
We introduce ThreeDWorld (TDW), a platform for interactive multi-modal physical simulation. TDW enables simulation of high-fidelity sensory data and physical interactions between mobile agents and objects in rich 3D environments. Unique properties include: real-time... View Details
- October 1, 2021
- Article
An Evaluation of Cross-efficiency Methods: With an Application to Warehouse Performance.
By: B.M. Balk, M.R. De Koster, Christian Kaps and J.L. Zofio
Cross-efficiency measurement is an extension of Data Envelopment Analysis that allows for tie-breaking ranking of the Decision Making Units (DMUs) using all the peer evaluations. In this article we examine the theory of cross-efficiency measurement by comparing a... View Details
- July 2021
- Article
Outsourcing Tasks Online: Matching Supply and Demand on Peer-to-Peer Internet Platforms
By: Zoë Cullen and Chiara Farronato
We study the growth of online peer-to-peer markets. Using data from TaskRabbit, an expanding marketplace for domestic tasks at the time of our study, we show that growth varies considerably across cities. To disentangle the potential drivers of growth, we look... View Details
- 2021
- Working Paper
Public Disclosure of Private Meetings: Does Observing Peers' Information Acquisition Affect Analysts' Attention Allocation?
By: Yi Ru, Ronghuo Zheng and Yuan Zou
We investigate the impact of observing peers’ information acquisition on financial analysts’ attention allocation. Using the timely disclosure mandate by the Shenzhen Stock Exchange as a setting, we find that, when analysts can observe that a firm is visited by other... View Details
- July 2021
- Article
Redistribution through Markets
By: Piotr Dworczak, Scott Duke Kominers and Mohammad Akbarpour
Policymakers frequently use price regulations as a response to inequality in the markets they control. In this paper, we examine the optimal structure of such policies from the perspective of mechanism design. We study a buyer-seller market in which agents have private... View Details
- May 2021
- Simulation
Customer Compatibility Exercise Application
By: Ryan W. Buell
Customers impose considerable variability on the operating systems of service organizations. They show up when they wish (arrival variability), they ask for different things (request variability), they vary in their willingness and ability to help themselves (effort... View Details
- 2021
- Article
Fair Influence Maximization: A Welfare Optimization Approach
By: Aida Rahmattalabi, Shahin Jabbari, Himabindu Lakkaraju, Phebe Vayanos, Max Izenberg, Ryan Brown, Eric Rice and Milind Tambe
Several behavioral, social, and public health interventions, such as suicide/HIV prevention or community preparedness against natural disasters, leverage social network information to maximize outreach. Algorithmic influence maximization techniques have been proposed... View Details