Publications
Publications
Show Results For
- All HBS Web
(360)
- Faculty Publications (95)
Page 1 of 95
Results →
- July 2024
- Article
The Passive-Ownership Share Is Double What You Think It Is
By: Alex Chinco and Marco Sammon
Each time a stock gets added to or dropped from a benchmark index, we ask: “How much money would have to be tracking that index to explain the huge spike in rebalancing volume we observe on reconstitution day?” While index funds held 16% of the US stock market in 2021,... View Details
- 2024
- Conference Paper
Quantifying Uncertainty in Natural Language Explanations of Large Language Models
By: Himabindu Lakkaraju, Sree Harsha Tanneru and Chirag Agarwal
Large Language Models (LLMs) are increasingly used as powerful tools for several
high-stakes natural language processing (NLP) applications. Recent prompting
works claim to elicit intermediate reasoning steps and key tokens that serve as
proxy explanations for LLM... View Details
- 2023
- Article
Benchmarking Large Language Models on CMExam—A Comprehensive Chinese Medical Exam Dataset
By: Junling Liu, Peilin Zhou, Yining Hua, Dading Chong, Zhongyu Tian, Andrew Liu, Helin Wang, Chenyu You, Zhenhua Guo, Lei Zhu and Michael Lingzhi Li
Recent advancements in large language models (LLMs) have transformed the field of question answering (QA). However, evaluating LLMs in the medical field is challenging due to the lack of standardized and comprehensive datasets. To address this gap, we introduce CMExam,... View Details
- 2023
- Article
M4: A Unified XAI Benchmark for Faithfulness Evaluation of Feature Attribution Methods across Metrics, Modalities, and Models
By: Himabindu Lakkaraju, Xuhong Li, Mengnan Du, Jiamin Chen, Yekun Chai and Haoyi Xiong
While Explainable Artificial Intelligence (XAI) techniques have been widely studied to explain predictions made by deep neural networks, the way to evaluate the faithfulness of explanation results remains challenging, due to the heterogeneity of explanations for... View Details
Keywords: AI and Machine Learning
- June 2023
- Article
National Customer Orientation: An Empirical Test across 112 Countries
By: Ofer Mintz, Imran S. Currim and Rohit Deshpandé
Customer orientation is a central tenet of marketing. However, less is known about how customer orientation varies across countries and time. Mintz, Currim, and Deshpandé (Eur. J. Mark., 56: 1014–1041, 2022) propose a country-level construct, national customer... View Details
- 2023
- Article
Evaluating Explainability for Graph Neural Networks
By: Chirag Agarwal, Owen Queen, Himabindu Lakkaraju and Marinka Zitnik
As explanations are increasingly used to understand the behavior of graph neural networks (GNNs), evaluating the quality and reliability of GNN explanations is crucial. However, assessing the quality of GNN explanations is challenging as existing graph datasets have no... View Details
Keywords: Analytics and Data Science
- 2022
- Article
OpenXAI: Towards a Transparent Evaluation of Model Explanations
By: Chirag Agarwal, Satyapriya Krishna, Eshika Saxena, Martin Pawelczyk, Nari Johnson, Isha Puri, Marinka Zitnik and Himabindu Lakkaraju
While several types of post hoc explanation methods have been proposed in recent literature, there is very little work on systematically benchmarking these methods. Here, we introduce OpenXAI, a comprehensive and extensible opensource framework for evaluating and... View Details
- 2022
- Working Paper
What's My Employee Worth? The Effects of Salary Benchmarking
By: Zoë B. Cullen, Shengwu Li and Ricardo Perez-Truglia
While U.S. legislation prohibits employers from sharing information about their employees’
compensation with each other, companies are still allowed to acquire and use more aggregated
data provided by third parties. Most medium and large firms report using this type... View Details
- August 2022
- Case
The Spreadsheet
By: Zoë B. Cullen and Alexander J. MacKay
Compensation is the largest expenditure of almost every venture. Getting compensation packages right affects talent acquisition, retention, and profitability. In this case, and accompanying negotiation exercise, students learn strategies and tactics for setting... View Details
- May 2022
- Article
Variance Analysis: New Insights from Health Care Applications
By: Robert S. Kaplan and Susanna Gallani
We use a health care application to illustrate how variance analysis can be used to benchmark costs across similar service delivery sites. Variances for personnel costs, typically the largest cost component in service organizations, are calculated for price, quantity,... View Details
- 2022
- Book
A Political Economy of Justice
By: Danielle Allen, Yochai Benkler, Leah Downey, Rebecca Henderson and Joshua Simons
Defining a just economy in a tenuous social-political time.
If we can agree that our current social-political moment is tenuous and unsustainable—and indeed, that may be the only thing we can agree on right now—then how do markets, governments, and people... View Details
If we can agree that our current social-political moment is tenuous and unsustainable—and indeed, that may be the only thing we can agree on right now—then how do markets, governments, and people... View Details
- 2022
- Chapter
Firms, Morality, and the Search for a Better World
Book Abstract: Defining a just economy in a tenuous social-political time. If we can agree that our current social-political moment is tenuous and unsustainable—and indeed, that may be the only thing we can agree on right now—then how do markets, governments, and... View Details
- April 2022
- Article
National Customer Orientation: A Framework, Propositions and Agenda for Future Research
By: Ofer Mintz, Imran S. Currim and Rohit Deshpandé
Purpose: This paper aims to propose a new country-level construct, national customer orientation, to provide a benchmark for global headquartered managers’ decisions and scholars investigating cross-national research.
Design/methodology/approach: A conceptual... View Details
Design/methodology/approach: A conceptual... View Details
- March 2022
- Article
Where to Locate COVID-19 Mass Vaccination Facilities?
By: Dimitris Bertsimas, Vassilis Digalakis Jr, Alexander Jacquillat, Michael Lingzhi Li and Alessandro Previero
The outbreak of COVID-19 led to a record-breaking race to develop a vaccine. However, the limited vaccine capacity creates another massive challenge: how to distribute vaccines to mitigate the near-end impact of the pandemic? In the United States in particular, the new... View Details
- Article
A Prescriptive Analytics Framework for Optimal Policy Deployment Using Heterogeneous Treatment Effects
By: Edward McFowland III, Sandeep Gangarapu, Ravi Bapna and Tianshu Sun
We define a prescriptive analytics framework that addresses the needs of a constrained decision-maker facing, ex ante, unknown costs and benefits of multiple policy levers. The framework is general in nature and can be deployed in any utility maximizing context, public... View Details
- 2021
- Working Paper
Does Social Media Cause Polarization? Evidence from Access to Twitter Echo Chambers during the 2019 Argentine Presidential Debate
By: Rafael Di Tella, Ramiro H. Gálvez and Ernesto Schargrodsky
We study how two groups, those inside vs. those outside echo chambers, react to a political event when we vary social media status (Twitter). Our treatments mimic two strategies often suggested as a way to limit polarization on social media: they expose people to... View Details
- October 1, 2021
- Article
An Evaluation of Cross-efficiency Methods: With an Application to Warehouse Performance.
By: B.M. Balk, M.R. De Koster, Christian Kaps and J.L. Zofio
Cross-efficiency measurement is an extension of Data Envelopment Analysis that allows for tie-breaking ranking of the Decision Making Units (DMUs) using all the peer evaluations. In this article we examine the theory of cross-efficiency measurement by comparing a... View Details
- September 15, 2021
- Article
Improving Deconvolution Methods in Biology Through Open Innovation Competitions: An Application to the Connectivity Map
By: Andrea Blasco, Ted Natoli, Michael G. Endres, Rinat A. Sergeev, Steven Randazzo, Jin Hyun Paik, N.J. Maximilian Macaluso, Rajiv Narayan, Xiaodong Lu, David Peck, Karim R. Lakhani and Aravind Subramanian
A recurring problem in biomedical research is how to isolate signals of distinct populations (cell types, tissues, and genes) from composite measures obtained by a single analyte or sensor. Existing computational deconvolution approaches work well in many specific... View Details
- 2021
- Article
Designing, Not Checking, for Policy Robustness: An Example with Optimal Taxation
By: Benjamin B. Lockwood, Afras Sial and Matthew C. Weinzierl
Economists typically check the robustness of their results by comparing them across plausible ranges of parameter values and model structures. A preferable approach to robustness—for the purposes of policymaking and evaluation—is to design policy that takes these... View Details
- April 2021
- Teaching Note
Drinkworks: Home Bar by Keurig
By: Sunil Gupta and Jonathan Levav
Teaching Note for HBS Case No. 521-010. In the summer of 2018, Drinkworks CEO Nathaniel Davis needed to make a number of go-to-market decisions ahead of his company’s upcoming product launch. Formed through a joint venture between Keurig Dr. Pepper and Anheuser-Busch... View Details
Keywords: Marketing; Marketing Strategy; Product Marketing; Product Launch; Product Positioning; Markets; Bids and Bidding; Demand and Consumers; Consumer Behavior; Market Design; Distribution; Distribution Channels; Product; Product Design; Product Development; Business Model; Customers; Customer Value and Value Chain; Decision Making; Decisions; Goods and Commodities; Innovation and Invention; Technological Innovation; Business or Company Management; Growth and Development Strategy; Research; Research and Development; Strategy; Adoption; Competitive Advantage; Segmentation; Information Technology; Information Infrastructure; Value; Value Creation; Food and Beverage Industry; Consumer Products Industry; North and Central America; United States