Publications
Publications
Show Results For
- All HBS Web
(2,125)
- Faculty Publications (304)
- January 2024
- Case
Sprouts Farmers Market
By: Rajiv Lal, Forest L. Reinhardt and Natalie Kindred
Sprouts Farmers Markets (Sprouts) is a Phoenix, Arizona-based chain of 400-plus natural foods stores in 23 U.S. states and $6.4 billion in sales as of 2022. In its product assortment, brand image, and store environment, Sprouts emphasizes freshness, health, innovation,... View Details
- 2024
- Conference Paper
Quantifying Uncertainty in Natural Language Explanations of Large Language Models
By: Himabindu Lakkaraju, Sree Harsha Tanneru and Chirag Agarwal
Large Language Models (LLMs) are increasingly used as powerful tools for several
high-stakes natural language processing (NLP) applications. Recent prompting
works claim to elicit intermediate reasoning steps and key tokens that serve as
proxy explanations for LLM... View Details
- January–February 2024
- Article
Shared Service Delivery Can Increase Client Engagement: A Study of Shared Medical Appointments
By: Ryan W. Buell, Kamalini Ramdas, Nazlı Sönmez, Kavitha Srinivasan and Rengaraj Venkatesh
Problem Definition: Clients and service providers alike often consider one-on-one service delivery to be ideal, assuming – perhaps unquestioningly – that devoting individualized attention best improves client outcomes. In contrast, in shared service delivery, clients... View Details
- 2024
- Chapter
The Private Economy Under Party-State Capitalism
By: Margaret M. Pearson, Meg Rithmire and Kellee S. Tsai
This chapter addresses the evolution of China’s approach to the private sector from the early reform era until the beginning of Xi Jinping’s third term. It argues that China has evolved from a familiar form of state capitalism, in which economic growth is the primary... View Details
- 2023
- Working Paper
Money, Time, and Grant Design
By: Kyle Myers and Wei Yang Tham
The design of research grants has been hypothesized to be a useful tool for
influencing researchers and their science. We test this by conducting two thought
experiments in a nationally representative survey of academic researchers. First,
we offer participants a... View Details
- 2023
- Article
Benchmarking Large Language Models on CMExam—A Comprehensive Chinese Medical Exam Dataset
By: Junling Liu, Peilin Zhou, Yining Hua, Dading Chong, Zhongyu Tian, Andrew Liu, Helin Wang, Chenyu You, Zhenhua Guo, Lei Zhu and Michael Lingzhi Li
Recent advancements in large language models (LLMs) have transformed the field of question answering (QA). However, evaluating LLMs in the medical field is challenging due to the lack of standardized and comprehensive datasets. To address this gap, we introduce CMExam,... View Details
- 2023
- Article
MoPe: Model Perturbation-based Privacy Attacks on Language Models
By: Marvin Li, Jason Wang, Jeffrey Wang and Seth Neel
Recent work has shown that Large Language Models (LLMs) can unintentionally leak sensitive information present in their training data. In this paper, we present Model Perturbations (MoPe), a new method to identify with high confidence if a given text is in the training... View Details
- 2023
- Article
Post Hoc Explanations of Language Models Can Improve Language Models
By: Satyapriya Krishna, Jiaqi Ma, Dylan Slack, Asma Ghandeharioun, Sameer Singh and Himabindu Lakkaraju
Large Language Models (LLMs) have demonstrated remarkable capabilities in performing complex tasks. Moreover, recent research has shown that incorporating human-annotated rationales (e.g., Chain-of-Thought prompting) during in-context learning can significantly enhance... View Details
- 2023
- Other Article
The Harvard USPTO Patent Dataset: A Large-Scale, Well-Structured, and Multi-Purpose Corpus of Patent Applications
By: Mirac Suzgun, Luke Melas-Kyriazi, Suproteem K. Sarkar, Scott Duke Kominers and Stuart Shieber
Innovation is a major driver of economic and social development, and information about many kinds of innovation is embedded in semi-structured data from patents and patent applications. Though the impact and novelty of innovations expressed in patent data are difficult... View Details
- 2023
- Working Paper
Toward a Better Understanding of Open Ecosystems: Implications for Policymakers
By: Feng Zhu and Carmelo Cennamo
The digital realm is undergoing a significant transformation, marked by the emergence of platform
business models and the concept of open ecosystems. This paper delves into the intricate nature of
ecosystem openness, underscoring the point that the openness of... View Details
- October 2023
- Teaching Note
Timnit Gebru: 'SILENCED No More' on AI Bias and The Harms of Large Language Models
By: Tsedal Neeley and Tim Englehart
Teaching Note for HBS Case No. 422-085. Dr. Timnit Gebru—a leading artificial intelligence (AI) computer scientist and co-lead of Google’s Ethical AI team—was messaging with one of her colleagues when she saw the words: “Did you resign?? Megan sent an email saying that... View Details
- October 2023
- Case
Fixie and Conversational AI Sidekicks
By: Jeffrey J. Bussgang and Carin-Isabel Knoop
In March 2023, Fixie Co-Founder and Chief Architect Matt Welsh and co-founders had the kind of meeting no founders want to have. The president of leading artificial intelligence (AI) research and deployment firm OpenAI, which had catapulted into fame with its ChatGPT... View Details
- October 2023
- Case
Driving Sustainability at AB InBev
By: Ethan Rouen and Antonio Manuel Oftelie
It was the height of the summer in 2022, and Michel Doukeris, the CEO of Anheuser-Busch InBev (AB InBev), and Peter Kraemer, the company’s Chief Supply Officer, gazed across the vast desert surrounding Zacatecas, Mexico. They were visiting their Grupo Modelo Brewery,... View Details
- 2023
- Working Paper
Causal Interpretation of Structural IV Estimands
By: Isaiah Andrews, Nano Barahona, Matthew Gentzkow, Ashesh Rambachan and Jesse M. Shapiro
We study the causal interpretation of instrumental variables (IV) estimands of nonlinear, multivariate structural models with respect to rich forms of model misspecification. We focus on guaranteeing that the researcher's estimator is sharp zero consistent, meaning... View Details
Keywords: Mathematical Methods
- 2023
- Working Paper
In-Context Unlearning: Language Models as Few Shot Unlearners
By: Martin Pawelczyk, Seth Neel and Himabindu Lakkaraju
Machine unlearning, the study of efficiently removing the impact of specific training points on the
trained model, has garnered increased attention of late, driven by the need to comply with privacy
regulations like the Right to be Forgotten. Although unlearning is... View Details
- 2023
- Working Paper
Navigating the Jagged Technological Frontier: Field Experimental Evidence of the Effects of AI on Knowledge Worker Productivity and Quality
By: Fabrizio Dell'Acqua, Edward McFowland III, Ethan Mollick, Hila Lifshitz-Assaf, Katherine C. Kellogg, Saran Rajendran, Lisa Krayer, François Candelon and Karim R. Lakhani
The public release of Large Language Models (LLMs) has sparked tremendous interest in how humans will use Artificial Intelligence (AI) to accomplish a variety of tasks. In our study conducted with Boston Consulting Group, a global management consulting firm, we examine... View Details
- September 2023 (Revised January 2024)
- Case
AI21 Labs in 2023: Strategy for Generative AI
By: David Yoffie, Orna Dan and Elena Corsi
Israeli generative artificial intelligence company AI21 Labs was founded in 2017 to realize the vision of true machine intelligence. It sought to reinvent writing and reading and in 2020 it launched Wordtune, an app using GenAI software to offer alternate text... View Details
- 2023
- Article
On the Impact of Actionable Explanations on Social Segregation
By: Ruijiang Gao and Himabindu Lakkaraju
As predictive models seep into several real-world applications, it has become critical to ensure that individuals who are negatively impacted by the outcomes of these models are provided with a means for recourse. To this end, there has been a growing body of research... View Details
- 2024
- Working Paper
The Crowdless Future? Generative AI and Creative Problem Solving
The rapid advances in generative artificial intelligence (AI) open up attractive opportunities for creative problem-solving through human-guided AI partnerships. To explore this potential, we initiated a crowdsourcing challenge focused on sustainable, circular economy... View Details
- August 2023
- Article
Explaining Machine Learning Models with Interactive Natural Language Conversations Using TalkToModel
By: Dylan Slack, Satyapriya Krishna, Himabindu Lakkaraju and Sameer Singh
Practitioners increasingly use machine learning (ML) models, yet models have become more complex and harder to understand. To understand complex models, researchers have proposed techniques to explain model predictions. However, practitioners struggle to use... View Details