Publications
Publications
Show Results For
- All HBS Web
(1,123)
- Faculty Publications (156)
Language
→
- 2024
- Working Paper
The Value of Open Source Software
By: Manuel Hoffmann, Frank Nagle and Yanuo Zhou
The value of a non-pecuniary (free) product is inherently difficult to assess. A pervasive
example is open source software (OSS), a global public good that plays a vital role in the economy
and is foundational for most technology we use today. However, it is... View Details
- 2024
- Conference Paper
Quantifying Uncertainty in Natural Language Explanations of Large Language Models
By: Himabindu Lakkaraju, Sree Harsha Tanneru and Chirag Agarwal
Large Language Models (LLMs) are increasingly used as powerful tools for several
high-stakes natural language processing (NLP) applications. Recent prompting
works claim to elicit intermediate reasoning steps and key tokens that serve as
proxy explanations for LLM... View Details
- 2023
- Article
Benchmarking Large Language Models on CMExam—A Comprehensive Chinese Medical Exam Dataset
By: Junling Liu, Peilin Zhou, Yining Hua, Dading Chong, Zhongyu Tian, Andrew Liu, Helin Wang, Chenyu You, Zhenhua Guo, Lei Zhu and Michael Lingzhi Li
Recent advancements in large language models (LLMs) have transformed the field of question answering (QA). However, evaluating LLMs in the medical field is challenging due to the lack of standardized and comprehensive datasets. To address this gap, we introduce CMExam,... View Details
- November 2023
- Article
Knowledge About the Source of Emotion Predicts Emotion-Regulation Attempts, Strategies, and Perceived Emotion-Regulation Success
By: Yael Millgram, Matthew K. Nock, David D. Bailey and Amit Goldenberg
People’s ability to regulate emotions is crucial to healthy emotional functioning. One overlooked aspect in emotion-regulation research is that knowledge about the source of emotions can vary across situations and individuals, which could impact people’s ability to... View Details
- 2023
- Article
MoPe: Model Perturbation-based Privacy Attacks on Language Models
By: Marvin Li, Jason Wang, Jeffrey Wang and Seth Neel
Recent work has shown that Large Language Models (LLMs) can unintentionally leak sensitive information present in their training data. In this paper, we present Model Perturbations (MoPe), a new method to identify with high confidence if a given text is in the training... View Details
- 2023
- Article
Post Hoc Explanations of Language Models Can Improve Language Models
By: Satyapriya Krishna, Jiaqi Ma, Dylan Slack, Asma Ghandeharioun, Sameer Singh and Himabindu Lakkaraju
Large Language Models (LLMs) have demonstrated remarkable capabilities in performing complex tasks. Moreover, recent research has shown that incorporating human-annotated rationales (e.g., Chain-of-Thought prompting) during in-context learning can significantly enhance... View Details
- 2023
- Other Article
The Harvard USPTO Patent Dataset: A Large-Scale, Well-Structured, and Multi-Purpose Corpus of Patent Applications
By: Mirac Suzgun, Luke Melas-Kyriazi, Suproteem K. Sarkar, Scott Duke Kominers and Stuart Shieber
Innovation is a major driver of economic and social development, and information about many kinds of innovation is embedded in semi-structured data from patents and patent applications. Though the impact and novelty of innovations expressed in patent data are difficult... View Details
- 2023
- Working Paper
Toward a Better Understanding of Open Ecosystems: Implications for Policymakers
By: Feng Zhu and Carmelo Cennamo
The digital realm is undergoing a significant transformation, marked by the emergence of platform
business models and the concept of open ecosystems. This paper delves into the intricate nature of
ecosystem openness, underscoring the point that the openness of... View Details
- October 2023
- Teaching Note
Timnit Gebru: 'SILENCED No More' on AI Bias and The Harms of Large Language Models
By: Tsedal Neeley and Tim Englehart
Teaching Note for HBS Case No. 422-085. Dr. Timnit Gebru—a leading artificial intelligence (AI) computer scientist and co-lead of Google’s Ethical AI team—was messaging with one of her colleagues when she saw the words: “Did you resign?? Megan sent an email saying that... View Details
- October 2023
- Case
Fixie and Conversational AI Sidekicks
By: Jeffrey J. Bussgang and Carin-Isabel Knoop
In March 2023, Fixie Co-Founder and Chief Architect Matt Welsh and co-founders had the kind of meeting no founders want to have. The president of leading artificial intelligence (AI) research and deployment firm OpenAI, which had catapulted into fame with its ChatGPT... View Details
- 2023
- Working Paper
In-Context Unlearning: Language Models as Few Shot Unlearners
By: Martin Pawelczyk, Seth Neel and Himabindu Lakkaraju
Machine unlearning, the study of efficiently removing the impact of specific training points on the
trained model, has garnered increased attention of late, driven by the need to comply with privacy
regulations like the Right to be Forgotten. Although unlearning is... View Details
- 2023
- Working Paper
Navigating the Jagged Technological Frontier: Field Experimental Evidence of the Effects of AI on Knowledge Worker Productivity and Quality
By: Fabrizio Dell'Acqua, Edward McFowland III, Ethan Mollick, Hila Lifshitz-Assaf, Katherine C. Kellogg, Saran Rajendran, Lisa Krayer, François Candelon and Karim R. Lakhani
The public release of Large Language Models (LLMs) has sparked tremendous interest in how humans will use Artificial Intelligence (AI) to accomplish a variety of tasks. In our study conducted with Boston Consulting Group, a global management consulting firm, we examine... View Details
- September 2023 (Revised January 2024)
- Case
AI21 Labs in 2023: Strategy for Generative AI
By: David Yoffie, Orna Dan and Elena Corsi
Israeli generative artificial intelligence company AI21 Labs was founded in 2017 to realize the vision of true machine intelligence. It sought to reinvent writing and reading and in 2020 it launched Wordtune, an app using GenAI software to offer alternate text... View Details
- 2024
- Working Paper
The Crowdless Future? Generative AI and Creative Problem Solving
The rapid advances in generative artificial intelligence (AI) open up attractive opportunities for creative problem-solving through human-guided AI partnerships. To explore this potential, we initiated a crowdsourcing challenge focused on sustainable, circular economy... View Details
- August 2023
- Article
Explaining Machine Learning Models with Interactive Natural Language Conversations Using TalkToModel
By: Dylan Slack, Satyapriya Krishna, Himabindu Lakkaraju and Sameer Singh
Practitioners increasingly use machine learning (ML) models, yet models have become more complex and harder to understand. To understand complex models, researchers have proposed techniques to explain model predictions. However, practitioners struggle to use... View Details
- August 29, 2023
- Article
The Fragility of Artists’ Reputations from 1795 to 2020
By: Letian Zhang, Mitali Banerjee, Shinan Wang and Zhuoqiao Hong
This study explores the longevity of artistic reputation. We empirically examine whether artists are more- or less-venerated after their death. We construct a massive historical corpus spanning 1795 to 2020 and build separate word-embedding models for each five-year... View Details
- 2023
- Working Paper
Beyond the Hype: Unveiling the Marginal Benefits of 3D Virtual Tours in Real Estate
By: Mengxia Zhang and Isamar Troncoso
3D virtual tours (VTs) have become a popular digital tool in real estate platforms, enabling potential buyers to virtually walk through the houses they search for online. In this paper, we study home sellers’ adoption of VTs and the VTs’ relative benefits compared to... View Details
- July 2023
- Article
Negative Expressions Are Shared More on Twitter for Public Figures Than for Ordinary Users
By: Jonas P. Schöne, David Garcia, Brian Parkinson and Amit Goldenberg
Social media users tend to produce content that contains more positive than negative emotional language. However, negative emotional language is more likely to be shared. To understand why, research has thus far focused on psychological processes associated with... View Details
- 2024
- Working Paper
Operational Impact of Communication Channels: Evidence from Last-Mile Delivery Services
By: Natalie Epstein, Santiago Gallino and Antonio Moreno
Communication channels are often used to improve customer satisfaction and behavior. This paper studies
how they can be used to enhance operational performance.
We partner with a last-mile delivery company and, through natural and field experiments, explore... View Details
We partner with a last-mile delivery company and, through natural and field experiments, explore... View Details
- 2024
- Working Paper
Using LLMs for Market Research
By: James Brand, Ayelet Israeli and Donald Ngwe
Large language models (LLMs) have rapidly gained popularity as labor-augmenting
tools for programming, writing, and many other processes that benefit from quick text
generation. In this paper we explore the uses and benefits of LLMs for researchers and
practitioners... View Details