Publications
Publications
Show Results For
- All HBS Web
(12,648)
- Faculty Publications (1,573)
Learning
→
- December 2023 (Revised August 2024)
- Case
Monsters in the Machine? Tackling the Challenge of Responsible AI
By: Paul M. Healy and Debora L. Spar
In November of 2022, the small tech company OpenAI released ChatGPT, an artificial intelligence chatbot which quickly captured the public’s imagination—becoming the world’s fastest-growing consumer application within months of its release. Though observers from across... View Details
- 2023
- Article
Balancing Risk and Reward: An Automated Phased Release Strategy
By: Yufan Li, Jialiang Mao and Iavor Bojinov
Phased releases are a common strategy in the technology industry for gradually releasing new products or updates through a sequence of A/B tests in which the number of treated units gradually grows until full deployment or deprecation. Performing phased releases in a... View Details
- 2023
- Article
Benchmarking Large Language Models on CMExam—A Comprehensive Chinese Medical Exam Dataset
By: Junling Liu, Peilin Zhou, Yining Hua, Dading Chong, Zhongyu Tian, Andrew Liu, Helin Wang, Chenyu You, Zhenhua Guo, Lei Zhu and Michael Lingzhi Li
Recent advancements in large language models (LLMs) have transformed the field of question answering (QA). However, evaluating LLMs in the medical field is challenging due to the lack of standardized and comprehensive datasets. To address this gap, we introduce CMExam,... View Details
- 2023
- Book
Beyond AI: ChatGPT, Web3, and the Business Landscape of Tomorrow
By: Ken Huang, Yang Wang, Feng Zhu, Xi Chen and Chunxiao Xing
This book explores the transformative potential of ChatGPT, Web3, and their impact on productivity and various industries. It delves into Generative AI (GenAI) and its representative platform ChatGPT, their synergy with Web3, and how they can revolutionize business... View Details
- 2023
- Article
M4: A Unified XAI Benchmark for Faithfulness Evaluation of Feature Attribution Methods across Metrics, Modalities, and Models
By: Himabindu Lakkaraju, Xuhong Li, Mengnan Du, Jiamin Chen, Yekun Chai and Haoyi Xiong
While Explainable Artificial Intelligence (XAI) techniques have been widely studied to explain predictions made by deep neural networks, the way to evaluate the faithfulness of explanation results remains challenging, due to the heterogeneity of explanations for... View Details
Keywords: AI and Machine Learning
- 2023
- Article
MoPe: Model Perturbation-based Privacy Attacks on Language Models
By: Marvin Li, Jason Wang, Jeffrey Wang and Seth Neel
Recent work has shown that Large Language Models (LLMs) can unintentionally leak sensitive information present in their training data. In this paper, we present Model Perturbations (MoPe), a new method to identify with high confidence if a given text is in the training... View Details
- 2023
- Article
Post Hoc Explanations of Language Models Can Improve Language Models
By: Satyapriya Krishna, Jiaqi Ma, Dylan Slack, Asma Ghandeharioun, Sameer Singh and Himabindu Lakkaraju
Large Language Models (LLMs) have demonstrated remarkable capabilities in performing complex tasks. Moreover, recent research has shown that incorporating human-annotated rationales (e.g., Chain-of-Thought prompting) during in-context learning can significantly enhance... View Details
- December 2023
- Article
Self-Orienting in Human and Machine Learning
By: Julian De Freitas, Ahmet Uğuralp, Zeliha Uğuralp, Laurie Paul, Joshua B. Tenenbaum and T. Ullman
A current proposal for a computational notion of self is a representation of one’s body in a specific time and place, which includes the recognition of that representation as the agent. This turns self-representation into a process of self-orientation, a challenging... View Details
- 2023
- Other Article
The Harvard USPTO Patent Dataset: A Large-Scale, Well-Structured, and Multi-Purpose Corpus of Patent Applications
By: Mirac Suzgun, Luke Melas-Kyriazi, Suproteem K. Sarkar, Scott Duke Kominers and Stuart Shieber
Innovation is a major driver of economic and social development, and information about many kinds of innovation is embedded in semi-structured data from patents and patent applications. Though the impact and novelty of innovations expressed in patent data are difficult... View Details
- 2023
- Working Paper
The Impact of Unionization on Consumer Perceptions of Service Quality: Evidence from Starbucks
By: Isamar Troncoso, Minkyung Kim, Ishita Chakraborty and SooHyun Kim
The US has seen a rise in union movements, but their effects on service industry marketing outcomes like customer satisfaction and perceptions of service quality remain understudied. In this paper, we empirically study the impact on customer satisfaction and... View Details
- 2024
- Working Paper
The Uneven Impact of Generative AI on Entrepreneurial Performance
By: Nicholas G. Otis, Rowan Clarke, Solène Delecourt, David Holtz and Rembrand Koning
Scalable and low-cost AI assistance has the potential to improve firm decision-making and economic performance. However, running a business involves a myriad of open-ended problems, making it difficult to know whether recent AI advances can help business owners make... View Details
- 2023
- Article
Verifiable Feature Attributions: A Bridge between Post Hoc Explainability and Inherent Interpretability
By: Usha Bhalla, Suraj Srinivas and Himabindu Lakkaraju
With the increased deployment of machine learning models in various real-world applications, researchers and practitioners alike have emphasized the need for explanations of model behaviour. To this end, two broad strategies have been outlined in prior literature to... View Details
- 2023
- Article
Which Models Have Perceptually-Aligned Gradients? An Explanation via Off-Manifold Robustness
By: Suraj Srinivas, Sebastian Bordt and Himabindu Lakkaraju
One of the remarkable properties of robust computer vision models is that their input-gradients are often aligned with human perception, referred to in the literature as perceptually-aligned gradients (PAGs). Despite only being trained for classification, PAGs cause... View Details
- November 2023
- Case
Open Source Machine Learning at Google
Set in early 2023, the case exposes students to the challenges of managing open source software at Google. The case focuses on the challenges for Alex Spinelli, Vice President of Product Management for Core Machine Learning. He must set priorities for Google’s efforts... View Details
- November 2023
- Case
Riiid: Scaling AI Educational Services Globally
By: John Jong-Hyun Kim, Nancy Dai and Ruru Hoong
This article explores the definition and evolution of AI, its applications in education, and the role of AI, particularly in K-12 education. It discusses the founding of Riiid, an AI-driven educational technology company, and its journey in the education sector, with a... View Details
- November 2023
- Case
Copilot(s): Generative AI at Microsoft and GitHub
This case tells the story of Microsoft’s 2018 acquisition of GitHub and the subsequent launch of GitHub Copilot, a tool that uses generative artificial intelligence to suggest snippets of code to software developers in real time. Set in late 2021, when Copilot was... View Details
- 2023
- Working Paper
Learning by Investing: Entrepreneurial Spillovers from Venture Capital
By: Josh Lerner, Jinlin Li and Tong Liu
This paper studies how investing in venture capital (VC) affects the entrepreneurial outcomes of individual limited partners (LPs). Using comprehensive administrative data on entrepreneurial activities and VC fundraising and investments in China, we first document that... View Details
- November 2023 (Revised June 2024)
- Case
Zest AI: Machine Learning and Credit Access
By: David S. Scharfstein and Ryan Gilland
- November 2023 (Revised April 2024)
- Case
Khanmigo: Revolutionizing Learning with GenAI
By: William A. Sahlman, Allison M. Ciechanover and Emily Grandjean
Already a leader in the edtech space since its 2008 launch, Khan Academy was now one of the first edtech organizations to embrace generative artificial intelligence ("genAI"). In March 2023, Khan Academy began beta testing Khanmigo, a genAI “guide” and tutor built with... View Details
- November 2023
- Case
Team Liquid: Fueling the Business of Fandom
By: Youngme Moon and Kerry Herman
In 2023, the co-CEOs of Team Liquid, one of the world's most prominent Esports organizations, are deciding whether and how to evolve their business model to include (1) a greater focus on enterprise revenue; and (2) more direct-to-consumer activity. Team Liquid has one... View Details