Publications
Publications
Show Results For
- All HBS Web
(119,772)
- Faculty Publications (3,297)
- 2023
- Article
Benchmarking Large Language Models on CMExam—A Comprehensive Chinese Medical Exam Dataset
By: Junling Liu, Peilin Zhou, Yining Hua, Dading Chong, Zhongyu Tian, Andrew Liu, Helin Wang, Chenyu You, Zhenhua Guo, Lei Zhu and Michael Lingzhi Li
Recent advancements in large language models (LLMs) have transformed the field of question answering (QA). However, evaluating LLMs in the medical field is challenging due to the lack of standardized and comprehensive datasets. To address this gap, we introduce CMExam,... View Details
- 2023
- Book
Beyond AI: ChatGPT, Web3, and the Business Landscape of Tomorrow
By: Ken Huang, Yang Wang, Feng Zhu, Xi Chen and Chunxiao Xing
This book explores the transformative potential of ChatGPT, Web3, and their impact on productivity and various industries. It delves into Generative AI (GenAI) and its representative platform ChatGPT, their synergy with Web3, and how they can revolutionize business... View Details
- December 2023
- Other Article
Introduction to the Special Section on Business and Climate Change
By: Rajesh Chandy, Glen Dowell, Colin Mayer, Erica Plambeck, George Serafeim, Michael W. Toffel, L. Beril Toktay and Elke Weber
- 2023
- Article
M4: A Unified XAI Benchmark for Faithfulness Evaluation of Feature Attribution Methods across Metrics, Modalities, and Models
By: Himabindu Lakkaraju, Xuhong Li, Mengnan Du, Jiamin Chen, Yekun Chai and Haoyi Xiong
While Explainable Artificial Intelligence (XAI) techniques have been widely studied to explain predictions made by deep neural networks, the way to evaluate the faithfulness of explanation results remains challenging, due to the heterogeneity of explanations for... View Details
Keywords: AI and Machine Learning
- 2023
- Article
MoPe: Model Perturbation-based Privacy Attacks on Language Models
By: Marvin Li, Jason Wang, Jeffrey Wang and Seth Neel
Recent work has shown that Large Language Models (LLMs) can unintentionally leak sensitive information present in their training data. In this paper, we present Model Perturbations (MoPe), a new method to identify with high confidence if a given text is in the training... View Details
- 2023
- Article
Post Hoc Explanations of Language Models Can Improve Language Models
By: Satyapriya Krishna, Jiaqi Ma, Dylan Slack, Asma Ghandeharioun, Sameer Singh and Himabindu Lakkaraju
Large Language Models (LLMs) have demonstrated remarkable capabilities in performing complex tasks. Moreover, recent research has shown that incorporating human-annotated rationales (e.g., Chain-of-Thought prompting) during in-context learning can significantly enhance... View Details
- 2023
- Article
Verifiable Feature Attributions: A Bridge between Post Hoc Explainability and Inherent Interpretability
By: Usha Bhalla, Suraj Srinivas and Himabindu Lakkaraju
With the increased deployment of machine learning models in various real-world applications, researchers and practitioners alike have emphasized the need for explanations of model behaviour. To this end, two broad strategies have been outlined in prior literature to... View Details
- December 2023
- Article
When Should the Off-Grid Sun Shine at Night? Optimum Renewable Generation and Energy Storage Investments
By: Christian Kaps, Simone Marinesi and Serguei Netessine
Globally, 1.5 billion people live off the grid, their only access to electricity often limited to operationally-expensive fossil fuel generators. Solar power has risen as a sustainable and less costly option, but its generation is variable during the day and... View Details
- 2023
- Article
Which Models Have Perceptually-Aligned Gradients? An Explanation via Off-Manifold Robustness
By: Suraj Srinivas, Sebastian Bordt and Himabindu Lakkaraju
One of the remarkable properties of robust computer vision models is that their input-gradients are often aligned with human perception, referred to in the literature as perceptually-aligned gradients (PAGs). Despite only being trained for classification, PAGs cause... View Details
- November 2023 (Revised April 2025)
- Case
Norse Atlantic Airways
By: Willy Shih
Bjørn Tore Larsen, Norse Atlantic Airways' founder and CEO, hadn't planned to get into the airline business. But when the COVID-19 pandemic depressed the global demand for air travel and the lease rates for jetliners, he realized if ever he was going to get into the... View Details
- November 2023
- Case
Open Source Machine Learning at Google
Set in early 2023, the case exposes students to the challenges of managing open source software at Google. The case focuses on the challenges for Alex Spinelli, Vice President of Product Management for Core Machine Learning. He must set priorities for Google’s efforts... View Details
- November 2023 (Revised November 2024)
- Case
Decarbonizing Shipping at A.P. Møller-Maersk (A)
By: Willy Shih, Michael W. Toffel and Kelsey Carter
Container shipping was responsible for moving more than 80% of globally traded goods, and almost 3% of global greenhouse gas emissions. A.P. Møller-Maersk, one of the top three container lines, conducted an extensive lifecycle assessment (LCA) of alternative fuels,... View Details
- November 2023 (Revised August 2024)
- Background Note
Life Cycle Assessment: An Overview
By: Willy C. Shih, Michael W. Toffel and Kelsey Carter
Life cycle assessment (LCA) is a holistic approach to quantifying the environmental impacts—including resources consumed and wastes produced—associated with the entire life cycle of a product, from the production or extraction of the raw materials used in its creation,... View Details
- November 2023
- Case
From Imitation to Innovation: Zongshen Industrial Group (Abridged)
By: Willy Shih and Nancy Dai
Like other small shops based in Chongqing, China, Zongshen Industrial Group started by assembling motorcycles from "standard" parts. The quality of its early products was good enough for rural Chinese buyers, though wealthier consumers usually purchased premium... View Details
- November 2023
- Case
Copilot(s): Generative AI at Microsoft and GitHub
This case tells the story of Microsoft’s 2018 acquisition of GitHub and the subsequent launch of GitHub Copilot, a tool that uses generative artificial intelligence to suggest snippets of code to software developers in real time. Set in late 2021, when Copilot was... View Details
- November 2023 (Revised February 2025)
- Background Note
Corporate Climate Targets
By: Willy C. Shih, Michael W. Toffel and Kelsey Carter
Companies that are addressing climate change by mitigating their greenhouse gas emissions often set reduction targets. This note describes several types of widely used carbon reduction targets, including carbon neutral, science based, net zero, real zero, and carbon... View Details
- November 2023
- Teaching Plan
Geely SEA: New Electric Vehicle Platforms
By: Willy Shih
Teaching Plan for HBS Case No. 622-001. Kent Bovellan, the Chief Engineer and Head of the Vehicle Architecture Center for Geely Holding, the Hangzhou, China headquartered global automotive group, was debating the platform choice for an upcoming "D" segment midsized... View Details
- November 2023 (Revised January 2024)
- Case
Votorantim: Uniting Family and Business Across Generations
By: Christina R. Wing, Carla Larangeira and Pedro Levindo
Over a 105-year span, the Ermírio de Moraes family built Votorantim, one of Latin America’s largest industrial conglomerates, and among Brazil’s topmost businesses, also credited for helping “build” the country over decades. By early 2023, Votorantim included... View Details
- November–December 2023
- Article
Keep Your AI Projects on Track
By: Iavor Bojinov
AI—and especially its newest star, generative AI—is today a central theme in corporate boardrooms, leadership discussions, and casual exchanges among employees eager to supercharge their productivity. Sadly, beneath the aspirational headlines and tantalizing potential... View Details
- November 2023
- Article
Open Source Software and Global Entrepreneurship
By: Nataliya Langburd Wright, Frank Nagle and Shane Greenstein
This is the first study to consider the relationship between open source software (OSS) and
entrepreneurship around the globe. This study measures whether country-level participation on
the GitHub OSS platform affects the founding of innovative ventures, and where it... View Details