Publications
Publications
Show Results For
- All HBS Web
(1,599)
- Faculty Publications (387)
AI
→
- December 2023 (Revised August 2024)
- Supplement
Microsoft Azure and the Cloud Wars (B)
By: Andy Wu and Matt Higgins
By 2023, the global market for cloud infrastructure had consolidated into a three-horse race. As of Q4 2022, Amazon, Microsoft, and Google collectively accounted for 66% of the global market. AWS had a market share of 33%, Microsoft Azure had 23%, and Google Cloud had... View Details
- December 2023 (Revised August 2024)
- Case
Monsters in the Machine? Tackling the Challenge of Responsible AI
By: Paul M. Healy and Debora L. Spar
In November of 2022, the small tech company OpenAI released ChatGPT, an artificial intelligence chatbot which quickly captured the public’s imagination—becoming the world’s fastest-growing consumer application within months of its release. Though observers from across... View Details
- 2023
- Article
Benchmarking Large Language Models on CMExam—A Comprehensive Chinese Medical Exam Dataset
By: Junling Liu, Peilin Zhou, Yining Hua, Dading Chong, Zhongyu Tian, Andrew Liu, Helin Wang, Chenyu You, Zhenhua Guo, Lei Zhu and Michael Lingzhi Li
Recent advancements in large language models (LLMs) have transformed the field of question answering (QA). However, evaluating LLMs in the medical field is challenging due to the lack of standardized and comprehensive datasets. To address this gap, we introduce CMExam,... View Details
- 2023
- Book
Beyond AI: ChatGPT, Web3, and the Business Landscape of Tomorrow
By: Ken Huang, Yang Wang, Feng Zhu, Xi Chen and Chunxiao Xing
This book explores the transformative potential of ChatGPT, Web3, and their impact on productivity and various industries. It delves into Generative AI (GenAI) and its representative platform ChatGPT, their synergy with Web3, and how they can revolutionize business... View Details
- 2023
- Article
M4: A Unified XAI Benchmark for Faithfulness Evaluation of Feature Attribution Methods across Metrics, Modalities, and Models
By: Himabindu Lakkaraju, Xuhong Li, Mengnan Du, Jiamin Chen, Yekun Chai and Haoyi Xiong
While Explainable Artificial Intelligence (XAI) techniques have been widely studied to explain predictions made by deep neural networks, the way to evaluate the faithfulness of explanation results remains challenging, due to the heterogeneity of explanations for... View Details
Keywords: AI and Machine Learning
- 2023
- Article
MoPe: Model Perturbation-based Privacy Attacks on Language Models
By: Marvin Li, Jason Wang, Jeffrey Wang and Seth Neel
Recent work has shown that Large Language Models (LLMs) can unintentionally leak sensitive information present in their training data. In this paper, we present Model Perturbations (MoPe), a new method to identify with high confidence if a given text is in the training... View Details
- 2023
- Article
Post Hoc Explanations of Language Models Can Improve Language Models
By: Satyapriya Krishna, Jiaqi Ma, Dylan Slack, Asma Ghandeharioun, Sameer Singh and Himabindu Lakkaraju
Large Language Models (LLMs) have demonstrated remarkable capabilities in performing complex tasks. Moreover, recent research has shown that incorporating human-annotated rationales (e.g., Chain-of-Thought prompting) during in-context learning can significantly enhance... View Details
- December 2023
- Article
Self-Orienting in Human and Machine Learning
By: Julian De Freitas, Ahmet Uğuralp, Zeliha Uğuralp, Laurie Paul, Joshua B. Tenenbaum and T. Ullman
A current proposal for a computational notion of self is a representation of one’s body in a specific time and place, which includes the recognition of that representation as the agent. This turns self-representation into a process of self-orientation, a challenging... View Details
- 2023
- Other Article
The Harvard USPTO Patent Dataset: A Large-Scale, Well-Structured, and Multi-Purpose Corpus of Patent Applications
By: Mirac Suzgun, Luke Melas-Kyriazi, Suproteem K. Sarkar, Scott Duke Kominers and Stuart Shieber
Innovation is a major driver of economic and social development, and information about many kinds of innovation is embedded in semi-structured data from patents and patent applications. Though the impact and novelty of innovations expressed in patent data are difficult... View Details
- 2024
- Working Paper
The Uneven Impact of Generative AI on Entrepreneurial Performance
By: Nicholas G. Otis, Rowan Clarke, Solène Delecourt, David Holtz and Rembrand Koning
Scalable and low-cost AI assistance has the potential to improve firm decision-making and economic performance. However, running a business involves a myriad of open-ended problems, making it difficult to know whether recent AI advances can help business owners make... View Details
- 2023
- Article
Verifiable Feature Attributions: A Bridge between Post Hoc Explainability and Inherent Interpretability
By: Usha Bhalla, Suraj Srinivas and Himabindu Lakkaraju
With the increased deployment of machine learning models in various real-world applications, researchers and practitioners alike have emphasized the need for explanations of model behaviour. To this end, two broad strategies have been outlined in prior literature to... View Details
- 2023
- Article
Which Models Have Perceptually-Aligned Gradients? An Explanation via Off-Manifold Robustness
By: Suraj Srinivas, Sebastian Bordt and Himabindu Lakkaraju
One of the remarkable properties of robust computer vision models is that their input-gradients are often aligned with human perception, referred to in the literature as perceptually-aligned gradients (PAGs). Despite only being trained for classification, PAGs cause... View Details
- November 2023
- Case
Open Source Machine Learning at Google
Set in early 2023, the case exposes students to the challenges of managing open source software at Google. The case focuses on the challenges for Alex Spinelli, Vice President of Product Management for Core Machine Learning. He must set priorities for Google’s efforts... View Details
- November 2023
- Case
Riiid: Scaling AI Educational Services Globally
By: John Jong-Hyun Kim, Nancy Dai and Ruru Hoong
This article explores the definition and evolution of AI, its applications in education, and the role of AI, particularly in K-12 education. It discusses the founding of Riiid, an AI-driven educational technology company, and its journey in the education sector, with a... View Details
- November 2023
- Case
Copilot(s): Generative AI at Microsoft and GitHub
This case tells the story of Microsoft’s 2018 acquisition of GitHub and the subsequent launch of GitHub Copilot, a tool that uses generative artificial intelligence to suggest snippets of code to software developers in real time. Set in late 2021, when Copilot was... View Details
- November 2023 (Revised April 2024)
- Case
Khanmigo: Revolutionizing Learning with GenAI
By: William A. Sahlman, Allison M. Ciechanover and Emily Grandjean
Already a leader in the edtech space since its 2008 launch, Khan Academy was now one of the first edtech organizations to embrace generative artificial intelligence ("genAI"). In March 2023, Khan Academy began beta testing Khanmigo, a genAI “guide” and tutor built with... View Details
- November–December 2023
- Article
Keep Your AI Projects on Track
By: Iavor Bojinov
AI—and especially its newest star, generative AI—is today a central theme in corporate boardrooms, leadership discussions, and casual exchanges among employees eager to supercharge their productivity. Sadly, beneath the aspirational headlines and tantalizing potential... View Details
- November 2023
- Article
Psychological Factors Underlying Attitudes toward AI Tools
By: Julian De Freitas, Stuti Agarwal, B. Schmitt and N. Haslam
What are the psychological factors driving attitudes toward AI tools, and how can resistance to AI systems be overcome when they are beneficial? In this perspective, we first organize the main sources of resistance into five main categories: opacity, emotionlessness,... View Details
- 2023
- Working Paper
The Optimal Stock Valuation Ratio
By: Sebastian Hillenbrand and Odhrain McCarthy
Trailing price ratios, such as the price-dividend and the price-earnings ratio, scale prices by trailing cash flow measures. They theoretically contain expected returns, yet, their performance in predicting stock market returns is poor. This is because of an omitted... View Details
- October 2023 (Revised January 2025)
- Case
Sydney Loves Kevin
By: Ryan W. Buell and Himabindu Lakkaraju
Kevin Roose was a columnist and podcast host for the New York Times, who focused on technology and its effects on society. When Microsoft launched the latest version of its search engine Bing in February 2023, the company invited Roose to its Redmond campus to... View Details