Publications
Publications
Show Results For
- All HBS Web
(927)
- Faculty Publications (354)
- 2023
- Article
M4: A Unified XAI Benchmark for Faithfulness Evaluation of Feature Attribution Methods across Metrics, Modalities, and Models
By: Himabindu Lakkaraju, Xuhong Li, Mengnan Du, Jiamin Chen, Yekun Chai and Haoyi Xiong
While Explainable Artificial Intelligence (XAI) techniques have been widely studied to explain predictions made by deep neural networks, the way to evaluate the faithfulness of explanation results remains challenging, due to the heterogeneity of explanations for... View Details
Keywords: AI and Machine Learning
- 2023
- Article
MoPe: Model Perturbation-based Privacy Attacks on Language Models
By: Marvin Li, Jason Wang, Jeffrey Wang and Seth Neel
Recent work has shown that Large Language Models (LLMs) can unintentionally leak sensitive information present in their training data. In this paper, we present Model Perturbations (MoPe), a new method to identify with high confidence if a given text is in the training... View Details
- 2023
- Article
Post Hoc Explanations of Language Models Can Improve Language Models
By: Satyapriya Krishna, Jiaqi Ma, Dylan Slack, Asma Ghandeharioun, Sameer Singh and Himabindu Lakkaraju
Large Language Models (LLMs) have demonstrated remarkable capabilities in performing complex tasks. Moreover, recent research has shown that incorporating human-annotated rationales (e.g., Chain-of-Thought prompting) during in-context learning can significantly enhance... View Details
- December 2023
- Article
Self-Orienting in Human and Machine Learning
By: Julian De Freitas, Ahmet Uğuralp, Zeliha Uğuralp, Laurie Paul, Joshua B. Tenenbaum and T. Ullman
A current proposal for a computational notion of self is a representation of one’s body in a specific time and place, which includes the recognition of that representation as the agent. This turns self-representation into a process of self-orientation, a challenging... View Details
- 2023
- Other Article
The Harvard USPTO Patent Dataset: A Large-Scale, Well-Structured, and Multi-Purpose Corpus of Patent Applications
By: Mirac Suzgun, Luke Melas-Kyriazi, Suproteem K. Sarkar, Scott Duke Kominers and Stuart Shieber
Innovation is a major driver of economic and social development, and information about many kinds of innovation is embedded in semi-structured data from patents and patent applications. Though the impact and novelty of innovations expressed in patent data are difficult... View Details
- 2024
- Working Paper
The Uneven Impact of Generative AI on Entrepreneurial Performance
By: Nicholas G. Otis, Rowan Clarke, Solène Delecourt, David Holtz and Rembrand Koning
Scalable and low-cost AI assistance has the potential to improve firm decision-making and economic performance. However, running a business involves a myriad of open-ended problems, making it difficult to know whether recent AI advances can help business owners make... View Details
- 2023
- Article
Verifiable Feature Attributions: A Bridge between Post Hoc Explainability and Inherent Interpretability
By: Usha Bhalla, Suraj Srinivas and Himabindu Lakkaraju
With the increased deployment of machine learning models in various real-world applications, researchers and practitioners alike have emphasized the need for explanations of model behaviour. To this end, two broad strategies have been outlined in prior literature to... View Details
- 2023
- Article
Which Models Have Perceptually-Aligned Gradients? An Explanation via Off-Manifold Robustness
By: Suraj Srinivas, Sebastian Bordt and Himabindu Lakkaraju
One of the remarkable properties of robust computer vision models is that their input-gradients are often aligned with human perception, referred to in the literature as perceptually-aligned gradients (PAGs). Despite only being trained for classification, PAGs cause... View Details
- November 2023
- Case
Open Source Machine Learning at Google
Set in early 2023, the case exposes students to the challenges of managing open source software at Google. The case focuses on the challenges for Alex Spinelli, Vice President of Product Management for Core Machine Learning. He must set priorities for Google’s efforts... View Details
- November 2023
- Case
Riiid: Scaling AI Educational Services Globally
By: John Jong-Hyun Kim, Nancy Dai and Ruru Hoong
This article explores the definition and evolution of AI, its applications in education, and the role of AI, particularly in K-12 education. It discusses the founding of Riiid, an AI-driven educational technology company, and its journey in the education sector, with a... View Details
- November 2023
- Case
Copilot(s): Generative AI at Microsoft and GitHub
This case tells the story of Microsoft’s 2018 acquisition of GitHub and the subsequent launch of GitHub Copilot, a tool that uses generative artificial intelligence to suggest snippets of code to software developers in real time. Set in late 2021, when Copilot was... View Details
- November 2023 (Revised June 2024)
- Case
Zest AI: Machine Learning and Credit Access
By: David S. Scharfstein and Ryan Gilland
- November 2023 (Revised April 2024)
- Case
Khanmigo: Revolutionizing Learning with GenAI
By: William A. Sahlman, Allison M. Ciechanover and Emily Grandjean
Already a leader in the edtech space since its 2008 launch, Khan Academy was now one of the first edtech organizations to embrace generative artificial intelligence ("genAI"). In March 2023, Khan Academy began beta testing Khanmigo, a genAI “guide” and tutor built with... View Details
- Working Paper
An AI Method to Score Celebrity Visual Potential from Human Faces
By: Flora Feng, Shunyuan Zhang, Xiao Liu, Kannan Srinivasan and Cait Lamberton
Celebrities have extraordinary abilities to attract and influence others. Predicting celebrity visual potential is important in the domains of business, politics, media, and entertainment. Can we use human faces to predict celebrity visual potential? If so, which... View Details
- November–December 2023
- Article
Keep Your AI Projects on Track
By: Iavor Bojinov
AI—and especially its newest star, generative AI—is today a central theme in corporate boardrooms, leadership discussions, and casual exchanges among employees eager to supercharge their productivity. Sadly, beneath the aspirational headlines and tantalizing potential... View Details
- November 2023
- Article
Psychological Factors Underlying Attitudes toward AI Tools
By: Julian De Freitas, Stuti Agarwal, B. Schmitt and N. Haslam
What are the psychological factors driving attitudes toward AI tools, and how can resistance to AI systems be overcome when they are beneficial? In this perspective, we first organize the main sources of resistance into five main categories: opacity, emotionlessness,... View Details
- 2023
- Working Paper
The Optimal Stock Valuation Ratio
By: Sebastian Hillenbrand and Odhrain McCarthy
Trailing price ratios, such as the price-dividend and the price-earnings ratio, scale prices by trailing cash flow measures. They theoretically contain expected returns, yet, their performance in predicting stock market returns is poor. This is because of an omitted... View Details
- October 2023
- Teaching Note
Timnit Gebru: 'SILENCED No More' on AI Bias and The Harms of Large Language Models
By: Tsedal Neeley and Tim Englehart
Teaching Note for HBS Case No. 422-085. Dr. Timnit Gebru—a leading artificial intelligence (AI) computer scientist and co-lead of Google’s Ethical AI team—was messaging with one of her colleagues when she saw the words: “Did you resign?? Megan sent an email saying that... View Details
- October 2023 (Revised June 2024)
- Case
ReUp Education: Can AI Help Learners Return to College?
By: Kris Ferreira, Christopher Thomas Ryan and Sarah Mehta
Founded in 2015, ReUp Education helps “stopped out students”—learners who have stopped making progress towards graduation—achieve their college completion goals. The company relies on a team of success coaches to engage with learners and help them reenroll. In 2019,... View Details
- October 2023
- Case
Fixie and Conversational AI Sidekicks
By: Jeffrey J. Bussgang and Carin-Isabel Knoop
In March 2023, Fixie Co-Founder and Chief Architect Matt Welsh and co-founders had the kind of meeting no founders want to have. The president of leading artificial intelligence (AI) research and deployment firm OpenAI, which had catapulted into fame with its ChatGPT... View Details