Publications
Publications
Show Results For
- All HBS Web
(6,905)
- Faculty Publications (1,887)
- 2023
- Article
Benchmarking Large Language Models on CMExam—A Comprehensive Chinese Medical Exam Dataset
By: Junling Liu, Peilin Zhou, Yining Hua, Dading Chong, Zhongyu Tian, Andrew Liu, Helin Wang, Chenyu You, Zhenhua Guo, Lei Zhu and Michael Lingzhi Li
Recent advancements in large language models (LLMs) have transformed the field of question answering (QA). However, evaluating LLMs in the medical field is challenging due to the lack of standardized and comprehensive datasets. To address this gap, we introduce CMExam,... View Details
- 2023
- Book
Beyond AI: ChatGPT, Web3, and the Business Landscape of Tomorrow
By: Ken Huang, Yang Wang, Feng Zhu, Xi Chen and Chunxiao Xing
This book explores the transformative potential of ChatGPT, Web3, and their impact on productivity and various industries. It delves into Generative AI (GenAI) and its representative platform ChatGPT, their synergy with Web3, and how they can revolutionize business... View Details
- September 2023
- Article
Customer Churn and Intangible Capital
By: Scott R. Baker, Brian Baugh and Marco Sammon
Intangible capital is a crucial and growing piece of firms’ capital structure, but many of its distinct components are difficult to measure. We develop and make available several new firm-level metrics regarding a key component of intangible capital – firms’ customer... View Details
- 2023
- Article
M4: A Unified XAI Benchmark for Faithfulness Evaluation of Feature Attribution Methods across Metrics, Modalities, and Models
By: Himabindu Lakkaraju, Xuhong Li, Mengnan Du, Jiamin Chen, Yekun Chai and Haoyi Xiong
While Explainable Artificial Intelligence (XAI) techniques have been widely studied to explain predictions made by deep neural networks, the way to evaluate the faithfulness of explanation results remains challenging, due to the heterogeneity of explanations for... View Details
Keywords: AI and Machine Learning
- 2023
- Article
MoPe: Model Perturbation-based Privacy Attacks on Language Models
By: Marvin Li, Jason Wang, Jeffrey Wang and Seth Neel
Recent work has shown that Large Language Models (LLMs) can unintentionally leak sensitive information present in their training data. In this paper, we present Model Perturbations (MoPe), a new method to identify with high confidence if a given text is in the training... View Details
- 2023
- Other Article
The Harvard USPTO Patent Dataset: A Large-Scale, Well-Structured, and Multi-Purpose Corpus of Patent Applications
By: Mirac Suzgun, Luke Melas-Kyriazi, Suproteem K. Sarkar, Scott Duke Kominers and Stuart Shieber
Innovation is a major driver of economic and social development, and information about many kinds of innovation is embedded in semi-structured data from patents and patent applications. Though the impact and novelty of innovations expressed in patent data are difficult... View Details
- December 2023
- Article
What Can Stockouts Tell Us About Inflation? Evidence from Online Micro Data
By: Alberto Cavallo and Oleksiy Kryvtsov
We use a detailed micro dataset on product availability and stockouts to construct a direct high-frequency measure of consumer product shortages during the 2020-2022 pandemic. We document a widespread multi-fold rise in stockouts in nearly all sectors early in the... View Details
- December 2023
- Article
When Should the Off-Grid Sun Shine at Night? Optimum Renewable Generation and Energy Storage Investments
By: Christian Kaps, Simone Marinesi and Serguei Netessine
Globally, 1.5 billion people live off the grid, their only access to electricity often limited to operationally-expensive fossil fuel generators. Solar power has risen as a sustainable and less costly option, but its generation is variable during the day and... View Details
- 2023
- Article
Which Models Have Perceptually-Aligned Gradients? An Explanation via Off-Manifold Robustness
By: Suraj Srinivas, Sebastian Bordt and Himabindu Lakkaraju
One of the remarkable properties of robust computer vision models is that their input-gradients are often aligned with human perception, referred to in the literature as perceptually-aligned gradients (PAGs). Despite only being trained for classification, PAGs cause... View Details
- November 2023 (Revised March 2024)
- Technical Note
Customer Data Privacy
By: Eva Ascarza and Ta-Wei Huang
This note provides an overview of the evolving landscape of customer data privacy in 2023. It highlights two pivotal aspects that make privacy a central concern for businesses: building and maintaining customer trust and navigating the intricate regulatory... View Details
- 2023
- Working Paper
Learning by Investing: Entrepreneurial Spillovers from Venture Capital
By: Josh Lerner, Jinlin Li and Tong Liu
This paper studies how investing in venture capital (VC) affects the entrepreneurial outcomes of individual limited partners (LPs). Using comprehensive administrative data on entrepreneurial activities and VC fundraising and investments in China, we first document that... View Details
- 2023
- Working Paper
Flow-Driven ESG Returns
I show that the recent returns to ESG investing are strongly driven by price impact
from flows towards ESG funds. Using data on institutional trades, I estimate the
market’s ability to accommodate the demand of ESG funds, which is given by the
elasticity of... View Details
- November–December 2023
- Article
Look the Part? The Role of Profile Pictures in Online Labor Markets
By: Isamar Troncoso and Lan Luo
Profile pictures are a key component of many freelancing platforms, a design choice that can impact hiring and matching outcomes. In this paper, we examine how appearance-based perceptions of a freelancer’s fit for the job (i.e., whether a freelancer "looks the part"... View Details
- 2024
- Working Paper
What Do Impact Investors Do Differently?
In recent years, impact investors – private investors who seek to generate simultaneously financial and social returns – have attracted intense interest and controversy. We analyze a novel, comprehensive data set of impact and traditional investors to assess how the... View Details
- October 2023 (Revised April 2024)
- Case
Veeva Systems: The Next Frontier
By: Satish Tadikonda and William Marks
Born out of a desire to bring technological advances in enterprise software into the healthcare vertical, Peter Gassner and Matt Wallach founded Veeva to bring life sciences companies into the digital age for data management in both the commercial and R&D sectors. Over... View Details
- October 2023 (Revised April 2024)
- Case
TetraScience: Unlocking the Power of Scientific Data
By: Satish Tadikonda and William Marks
After pivoting from a focus on hardware to a focus on scientific data, TetraScience, led by veteran SaaS executive, Patrick Grady and Founder Spin Wang, has embarked on a journey from nearly cash-out to a player in the scientific data management space. This case... View Details
- 2023
- Working Paper
The Political Economy of a 'Miracle Cure': The Case of Nebulized Ibuprofen and Its Diffusion in Argentina
By: Sebastian Calónico, Rafael Di Tella and Juan Cruz Lopez Del Valle
We document the diffusion of nebulized ibuprofen in Argentina as a treatment for COVID-19. As the pandemic spread, this clinically unsupported drug reached thousands of patients, even some seriously ill, despite warnings by the regulator and medical societies. Detailed... View Details
- October 2023 (Revised February 2024)
- Technical Note
Design and Evaluation of Targeted Interventions
By: Eva Ascarza and Ta-Wei (David) Huang
Targeted interventions serve as a pivotal tool in business strategy, streamlining decisions for enhanced efficiency and effectiveness. This note delves into two central facets of such interventions: first, the design of potent decision guidelines, or targeting... View Details
- October–December 2023
- Article
A Practical Guide to Conversation Research: How to Study What People Say to Each Other
By: Michael Yeomans, Katelynn Boland, Hanne K. Collins, Nicole Abi-Esber and Alison Wood Brooks
Conversation—a verbal interaction between two or more people—is a complex, pervasive, and consequential human behavior. Conversations have been studied across many academic disciplines. However, advances in recording and analysis techniques over the last decade have... View Details
- 2023
- Working Paper
Black-box Training Data Identification in GANs via Detector Networks
By: Lukman Olagoke, Salil Vadhan and Seth Neel
Since their inception Generative Adversarial Networks (GANs) have been popular generative models across images, audio, video, and tabular data. In this paper we study whether given access to a trained GAN, as well as fresh samples from the underlying distribution, if... View Details