Publications

September 23, 2024
Article

AI Wants to Make You Less Lonely. Does It Work?

By: Julian De Freitas

Keywords: AI and Machine Learning; Well-being

Find at Harvard

2023
Working Paper

Distributionally Robust Causal Inference with Observational Data

By: Dimitris Bertsimas, Kosuke Imai and Michael Lingzhi Li

We consider the estimation of average treatment effects in observational studies and propose a new framework of robust causal inference with unobserved confounders. Our approach is based on distributionally robust optimization and proceeds in two steps. We first... View Details

Keywords: AI and Machine Learning; Mathematical Methods

2024
Working Paper

Displacement or Complementarity? The Labor Market Impact of Generative AI

By: Wilbur Xinyuan Chen, Suraj Srinivasan and Saleh Zakerinia

Generative AI is poised to reshape the labor market, affecting cognitive and white-collar occupations in ways distinct from past technological revolutions. This study examines whether generative AI displaces workers or augments their jobs by analyzing labor demand and... View Details

Keywords: Generative Ai; Labor Market; Automation And Augmentation; Labor; AI and Machine Learning; Competency and Skills

October 2024
Technical Note

Prompt Engineering

By: Michael Parzen and Jo Ellery

This note covers the basics of prompt engineering, a key tool for making use of modern generative AI. We discuss the principles of prompt engineering and illustrate these principles with techniques for asking questions. We further list the types of prompts that can be... View Details

Keywords: Large Language Model; AI and Machine Learning

2023
Article

Benchmarking Large Language Models on CMExam—A Comprehensive Chinese Medical Exam Dataset

By: Junling Liu, Peilin Zhou, Yining Hua, Dading Chong, Zhongyu Tian, Andrew Liu, Helin Wang, Chenyu You, Zhenhua Guo, Lei Zhu and Michael Lingzhi Li

Recent advancements in large language models (LLMs) have transformed the field of question answering (QA). However, evaluating LLMs in the medical field is challenging due to the lack of standardized and comprehensive datasets. To address this gap, we introduce CMExam,... View Details

Keywords: Large Language Model; AI and Machine Learning; Analytics and Data Science; Health Industry

July–August 2021
Article

Why You Aren't Getting More from Your Marketing AI

By: Eva Ascarza, Michael Ross and Bruce G.S. Hardie

Fewer than 40% of companies that invest in AI see gains from it, usually because of one or more of these errors: (1) They don’t ask the right question, and end up directing AI to solve the wrong problem. (2) They don’t recognize the differences between the value of... View Details

Keywords: Artificial Intelligence; Marketing; Decision Making; Communication; Framework; AI and Machine Learning

Find at Harvard

July 2024
Article

AI, ROI, and Sales Productivity

By: Frank V. Cespedes

Artificial intelligence (AI) is now a loose term for many different things and at the peak of its hype curve. So managers hitch-their-pitch to the term in arguing for resources. But like any technology, its business value depends upon actionable use cases embraced by... View Details

Keywords: ROI; AI and Machine Learning; Sales; Investment Return

March 16, 2021
Article

From Driverless Dilemmas to More Practical Commonsense Tests for Automated Vehicles

By: Julian De Freitas, Andrea Censi, Bryant Walker Smith, Luigi Di Lillo, Sam E. Anthony and Emilio Frazzoli

For the first time in history, automated vehicles (AVs) are being deployed in populated environments. This unprecedented transformation of our everyday lives demands a significant undertaking: endowing complex autonomous systems with ethically acceptable behavior. We... View Details

Keywords: Automated Driving; Public Health; Artificial Intelligence; Transportation; Health; Ethics; Policy; AI and Machine Learning

Find at Harvard

2024
Case

EPCorp: Convincing the C-Suite

By: Jacob M. Cook

In EPCorp: Convincing the C-Suite, Shivani Bahl is attempting to sell EPCorp's CEO, Debbie Sullivan, on her ideas for not only a new website upgrade but also a more expansive vision on how data and Generative AI can be used to grow the company. Debbie is understandably... View Details

Keywords: AI and Machine Learning; E-commerce; Growth and Development Strategy

September 2024
Background Note

Copyright and Fair Use

By: David B. Yoffie

The U.S. Copyright Office defines a copyright as “a type of intellectual property that protects original works of authorship as soon as an author fixes the work in a tangible form of expression.” Two core principles of copyright are originality and fixation. A work is... View Details

Keywords: AI and Machine Learning; Copyright; Lawsuits and Litigation; United States

2022
Working Paper

The Evolution of ESG Reports and the Role of Voluntary Standards

By: Ethan Rouen, Kunal Sachdeva and Aaron Yoon

We examine the evolution of ESG reports of S&P 500 firms from 2010 to 2021. The percentage of firms releasing these voluntary disclosures increased from 35% to 86% during this period, although the length of these documents experienced more modest growth. Using a... View Details

Keywords: Voluntary Disclosure; Textual Analysis; Modeling And Analysis; Corporate Social Responsibility and Impact; AI and Machine Learning; Accounting

SSRN

August 25, 2022
Article

Find the Right Pace for Your AI Rollout

By: Rebecca Karp and Aticus Peterson

Implementing AI can introduce disruptive change and disfranchise staff and employees. When members are reluctant to adopt a new technology, they might hesitate to use it, push back against its deployment, or use it in limited capacity — which affects the benefits an... View Details

Keywords: AI and Machine Learning; Technology Adoption; Change Management

Article

Fake AI People Won't Fix Online Dating

By: Scott Duke Kominers

Computer-generated images may inspire even more distrust and surely won’t lead to the love of a lifetime. View Details

Keywords: Artificial Intelligence; Dating Services; Internet and the Web; Ethics; AI and Machine Learning

Working Paper

Shifting Work Patterns with Generative AI

By: Eleanor W. Dillon, Sonia Jaffe, Nicole Immorlica and Christopher T. Stanton

We present evidence on how generative AI changes the work patterns of knowledge workers using data from a 6-month-long, cross-industry, randomized field experiment. Half of the 7,137 workers in the study received access to a generative AI tool integrated into the... View Details

Keywords: AI and Machine Learning; Behavior; Time Management

January 2025
Technical Note

AI vs Human: Analyzing Acceptable Error Rates Using the Confusion Matrix

By: Tsedal Neeley and Tim Englehart

This technical note introduces the confusion matrix as a foundational tool in artificial intelligence (AI) and large language models (LLMs) for assessing the performance of classification models, focusing on their reliability for decision-making. A confusion matrix... View Details

Keywords: Reliability; Confusion Matrix; AI and Machine Learning; Decision Making; Measurement and Metrics; Performance

September 2024
Exercise

Finding Your 'Jagged Frontier': A Generative AI Exercise

By: Mitchell Weiss

In 2023 a set of scholars set out to study the effect of artificial intelligence (AI) on the quality and productivity of knowledge workers—in this specific instance, management consultants. They wanted to know across a range of tasks in a workflow, which, if any, would... View Details

Keywords: AI and Machine Learning; Performance Productivity; Performance Evaluation; Consulting Industry

November 2, 2021
Article

The Cultural Benefits of Artificial Intelligence in the Enterprise

By: Sam Ransbotham, François Candelon, David Kiron, Burt LaFountain and Shervin Khodabandeh

The 2021 MIT SMR-BCG report identifies a wide range of AI-related cultural benefits at both the team and organizational levels. Whether it’s reconsidering business assumptions or empowering teams, managing the dynamics across culture, AI use, and organizational... View Details

Keywords: AI and Machine Learning; Organizational Culture; Performance Effectiveness

Register to Read

20 Oct 2022 - 22 Oct 2022
Talk

Stigma Against AI Companion Applications

By: Julian De Freitas, A. Ragnhildstveit and A.K. Uğuralp

Keywords: AI and Machine Learning; Attitudes; Perception

2025
Article

Humor as a Window into Generative AI Bias

By: Roger Samure, Julian De Freitas and Stefano Puntoni

A preregistered audit of 600 images by generative AI across 150 different prompts explores the link between humor and discrimination in consumer-facing AI solutions. When ChatGPT updates images to make them “funnier”, the prevalence of stereotyped groups changes. While... View Details

Keywords: AI and Machine Learning; Demographics; Prejudice and Bias