Publications
Publications
Show Results For
- All HBS Web
(102)
- Faculty Publications (26)
Page 1 of 26
Results →
- March 2024
- Case
Unintended Consequences of Algorithmic Personalization
By: Eva Ascarza and Ayelet Israeli
“Unintended Consequences of Algorithmic Personalization” (HBS No. 524-052) investigates algorithmic bias in marketing through four case studies featuring Apple, Uber, Facebook, and Amazon. Each study presents scenarios where these companies faced public criticism for... View Details
- February 2024
- Module Note
Data-Driven Marketing in Retail Markets
By: Ayelet Israeli
This note describes an eight-class sessions module on data-driven marketing in retail markets. The module aims to familiarize students with core concepts of data-driven marketing in retail, including exploring the opportunities and challenges, adopting best practices,... View Details
Keywords: Data; Data Analytics; Retail; Retail Analytics; Data Science; Business Analytics; ＂Marketing Analytics＂; Omnichannel; Omnichannel Retailing; Omnichannel Retail; DTC; Direct To Consumer Marketing; Ethical Decision Making; Algorithmic Bias; Privacy; A/B Testing; Descriptive Analytics; Prescriptive Analytics; Predictive Analytics; Analytics and Data Science; E-commerce; Marketing Channels; Demand and Consumers; Marketing Strategy; Retail Industry
- 2024
- Working Paper
Warnings and Endorsements: Improving Human-AI Collaboration Under Covariate Shift
By: Matthew DosSantos DiSorbo and Kris Ferreira
Problem definition: While artificial intelligence (AI) algorithms may perform well on data that are representative of the training set (inliers), they may err when extrapolating on non-representative data (outliers). These outliers often originate from covariate shift,... View Details
- September 29, 2023
- Article
Eliminating Algorithmic Bias Is Just the Beginning of Equitable AI
By: Simon Friis and James Riley
When it comes to artificial intelligence and inequality, algorithmic bias rightly receives a lot of attention. But it’s just one way that AI can lead to inequitable outcomes. To truly create equitable AI, we need to consider three forces through which it might make... View Details
- June 2023
- Simulation
Artea Dashboard and Targeting Policy Evaluation
By: Ayelet Israeli and Eva Ascarza
Companies deploy A/B experiments to gain valuable insights about their customers in order to answer strategic business problems. In marketing, A/B tests are often used to evaluate marketing interventions intended to generate incremental outcomes for the firm. The Artea... View Details
Keywords: Algorithm Bias; Algorithmic Data; Race And Ethnicity; Experimentation; Promotion; Marketing And Society; Big Data; Privacy; Data-driven Management; Data Analysis; Data Analytics; E-Commerce Strategy; Discrimination; Targeted Advertising; Targeted Policies; Pricing Algorithms; A/B Testing; Ethical Decision Making; Customer Base Analysis; Customer Heterogeneity; Coupons; Marketing; Race; Gender; Diversity; Customer Relationship Management; Marketing Communications; Advertising; Decision Making; Ethics; E-commerce; Analytics and Data Science; Retail Industry; Apparel and Accessories Industry; United States
- 2023
- Working Paper
Insufficiently Justified Disparate Impact: A New Criterion for Subgroup Fairness
By: Neil Menghani, Edward McFowland III and Daniel B. Neill
In this paper, we develop a new criterion, "insufficiently justified disparate impact" (IJDI), for assessing whether recommendations (binarized predictions) made by an algorithmic decision support tool are fair. Our novel, utility-based IJDI criterion evaluates false... View Details
- 2023
- Working Paper
The Limits of Algorithmic Measures of Race in Studies of Outcome Disparities
By: David S. Scharfstein and Sergey Chernenko
We show that the use of algorithms to predict race has significant limitations in measuring and understanding the sources of racial disparities in finance, economics, and other contexts. First, we derive theoretically the direction and magnitude of measurement bias in... View Details
- October–December 2022
- Article
Achieving Reliable Causal Inference with Data-Mined Variables: A Random Forest Approach to the Measurement Error Problem
By: Mochen Yang, Edward McFowland III, Gordon Burtch and Gediminas Adomavicius
Combining machine learning with econometric analysis is becoming increasingly prevalent in both research and practice. A common empirical strategy involves the application of predictive modeling techniques to "mine" variables of interest from available data, followed... View Details
- May 2022 (Revised June 2024)
- Case
LOOP: Driving Change in Auto Insurance Pricing
By: Elie Ofek and Alicia Dadlani
John Henry and Carey Anne Nadeau, co-founders and co-CEOs of LOOP, an insurtech startup based in Austin, Texas, were on a mission to modernize the archaic $250 billion automobile insurance market. They sought to create equitably priced insurance by eliminating pricing... View Details
- Article
Eliminating Unintended Bias in Personalized Policies Using Bias-Eliminating Adapted Trees (BEAT)
By: Eva Ascarza and Ayelet Israeli
An inherent risk of algorithmic personalization is disproportionate targeting of individuals from certain groups (or demographic characteristics such as gender or race), even when the decision maker does not intend to discriminate based on those “protected”... View Details
- September–October 2021
- Article
Frontiers: Can an AI Algorithm Mitigate Racial Economic Inequality? An Analysis in the Context of Airbnb
By: Shunyuan Zhang, Nitin Mehta, Param Singh and Kannan Srinivasan
We study the effect of Airbnb’s smart-pricing algorithm on the racial disparity in the daily revenue earned by Airbnb hosts. Our empirical strategy exploits Airbnb’s introduction of the algorithm and its voluntary adoption by hosts as a quasi-natural experiment. Among... View Details
- September 17, 2021
- Article
AI Can Help Address Inequity—If Companies Earn Users' Trust
By: Shunyuan Zhang, Kannan Srinivasan, Param Singh and Nitin Mehta
While companies may spend a lot of time testing models before launch, many spend too little time considering how they will work in the wild. In particular, they fail to fully consider how rates of adoption can warp developers’ intent. For instance, Airbnb launched a... View Details
- March 2021
- Supplement
Artea (A), (B), (C), and (D): Designing Targeting Strategies
By: Eva Ascarza and Ayelet Israeli
Power Point Supplement to Teaching Note for HBS No. 521-021,521-022,521-037,521-043. This collection of exercises aims to teach students about 1)Targeting Policies; and 2)Algorithmic bias in marketing—implications, causes, and possible solutions. Part (A) focuses on... View Details
Keywords: Targeted Advertising; Targeting; Algorithmic Data; Bias; A/B Testing; Experiment; Advertising; Gender; Race; Diversity; Marketing; Customer Relationship Management; Prejudice and Bias; Analytics and Data Science; Retail Industry; Apparel and Accessories Industry; Technology Industry; United States
- September 2020 (Revised July 2022)
- Teaching Note
Algorithmic Bias in Marketing
By: Ayelet Israeli and Eva Ascarza
Teaching Note for HBS No. 521-020. This note focuses on algorithmic bias in marketing. First, it presents a variety of marketing examples in which algorithmic bias may occur. The examples are organized around the 4 P’s of marketing – promotion, price, place and... View Details
- September 2020 (Revised July 2022)
- Technical Note
Algorithmic Bias in Marketing
By: Ayelet Israeli and Eva Ascarza
This note focuses on algorithmic bias in marketing. First, it presents a variety of marketing examples in which algorithmic bias may occur. The examples are organized around the 4 P’s of marketing – promotion, price, place and product—characterizing the marketing... View Details
Keywords: Algorithmic Data; Race And Ethnicity; Promotion; ＂Marketing Analytics＂; Marketing And Society; Big Data; Privacy; Data-driven Management; Data Analysis; Data Analytics; E-Commerce Strategy; Discrimination; Targeting; Targeted Advertising; Pricing Algorithms; Ethical Decision Making; Customer Heterogeneity; Marketing; Race; Ethnicity; Gender; Diversity; Prejudice and Bias; Marketing Communications; Analytics and Data Science; Analysis; Decision Making; Ethics; Customer Relationship Management; E-commerce; Retail Industry; Apparel and Accessories Industry; United States
- September 2020 (Revised February 2024)
- Teaching Note
Artea (A), (B), (C), and (D): Designing Targeting Strategies
By: Eva Ascarza and Ayelet Israeli
Teaching Note for HBS No. 521-021,521-022,521-037,521-043. This collection of exercises aims to teach students about 1)Targeting Policies; and 2)Algorithmic bias in marketing—implications, causes, and possible solutions. Part (A) focuses on A/B testing analysis and... View Details
- September 2020 (Revised July 2022)
- Exercise
Artea (B): Including Customer-Level Demographic Data
By: Eva Ascarza and Ayelet Israeli
This collection of exercises aims to teach students about 1)Targeting Policies; and 2)Algorithmic bias in marketing—implications, causes, and possible solutions. Part (A) focuses on A/B testing analysis and targeting. Parts (B),(C),(D) Introduce algorithmic bias. The... View Details
- September 2020 (Revised July 2022)
- Exercise
Artea (C): Potential Discrimination through Algorithmic Targeting
By: Eva Ascarza and Ayelet Israeli
This collection of exercises aims to teach students about 1)Targeting Policies; and 2)Algorithmic bias in marketing—implications, causes, and possible solutions. Part (A) focuses on A/B testing analysis and targeting. Parts (B),(C),(D) Introduce algorithmic bias. The... View Details
- September 2020 (Revised July 2022)
- Exercise
Artea (D): Discrimination through Algorithmic Bias in Targeting
By: Eva Ascarza and Ayelet Israeli
This collection of exercises aims to teach students about 1)Targeting Policies; and 2)Algorithmic bias in marketing—implications, causes, and possible solutions. Part (A) focuses on A/B testing analysis and targeting. Parts (B),(C),(D) Introduce algorithmic bias. The... View Details
- September 2020 (Revised June 2023)
- Exercise
Artea: Designing Targeting Strategies
By: Eva Ascarza and Ayelet Israeli
This collection of exercises aims to teach students about 1)Targeting Policies; and 2)Algorithmic bias in marketing—implications, causes, and possible solutions. Part (A) focuses on A/B testing analysis and targeting. Parts (B),(C),(D) Introduce algorithmic bias. The... View Details
Keywords: Algorithmic Data; Race And Ethnicity; Experimentation; Promotion; ＂Marketing Analytics＂; Marketing And Society; Big Data; Privacy; Data-driven Management; Data Analytics; Data Analysis; E-Commerce Strategy; Discrimination; Targeted Advertising; Targeted Policies; Targeting; Pricing Algorithms; A/B Testing; Ethical Decision Making; Customer Base Analysis; Customer Heterogeneity; Coupons; Algorithmic Bias; Marketing; Race; Gender; Diversity; Customer Relationship Management; Marketing Communications; Advertising; Decision Making; Ethics; E-commerce; Analytics and Data Science; Retail Industry; Apparel and Accessories Industry; United States