Publications
Publications
Show Results For
- All HBS Web
(1,135)
- Faculty Publications (225)
- June 2023
- Simulation
Artea Dashboard and Targeting Policy Evaluation
By: Ayelet Israeli and Eva Ascarza
Companies deploy A/B experiments to gain valuable insights about their customers in order to answer strategic business problems. In marketing, A/B tests are often used to evaluate marketing interventions intended to generate incremental outcomes for the firm. The Artea... View Details
Keywords: Algorithm Bias; Algorithmic Data; Race And Ethnicity; Experimentation; Promotion; Marketing And Society; Big Data; Privacy; Data-driven Management; Data Analysis; Data Analytics; E-Commerce Strategy; Discrimination; Targeted Advertising; Targeted Policies; Pricing Algorithms; A/B Testing; Ethical Decision Making; Customer Base Analysis; Customer Heterogeneity; Coupons; Marketing; Race; Gender; Diversity; Customer Relationship Management; Marketing Communications; Advertising; Decision Making; Ethics; E-commerce; Analytics and Data Science; Retail Industry; Apparel and Accessories Industry; United States
- 2023
- Working Paper
Insufficiently Justified Disparate Impact: A New Criterion for Subgroup Fairness
By: Neil Menghani, Edward McFowland III and Daniel B. Neill
In this paper, we develop a new criterion, "insufficiently justified disparate impact" (IJDI), for assessing whether recommendations (binarized predictions) made by an algorithmic decision support tool are fair. Our novel, utility-based IJDI criterion evaluates false... View Details
- 2023
- Working Paper
Design-Based Confidence Sequences: A General Approach to Risk Mitigation in Online Experimentation
By: Dae Woong Ham, Michael Lindon, Martin Tingley and Iavor Bojinov
Randomized experiments have become the standard method for companies to evaluate the performance of new products or services. In addition to augmenting managers’ decision-making, experimentation mitigates risk by limiting the proportion of customers exposed to... View Details
- 2023
- Working Paper
PRIMO: Private Regression in Multiple Outcomes
By: Seth Neel
We introduce a new differentially private regression setting we call Private Regression in Multiple Outcomes (PRIMO), inspired the common situation where a data analyst wants to perform a set of l regressions while preserving privacy, where the covariates... View Details
- 2023
- Working Paper
Nailing Prediction: Experimental Evidence on the Value of Tools in Predictive Model Development
By: Daniel Yue, Paul Hamilton and Iavor Bojinov
Predictive model development is understudied despite its centrality in modern artificial
intelligence and machine learning business applications. Although prior discussions
highlight advances in methods (along the dimensions of data, computing power, and
algorithms)... View Details
Keywords: Analytics and Data Science
- 2022
- Working Paper
Stories, Statistics and Memory
By: Thomas Graeber, Christopher Roth and Florian Zimmermann
For most decisions, we rely on information encountered over the course of days,
months or years. We consume this information in various forms, including abstract
summaries of multiple data points – statistics – and contextualized anecdotes about
individual instances... View Details
- September 16, 2022
- Article
A Causal Test of the Strength of Weak Ties
By: Karthik Rajkumar, Guillaume Saint-Jacques, Iavor I. Bojinov, Erik Brynjolfsson and Sinan Aral
The authors analyzed data from multiple large-scale randomized experiments on LinkedIn’s People You May Know algorithm, which recommends new connections to LinkedIn members, to test the extent to which weak ties increased job mobility in the world’s largest... View Details
- September 2022
- Article
Tone at the Bottom: Measuring Corporate Misconduct Risk from the Text of Employee Reviews
By: Dennis W. Campbell and Ruidi Shang
This paper examines whether information extracted via text-based statistical methods applied to employee reviews left on the website Glassdoor.com can be used to develop indicators of corporate misconduct risk. We argue that inside information on the incidence of... View Details
- August 29, 2022
- Other Article
Income Inequality Is Rising. Are We Even Measuring It Correctly?
By: Jon M. Jachimowicz, K. Blesch and Oliver P. Hauser
Income inequality is on the rise in many countries around the world, according to the United Nations. What’s more, disparities in global income were exacerbated by the COVID-19 pandemic, with some countries facing greater economic losses than others.
Policymakers... View Details
- August 2022
- Supplement
Zalora: Data-Driven Pricing Recommendations
By: Ayelet Israeli
This exercise can be used in conjunction with the main case "Zalora: Data-Driven Pricing" to facilitate class discussion without requiring data analysis from the students. Instead, the exercise presents reports that were created by the data science team to answer the... View Details
Keywords: Pricing; Pricing Algorithms; Dynamic Pricing; Ecommerce; Pricing Strategy; Pricing And Revenue Management; Apparel; Singapore; Startup; Demand Estimation; Data Analysis; Data Analytics; Exercise; Price; Internet and the Web; Apparel and Accessories Industry; Retail Industry; Fashion Industry; Singapore
- 2022
- Article
Data Poisoning Attacks on Off-Policy Evaluation Methods
By: Elita Lobo, Harvineet Singh, Marek Petrik, Cynthia Rudin and Himabindu Lakkaraju
Off-policy Evaluation (OPE) methods are a crucial tool for evaluating policies in high-stakes domains such as healthcare, where exploration is often infeasible, unethical, or expensive. However, the extent to which such methods can be trusted under adversarial threats... View Details
- 2022
- Article
Nonparametric Subset Scanning for Detection of Heteroscedasticity
By: Charles R. Doss and Edward McFowland III
We propose Heteroscedastic Subset Scan (HSS), a novel method for identifying covariates that are responsible for violations of the homoscedasticity assumption in regression settings. Viewing the problem as one of anomalous pattern detection, we use subset scanning... View Details
- 2022
- Working Paper
Causal Inference During A Pandemic: Evidence on the Effectiveness of Nebulized Ibuprofen as an Unproven Treatment for COVID-19 in Argentina
By: Sebastian Calonico, Rafael Di Tella and Juan Cruz Lopez Del Valle
Many medical decisions during the pandemic were made without the support of causal evidence obtained in clinical trials. We study the case of nebulized ibuprofen (NaIHS), a drug that was extensively used on COVID-19 patients in Argentina amidst wild claims about its... View Details
- Article
Do the Right Firms Survive Bankruptcy?
By: Samuel Antill
In U.S. Chapter 11 bankruptcy cases, firms are either reorganized, acquired, or liquidated. I show that decisions to liquidate often reduce creditor recovery, costing creditors billions of dollars every year. I exploit the within-district random assignment of... View Details
- April–June 2022
- Other Article
Commentary on 'Causal Decision Making and Causal Effect Estimation Are Not the Same... and Why It Matters'
There has been a substantial discussion in various methodological and applied literatures around causal inference; especially in the use of machine learning and statistical models to understand heterogeneity in treatment effects and to make optimal decision... View Details
- March 2022 (Revised January 2025)
- Technical Note
Exploratory Data Analysis
This module note provides an overview of exploratory data analysis for an introduction to data science course. It begins by defining the term "data", and then describes the different types of data that companies work with (structured v. unstructured, categorical v.... View Details
- March 2022 (Revised January 2025)
- Technical Note
Prediction & Machine Learning
This note provides an introduction to machine learning for an introductory data science course. The note begins with a description of supervised, unsupervised, and reinforcement learning. Then, the note provides a brief explanation of the difference between traditional... View Details
- March 2022 (Revised January 2025)
- Technical Note
Statistical Inference
This note provides an overview of statistical inference for an introductory data science course. First, the note discusses samples and populations. Next the note describes how to calculate confidence intervals for means and proportions. Then it walks through the logic... View Details
- March 2022
- Article
Assessing the Impact of the COVID-19 Pandemic on Clinician Ambulatory Electronic Health Record Use
By: A Jay Holmgren, Lance Downing, Mitchell Tang, Christopher Sharp, Christopher Longhurst and Robert S. Huckman
Objective: The COVID-19 pandemic changed clinician electronic health record (EHR) work in a multitude of ways. To evaluate how, we measure ambulatory clinician EHR use in the United States throughout the COVID-19 pandemic.
Materials and Methods: We use EHR... View Details
Materials and Methods: We use EHR... View Details
- January 10, 2022
- Article
The Link Between Income, Income Inequality, and Prosocial Behavior Around the World: A Multiverse Approach
By: Lucia Macchia and Ashley V. Whillans
The questions of whether high-income individuals are more prosocial than low-income individuals and whether income inequality moderates this effect have received extensive attention. We shed new light on this topic by analyzing a large-scale dataset with a... View Details