Publications
Publications
Show Results For
- All HBS Web
(118,467)
- Faculty Publications (57)
- 2023
- Article
Balancing Risk and Reward: An Automated Phased Release Strategy
By: Yufan Li, Jialiang Mao and Iavor Bojinov
Phased releases are a common strategy in the technology industry for gradually releasing new products or updates through a sequence of A/B tests in which the number of treated units gradually grows until full deployment or deprecation. Performing phased releases in a... View Details
- November–December 2023
- Article
Keep Your AI Projects on Track
By: Iavor Bojinov
AI—and especially its newest star, generative AI—is today a central theme in corporate boardrooms, leadership discussions, and casual exchanges among employees eager to supercharge their productivity. Sadly, beneath the aspirational headlines and tantalizing potential... View Details
- July 2023
- Article
Design and Analysis of Switchback Experiments
By: Iavor I Bojinov, David Simchi-Levi and Jinglong Zhao
In switchback experiments, a firm sequentially exposes an experimental unit to a random treatment, measures its response, and repeats the procedure for several periods to determine which treatment leads to the best outcome. Although practitioners have widely adopted... View Details
- 2023
- Working Paper
Design-Based Confidence Sequences: A General Approach to Risk Mitigation in Online Experimentation
By: Dae Woong Ham, Michael Lindon, Martin Tingley and Iavor Bojinov
Randomized experiments have become the standard method for companies to evaluate the performance of new products or services. In addition to augmenting managers’ decision-making, experimentation mitigates risk by limiting the proportion of customers exposed to... View Details
- 2023
- Working Paper
Nailing Prediction: Experimental Evidence on the Value of Tools in Predictive Model Development
By: Daniel Yue, Paul Hamilton and Iavor Bojinov
Predictive model development is understudied despite its centrality in modern artificial
intelligence and machine learning business applications. Although prior discussions
highlight advances in methods (along the dimensions of data, computing power, and
algorithms)... View Details
Keywords: Analytics and Data Science
- December 1, 2022
- Article
Which Connections Really Help You Find a Job?
By: Iavor I. Bojinov, Karthik Rajkumar, Guillaume Saint-Jacques, Erik Brynjolfsson and Sinan Aral
Experiments involving 20 million people generated a surprising finding: moderately weak connects — and not strong connections — are the most useful in finding a new job. To be more specific, the ties that are most helpful for finding new jobs tend to be moderately... View Details
- October 2022 (Revised January 2025)
- Case
On Ramp to Crypto
- September 16, 2022
- Article
A Causal Test of the Strength of Weak Ties
By: Karthik Rajkumar, Guillaume Saint-Jacques, Iavor I. Bojinov, Erik Brynjolfsson and Sinan Aral
The authors analyzed data from multiple large-scale randomized experiments on LinkedIn’s People You May Know algorithm, which recommends new connections to LinkedIn members, to test the extent to which weak ties increased job mobility in the world’s largest... View Details
- September 2022 (Revised July 2023)
- Case
Data Privacy in Practice at LinkedIn
- Article
Online Experimentation: Benefits, Operational and Methodological Challenges, and Scaling Guide
By: Iavor Bojinov and Somit Gupta
In the past decade, online controlled experimentation, or A/B testing, at scale has proved to be a significant driver of business innovation. The practice was first pioneered by the technology sector and, more recently, has been adopted by traditional companies... View Details
- June 2022 (Revised January 2025)
- Technical Note
Causal Inference
This note provides an overview of causal inference for an introductory data science course. First, the note discusses observational studies and confounding variables. Next the note describes how randomized experiments can be used to account for the effect of... View Details
- March 2022 (Revised January 2025)
- Technical Note
Exploratory Data Analysis
This module note provides an overview of exploratory data analysis for an introduction to data science course. It begins by defining the term "data", and then describes the different types of data that companies work with (structured v. unstructured, categorical v.... View Details
- March 2022 (Revised January 2025)
- Technical Note
Linear Regression
This note provides an overview of linear regression for an introductory data science course. It begins with a discussion of correlation, and explains why correlation does not necessarily imply causation. The note then describes the method of least squares, and how to... View Details
- March 2022 (Revised January 2025)
- Technical Note
Prediction & Machine Learning
This note provides an introduction to machine learning for an introductory data science course. The note begins with a description of supervised, unsupervised, and reinforcement learning. Then, the note provides a brief explanation of the difference between traditional... View Details
- March 2022 (Revised January 2025)
- Technical Note
Statistical Inference
This note provides an overview of statistical inference for an introductory data science course. First, the note discusses samples and populations. Next the note describes how to calculate confidence intervals for means and proportions. Then it walks through the logic... View Details
- March 2022
- Article
Estimating the Effectiveness of Permanent Price Reductions for Competing Products Using Multivariate Bayesian Structural Time Series Models
By: Fiammetta Menchetti and Iavor Bojinov
Researchers regularly use synthetic control methods for estimating causal effects when a sub-set of units receive a single persistent treatment, and the rest are unaffected by the change. In many applications, however, units not assigned to treatment are nevertheless... View Details
- November 2021
- Article
Panel Experiments and Dynamic Causal Effects: A Finite Population Perspective
By: Iavor Bojinov, Ashesh Rambachan and Neil Shephard
In panel experiments, we randomly assign units to different interventions, measuring their outcomes, and repeating the procedure in several periods. Using the potential outcomes framework, we define finite population dynamic causal effects that capture the relative... View Details
- August 2021 (Revised February 2024)
- Case
Data Science at the Warriors
By: Iavor I. Bojinov and Michael Parzen
The case explores the development and early growth of a data science team at the Golden State Warriors, an NBA team based in San Francisco. The case begins by explaining the initial rationale for investing in data science, then covers a debate on the appropriate team... View Details
- August 2021
- Case
Orchadio's First Two Split Experiments
By: Iavor I. Bojinov, Marco Iansiti and David Lane
Orchadio, a direct-to-consumer grocery business, needs to conduct its first two A/B tests—one to evaluate the effectiveness and functioning of its newly redesigned website, and one to market-test four versions of a new banner for the website. To do so, it will rely on... View Details
Keywords: Information Management; Technological Innovation; Knowledge Use and Leverage; Resource Allocation; Marketing; Measurement and Metrics; Customization and Personalization; Information Technology; Internet and the Web; Digital Platforms; Information Technology Industry; Food and Beverage Industry
- August 2021
- Case
Precision Paint Co.
Describes a marketing director about to launch a new process for demand forecasting. Provides data that allow students to do a multivariable regression analysis. A rewritten version of an earlier case. View Details