Publications
Publications
Show Results For
- All HBS Web
(1,186)
- Faculty Publications (328)
- 2021
- Working Paper
Population Interference in Panel Experiments
By: Iavor I Bojinov, Kevin Wu Han and Guillaume Basse
The phenomenon of population interference, where a treatment assigned to one experimental unit affects another experimental unit's outcome, has received considerable attention in standard randomized experiments. The complications produced by population interference in... View Details
- March 2021
- Case
VideaHealth: Building the AI Factory
By: Karim R. Lakhani and Amy Klopfenstein
Florian Hillen, co-founder and CEO of VideaHealth, a startup that used artificial intelligence (AI) to detect dental conditions on x-rays, spent the early years of his company laying the groundwork for an AI factory. A process for quickly building and iterating on new... View Details
Keywords: Artificial Intelligence; Innovation and Invention; Disruptive Innovation; Technological Innovation; Information Technology; Applications and Software; Technology Adoption; Digital Platforms; Entrepreneurship; AI and Machine Learning; Technology Industry; Medical Devices and Supplies Industry; North and Central America; United States; Massachusetts; Cambridge
- February 2021
- Tutorial
Getting Started in RStudio Cloud
By: Chiara Farronato and Caleb Kwon
This video provides an introduction to the free programming language R using an online cloud version of RStudio, which is the most popular editor and interface for writing and executing R code. The video begins by providing a brief background of R and RStudio and... View Details
- February 2021
- Tutorial
T-tests: Theory and Practice
By: Michael Parzen, Natalie Epstein, Chiara Farronato and Michael Toffel
This video provides an introduction to hypothesis testing, sampling, t-tests, and p-values. It provides examples of A/B testing and t-testing to assess whether difference between two groups are statistically significant. This video can be assigned in conjunction with... View Details
- Article
Towards Robust and Reliable Algorithmic Recourse
By: Sohini Upadhyay, Shalmali Joshi and Himabindu Lakkaraju
As predictive models are increasingly being deployed in high-stakes decision making (e.g., loan
approvals), there has been growing interest in post-hoc techniques which provide recourse to affected
individuals. These techniques generate recourses under the assumption... View Details
- December 2020 (Revised March 2024)
- Supplement
Experimentation at Yelp
By: Iavor Bojinov and Karim R. Lakhani
- Article
Beyond Individualized Recourse: Interpretable and Interactive Summaries of Actionable Recourses
By: Kaivalya Rawal and Himabindu Lakkaraju
As predictive models are increasingly being deployed in high-stakes decision-making, there has been a lot of interest in developing algorithms which can provide recourses to affected individuals. While developing such tools is important, it is even more critical to... View Details
- Article
Robust and Stable Black Box Explanations
By: Himabindu Lakkaraju, Nino Arsov and Osbert Bastani
As machine learning black boxes are increasingly being deployed in real-world applications, there
has been a growing interest in developing post hoc explanations that summarize the behaviors
of these black boxes. However, existing algorithms for generating such... View Details
- October 2020 (Revised March 2024)
- Case
Experimentation at Yelp
By: Iavor Bojinov and Karim R. Lakhani
Over the last decade, experimentation has become integral to the research and development processes of technology companies—including Yelp—for understanding customer preferences and mitigating innovation risks. The case describes Yelp's journey with experimentation,... View Details
- September 2020 (Revised June 2023)
- Exercise
Artea: Designing Targeting Strategies
By: Eva Ascarza and Ayelet Israeli
This collection of exercises aims to teach students about 1)Targeting Policies; and 2)Algorithmic bias in marketing—implications, causes, and possible solutions. Part (A) focuses on A/B testing analysis and targeting. Parts (B),(C),(D) Introduce algorithmic bias. The... View Details
Keywords: Algorithmic Data; Race And Ethnicity; Experimentation; Promotion; ＂Marketing Analytics＂; Marketing And Society; Big Data; Privacy; Data-driven Management; Data Analytics; Data Analysis; E-Commerce Strategy; Discrimination; Targeted Advertising; Targeted Policies; Targeting; Pricing Algorithms; A/B Testing; Ethical Decision Making; Customer Base Analysis; Customer Heterogeneity; Coupons; Algorithmic Bias; Marketing; Race; Gender; Diversity; Customer Relationship Management; Marketing Communications; Advertising; Decision Making; Ethics; E-commerce; Analytics and Data Science; Retail Industry; Apparel and Accessories Industry; United States
- 2020
- Working Paper
Design and Analysis of Switchback Experiments
By: Iavor I Bojinov, David Simchi-Levi and Jinglong Zhao
In switchback experiments, a firm sequentially exposes an experimental unit to a random treatment, measures its response, and repeats the procedure for several periods to determine which treatment leads to the best outcome. Although practitioners have widely adopted... View Details
- August 2020 (Revised September 2020)
- Technical Note
Assessing Prediction Accuracy of Machine Learning Models
By: Michael W. Toffel, Natalie Epstein, Kris Ferreira and Yael Grushka-Cockayne
The note introduces a variety of methods to assess the accuracy of machine learning prediction models. The note begins by briefly introducing machine learning, overfitting, training versus test datasets, and cross validation. The following accuracy metrics and tools... View Details
- August 2020
- Technical Note
Comparing Two Groups: Sampling and t-Testing
This note describes sampling and t-tests, two fundamental statistical concepts. View Details
- 2020
- Working Paper
What Can Economics Say About Alzheimer's Disease?
By: Amitabh Chandra, Courtney Coile and Corina Mommaerts
Alzheimer’s Disease (AD) affects one in ten people aged 65 or older and is the most expensive disease in the United States. We describe the central economic questions raised by AD. While there is overlap with the economics of aging, the defining features of the... View Details
- Article
The Impact of COVID-19 on Small Business Outcomes and Expectations
By: Alexander Bartik, Marianne Bertrand, Zoë B. Cullen, Edward L. Glaeser, Michael Luca and Christopher Stanton
To explore the impact of COVID on small businesses, we conducted a survey of more than 5,800 small businesses between March 28 and April 4, 2020. Several themes emerged. First, mass layoffs and closures had already occurred—just a few weeks into the crisis. Second, the... View Details
- July 2020 (Revised January 2021)
- Case
Vineet Nayar and Sampark Foundation: Frugal Innovation at Scale (A)
By: Linda A. Hill and Emily Tedards
In 2005, Vineet Nayar, the former CEO and Vice Chairman of HCL Technologies, and his wife, Anupama Nayar, committed $100 million of their personal wealth to found Sampark Foundation — a grant-making philanthropy with a mission to transform learning outcomes for 20... View Details
Keywords: Organizational Behavior; Cultural Change; Digital; Innovation; Experimentation; Metrics; Education Reform; Non-profit; Frugal Innovation; Scale; Ecosystem; Government; Education; Social Enterprise; Leadership; Leading Change; Change Management; Organizational Culture; Innovation Leadership; Nonprofit Organizations; Growth and Development Strategy; Information Technology; Digital Transformation; India
- July 2020 (Revised January 2021)
- Case
Vineet Nayar and Sampark Foundation: Frugal Innovation at Scale (A) (Abridged)
By: Linda A. Hill and Emily Tedards
In 2005, Vineet Nayar, the former CEO and Vice Chairman of HCL Technologies, and his wife, Anupama Nayar, committed $100 million of their personal wealth to found Sampark Foundation—a grant-making philanthropy with a mission to transform learning outcomes for 20... View Details
Keywords: Organizational Behavior; Organizational Alignment; Culture Change; Digital; Innovation; Experimentation; Metrics; Education Reform; Non-profit; Frugal Innovation; Scale; Ecosystem; Government; Education; Social Enterprise; Leadership; Leading Change; Change Management; Organizational Culture; Alignment; Innovation Leadership; Nonprofit Organizations; Growth and Development Strategy; Information Technology; Digital Transformation; India
- July 2020
- Case
Kathy Fish at Procter & Gamble: Navigating Industry Disruption by Disrupting from Within
When Kathy Fish, Procter & Gamble’s Chief Research, Development & Innovation Officer, and a 40-year company veteran, stepped into her role in 2014, she was concerned that the world’s leading consumer packaged goods company had lost its capability to produce a steady... View Details
Keywords: Female Protagonist; Organizational Change; Organizational Behavior; Culture Change; Digital; Innovation; Lean Startup; Experimentation; Metrics; Consumer Packaged Goods (CPG); Leadership; Leading Change; Change Management; Organizational Culture; Organizational Change and Adaptation; Disruption; Innovation and Invention; Digital Transformation
- July 2020
- Article
Higher Economic Inequality Intensifies the Financial Hardship of People Living in Poverty by Fraying the Community Buffer
By: Jon M. Jachimowicz, Barnabas Szaszi, Marcel Lukas, David Smerdon, Jaideep Prabhu and Elke U. Weber
The current research investigates whether higher economic inequality disproportionately intensifies the financial hardship of low-income individuals. We propose that higher economic inequality increases financial hardship for low-income individuals by reducing their... View Details
- July–September 2020
- Article
Innovation Contest: Effect of Perceived Support for Learning on Participation
By: Olivia Jung, Andrea Blasco and Karim R. Lakhani
Background: Frontline staff are well positioned to conceive improvement opportunities based on first-hand knowledge of what works and does not work. The innovation contest may be a relevant and useful vehicle to elicit staff ideas. However, the success of the... View Details