Filter Results:
(70)
Show Results For
- All HBS Web
(449)
- Faculty Publications (70)
Show Results For
- All HBS Web
(449)
- Faculty Publications (70)
Page 1 of 70
Results →
- 2024
- Working Paper
Webmunk: A New Tool for Studying Online Behavior and Digital Platforms
By: Chiara Farronato, Audrey Fradkin and Chris Karr
Understanding the behavior of users online is important for researchers, policymakers, and private companies alike. But observing online behavior and conducting experiments is difficult without direct access to the user base and software of technology companies. We... View Details
Farronato, Chiara, Audrey Fradkin, and Chris Karr. "Webmunk: A New Tool for Studying Online Behavior and Digital Platforms." NBER Working Paper Series, No. 32694, July 2024.
- 2024
- Working Paper
Winner Take All: Exploiting Asymmetry in Factorial Designs
By: Matthew DosSantos DiSorbo, Iavor I. Bojinov and Fiammetta Menchetti
Researchers and practitioners have embraced factorial experiments to simultaneously test multiple treatments, each with different levels. With the rise of technologies like Generative AI, factorial experimentation has become even more accessible: it is easier than ever... View Details
Keywords: Factorial Designs; Fisher Randomizations; Rank Estimators; Employer Interventions; Causal Inference; Mathematical Methods; Performance Improvement
DosSantos DiSorbo, Matthew, Iavor I. Bojinov, and Fiammetta Menchetti. "Winner Take All: Exploiting Asymmetry in Factorial Designs." Harvard Business School Working Paper, No. 24-075, June 2024.
- 2024
- Working Paper
Business Experiments as Persuasion
By: Orie Shelef, Rebecca Karp and Robert Wuebker
Much of the prior work on experimentation rests upon the assumption that entrepreneurs and managers use—or should optimally adopt—a "scientific approach" to test possible decisions before making them. This paper offers an alternative view of experimental strategy,... View Details
Shelef, Orie, Rebecca Karp, and Robert Wuebker. "Business Experiments as Persuasion." Harvard Business School Working Paper, No. 24-065, March 2024.
- 2023
- Working Paper
An Experimental Design for Anytime-Valid Causal Inference on Multi-Armed Bandits
By: Biyonka Liang and Iavor I. Bojinov
Typically, multi-armed bandit (MAB) experiments are analyzed at the end of the study and thus require the analyst to specify a fixed sample size in advance. However, in many online learning applications, it is advantageous to continuously produce inference on the... View Details
Liang, Biyonka, and Iavor I. Bojinov. "An Experimental Design for Anytime-Valid Causal Inference on Multi-Armed Bandits." Harvard Business School Working Paper, No. 24-057, March 2024.
- 2024
- Working Paper
Design of Panel Experiments with Spatial and Temporal Interference
By: Tu Ni, Iavor Bojinov and Jinglong Zhao
One of the main practical challenges companies face when running experiments (or A/B tests) over a panel is interference, the setting where one experimental unit's treatment assignment at one time period impacts another's outcomes, possibly at the following time... View Details
Keywords: Research
Ni, Tu, Iavor Bojinov, and Jinglong Zhao. "Design of Panel Experiments with Spatial and Temporal Interference." Harvard Business School Working Paper, No. 24-058, March 2024.
- 2023
- Chapter
Malleability Interventions in Intergroup Relations
By: Smadar Cohen-Chen, Amit Goldenberg, James J. Gross and Eran Halperin
One important characteristic of intergroup relations and conflicts is the fact that toxic or violent intergroup relations are often associated with fixed and stable perceptions of various entities, including the ingroup (stable and positive), the outgroup (stable and... View Details
Cohen-Chen, Smadar, Amit Goldenberg, James J. Gross, and Eran Halperin. "Malleability Interventions in Intergroup Relations." Chap. 7 in Psychological Intergroup Interventions: Evidence-based Approaches to Improve Intergroup Relations, by Eran Halperin, Boaz Hameiri, and Rebecca Littman. Routledge, 2023.
- July 2023
- Article
Design and Analysis of Switchback Experiments
By: Iavor I Bojinov, David Simchi-Levi and Jinglong Zhao
In switchback experiments, a firm sequentially exposes an experimental unit to a random treatment, measures its response, and repeats the procedure for several periods to determine which treatment leads to the best outcome. Although practitioners have widely adopted... View Details
Bojinov, Iavor I., David Simchi-Levi, and Jinglong Zhao. "Design and Analysis of Switchback Experiments." Management Science 69, no. 7 (July 2023): 3759–3777.
- 2022
- Article
Data Poisoning Attacks on Off-Policy Evaluation Methods
By: Elita Lobo, Harvineet Singh, Marek Petrik, Cynthia Rudin and Himabindu Lakkaraju
Off-policy Evaluation (OPE) methods are a crucial tool for evaluating policies in high-stakes domains such as healthcare, where exploration is often infeasible, unethical, or expensive. However, the extent to which such methods can be trusted under adversarial threats... View Details
Lobo, Elita, Harvineet Singh, Marek Petrik, Cynthia Rudin, and Himabindu Lakkaraju. "Data Poisoning Attacks on Off-Policy Evaluation Methods." Proceedings of the Conference on Uncertainty in Artificial Intelligence (UAI) 38th (2022): 1264–1274.
- 2022
- Chapter
Redirecting Rawlsian Reasoning Toward the Greater Good
By: Joshua D. Greene, Karen Huang and Max Bazerman
In A Theory of Justice, John Rawls employed the ‘veil of Ignorance’ as a moral reasoning device designed to promote impartial thinking. By imagining the choices of decision-makers who are blind to biasing information, one might see more clearly the organizing... View Details
Greene, Joshua D., Karen Huang, and Max Bazerman. "Redirecting Rawlsian Reasoning Toward the Greater Good." Chap. 15 in The Oxford Handbook of Moral Psychology, edited by Manuel Vargas and John M. Doris, 246–261. Oxford, UK: Oxford University Press, 2022.
- June 2022 (Revised July 2022)
- Technical Note
Causal Inference
This note provides an overview of causal inference for an introductory data science course. First, the note discusses observational studies and confounding variables. Next the note describes how randomized experiments can be used to account for the effect of... View Details
Keywords: Causal Inference; Causality; Experiment; Experimental Design; Data Science; Analytics and Data Science
Bojinov, Iavor I., Michael Parzen, and Paul Hamilton. "Causal Inference." Harvard Business School Technical Note 622-111, June 2022. (Revised July 2022.)
- 2022
- Working Paper
Are Experts Blinded by Feasibility?: Experimental Evidence from a NASA Robotics Challenge
By: Jacqueline N. Lane, Zoe Szajnfarber, Jason Crusan, Michael Menietti and Karim R. Lakhani
Resource allocation decisions play a dominant role in shaping a firm’s technological trajectory and competitive advantage. Recent work indicates that innovative firms and scientific institutions tend to exhibit an anti-novelty bias when evaluating new projects and... View Details
Keywords: Evaluations; Novelty; Feasibility; Field Experiment; Resource Allocation; Technological Innovation; Competitive Advantage; Decision Making
Lane, Jacqueline N., Zoe Szajnfarber, Jason Crusan, Michael Menietti, and Karim R. Lakhani. "Are Experts Blinded by Feasibility? Experimental Evidence from a NASA Robotics Challenge." Harvard Business School Working Paper, No. 22-071, May 2022.
- 2022
- Article
Social Interactivity in Live Video Experiences Reduces Loneliness
By: Benjamin T. Kaveladze, Robert R. Morris, Rosa Victoria Dimitrova-Gammeltoft, Amit Goldenberg, James J. Gross, Judd Antin, Melissa Sandgren and Melissa C. Thomas-Hunt
Background: Loneliness, especially when chronic, can substantially reduce one's quality of life. However, positive social experiences might help to break cycles of loneliness by promoting more prosocial cognitions and behaviors. Internet-mediated live video... View Details
Keywords: Lonelines; Social Connection; Internet-mediated Communication; Experiment; Emotions; Well-being; Interpersonal Communication; Internet
Kaveladze, Benjamin T., Robert R. Morris, Rosa Victoria Dimitrova-Gammeltoft, Amit Goldenberg, James J. Gross, Judd Antin, Melissa Sandgren, and Melissa C. Thomas-Hunt. "Social Interactivity in Live Video Experiences Reduces Loneliness." Frontiers in Digital Health 4:859849 (2022).
- 2022
- Working Paper
Can a Website Bring Unemployment Down? Experimental Evidence from France
By: Aïcha Ben Dhia, Bruno Crépon, Esther Mbih, Louise Paul-Delvaux, Bertille Picard and Vincent Pons
We evaluate the impact of an online platform giving job seekers tips to improve their search and recommendations of new occupations and locations to target, based on their personal data and labor market data. Our experiment used an encouragement design and was... View Details
Keywords: Online Platform; Digital Platform; Unemployment; Encouragement Design; Job Search; Jobs and Positions; Internet and the Web; Well-being; Outcome or Result; Digital Platforms; France
Ben Dhia, Aïcha, Bruno Crépon, Esther Mbih, Louise Paul-Delvaux, Bertille Picard, and Vincent Pons. "Can a Website Bring Unemployment Down? Experimental Evidence from France." NBER Working Paper Series, No. 29914, April 2022.
- January 2022
- Article
Rational Habit Formation: Experimental Evidence from Handwashing in India
By: Reshmaan Hussam, Atonu Rabbani, Giovanni Reggiani and Natalia Rigol
We test the predictions of the rational addiction model, reconceptualized as rational habit formation, in the context of handwashing in rural India. To track handwashing, we design soap dispensers with timed sensors. We test for rational habit formation by informing... View Details
Hussam, Reshmaan, Atonu Rabbani, Giovanni Reggiani, and Natalia Rigol. "Rational Habit Formation: Experimental Evidence from Handwashing in India." American Economic Journal: Applied Economics 14, no. 1 (January 2022): 1–41. (Lead Article.)
- Article
Social Technology: An Interdisciplinary Approach to Improving Care for Older Adults
By: Arthur Kleinman, Hongtu Chen, Sue E. Levkoff, Ann Forsyth, David E. Bloom, Winnie Yip, Tarun Khanna, Conor J. Walsh, David Perry, Ellen W. Seely, Anne S. Kleinman, Yan Zhang, Yuan Wang, Jun Jing, Tianshu Pan, Ning An, Zhenggang Bai, Jiexiu Wang, Qing Liu and Fawwaz Habbal
Population aging is a defining demographic reality of our era. It is associated with an increase in the societal burden of delivering care to older adults with chronic conditions or frailty. How to integrate global population aging and technology development to help... View Details
Keywords: Health Care and Treatment; Age; Service Delivery; Information Technology; Collaborative Innovation and Invention
Kleinman, Arthur, Hongtu Chen, Sue E. Levkoff, Ann Forsyth, David E. Bloom, Winnie Yip, Tarun Khanna, Conor J. Walsh, David Perry, Ellen W. Seely, Anne S. Kleinman, Yan Zhang, Yuan Wang, Jun Jing, Tianshu Pan, Ning An, Zhenggang Bai, Jiexiu Wang, Qing Liu, and Fawwaz Habbal. "Social Technology: An Interdisciplinary Approach to Improving Care for Older Adults." Art. 729149. Frontiers in Public Health 9 (2021).
- July–August 2021
- Article
Surfacing the Submerged State: Operational Transparency Increases Trust in and Engagement with Government
By: Ryan W. Buell, Ethan Porter and Michael I. Norton
Problem definition: As trust in government reaches historic lows, frustration with government performance approaches record highs.
Academic/practical relevance: We propose that in co-productive settings like government services, peoples’ trust and... View Details
Keywords: Government Services; Behavioral Operations; Operational Transparency; Government Administration; Service Operations; Programs; Perception; Attitudes; Behavior; Trust
Buell, Ryan W., Ethan Porter, and Michael I. Norton. "Surfacing the Submerged State: Operational Transparency Increases Trust in and Engagement with Government." Manufacturing & Service Operations Management 23, no. 4 (July–August 2021): 781–802.
- 2021
- Working Paper
Population Interference in Panel Experiments
By: Iavor I Bojinov, Kevin Wu Han and Guillaume Basse
The phenomenon of population interference, where a treatment assigned to one experimental unit affects another experimental unit's outcome, has received considerable attention in standard randomized experiments. The complications produced by population interference in... View Details
Bojinov, Iavor I., Kevin Wu Han, and Guillaume Basse. "Population Interference in Panel Experiments." Harvard Business School Working Paper, No. 21-100, March 2021.
- February 2021
- Tutorial
Getting Started in RStudio Cloud
By: Chiara Farronato and Caleb Kwon
This video provides an introduction to the free programming language R using an online cloud version of RStudio, which is the most popular editor and interface for writing and executing R code. The video begins by providing a brief background of R and RStudio and... View Details
- February 2021
- Tutorial
T-tests: Theory and Practice
This video provides an introduction to hypothesis testing, sampling, t-tests, and p-values. It provides examples of A/B testing and t-testing to assess whether difference between two groups are statistically significant. This video can be assigned in conjunction with... View Details
- September 2020 (Revised June 2023)
- Exercise
Artea: Designing Targeting Strategies
By: Eva Ascarza and Ayelet Israeli
This collection of exercises aims to teach students about 1)Targeting Policies; and 2)Algorithmic bias in marketing—implications, causes, and possible solutions. Part (A) focuses on A/B testing analysis and targeting. Parts (B),(C),(D) Introduce algorithmic bias. The... View Details
Keywords: Algorithmic Data; Race And Ethnicity; Experimentation; Promotion; "Marketing Analytics"; Marketing And Society; Big Data; Privacy; Data-driven Management; Data Analytics; Data Analysis; E-Commerce Strategy; Discrimination; Targeted Advertising; Targeted Policies; Targeting; Pricing Algorithms; A/B Testing; Ethical Decision Making; Customer Base Analysis; Customer Heterogeneity; Coupons; Algorithmic Bias; Marketing; Race; Gender; Diversity; Customer Relationship Management; Marketing Communications; Advertising; Decision Making; Ethics; E-commerce; Analytics and Data Science; Retail Industry; Apparel and Accessories Industry; United States
Ascarza, Eva, and Ayelet Israeli. "Artea: Designing Targeting Strategies." Harvard Business School Exercise 521-021, September 2020. (Revised June 2023.)