Publications
Publications
Show Results For
- All HBS Web
(987)
- Faculty Publications (409)
- 2023
- Article
Evaluating Explainability for Graph Neural Networks
By: Chirag Agarwal, Owen Queen, Himabindu Lakkaraju and Marinka Zitnik
As explanations are increasingly used to understand the behavior of graph neural networks (GNNs), evaluating the quality and reliability of GNN explanations is crucial. However, assessing the quality of GNN explanations is challenging as existing graph datasets have no... View Details
Keywords: Analytics and Data Science
- 2023
- Article
Experimental Evaluation of Individualized Treatment Rules
By: Kosuke Imai and Michael Lingzhi Li
The increasing availability of individual-level data has led to numerous applications of individualized (or personalized) treatment rules (ITRs). Policy makers often wish to empirically evaluate ITRs and compare their relative performance before implementing them in a... View Details
- 2023
- Working Paper
Nailing Prediction: Experimental Evidence on the Value of Tools in Predictive Model Development
By: Daniel Yue, Paul Hamilton and Iavor Bojinov
Predictive model development is understudied despite its centrality in modern artificial
intelligence and machine learning business applications. Although prior discussions
highlight advances in methods (along the dimensions of data, computing power, and
algorithms)... View Details
Keywords: Analytics and Data Science
- 2022
- Article
OpenXAI: Towards a Transparent Evaluation of Model Explanations
By: Chirag Agarwal, Satyapriya Krishna, Eshika Saxena, Martin Pawelczyk, Nari Johnson, Isha Puri, Marinka Zitnik and Himabindu Lakkaraju
While several types of post hoc explanation methods have been proposed in recent literature, there is very little work on systematically benchmarking these methods. Here, we introduce OpenXAI, a comprehensive and extensible opensource framework for evaluating and... View Details
- 2022
- Working Paper
The Limits of Decentralized Administrative Data Collection: Experimental Evidence from Colombia
By: Natalia Garbiras-Diaz and Tara Slough
States collect vast amounts of data for use in policymaking and public administration. To
do so, central governments frequently solicit data from decentralized bureaucrats. Because
central governments use these data in policymaking, decentralized bureaucrats may face... View Details
- December 2022
- Article
The Rise of People Analytics and the Future of Organizational Research
By: Jeff Polzer
Organizations are transforming as they adopt new technologies and use new sources of data, changing the experiences of employees and pushing organizational researchers to respond. As employees perform their daily activities, they generate vast digital data. These data,... View Details
- 2022
- Article
Which Explanation Should I Choose? A Function Approximation Perspective to Characterizing Post hoc Explanations
By: Tessa Han, Suraj Srinivas and Himabindu Lakkaraju
A critical problem in the field of post hoc explainability is the lack of a common foundational goal among methods. For example, some methods are motivated by function approximation, some by game theoretic notions, and some by obtaining clean visualizations. This... View Details
- November–December 2022
- Article
Your Company Needs a Space Strategy. Now.
By: Matthew Weinzierl, Prithwiraj (Raj) Choudhury, Tarun Khanna, Alan MacCormack and Brendan Rosseau
Space is becoming a potential source of value for businesses across a range of sectors, including agriculture, pharmaceuticals, consumer goods, and tourism. To understand what the opportunities are for your company, the authors advise you to consider the four ways in... View Details
- November–December 2022
- Article
The Value of Descriptive Analytics: Evidence from Online Retailers
By: Ron Berman and Ayelet Israeli
Does the adoption of descriptive analytics impact online retailer performance, and if so, how? We use the synthetic difference-in-differences method to analyze the staggered adoption of a retail analytics dashboard by more than 1,500 e-commerce websites, and we find an... View Details
- October 2022
- Supplement
Single Earth: Science White Paper Supplement
By: Rembrand Koning and Emer Moloney
Science White Paper prepared by Single.Earth to give an overview of the models and solutions it has developed. View Details
Keywords: Business Startups; Entrepreneurship; Climate Change; Environmental Sustainability; Green Technology; Natural Resources; Pollution; Analytics and Data Science; Marketing; Product Marketing; Product Launch; Product Positioning; Markets; Market Timing; Strategy; Green Technology Industry; Estonia
- October 2022
- Case
Single.Earth
By: Rembrand Koning and Emer Moloney
Estonian greentech company Single.Earth is launching a nature-backed token that is linked to and funds the protection of a specific plot fo land. The first landowners had been onboarded to the company's Digital Twin, a virtual representation of the planet's natural... View Details
Keywords: Alternative Assets; Business Startups; Entrepreneurship; Climate Change; Environmental Sustainability; Green Technology; Natural Resources; Pollution; Analytics and Data Science; Marketing; Product Marketing; Product Launch; Product Positioning; Markets; Market Timing; Strategy; Green Technology Industry; Estonia
- October 2022 (Revised December 2022)
- Case
SMART: AI and Machine Learning for Wildlife Conservation
By: Brian Trelstad and Bonnie Yining Cao
Spatial Monitoring and Reporting Tool (SMART), a set of software and analytical tools designed for the purpose of wildlife conservation, had demonstrated significant improvements in patrol coverage, with some observed reductions in poaching and contributing to wildlife... View Details
- September 2022 (Revised November 2022)
- Teaching Note
PittaRosso: Artificial Intelligence-Driven Pricing and Promotion
By: Ayelet Israeli
Teaching Note for HBS Case No. 522-046. View Details
Keywords: Artificial Intelligence; Pricing; Pricing Algorithm; Pricing Decisions; Pricing Strategy; Pricing Structure; Promotion; Promotions; Online Marketing; Data-driven Decision-making; Data-driven Management; Retail; Retail Analytics; Price; Advertising Campaigns; Analytics and Data Science; Analysis; Digital Marketing; Budgets and Budgeting; Marketing Strategy; Transformation; Decision Making; AI and Machine Learning; Retail Industry; Italy
- August 2022
- Supplement
Zalora: Data-Driven Pricing Recommendations
By: Ayelet Israeli
This exercise can be used in conjunction with the main case "Zalora: Data-Driven Pricing" to facilitate class discussion without requiring data analysis from the students. Instead, the exercise presents reports that were created by the data science team to answer the... View Details
Keywords: Pricing; Pricing Algorithms; Dynamic Pricing; Ecommerce; Pricing Strategy; Pricing And Revenue Management; Apparel; Singapore; Startup; Demand Estimation; Data Analysis; Data Analytics; Exercise; Price; Internet and the Web; Apparel and Accessories Industry; Retail Industry; Fashion Industry; Singapore
- August 2022
- Background Note
Retail Media Networks
By: Eva Ascarza, Ayelet Israeli and Celine Chammas
In 2022, retail media was one of the fastest growing segments in digital advertising. A retail media network (RMN) allows a retailer to use its assets for advertising. Retailers set up an advertising business by allowing marketers to buy advertising space across their... View Details
Keywords: Advertisers; Advertising Media; Media And Broadcasting Industry; Retail; Retail Analytics; Retail Promotion; Retailing; Ecommerce; E-Commerce Strategy; E-commerce; Marketing Communication; Targeting; Targeted Advertising; Targeted Marketing; Advertising; Marketing; Marketing Communications; Marketing Strategy; Brands and Branding; Media; Marketing Channels; Retail Industry; Consumer Products Industry; Advertising Industry; United States
- 2022
- Article
Data Poisoning Attacks on Off-Policy Evaluation Methods
By: Elita Lobo, Harvineet Singh, Marek Petrik, Cynthia Rudin and Himabindu Lakkaraju
Off-policy Evaluation (OPE) methods are a crucial tool for evaluating policies in high-stakes domains such as healthcare, where exploration is often infeasible, unethical, or expensive. However, the extent to which such methods can be trusted under adversarial threats... View Details
- 2022
- Article
Fairness via Explanation Quality: Evaluating Disparities in the Quality of Post hoc Explanations
By: Jessica Dai, Sohini Upadhyay, Ulrich Aivodji, Stephen Bach and Himabindu Lakkaraju
As post hoc explanation methods are increasingly being leveraged to explain complex models in high-stakes settings, it becomes critical to ensure that the quality of the resulting explanations is consistently high across all subgroups of a population. For instance, it... View Details
- 2022
- Article
Towards Robust Off-Policy Evaluation via Human Inputs
By: Harvineet Singh, Shalmali Joshi, Finale Doshi-Velez and Himabindu Lakkaraju
Off-policy Evaluation (OPE) methods are crucial tools for evaluating policies in high-stakes domains such as healthcare, where direct deployment is often infeasible, unethical, or expensive. When deployment environments are expected to undergo changes (that is, dataset... View Details
- July 2022
- Case
Operation Overlord
By: Boris Groysberg, Greg Goullet, Katherine Connolly Baden and Sarah L. Abbott
On June 6, 1944, nearly 5,000 ships, 11,000 planes, and 160,000 infantrymen under an Allied joint-command of American, British, and Canadian leaders were sent across the English Channel, with hopes of re-establishing a foothold in Nazi-occupied France. Known as D-Day,... View Details
- July 2022
- Supplement
Solution for E-Commerce Analytics for CPG Firms (A): Estimating Sales
By: Ayelet Israeli
Keywords: Data Analysis; Data Analytics; CPG; Consumer Packaged Goods (CPG); Estimation; Online Channel; Retail Analytics; Retail; Retailing Industry; Data; Data Sharing; Bricks And Mortar; Ecommerce; Analytics and Data Science; Analysis; Sales; Goods and Commodities; Retail Industry; Consumer Products Industry; United States