SMU SOE Online Seminar (Nov 9, 2020, 9am-10.30am): Optimality of Matched-Pair Designs in Randomized Controlled Trials

Please click here if you are unable to view this page.

TOPIC:

OPTIMALITY OF MATCHED-PAIR DESIGNS IN RANDOMIZED CONTROLLED TRIALS

ABSTRACT This paper studies the optimality of matched-pair designs in randomized controlled trials (RCTs). Matched-pair designs are examples of stratiﬁed randomization, in which the researcher partitions a set of units into strata based on their observed covariates and assign a fraction of units in each stratum to treatment. A matched-pair design is such a procedure with two units per stratum. Despite the prevalence of stratiﬁed randomization in RCTs, implementations differ vastly. We provide an econometric framework in which, among all stratiﬁed randomization procedures, the optimal one in terms of the mean-squared error of the difference-in-means estimator is a matched-pair design that orders units according to a scalar function of their covariates and matches adjacent units. Our framework captures a leading motivation for stratifying in the sense that it shows that the proposed matched-pair design additionally minimizes the magnitude of the ex-post bias, i.e., the bias of the estimator conditional on realized treatment status. We then consider empirical counterparts to the optimal stratiﬁcation using data from pilot experiments and provide two different procedures depending on whether the sample size of the pilot is large or small. For each procedure, we develop methods for testing the null hypothesis that the average treatment effect equals a prespeciﬁed value. Each test we provide is asymptotically exact in the sense that the limiting rejection probability under the null equals the nominal level. We run an experiment on the Amazon Mechanical Turk using one of the proposed procedures, replicating one of the treatment arms in DellaVigna and Pope (2018), and ﬁnd the standard error decreases by 29%, so that only half of the sample size is required to attain the same standard error. Keywords: Matched-pair design, stratiﬁed randomization, randomized controlled trial, ex-post bias, treatment effect, stratiﬁcation, pilot experiment, matched pairs. JEL Codes: C12, C13, C14, C90. Click here to view the paper. Click here to view the CV.		This seminar will be held via Zoom. A confirmation email with the Zoom details will be sent to the registered email by 6 November 2020.
		PRESENTER Yuehao Bai University of Michigan
		RESEARCH FIELD Econometrics
		DATE: 9 November 2020 (Monday)
		TIME: 9.00am - 10.30am

© Copyright 2024 by Singapore Management University. All Rights Reserved.