Optimal Few-Stage Designs

Janis Hardwick      Quentin F. Stout
University of Michigan

 

Abstract: Optimal designs are presented for experiments in which sampling is carried out in stages. There are two Bernoulli populations and it is assumed that the outcomes of the previous stage are available before the sampling decision for the next stage is determined. At each stage, the design specifies the number of observations to be taken and the relative proportion to be sampled from each population. Of particular interest are 2-stage and 3-stage designs.

The designs are optimal in a strong sense, namely, among all designs with the same sample size, priors, and number of stages, they optimize the expected value of the objective function. Most other designs are suboptimal because they require that the stage sizes must always be the same no matter what observations have occured, or because they use approximations to determine the design's parameters.

To illustrate that the algorithms can be used for experiments of useful sample sizes, they are applied to estimation and optimization problems. Results indicate that, for problems of moderate size, published asymptotic analyses do not always represent the true behavior of the optimal stage sizes, and efficiency may be lost if the analytical results are used instead of the true optimal allocation. Our results also suggest that one might approach large problems by extrapolating optimal solutions for moderate sample sizes; and, that approaches of this sort could give design guidelines that are far more explicit (and hopefully closer to optimal) than those obtained through asymptotic analyses alone.

The exactly optimal few stage designs discussed here are generated computationally, and the examples presented indicate the ease with which this approach can be used to solve problems that present analytical difficulties. The algorithms described are flexible and provide for the accurate representation of important characteristics of the problem. It is also shown that in various cases the base algorithms can be modified to incorporate simplifications. In such settings, significant speedups and space reductions can be obtained, permitting the exact solution of even larger problems.

With simple modifications, the program can be used to optimize response adaptive designs where there is optional stopping.

Keywords: sequential analysis, controlled clinical trial, two-stage procedure, three-stage, design of experiments, group allocation, response-adaptive sampling design, bandit problem, dynamic programming.

Complete paper This paper appears in Journal of Statistical Planning and Inference 104 (2002), pp. 121-145.

 


Related Work
Seminar Presentation:
Optimal Few-Stage Designs for Clinical Trials.
Adaptive Allocation:
Here is an explanation of this topic, and here are our relevant publications.
Dynamic Programming (also known as backward induction):
Here is an overview of our work.


Quentin's Home Copyright © 2005-2008 Quentin F. Stout