Abstract
In contrast to prospective power analysis, retrospective power analysis provides an estimate of the statistical power of a hypothesis test after an investigation has been conducted rather than before. In this article, three approaches to obtaining point estimates of power and an interval estimation algorithm are delineated. Previous research on the bias and sampling error of these estimates is briefly reviewed. Finally, an SAS macro that calculates the point and interval estimates is described. The macro was developed to estimate the power of anF test (obtained from analysis of variance, multiple regression analysis, or any of several multivariate analyses), but it may be easily adapted for use with other statistics, such as chi-square tests ort tests.
Article PDF
Similar content being viewed by others
References
Brewer, J. K., &Sindelar, P. T. (1987). Adequate sample size: A priori and post hoc considerations.Journal of Special Education,21, 74–84.
Cohen, J. (1988).Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
Gerard, P. D., Smith, D. R., &Weerakkody, G. (1998). Limits of retrospective power analysis.Journal of Wildlife Management,62, 801–807.
Goodman, S. N., &Berlin, J. A. (1994). The use of predicted confidence intervals when planning experiments and the misuse of power when interpreting results.Annals of Internal Medicine,130, 1005–1013.
Harlow, L. L., Muliak, S. A., &Steiger, J. H. (Eds.) (1997).What if there were no significance tests? Mahwah, NJ: Erlbaum.
Hedges, L. V., &Olkin, I. (1985).Statistical methods for meta-analysis. New York: Academic Press.
Hoenig, J. M., &Heisey, D. M. (2001). The abuse of power: The pervasive fallacy of power calculations for data analysis.American Statistician,55, 19–24.
Johnson, N. L., Kotz, S., &Balakrishnan, N. (1995).Continuous univariate distributions (2nd ed., Vol. 2). New York: Wiley.
Kirk, R. (1996). Practical significance: A concept whose time has come.Educational & Psychological Measurement,56, 746–759.
Kromrey, J. D., &Hogarty, K. Y. (2000a). Retrospective power analysis: An empirical comparison of point and interval estimates.Proceedings of the American Statistical Association, Section on Government Statistics and Section on Social Statistics (pp. 265–269). Alexandria, VA: American Statistical Association.
Kromrey, J. D., &Hogarty, K. Y. (2000b). Retrospective statistical power analysis: An empirical investigation of point and interval estimation techniques.Multiple Linear Regression Viewpoints,26, 7–14.
Lenth, R. V. (2001). Some practical guidelines for effective sample size determination.American Statistician,55, 187–193.
Ottenbacher, K. J., &Maas, F. (1999). How to detect effects: Statistical power and evidence-based practice in occupational therapy research.American Journal of Occupational Therapy,53, 181–188.
Press, W. H., Teukolsky, S.A., Vetterling, W. T., &Flannery, B. P. (1992).Numerical recipes in FORTRAN: The art of scientific computing (2nd ed.). New York: Cambridge University Press.
Schuirmann, D. J. (1987). A comparison of the two one-sided tests procedure and the power approach for assessing the equivalence of average bioavailability.Journal of Pharmacokinetics & Biopharmaceutics,15, 657–680.
Steidl, R. J., Hayes, J. P., &Schauber, E. (1997). Statistical power analysis in wildlife research.Journal of Wildlife Management,61, 270–279.
Steiger, J. H., &Fouladi, R. T. (1997). Noncentrality interval estimation and the evaluation of statistical models. In L. L. Harlow, S. A. Muliak, & J. H. Steiger (Eds.),What if there were no significance tests? (pp. 221–257). Mahwah, NJ: Erlbaum.
Taylor, D. J., &Muller, K. E. (1996). Bias in linear model power and sample size calculation due to estimating noncentrality.Communications in Statistics: Theory & Methods,25, 1595–1610.
Zumbo, B. D., &Hubley, A. M. (1998). A note on misconceptions concerning prospective and retrospective power.The Statistician,47, 385–388.
Author information
Authors and Affiliations
Corresponding authors
Rights and permissions
About this article
Cite this article
Hogarty, K.Y., Kromrey, J.D. RETR_PWR: An SAS macro for retrospective statistical power analysis. Behavior Research Methods, Instruments, & Computers 35, 585–589 (2003). https://doi.org/10.3758/BF03195537
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03195537