10.2190/WPMG-5YNV-EPAC-JPMM WPMG5YNVEPACJPMM 6 Procedures for Aggregating the Results of Energy Conservation Research 77 92 20020509 20020509 20020509 20020509 WPMG5YNVEPACJPMM.pdf http://baywood.metapress.com/link.asp?target=contribution&id=WPMG5YNVEPACJPMM 1 Brian Stecher Educational Testing Service Various procedures for aggregating the results of research on energy consumption are analyzed and some important criticisms are addressed. The methods include the "voting" method, combined significance tests, measures of overall effect size, and cluster analysis. Methods for testing the influence of relevant mediating variables are also described. Effect size measures are recommended, but the energy evaluator is cautioned to select the procedure that is appropriate to the body of research under investigation. J. D. Claxton, C. D. Anderson, J. R. D. Ritchie, and G. H. G. McDougall, (eds.), <i>Consumers and Energy Conservation</i>, Prager, New York, 1981. A. Baum and J. E. Singer, (eds.), <i>Advances in Environmental Psychology</i>, Vol. 3, (Energy Conservation: Psychological Perspectives), Lawrence Erlbaum Associates, Hillsdale, NJ, 1981. C. Seligman and L. J. Becker, (eds.), <i>Journal of Social Issues, 37</i>:2, Spring, 1981. H. J. Walburg and E. H. Haertell, Research Integration: An Introduction and Overview, <i>Evaluation in Education, 4</i>, pp. 5-10, 1980. J. Sonderstrom, L. Barry, and E. Hirst, The Use of Meta-Evaluation to Plan Evaluations of Conservation Programs, <i>Evaluation and Program Planning, 4</i>, pp. 113-122, 1981. D. B. Pillemer and R. J. Light, Synthesizing Outcomes: How to Use Research for Many Studies, <i>Harvard Educational Review, 50</i>, pp. 175-195, 1980. G.V Glass, Integrating Findings: The Meta-Analysis of Research, in <i>Review of Research in Education</i>, L. Shulman (ed.), Vol. 5, F. E. Peacock, Itasca, Illinois, 1977. Energy Conservation Group. <i>The Energy Conservation Programs and Research of California's Major Energy Utility Companies</i>, 1977-1980. University of California, Santa Cruz, 1982. H. M. Cooper and R. Rosenthal, A Comparison of Statistical and Traditional Procedures for Summarizing Research, <i>Evaluation in Education, 4</i>, pp. 33-36, 1980. G. V Glass, Primary, Secondary, and Meta-Analysis of Research, <i>Educational Researcher</i>, November, 1976. R. S. Mansfield and T. D. Busse, Meta-Analysis of Research: A Rejoinder to Glass, <i>Educational Researcher</i>, p. 3, October, 1977. G. V Glass, Reply to Mansfield and Busse, <i>Educational Researcher</i>, p. 3, January, 1978. M. L. Smith and G. V Glass, Meta-Analysis of Psychotherapy Outcome Studies, <i>American Psychologist, 32</i>, pp. 752-760, 1977. H. J. Eysenck, An Exercise in Mega-Silliness, <i>American Psychologist, 33</i>, p. 17, 1978. G. V Glass and M. L. Smith, Reply to Eysenck, <i>American Psychologist, 33</i>, pp. 517-519, 1978. T. D. Cook and C. L. Gruder, Meta-Evaluation Research, <i>Evaluation Quarterly, 2</i>:1, pp. 5-51, February, 1978. R. Rosenthal, Combining Probabilities and the File-Drawer Problem, <i>Evaluation in Education, 4</i>, pp. 18-21, 1980. M. L. Smith, Publication Bias in Meta-Analysis, <i>Evaluation in Education, 4</i>, pp. 22-24, 1980. R. J. Light and P. V. Smith, Accumulating Evidence: Procedures for Resolving Contradictions among Different Studies, <i>Harvard Educational Review, 41</i>, pp. 429-471, 1971. G. V Glass, R. McGaw and M. L. Smith, <i>Meta-Analysis and Social Research</i>, Sage Publications, Beverly Hills, California, 1981. L. V. Hedges, Distribution Theory for Glass's Estimator of Effect Size and Related Estimators, <i>Journal of Educational Statistics, 6</i>:2, pp. 107-128, Summer, 1981. L. V. Hedges, Unbiased Estimation of Effect Size, <i>Evaluation in Education, 4</i>, pp. 25-27, 1980. W. A. Stock, M. A. Okun, M. J. Haring, W. Miller, C. Kinney and R. W. Cuervorst, Rigor in Data Synthesis: A Case Study of Reliability in Meta-Analysis, <i>Educational Researcher, 11</i>:6, pp. 10-14, June-July, 1982.