10.2190/VGH1-186E-JTD6-KK2N VGH1186EJTD6KK2N 1 Connecting Ecological Monitoring and Ecological Indicators: A Review of the Literature 325 363 20020509 20020509 20020509 20020509 VGH1186EJTD6KK2N.pdf http://baywood.metapress.com/link.asp?target=contribution&id=VGH1186EJTD6KK2N 4 Jerry A. Griffith University of Kansas, Lawrence Ecological monitoring is receiving renewed interest, is being performed with increased scientific rigor, and offers plentiful research opportunities. In the 1990s several countries are embarking on ambitious national ecological monitoring programs as monitoring is becoming more important for assessing ecological status and for underpinning environmental policy decisions and funding priorities. Several important facets of monitoring are reviewed in this article including: 1) the philosophy and objectives upon which monitoring programs are based, 2) the use of ecological indicators for assessing the status of the environment and, 3) criteria upon which to base the choice of indicators. the most important issues in monitoring lie not in post-monitoring data analyses but rather in all phases of the design of the monitoring regime.

R. Graham, C. Hunsaker, R. O'Neill, and B. Jackson, Ecological Risk Assessment at the Regional Scale, Ecological Application, 1:2, pp. 196-206.

C. T. Hunsaker, D. E. Carpenter, and J. J. Messer, Ecological Indicators for Regional Monitoring, Bulletin of the Ecological Society of America, 71:3, pp. 165-172, 1990.

C. Loehle, Managing and Monitoring Ecosystems in the Face of Heterogeneity, in Ecological Heterogeneity, J. Kolasa and S. Pickett (eds.), (Series: Ecological Studies: Analysis and Synthesis 86), Springer-Verlag, New York, pp. 144-159, 1991.

M. Nip and H. Udo de Haes, Ecosystem Approaches to Environmental Quality Assessment, Environmental Management, 19:1, pp. 135-145, 1995.

D. J. Schaeffer, E. E. Herricks, and H. W. Kerster, Ecosystem Health: I. Measuring Ecosystem Health, Environmental Management, 12, pp. 445-455, 1988.

J. Thomas and S. Huke, the Forest Service Approach to Healthy Ecosystems, Journal of Forestry, 94:8, pp. 14-18, 1996.

H. Hirvonen, the Development of Regional Scale Ecological Indicators: A Canadian Approach, in Ecological Indicators, D. McKenzie, D. Hyatt, and J. McDonald (eds.), Elsevier, Essex, England, pp. 901-915, 1992.

J. J. Messer, R. Linthurst, and W. Overton, An EPA Program for Monitoring Ecological Status and Trends, Environmental Monitoring and Assessment, 17:1, pp. 67-78, 1991.

C. Bernes, B. Glege, K. Johannsson, and J. Larson, Design of an Integrated Monitoring Programme in Sweden, Environmental Monitoring and Assessment, 6, pp. 113-126, 1986.

J. Latour, R. Lammers, R. Reiling, D. Bal, and R. Bink, Ecological Information in the Netherlands National Environmental Outlooks, Ecosystem Health, 1:2, pp. 113-124, 1995.

P. Aldhaus, UK Sets Early Warning System, Nature, 355, p. 383, 1992.

D. Prochazkova, Theoretical Background of Environmental Monitoring and Its Conception in the Czech Republic, Environmental Monitoring and Assessment, 34:2, pp. 105-113, 1995.

O. Roots and L. Saare, Structure and Objectives of the Estonian Environmental Monitoring Program, Environmental Monitoring and Assessment, 40, pp. 289-301, 1996.

J. Marko and A. Propperova, Environmental Monitoring within the Slovak Republic, Environmental Monitoring and Assessment, 34:2, pp. 131-136, 1995.

W. Glaze, Research Priorities for the 21st Century, Environmental Science and Technology, 31:1, pp. 20A-23A, 1997.

EPA (U. S. Environmental Protection Agency), EMAP Currents: An Online Document with Information on EMAP, Available on the Internet, HTML address: <a target="_blank" href='http://www.epa.gov/emap'>http://www.epa.gov/emap</a>

F. Kutz, R. A. Linthurst, C. Riordan, M. Slimak, and R. Frederick, Ecological Research at EPA: New Directions, Environmental Science and Technology, 26:5, pp. 860-866, 1992.

E. Harrison, Bioindicators of Pollution: A Bibliography with Abstracts, NTIS/PS-76/0868, National Technical Information Service, Springfield, Virginia, 1976.

W. Thomas, Indicators of Environmental Quality, Plenum Press, New York, 1972.

B. Freedman, Environmental Ecology: The Impacts of Pollution and Other Stresses on Ecosystem Structure and Function, Academic Press, San Diego, California, 1989.

A. R. Olsen (ed.), The Indicator Development Strategy for the Environmental Monitoring and Assessment Program, EPA/600/3-91/023, U. S. Environmental Protection Agency Environmental Research Laboratory, Corvallis, Oregon, 1992.

R. Breckenridge, W. Kepner, and D. Mouat, A Process for Selecting Indicators for Monitoring Conditions of Rangeland Health, Environmental Monitoring and Assessment, 36:1, pp. 45-60, 1995.

W. Heck, C. Campbell, G. Hess, J. Meyer, T. Moser, S. Peck, J. Rawlings, and A. Finkner, Environmental Monitoring and Assessment Program (EMAP)—Agroecosystem Monitoring and Research Strategy, EPA/600/4-91/013, U. S. Environmental Protection Agency, Washington, D. C., 1991.

S. Hedtke, A. Pilli, D. Dolan, G. McRae, B. Goodno, M. Henry, R. Kreis, J. Eaton, R. Hoke, G. Warren, D. Swackhammer, and S. Lozano, Draft EMAP—Great Lakes Monitoring and Research Strategy, U. S. Environmental Protection Agency, Office of Research and Development, Duluth, Minnesota, June 1992.

J. M. Hellawell, Development of a Rationale for Monitoring, in Monitoring for Conservation and Ecology, B. Goldsmith (ed.), Chapman and Hall, London, pp. 1-14, 1991.

W. Kepner et al., Arid Ecosystems Strategic Monitoring Plan, 1991, EPA 600/4-91/018 Preissue copy, Environmental Monitoring Systems Laboratory, U. S. Environmental Protection Agency, Las Vegas, Nevada, 1991.

N. Liebowitz, L. Squires, and J. Baker, Research Plan for Monitoring Wetland Ecosystems, EPA/600/3-91/-10, U. S. Environmental Protection Agency, Environmental Research Laboratory, Corvallis, Oregon, 1991.

C. Palmer, K. Riitters, T. Strickland, D. Cassell, G. Byers, M. Papp, and C. Liff, Monitoring and Research Strategy for Forests—Environmental Monitoring and Assessment Program (EMAP), EPA/600/4-91/012, U. S. Environmental Protection Agency, Washington, D. C., 1991.

S. Paulsen et al., EMAP-Surface Waters Monitoring and Research Strategy: Fiscal Year 1991, EPA/600-3-91/022, Environmental Research Laboratory, Office of Research and Development, U. S. Environmental Protection Agency, Corvallis, Oregon, 1991.

K. Riitters, B. Law, R. Kucera, A. Gallant, R. DeVelice, and C. Palmer, A Selection of Forest Condition Indicators for Monitoring, Environmental Monitoring and Assessment, 20, pp. 21-33, 1992.

J. K. Summers, J. F. Paul, and A. Robertson, Monitoring the Ecological Condition of Estuaries in the United States, Toxicology and Environmental Chemistry, 49, pp. 93-108, 1995.

T. R. Whittier and S. G. Paulsen, the Surface Water Component of the Environmental Monitoring and Assessment Program: An Overview, Journal of Aquatic Ecosystem Health, 1:2, pp. 119-126, 1992.

G. Sheehy, Environmental Indicator Research: A Literature Review for State of the Environment (SOE) Reporting (Draft) Technical Report Series No. 7, Strategies and Scientific Methods, SOE Reporting Branch, Canadian Wildlife Service, Environment Canada, Ottawa, 1989.

R. Rajagopal, U. Natarajan, and J. Wacker, Information Integration for Environmental Monitoring and Assessment, The Environmental Professional, 14, pp. 151-177, 1992.

I. F. Spellerberg, Monitoring Ecological Change, Cambridge University Press, Cambridge, England, 1991.

D. S. Slocombe, Environmental Monitoring for Protected Areas: Review and Prospect, Environmental Monitoring and Assessment, 21, pp. 49-78, 1992.

D. Bruns, C. Staley, R. Rope, and K. Moor, An Ecosystem Approach to Ecological Characterization in the NEPA Process, in Environmental Analysis: The NEPA Experience, S. Hildebrand and J. Cannon (eds.), Lewis Publishers, Boca Raton, Florida, pp. 103-124, 1993.

D. H. McKenzie, D. E. Hyatt, and J. V. McDonald, Ecological Indicators, Elsevier, Essex, England, 1992.

D. J. Rapport, Ecosystem Health: Exploring the Territory, Ecosystem Health, 1:1, pp. 5-14, 1995.

J. Cairns, Jr., P. McCormick, and B. Niederlehner, A Proposed Framework for Developing Indicators of Ecosystem Health, Hydrobiologia, 263, pp. 1-44, 1993.

J. Griffith and C. Hunsaker, Ecosystem Monitoring and Ecological Indicators: An Annotated Bibliography and Review of Literature, EPA/620/R-94/021, U. S. Environmental Protection Agency, Office of Research and Development, Environmental Research Laboratory, Athens, Georgia, 1994.

M. Morrison, Resource Inventory and Monitoring, Restoration Management Notes, 12: 2, pp. 179-183, 1994.

G. Davis, Design Elements of Monitoring Programs: The Necessary Ingredients for Success, Environmental Monitoring and Assessment, 26, pp. 99-105, 1993.

D. Roux, H. Van Vliet, and M. Van Veelen, Towards Integrated Water Quality Monitoring: Assessment of Ecosystem Health, Water SA, 19:4, pp. 275-279, 1993.

B. Hart, Ecological Condition of Australia's Rivers, Search, 23:1, pp. 33-37, 1992.

B. Hart, I. Campbell, C. Angehrn-Bettinazzi, and M. Jones, Australian Water Quality Guidelines: A New Approach for Protecting Ecosystem Health, Journal of Aquatic Ecosystem Health, 2, pp. 151-163, 1993.

C. Hicks, Minimum Standard Needed to Protect U. S. Rangelands, News Report-National Research Council (USA) 44:2, pp. 12-14, 1994.

E. Smith et al., New Concepts for Assessment of Rangeland Condition, Journal of Rangeland Management, 48:3, pp. 271-282, 1995.

Committee on Rangelands Classification, Rangeland Health: New Methods to Classify, Inventory, and Monitor Rangelands, National Academy Press, Washington, D. C., 1994.

National Research Council, Managing Troubled Waters: The Role of Marine Environmental Monitoring, National Academy Press, Washington, D. C., 125 pp., 1990.

J. Musil, Central and Eastern European Needs for Environmental Care, Environmental Monitoring and Assessment, 34:2, pp. 131-136, 1995.

J. Cairns, Jr., Ecosystem Health through Ecological Restoration: Barriers and Opportunities, Journal of Aquatic Ecosystem Health, 3, pp. 5-14, 1994.

J. Miller, Bioscience and Ecological Integrity, Bioscience, 41:4, pp. 206-210, 1991.

P. Landres, the Role of Ecological Monitoring in Managing Wilderness, Trends, 32:1, pp. 10-13, 1995.

M. H. Belsky, Using Legal Principles to Promote the ‘Health’ of an Ecosystem, Tulsa Journal of Comparative International Law, 3:2, pp. 183-205, 1996.

K. A. Roberts, Field Monitoring: Confessions of an Addict, in Monitoring for Conservation and Ecology, B. Goldsmith (ed.), Chapman and Hall, London, 1991.

M. B. Usher, Scientific Requirements of a Monitoring Programme, in Monitoring for Conservation and Ecology, B. Goldsmith (ed.), Chapman and Hall, London, 1991.

S. Miller, Federal Environmental Monitoring: Will the Bubble Burst? Environmental Science and Technology, 12:12, pp. 1264-1269, 1978.

F. Hinds, Towards Monitoring of Long-Term Trends in Terrestrial Ecosystems, Environmental Conservation, 11, pp. 11-18, 1984.

E. Herricks and D. J. Schaeffer, Selection of Test Systems for Ecological Analysis, Water Science and Technology, 19:11, pp. 47-54, 1987.

D. Segar, D. Phillips, and E. Stamman, Strategies for Long-Term Pollution Monitoring of the Coastal Oceans, in New Approaches to Monitoring Aquatic Ecosystems, T. Boyle (ed.), ASTM STP 940, American Society for Testing and Materials, Philadelphia, 1987.

D. Phillips and D. Segar, Use of Bio-Indicators in Monitoring Conservative Contaminants: Programme Design Imperatives, Marine Pollution Bulletin, 17:1, pp. 10-17, 1986.

J. Ford, J. Stoddard, and C. Powers, Perspectives on Environmental Monitoring: An Introduction to the U. S. EPA Long-Term Monitoring Project, Environmental Monitoring and Assessment, 67, pp. 247-255, 1993.

T. Stohlgren, D. Binkley, T. Veblen, and W. Baker, Attributes of Reliable Long-Term Landscape-Scale Studies: Malpractice Insurance for Landscape Ecologists, Environmental Monitoring and Assessment, 36:1, pp. 1-25, 1995.

B. B. Bernstein, A Combined Science and Management Framework for Developing Regional Monitoring Objectives, Coastal Management, 21, pp. 185-195, 1993.

B. B. Bernstein, A Framework for Trend Detection: Coupling Ecological and Managerial Perspectives, in Ecological Indicators, D. McKenzie, D. E. Hyatt, and J. McDonald (eds.), Elsevier, Essex, England, pp. 1101-1114, 1992.

B. Stout, the Good, the Bad, and the Ugly of Monitoring Programs: Defining Questions and Establishing Objectives, Environmental Monitoring and Assessment, 26, pp. 91-98, 1993.

P. Cullen, Biomonitoring and Environmental Management, Environmental Monitoring and Assessment, 14, pp. 107-114, 1990.

D. W. Schindler, Detecting Ecosystem Responses to Anthropogenic Stress, Canadian Journal of Fisheries and Aquatic Science (Supplement), 1:44, pp. 6-25, 1987.

R. Wilson, L. Harding, and H. Hirvonen, Marine Ecosystem Monitoring Network Design, Ecosystem Health, 1:4, pp. 222-227, 1995.

J. O'Connor and D. Flemer, Monitoring, Research, and Management: Integration for Decision-Making in Coastal Marine Environments, in New Approaches to Monitoring Aquatic Ecosystems, T. Boyle (ed.), ASTM STP 940, American Society for Testing and Materials, pp. 70-90, 1987.

P. Calow and D. J. Rapport, Rapporteur's Report, in Evaluating and Monitoring the Health of Large-Scale Ecosystems, D. Rapport, C. Gaudet, and P. Calow (eds.), Springer-Verlag, Berlin, 1995.

L. Conquest, Statistical Approaches to Environmental Monitoring: Did We Teach the Wrong Things? Environmental Monitoring and Assessment, 26, pp. 107-124, 1993.

T. Ernst, N. Leibowitz, D. Roose, S. Stehman, and N. S. Urquhart, Evaluation of U. S. EPA Environmental Monitoring and Assessment Program's (EMAP)—Wetlands Sampling Design and Classification Environmental Management, 19:1, pp. 99-113, 1995.

R. Kuehl, R. Breckenridge, and M. Pana, Integrated Response Plot Designs for Indicators of Desertification, Environmental Monitoring and Assessment, 37:1/3, pp. 189-209, 1995.

P. Murtaugh, the Statistical Evaluation of Ecological Indicators, Ecological Application, 6:1, pp. 132-139, 1996.

D. L. Stevens, Implementation of a National Monitoring Program, Journal of Environmental Management, 42, pp. 1-29, 1994.

D. White, A. J. Kimerling, and W. Overton, Cartographic and Geometric Components of a Global Sampling Design for Environmental Monitoring, Cartography and Geographic Information Systems, 19:1, pp. 5-22, 1992.

S. Millard, Environmental Monitoring, Statistics, and the Law: Room for Improvement, The American Statistician, 41, pp. 249-253, 1987.

M. Power, G. Power, and D. Dixon, Detection and Decision-Making in Environmental Effects Monitoring, Environmental Management, 19:5, pp. 629-640, 1995.

P. Sanden and A. Danielsson, Spatial Properties of Nutrient Concentrations in the Baltic Sea, Environmental Monitoring and Assessment, 34:3, pp. 289-307, 1995.

W. Shampine, Quality Assurance and Quality Control in Monitoring Programs, Environmental Monitoring and Assessment, 26, pp. 143-151, 1993

S. Stafford, Data, Data Everywhere but not a Byte to Read: Managing Monitoring Information, Environmental Monitoring and Assessment, 26, pp. 125-141, 1993.

W. Michener, R. Feller, and D. Edwards, Development, Management, and Analysis of a Long-Term Ecological Research Information Base: Example for Marine Macrobenthos, in New Approaches to Monitoring Aquatic Ecosystems, T. Boyle (ed.), ASTM STP 940, American Society for Testing and Materials, Philadelphia, pp. 173-178, 1987.

J. Kay, A Nonequilibrium Thermodynamic Framework for Discussing Ecosystem Integrity, Environmental Management, 15:4, pp. 483-495, 1991.

J. R. Karr, Biological Monitoring and Environmental Assessment: A Conceptual Framework, Environmental Management, 11, pp. 249-256, 1987.

J. Karr, Biological Integrity—A Long Neglected Aspect of Water Resource Management, Ecological Application, 1:1, pp. 66-84, 1991.

J. Karr, Defining and Assessing Ecological Integrity: Beyond Water Quality, Environmental Toxicology and Chemistry, 12, pp. 1521-1531, 1993.

R. Steedman and H. Regier, Ecological Bases for an Understanding of Ecosystem Integrity in the Great Lakes Basin, in An Ecosystem Approach to the Integrity of the Great Lakes in Turbulent Times, C. Edwards and H. Regier (eds.), Great Lakes Fishery Commission Special Publication 90-4, Great Lakes Fishery Commission, Ann Arbor, Michigan, 1990.

R. J. Steedman, Ecosystem Health as a Management Goal, Journal of the North American Benthological Society 13:4, pp. 605-610, 1994.

J. Callicott, A Review of Some Problems with the Concept of Ecosystem Health, Ecosystem Health, 1:2, pp. 101-112, 1995.

D. J. Rapport, What Constitutes Ecosystem Health? Perspectives in Biology and Medicine, 33:1, pp. 120-132, 1990.

D. J. Rapport, What is Clinical Ecology? in Ecosystem Health: New Goals for Environmental Management, R. Costanza, B. Norton, and B. Haskell (eds.), Island Press, Covelo, California, 1992.

D. J. Rapport, Evaluating Ecosystem Health, Journal of Aquatic Ecosystem Health, 1:1, pp. 15-24, 1992.

D. J. Schaeffer, Diagnosing Ecosystem Health, Ecotoxicology and Environmental Safety, 34, pp. 18-34, 1996.

D. F. Malley, Raising Consciousness in Ecosystem Health, Journal of Aquatic Ecosystem Health, 2, pp. 317-327, 1993.

M. Hammond and A. Holland, Ecosystem Health: Some Prognostications, Environmental Values, 4, pp. 283-286, 1995.

G. W. Suter II, A Critique of Ecosystem Health Concepts and Indices, Environmental Toxicology and Chemistry, 12:9, pp. 1533-1540, 1993.

D. Policansky, Application of Ecological Knowledge to Environmental Problems: Ecological Risk Assessment, in Comparative Environmental Risk Assessment, C. R. Cothern (ed.), Lewis Publishers, Boca Raton, Florida, pp. 37-49, 1993.

K. S. Shrader-Frechette, Ecosystem Health: A New Paradigm for Ecological Assessment? Trends in Ecology and Evolution, 9:12, pp. 458-460, 1994.

B. W. Okey, Systems Approaches and Properties, and Agroecosystem Health, Journal of Environmental Management, 48, pp. 187-199, 1996.

J. R. Kelly and M. A. Harwell, Indicators of Ecosystem Recovery, Environmental Management, 14:5, pp. 527-545, 1990.

C. Azar, J. Holmberg, and K. Lindgren, Socio-Ecological Indicators for Sustainability, Ecological Economics, 18:2, pp. 89-102, 1996.

A. Gilbert and J. Feenstra, A Sustainability Indicator for the Dutch Environmental Policy Theme ‘Diffusion’; Cadmium Accumulation in Soil, Ecological Economics, 9:3, pp. 253-265, 1994.

J. Nilsson and S. Bergstrom, Indicators for the Assessment of Ecological and Economic Consequences of Municipal Policies for Resource Use, Ecological Economics, 14:3, pp. 175-184, 1995.

J. Holmberg and S. Karlsson, On Designing Socio-Ecological Indicators, in Society and Environment: A Swedish Research Perspective, U. Svedin and B. Hagerhill Aniannsson (eds.), Kluwer Academic Publishers, Dordrecht, pp. 89-106, 1992.

P. J. Schroevers, the Need of an Ecological Quality Concept, Environmental Monitoring and Assessment, 3, pp. 219-226, 1983.

R. Green, Statistical and Nonstatistical Considerations for Environmental Monitoring Studies, Environmental Monitoring and Assessment, 4, pp. 293-301, 1983.

J. A. Perry, N. Troelstrup Jr., M. Newsom, and B. Shelley, Whole Ecosystem Manipulation Experiments: The Search for Generality, Water Science and Technology, 19:11, pp. 55-71, 1987.

B. Freedman, Environmental Stress and the Management of Ecological Reserves, in Science and the Management of Protected Areas, J. Willison, S. Bondrup-Neilson, C. Drysdale, T. Herman, N. Munro, and T. Pollack (eds.), Elsevier, Amsterdam, pp. 303-308, 1992.

R. C. Ward, Indicator Selection: A Key Element in Monitoring System Design, in Ecological Indicators, D. McKenzie, D. Hyatt, and J. McDonald (eds.), Elsevier, Essex, England, pp. 147-158, 1992.

P. Landres, Ecological Indicators: Panacea or Liability? in Ecological Indicators, D. McKenzie, D. Hyatt, and J. McDonald (eds.), Elsevier, Essex, England, pp. 1296-1318, 1992.

M. Morrison and B. Marcot, An Evaluation of Resource Inventory and Monitoring Programs Used in National Forest Planning, Environmental Management, 19:1, pp. 147-156, 1995.

Committee on the Formation of the National Biological Survey, National Research Council, National Academy Press, Washington, D. C., 1993.

S. Draggan, J. Cohrssen, and R. Morrison, Environmental Monitoring, Assessment and Management—The Agenda for Long-Term Research and Development, Praeger, New York, 1987.

J. Lubchenco et al., the Sustainable Biosphere Initiative: An Ecological Research Agenda. A Report from the Ecological Society of America, Ecology, 72:2, pp. 371-412, 1991.

G. W. Barrett, Stress Effects on Natural Ecosystems, Ohio Journal of Science, 78, pp. 160-162, 1978.

G. Barrett, G. Van Dyne, and E. Odum, Stress Ecology, Bioscience, 26, pp. 192-194, 1976.

A. Alm, Leading Environmental Indicators, Environmental Science and Technology, 25:5, p. 839, 1991.

EPA, Future Risk: Research Strategies for the 1990's. SAB-EC-88-048. Science Advisory Board, U. S. Environmental Protection Agency, Washington, D. C., 1988.

C. Holling, the Resilience of Terrestrial Ecosystems: Local Surprise and Global Change, in Sustainable Development of the Biosphere, Cambridge University Press, Cambridge, England, pp. 292-317, 1986.

B. J. Huntley et al., A Sustainable Biosphere: The Global Imperative, Bulletin of the Ecological Society of America, 73:1, pp. 7-13, 1992.

Z. Xu, D. Bradley, and P. Jakes, Measuring Forest Ecosystem Sustainability: A Resource Accounting Approach, Environmental Management, 19:5, pp. 685-692, 1995.

D. Waltner-Toews, Ecosystem Health—A Framework for Implementing Sustainability in Agriculture, Bioscience, 46:9, pp. 686-689, 1996.

J. Camargo, the Importance of Biological Monitoring for the Ecological Risk Assessment of Freshwater Pollution: A Case Study, Environment International, 20:2, pp. 229-238, 1994.

H. Joshi et al., Ecosystem Studies on Upper Region of Ganga River, India, Environmental Monitoring and Assessment, 35:3, pp. 181-206, 1995.

J. Salanki and H. Salama, Signalization, Monitoring, and Evaluation of Environmental Pollution Using Biological Indicators, Acta Biol. Hung., 38:1, 5-11, 1987.

P. Koskimies, Birds as a Tool in Environmental Monitoring, Annales Zoologica Fennici, 26:3, pp. 153-166, 1989.

I. Zonneveld, Principles of Bio-Indication, Environmental Monitoring and Assessment, 3, pp. 207-217, 1983.

D. Bella, Ecological Indicators of Global Climate Change: A Research Framework, Environmental Management, 18:4, pp. 489-500, 1994.

E. Cooter, S. LeDuc, and L. Truppi, Climate Research for Ecological Monitoring and Assessment: A New England Example, Climate Research, 2, pp. 101-112, 1992.

G. Woodwell, Effects of Pollution on the Structure and Physiology of Ecosystems, Science, 168, pp. 429-433, 1970.

E. Odum, Trends Expected in Stressed Ecosystems, Bioscience, 35, pp. 419-422, 1985.

D. W. Schindler, Experimental Perturbation of Whole Lakes as Tests of Hypotheses Concerning Ecosystem Structure and Function, Oikos, 57, pp. 25-41, 1990.

T. Lefroy and R. Hobbs, Ecological Indicators for Sustainable Agriculture, Australian Journal of Soil and Water Conservation, 5:4, pp. 22-28, 1992.

P. Sheehan, Effects on Community and Ecosystem Structure and Dynamics, in Effects of Pollutants at the Ecosystem Level, SCOPE 22, P. Sheehan, D. Miller, C. Butler, and P. Bourdeau (eds.), John Wiley & Sons, New York, pp. 51-99, 1984.

P. J. Sheehan, Functional Changes in the Ecosystem, in Effects of Pollutants at the Ecosystem Level, SCOPE 22, P. J. Sheehan, D. R. Miller, and G. C. Butler (eds.), John Wiley & Sons, New York, pp. 101-146, 1984.

D. R. Miller, Distinguishing Ecotoxic Effects, in Effects of Pollutants at the Ecosystem Level, P. Sheehan, D. Miller, G. Butler, and P. Bourdeau (eds.), John Wiley & Sons, New York, pp. 15-22, 1984.

H. de Kruijf, Extrapolation through Hierarchical Levels, Comparative Biochemistry and Physiology, 100C(1/2), pp. 291-299, 1991.

J. Kimmins, Monitoring the Condition of the Canadian Forest Environment: The Relevance of the Concept of "Ecological Indicators," Environmental Monitoring and Assessment, 15, pp. 231-240, 1990.

F. Taub, Indicators of Change in Natural and Human-Impacted Ecosystems: Status, in Preserving Ecological Systems: The Agenda for Long-Term Research and Development, S. Draggan, J. Cohrssen, and R. Morrison (eds.), Praeger, New York, pp. 115-144, 1987.

J. R. Kelly and M. A. Harwell, Indicators of Ecosystem Response and Recovery, in Ecotoxicology: Problems and Approaches, S. Levin, M. Harwell, J. Kelly, and K. Kimball (eds.), Springer-Verlag, New York, pp. 9-39, 1989.

M. Harwell and C. Harwell, Environmental Decision-Making in the Presence of Uncertainty, in Ecotoxicology: Problems and Approaches, S. Levin, M. Harwell, J. Kelly, and K. Kimball (eds.), Columbia University Press, New York, pp. 516-540, 1989.

A. R. Johnson, Evaluating Ecosystem Response to Toxicant Stress: A State Space Approach, in Aquatic Toxicology and Hazard Assessment: 10th Volume, ASTPM STP 971, American Society for Testing and Materials, pp. 275-285, 1988.

A. R. Johnson, Diagnostic Variables as Predictors of Ecological Risk, Environmental Management, 12:4, pp. 515-523, 1988.

J. R. Newman and K. R. Schreiber, Animals as Indicators of Ecosystem Responses to Air Emissions, Environmental Management, 8:4, pp. 309-324, 1984.

R. F. Noss, Indicators for Monitoring Biodiversity—A Hierarchical Approach, Conservation Biology, 4:4, pp. 355-364, 1990.

B. Williams and M. Marcot, Use of Biodiversity Indicators for Analyzing and Managing Forested Landscapes, in Transactions of the 56th North American Wildlife and Natural Resources Conference, R. McCabe (ed.), Wildlife Management Institute, Washington, D. C., pp. 613-627, 1991.

W. Reid, J. McNeely, D. Tunstall, D. Bryant, and M. Winograd, Biodiversity Indicators for Policy-Makers, World Resources Institute (WRI) Publication, ISBN 1-56973-000-8, WRI, Washington, D. C., 1993.

D. Bruns, G. B. Wiersma, and G. Minshall, Evaluation of Community and Ecosystem Monitoring Parameters at a High-Elevation, Rocky Mountain Site, Environmental Toxicology and Chemistry, 11, pp. 459-472, 1992.

D. Bruns, G. B. Wiersma, and E. Rykiel, Ecosystem Monitoring at Global Baseline Sites, Environmental Monitoring and Assessment, 17:1, pp. 3-31, 1991.

P. Herrmann and R. Stottlemyer, Long-Term Monitoring for Environmental Change in United States National Parks—A Watershed Approach, Environmental Monitoring and Assessment, 17:1, pp. 51-65, 1991.

R. Vora, Developing Programs to Monitor Ecosystem Health and Effectiveness of Management Practices on Lakes States National Forests, USA, Biological Conservation, 80, pp. 289-302, 1997.

H. Udo de Haes, M. Nip, and F. Klijn, Towards Sustainability: Indicators of Environmental Quality, in In Search of Indicators of Sustainable Development, O. Kuik and H. Verbruggen (eds.), Kluwer Academic Publishers, Dordrecht, the Netherlands, pp. 89-105, 1991.

P. A. Keddy, Biological Monitoring and Ecological Prediction: From Nature Reserve Management to National State of the Environment Indicators, in Monitoring for Conservation and Ecology, B. Goldsmith (ed.), Chapman and Hall, London, 1991.

C. Bost and Y. Maho, Seabirds as Bioindicators of Changing Marine Ecosystems: New Perspectives, Acta Oecologica, 14:3, pp. 463-470, 1993.

D. Silsbee and D. Peterson, Planning and Implementation of Long-Term Resource Monitoring Programs, Environmental Monitoring and Assessment, 26, pp. 177-185, 1993.

T. A. Hanley, Potential Role of Deer (Cervidae) as Ecological Indicators of Forest Management, Forest Ecology and Management, 88, pp. 199-204, 1996.

T. A. Hanley, the Use of Black-Tailed Deer as an Ecological Indicator, Biological Conservation, 66:1, pp. 61-68, 1993.

M. Palmer, Potential Biases in Site and Species Selection for Ecological Monitoring, Environmental Monitoring and Assessment, 26, pp. 277-282, 1993.

P. Landres, J. Verner, and J. Thomas, Ecological Uses of Vertebrate Indicator Species: A Critique, Conservation Biology, 2, pp. 316-328, 1988.

J. Caims, Jr. and P. V. McCormick, Developing an Ecosystem-Based Capability for Ecological Risk Assessments, The Environmental Professional, 14, pp. 186-196, 1992.

Alberti, M. and J. D. Parker, Indices of Environmental Quality: The Search for Credible Measures, Environmental Impact Assessment Review, 11, pp. 95-101, 1991.

L. Bardwell, Problem-Framing: A Perspective on Environmental Problem-Solving, Environmental Management, 15:5, pp. 603-612, 1991.

D. J. Rapport, Workgroup Issue Paper. Criteria for Ecological Indicators, Environmental Monitoring and Assessment, 15, pp. 273-275, 1990.

G. Krantzberg, Rapporteur's Report of Work Group: Indicators at Community or Systems Level, Environmental Monitoring and Assessment, 15, pp. 283-284, 1990.

K. Day, Rapporteur's Report of Work Group: Indicators at the Species and Biochemical Level, Environmental Monitoring and Assessment, 15, pp. 277-279, 1990.

D. Liverman, M. Hanson, B. Brown, and R. Merideth, Global Sustainability: Towards Measurement, Environmental Management, 12, pp. 133-143, 1988.

T. M. Frost, S. R. Carpenter, T. K. Kratz, and J. Magnuson, Choosing Ecological Indicators of Condition: Effect of Taxonomic Aggregation on Sensitivity to Stress and Natural Variability, in Ecological Indicators, D. McKenzie, D. E. Hyatt, and J. McDonald (eds.), Elsevier, Essex, England, 1992.

J. Cairns, Jr., Determining Desirable Levels of Ecosystem Services per capita, Journal of Aquatic Ecosystem Health, 2, pp. 237-242, 1993.

P. Seidl and P. Murray (eds.), A Proposed Framework for Developing Indicators of Ecosystem Health for the Great Lakes Region, Council of Great Lakes Resource Managers, International Joint Commission, Windsor, Ontario, 1991.

T. Marshall, R. A. Ryder, C. J. Edwards, and G. R. Spangler, Using the Lake Trout as an Indicator of Ecosystem Health: Application of the Dichotomous Key, Great Lakes Fishery Commission Technical Report No. 49, Great Lakes Fishery Commission, Ann Arbor, Michigan, 1987.

K. Riitters and J. Barnard, Criteria for Evaluating Indicators of Forest Health, in Global Natural Resources Monitoring and Assessments: Preparing for the 21st Century, H. Lund and G. Preto (eds.), American Society for Photogrammetry and Remote Sensing, Bethesda, Maryland, 1990.

G. Bergkamp, A Hierarchical Approach for Desertification Assessment, Environmental Monitoring and Assessment, 37:1/3, pp. 59-78, 1995.

M. Soule, Biodiversity Indicators in California: Taking Nature's Temperature, California Agriculture, 49:6, pp. 40-44, 1995.

S. Adams and M. Ryon, A Comparison of Health Assessment Approaches for Evaluating the Effects of Contaminant-Related Stress on Fish Populations, Journal of Aquatic Ecosystem Health, 3, pp. 15-25, 1994.

J. Loftis, G. McBride, and J. Ellis, Consideration of Scale in Water Quality Monitoring and Data Analysis, Water Resources Bulletin, 27:2, pp. 255-264, 1991.

D. Larsen, N. S. Urquhart, and D. Kugler, Regional Scale Trend Monitoring of Indicators of Trophic Condition of Lakes, Water Resources Bulletin, 31:1, pp. 117-140, 1995.

J. Kolasa and S. T. A. Pickett, Ecosystem Stress and Health: An Expansion of the Conceptual Basis, Journal of Aquatic Ecosystem Health, 1:1, pp. 7-14, 1992.

E. Herricks, D. J. Schaeffer, and J. Perry, Biomonitoring: Closing the Loop in the Environmental Sciences, in Ecotoxicology: Problems and Approaches, S. Levin, M. Harwell, J. Kelly, and K. Kimball (eds.), Columbia University Press, New York, pp. 351-366, 1989.

American Management Systems, Inc., Review of the Literature on Ecological Endpoints, Report to the Office of Policy, Planning and Evaluation, U. S. Environmental Protection Agency, EPA Contract No. 68-01-7002, American Management Systems, Arlington, Virginia, 1987.

J. Cairns, Jr., the Genesis of Biomonitoring in Aquatic Ecosystems, The Environmental Professional, 12, pp. 169-176, 1990.

R. Diaz, Ecosystem Assessment using Estuarine and Marine Benthic Community Structures, in Sediment Toxicity Assessment, G. Burton, Jr. (ed.), Lewis Publishers, Boca Raton, Florida, pp. 67-85, 1992.

J. Innes, Theoretical and Practical Criteria for the Selection of Ecosystem Monitoring Plots in Swiss Forests, Environmental Monitoring and Assessment, 36:3, pp. 271-294, 1995.

Y. A. Izrael and R. Munn, Monitoring the Environment and Renewable Resources, in Sustainable Development of the Biosphere, W. Clark and R. Munn (eds.), Cambridge University Press, Cambridge, England, pp. 360-375, 1986.

G. MacDonald, A More Complete Picture: Combined Approach Measures Aquatic Ecosystem Health, Water Environment and Technology, 7:11, pp. 25-36, 1995.

R. Munn, the Design of Integrated Monitoring Systems to Provide Early Indications of Environmental/Ecological Changes, Environmental Monitoring and Assessment, 11, pp. 203-217, 1988.

S. C. Trombulak, Ecological Health and the Northern Forest, Vermont Law Review, 19:2, pp. 283-298, 1995.

P. Ringold, J. Alegria, R. Czaplewski, B. Mulder, T. Tolle, and K. Burnett, Adaptive Monitoring Design for Ecosystem Management, Ecological Applications, 6:3, pp. 745-747, 1996.

C. Holling (ed.), Adaptive Environmental Assessment and Management, Wiley Publishers, Chichester, England, 1978.

E. Podlesakova and J. Nemecek, Retrospective Monitoring and Inventory of Soil Contamination in Relation to Systematic Monitoring, Environmental Monitoring and Assessment, 34:2, pp. 121-125, 1995.

D. J. Rapport, C. Gaudet, and P. Calow, Monitoring and Evaluating the Health of Regional Scale Ecosystems, Springer-Verlag, Berlin and Heidelberg, 1995.

E. Herricks and D. J. Schaeffer, Can We Optimize Biomonitoring? Environmental Management, 9, pp. 487-492, 1985.

G. W. Suter II, Ecological Endpoints, in Ecological Assessment of Hazardous Waste Sites: A Field and Laboratory Reference, W. Warren-Hicks, B. Parkhurst, and S. Baker, Jr. (eds.), U. S. Environmental Protection Agency, Corvallis, Oregon, pp. 2-1, 2-28, 1989.

G. W. Suter II, Endpoints for Regional Ecological Risk Assessments, Environmental Management, 14:1, pp. 9-23, 1990.

W. Kreisel, Representation of the Environmental Quality Profile of a Metropolitan Area, Environmental Monitoring and Assessment, 4:1, pp. 15-33, 1984.