Home SDM Overview Steps Tools Applications Contact
Defined Level Scales

Define and describe discrete levels of impact. Use a small and consistent set of factors to define each level. For Example: To compare the degree of public support or collaboration for different facility siting options, it may be important to consider both:

  • Number of groups who oppose or support the facility 

  • Strength of their support/opposition 

The following attribute was used in Keeney and Sicherman (1983) in an analysis to evaluate potential power plant sites. From Gregory and Keeney (2003).
Level Description
1 Support - No groups are opposed to the facility and at least one group has organized support for the facility.
0 Neutrality - All groups are indifferent or uninterested.
-1 Controversy - One or more groups have organized opposition, although no groups have organized action-oriented opposition. Other groups may be either neutral or support the facility.
-2 Action-oriented opposition - Exactly one group has action-oriented opposition. Other groups have organized support, indifference or organized opposition.
-3 Strong action-oriented opposition - Two or more groups have action-oriented opposition.

Such scales are useful in an ecological context as well. To rank environmental problems in one are of the country, the US EPA used a defined impact scale based on: 

  • Magnitude of impact on assimilative capacity 

  • Duration of the impact 

The resulting constructed scale is shown below (EPA 1993).
Level Description
1 Problem reduces assimilative capacity of the natural system through destruction of vegetation and microorganism populations.
2 Problem exceeds the assimilative capacity of the natural system for less than one year.
3 Problem exceeds the assimilative capacity of the natural system for more than one year and less than five years.
4 Problem continually exceeds the assimilative capacity of the natural system. Problem lasts more than five years but less than 50 years
5 Problem continually exceeds the assimilative capacity of the natural system. Problem lasts more than 50 years.

Key challenges in developing good constructed scales include: 

  • Making them unambiguous (specific rather than vague) and consistently applied

  • Providing appropriate treatment for the value judgments embedded in them 

These topics are addressed in the discussion questions.

Quantity/Quality Scales

A scale that weights the quantity of something by its quality. It's used when the impact is determined both by quantity and quality. For example:
Emissions volume x concentration or tonnes x toxicity rating
Algal productivity area x density
Productive capacity area x % loss
Employment # jobs x % of full time
 

Yes/No Criteria

Yes/no criteria can be useful in cases where there are clear thresholds - e.g., compliance with a regulatory standard or legal requirement. However, use caution in using "consistency" with a policy directive or with practices in other jurisdictions as an evaluation criterion. It is usually much better to identify the underlying fundamental objective that this consistency is meant to address. 

Yes/no criteria can also usefully be used at a screening stage - even if there is no firm threshold for acceptability, it may be possible to establish some value for a criterion that clearly is not acceptable and use this to screen out clearly unacceptable alternatives.

However, Yes/no criteria often hide important trade-off information; for example consider one alternative that is 2% below a threshold, and another that is 50% below a threshold. In some cases, we would probably want to know that the first alternative almost made the threshold whereas the second missed it by a long way. With a Yes/no criterion, we would be indifferent to these two alternatives because both would simply rate 'no'.

Key Ideas
Defined level scales reduce the ambiguity often found when using scales with ambiguous descriptions

Copyright 2008 Compass Resource Management Ltd. All rights reserved