CADDIS Volume 1: Stressor Identification
Step 3: Evaluate Data from the Case
Related Links
On this page
- Concept
- Examples
- How do I analyze the data?
- What evidence would support or weaken the case for a candidate cause?
- How do I score the evidence?
- Helpful tips
Types of evidence
Verified Predictions
Concept
Knowledge of a cause's mode of action permits prediction and subsequent confirmation of previously unobserved effects.
Examples
Consider organophosphate pesticides as a candidate cause of reduced aquatic insect abundance. What findings support or weaken the case for these pesticides as the cause, based on evidence garnered from predicted effects?
- Supporting evidence - Monitoring data show that other taxa sensitive to cholinesterase inhibitors (e.g., crayfish) have declined at the impaired site, while taxa without cholinergic receptors (e.g., rotifers) have not been adversely affected.
- Weakening evidence - Monitoring data show that taxa predicted to decrease with exposure to organophosphates are not reduced at the impaired site, whereas taxa predicted to be unaffected have declined.
How do I Analyze My Data?
Prediction requires knowledge of effects that occur with particular causes. If other candidates may cause the effect, successful prediction of the effect is only weakly supportive. The prediction may involve evidence of temporal sequence, spatial/temporal co-occurrence, stressor-response relationships, exposure or mechanism, causal pathway, or manipulations. For this reason, special care should be taken to avoid biasing the analysis by using the same evidence more than once. This type of evidence can greatly strengthen the case for a candidate cause, if it truly results from a prediction, because predictions are based on a deeper knowledge of mechanisms driving potential cause-effect interactions.
The logical constraints and statistical tests appropriate for analysis of predictions depend on the nature of the prediction or the type of evidence the prediction addresses; these issues have already been discussed under previous types of evidence from the case.
Examples of analysis in support of Verified Predictions:
What evidence would support or weaken the case for a candidate cause?
Supports
- Data showing that a predicted, previously undocumented effect is observed at the impaired site
Weakens
- Data showing that a predicted, previously undocumented effect is not observed at the impaired site
Refutes
- Data showing, with a high degree of certainty, that a predicted obligatory effect does not occur at the impaired site
How do I score the evidence?
Finding | Interpretation | Score |
---|---|---|
Specific or multiple predictions of other effects of the candidate cause are confirmed. | This finding convincingly supports the case for the candidate cause, because predictions confirm a mechanistic understanding of the causal relationship, and verification of a predicted association is stronger evidence than associations explained after the fact. | + + + |
A general prediction of other effects of the candidate cause is confirmed. | This finding somewhat supports the case for the candidate cause, but is not strongly supportive because another cause may be responsible. | + |
It is unclear whether predictions of other effects of the candidate cause are confirmed. | This finding neither supports nor weakens the case for the candidate cause. | 0 |
A prediction of other effects of the candidate cause fails to be confirmed. | This finding somewhat weakens the case for the candidate cause, but is not strongly weakening, because other factors may mask or interfere with the predicted effect. | - |
Multiple predictions of other effects of the candidate cause fail to be confirmed. | This finding convincingly weakens the case for the candidate cause. | - - - |
Specific predictions of other effects of the candidate cause fail to be confirmed, and the evidence is indisputable. | This finding refutes the case for the candidate cause. | R |
Helpful tips
- The power of this type of evidence resides in making predictions, rather than explaining the reasons for observations post hoc; observation without a prior prediction is simply descriptive.
- The best predictions are specific and unambiguous.
Evaluate Data from the Case: In-Depth Look | Evaluate Data from Elsewhere: In-Depth Look | Step-by-Step Guide Introduction