(A) Is the economic evaluation valid?
Screening Questions
1. Was a well-defined question posed?
HINT: Is it clear what the authors are trying to achieve?
- What is the perspective?
- How many options are compared?
- Are both costs and consequences considered?
- What is the time horizon?
Yes Can’t tell No
2. Was a comprehensive description of the competing alternatives given?
HINT: Is there a clear decision tree (or similar given):
- Can you tell who did what, to whom, where and how often?
Yes Can’t tell No
Is it worth continuing?
Detailed questions
3. Does the paper provide evidence that the programme would be effective (i.e. would the programme do more good than harm)?
HINT: Consider:
- if an RCT or systematic review was used; if not consider how strong the evidence was
(Economic evaluations frequently have to integrate different types of knowledge stemming from different study designs)
Yes Can’t tell No
4. Were the effects of the intervention identified, measured and valued appropriately?
HINT: Effects can be measured in natural units (e.g. years of life) or more complex units (e.g. years adjusted for quality of life such as QALYs) or monetary equivalents of the benefit gained
(e.g. $)
Yes Can’t tell No
(B) How were consequences and costs assessed and compared?
5. Were all important and relevant resources required and health outcome costs for each alternative identified, measured in appropriate units and valued credibly?
HINT: Identified?
- Remember the perspective being taken
HINT: Measured accurately in appropriate units prior to evaluation?
- Appropriate units may be hours of nursing time,
Number of physician visits, years-of-life gained etc.
HINT: Valued credibly?
- Are the values realistic?
- How have they been derived?
- Have opportunity costs been considered?
Yes Can’t tell No
6. Were costs and consequences adjusted for different times at which they occurred (discounting)?
Yes Can’t tell No
7. What were the results of the evaluation?
HINT: Consider
- What is the bottom line?
- What units were used (e.g. cost/life year gained, Cost/QALY, net benefit)?
Yes Can’t tell No
8. Was an incremental analysis of the consequences and cost of alternatives performed?
Yes Can’t tell No
9. Was an adequate sensitivity analysis performed?
HINT: Consider
- If all the main areas of uncertainty were considered by changing the estimate of the variable and
- looking at how this would change the result of the
economic evaluation
Yes Can’t tell No
(C) Will the results help in purchasing for local people?
10. Is the programme likely to be equally effective in your context or setting?
HINT: Consider whether
- the patients covered by the review could be sufficiently different to your population to cause concern
- your local setting is likely to differ much from that of the review
Yes Can’t tell No
11. Are the costs translatable to your setting?
Yes Can’t tell No
12. Is it worth doing in your setting?
Yes Can’t tell No