J Epidemiol Community Health

HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS REGISTER
[Advanced]

This Article
Right arrow Full Text
Right arrow Full Text (PDF)
Right arrow Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this link to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Add article to my folders
Right arrow Download to citation manager
Right arrowRequest Permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Rychetnik, L
Right arrow Articles by Shiell, A
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Rychetnik, L
Right arrow Articles by Shiell, A
Journal of Epidemiology and Community Health 2002;56:119-127
© 2002 Journal of Epidemiology and Community Health


THEORY AND METHODS

Criteria for evaluating evidence on public health interventions

L Rychetnik1, M Frommer1, P Hawe2, A Shiell2

1 Effective Healthcare Australia, School of Population Health and Health Services Research, University of Sydney, Australia
2 Department of Community Health Sciences, University of Calgary, Canada and School of Public Health, LaTrobe University, Australia

Correspondence to:
Correspondence to:
Lucie Rychetnik, Effective Healthcare Australia, Victor Coppleson Building, DO2, University of Sydney, NSW 2006, Australia;
lucier{at}med.usyd.edu.au

Public health interventions tend to be complex, programmatic, and context dependent. The evidence for their effectiveness must be sufficiently comprehensive to encompass that complexity. This paper asks whether and to what extent evaluative research on public health interventions can be adequately appraised by applying well established criteria for judging the quality of evidence in clinical practice. It is adduced that these criteria are useful in evaluating some aspects of evidence. However, there are other important aspects of evidence on public health interventions that are not covered by the established criteria. The evaluation of evidence must distinguish between the fidelity of the evaluation process in detecting the success or failure of an intervention, and the success or failure of the intervention itself. Moreover, if an intervention is unsuccessful, the evidence should help to determine whether the intervention was inherently faulty (that is, failure of intervention concept or theory), or just badly delivered (failure of implementation). Furthermore, proper interpretation of the evidence depends upon the availability of descriptive information on the intervention and its context, so that the transferability of the evidence can be determined. Study design alone is an inadequate marker of evidence quality in public health intervention evaluation.


Keywords: public health intervention




This article has been cited by other articles:


Home page
J. Epidemiol. Community HealthHome page
C Bambra, M Whitehead, A Sowden, J Akers, and M Petticrew
"A hard day's night?" The effects of Compressed Working Week interventions on the health and work-life balance of shift workers: a systematic review
J. Epidemiol. Community Health, September 1, 2008; 62(9): 764 - 777.
[Abstract] [Full Text] [PDF]


Home page
J. Epidemiol. Community HealthHome page
K-C Tang, B C K Choi, and R Beaglehole
Grading of evidence of the effectiveness of health promotion interventions
J. Epidemiol. Community Health, September 1, 2008; 62(9): 832 - 834.
[Abstract] [Full Text] [PDF]


Home page
HEALTH PROMOT INTHome page
S. Ramanathan, K. R. Allison, G. Faulkner, and J. J. M. Dwyer
Challenges in assessing the implementation and effectiveness of physical activity and nutrition policy interventions as natural experiments
Health Promot. Int., September 1, 2008; 23(3): 290 - 297.
[Abstract] [Full Text] [PDF]


Home page
Health Policy PlanHome page
C. K. deWilde, A. Milman, Y. Flores, J. Salmeron, and I. Ray
An integrated method for evaluating community-based safe water programmes and an application in rural Mexico
Health Policy Plan., August 7, 2008; (2008) czn017v1.
[Abstract] [Full Text] [PDF]


Home page
Inj. Prev.Home page
Y. Robitaille and L. Gauvin
Fall prevention in older adults: towards an integrated population-based perspective
Inj. Prev., June 1, 2008; 14(3): 147 - 148.
[Full Text] [PDF]


Home page
Fam PractHome page
M. Slade, L. Gask, M. Leese, P. McCrone, C. Montana, R. Powell, M. Stewart, and C. Chew-Graham
Failure to improve appropriateness of referrals to adult community mental health services--lessons from a multi-site cluster randomized controlled trial
Fam. Pract., June 1, 2008; 25(3): 181 - 190.
[Abstract] [Full Text] [PDF]


Home page
HEALTH PROMOT INTHome page
B. Spencer, U. Broesskamp-Stone, B. Ruckstuhl, G. Ackermann, A. Spoerri, and B. Cloetta
Modelling the results of health promotion activities in Switzerland: development of the Swiss Model for Outcome Classification in Health Promotion and Prevention
Health Promot. Int., March 1, 2008; 23(1): 86 - 97.
[Abstract] [Full Text] [PDF]


Home page
J. Epidemiol. Community HealthHome page
C. Bambra, M. Egan, S. Thomas, M. Petticrew, and M. Whitehead
The psychosocial and health effects of workplace reorganisation. 2. A systematic review of task restructuring interventions
J. Epidemiol. Community Health, December 1, 2007; 61(12): 1028 - 1037.
[Abstract] [Full Text] [PDF]


Home page
COMMUNITY DEV JHome page
J. Adams, K. Witten, and K. Conway
Community development as health promotion: evaluating a complex locality-based project in New Zealand
Community Dev. J., November 16, 2007; (2007) bsm049v1.
[Abstract] [Full Text] [PDF]


Home page
J. Epidemiol. Community HealthHome page
M. Egan, C. Bambra, S. Thomas, M. Petticrew, M. Whitehead, and H. Thomson
The psychosocial and health effects of workplace reorganisation. 1. A systematic review of organisational-level interventions that aim to increase employee control
J. Epidemiol. Community Health, November 1, 2007; 61(11): 945 - 954.
[Abstract] [Full Text] [PDF]


Home page
J Public Health (Oxf)Home page
E. Waters, N. Priest, R. Armstrong, S. Oliver, P. Baker, D. McQueen, C. Summerbell, M. P. Kelly, and B. Swinburn
The role of a Prospective Public Health Intervention Study Register in building public health evidence: proposal for content and use
J. Public Health Med., September 1, 2007; 29(3): 322 - 327.
[Abstract] [Full Text] [PDF]


Home page
Health Educ ResHome page
E. L. James, C. Fraser, K. Anderson, and F. Judd
Use of research by the Australian health promotion workforce
Health Educ. Res., August 1, 2007; 22(4): 576 - 587.
[Abstract] [Full Text] [PDF]


Home page
Health Educ ResHome page
L. McLaren, L. M. Ghali, D. Lorenzetti, and M. Rock
Out of context? Translating evidence from the North Karelia project over place and time
Health Educ. Res., June 1, 2007; 22(3): 414 - 424.
[Abstract] [Full Text] [PDF]


Home page
Occup. Environ. Med.Home page
P J Nicholson
How to undertake a systematic review in an occupational setting
Occup. Environ. Med., May 1, 2007; 64(5): 353 - 358.
[Full Text] [PDF]


Home page
Integr Cancer TherHome page
M. J. Verhoef, L. C. Vanderheyden, and V. Fonnebo
A whole systems research approach to cancer care: why do we need it and how do we get started?
Integr Cancer Ther, December 1, 2006; 5(4): 287 - 292.
[Abstract] [PDF]


Home page
Eur J Public HealthHome page
R S. Kovats and L E. Kristie
Heatwaves and public health in Europe
Eur J Public Health, December 1, 2006; 16(6): 592 - 599.
[Abstract] [Full Text] [PDF]


Home page
Inj. Prev.Home page
S Mallonee, C Fowler, and G R Istre
Bridging the gap between research and practice: a continuing challenge
Inj. Prev., December 1, 2006; 12(6): 357 - 359.
[Full Text] [PDF]


Home page
J. Epidemiol. Community HealthHome page
K. Whittaker, C. Sutton, and C. Burton
Pragmatic randomised controlled trials in parenting research: the issue of intention to treat.
J. Epidemiol. Community Health, October 1, 2006; 60(10): 858 - 864.
[Abstract] [Full Text] [PDF]


Home page
Eur J Public HealthHome page
K. Stronks and J. P. Mackenbach
Evaluating the effect of policies and interventions to address inequalities in health: lessons from a Dutch programme
Eur J Public Health, August 1, 2006; 16(4): 346 - 353.
[Abstract] [Full Text] [PDF]


Home page
J. Epidemiol. Community HealthHome page
E. Waters, J. Doyle, N. Jackson, F. Howes, G. Brunton, and A. Oakley
Evaluating the effectiveness of public health interventions: the role and activities of the Cochrane Collaboration.
J. Epidemiol. Community Health, April 1, 2006; 60(4): 285 - 289.
[Abstract] [Full Text] [PDF]


Home page
HEALTH PROMOT INTHome page
S. Wang, J. R. Moss, and J. E. Hiller
Applicability and transferability of interventions in evidence-based public health
Health Promot. Int., March 1, 2006; 21(1): 76 - 83.
[Abstract] [Full Text] [PDF]


Home page
HEALTH PROMOT INTHome page
M. Dooris
Healthy settings: challenges to generating evidence of effectiveness
Health Promot. Int., March 1, 2006; 21(1): 55 - 65.
[Abstract] [Full Text] [PDF]


Home page
BMJHome page
A. Oakley, V. Strange, C. Bonell, E. Allen, J. Stephenson, and RIPPLE Study Team
Process evaluation in randomised controlled trials of complex interventions.
BMJ, February 18, 2006; 332(7538): 413 - 416.
[Full Text] [PDF]


Home page
J. Epidemiol. Community HealthHome page
H. Thomson, R. Atkinson, M. Petticrew, and A. Kearns
Do urban regeneration programmes improve public health and reduce health inequalities? A synthesis of the evidence from UK policy and practice (1980-2004)
J. Epidemiol. Community Health, February 1, 2006; 60(2): 108 - 115.
[Abstract] [Full Text] [PDF]


Home page
HEALTH PROMOT INTHome page
N. Jackson, E. Waters, and for the Guidelines for Systematic Reviews in Healt
Criteria for the systematic review of health promotion and public health interventions
Health Promot. Int., December 1, 2005; 20(4): 367 - 374.
[Abstract] [Full Text] [PDF]


Home page
J. Epidemiol. Community HealthHome page
D. Ogilvie, M. Egan, V. Hamilton, and M. Petticrew
Systematic reviews of health effects of social interventions: 2. Best available evidence: how low should you go?
J. Epidemiol. Community Health, October 1, 2005; 59(10): 886 - 892.
[Abstract] [Full Text] [PDF]


Home page
Br. J. Ophthalmol.Home page
T Y Wong
Cataract surgery programmes in Africa
Br. J. Ophthalmol., October 1, 2005; 89(10): 1231 - 1232.
[Full Text] [PDF]


Home page
J. Epidemiol. Community HealthHome page
D. Ogilvie, V. Hamilton, M. Egan, and M. Petticrew
Systematic reviews of health effects of social interventions: 1. Finding the evidence: how far should you go?
J. Epidemiol. Community Health, September 1, 2005; 59(9): 804 - 808.
[Abstract] [Full Text] [PDF]


Home page
Palliat MedHome page
S. M Aoun and L. J Kristjanson
Challenging the framework for evidence in palliative care research
Palliative Medicine, September 1, 2005; 19(6): 461 - 465.
[Abstract] [PDF]


Home page
Am J EpidemiolHome page
L. Tooth, R. Ware, C. Bain, D. M. Purdie, and A. Dobson
Quality of Reporting of Observational Longitudinal Research
Am. J. Epidemiol., February 1, 2005; 161(3): 280 - 288.
[Abstract] [Full Text] [PDF]


Home page
Arch. Dis. Child.Home page
D Ogilvie
Hospital based alternatives to acute paediatric admission: a systematic review
Arch. Dis. Child., February 1, 2005; 90(2): 138 - 142.
[Abstract] [Full Text] [PDF]


Home page
Health Educ ResHome page
B. Rush, A. Shiell, and P. Hawe
A census of economic evaluations in health promotion
Health Educ. Res., December 1, 2004; 19(6): 707 - 719.
[Abstract] [Full Text] [PDF]


Home page
BMJHome page
D. Ogilvie, M. Egan, V. Hamilton, and M. Petticrew
Promoting walking and cycling as an alternative to using cars: systematic review
BMJ, October 2, 2004; 329(7469): 763.
[Abstract] [Full Text] [PDF]


Home page
J. Epidemiol. Community HealthHome page
M. Petticrew, M. Whitehead, S. J Macintyre, H. Graham, and M. Egan
Evidence for public health policy on inequalities: 1: The reality according to policymakers
J. Epidemiol. Community Health, October 1, 2004; 58(10): 811 - 816.
[Abstract] [Full Text] [PDF]


Home page
Health Educ ResHome page
R. Power, L. F. Langhaug, T. Nyamurera, D. Wilson, M. T. Bassett, and F. M. Cowan
Developing complex interventions for rigorous evaluation--a case study from rural Zimbabwe
Health Educ. Res., October 1, 2004; 19(5): 570 - 575.
[Abstract] [Full Text] [PDF]


Home page
J. Epidemiol. Community HealthHome page
P. Hawe, A. Shiell, T. Riley, and L. Gold
Methods for exploring implementation variation and local context within a cluster randomised community intervention trial
J. Epidemiol. Community Health, September 1, 2004; 58(9): 788 - 793.
[Abstract] [Full Text] [PDF]


Home page
J. Epidemiol. Community HealthHome page
L. Rychetnik, P. Hawe, E. Waters, A. Barratt, and M. Frommer
A glossary for evidence based public health
J. Epidemiol. Community Health, July 1, 2004; 58(7): 538 - 545.
[Abstract] [Full Text] [PDF]


Home page
J. Epidemiol. Community HealthHome page
A Adily and J Ward
Evidence based practice in population health: a regional survey to inform workforce development and organisational change
J. Epidemiol. Community Health, June 1, 2004; 58(6): 455 - 460.
[Abstract] [Full Text] [PDF]


Home page
HEALTH PROMOT INTHome page
E. A. Abbema, P. Van Assema, G. J. Kok, E. De Leeuw, and N. K. De Vries
Effect evaluation of a comprehensive community intervention aimed at reducing socioeconomic health inequalities in the Netherlands
Health Promot. Int., June 1, 2004; 19(2): 141 - 156.
[Abstract] [Full Text] [PDF]


Home page
HEALTH PROMOT INTHome page
L. Rychetnik and M. Wise
Advocating evidence-based health promotion: reflections and a way forward
Health Promot. Int., June 1, 2004; 19(2): 247 - 257.
[Abstract] [Full Text] [PDF]


Home page
ANN INTERN MEDHome page
L. Jack Jr., L. Liburd, T. Spencer, and C. O. Airhihenbuwa
Understanding the Environmental Issues in Diabetes Self-Management Education Research: A Reexamination of 8 Studies in Community-Based Settings
Ann Intern Med, June 1, 2004; 140(11): 964 - 971.
[Abstract] [Full Text] [PDF]


Home page
J. Epidemiol. Community HealthHome page
H Roberts, K Curtis, K Liabo, D Rowland, C DiGuiseppi, and I Roberts
Putting public health evidence into practice: increasing the prevalence of working smoke alarms in disadvantaged inner city housing
J. Epidemiol. Community Health, April 1, 2004; 58(4): 280 - 285.
[Abstract] [Full Text] [PDF]


Home page
BMJHome page
H. Thomson, R. Hoskins, M. Petticrew, D. Ogilvie, N. Craig, T. Quinn, and G. Lindsay
Evaluating the health effects of social interventions
BMJ, January 31, 2004; 328(7434): 282 - 285.
[Full Text] [PDF]


Home page
J. Epidemiol. Community HealthHome page
K C Tang, J P Ehsani, and D V McQueen
Evidence based health promotion: recollections, reflections, and reconsiderations
J. Epidemiol. Community Health, November 1, 2003; 57(11): 841 - 843.
[Full Text] [PDF]


Home page
Health Educ BehavHome page
S. S. Bull, C. Gillette, R. E. Glasgow, and P. Estabrooks
Work Site Health Promotion Research: To what Extent can we Generalize the Results and what is Needed to Translate Research to Practice?
Health Educ Behav, October 1, 2003; 30(5): 537 - 549.
[Abstract] [PDF]


Home page
J. Epidemiol. Community HealthHome page
M Petticrew and H Roberts
Evidence, hierarchies, and typologies: horses for courses
J. Epidemiol. Community Health, July 1, 2003; 57(7): 527 - 529.
[Abstract] [Full Text] [PDF]


Home page
J. Epidemiol. Community HealthHome page
D V McQueen
The evidence debate
J. Epidemiol. Community Health, February 1, 2002; 56(2): 83 - 84.
[Full Text] [PDF]




HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS REGISTER
Terms and conditions relating to subscriptions purchased online  ¦  Website terms and conditions  ¦  Privacy policy
Copyright © 2002 by the BMJ Publishing Group Ltd.