European Journal of Vascular & Endovascular Surgery
Volume 40, Issue 5 , Pages 669-677 , November 2010

Quality Control in Systematic Reviews and Meta-analyses

  • M.J. Bown

      Affiliations

    • The University of Leicester, Department of Cardiovascular Sciences, Robert Kilpatrick Clinical Sciences Building, Leicester Royal Infirmary, Leicester LE2 7LX, United Kingdom
    • Corresponding Author InformationCorresponding author. Tel.: +44 1162523252; fax: +44 1162523179.
    • ,
  • A.J. Sutton

      Affiliations

    • The University of Leicester, Department of Health Sciences, United Kingdom

Received 7 April 2010 ,Accepted 16 July 2010.

References 

  1. Reuters ISI Web of Knowledge. [Internet]. Reuters; 2009;[accessed 26.09.2009]. Available: http://wokinfo.com/
  2. Devereaux PJ, Beattie WS, Choi PT, Badner NH, Guyatt GH, Villar JC, et al. How strong is the evidence for the use of perioperative beta blockers in non-cardiac surgery? Systematic review and meta-analysis of randomised controlled trials. BMJ. 2005;331(7512):313–321
  3. Fleisher LA, Beckman JA, Brown KA, Calkins H, Chaikof EL, Fleischmann KE, et al. ACC/AHA 2007 guidelines on perioperative cardiovascular evaluation and care for noncardiac surgery: executive summary: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines (Writing Committee to Revise the 2002 Guidelines on Perioperative Cardiovascular Evaluation for Noncardiac Surgery) Developed in Collaboration With the American Society of Echocardiography, American Society of Nuclear Cardiology, Heart Rhythm Society, Society of Cardiovascular Anesthesiologists, Society for Cardiovascular Angiography and Interventions, Society for Vascular Medicine and Biology, and Society for Vascular Surgery. J Am Coll Cardio. 2007;50(17):1707–1732
  4. Group PS, Devereaux PJ, Yang H, Yusuf S, Guyatt G, Leslie K, et al. Effects of extended-release metoprolol succinate in patients undergoing non-cardiac surgery (POISE trial): a randomised controlled trial. Lancet. 2008;371(9627):1839–1847
  5. Stroup DF, Berlin JA, Morton SC, Olkin I, Williamson GD, Rennie D, et al. Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA. 2000;283(15):2008–2012
  6. Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J Clin Epid. 2009;62(10):1006–1012
  7. Higgins JP, Green S. Cochrane handbook for systematic reviews of interventions version 5.0.2. The Cochrane Collaboration. 2009;[updated September 2009]
  8. Centre for Reviews and Dissemination . Systematic reviews: CRD’s guidance for undertaking reviews in health care [Internet]. York: University of York; 2009;[accessed 29.03.2010]. Available from: http://www.york.ac.uk/inst/crd/systematic_reviews_book.ht
  9. Leeflang MM, Deeks JJ, Gatsonis C, Bossuyt PM Cochrane Diagnostic Test Accuracy Working Group. Systematic reviews of diagnostic test accuracy. Ann Int Med. 2008;149(12):889–897
  10. Jeng JS, Liu HM, Tu YK. Carotid angioplasty with or without stenting versus carotid endarterectomy for carotid artery stenosis: a meta-analysis. J Neurol Sci. 2008;270(1–2):40–47
  11. Ringleb PA, Chatellier G, Hacke W, Favre JP, Bartoli JM, Eckstein HH, et al. Safety of endovascular treatment of carotid artery stenosis compared with surgical treatment: a meta-analysis. J Vasc Surg. 2008;47(2):350–355
  12. Ederle J, Featherstone RL, Brown MM. Percutaneous transluminal angioplasty and stenting for carotid artery stenosis. Cochrane Database of Systematic Reviews. 2007;(4):CD000515
  13. Luebke T, Aleksic M, Brunkwall J. Meta-analysis of randomized trials comparing carotid endarterectomy and endovascular treatment. Euro J Vasc & Endovasc Surg. 2007;34(4):470–479
  14. McManus RJ, Wilson S, Delaney BC, Fitzmaurice DA, Hyde CJ, Tobias RS, et al. Review of the usefulness of contacting other experts when conducting a literature search for systematic reviews. BMJ. 1998;317(7172):1562–1563
  15. Moher D, Fortin P, Jadad AR, Juni P, Klassen T, Le Lorier J, et al. Completeness of reporting of trials published in languages other than English: implications for conduct and reporting of systematic reviews. Lancet. 1996;347(8998):363–366[see comment]
  16. Gregoire G, Derderian F, Le Lorier J. Selecting the language of the publications included in a meta-analysis: is there a Tower of Babel bias?. J Clin Epid. 1995;48(1):159–163
  17. Juni P, Holenstein F, Sterne J, Bartlett C, Egger M. Direction and impact of language bias in meta-analyses of controlled trials: empirical study. Int J Epid. 2002;31(1):115–123
  18. The Cochrane Collaboration [Internet]. Oxford. [accessed 26.09.2009]. Available from: www.cochrane.org
  19. Chalmers I, Dickersin K, Chalmers TC. Getting to grips with Archie Cochrane’s agenda. BMJ. 1992;305(6857):786–788
  20. Borm GF, Donders AR. Updating meta-analyses leads to larger type I errors than publication bias. J Clin Epid. 2009;62(8):825.e10–830.e10
  21. Rerkasem K, Rothwell PM. Systematic review of the operative risks of carotid endarterectomy for recently symptomatic stenosis in relation to the timing of surgery. Stroke. 2009;40(10):e564–e572
  22. Culwell KR, Curtis KM, del Carmen Cravioto M. Safety of contraceptive method use among women with systemic lupus erythematosus: a systematic review. Obst & Gynec. 2009;114(2 Pt 1):341–353
  23. Rebollo Aguirre AC, Ramos-Font C, Villegas Portero R, Cook GJ, Llamas Elvira JM, Tabares AR. 18F-fluorodeoxiglucose positron emission tomography for the evaluation of neoadjuvant therapy response in esophageal cancer: systematic review of the literature. Ann Surg. 2009;250(2):247–254
  24. Deeks JJ. Issues in the selection of a summary statistic for meta-analysis of clinical trials with binary outcomes. Stat Med. 2002;21(11):1575–1600
  25. Higgins JP, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Medi. 2002;21(11):1539–1558
  26. Rucker G, Schwarzer G, Carpenter JR, Schumacher M. Undue reliance on I(2) in assessing heterogeneity may mislead. BMC Med Res Method. 2008;8:79
  27. Higgins JP. Commentary: heterogeneity in meta-analysis should be expected and appropriately quantified. Int J Epid. 2008;37(5):1158–1160
  28. Patsopoulos NA, Evangelou E, Ioannidis JP. Sensitivity of between-study heterogeneity in meta-analysis: proposed metrics and empirical evaluation. Int J Epid. 2008;37(5):1148–1157
  29. Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR. Publication bias in clinical research. Lancet. 1991;337(8746):867–872
  30. Song F, Parekh-Bhurke S, Hooper L, Loke Y, Ryder J, Sutton A, et al. Extent of publication bias in different categories of research cohorts: a meta-analysis of empirical studies. BMC Med Res Method. 2009;9(1):79
  31. Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997;315(7109):629–634
  32. Peters JL, Sutton AJ, Jones DR, Abrams KR, Rushton L. Contour-enhanced meta-analysis funnel plots help distinguish publication bias from other causes of asymmetry. J Clin Epid. 2008;61(10):991–996
  33. Sutton AJ, Higgins JP. Recent developments in meta-analysis. Stat Medi. 2008;27(5):625–650
  34. Lau J, Ioannidis JP, Terrin N, Schmid CH, Olkin I. The case of the misleading funnel plot. BMJ. 2006;333(7568):597–600
  35. Agarwal R, Sinha AD. Cardiovascular protection with antihypertensive drugs in dialysis patients: systematic review and meta-analysis. Hypertension. 2009;53(5):860–866
  36. Sanabria A, Dominguez LC, Valdivieso E, Gomez G. Prophylactic antibiotics for mesh inguinal hernioplasty: a meta-analysis. Annals of Surgery. 2007;245(3):392–396
  37. Duval S, Tweedie R. Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biome. 2000;56(2):455–463
  38. Moreno SG, Sutton AJ, Ades AE, Stanley TD, Abrams KR, Peters JL, et al. Assessment of regression-based methods to adjust for publication bias through a comprehensive simulation study. BMC Med Res Method. 2009;9:2
  39. Bown MJ, Bolia A, Sutton AJ. Subintimal angioplasty: meta-analytical evidence of clinical utility. Euro J Vasc & Endovasc Surg. 2009;38(3):323–337
  40. Yang SH, Yang KH, Li YP, Zhang YC, He XD, Song AL, et al. Breast conservation therapy for stage I or stage II breast cancer: a meta-analysis of randomized controlled trials. Ann Oncol. 2008;19(6):1039–1044
  41. Bax L, Yu LM, Ikeda N, Moons KG. A systematic comparison of software dedicated to meta-analysis of causal studies. BMC Medical Research Methodology. 2007;7:40
  42. STATA [Internet]. [accessed 13.05.2010]. Available from: http://www.stata.com
  43. The R project [Internet]. [accessed 13.05.2010]. Available from: http://www.r-project.org/
  44. Comprehensive meta-analysis [Internet]. [accessed 12.07.2010]. Available from: http://www.meta-analysis.com
  45. Bax L. MIX 2.0. Professional software for meta-analysis in excel. Version (2.0.0.7). BiostatXL; 2010;http://www.meta-analysis-made-easy.com
  46. Statsdirect [Internet] . [accessed 13.05.2010]. Available from: http://www.statsdirect.com/

PII: S1078-5884(10)00438-7

doi: 10.1016/j.ejvs.2010.07.011

European Journal of Vascular & Endovascular Surgery
Volume 40, Issue 5 , Pages 669-677 , November 2010

Article Tools

* Image Usage & Resolution