If you don't remember your password, you can reset it by entering your email address and clicking the Reset Password button. You will then receive an email that contains a secure link for resetting your password
If the address matches a valid account an email will be sent to __email__ with instructions for resetting your password
Significant improvements in outcome have followed the reconfiguration of vascular services in the United Kingdom, a process that included the centralization of major arterial surgery and annual examination of institutional mortality rates for index procedures. Controversially, however, public reporting of surgeon-specific mortality data (SSMD) has now become mandatory for all cases of elective abdominal aortic aneurysm (AAA) repair and carotid endarterectomy performed in England, but the impact of this policy on mortality relating to AAA or carotid disease remains unknown. This paper examines the balance between the potential benefits of public SSMD reporting (transparency and quality improvement) versus the potential risks (gaming, risk-averse behaviour and/or an increase in inappropriate conservative management); and considers whether SSMD are an appropriate or meaningful metric for AAA repair and carotid endarterectomy in contemporary practice.
In the United Kingdom (UK), the reporting of surgeon-specific mortality data (SSMD) has become mandatory for vascular surgery, with particular focus on elective abdominal aortic aneurysm (AAA) repair and carotid endarterectomy.
AAA repair (in particular) has attracted considerable commentary. From 1999 to 2006, post-operative mortality was higher in England than in many other countries (7.9% vs. 1.9–4.5%).
This stimulated considerable service reconfigurations (e.g. centralization), quality improvement initiatives, the uptake of endovascular technology and the examination of institution-level mortality data,
and there is a need to examine the balance between the suggested/potential benefits of SSMD reporting (transparency and quality improvement) versus potential risks (gaming and risk-averse behaviour).
Public disclosure of SSMD for cardiac surgery has generated considerable controversy.
It has been suggested that risk aversion resulting from SSMD can lead to greater population mortality, because higher-risk patients may be denied intervention. Analyses to refute these suggestions have been criticized for incomplete risk adjustment, ascertainment bias, and a lack of information regarding patients who are refused surgery.
Has the publication of cardiac surgery outcome data been associated with changes in practice in northwest England: an analysis of 25,730 patients undergoing CABG surgery under 30 surgeons over eight years.
The attribution of deaths to individual surgeons has also been criticized because most deaths after cardiac surgery are due to failure of teams, institutional structures and processes rather than individual surgeon error.
In the absence of an acceptable alternative, high-risk patients have shown a willingness to accept the possibility of considerable perioperative complications,
For a condition such as AAA, the proportion of patients who are refused surgery is an important determinant of population outcomes, and requires specific attention.
Turndown rates for elective AAA are poorly reported but these rates are important, because the prognosis of patients denied intervention is poor, with 35% 2-year survival being typical.
Comparisons of international practice have demonstrated that higher turndown rates are associated with significant increases in overall aneurysm-related mortality, even where the surgical outcome of ruptured AAA repair is equivalent in different healthcare systems.
even though these data are required to place peri-operative mortality in context and may be subject to considerably greater variation than operative mortality rates.
The rate of aortic rupture is significant in patients with large unoperated AAA and the decision to turndown AAA repair for physiological reasons is subjective and may be incorrect, especially if the aneurysm is morphologically amenable to endovascular repair (EVAR). Patients with aneurysms that are larger than 8 cm (who are managed conservatively) have a rupture rate of 26% within 6 months, and the rate of aneurysm rupture is 32.5% within 1 year for aneurysms exceeding 7 cm in diameter.
yet are not captured in SSMD reports for AAA repair. SSMD are uninterpretable without reference to turndown rates, aneurysm diameter, morphologic suitability for EVAR, and the principle reasons for turndown. Without these data, the extent of selection bias remains unknown and it is not possible to mitigate or exclude risk-averse behavior.
In addition to complete case ascertainment, accurate risk adjustment is required in order to report credible SSMD. In cardiac surgery, the fitness for use of established risk adjustment tools has been subject to renewed appraisal,
Dynamic trends in cardiac surgery: why the logistic EuroSCORE is no longer suitable for contemporary cardiac surgery and implications for future risk models.
and the challenge is even greater for AAA repair. Existing risk-adjustment tools for AAA repair in England have combined surgeon-submitted data for both open and endovascular repair, rather than allowing analysis of each operation in isolation, despite evidence that the determinants of outcome after EVAR are morphological, whereas those after open repair are physiological.
Current tools for risk adjusting the outcome of AAA repair in the NHS have not been subject to rigorous external validation, lack adjustment for AAA morphology, have not quantified long-term durability or protection from AAA-related mortality for EVAR,
The abdominal aortic aneurysm statistically corrected operative risk evaluation (AAA SCORE) for predicting mortality after open and endovascular interventions.
and do not account for the life expectancy of patients who are refused AAA repair as a result of the application of these tools prior to surgery. There is, therefore, an unmet need for an accurate and objective algorithm to predict which patients will benefit from AAA repair and this is the subject of considerable ongoing research funded by the National Institute for Health Research (NIHR HTA 09/91/39). In the absence of an accepted national algorithm to contextualize case selection, a policy of national reporting for SSMD is difficult to justify.
Institutions, rather than individual surgeons, appear to have a more powerful impact on the outcome of AAA repair and this makes SSMD difficult to interpret. The case for centralizing vascular services and reporting institution-level results is now widely accepted in the English NHS. A robust relationship has been repeatedly demonstrated between higher annual caseload (volume) and lower operative mortality for AAA repair and this correlation exists across a wide range of arterial surgical procedures.
Institution (rather than surgeon) level outcome reporting is appealing, because AAA repair is performed by a team (rather than an individual) and, increasingly, by joint consultant operating. The outcomes of vascular surgery vary considerably between different hospitals
Inter-relationship of procedural mortality rates in vascular surgery in England: retrospective analysis of hospital episode statistics from 2005 to 2010.
Variations and inter-relationship in outcome from emergency admissions in England: a retrospective analysis of hospital episode statistics from 2005–2010.
Most deaths after AAA repair are not related to the operation itself. Mortality generally results from an institutional failure to identify and treat important complications and morbidities that follow the procedure; a concept deemed “failure to rescue” after surgery. Failure-to-rescue rates are closely related to a variety of hospital characteristics, including staffing and intensive care resource. The importance of the treating institution in determining clinical success makes SSMD difficult to interpret or justify. Improvements in AAA outcomes are also affected by myriad other non-surgical factors including specialist vascular anaesthesia, intensive care expertise,
while the procedure is increasingly performed by dual consultant operating rather than a single operator.
SSMD reported in isolation is, at best, an incomplete reflection of overall quality of care. At worst, sensationalist journalism surrounding the release of SSMD, including reports that some surgeons were “thirty times worse than their colleagues”,
could adversely impact the rate of aneurysm-related mortality in the UK. A comprehensive approach is required and should include publicly accountable data regarding institutional structure/process factors, safety data (including failure to rescue, institutional reporting of adverse events), resource availability, and the uptake of endovascular technology, timeliness of care, equity of access to AAA repair, efficiency of care (length of stay and morbidity data), patient-reported outcomes, and, most importantly, turndown rates. Appropriate risk adjustment tools must be developed and include aneurysm morphology data. Until the potentially adverse impact of SSMD can be monitored and understood, caution is advocated in the attribution of deaths after AAA repair to individual surgeons.
Conflict of Interest
Prof. Thompson is the Chair of the CRG (Clinical Reference Group) for commissioning Vascular Surgery in NHS England. Prof. Loftus is the Chair of the National Vascular Committee for Audit and Quality Improvement and is the National Lead for Revalidation in Vascular Surgery.
Has the publication of cardiac surgery outcome data been associated with changes in practice in northwest England: an analysis of 25,730 patients undergoing CABG surgery under 30 surgeons over eight years.
Dynamic trends in cardiac surgery: why the logistic EuroSCORE is no longer suitable for contemporary cardiac surgery and implications for future risk models.
The abdominal aortic aneurysm statistically corrected operative risk evaluation (AAA SCORE) for predicting mortality after open and endovascular interventions.
Inter-relationship of procedural mortality rates in vascular surgery in England: retrospective analysis of hospital episode statistics from 2005 to 2010.
Variations and inter-relationship in outcome from emergency admissions in England: a retrospective analysis of hospital episode statistics from 2005–2010.
To submit a comment for a journal article, please use the space above and note the following:
We will review submitted comments as soon as possible, striving for within two business days.
This forum is intended for constructive dialogue. Comments that are commercial or promotional in nature, pertain to specific medical cases, are not relevant to the article for which they have been submitted, or are otherwise inappropriate will not be posted.
We require that commenters identify themselves with names and affiliations.