- Open Access
Improving quality of care and clinical outcomes for rectal cancer through clinical audits in a multicentre cancer care organisation
Radiation Oncology volume 15, Article number: 28 (2020)
Colorectal cancer treatment requires a complex, multidisciplinary approach. Because of the potential variability, monitoring through clinical audits is advisable. This study assesses the effects of a quality improvement action plan in patients with locally advanced rectal cancer and treated with radiotherapy.
Comparative, multicentre study in two cohorts of 120 patients each, selected randomly from patients diagnosed with rectal cancer who had initiated radiotherapy with a curative intent. Based on the results from a baseline clinical audit in 2013, a quality improvement action plan was designed and implemented; a second audit in 2017 evaluated its impact.
Standardised information was present on 77.5% of the magnetic resonance imaging (MRI) staging reports. Treatment strategies were similar in all three study centres. Of the patients whose treatment was interrupted, just 9.7% received a compensation dose. There was an increase in MRI re-staging from 32.5 to 61.5%, and a significant decrease in unreported circumferential resection margins following neoadjuvant therapy (ypCRM), from 34.5 to 5.6% (p < 0.001).
The comparison between two clinical audits showed improvements in neoadjuvant radiotherapy in rectal cancer patients. Some indicators reveal areas in need of additional efforts, for example to reduce the overall treatment time.
Colorectal cancer is the third most common cancer worldwide and the second in Catalonia; 45% of these tumours are in the rectum [1, 2]. A locally advanced rectal tumour (LART) is defined by the presence of a neoplasm classified as T3/T4, with or without lymph node infiltration (N0/N+), and no metastatic dissemination. Treatment is multidisciplinary and consists of surgery plus radiochemotherapy , with careful evaluation of magnetic resonance imaging (MRI) parameters before and after preoperative treatment. The total mesorectal excision is a quality indicator, and the main factor for local control, but in LART the neoadjuvant treatment achieves greater control than surgery alone. Since the results of the Swedish Rectal Cancer Trial were published in 1997 , neoadjuvant, multimodal treatment has taken root as the standard treatment strategy. Substantial reductions in local recurrence have been achieved thanks to radiotherapy (RT), both short-course radiotherapy (SCRT) and long-course radiotherapy (LCRT), which is combined with chemotherapy. In historical series, local recurrence was 30 to 45%, compared with less than 10% today . In 2019, multimodality treatment for LART also implies personalised strategies to decrease the surgical burden for patients responding after pre-operative treatment, including ‘wait and watch’ or organ-preservation approaches.
Thus, successful treatment of locally advanced rectal cancer requires a multidisciplinary approach [6, 7]. The complexity of care processes – and the resulting potential for variability in clinical decision-making – make monitoring highly desirable. Clinical audits, for their part, are a widely used instrument to identify variability in clinical practice and areas in need of improvement. Several countries have incorporated audits as a strategy to evaluate health policies [8, 9]. The impact of the results obtained depends to a large extent on the analysis of the outcomes, the quality of the data collected, and the credibility of the audit team. There are few studies that report the effects of corrective measures established based on post-intervention audits .
The aim of this study was to assess the effects of the quality improvement action plan on the quality of clinical care processes in patients with rectal cancer, with an emphasis on the diagnostic and neoadjuvant treatment phases.
This study took place in the Institut Català d’Oncologia (ICO), a cancer care organisation with three specialised centres offering radiation oncology treatments. ICO collaborates with the corresponding university hospitals that belong to the Institut Calatà de la Salut (ICS);it works in a network with
another 17 more local hospitals, and it is the reference centre in oncology for nearly 3 million people (45% of the adult population in Catalonia). The care model is characterised by a multidisciplinary focus on specific pathologies, in compliance with corporate clinical practice guidelines.
This multicentre comparative study was performed over two periods (2013 and 2017). For each study year, we selected a representative sample of patients diagnosed with rectal cancer and treated with neoadjuvant RT.
The study began with the creation of a working group made up of radiation oncologists and medical physicists from all three centres, and led by the clinical reference centre in rectal cancer. Key aspects of the diagnostic, therapeutic and follow-up phases were identified based on the literature [11, 12], as were the study indicators, including the appropriateness of the diagnostic tests performed, quality of the diagnostic reports, multidisciplinary approach, appropriateness and adherence to the prescribed treatment, imaging controls during the RT sessions, post-surgical circumferential resection margin (ypCRM), and adverse effects. A purpose-designed form was used to collect the required data during the first audit, and for the second audit it was adapted to include the new indicators derived from the action plan.
The first clinical audit for radiation oncology (ACOR-1) identified areas in need of improvement. The analysis of these published results  informed the development of an action plan, which was approved in April 2016 and implemented thereafter. A new audit (ACOR-2) was then performed to assess the extent to which the improvement targets were achieved.
The audits consisted of a review of a random sample of 40 clinical histories from each centre. The target population was patients diagnosed with rectal cancer (International Classification of Diseases; ICD-9:154.1) who received neoadjuvant RT with a curative intent (starting in 2013 in the first cohort and between June and December of 2017 in the second).
For ACOR-2, the cognizant clinical practice guidelines specified the criteria for concomitant chemotherapy and two alternative strategies for RT: LCRT (45 Gy to 50.4 Gy in fractions of 1.8 Gy) and SCRT (25 Gy in fractions of 5 Gy), administered on 5 consecutive days. The SCRT strategy was preferentially indicated in patients over the age of 70, in tumours of the middle third of the rectum, and in disease without involvement of the mesorectal fascia or metastasis .
Following a pilot test, a team of external auditors undertook the first audit from June to September 2015, and the second from June to September 2018. Data were collected from the electronic clinical records in the participating centres (SAP i.s.h. med Cerner & SAP) and the specific information system for radiotherapy (Aria oncology information System BY Varian Medical Systems Inc.).
For the diagnostic phase, the quality improvement action plan (Table 1) covered measures to increase the available clinical information needed to develop a treatment strategy, based on personal communication and multidisciplinary committees. The audit highlighted the need to standardise the MRI report, based on the Mercury Study Group criteria . Another aspect considered was tumour board review to approve the treatment plan, in patients diagnosed both in our centres and in the regional hospitals.
Measures to improve the treatment phase included standardising the use of intensity-modulated radiotherapy (IMRT) in the three centres, based on the following indications: tumours in the lower third of the rectum; patients with hysterectomy; rT4 rectal tumours; and infiltration to the prostate, bladder or uterus in patients in whom the planning target volume included the lymphatic areas of the external iliac system lymph nodes . Other measures were the development and implementation of a management protocol for RT session interruptions to reduce prolonged overall treatment time (OTT) and a protocol for image-guided radiotherapy (IGRT) during the treatment (to be undertaken at least once a week); an increase in the percentage of patients re-evaluated with MRI prior to surgery; and the state of the ypCRM on the pathology report describing the surgical specimens.
Finally, for the follow-up, the action plan aimed to improve reporting of adverse effects over the clinical course, according to the Common Terminology Criteria for Adverse Events (CTCAE) v4.0 .
We used R software available as Free Software (version 3.0.2) for the statistical analysis. The sample size calculation was based on a level of confidence of 0.95 (α = 0.05), assuming a finite population of about 100 cases per centre and a 20% rate of attrition. Pearson’s chi-squared test was used to compare results between groups.
Table 2 presents the characteristics of the patients included in the ACOR-1 and ACOR-2 cohorts. There were no significant differences in the demographic or clinical profiles, except in histological grade and distance from tumour to mesorectal fascia. Table 3 shows the outcomes for the diagnostic phase after implementing the action plan. Availability of the biopsy report reached 100% in patients in the second period, as did MRI staging in two of the three centres. The MRI reports met the established criteria in 77.5% of the cases, representing a significant rise with respect to the first period. In centre A, there were 10 cases where the report noted the distance from the tumour to the anorectal junction rather than the anal verge (these measures are considered equivalent with respect to the fulfilment of the standard).
The outcomes for the treatment phase are detailed in Table 4. The pattern of neoadjuvant treatment is similar between centres and in both cohorts. In ACOR-2, 62.7% of the patients received a total of 50.4 Gy (LCRT), a significant difference with respect to ACOR-1 that mainly reflects an improvement in centre A.
A protocol for managing treatment interruptions was approved in June 2017. Compliance was 9.7%; we did not observe a significant decrease in patients with prolonged OTT over seven days (in the case of LCRT) or in the percentage of patients who received their last dose on a Monday (radiotherapy units are not active on weekends). A protocol for image-guided radiotherapy was approved in October 2016; the compliance rate was 95.8%.
There was a significant increase in the performance of the MRI restaging procedure in all centres, from 32.5 to 61.3% (Table 5). The proportion of patients in whom surgery was indicated dropped slightly, from 96.7 to 90%, reflecting an increase in patients following a conservative treatment strategy. There was also a significant improvement in the availability of the ypCRM on the anatomical pathology report (ACOR-2: 94.4%).
For the follow-up phase, adverse effects of treatment were reported on 99.8% of the visits, and these were graded for severity according to the CTCAE in 36.2% of the cases.
Clinical audits are a well-known tool for identifying areas to improve in the care process. This study reports the results of an action plan for improving quality in neoadjuvant treatment for locally advanced rectal cancer in three centres, based on the findings of an initial quality audit. The ACOR-1 audit revealed variability in clinical practice between centres and showed suboptimal outcomes for several standard quality indicators. ACOR-2 showed the evolution of these indicators following the implementation of quality improvement measures.
In the diagnostic phase, the MRI is the best tool to identify the patients with locally advanced tumours who would most benefit from neoadjuvant treatment . All the cases audited in ACOR-2 included this test, and there was a significant improvement in the quality of the report. Specifically, there was an increase in adherence to the Mercury Group’s recommendations on reporting rectal cancer MRIs , including the distance from the tumour to the mesorectal fascia (CRM), reported in 61.7% of the cases in ACOR-1 and 82.5% in ACOR-2, and the distance to the anal verge or the anorectal union, reported in 68.3 and 96.7% of the cases, respectively (p < 0.001). Overall, the centres did not achieve the optimal level of reporting (85%), but 77.5% of the reports in ACOR-2 did meet the established criteria, compared to just 45% in ACOR-1 – a significant change. We consider that having a proforma, which would include the state of the resection margin (CRM) and the distance from the tumour to the anal verge, would be a decisive factor in achieving optimal reporting, as described by Taylor and colleagues [18, 19].
The number of patients coming to the ICO-ICS unit with a diagnosis in hand increased significantly, probably due to the centralisation policies implemented for this pathology in the region . All the cases diagnosed in the ICO unit were reviewed by a tumour board to approve the therapeutic strategy.
In ACOR-2, the treatment plan adopted most frequently was radiochemotherapy, with LCRT and a dose of 50.4 Gy. Compared with the outcomes observed in ACOR-1, ACOR-2 showed greater standardisation between centres and better adherence to the approved guidelines, although some variability persists, which is consistent with other studies . For example, two of the centres used SCRT in 20% of the patients, while the other did so in just 5%. This difference is probably due to the divergent approaches in patients of advanced age. One centre adheres to the strategy for avoiding surgery in frail patients, so its adoption of LCRT is more assiduous. In contrast, the other two centres favour the avoidance of chemotherapy [22, 23].
We also noted an increase in the use of volumetric modulated arc therapy (VMAT), from 2.5 to 20.8% (p < 0.001), and its dissemination in all three centres. Although the radiated intestinal volume may be susceptible to late toxicity, VMAT reduces acute toxicity and consequently, treatment interruptions . Thus, consensus-based indications were developed for patients with tumours that infiltrated into adjacent organs, and in general when treatment of the external iliac lymph nodes and/or the groin nodes is unavoidable.
One of the action plan’s target areas was OTT. Even though special efforts were made to improve this indicator, both audits showed that the overall RT treatment time was still more than seven days longer than planned for LCRT, usually because of weekday public holidays and technical inspections of the accelerators. There were no significant changes between study periods. We also observed a non-significant improvement in the percentage of patients whose last RT session was on a Monday. To improve this aspect, a protocol for managing treatment interruptions was designed and finally approved in June 2017. The delay in approval is probably the reason that we identified only seven patients in whom it was appropriately applied (four of them in centre B). Indeed, the included patients initiated treatment only from June to December 2017. Thus, the centres still have work to do in improving adherence to the treatment. As with any measure that affects the daily work routine and entails organisational changes, achieving success in this endeavour will be challenging .
Another target area was the standardisation of IGRT during treatment. This measure, too, was subject to a new protocol (approved in October 2016), and adherence was 95.8%.
Once the neoadjuvant treatment is finalised, restaging (primarily based on MRI) is necessary to define the surgical technique. We observed a significant rise in the adoption of this approach in all three centres, with 32.5% of all cases undergoing MRI restaging in ACOR-1 and 61.3% in ACOR-2 (p < 0.001). Moreover, there is already a consolidated scientific basis permitting selected patients to follow a conservative strategy and avoid surgery, that is, ‘watch and wait’ [25, 26]. In our case, in ACOR-2, surgery was indicated in 90% of the patients, compared to 96.7% in ACOR-1 (p = 0.035). In 3/12 patients (25%) in whom surgery was not indicated, the reason was having cT0N0 after completing chemoradiotherapy.
Without a doubt, the most important quality indicator in neoadjuvant treatment of rectal cancer for local control and survival is the state of the circumferential resection margin (ypCRM). This detail was not described in the anatomical pathology report for 34.5% of the surgical specimens in ACOR-1, compared to 5.6% in ACOR-2 (p < 0.001). Overall, 14.8% of the surgical specimens showed CRM involvement (ypCRM+), which is consistent with the literature [27, 28]. Considering the RT strategy, 13% of the LCRT treatments had ypCRM+, compared to 25% of those with SCRT treatment. We considered the proportion of 10% to be optimal.
With regard to the low-quality reporting of adverse events over the clinical course (absence of grading and aspects related to sexual function or bowel control), the specific list of CTCAE (v 4.0) criteria  helped to moderately improve reporting. Nevertheless, the results obtained in ACOR-2 highlight the need to double down on efforts to improve this aspect.
The ultimate aim of treatment is not only to cure disease, but also to restore the person’s dignity and achieve their social reinsertion. To this end, it is essential to understand the impact of dysfunctions and symptoms derived from treatment on patients’ quality of life . Future studies are necessary to explore this aspect in the long term, applying specific validated instruments like the EORTC questionnaires for quality of life in cancer patients and for colorectal quality of life in patients with rectal cancer receiving neoadjuvant treatment.
This study has several limitations. Some are related to the design of the audit, which included only 40 clinical histories per centre, limiting the power of the assessment, especially for clinical outcomes. In addition, the period selected (especially for the ACOR-2) allowed little time for the consolidation of changes derived from the action plan. Moreover, the data collected were from clinical histories; any measure taken but not recorded on the patient’s electronic medical record would, for the purposes of the clinical audit, be non-existent.
In conclusion, this study analyses the influence of feedback from clinical audit data in improving neoadjuvant treatment procedures in rectal cancer. Our results show progress as well as areas in which additional efforts should be made, including: decreasing the percentage of positive ypCRMs; limiting treatment interruptions in order to reduce overall treatment time; and better selection of therapeutic options in elderly patients, according to frailty and mobility. In short, the audit undertaken shows total or partial correction in most areas targeted for quality improvements following the first audit, a decrease in variability between centres, and an improvement in adherence to clinical practice guidelines for rectal cancer.
Availability of data and materials
The datasets during and/or analysed during the current study available from the corresponding author on reasonable request.
first clinical audit for radiation oncology
second clinical audit for radiation oncology
Common Terminology Criteria for Adverse Events
European Organisation for Research and Treatment of Cancer
Institut Català d’Oncologia
Institut Català de la Salut
locally advanced rectal tumour
long course radiotherapy
magnetic resonance imaging
overall treatment time
short course radiotherapy
volumetric modulated arc therapy
circumferential resection margin (following neoadjuvant treatment)
Vernet R, Borras JM, Aliste L, Antonio M, Guarga A, Manchon-Walsh P. Influence of age on variation in patterns of care in patients with rectal cancer in Catalonia (Spain). Clin Transl Oncol. 2018;20:1538.
Ferlay J, Steliarova-Foucher E, Lortet-Tieulent J, Rosso S, Coebergh JW, Comber H, Forman D, Bray F. Cancer incidence and mortality patterns in Europe: estimates for 40 countries in 2012. Eur J Cancer. 2013;49:1374–403.
Rich T, Gunderson LL, Lew R, Galdibini JJ, Cohen AM, Donaldson G. Patterns of recurrence of rectal cancer after potentially curative surgery. Cancer. 1983;52:1317–29.
Kapiteijn E, Marijnen CA, Nagtegaal ID, Putter H, Steup WH, Wiggers T. Et Al. preoperative radiotherapy combined with total mesorectal excision for resectable rectal cancer. N Engl J Med. 2001;345(9):638–46.
MacFarlane JK, Ryall RD, Heald RJ. Mesorectal excision for rectal cancer. Lancet. 1993;341:457–60.
Lee M, Gibbs P, Wong R. Multidisciplinary Management of Locally Advanced Rectal Cancer-an Evolving Landscape? Clin Colorectal Cancer. 2015;14(4):251–61.
van de Velde CJ, Boelens PG, Borras JM, Coebergh JW, Cervantes A, Blomqvist L, et al. EURECCA colorectal: multidisciplinary management: European consensus conference colon & rectum. Eur J Cancer. 2014;50(1):1.e1–1.e34.
Taylor A, Neuburger J, Walker K, Cromwell D, Groene O. How is feedback from national clinical audits used? Views from English National Health Service trust audit leads. J Health Serv Res Policy. 2016;21(2):91–100.
Prades J, Manchon-Walsh P, Solà J, Espinàs JA, Guarga A, Borras JM. Improving clinical outcomes through centralization of rectal cancer surgery and clinical audit: a mixed-methods assessment. Eur J Pub Health. 2016;26(4):538–42.
Zerillo JA, Schouwenburg MG, van Bommel ACM, Stowell C, Lippa J, et al. An international collaborative standardizing a comprehensive patient-centered outcomes measurement set for colorectal cancer. JAMA Oncol. 2017;3(5):686–94.
Manchon-Walsh P, Borras JM, Espinas JA, Aliste L. On behalf of the Catalonian rectal Cancer group. Et al. variability in the quality of rectal cancer care in public hospitals in Catalonia (Spain): clinical audit as a basis for action. Eur J Surg Oncol. 2011;37(4):325–33.
Fundowicz M, Macia M, Marin S, Bogusz-Czerniewicz M, Konstanty E, Modolel I, et al. Preoperative radiotherapy for rectal cancer: a comparative study of quality control adherence at two cancer hospitals in Spain and Poland. Radiol Oncol. 2014;48(2):210–8.
Torras MG, Canals E, Jurado-Bruggeman D, Marín-Borras S, Macià M, Jové J. Clinical audit of the radiotherapy process in rectal Cancer: clinical practice guidelines and quality certification do not avert variability in clinical practice. Transl Oncol. 2018;11(3):794–9.
Bujko K, Wyrwicz L, Rutkowski A, Malinowska M, Pietrzak L, Kryński J, et al. Long-course oxaliplatin-based preoperative chemoradiation versus 5 × 5 Gy and consolidation chemotherapy for cT4 or fixed cT3 rectal cancer: results of a randomized phase III study. Ann Oncol. 2016;27(5):834–42.
MERCURY Study Group. Diagnostic accuracy of preoperative magnetic resonance imaging in predicting curative resection of rectal cancer: prospective observational study. BMJ. 2006;333(7572):779.
Teoh S, Muirhead R. Rectal radiotherapy--intensity-modulated radiotherapy delivery, delineation and doses. Clin Oncol (R Coll Radiol). 2016;28(2):93–102.
-Common Terminology Criteria for Adverse Events (CTAE). Version 4.0. Published: May 28, 2009 (v4.03: June 14, 2010). U. S. DEPARTMENT OF HEALTH AND HUMAN SERVICES (National Institutes of Health. National Cancer Institute.
-Taylor F, Mangat N, Swift IR, Brown G. Proforma-based reporting in rectal cancer. Cancer Imaging 2010;10 Spec no A:S142–50.
Siddiqui MRS, Shanmuganandan AP, Rasheed S, Tekkis P, Brown G, Abulafi AM. An audit comparing the reporting of staging MRI scans for rectal cancer with the London Cancer Alliance (LCA) guidelines. Eur J Surg Oncol. 2017;43(11):2093–104.
Manchon-Walsh P, Aliste L, Espinàs JA, Prades J, Guarga A, Balart J, Biondo S, Castells A, Sanjuan X, Tabernero J, Borras JM, Catalonian rectal CancerGroup. Improving survival and local control in rectal cancer in Catalonia (Spain) in the context of centralisation: a full cycle audit assessment. Eur J Surg Oncol. 2016;42(12):1873–80.
van Leersum NJ, Snijders HS, Wouters MWJM, Henneman D, Marijnen CAM, Rutten HR, on behalf of the Dutch Surgical Colorectal Cancer Audit Group, et al. Evaluating national practice of preoperative radiotherapy for rectal cancer based on clinical auditing. Eur J Surg Oncol. 2013;39(9):1000–6.
-Wang SJ, Hathout L, Malhotra U, Maloney-Patel N, Kilic S, Poplin E, Jabbour SK. Decision-Making Strategy for Rectal Cancer Management Using Radiation Therapy for Elderly or Comorbid Patients. Int J Radiat Oncol Biol Phys 2018;15;100(4):926–944.
Montroni I, Ugolini G, Saur NM, Spinelli A, Rostoft S, Millan M, et al. Personalized management of elderly patients with rectal cancer: expert recommendations of the European Society of Surgical Oncology, European Society of Coloproctology, International Society of Geriatric Oncology, and American College of Surgeons Commission on Cancer. Eur J SurgOncol. 2018;44(11):1685–702.
Bese NS, Hendry J, Jeremic B. Effects of prolongation of overall treatment time due to unplanned interruptions during radiotherapy of different tumor sites and practical methods for compensation. Int J Radiat Oncol Biol Phys. 2007;68(3):654–61.
van der Valk MJM, Hilling DE, Bastiaannet E, Meershoek-Klein Kranenbarg E, Beets GL, Figueiredo NL, Habr-Gama A. Et Al. long-term outcomes of clinical complete responders after neoadjuvant treatment for rectal cancer in the International Watch & Wait Database (IWWD): an international multicentre registry study. Lancet. 2018;391(10139):2537–45.
Dossa F, Chesney TR, Acuna SA, Baxter NN, et al. A watch-and-wait approach for locally advanced rectal cancer after a clinical complete response following neoadjuvant chemoradiation: a systematic review and meta-analysis. Lancet Gastroenterol Hepatol. 2017;2(7):501–13.
Quirke P, Steele R, Monson J, Grieve R, Khanna S, Couture J, et al. Effect of the plane of surgery achieved on local recurrence in patients with operable rectal cancer: a prospective study using data from the MRC CR07 and NCIC-CTG CO16 randomised clinical trial. Lancet. 2009;373(9666):821–8.
Warrier SK, Kong JC, Guerra GR, Chittleborough TJ, Naik A, Ramsay RG, Lynch AC, Heriot AG. Risk factors associated with circumferential resection margin positivity in rectal Cancer: a Binational registry study. Dis Colon Rectum. 2018;61(4):433–40.
Whistance RN, Conroy T, Chie W, Costantini A, Sezer O, Koller M, et al. Clinical and psychometric validation of the EORTC QLQ-CR29 questionnaire module to assess health-related quality of life in patients with colorectal cancer. Eur J Cancer. 2009;45(17):3017–26.
We would like to thank all the professionals involved in the radiotherapy process in the Institut Català d’Oncologia (Catalonia), without whom this study would not have been possible.
All funding or project support is acknowledged in the manuscript.
Ethics approval and consent to participate
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee (Comité Ético de Investigación Clínica del Hospital de Bellvitge, Ref. PR015/15) and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Torras, M.G., Canals, E., Muñoz-Montplet, C. et al. Improving quality of care and clinical outcomes for rectal cancer through clinical audits in a multicentre cancer care organisation. Radiat Oncol 15, 28 (2020). https://doi.org/10.1186/s13014-020-1465-z
- Rectal Cancer
- Clinical audit
- Radiotherapy process
- Clinical practice variability
- Improvement Quality process