- Open Access
Quality audits of radiotherapy centres in Latin America: a pilot experience of the International Atomic Energy Agency
Radiation Oncology volume 10, Article number: 169 (2015)
In Latin America radiotherapy quality varies significantly among hospitals, where highly equipped academic centers coexist with others not meeting minimal requirements. In 2007, the International Atomic Energy Agency published guidelines for auditing radiotherapy centers, known as the “Quality Assurance Team for Radiation Oncology” (QUATRO) audits. The present report summarizes a pilot experience with QUATRO audits to 12 radiotherapy centres.
The findings from QUATRO audits conducted in 12 radiotherapy centres in Latin America between 2008 and 2013 were analysed. Events representing weaknesses or gaps in the process of radiotherapy were recorded. Relevant data for estimating human and technological needs of visited centres were processed. The main difficulties and strengths faced by institutions were also documented.
All 12 radiotherapy centres were successfully audited following the QUATRO method. IAEA provided a dosimetry kit for quality control. Forty percent of audited institutions were immersed in a health system that did not recognize cancer as a public health priority problem. With few exceptions, local training programs for physicists and technologists were scarce and research was not an activity of interest among physicians. Centres were provided with sufficient staff to meet the local demand, both in the case of radiation oncologists, physicists and radiation therapists. Three centres lacking the minimum infrastructure were identified. Three institutions did not perform gynaecological brachytherapy, and one installation delivered around 900 teletherapy treatments annually without simulation, planning or dosimetry equipment for that purpose. Recommendations to centres were classified as related to personnel, infrastructure, processes and institutional organizational aspects. Many recommendations warned governments about the evident need for allocating more budgetary resources to radiotherapy. Most recommendations pointed out different aspects related to strengthen human resources training and technological support to the audited centres. Scheduled follow-up visits were also stressed.
The QUATRO audits proved to be a valuable tool for identifying weaknesses in infrastructure, human resources and procedures in radiotherapy centres. Follow-up visits conducted by the IAEA or by regional or local organizations are necessary in order to evaluate outcomes and sustainability of implemented recommendations.
Latin America includes countries in Central America, South America, the Caribbean and México, covering nineteen countries and about 600 million inhabitants .
There is notable inequity in access to health services within the region. The scenario is characterized by significant heterogeneity in infrastructure and supply of services both within and between countries [2, 3]. This is also the case for oncology in general and radiation oncology in particular .
The cancer incidence in Central America is of 134 cases per 100,000 people per year, and 190 new cases is the number for South America . The availability of megavoltage therapy machines varies from less than 1 to more than 4 units per million people between the least and most equipped countries respectively. The needs are covered in a 58─75 %, depending on the country . Most professionals specialized in cancer and its treatment are concentrated in the largest cities. The increasing migration of people from rural areas to cities has resulted in a predominance of urban health services deepening the inequity which affects the most vulnerable sectors .
The quality of oncology services also varies significantly between hospitals, and highly equipped academic centres coexist with facilities not meeting the minimal requirements of a basic clinic . Collected data and recommendations related to these aspects constitute the body of this publication.
Background and purpose
Analysis of indicators obtained through surveys and audits is a widely used methodology to measure performance of health services [7, 8], including radiation oncology providers .
The Division of Human Health of the International Atomic Energy Agency (IAEA) published guidelines for audits of radiotherapy centres in 2007, known as QUATRO (“Quality Assurance Team in Radiation Oncology”) audits . The publication contains checklists that auditors ought to complete, the analysis of which allows measurement of the degree of development of the audited institution. The composition of the on-site visit depends on the scope, level of development and expected content of the audit visit, but in all cases involved a radiation oncologist, a radiotherapy physicist and a radiation therapist (RTT). A fourth member with special competencies such as a radiation protection officer was engaged from the visited country. Data collected by the auditors normally include observations concerning buildings, human resources, treatment and dosimetry equipment, comprehensive patient care, adherence to standards of radiation protection and establishment of quality assurance programmes, education and research [11–14].
Given that QUATRO audits are voluntary, only centres that desire and formally request participation were audited. The final aim of a QUATRO audit is a draft of recommendations to the audited centre, IAEA and governmental authorities of the country where the institution is located in order to optimize the quality of clinical care provided to patients who receive radiotherapy.
Audit reports are confidential. The intention is never to disseminate findings relating to a particular centre or to investigate accidents or alleged punishable actions. This publication summarizes the results of 12 such QUATRO audits in Latin America.
Materials and methods
The reports from QUATRO audits conducted in 12 radiotherapy centres in Latin America between 2008 and 2013 were analysed. The sample of centres to be audited was selected during an IAEA regional project coordinators’ meeting in 2007 during which country representatives selected radiotherapy centres of diverse level of development across the region. The purpose was to validate the QUATRO method in Latin America and further encourage countries to develop their own national audit systems based on this method. As part of a joint project between the IAEA and the Pan American Health Organization (PAHO), Regional Office of the World Health Organization for the Americas, to support the Action Plan on Cancer Control for Central America and the Dominican Republic, PAHO facilitated the circulation of the IAEA dosimetry kit and provided an additional expert to join the IAEA teams for the audits held in those countries.
Drawbacks for the actual audit implementation were recorded. Relevant data for estimating human and technological needs of the centres audited were processed. In the first case, estimates were made by using a tool developed by the IAEA for calculating ‘necessary personnel’ based on existing staff . The theoretical calculation of ‘necessary machines’ was based on IAEA recommendations . The main difficulties faced by institutions were documented as well as their strengths.
A coding scheme was developed to categorize recommendations that auditors made to the audited centres. The authors discussed, agreed and assigned a code to each recommendation. The codes were loaded into an internally designed Excel spreadsheet to be summed and the frequency of each recommendation was obtained. Recommendations to governments and to IAEA were manually processed.
The analysis of reports and causality were conducted by a working group of the Division of Human Health of the IAEA. Confidentiality was maintained throughout the process.
Results and discussion
Twelve radiotherapy services located in 10 Latin American countries (4 in South America and 6 in Central America) were audited from 2008 to 2013. Due to the selection method described above, the sample is small compared to the total number of facilities existing in the region; 649 radiotherapy centres as of March 2015 [5, 16–18]. Hence this report should not be construed as representative of the overall situation of Latin America.
Two institutions were categorized as ‘not for profit’ private hospitals while all others belonged to the public health system of the country involved.
It was noted that most audits had been requested voluntarily by health system personnel with the agreement and consent of heads of departments. A single service was exceptional, where the staff advised that the audit had been imposed by hospital authorities. However staff members in this case, as in all the others, were keen to assist and collaborate with the auditors to achieve the objectives of the mission.
Drawbacks for implementing the audits
Problems regarding the equipment that the IAEA sent for quality control of irradiation machines and clinical dosimetry devices (dosimetry kit) were reported in four instances. This happened in the first missions due to protracted retention of the IAEA dosimetry kit in local customs. To overcome this problem, in subsequent audits the dosimetry kit was sent to the countries through PAHO official channels several weeks before the visit. In the first three visits, measurements were not possible due to this obstacle. In an additional one, measurements were conducted using dosimetry equipment brought by one of the auditors as per IAEA request. In the others, measurements were carried out successfully.
One audited centre had no clinical dosimetry equipment and thus only quality control of the single operating therapy machine (60Co unit) was possible.
The setting of the audited centres. Shortcomings and difficulties
Forty percent of audited institutions belonged to health systems that did not prioritise cancer as a public health issue, nor recognised the different disciplines that make up a radiotherapy team, in particular medical physics.
With few exceptions, local training programs for physicists and technologists were scarce and research was not an activity of interest among physicians.
Some degree of demotivation of workers was evident in 30 % of centres, and a near constant absence of quality management programmes was reported. These factors impacted negatively on the performance of services, as evidenced by the long lists of patients waiting to receive care in more than half of the audited centres.
Given that cervical cancer is the malignancy with the second highest incidence and mortality among females in the region [4, 19, 20], it is a striking and disturbing fact that three of the audited centres do not perform gynaecological brachytherapy procedures as part of the curative treatment of the disease. Lack of equipment, referral of patients to other facilities that provide the practice and/or lack of paying capacity of patients to afford the costs were the commonest reasons.
Although lack of equity in the provision of services depending on the economics of patients was not registered as a frequent event, cases of inequitable use of technology were identified, including external radiotherapy with 60Co vs linear accelerator, restriction of gynaecological treatments and omissions in computed tomography simulation (planning in the treatment machine vs CT simulation).
Radiation protection was frequently not considered an important issue; its management was deficient and international recommendations [21, 22] were not met in half of the audited installations.
Highlighted virtues of audited centres
Only a single instance of sloth and poor cooperation with auditors was reported. Most reports highlighted an excellent disposition and collaborative attitude of institutional staff at all levels of the hierarchy.
One department was designated a ‘centre of competence’ by the audit team, which also stressed that with the support of higher authorities it could become a ‘centre of excellence’ .
Those institutions that offered formal training programmes such as residency programmes for physicians and physicists and continuing education activities were categorized as ‘academic centres’ [23, 24]. Three centers in South America and one in Central America received this rating.
Human resources and staff needs
Contrary to most publications concerning radiation oncology services in Latin America and the Caribbean [5, 16, 17] where needs have been calculated based on population of the respective countries [1, 3, 25], the centres audited by the IAEA generally had sufficient staff numbers to meet requirements both in the case of radiation oncologists and supporting staff (physicists and radiation therapists) [26–30]. Despite large numerical differences among departments, when each one is analysed separately, it is evident that the estimated minimum number of workers required is exceeded by existing ones in most cases. This was true for technical staff in eight (67 %) of the twelve centres audited and physicists and radiation oncologists in seven (58 %) (Table 1).
Interestingly, estimates indicated that one of the academic centres required double its existing physical and medical staff. This is because calculations directly increase the theoretical staff requirements depending on the technological resources of the department. Also, residents do not factor in calculations of personnel needs, while in reality the more advanced trainees in this centre undertake a significant workload. When the numbers of this particular centre are merged with those of other centres for a sub-regional estimation, its influence on the result indicates a slight lack of radiation oncologists and physicists in audited centres in South America.
The same effect but in the opposite direction, occurs when centres with major infrastructure ‘compensate’ for centers with more modest ones. Merging data into sub-regions makes differences between them ‘disappear’. For example, two departments were found where radiation oncologists were treating more than double the recommended number of patients with teletherapy (Table 2) [26–30], but this is not perceptible when presenting the results by sub-region (Table 1).
Facilities and equipment
Some centres lacking the minimum infrastructure recommended by the IAEA and other organizations [26–30] were identified. Three institutions did not perform gynaecological brachytherapy as previously mentioned. In addition, one installation delivered around 900 teletherapy treatments annually without simulation, planning or dosimetry equipment for that purpose (Table 3).
The technological capabilities were very heterogeneous among audited centres but as in the case of staff, differences were barely perceptible when data were collated (Table 3).
Recommendations from QUATRO audit teams
To audited centres
The recommendations to the audited centres were classified into personnel, infrastructure, processes and institutional organizational aspects.
Related to personnel
Improving communication among internal staff, among radiation oncologists with practitioners from other hospital departments and between the audited institution and other organizations was the most frequent recommendation in this category. Improving training and encouraging professional development to workers in general, and technologists in particular, was also a common recommendation (Fig. 1).
Related to infrastructure
Infrastructure includes all elements and technological resources that enable proper treatment planning and delivery. Furthermore it includes devices for clinical dosimetry and quality control of machines, computer platforms including network connections, and building aspects such as bunkers, changing rooms, meeting rooms, access pathways (wheelchairs, stretchers) and associated services.
The recommendations addressed topics concerning teletherapy and brachytherapy infrastructure together and each of the modalities separately (Fig. 2).
Installing, upgrading and expanding of computing resources stand out among the recommendations along with some aspects related to patient privacy. Acquiring devices for patient immobilization and clinical dosimetry as well as optimizing maintenance (preventive and corrective) of treatment machines were the commonest recommendations for teletherapy. All those centres without brachytherapy or with obsolete brachytherapy facilities were advised to install, upgrade and modernize this modality in the short term.
Relative to processes
As in the previous section, recommendations were divided into those concerning processes of external beam radiotherapy and brachytherapy alike, those aimed exclusively at teletherapy processes and the ones developed based on the findings of the auditors in brachytherapy services.
Both modalities, together and individually, did not adhere to protocols and institutional policies in most of the audited centres. Consequently the most frequent recommendation in this category was linked to these processes. Other very frequent recommendations highlighted the inadequate access of patients to multiple processes within institutions causing unacceptable waiting lists (Fig. 2). Waiting lists delayed patient access to the general process of radiotherapy as well as to each one of its individual components.
Related to organizational aspects
Here recommendations were limited to two terms, implementing non-existing programmes and improving those programmes that run incompletely or improperly. Quality management, radiation safety, allocation of responsibilities, follow up of patients and clinical research activities were the main programmes which most departments were recommended to implement or optimize (Fig. 3). The change of attitude of organizations focusing more on patients’ needs was also a frequent recommendation.
Radiotherapy centres which had been affected by radiation overexposure events in the past [31, 32] were advised to implement comprehensive institutional programmes to allow them to resume their activities with the confidence and fluency which the specialty requires.
Many recommendations advised governments on the evident need for allocating more budgetary resources to strengthen radiotherapy services (Fig. 4). Furthermore, the audit teams emphasized that neoplastic diseases must be considered a priority public health issue and that countries should implement comprehensive cancer control programs and ensure their sustainability.
The majority of recommendations alluded to different strategies to strengthen collaboration in human resource training and technological support to audited centres. Scheduled monitoring and follow-up visits were also stressed (Fig. 4). One of the audited centres received a follow-up visit 5 years following the original one. The report of this follow-up visits reflects a partial implementation of the recommendations issued in the first audit.
Quality audits following the QUATRO method were a valuable tool for identifying weaknesses that radiotherapy centres had regarding staff, infrastructure, processes and institutional organization. The recommendations drafted by the auditors provide guidance to improve levels of operation and service delivery in evaluated departments. Follow-up visits conducted by the IAEA or by regional or local organizations are necessary in order to evaluate the outcomes and sustainability of implemented changes. Countries with a large number of radiotherapy centres could adopt the QUATRO methodology to develop their own national audit systems as part of their national quality programmes in radiotherapy.
International Atomic Energy Agency
Pan American Health Organization
Quality Assurance Team in Radiation Oncology
Bachelor of Science
External beam radiotherapy
Magnetic resonance imaging
Positron emission tomography
Identification of the patient
Full time equivalent
Population Reference Bureau. 2014 World Population Data Sheet. http://www.prb.org/pdf14/2014-world-population-data-sheet_eng.pdf (accessed Dec 10, 2014).
Health in the Americas 2012. Regional Overview and country profiles. Washington DC: PAHO/WHO; 2012.
Goss PE, Lee BL, Badovinac-Crnjevic T, Strasser-Weippl K, Chavarri-Guerra Y, St Louis J et al. Planning cancer control in Latin America and the Caribbean. Lancet Oncol. 2013;14:391–36.
World Health Organization. International Agency for Research on Cancer. Globocan 2012: Estimated cancer incidence, mortality and prevalence worldwide in 2012. Available at: http://globocan.iarc.fr/Pages/fact_sheets_population.aspx (accessed Dec 3, 2014).
Zubizarreta EH, Fidarova E, Healy B, Rosenblatt E. Need for radiotherapy in low and middle income countries — the silent crisis continues. Clin Oncol. 2014;27(2):107–14.
International Atomic Energy Agency. Setting up a Radiotherapy Programme. Vienna: IAEA; 2008.
WHO Regional Office for Europe. Measuring hospital performance to improve quality of care in Europe: a need for clarifying concepts and defining the main dimensions. Copenhagen: WHO Regional Office for Europe. 2003.
Shih A, Schoenbaum SC. The Commonwealth Fund. Commission on a high performance health system. Measuring hospital performance: The importance of process measures, vol. 6. New York: Commonwealth Fund; Pub. 1046; 2007.
Cionini L, Gardani G, Gabriele P, Magri S, Morosini PL, Rosi A, et al. Quality indicators in radiotherapy. Radiother Oncol. 2007;82:191–200.
International Atomic Energy Agency. Comprehensive audit of radiotherapy practices: a tool for quality improvement. Vienna: Quality assurance team for radiation oncology (QUATRO); 2007.
Kutcher GJ, Coia L, Gillin M, Hanson WF, Leibel S, Morton R, et al. American Association of Physicists in Medicine Task Group 40. Report No. 46. Comprehensive QA for Radiation Oncology.
Fraass B, Doppke K, Hunt M, Kutcher G, Starkschall G, Stern R, et al. American Association of Physicists in Medicine Radiation Therapy Committee Task Group 53: quality assurance for clinical.
International Atomic Energy Agency. IAEA-TECDOC-1151. Aspectos físicos de la garantía de calidad en radioterapia: Protocolo de control de calidad. Viena: IAEA; 2000.
Mutic S, Palta JR, Butker EK, Das IJ, Huq MS, Loo LN, et al. Quality assurance for computed-tomography simulators and the computed tomography-simulation process: Report of the AAPM Radiation Therapy Committee Task Group 66. Med Phys. 2003;30:2762–92.
International Atomic Energy Agency. Staffing and Cost Calculation. Available at: http://nucleus.iaea.org/HHW/RadiationOncology/Makingthecaseforradiotherapyinyourcountry/Roleofradiotherapyincancercare/Radiotherapyisacosteffectivesystemwhichneedsabalance/RO_Staffing_Calculator.xlt (accessed Nov 19, 2014).
Zubizarreta EH, Poitevin A, Levin CV. Overview of radiotherapy resources in Latin America: a survey by the International Atomic Energy Agency (IAEA). Radiother Oncol. 2004;73:97–100.
Guedea F, Ventura M, Londres B, Pinillos L, Poitevin A, Ospino R, et al. Overview of brachytherapy resources in Latin America: a patterns-of-care survey. Brachytherapy. 2011;10:363–8.
International Atomic Energy Agency. Directory of radiotherapy centres (DIRAC). Vienna; 2012. Available at: http://www-naweb.iaea.org/nahu/dirac/ (accessed Dec 2, 2014).
Cancer Research UK. Worldwide cancer incidence. Updated February 2014. Available at: http://www.cancerresearchuk.org/cancer-info/cancerstats/world/incidence/#By (accessed Nov 13, 2014).
Tanderup K, Eifel PJ, Yashar CM, Pötter R, Grigsby PW. Curative radiation therapy for locally advanced cervical cancer: brachytherapy is NOT optional. Int J Radiat Oncol Biol Phys. 2014;88(3):537–9.
International Atomic Energy Agency. Safety Reports Series No. 47. Radiation Protection in the Design of Radiotherapy Facilities. Vienna: IAEA; 2006.
International Atomic Energy Agency. Proceedings Series. 12th Congress of the International Radiation Protection Association (IRPA12): Strengthening Radiation Protection Worldwide — Highlights, Global Perspective and Future Trends. Vienna: IAEA; 2010.
American College of Radiology. Radiation oncology practice accreditation program requirements. 2013. Available at: http://www.acr.org/~/media/ACR/Documents/Accreditation/RO/Requirements.pdf (accessed Dec 3, 2014).
Röttinger E, Barrett A, Leer JW. European Board of Radiotherapy. Guidelines for the Infrastructure of Training Institutes and Teaching Departments for Radiotherapy in Europe. July 2003. Available at: http://www.estro.org/binaries/content/assets/estro/school/european-guidelines/gititdre.pdf (accessed Nov 19, 2014).
Knaul FM, Frenk J, Shulman L. For the Global Task Force on Expanded Access to Cancer Care and Control in Developing Countries. Closing the cancer divide: a blueprint to expand access in low and middle Initiative; 2011. Available at: http://gtfccc.harvard.edu/fs/docs/icb.topic1063570.files/ccd_report_111027.pdf (accessed Nov 18, 2014).
Slotman BJ, Cottier B, Bentzen SM, Heeren G, Lievens Y, van den Bogaert W. Overview of national guidelines for infrastructure and staffing of radiotherapy. ESTRO-QUARTS: Work package 1. Radiother Oncol. 2005;75:349–54.
Budiharto T, Musat E, Poortmans P, Hurkmans C, Monti A, Bar-Deroma R, et al. Profile of European radiotherapy departments contributing to the EORTC Radiation Oncology Group (ROG) in the 21st century. Radiother Oncol. 2008;88:403–10.
International Atomic Energy Agency. Planning national radiotherapy services: a practical tool. Vienna: IAEA Human Health Series No. 14; 2010.
Purdy JA, Klein EE, Poortmans P, Hurkmans C. Quality Management and Safety in Radiation Oncology. In: Levitt SH, Purdy JA, Perez CA, Poortmans P, editors. Technical Basis of Radiation Oncology. Practical Clinical Applications. 5th ed. Berlin, Heidelberg: Spinger-Verlag; 2012. p. 485–530.
Dunscombe P, Grau C, Defourny N, Malicki J, Borras JM, Coffey M, et al. Guidelines for equipment and staffing of radiotherapy facilities in the European countries: Final results of the ESTRO-HERO survey. Radiother Oncol. 2014;112:165–77.
International Atomic Energy Agency. Accidental Overexposure of Radiotherapy Patients in San Jose, Costa Rica. Vienna: IAEA; 1998.
International Atomic Energy Agency. Investigation of an accidental exposure of radiotherapy patients in Panama; report of a team of experts. Vienna: IAEA; 2001.
Audit missions were funded by the IAEA Technical Cooperation Fund through regional and national technical cooperation projects. In 3 cases an additional expert was sponsored by the Pan American Health Organization (PAHO).
The IAEA is grateful to all auditors: Sergio Aguiar, Francisco Aguirre, Rodolfo Alfonso Laguardia, Maria Esperanza Castellanos, Marcela De la Torre, Rene Delgado Aguirre, Andrés Ferrer, Aracelli Guerra Bello, Danny Medina, Angel Juan Meneses, Doris Millan, Paulo Eduardo Novaes, Dionisio Pedro Oliva, Rosalba Ospino Peña, Angelina Patiño Trezza, Adela Poitevin, Aldo Quarneti, Thais Morella Rebolledo, Gabriela Requejo, Berta Roth, Roberto Salomon de Souza, Jose Samper, Rosanna Sansogne and Gustavo Sarria Bardales.
The authors declare that they have no competing interests.
ER, EZ and JI planned and coordinated all quality audits. ER, EZ, JI, SB, FGY contributed to the data analysis and drafting of the report. PJ provided technical and financial support from PAHO. All authors read and approved the final manuscript.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Rosenblatt, E., Zubizarreta, E., Izewska, J. et al. Quality audits of radiotherapy centres in Latin America: a pilot experience of the International Atomic Energy Agency. Radiat Oncol 10, 169 (2015). https://doi.org/10.1186/s13014-015-0476-7
- International Atomic Energy Agency
- Radiation Oncologist
- Quality Audit
- Radiotherapy Centre
- Comprehensive Cancer Control