- Open Access
Dosimetric verification of radiotherapy treatment planning systems in Serbia: national audit
Radiation Oncologyvolume 7, Article number: 155 (2012)
Independent external audits play an important role in quality assurance programme in radiation oncology. The audit supported by the IAEA in Serbia was designed to review the whole chain of activities in 3D conformal radiotherapy (3D-CRT) workflow, from patient data acquisition to treatment planning and dose delivery. The audit was based on the IAEA recommendations and focused on dosimetry part of the treatment planning and delivery processes.
The audit was conducted in three radiotherapy departments of Serbia. An anthropomorphic phantom was scanned with a computed tomography unit (CT) and treatment plans for eight different test cases involving various beam configurations suggested by the IAEA were prepared on local treatment planning systems (TPSs). The phantom was irradiated following the treatment plans for these test cases and doses in specific points were measured with an ionization chamber. The differences between the measured and calculated doses were reported.
The measurements were conducted for different photon beam energies and TPS calculation algorithms. The deviation between the measured and calculated values for all test cases made with advanced algorithms were within the agreement criteria, while the larger deviations were observed for simpler algorithms. The number of measurements with results outside the agreement criteria increased with the increase of the beam energy and decreased with TPS calculation algorithm sophistication. Also, a few errors in the basic dosimetry data in TPS were detected and corrected.
The audit helped the users to better understand the operational features and limitations of their TPSs and resulted in increased confidence in dose calculation accuracy using TPSs. The audit results indicated the shortcomings of simpler algorithms for the test cases performed and, therefore the transition to more advanced algorithms is highly desirable.
Quality Assurance (QA) in radiotherapy treatment planning process is essential to ensure that the dose calculation is performed correctly and to minimize the likelihood of accidental exposure[1, 2]. Many studies have been performed that lead to the development of guidelines and protocols for QA of 3D radiotherapy TPSs[3, 4]. Some studies have been done for solving specific problems associated with TPSs performance and dose calculation[5–7]. For the purpose of acceptance testing, commissioning and QA of TPSs, the IAEA has published Technical Reports Series No. 430 that provides the general framework and describes a large number of tests and procedures to be considered by the TPS users. However, small hospitals with limited resources or large hospitals with high patient load and limited staff are not always able to perform all procedures recommended in this report, therefore the IAEA prepared a set of practical tests for dosimetry calculations in radiotherapy, defined in a dedicated technical document, TECDOC 1583.
This document has been used as the basis to conduct the dosimetric audit of TPSs in Serbia. The methodology of this audit focuses on dosimetry part of the treatment planning and delivery processes. An anthropomorphic phantom is used with a set of clinical test cases prepared by the IAEA, covering a range of typical clinical radiation techniques in 3D CRT. The audit methodology verifies the chain in external beam radiotherapy workflow, from patient data acquisition to treatment planning and dose delivery.
The audit was conducted in three out of six radiotherapy departments in Serbia, i.e. the Institute of Oncology of Vojvodina in Sremska Kamenica, the Clinical Centre in Niš and the Institute of Oncology and Radiology of Serbia in Belgrade. Hospitals where audit was not conducted either did not have computerized TPS or their treatment machines were out of working order during the auditing period. The audit programme required two days per hospital to be carried out.
The choice of the phantom for this study was based on the following considerations: minimal restricted flexibility, easy handling and capability to perform all dosimetric and anatomical test cases. From the comparison of different phantoms for clinical commissioning of TPSs following an IAEA protocol given in TECDOC 1583, it was chosen that the clinical test case measurements will be conducted on the semi-anthropomorphic phantom CIRS Thorax 002 LFC (CIRS Inc., Norfolk, Virginia). The phantom is elliptical in shape (30 cm long x 30 cm wide x 20 cm thick) and represents an average human torso in proportion, density and two-dimensional structure. The body of the phantom is made of plastic water, lung and bone sections containing 10 holes to hold interchangeable rod inserts for an ionization chamber. The holes are numbered as shown in Figure1. The phantom was supplemented with a set of four reference plugs with well-defined relative electron densities (muscle, bone, lung and adipose equivalent tissue).
The phantom was scanned in each hospital using a CT. Dose measurements were performed by placing the calibrated ionization chamber into the different holes in the phantom. The scanning procedure and that for the dose measurements are described in the sections below.
The purpose of this test was to verify the Hounsfield units (HU) to relative electron density (RED) conversion curve stored in the TPSs. The phantom was scanned twice in each hospital using a CT. For the first scan the reference plugs with different known material properties were inserted into the holes in the phantom to check CT numbers to the RED conversion curve. Recommended arrangement of the reference plugs for the first CT scan were: hole 2- muscle reference plug, hole 4 - adipose reference plug, hole 5 - syringe filled with water, hole 6 - lung reference plug, hole 7 - should be empty to represent air and hole 10 - bone reference plug.
The second scan was done without reference plugs and was used for the planning of clinical test cases as defined in the TPS audit exercise. During second scan all holes were filled with appropriate rod inserts. The local scanning protocol was used, and the scanning parameters for both scans were kept the same. The acceptance criteria for the difference between the stored and measured values of CT numbers for the same RED was ± 20HU.
Clinical test cases
A set of clinical test cases was created to verify a range of basic treatment techniques applied in the clinical practice. The beam geometry and sample dose distribution are shown in Figure1. The detailed description of test cases is given in the IAEA TECDOC 1583. The measurement points for each case were selected to avoid high dose gradients and measurements in the penumbra region. The total number of measurement points in eight test cases was fifteen. The same set of clinical test cases was applied in all three hospitals. The dose calculations were performed for each available algorithm based on the grid size normally used in the hospital’s clinical practice.
Treatment planning systems
Two different calculation algorithms implemented on three CMS XiO (Elekta CMS Software, St. Louis, Missouri) versions 4.33, 4.40 and 4.60 TPSs were investigated. All three hospitals use inhomogeneity corrections in clinical practice. The full description of implemented calculation algorithms are beyond the scope of this paper and can be found elsewhere[10–13]. The algorithms in this study have been divided into two groups:
Type (a) algorithms. Model based algorithms where changes in lateral electron and photon transport are not modeled (no lateral transport). Such algorithms use a pencil beam convolution model and primarily equivalent path length corrections to account for inhomogeneities.
Type (b) algorithms. Model based algorithms where changes in lateral electron and photon transport are approximately modeled (with lateral transport). These algorithms use a point kernel convolution/superposition model and account for the density variation in 3D.
CT scanners used in the study were Somatom 4 Plus (Siemens, Erlangen) and Light speed RT (General Electric Inc., Fairfield, Connecticut). Dose measurements were performed in three hospitals using different linear accelerators with nominal photon energies of 6 and 15 MV from the Varian Clinac 2100 series (Varian Medical Systems, Palo Alto, California); 6 and 15 MV beams from Siemens Oncor accelerators (Siemens Medical Solutions, Erlangen) and 6 and 15 MV beams from Elekta Synergy accelerators (Elekta Oncology Systems, Crawley). The photon beams were divided according to the energy into two groups: lower energy X-ray (6 MV) and higher energy X-ray (15MV) beams. In two institutions Farmer type chambers FC65-G (IBA Dosimetry, Schwarzenbruck, Germany) were used while in one institution ionisation chamber NE 2571 (Nuclear Enterprise Technology, U.K) was employed. In all measurements Dose 1 (IBA Dosimetry, Schwarzenbruck, Germany) electrometer was used. All chambers and the electrometer were calibrated by the national secondary standards dosimetry laboratory. For all measurement points, the absorbed dose to water was determined from ionization chamber measurements using the IAEA TRS 398 dosimetry code of practice. When measuring in lung and bone equivalent materials it is assumed that the doses are measured in small water cavities within these materials. Since these small cavities have not been outlined on CT slices during dose calculations, the reported doses in these materials have a larger uncertainty than those in plastic water. The impact of water cavities has been estimated to increase the calculated dose by up to 2% for lung equivalent material and up to 0.3% for bone equivalent material in worst case scenarios.
Analysis of the results
For the evaluation of the measured (Dmeas) and TPS calculated (Dcal) values the criteria specified in IAEA TRS 430 were employed. However, due to the limited number of available positions for dose measurements in the phantom and for better consistency in the interpretation of the results for the various points the dose differences were normalized to the dose measured at the reference point for each test case, i.e. the following equation was used:
where Dmeas, ref is the dose value measured at the reference point. This reference point is a point that is expected to have received 2 Gy, and it was specified for each test case. For multiple beam combination the difference between measured and calculated dose values for selected beam should be related to the dose measured at the reference point for the corresponded beam. The agreement criteria for each test case were determined according to the complexity of the test case geometry.
CT to RED conversion
All systems reviewed in this audit had generic or TPS manufacturer supplied CT to RED conversion curves. Based on the measurements, we concluded that there were differences of 6-12% in the region of higher electron densities in two out of three cases (Figure2). However, it was estimated that this difference in relative electron density affects dose calculation accuracy less than 2%[9, 15]. In Figure2 we also presented a zoom at high density region with TPS data added.
Clinical test cases
The differences between the measured and calculated doses for the various measurement points and test cases for all three hospitals are presented in Figures3 and4. The results are grouped according to the energies and the calculation algorithms implemented (with or without lateral transport). Also the value of the agreement criteria for each measurement point and their sum, for the points where there are contributions from a several beams coming from various directions, is shown as a thick purple line.
The differences in the results between centres with similar calculation algorithms could be partly attributed to model beam fitting process and CMS XiO TPS limitations to model different accelerator’s heads.
The largest deviations were observed in the customised blocking test (test 5) in point 7, which was located within the lung equivalent material, see Figure3. The differences up to 9% for lower energy beams and up to 15% for higher energy beams were found for the type (a) algorithms. For the type (b) algorithms (Figure4) the results for both groups of beam energies were within the agreement criteria.
The irregular L-shaped field test (test 6) had three measurement points: one in plastic water (point 3), one in the lung equivalent material (point 7) and one in the bone equivalent material (point 10). Large deviations up to 9% for lower energy beams and up to 12% for higher energy beams were observed in point 7 for the algorithms type (a), as can be seen in Figure3. Type (b) algorithms showed results within the agreement criteria (Figure4).
The four-field box test (test 4) had three measurement points: one at the isocentre in plastic water (point 5), one in the lung equivalent material on the central axis of lateral beams (point 6) and one in the bone equivalent material on the central axis of vertical beams (point 10). The deviations outside agreement criteria were found for points 6 (lung) and 10 (bone) for type (a) algorithms for all energies (Figure3). The differences up to 9% for lower energy beams and up to 14.8% for higher energy beams were found in point 6 (lung). The dose in point 10 (bone) was underestimated by 6% for lower energy beams and 7.2% for higher energy beams. Type (b) algorithms yielded results within the agreement criteria (Figure4).
Before the audit, all three centers used algorithms type (a) for dose calculation in treatment plans for all patients. During the comparison of both algorithm types in clinical cases the largest deviations were observed for lung tumor patients treated with higher energy beams. It was noticed that high energy lung treatment plans calculated by algorithms type (a) may result in reduction of PTV volume covered by 95% isodose by up to 18%. Due to this problem, the change in clinical practice was introduced after the audit in all three centers and all dose calculations in the thorax region are performed with type (b) algorithm.
Also, the verification of basic dosimetry data input into TPS was done. After the review of the dosimetric data entered into the local TPS, it was found that the head scatter factors for a 15 MV photon beam in one of the hospitals were not correct and new measurements with a mini phantom were performed to correct this problem. In another hospital, a mistake in a wedge factor entry for a high energy beam and 15 degree hard wedge was discovered for the field 15x15 cm2 and it was corrected.
The TPS data review within this audit appeared to be an excellent opportunity to spot any errors in the local TPS data and correct them.
An adjustment in CT numbers to the RED conversion curve was needed in two out of three TPSs in the high density region according to criteria from TRS 430. The differences of 6-12% were found in the region with densities above that for water. However, the magnitude of the error in the calculated dose due to this difference was estimated to be less than 2% for the 6 MV photon beam passing through 5 cm thick material with the RED of 1.5[9, 15]. Therefore, the adjustments were not carried out.
Although the TPS algorithm testing was not the purpose of the audit, several general conclusions could be drawn. The systematic dose overestimation by up to 15% for the type (a) calculation algorithms was recorded for all measurement points located inside the lung equivalent material. It was observed that the range of deviations was related to the beam energy, i.e. larger deviations were observed for the higher beam energy. Doses inside the bone equivalent material were underestimated by up to 7% for both 6 MV and 15 MV beams for both algorithm types. In general, the type (a) algorithms are not adequate for dose calculations in the presence of and inside low density inhomogeneities, while the type (b) algorithms showed good results for all test cases.
Accordingly, a comparison of calculation for different clinical lung treatment plans was carried out. Patient plans were calculated by both algorithms, but irradiated according to the results of the advanced type (b) algorithm. The overall treatment time calculated with algorithm type (b), was 5–7% longer in comparison to the calculation of algorithm type (a), and the coverage of PTV, in terms of 95% isodose, was better (up to 18%). That means that the plan calculated by the simpler algorithm was actually overestimating the dose to be delivered, in reality leading to the underdosage of the target volume. This applies both to lower energy and even more to higher energy beams.
Differences between doses calculated with algorithms type (a) and (b) are primarily due to changes in electron transport in the lungs, which is not adequately taken into account by algorithms type (a). Many papers have demonstrated that simplistic algorithms can overestimate the dose at tumor lung boundary which may be misleading clinically and even contra-indicated[18–21].
Following findings from the audit, and recommendations from the literature, the preferred beam energy for planning the lung tumors, was moved from higher to lower energies in most thorax cases in the audited clinics. In some cases were used combinations of higher and lower energy beams due to better dose distribution.
Transition to more advanced algorithms provides a better consistency between the reported and actually delivered doses, which opens opportunities for establishing a more precise dose-volume relationship for tumours and normal tissues.
The range of the dose deviations that occurred in this audit exercise reflects the relative dosimetric accuracy of the treatment planning process from CT scanning to the dose delivery. The accuracy of the dose calculation algorithm is one of the main factors affecting the overall uncertainty of the dose delivered to the patient, and it is very important to perform various tests to better understand the TPS limitations. The test cases presented within this audit proved to be useful to verify the TPS calculations with measurements and to estimate the magnitude of algorithm limitations in situations close to clinical settings, however, it should be understood that the type and number of tests performed should depend on the local practice of a particular institution.
The users of different TPSs may utilize the final results of tests as a reference data for the ongoing periodic QA checks. However, it is important to emphasize that the final dose calculation results may be affected by different factors, such as the dose calculation grid, inadequacies in input data, the choice of phantom used, and others.
The ionization chamber dosimetry with a limited number of points has some restrictions as the results may depend on the selection of individual points. However, the end-to-end approach is considered adequate for the evaluation of the overall quality of the dose calculations and to explore the limitations of the TPS[9, 24]. Some aspects such as the penumbra widening in low density materials at higher energy beams (test 1, point 9) may be better explored using film dosimetry but this was beyond the objectives of this study.
Another advantage of the TPS audit is that it can be performed in a reasonable amount of time in hospitals with high patient load and limited staff and enables the user to have his/her work evaluated by an independent peer reviewer.
The methodology described in the IAEA TECDOC 1583 was used to perform TPS audits in three radiotherapy centers of Serbia. A few discrepancies in basic dosimetric data were discovered and corrected. The results also indicated the shortcomings of type (a) treatment planning algorithms and, therefore the transition to more advanced algorithms, type (b), was implemented. In addition, it was decided to consistently plan future lung cancer treatments with lower energy photon beams for which the TPS dose calculations are more accurate compared to those for higher energy beams. The audit could also help the users to appreciate the properties, qualities and operational characteristics of treatment planning systems and to better understand their limitations.
IAEA: Investigation of an Accidental Exposure of Radiotherapy Patients in Panama. Vienna: IAEA; 2001.
IAEA: Lessons Learned from Accidental Exposures in Radiotherapy, Safety Reports Series No. 17. Vienna: IAEA; 2000.
AAPM (American Association of Physicists in Medicine): Quality assurance for clinical radiotherapy treatment planning. Med Phys 1998, 25: 1773-1829. report 53 10.1118/1.598373
Mijnheer B, Olszewska A, Fiorino C, et al.: Quality assurance of treatment planning systems. Practical examples for non-IMRT photon beams. Brussels: ESTRO; 2005. ESTRO Booklet no. 7
Nisbet A, Beange I, Vollmar HS, Irvine C, Morgan A, Thwaites DI: Dosimetric verification of a commercial collapsed cone algorithm in simulated clinical situations. Radiother Oncol 2004, 73: 79-88. 10.1016/j.radonc.2004.06.007
Davidson SE, Ibbott GS, Prado KL, Dong L, Liao Z, Followill DS: Accuracy of two heterogeneity dose calculation algorithms for IMRT in treatment plans designed using an anthropomorphic thorax phantom. Med Phys 2007, 34: 1850-1857. 10.1118/1.2727789
Cheng CW, Das IJ, Tang W, et al.: Dosimetric comparison of treatment planning systems in irradiation of breast with tangential fields. Int J Radiat Oncol Biol Phys 1997, 38: 835-842. 10.1016/S0360-3016(97)00078-3
IAEA (International Atomic Energy Agency): Technical Report Series 430 Commissioning and quality assurance of computerized planning systems for radiation treatment of cancer. Vienna: IAEA; 2005.
IAEA (International Atomic Energy Agency): Commissioning of radiotherapy treatment planning systems: testing for typical external beam treatment techniques. Vienna: IAEA; 2008. TECDOC 1583
Venselaar JLM, Welleweerd J: Application of a test package in an intercomparison of the performance of treatment planning systems used in a clinical setting. Radiother Oncol 2001, 60: 203-213. 10.1016/S0167-8140(01)00304-8
AAPM (American Association of Physicists in Medicine): Tissue inhomogeneity corrections for MV photon beams. Report of Task Group No. 65 of the Radiation Therapy Committee of the American Association of Physicists in Medicine (AAPM). Madison, WI: Medical Physics Publishing; 2004. Report 85
Kappas C, Rosenwald JC: Quality control of inhomogeneity correction algorithms used in treatment planning systems. Int J Radiat Oncol Biol Phys 1995, 32: 847-858. 10.1016/0360-3016(94)00474-Y
Knoos T, Wieslander E, Cozzi L, et al.: Comparison of dose calculation algorithms for treatment planning in external photon beam therapy for clinical situations. Phys Med Biol 2006, 51: 5785-5807. 10.1088/0031-9155/51/22/005
IAEA (International Atomic Energy Agency): Absorbed dose determination in external beam radiotherapy. An International Code of Practice for Dosimetry Based on Standards of Absorbed Dose to Water. Vienna: IAEA; 2000. Technical Report Series 398
Chu JCH, Ni B, Kriz R, Saxena VA: Applications of simulator computed tomography number for photon dose calculations during radiotherapy treatment planning. Radiother Oncol 2000, 55: 65-73.
Alam R, Ibbott GS, Pourang R, Nath R: Application of AAPM Radiation Therapy Committee Task Group 23 test package for comparison of two treatment planning systems for photon external beam radiotherapy. Med Phys 1997, 24: 2043-2054. 10.1118/1.598119
Carrasco P, Jornet N, Duch MA, et al.: Comparison of dose calculation algorithms in slab phantoms with cortical bone equivalent heterogeneities. Med Phys 2007, 34: 3323-3333. 10.1118/1.2750972
Orton CG, Chungbin S, Klein EE, Gillin MT, Schultheiss TE, Sause WT: Study of lung density corrections in a clinical trial (RTOG 88–08). Int J Radiat Oncol Biol Phys 1998,41(4):787-794. 10.1016/S0360-3016(98)00117-5
Yorke E, Harisiadis L, Wessels B, Aghdam H, Altemus R: Dosimetric considerations in radiation therapy of coin lesions of the lung. Int J Radiat Oncol Biol Phys 1996,34(2):481-487. 10.1016/0360-3016(95)02036-5
Zhu XR, Low DA, Harms WB, Purdy JA: A convolution-adapted ratio-TAR algorithm for 3D photon beam treatment planning. Med Phys 1995, 22: 1315-1327. 10.1118/1.597516
Klein EE, Morrison A, Purdy JA, Graham MV, Matthews J: A volumetric study of measurements and calculations of lung density corrections for 6 MV and 18 MV photons. Int J Radiat Oncol Biol Phys 1997, 37: 1163-1170. 10.1016/S0360-3016(97)00110-7
Pettersen MN, Aird E, Olsen DR: Quality assurance of dosimetry and the impact on sample size. Radiother Oncol 2008, 86: 195-199. 10.1016/j.radonc.2007.07.001
Gershkevitsh E, Schmidt R, Velez G, Miller D, Korf E, Yip F, Wanwilairat S, Vatnitsky S: Dosimetric verification of radiotherapy treatment planning systems: Results of IAEA pilot study. Radiother Oncol 2008, 89: 338-346. 10.1016/j.radonc.2008.07.007
Schiefer H, Fogliata A, Nicolini G, et al.: The Swiss IMRT dosimetry intercomparison using a thorax phantom. Med Phys 2010,37(8):4424-4431. 10.1118/1.3460795
Petrovic B, Rutonjski L, Baucal M, Teodorovic M, Gershkevitsh E: Verification of newly upgraded radiation therapy treatment planning system XIO CMS at the Institute of oncology Vojvodina, International Symposium on Standards, Applications and Quality Assurance in Medical radiation Dosimetry (IDOS). Book of extended synopses.Vienna: IAEA;. 2010, 435-436.
This audit was supported by the International Atomic Energy Agency through a Technical Co-operation Project RER/6/018: "Strengthening Regional Capacity in Medical Radiation Physics". The authors would like to express special thanks to the physicists of various radiotherapy departments who helped with the measurements, and particularly Mr. Milan Sarić and Mr. Goran Kolarević (Institute of oncology and radiology of Serbia, Belgrade, Serbia), Mr. Dragan Nikolić and Ms. Tamara Jovanović (Clinical center, Niš, Serbia).
The authors declare that they have no competing interests.
LR: substantial contributions to conception and design, acquisition of data, treatment planning, analysis and interpretation of data, writing the draft of the manuscript, revising it critically for important intellectual content. BP: analysis and interpretation of data, substantial contributions to conception and design, revising it critically for important intellectual content, have given final approval of the version to be published. MB: treatment planning of test cases, revision of manuscript. MT: treatment planning of test cases, revision of manuscript. OČ: acquisition of data, revision of manuscript. EG: substantial contributions to conception and design, acquisition of data, analysis and interpretation of data, drafting the manuscript, revising it critically for important intellectual content, have given final approval of the version to be published. JI: substantial contributions to conception and design, drafting the manuscript, revising it critically for important intellectual content, have given final approval of the version to be published. All authors read and approved the final manuscript.
Borislava Petrović, Milutin Baucal, Milan Teodorović, Ozren Čudić, Eduard Gershkevitsh and Joanna Izewska contributed equally to this work.