Mechanical performance of a commercial knowledge-based VMAT planning for prostate cancer

Background This study clarified the mechanical performance of volumetric modulated arc therapy (VMAT) plans for prostate cancer generated with a commercial knowledge-based treatment planning (KBP) and whether KBP system could be applied clinically without any major problems with mechanical performance. Methods Thirty consecutive prostate cancer patients who underwent VMAT using extant clinical plans were evaluated. The mechanical performance and dosimetric accuracy of the single optimized KBPs, which were trained with other 51 clinical plans, were compared with the clinical plans. The mechanical performance metrics were mean field area (MFA), mean asymmetry distance (MAD), cross-axis score (CAS), closed leaf score (CLS), small aperture score (SAS), leaf travel (LT), modulation complexity score (MCSv), and monitor unit (MU). The γ passing rates were evaluated with ArcCheck and EBT3 film. Results The mean mechanical performance metrics (clinical plan vs. KBP) were as follows: 18.28 cm2 vs. 17.25 cm2 (MFA), 21.08 mm vs. 20.47 mm (MAD), 0.54 vs. 0.55 (CAS), 0.040 vs. 0.051 (CLS), 0.20 vs. 0.23 (SAS5mm), 458.5 mm vs. 418.8 mm (LT), 0.27 vs. 0.27 (MCSv), and 618.2 vs. 622.1 (MU), respectively. Significant differences were observed for CLS and LT. The average γ passing rates (clinical plan vs. KBP) were as follows: 99.0% vs. 99.1% (3%/3 mm) and 92.4% vs. 92.5% (2%/2 mm) with ArcCHeck, and 99.5% vs. 99.4% (3%/3 mm) and 95.2% vs. 95.4% (2%/2 mm) with EBT3 film, respectively. Conclusions The KBP used lower multileaf collimator (MLC) travel and more closed or small MLC apertures than the clinical plan. The KBP system of VMAT for the prostate cancer was acceptable for clinical use without any major problems.


Background
In intensity-modulated radiotherapy (IMRT) and volumetric modulated arc therapy (VMAT), variations in knowledge and experience can lead to significant differences in the plan quality and may compromise the gains of high-precision radiotherapy [1,2]. Knowledge-based treatment planning (KBP) is an approach to reduce the differences in plan quality and improve planning consistency [1]. A commercial KBP module, RapidPlan (Varian Medical Systems, Palo Alto CA, USA) has been released for the Eclipse (Varian) treatment planning system (TPS). KBP uses a statistical model generated from a library of clinically accepted plans with consistent high quality to train dose volume histograms (DVHs) [1,3]. This model predicts an achievable DVH range and generates dose volume objectives for IMRT and VMAT plan optimization [1,3].
Many studies have reported the KBP can generate the better or comparable dosimetric results in some anatomical sites [1][2][3][4][5][6][7][8][9]. Hussein et al. described the KBP was able to produce IMRT and VMAT treatment plans for prostate cancer with a single optimization, with sparing and conformity better than or comparable to a clinical plan [1]. In addition, Ueda et al. suggested the KBP could also reproduce the dose distributions based on the experience of institutions in the case of sharing the KBP model, although it was necessary to verify the registered DVH curves could match the plan design of each institution [10]. However, Kubo et al. found that KBP may encounter difficulties with high numbers of MUs and high modulation complexity [11]. At this time, we focused on the mechanical performance of the KBP, which has not been delineated. Additionally, dosimetric accuracy can be affected by mechanical performance [12,13]. VMAT delivery requires extremely precise mechanical performance for a linear accelerator (Linac) due to the simultaneous gantry speed, dose rate, and multileaf collimator (MLC) aperture shape variations; this makes patient-specific quality assurance (QA) an essential prerequisite for actual patient treatment [13,14]. The purpose of this study was to clarify the mechanical performance of the VMAT plans generated by the KBP for prostate cancer and verify patient-specific QA to assess KBP's appropriateness in the clinical setting.

Clinical plan and KBP
The cases of 30 consecutive prostate cancer patients (between September 2016 and March 2017) who underwent VMAT with clinical plans were analyzed. We trained the KBP system with the other consecutive 51 cases of T1-T2c prostate cancer treated between August 2015 and August 2016. Written informed consent was obtained from all patients and the Institutional Ethics Committee approved this study (institutional review board number: 29-133). The KBP model configuration and training process is well-explained in the literature [5,7,11]. The clinical target volume (CTV) was defined as the prostate and seminal vesicle and delineated by experienced radiation oncologists. The planning target volume (PTV) was defined with a 6 mm posterior margin and a 10 mm margin in all other directions added to the CTV to reduce the dose at the prostate-rectal interface. The organ at risks (OARs) were rectal wall and bladder wall. The rectum was delineated up to 1.0 cm above and below the PTV. The rectal wall and bladder wall were delineated 4.0 mm inside the outer surface of rectum and bladder, respectively. The prescribed dose was 78 Gy in 39 fractions to 95% of the volume of the PTV minus rectum (PTV − R) using 10 MV photon beams and 2 full arcs VMAT (Gantry angle: 181°-179°, clockwise and 179°-181°, counterclockwise, collimator angles: 30°and 330°). The control point spacing was 2°angular separation. All VMAT plans were calculated with the Varian Analytic Anisotropic Algorithm (AAA) [15] using the Eclipse treatment planning system ver. 13.6 for a TrueBeam (Varian) with a Millennium 120 MLC. The goals of the treatment plan in our institution were as follows: The maximum dose (D max ) was < 110% and the mean dose (D mean ) was 99-103% of the prescribed dose for the PTV − R; V 40 Gy < 60%, V 60 Gy < 35%, V 70 Gy < 25%, and V 78 Gy < 1% for the rectal wall; V 40 Gy < 60% and V 70 Gy < 35% for the bladder wall [10,16]. The overlap region between PTV and rectal wall was covered with the 90% isodose line.
The geometry and dosimetry of the PTV − R, rectum, and bladder were registered in the KBP library. In this model, the geometry or dosimetry outliers were not excluded since the removal of statistical outliers had no significant impact on establishing the model [1]. Then, we performed the dose calculation using KBP with the single optimization in the 30 consecutive clinical cases.

KBP validation
The following parameters were compared between the 30 clinical plans and the 30 KBPs:

Patient-specific QA
The gamma index evaluation for patient-specific QA has been a standard technique used to evaluate measured distributions in commercial detector systems and gafchromic film against the dose distributions predicted by TPSs [21]. We employed ArcCheck (SunNuclear, Melbourne FL, USA) as a commercial detector system for patient-specific QA. The film dosimetry was also performed. The EBT3 gafchromic film (Ashland ISP Advanced Materials, Bridgewater, NJ, USA) was inserted at the sagittal plane in center of the ArcCheck. Irradiated films were scanned using Epson ES-10000G scanner (Epson Corp., Nagano, Japan) at least 24 h after irradiation with a resolution of 150 dpi from red channel. A calibration curve, film optical density versus dose, was determined for a range from 0 to 300 cGy. For analysis, the DoseLab ver. 6.70 (Mobius Medical Systems, TX, USA) was employed. An ionization chamber (CC01, IBA, Schwarzenbruck, Germany) was used for measurement of absorbed dose at the isocenter in the ArcCheck (source-to-axis distance (SAD) = 100 cm). Then we evaluated the differences in dose distribution and point dose at isocenter among plans and measurements for each clinical plan and KBP. The difference of dose distribution was evaluated using the passing rate of γ index with two tolerances in terms of dose difference (DD) and distance to agreement (DTA) (3%/3 mm and 2%/2 mm) with a threshold at 10%.

Statistical analysis
The data are expressed as the median and interquartile ranges (first quartile, third quartile), unless otherwise indicated.  Table 2 summarizes the results of comparisons between the clinical plan and the KBP of D max , D min , D mean , HI and CI 95 for PTV − R, dose-volume parameters for rectal wall and bladder wall. For the PTV − R, the D min and the D mean were comparable between the clinical plan and the KBP, and the D max of the KBP was significantly lower than those of the clinical plan (p < 0.01). The homogeneity of PTV − R of the KBP was significantly better than those of the clinical plan (p = 0.03). In addition, the PTV − R coverage of the KBP was more conformal as indicated by the CI 95 being significantly lower than the CI 95 of the clinical plan (p < 0.01). For the rectal wall and the bladder wall, the dose-volume parameters of the KBP were comparable to those of the clinical plan except for the V 78 Gy for the rectal wall. The   Fig. 1. The KBP was able to generate better or comparable dosimetric results compared to clinical plan using our training model.  Fig. 2a-c. On the other hand, negative correlations were observed between MCS v and SASs for threshold ≥10 mm in Fig. 2e, f. Table 4 shows the γ passing rate of each criterion for the clinical plan and the KBP. No significant differences were observed between the clinical plan and the KBP in the γ passing rate with ArcCheck and EBT3 film. The γ passing rates of the clinical plan and the KBP were > 90% for all cases for commonly used criteria of 3%/ 3 mm [22][23][24]. For more stringent 2%/2 mm, the cases of the clinical plan and the KBP in which the γ passing rates were > 90% with the ArcCheck were 24 and 25 cases in 30 cases, respectively. On the other hand, the cases of both the clinical plan and the KBP in which the γ passing rates were > 90% with EBT3 film were 28 cases in 30 cases. No mechanical performance metrics were correlated to the γ passing rate. The differences in absorbed dose at the isocenter for measurement compared to the TPS were − 0.40% (− 0.86%, 0.023%) and − 0.29% (− 0.50%, − 0.083%) for the clinical plan and the KBP, respectively (p = 0.48).

Discussion
In this study, we clarified the mechanical performance and evaluated the dosimetric accuracy of the VMAT generated by the KBP for prostate cancer. The KBP system can be used in clinical practice without any major problems, although the KBP created dose distributions a c b Fig. 1 The average DVHs of the clinical plan and the KBP for PTV − R (a), rectal wall (b), and bladder wall (c). For the PTV − R of the KBP, the D max was lower than those of the clinical plans, which improved the homogeneity. The V 78 Gy for rectal wall of the KBP was higher than those of the clinical plans, however it was < 1% for all cases  In the KBP model validation, Table 2 and Fig. 1 show the dose volume parameters of the KBP with the single optimization for PTV − R were better or comparable, and for rectal wall and bladder wall were comparable, to the clinical plan, respectively. The KBP also had higher homogeneity and conformity for PTV − R compared to the clinical plan. However, this model could contain a limited number of structures (e.g. femoral head, sacrum, anal canal, and bulbus penis).
In mechanical performance, the CLS and the LT values of the KBP were significantly different from the clinical plan as shown in Table 3. Additionally, the SASs for all thresholds of the KBP were higher than those of the clinical plan, although not to a significant degree. The KBP system might use lower MLC travel, and more closed or small MLC apertures at each control point than the clinical plan. The negative correlations between MCS v and SASs for threshold ≥10 mm were shown in Fig. 2e-f. The modulation complexity was increased with the proportion of small apertures increasing, which was also described by Crowe et al. [20]. Therefore, one full arc VMAT plan generated by the KBP might increase the MU and the modulation complexity compared to the clinical plan [11]. On the other hand, two full arcs VMAT plans generated by the KBP might decrease the MU and the modulation complexity. Hussein et al. also showed the MU and modulation complexity were not difference between the KBP and clinical plan for two full arcs VMAT plans [1].
The γ passing rates for all criteria of DD and DTA were not significantly different between the clinical plan and the KBP, and all cases of the clinical plan and the KBP had the γ passing rates of more than 90% for AAPM recommending criteria of 3%/3 mm [23] as shown in Table 4, although the mechanical performance of the KBP did not correspond to that of the clinical plan. A patient-specific QA passed if the γ passing rate was > 90% of points achieving the 3%/3 mm criterion, which is acceptable in the clinical setting [22][23][24], although some reports describe more stringent criteria such as 2%/2 mm [25][26][27]. It is necessary to understand the sensitivity and limitations of the gamma index analysis combined with the equipment in use [21].

Conclusions
The KBP with the single optimization used lower MLC travel and more closed or small MLC apertures compared to the clinical plan. The VMAT plan generated by the KBP for prostate cancer could be applied clinically without any major problems.