Utilizing clinical pathways and web-based conferences to improve quality of care in a large integrated network using breast cancer radiation therapy as the model

Background Clinical pathways outline criteria for dose homogeneity and critical organ dosimetry. Based upon an internal audit showing suboptimal compliance with dosimetric parameters in whole breast irradiation (WBI), we conducted a mandatory web-based teaching conference for the network. This study reports the impact of this initiative on subsequent treatment plans. Methods Radiation treatment plans were collected for the 10 most recent patients receiving WBI at 16 institutions within the UPMC Hillman Cancer Center network. Subsequently, a web-based conference was conducted to educate staff physicians, physicists, and dosimetrists with goals for dose homogeneity and critical organ dosimetry. Six months post-conference, another 10 plans were collected from each site and compared to pre-conference plans for deviations from dosimetric criteria. Results Dose homogeneity significantly improved after the conference with breast V105% decreasing from 15.6% to 11.2% (p = 0.004) and breast V110% decreasing from 1.3% to 0.04% (p = 0.008). A higher percentage of cases were compliant with dosimetric criteria, with breast V105% > 20% decreasing from 22.5% to 7.5% of cases (p = 0.0002) and breast V110% > 0% decreasing from 13.8% to 4.4% of cases (p = 0.003). Conclusions Implementation of a web-based teaching conference helped improve adherence to clinical pathway dosimetric guidelines for WBI. In radiation oncology networks, this may be an effective model to ensure quality in routine practice and can be extrapolated to other disease sites.


Background
The technique of adjuvant whole breast irradiation (WBI) has improved significantly in the last decade. Modalities such as three-dimensional conformal radiation therapy (3D-CRT) and intensity modulated radiation therapy (IMRT) allow for assessment of dose distribution for the entire target volume, as opposed to only the central axis. Improved dose homogeneity in breast irradiation has been shown to significantly decrease the risk of moist desquamation and improve long-term cosmesis [1][2][3][4][5][6]. There is also strong evidence that increased mean heart dose linearly increases risk for major coronary events, which is particularly important for left-sided tumors [7,8]. Given these outcomes, dose homogeneity and critical organ dosimetry have become important targets to achieve in treatment planning.
The UPMC Hillman Cancer Center is a National Cancer Institute-designated Comprehensive Cancer Center comprised of 4 central academic centers and 16 regional community centers. Within such a large network, variations in practice patterns are almost unavoidable. In order to help standardize clinical practices, the UPMC Hillman Cancer Center implemented clinical pathways for breast cancer in 2003. Clinical pathways apply evidence-based treatment-specific guidelines in the form of a decision support tool, and for breast cancer, they specify criteria for dose homogeneity and critical organ dosing in adjuvant radiation treatment. Based upon an internal audit showing suboptimal compliance with dosimetric parameters, we conducted a mandatory web-based teaching conference for the network. In this study, we report the impact of this teaching initiative on multi-center compliance with dosimetric guidelines across a large, integrated radiation oncology network.

Methods
An internal audit was performed at 16 regional facilities in Western Pennsylvania within the UPMC Hillman Cancer Center network, including 3 academic sites and 13 community sites. The 10 most recent treatment plans from each of the facilities (n = 160) were obtained from integrated sites through the ARiA record-and-verify database (Varian Medical Systems, Palo Alto, CA) using International Classification of Disease, ninth revision, codes for breast cancer (174.0-174.9) and DCIS (233.0) between June 2015 and June 2016.
Clinical pathways (Via Oncology, Pittsburgh, PA) have been used in practice in the UPMC Hillman Cancer Center network since 2003, with implementation and continued review of guidelines as detailed in prior publications [9]. Pathway criteria for dose homogeneity and critical organ dosimetry were defined based on published data and critical evaluation of breast plans in our network [1][2][3][4][5][6]10]. The criteria are stated as follows: 1. V 105% ≤ 10-15%, where V 105% is the breast volume receiving 105% of the prescription dose. Larger breasts can accept V 105% up to 15-20%, where 20% is the cutoff for meeting compliance. 2. V 110% = 0%, where V 110% is the breast volume receiving 110% of the prescription dose. 3. Mean heart dose < 3 Gy. The heart was contoured as an organ at risk for both left and right breast irradiation.
Following analysis of the baseline 160 plans, a mandatory web-based teaching conference for radiation oncologists, physicists, and dosimetrists was conducted across all 16 in-network oncology centers. Attendance was recorded, and a second session was conducted the following week for those who could not attend the first meeting. Conference content included a review of established contouring guidelines, dosimetric constraints, and network-wide preferences for treatment planning. Three-dimensional field-in-field (3D-FIF) radiation therapy without wedges was the recommended technique, with the rationale of reducing hot spots and minimizing scatter to the contralateral breast. If 3D-FIF treatment plans did not meet criteria for previously outlined coverage and dose homogeneity constraints, then tangential beam IMRT with inverse planning was recommended. Afterwards, a teaching document referencing the contouring and dosimetric criteria found in clinical pathways was distributed to all sites. Conference attendees were not notified that a follow-up audit would be conducted, nor were there any changes in incentives or penalties associated with pathway deviations.
The impact of web-based teaching was assessed 6 months after the conference. The 10 most recent breast plans from each of the 16 oncology sites were collected and analyzed for dose homogeneity and critical organ dosimetry. Pre-conference and post-conference plans (n = 320) were then compared as described below.
IBM SPSS version 22 (IBM cooperation, Armonk, NY) was used for data analysis. Variations in breast plans were analyzed based on the percentage of cases with breast homogeneity deviations for breast V 105% and V 110% or mean heart dose deviations. Subset analyses were performed for left versus right breast heart dose and for changes in dose homogeneity stratified by breast volume using the Mann-Whitney U test. Technique specification (3D-FIF vs. IMRT), energy utilization (6 MV vs. 6 MV + high energy), and factors predictive of dosimetric deviations were analyzed between pre-conference and post-conference using Chi-square analysis.

Results
Baseline patient characteristics can be found in Table 1. There were no significant differences between the pre-and post-conference populations in terms of disease laterality, median breast CTV, and hypofractionation adoption.

Discussion
In radiation oncology, major variations in quality often occur during treatment planning and delivery, and these deviations are hard to capture. Despite the specification of parameters for dose homogeneity and critical organ dosimetry in our clinical pathways, an internal audit showed that baseline adherence to dose homogeneity was suboptimal, with 22.5% of treatment plans having breast V 105% > 20% and 13.8% of plans having V 110% > 0%. We hypothesize several potential barriers that may have affected compliance with clinical pathway recommendations. For physicians, physicists, and dosimetrists who initially had trained with 2D-RT for breast cancer, there may have been a general unfamiliarity with the importance of dose homogeneity, as much of the data to support dose homogeneity has come out in the last 10 years [1][2][3][4][5][6]11]. Indeed, dose homogeneity guidelines themselves are not well defined in the literature. The only recommendation made in ASTRO guidelines for WBI is to limit maximum breast dose to less than 107%, on the basis of randomized trials involving standard 2D-RT planning [12].
We designed the network-wide educational intervention to address these possible uncertainties, and we can identify several key factors that led to its success. The web-based platform maximized outreach to all sites in the network, and we mandated the conference for not only physicians, but also physicists and dosimetrists. This helped ensure that all involved in the radiation planning process would be equally aware of expectations, and detailed technical guidance was provided on how best to achieve the dosimetric goals that were set. As a result, a significant improvement was seen in dose homogeneity following this education, with adherence to  breast V 105% < 20% and V 110% = 0% in 92.5% and 95.6% of plans, respectively. There are limitations and areas for future improvement for this intervention. This study was unable to account for operator-dependent variability, either between facilities or individual providers, but there were substantial network-wide improvements regardless. Although staff were not told plans would be re-analyzed, we are unable to account for post-conference changes that may have occurred secondary to a perceived observer effect. Similar interventions in the future may benefit from post-conference surveys assessing what factors or attitudes changed to produce this improvement in quality. To effectively stress the need for improvement, future educational strategies may also benefit from quantitative visualizations of group performance metrics. Finally, this study does not address the durability of the changes made post-conference, but long-term outcomes may be the subject of future studies.

Conclusions
The web-based teaching conference is an effective model to improve adherence to clinical pathway guidelines in a large radiation oncology network. The goal of implementing these models is to try and achieve the same level of adherence as that seen in clinical trials, and analyses of phase III clinical trials have shown that major RT deviations had adverse impacts on toxicities, tumor control, and even survival outcomes [13][14][15][16]. Postconference, we saw a significant improvement in adherence to dose homogeneity criteria in breast plans, and we are working to extend this approach to other disease sites. On the foundation of existing clinical pathways, the web-based conference encouraged practitioners to minimize deviations from dosimetric guidelines and improve quality of care significantly, helping ensure that outcomes seen in clinical studies translate to everyday practice.
Data were presented as an oral presentation at the 2016 American Society for Radiation Oncology (ASTRO) annual meeting in San Antonio, TX.