- Open Access
Interobserver variability in the delineation of the tumour bed using seroma and surgical clips based on 4DCT scan for external-beam partial breast irradiation
Radiation Oncology volume 10, Article number: 66 (2015)
To explore the interobserver variability in the delineation of the tumour bed using seroma and surgical clips based on the four-dimensional computed tomography (4DCT) scan for external-beam partial breast irradiation (EB-PBI) during free breathing.
Patients with a seroma clarity score (SCS) 3 ~ 5 and ≥5 surgical clips in the lumpectomy cavity after breast-conserving surgery who were recruited for EB-PBI underwent 4DCT simulation. Based on the ten sets of 4DCT images acquired, the tumour bed formed using the clips, the seroma, and both the clips and seroma (defined as TBC, TBS and TBC+S, respectively) were delineated by five radiation oncologists using specific guidelines. The following parameters were calculated to analyse interobserver variability: volume of the tumour bed (TBC, TBS, TBC+S), coefficient of variation (COVC, COVS, COVC+S), and matching degree (MDC, MDS, MDC+S).
The interobserver variability for TBC and TBC+S and for COVC and COVC+S were statistically significant (p = 0.021, 0.008, 0.002, 0.015). No significant difference was observed for TBS and COVS (p = 0.867, 0.061). Significant differences in interobserver variability were observed for MDC vs MDS, MDC vs MDC+S, MDS vs MDC+S (p = 0.000, 0.032, 0.008), the interobserver variability of MDS was smaller than that of MDC and MDC+S (MDS > MDC+S > MDC).
When the SCS was 3 ~ 5 points and the number of surgical clips was ≥5, interobserver variability was minimal for the delineation of the tumour bed based on seroma.
Breast-conserving therapy (BCT), which involves a wide local excision followed by radiotherapy to the whole breast, is the standard treatment for early-stage breast cancer . The efficacy of BCT for the treatment of early-stage breast carcinoma has been established in multiple randomised trials [2,3]. External-beam partial breast irradiation (EB-PBI) has recently garnered increasing interest [4,5]. Several studies reported that EB-PBI, which delivers radiotherapy to the postoperative tumour bed (TB) with a margin of adjacent breast tissue, could achieve excellent results in certain patients. However, there are inherent challenges in defining accurate target volumes for partial breast irradiation (PBI). Studies demonstrate significant interobserver variability between radiation oncologists in defining the lumpectomy cavity, indicating the need to improve the accuracy and consistency in the delineation of the TB [6,7].
Surgical clips and seroma are important markers for delineating the TB for EB-PBI [7,8]. Kirby et al.  reported that the number of implanted markers influences the accuracy of target delineation and that five to six surgical clips are preferable for TB delineation for PBI or breast boost radiotherapy. Landis et al.  indicated that the shift of the centre of mass (COM) decreased and the percent volume overlap (PVO) increased significantly as the seroma clarity score (SCS) increased. The influence of the number of metal clips, SCS, delineation experience and contouring guidelines for the delineation of TB in CT images have been investigated [6,7,9-11]. However, the effect of interobserver variability on the delineation of the TB using seroma and surgical clips based on 4DCT scan is not clearly established. To investigate the impact of different markers on interobserver variability in the delineation of TB based on 4DCT scan for EB-PBI, we analysed the TB delineated by five observers in this study based on clips, seroma, and both clips and seroma.
Twenty patients who underwent wide-local excision of breast cancer with full-thickness unstitching of the excision cavity (10 left-sided and 10 right-sided lesions) followed by EB-PBI between June 2009 and November 2013 were included in this study. To improve the delineation accuracy and consistency, all of the enrolled patients had SCS 3 ~ 5 and ≥5 surgical clips to mark the boundaries of the lumpectomy cavity. For every patient, five or more roundish surgical clips with diameters of 2 mm were implanted. The surgical clips were fixed to the superior, inferior, medial, lateral, and posterior walls of the surgical cavity, respectively (median number: 6) . The average interval from lumpectomy to 4DCT scan was 10 weeks (range, 3-16 weeks). All patients were free of chronic lung diseases, and their ventilation functions were normal. Written informed consent was obtained from all patients with the approval of the Institutional Review Board (Shandong Tumour Hospital Ethics Committee).
Four-dimensional CT image acquisition
All twenty patients were immobilised in the supine position on a breast board using an arm support (with both arms above the head to adequately expose the breast). 4DCT images and respiratory signals were acquired with a thickness of 3 mm at the conclusion of the standard CT simulation using a 16-slice Brilliance Big Bore CT scanner (Philips Medical Systems, Inc., Cleveland, OH, USA). The signals were sent to the scanner to label a time tag on each CT image. GE Advantage 4D software (General Electric Healthcare, Waukesha, WI, USA) sorted the reconstructed 4DCT images into 10 respiratory phases based on these tags, with 0% corresponding to end inhalation (EI) and 50% corresponding to end exhalation (EE). Then, the constructed 4DCT image sets were transferred to the Eclipse treatment planning system (Eclipse™ 8.6; Varian Medical Systems, Palo Alto, CA) for structure delineation.
Five observers specialising in radiation treatment of breast carcinoma with more than five years of radiotherapy experience performed the delineations.
Tumour bed delineation
The 10% ~ 90% phases of the 4DCT images were registered on the 0% phase images, which served as the basic phase image. The tumour beds were delineated from the ten sets of 4DCT images based on the clips, the seroma, and both the clips and seroma (termed TBC, TBS, TBC+S, respectively) according to a set of guidelines  (Figure 1). When the TB was delineated based on clips, we adjusted the window level and width to minimise the impact of seroma for contouring. All observers outlined a single test case that was reviewed prior to commencing the study to ensure that the guidelines were being followed.
To quantify interobserver variability, the following parameters were calculated: the volume of TB (TBC, TBS, TBC+S), which was an average value generated from the ten contours of the registered images for each patient, and the interobserver coefficient of variation (COVC, COVS, COVC+S) for each patient. The COV was defined as the ratio between the standard deviation and the average volume of TB. For TBC, TBS, and TBC+S, an evaluation of the matching degree among the various observers in the EE phase was also performed. For each patient, the ratio between the intersection volume (the intersection among the volumes delineated by the five observers) and the union volume (the union among the volumes delineated by the five observers) was calculated (termed MDC, MDS and MDC+S, respectively)  (Figure 2). The volume variability between the clips, the seroma, and both the clips and seroma based on the same observer was also calculated.
SPSS 19.0 software was used for statistical analyses. A normal distribution test and a test for homogeneity of variance were performed. To investigate the interobserver variability in the delineation of the TB based on different makers in 4DCT images, a univariate analysis of variance (ANOVA) was used to compare differences in the TB (TBC, TBS, TBC+S), COV (COVC, COVS, COVC+S) and MD (MDC, MDS, MDC+S) between observers. The volume variability between the TBC, TBS and TBC+S was also compared using ANOVA. P < 0.05 was considered significant.
The volumes of TBC, TBS and TBC+S are listed in Table 1. The average volumes of TBC, TBS and TBC+S were 21.98 cc (range 8.70-45.13), 14.36 cc (range 3.14-41.80), and 28.79 cc (range 12.88-55.80), respectively. The volume variability between the TBC, TBS and TBC+S was statistically significant (p < 0.05) (Table 2). Furthermore, the average duration from lumpectomy to 4DCT scan was 10 weeks (range, 3-16). The volume of TBC was similar to that of TBS for six patients during weeks 4-8, the TBC was less than TBS in two patients during weeks 0-3, and the TBC was larger than TBS for twelve patients during weeks 8-16.
The interobserver variability for TBC, TBS and TBC+S is listed in Table 2. The interobserver variability for TBC and TBC+S was statistically significant (p = 0.021, 0.008). However, the interobserver variability for TBS was not statistically significant (p = 0.867).
The interobserver variability for COV is listed in Table 3. The interobserver variability for COVC and COVC+S was statistically significant (p = 0.002, 0.015), but the interobserver variability for COVS was not statistically significant (p = 0.061).
Table 4 lists the differences in MD between the volumes delineated based on clips, seroma, and both clips and seroma in the EE phase. The interobserver variability for the MDC, MDS and MDC+S was statistically significant (F = 16.866, p = 0.000). There were also significant differences between MDC and MDS, MDC and MDC+S, and MDS and MDC+S (p = 0.000, 0.032, 0.008); the interobserver variability for MDS was smaller than that of MDC and MDC+S (MDS > MDC+S > MDC).
The accuracy of target volume delineation is critical for EB-PBI. The optimal target volume for EB-PBI remains to be established. Most reports define the tumour excision cavity or postoperative seroma as the target volume in treatment planning [7,8,15]. However, these studies also reported significant interobserver variation in delineating post-lumpectomy cavities. van Mourik et al.  investigated breast target volume delineations among thirteen observers in eight patients. They reported that the presence of clips or seroma reduced interobserver variability but that significant volumetric and spatial interobserver variability was observed in clinical target volume (CTV) even with the help of delineation guidelines. Therefore, reducing interobserver variability is a pressing issue. To improve delineation accuracy and consistency, we selected patients with SCS 3 ~ 5 and ≥5 surgical clips to mark the boundaries of the lumpectomy cavity.
Seroma clarity and volume in the lumpectomy cavity decreased as a function of time from surgery to the CT scan. The use of the CT-based seroma to guide the EB-PBI target volume is difficult due to a lack of clearly defined standards. Kader et al.  selected 205 women with early-stage breast cancer to undergo planning CT after breast conserving surgery and found that the mean seroma volume decreased from 47 cc to 30 cc during postoperative weeks 3-8, stabilised during weeks 9-14 (mean 21 cc) and was involuted beyond 14 weeks (mean 9 cc). In our study, the average duration from lumpectomy to 4DCT scan was 10 weeks (range, 3-16). The volume of TBC approached the volume of TBS for six patients during weeks 4-8, and the TBC < TBS in two patients during weeks 0-3. However, after 8 weeks, the volume of TBC was larger than that of TBS for 12 patients. Therefore, given the magnitude and time trends of seroma volume and clarity loss, the optimal time to obtain the planning CT scan for PBI is within 8 weeks after surgery.
Surgical clips are not always consistent with the edge of seroma and the boundary of the lumpectomy cavity [13,17]. Ding et al  measured the three dimensional displacements of the GTVC, the GTVs and the GTVC+S and found that in the LR, AP and SI directions, the displacements were 0.9 mm, 1.05 mm and 1.20 mm for GTVC; 0.80 mm, 1.05 mm and 0.80 mm for GTVs; and 0.90 mm, 1.20 mm and 1.40 mm for GTVC+S, respectively. In other words, the three dimensional displacements of GTVC+S were greater than those of GTVC and GTVS. Yang et al.  also measured the distance between surgical clips and the edge of the seroma in a coronal plane in women who underwent wide local excision of breast cancer and reported that the mean seroma edge extended beyond the clips by 0.3-0.5 cm. This study indicates that the volume of TBC+S delineated by observers was significantly larger than TBC and TBS. These results may be due to decreased seroma clarity and volume in the lumpectomy cavity from the time of lumpectomy to the 4DCT scan, as well as the variability between the TBC, TBS, TBC+S regarding treatment margin.
Interestingly, we observed no significant differences between observers for TBS (p = 0.867) and COVS (p = 0.061). This could be explained by the short average duration from lumpectomy to planning CT and because the SCS 3 ~ 5 in the lumpectomy cavity improved the visualisation of the surgical cavity. Landis et al.  reported similar results in patients of SCS 4 and 5, as the average COM shift was 3 mm and 2 mm, respectively, and the PVO was 77% and 87%, respectively. Wong et al.  also reported that after reviewing contouring guidelines, the differences in seroma target volume (STV), CTV, and planning target volume (PTV) were no longer statistically significant. Although Dzhugashvili et al.  reported that the conformity index of TB delineation was significantly improved by the placement of surgical clips within the lumpectomy cavity, a higher level of interobserver concordance was observed by the five observers when the SCS was 3 ~ 5 points in the lumpectomy cavity. These data suggest that interobserver variability in the delineation of TB based on seroma was not obvious when the SCS was 3 ~ 5 points.
Although interobserver variability in the delineation of the TB based on seroma was minimal, the clinical reality could vary across regions. This was a retrospective study, and all the enrolled patients had undergone wide-local excision of breast cancer with full-thickness unstitching of the excision cavity. Full thickness closure of the excision cavity and oncoplastic surgical procedures are becoming more widely practiced in some regions, and these surgical methods could reduce the rate of seroma and its reliability as a marker of the TB. Therefore, patients should be given five or more surgical clips to reduce interobserver variability when only clips are used in clinical practice. Moreover, the placement of clips in the surgical cavity could be based on guidelines, and the duration from lumpectomy to 4DCT scan could be shortened.
Hurkmans et al.  reported that intra- and, to a greater extent, interobserver variability in the delineation of breast target volume on CT scans can be large. Both Dzhugashvili et al.  and Yang et al.  also reported interobserver variability (similar to the results presented here) in the delineation of the TB based on clips. These results can be explained by the fact that tissue stranding from the surgical cavity, proximity to muscle, dense breast parenchyma, and benign calcifications may be mistaken for surgical clips. Moreover, limited soft-tissue contrast on CT makes it an unreliable modality for detecting a layer of the image lacking surgical clips and when distinguishing between surgically induced densities and normal glandular breast tissue. Finally, the experience of the radiation oncologist and subjective determination of the location of the post-surgical cavity contribute to interobserver variability. Using a combination of information to more precisely define the TB, such as surgical reports, clinical palpation of the surgical defect and CT-based planning, may decrease interobserver variability. Additionally, clear communication between the surgeon and radiotherapist, including diagrammatic explanations, are crucial for accurately targeting the TB.
Cover et al.  reported that when the EE phase was reviewed in the sagittal plane, gating would reduce the mean tumour mobility from 6.3 ± 2.0 mm to 1.4 ± 0.5 mm. Moreover, 4DCT simulation scan can reduce motion artefacts [23,24]. Therefore, to investigate spatial mismatches of interobserver variability in the delineation of the TB based on different markers, the difference between the MDC, MDS and MDC+S were further analysed and compared based on the end-exhalation phase. Our study found interobserver variability between the MDC, MDS and MDC+S, as well as between the MDc and MDs, MDC and MDC+S, and MDS and MDC+S. Our results suggest spatial mismatch existed among observers in the delineation of the TB based on clips, the seroma, both the clips and seroma. Additionally, the MD of the seroma was larger than that of the clips as well as both the clips and seroma, and the MD of both the clips and seroma was larger than that of the clips alone (Table 4). However, the average CI reported by van Mourik et al.  was 0.53, which was considerably higher than that in the present study. This difference is likely due to differing target volume and calculation methods. Landis et al.  and Li et al.  reported even higher CI values ranging from 0.73-0.75; however this analysis focused on the PTV instead of the TB, the CI of which increases due to the larger volumes.
Image-guided techniques can improve clip and seroma localisation during treatment, potentially enabling the use of a smaller GTV-to-PTV margin. Ultrasound image guidance has also been investigated . However, it is unclear if the margin is sufficient to account for interobserver contour variability. Further studies are needed to determine, whether contouring variability could result in an underdosing of the clips or seroma. Thus, it is imperative that future studies aiming to reduce margins from current treatment practice take interobserver contour variability into consideration.
The results of our study suggest that interobserver variability is smaller in the 4DCT delineation of the TB based on seroma compared with clips or both clips and seroma when the SCS was 3 ~ 5 points and the number of surgical clips was ≥5 in the lumpectomy cavity. Interobserver volume differences were observed between the TBs delineated based on surgical clips, and those delineated based on both the clips and seroma. This was also the case for spatial mismatch (MD), which was measured and analysed at the end-expiration phase. Optimising the time from lumpectomy to 4DCT scan is necessary to minimise interobserver variability in the delineation of the TB. If the time from lumpectomy to 4DCT simulation scan could be appropriately chosen, the delineation of the target volume based on seroma may be more reasonable in radiotherapy treatment planning.
Partial breast irradiation
External-beam partial breast irradiation
Seroma clarity score
Four-dimensional computed tomography
Coefficient of variation
Centre of mass
Percent volume overlap
Clarke M, Collins R, Darby S, Davies C, Elphinstone P, Evans E, et al. Effects of radiotherapy and of differences in the extent of surgery for early breast cancer on local recurrence and 15-year survival: an overview of the randomised trials. Lancet Oncol. 2005;366:2087–106.
Litiere S, Werutsky G, Fentiman IS, Rutgers E, Christiaens MR, Van Limbergen E, et al. Breast conserving therapy versus mastectomy for stage I-II breast cancer: 20 year follow-up of the EORTC 10801 phase 3 randomised trial. Lancet Oncol. 2012;13:412–9.
Blichert-Toft M, Nielsen M, During M, Møller S, Rank F, Overgaard M, et al. Long-term results of breast conserving surgery vs. mastectomy for early stage invasive breast cancer: 20-year follow-up of the Danish randomized DBCG-82TM protocol. Acta Oncol. 2008;47:672–81.
Offersen BV, Overgaard M, Kroman N, Overgaard J. Accelerated partial breast irradiation as part of breast conserving therapy of early breast carcinoma: a systematic review. Radiother Oncol. 2009;90:1–13.
Njeh CF, Saunders MW, Langton CM. Accelerated partial breast irradiation using external beam conformal radiation therapy: a review. Crit Rev Oncol Hematol. 2012;81:1–20.
Kader HA, Truong PT, Pai R, Panades M, Jones S, Ansbacher W, et al. When is CT-based postoperative seroma most useful to plan partial breast radiotherapy? Evaluation of clinical factors affecting seroma volume and clarity. Int J Radiat Oncol Biol Phys. 2008;72:1064–9.
Kirby AM, Jena R, Harris EJ, Evans PM, Crowley C, Gregory DL, et al. Tumour bed delineation for partial breast/breast boost radiotherapy: what is the optimal number of implanted markers? Radiother Oncol. 2013;106:231–5.
Landis DM, Luo W, Song J, Bellon JR, Punglia RS, Wong JS, et al. Variability among breast radiation oncologists in the delineation of the postsurgical lumpectomy cavity. Int J Radiat Oncol Biol Phys. 2007;67:1299–308.
Dzhugashvili M, Tournay E, Pichenot C, Dunant A, Pessoa E, Khallel A, et al. 3D-conformal accelerated partial breast irradiation treatment planning: the value of surgical clips in the delineation of the lumpectomy cavity. Radiat Oncol. 2009;4:70.
Thureau S, Oden S, Mokaouim R, Mezzani-Saillard S, Clatot F, Hanzen C. Assessing the contribution of a standardized method in defining the tumor bed using surgical clips in breast cancer. Cancer Radiother. 2012;16:100–6.
Sharma R, Spierer M, Mutyala S, Thawani N, Cohen HW, Hong L, et al. Change in seroma volume during whole-breast radiation therapy. Int J Radiat Oncol Biol Phys. 2009;75:89–93.
Shaikh T, Chen T, Khan A, Yue NJ, Kearney T, Cohler A, et al. Improvement in interobserver accuracy in delineation of the lumpectomy cavity using fiducial markers. Int J Radiat Oncol Biol Phys. 2010;78:1127–34.
Ding Y, Li J, Wang W, Fan T, Xu M, Shao Q, et al. Displacement of the lumpectomy cavity defined by surgical clips and seroma based on 4D-CT scan for external-beam partial breast irradiation after breast conserving surgery: a comparative study. Br J Radiol. 2013;86:20130416.
Geets X, Daisne JF, Arcangeli S, Coche E, De Poel M, Duprez T, et al. Inter-observer variability in the delineation of pharyngo-laryngeal tumor, parotid glands and cervical spinal cord: comparison between CT-scan and MRI. Radiother Oncol. 2005;77:25–31.
Yang TJ, Tao R, Elkhuizen PH, van Vliet-Vroegindeweij C, Li G, Powell SN. Tumor bed delineation for external beam accelerated partial breast irradiation: A systematic review. Radiother Oncol. 2013;108:181–9.
van Mourik AM, Elkhuizen PH, Minkema D, Duppen JC, On behalf of the Dutch Young Boost Study Group, van Vliet-Vroegindeweij C. Multi-institutional study on target volume delineation variation in breast radiotherapy in the presence of guidelines. Radiother Oncol. 2010;94:286–91.
Yang Z, Chen J, Hu W, Pan Z, Cai G, Yu X, et al. Planning the breast boost: how accurately do surgical clips represent the CT seroma? Radiother Oncol. 2010;97:530–4.
Wong EK, Truong PT, Kader HA, Nichol AM, Salter L, Petersen R, et al. Consistency in seroma contouring for partial breast radiotherapy: impact of guidelines. Int J Radiat Oncol Biol Phys. 2006;66:372–6.
Hurkmans CW, Borger JH, Pieters BR, Russell NS, Jansen EP, Mijnheer BJ. Variability in target volume delineation on CT scans of the breast. Int J Radiat Oncol Biol Phys. 2001;50:1366–72.
Dzhugashvili M, Pichenot C, Dunant A, Balleyguier C, Delaloge S, Mathieu MC, et al. Surgical clips assist in the visualization of the lumpectomy cavity in three-dimensional conformal accelerated partial-breast irradiation. Int J Radiat Oncol Biol Phys. 2010;76:1320–4.
Yang TJ, Minkema D, Elkhuizen PH, Heemsbergen W, van Mourik AM, van Vliet-Vroegindeweij C. Clinical applicability of cone-beam computed tomography in monitoring seroma volume change during breast irradiation. Int J Radiat Oncol Biol Phys. 2010;78:119–26.
Cover KS, Lagerwaard FJ, Senan S. Color intensity projections: a rapid approach for evaluating four-dimensional CT scans in treatment planning. Int J Radiat Oncol Biol Phys. 2006;64:954–61.
Wang W, Li JB, Hu HG, Sun T, Xu M, Tan TY, et al. Evaluation of dosimetric variance in whole breast forward-planned intensity-modulated radiotherapy based on 4DCT and 3DCT. J Radiat Res. 2013;54:755–61.
Liao ZW, Guan XX, Li FY, He ZY, Xue M, Huang XY, et al. Accelerated partial breast irradiation: use of four-dimensional CT for target localization and ssessment of intrafractional motion. Oncol Res. 2010;18:503–7.
Li XA, Tai A, Arthur DW, Buchholz TA, Macdonald S, Marks LB, et al. Variability of target and normal structure delineation for breast cancer radiotherapy: an RTOG Multi-Institutional and Multiobserver Study. Int J Radiat Oncol Biol Phys. 2009;73:944–51.
Berrang TS, Truong PT, Popescu C, Drever L, Kader HA, Hilts ML, et al. 3D ultrasound can contribute to planning CT to define the target for partial breast radiotherapy. Int J Radiat Oncol Biol Phys. 2009;73:375–83.
This work was supported by Shandong Province Science and Technology Development Projects (2013WS0346).
The authors declare that they have no competing interests.
BG and JBL designed the study, contributed to the data collection, and drafted the manuscript. WW, MX, QS, YJZ and CQL made important contributions in delineating the TB based on clips, seroma, and both clips and seroma. WW and YLG contributed to data collection and analysis. All authors read and approved the final manuscript.
About this article
Cite this article
Guo, B., Li, J., Wang, W. et al. Interobserver variability in the delineation of the tumour bed using seroma and surgical clips based on 4DCT scan for external-beam partial breast irradiation. Radiat Oncol 10, 66 (2015). https://doi.org/10.1186/s13014-015-0370-3
- Breast cancer
- Four-dimensional computed tomography
- Interobserver variability
- Surgical clips