Skip to main content

Table 3 Mean values and standard deviations of parameters that evaluate the contours generated by the three software, before and after the manual correction, for each organ of the head and neck

From: Systematic evaluation of three different commercial software solutions for automatic segmentation for adaptive therapy in head-and-neck, prostate and pleural cancer

  AA MA VA AM MM VM p value
CTV1
DSC, (SD) 0.68 (0.19) 0.67 (0.17) 0.66 (0.18) 0.72 (0.15) 0.76 (0.11) 0.71 (0.09) #
Sensitivity, (SD) 0.73 (0.23) 0.76 (0.19) 0.74 (0.22) 0.79 (0.18) 0.85 (0.10) 0.81 (0.16)  
IncI, (SD) 0.64 (0.17) 0.61 (0.18) 0.60 (0.17) 0.67 (0.13) 0.69 (0.13) 0.65 (0.09) * #
ΔV (%), (SD) 14.10 (25.99) 25.92 (21.18) 23.28 (28.44) 17.72 (22.19) 24.94 (26.01) 27.40 (32.49)  
Δx (mm), (SD) 2.62 (2.02) 2.92 (1.76) 2.44 (1.58) 2.12 (1.45) 2.70 (1.03) 2.88 (2.42)  
Δy (mm), (SD) 2.58 (2.70) 2.66 (2.72) 2.86 (2.37) 2.60 (2.47) 2.74 (2.47) 5.30 (3.32)  
Δz (mm), (SD) 5.40 (7.98) 5.70 (5.65) 5.10 (5.77) 5.40 (7.98) 3.60 (5.67) 4.80 (5.02)  
CTV2
DSC, (SD) 0.84 (0.03) 0.83 (0.03) 0.81 (0.02) 0.85 (0.03) 0.84 (0.03) 0.82 (0.03)  
Sensitivity, (SD) 0.85 (0.04) 0.86 (0.05) 0.85 (0.05) 0.86 (0.04) 0.88 (0.04) 0.86 (0.04)  
IncI, (SD) 0.83 (0.06) 0.81 (0.06) 0.78 (0.05) 0.83 (0.06) 0.81 (0.06) 0.78 (0.06)  
ΔV (%), (SD) 3.50 (11.31) 7.40 (13.33) 10.00 (12.34) 4.45 (10.20) 8.38 (11.57) 10.68 (12.51)  
Δx (mm), (SD) 2.95 (2.30) 2.85 (1.85) 3.08 (1.81) 2.48 (2.56) 2.95 (1.80) 3.38 (1.37)  
Δy (mm), (SD) 2.38 (0.69) 3.73 (2.50) 2.53 (1.94) 2.23 (0.95) 3.60 (2.54) 2.90 (1.51)  
Δz (mm), (SD) 1.50 (1.23) 1.50 (2.12) 1.88 (2.25) 1.50 (1.23) 1.88 (1.44) 2.63 (1.44)  
Larynx
DSC, (SD) 0.86 (0.04) 0.87 (0.01) 0.82 (0.04) 0.90 (0.03) 0.89 (0.02) 0.86 (0.05)  
Sensitivity, (SD) 0.87 (0.06) 0.88 (0.03) 0.85 (0.06) 0.92 (0.04) 0.93 (0.01) 0.91 (0.02)  
IncI, (SD) 0.86 (0.03) 0.85 (0.03) 0.80 (0.05) 0.87 (0.02) 0.85 (0.02) 0.82 (0.08)  
ΔV (%), (SD) 1.43 (5.92) 3.85 (6.75) 5.83 (9.59) 5.15 (3.37) 8.55 (1.93) 11.20 (11.32)  
Δx (mm), (SD) 0.65 (0.51) 0.38 (0.48) 0.88 (0.48) 0.90 (0.52) 0.53 (0.61) 0.50 (0.00)  
Δy (mm), (SD) 0.38 (0.25) 0.75 (0.65) 0.40 (0.80) 0.38 (0.25) 0.50 (0.58) 0.90 (0.52)  
Δz (mm), (SD) 5.63 (3.75) 9.75 (5.81) 3.75 (4.50) 0.75 (0.87) 1.50 (1.23) 0.75 (1.50)  
Sup. Pharynx
DSC, (SD) 0.36 (0.22) 0.35 (0.12) 0.33 (0.13) 0.57 (0.05) 0.50 (0.14) 0.52 (0.11)  
Sensitivity, (SD) 0.49 (0.38) 0.51 (0.35) 0.47 (0.32) 0.74 (0.10) 0.80 (0.11) 0.76 (0.11)  
IncI, (SD) 0.42 (0.14) 0.42 (0.26) 0.40 (0.23) 0.49 (0.13) 0.40 (0.20) 0.42 (0.19)  
ΔV (%), (SD) 27.70 (90.39) 67.50 (125.10) 57.25 (112.28) 61.63 (48.64) 146.60 (134.73) 107.58 (96.01)  
Δx (mm), (SD) 1.18 (1.41) 1.43 (1.27) 1.73 (2.45) 0.98 (0.95) 0.75 (0.50) 1.03 (0.82)  
Δy (mm), (SD) 1.88 (1.38) 1.90 (1.04) 3.23 (3.78) 1.13 (0.90) 1.48 (1.63) 1.88 (1.74)  
Δz (mm), (SD) 6.00 (3.24) 6.75 (3.12) 4.88 (3.75) 3.00 (1.73) 4.50 (2.12) 3.38 (3.09)  
Mid. Pharynx
DSC, (SD) 0.57 (0.10) 0.56 (0.13) 0.43 (0.19) 0.61 (0.09) 0.60 (0.12) 0.62 (0.12)  
Sensitivity, (SD) 0.52 (0.12) 0.57 (0.17) 0.44 (0.19) 0.59 (0.12) 0.68 (0.15) 0.64 (0.13) °
IncI, (SD) 0.65 (0.13) 0.56 (0.12) 0.44 (0.21) 0.64 (0.10) 0.55 (0.13) 0.61 (0.11) * #
ΔV (%), (SD) −18.94 (18.43) 4.62 (27.73) 4.12 (37.64) −7.48 (16.77) 27.38 (34.84) 4.66 (9.21) * +
Δx (mm), (SD) 0.60 (0.82) 0.80 (0.45) 1.20 (1.11) 0.90 (0.82) 0.80 (0.45) 0.70 (0.57)  
Δy (mm), (SD) 3.32 2.64() 2.78 (1.08) 2.64 (2.256) 3.02 (2.78) 2.76 (2.32) 1.68 (1.29)  
Δz (mm), (SD) 4.20 (4.55) 3.90 (4.70) 4.80 (5.13) 4.20 (4.42) 5.40 (4.81) 5.10 (5.37)  
Inf. Pharynx
DSC, (SD) 0.65 (0.07) 0.66 (0.05) 0.63 (0.07) 0.71 (0.04) 0.72 (0.03) 0.72 (0.04)  
Sensitivity, (SD) 0.59 (0.08) 0.65 (0.08) 0.60 (0.09) 0.67 (0.04) 0.72 (0.10) 0.73 (0.07) *
IncI, (SD) 0.75 (0.11) 0.69 (0.07) 0.66 (0.09) 0.75 (0.10) 0.72 (0.05) 0.72 (0.09) # ^
ΔV (%), (SD) −20.04 (15.57) −5.58 (17.12) −7.46 (16.01) −9.96 (14.02) 1.62 (19.64) 3.22 (18.60) * #
Δx (mm), (SD) 1.12 (0.44) 0.72 (0.47) 0.90 (0.65) 0.60 (0.55) 0.50 (0.50) 0.70 (0.48)  
Δy (mm), (SD) 2.06 (2.28) 1.62 (1.63) 1.38 (1.43) 1.90 (2.12) 1.52 (0.61) 1.28 (2.07)  
Δz (mm), (SD) 3.90 (3.29) 2.70 (1.26) 3.00 (3.82) 4.50 (3.52) 4.20 (2.47) 2.70 (3.25)  
Thyroid
DSC, (SD) 0.73 (0.11) 0.77 (0.06) 0.73 (0.07) 0.81 (0.05) 0.82 (0.06) 0.82 (0.05) ^
Sensitivity, (SD) 0.79 (0.15) 0.81 (0.10) 0.79 (0.08) 0.86 (0.08) 0.84 (0.05) 0.84 (0.04)  
IncI, (SD) 0.69 (0.11) 0.75 (0.10) 0.70 (0.11) 0.78 (0.10) 0.81 (0.10) 0.80 (0.07) °
ΔV (%), (SD) 14.86 (23.01) 10.34 (28.54) 15.70 (26.54) 14.00 (25.25) 5.72 (17.65) 5.98 (9.27) °
Δx (mm), (SD) 0.98 (0.82) 1.26 (1.51) 1.48 (1.37) 0.50 (0.00) 0.70 (0.98) 1.56 (1.93)  
Δy (mm), (SD) 1.18 (1.06) 0.98 (0.90) 1.68 (2.12) 0.70 (0.45) 0.40 (0.42) 0.60 (0.55)  
Δz (mm), (SD) 3.00 (2.37) 2.10 (2.28) 1.50 (1.50) 2.70 (2.47) 1.20 (1.96) 2.10 (1.34)  
Masticator space right
DSC, (SD) 0.80 (0.04) 0.82 (0.03) 0.80 (0.03) 0.85 (0.02) 0.84 (0.04) 0.84 (0.02) °
Sensitivity, (SD) 0.79 (0.07) 0.84 (0.03) 0.80 (0.06) 0.83 (0.07) 0.91 (0.02) 0.86 (0.03) ° + =
IncI, (SD) 0.84 (0.10) 0.80 (0.03) 0.80 (0.02) 0.86 (0.05) 0.79 (0.07) 0.82 (0.02) + ^
ΔV (%), (SD) −3.52 (21.72) 4.74 (3.43) −0.62 (6.99) −3.16 (12.28) 16.28 (12.24) 5.14 (2.48) ° =
Δx (mm), (SD) 0.82 (0.58) 1.00 (0.5) 0.82 (0.58) 0.50 (0.71) 0.90 (0.82) 0.82 (0.30)  
Δy (mm), (SD) 1.12 (0.69) 1.20 (0.99) 1.20 (1.29) 1.02 (0.36) 1.78 (1.85) 1.30 (1.19)  
Δz (mm), (SD) 3.30 (1.64) 4.80 (5.13) 5.40 (4.70) 2.70 (0.67) 3.00 (3.52) 2.70 (1.64)  
Masticator Space left
DSC, (SD) 0.79 (0.05) 0.81 (0.05) 0.77 (0.05) 0.86 (0.02) 0.86 (0.03) 0.85 (0.02) * # °
Sensitivity, (SD) 0.72 (0.08) 0.79 (0.08) 0.73 (0.09) 0.82 (0.05) 0.89 (0.03) 0.86 (0.04) * ° + ^
IncI, (SD) 0.89 (0.05) 0.85 (0.01) 0.82 (0.01) 0.90 (0.02) 0.83 (0.07) 0.84 (0.03) ° + ^
ΔV (%), (SD) −18.64 (12.32) −7.02 (10.16) −10.58 (12.18) −8.30 (5.83) 8.26 (10.51) 3.00 (5.82) ° + ^
Δx (mm), (SD) 0.84 (1.34) 1.02 (0.65) 1.02 (0.82) 1.040 (0.96) 0.92 (0.58) 0.62 (0.69)  
Δy (mm), (SD) 2.26 (1.85) 1.76 (1.27) 2.12 (0.80) 1.820 (1.08) 2.52 (2.76) 1.94 (1.37)  
Δz (mm), (SD) 3.00 (2.60) 6.00 (5.09) 6.00 (5.91) 2.40 (0.82) 3.00 (4.37) 2.40 (1.34)  
Mandible
DSC, (SD) 0.89 (0.02) 0.86 (0.02) 0.84 (0.02) 0.90 (0.02) 0.89 (0.02) 0.89 (0.02) *
Sensitivity, (SD) 0.87 (0.05) 0.86 (0.04) 0.82 (0.04) 0.88 (0.04) 0.92 (0.03) 0.92 (0.03) + ^
IncI, (SD) 0.92 (0.02) 0.86 (0.05) 0.86 (0.06) 0.92 (0.02) 0.86 (0.05) 0.87 (0.05) * # + ^
ΔV (%), (SD) −4.76 (7.12) −0.48 (9.51) −3.60 (12.00) −3.88 (6.02) 7.06 (9.05) 7.02 (8.78)  
Δx (mm), (SD) 0.30 (0.27) 0.60 (0.42) 0.50 (0.35) 0.30 (0.27) 0.70 (0.57) 0.30 (0.27)  
Δy (mm), (SD) 0.30 (0.27) 0.40 (0.22) 0.50 (0.35) 0.30 (0.27) 0.30 (0.27) 0.20 (0.27)  
Δz (mm), (SD) 0.60 (0.82) 0.30 (0.67) 1.20 (1.26) 0.90 (0.82) 0.60 (0.82) 0.60 (0.82)  
Spinal cord
DSC, (SD) 0.70 (0.10) 0.81 (0.05) 0.78 (0.06) 0.84 (0.02) 0.87 (0.01) 0.86 (0.01) *
Sensitivity, (SD) 0.60 (0.14) 0.78 (0.10) 0.75 (0.08) 0.78 (0.05) 0.87 (0.03) 0.88 (0.04) * #
IncI, (SD) 0.89 (0.07) 0.86 (0.07) 0.83 (0.08) 0.91 (0.05) 0.87 (0.02) 0.84 (0.03)  
ΔV (%), (SD) −32.46 (19.30) −9.00 (16.93) −8.40 (14.92) −13.18 (9.26) 0.66 (4.55) 5.52 (8.34) * # + ^
Δx (mm), (SD) 0.80 (0.45) 0.60 (0.22) 0.92 (0.66) 1.00 (0.80) 0.90 (0.42) 0.30 (0.27)  
Δy (mm), (SD) 3.62 (6.98) 4.88 (7.20) 2.78 (3.96) 0.92 (0.43) 0.32 (0.72) 0.62 (0.59)  
Δz (mm), (SD) 7.80 (11.74) 7.20 (12.79) 6.00 (10.92) 0.60 (0.82) 0.30 (0.67) 0.00 (0.00)  
Parotid gland right
DSC, (SD) 0.78 (0.08) 0.79 (0.07) 0.73 (0.08) 0.80 (0.06) 0.82 (0.05) 0.80 (0.05) # ° =
Sensitivity, (SD) 0.79 (0.13) 0.82 (0.12) 0.79 (0.16) 0.82 (0.12) 0.86 (0.10) 0.84 (0.10) +
IncI, (SD) 0.80 (0.11) 0.77 (0.09) 0.71 (0.08) 0.80 (0.09) 0.79 (0.07) 0.79 (0.10) #
ΔV (%), (SD) −1.06 (21.92) 8.96 (21.67) 13.02 (29.54) 4.40 (22.94) 10.40 (18.23) 9.14 (23.61) *
Δx (mm), (SD) 1.50 (1.00) 1.62 (1.24) 2.02 (1.06) 1.96 (1.79) 1.62 (1.24) 1.94 (1.19)  
Δy (mm), (SD) 6.46 (7.06) 5.64 (5.66) 6.58 (6.25) 6.4 (7.11) 4.32 (6.34) 5.76 (7.04)  
Δz (mm), (SD) 2.40 (0.82) 2.40 (0.82) 3.60 (2.51) 1.80 (1.26) 1.50 (1.06) 1.20 (1.64)  
Parotid gland left
DSC, (SD) 0.79 (0.07) 0.78 (0.08) 0.73 (0.04) 0.80 (0.07) 0.81 (0.06) 0.81 (0.05) °
Sensitivity, (SD) 0.77 (0.11) 0.79 (0.11) 0.77 (0.05) 0.79 (0.11) 0.83 (0.09) 0.85 (0.07) ^
IncI, (SD) 0.82 (0.07) 0.77 (0.11) 0.69 (0.04) 0.82 (0.09) 0.80 (0.11) 0.78 (0.08) #
ΔV (%), (SD) −5.84 (17.41) 4.44 (20.36) 12.96 (4.75) −1.88 (21.29) 6.54 (21.64) 9.78 (14.61) *
Δx (mm), (SD) 2.00 (1.46) 2.46 (1.23) 2.12 (1.43) 2.12 (1.62) 2.08 (1.46) 3.08 (1.75) ^
Δy (mm), (SD) 1.68 (2.21) 2.60 (1.37) 2.12 (1.76) 1.38 (1.60) 0.78 (1.21) 1.38 (2.00)  
Δz (mm), (SD) 3.60 (2.73) 3.30 (2.68) 4.50 (1.50) 2.70 (1.96) 3.60 (2.73) 2.70 (2.23)  
Cochlea right
DSC, (SD) 0.63 (0.13) 0.63 (0.17) 0.46 (0.16) 0.80 (0.03) 0.77 (0.10) 0.69 (0.07) # ° ^
Sensitivity, (SD) 0.59 (0.17) 0.68 (0.24) 0.42 (0.13) 0.77 (0.09) 0.84 (0.11) 0.80 (0.10) # °
IncI, (SD) 0.71 (0.17) 0.64 (0.23) 0.55 (0.25) 0.88 (0.09) 0.72 (0.07) 0.64 (0.14) # + ^
ΔV (%), (SD) −5.28 (6.84) 16.94 (54.41) −15.74 (23.04) −7.36 (17.40) 17.9 (21.82) 33.98 (49.56) +
Δx (mm), (SD) 0.90 (0.42) 0.72 (0.47) 1.28 (1.11) 0.42 (0.24) 0.62 (0.69) 0.72 (0.88)  
Δy (mm), (SD) 1.38 (1.77) 1.38 (1.20) 1.60 (1.90) 0.40 (0.42) 0.30 (0.27) 0.72 (0.30)  
Δz (mm), (SD) 0.50 (0.71) 0.90 (0.82) 2.40 (2.01) 0.40 (0.65) 0.30 (0.67) 0.90 (0.82)  
Cochlea left
DSC, (SD) 0.52 (0.16) 0.69 (0.10) 0.59 (0.07) 0.78 (0.07) 0.78 (0.04) 0.72 (0.07) °
Sensitivity, (SD) 0.45 (0.22) 0.69 (0.13) 0.58 (0.07) 0.69 (0.09) 0.81 (0.05) 0.75 (0.08) * +
IncI, (SD) 0.87 (0.10) 0.70 (0.15) 0.63 (0.13) 0.92 (0.05) 0.76 (0.09) 0.72 (0.16) * # + ^
ΔV (%), (SD) −51.04 (29.55) 6.06 (30.04) −5.40 (13.70) −23.32 (10.44) 10.24 (12.62) 11.50 (34.88) * + ^
Δx (mm), (SD) 1.00 (0.50) 0.60 (0.42) 1.00 (0.71) 0.30 (0.27) 0.40 (0.22) 0.50 (0.50)  
Δy (mm), (SD) 0.40 (0.42) 0.40 (0.42) 0.90 (0.55) 0.60 (0.55) 0.20 (0.45) 1.00 (0.50) =
Δz (mm), (SD) 0.90 (0.82) 1.00 (1.28) 1.00 (1.28) 0.30 (0.67) 1.20 (1.26) 0.40 (0.65)  
Brain stem
DSC, (SD) 0.80 (0.07) 0.81 (0.11) 0.77 (0.15) 0.88 (0.02) 0.88 (0.03) 0.89 (0.03)  
Sensitivity, (SD) 0.74 (0.09) 0.76 (0.17) 0.73 (0.22) 0.86 (0.04) 0.86 (0.08) 0.89 (0.03)  
IncI, (SD) 0.89 (0.06) 0.89 (0.03) 0.85 (0.03) 0.90 (0.02) 0.90 (0.03) 0.88 (0.04)  
ΔV (%), (SD) −17.50 (8.23) −14.36 (19.96) −13.68 (26.28) −4.54 (6.22) −4.00 (10.88) 1.44 (1.75) ^
Δx (mm), (SD) 0.70 (0.57) 1.32 (0.78) 1.12 (0.69) 0.60 (0.22) 0.92 (0.86) 1.04 (1.02)  
Δy (mm), (SD) 1.40 (0.82) 1.76 (0.80) 1.88 (0.74) 0.68 (0.82) 0.90 (1.34) 1.10 (0.67)  
Δz (mm), (SD) 2.40 (3.29) 3.00 (3.82) 4.20 (4.67) 0.90 (0.82) 0.90 (1.34) 0.30 ()  
Esophagus
DSC, (SD) 0.63 (0.10) 0.65 (0.15) 0.64 (0.13) 0.83 (0.05) 0.84 (0.06) 0.83 (0.06)  
Sensitivity, (SD) 0.57 (0.15) 0.57 (0.19) 0.63 (0.17) 0.85 (0.06) 0.87 (0.04) 0.88 (0.02)  
IncI, (SD) 0.76 (0.12) 0.79 (0.09) 0.67 (0.11) 0.82 (0.10) 0.82 (0.11) 0.79 (0.10) °
ΔV (%), (SD) −21.68 (29.94) −27.04 (26.22) −5.92 (23.75) 5.62 (18.34) 8.26 (18.26) 12.04 (12.37)  
Δx (mm), (SD) 1.12 (0.42) 1.38 (1.05) 1.54 (0.86) 0.60 (0.65) 0.80 (0.57) 1.00 (0.79)  
Δy (mm), (SD) 3.84 (5.83) 4.54 (6.48) 3.66 (3.77) 0.82 (0.84) 1.12 (0.76) 0.72 (0.79)  
Δz (mm), (SD) 7.80 (11.64) 7.50 (12.68) 6.60 (10.64) 1.50 (1.06) 1.20 (1.26) 1.20 (1.26)  
  1. For automatic segmentation: *AA vs. MA: p<0.043, #AA vs. VA: p<0.043, °MA vs. VA: p<0.043.
  2. For automatic segmentation+ manual correction: +AM vs. MM: p<0.043, ^AM vs. VM: p<0.043, =MM vs. VM: p<0.043.
  3. Abbreviations: CTV = Clinical target volume; SD = Standard deviation, DSC = DICE similarity coefficient, IncI = inclusiveness index, AA = Abas Automatic, MA = MiM Automatic, VA = Velocity Automatic, AM = Abas Manual Correction, MM = MiM Manual Correction, VM = Velocity Manual Correction.
Back to article page

Radiation Oncology

ISSN: 1748-717X

Contact us