Model to predict cause‐specific mortality in patients with olfactory neuroblastoma: a competing risk analysis
Radiation Oncology volume 16, Article number: 103 (2021)
The main objective of this study was to evaluate the cumulative incidence of cause-specific mortality and other causes of mortality for patients with olfactory neuroblastoma (ONB). The secondary aim was to model the probability of cause-specific death and build a competing risk nomogram to predict cause-specific mortality for this disease.
Patients with ONB from 1975 to 2016 were identified from the Surveillance, Epidemiology, and End Results database. We estimated the cumulative incidence function (CIF) for cause-specific mortality and other causes of mortality, and constructed the Fine and Gray’s proportional subdistribution hazard model, as well as a competing-risk nomogram based on Fine and Gray’s model, to predict the probability of cause-specific mortality for patients with ONB.
After data selection, 826 cases were included for analysis. Five-year cumulative incidence of cause-specific mortality was 19.5% and cumulative incidence of other causes of mortality was 11.3%. Predictors of cause-specific mortality for ONB included tumor stage, surgery and chemotherapy. Age was most strongly predictive of other causes of mortality: patients aged > 60 years exhibited subdistribution hazard ratios of 1.063 (95 % confidence interval [CI] 1.05–1.08; p = 0.001). The competing risk nomogram for cause-specific mortality was well-calibrated, and had good discriminative ability (concordance index = 0.79).
We calculated the CIF of cause-specific mortality and other causes of mortality in patients with the rare malignancy ONB. We also built the first competing risk nomogram to provide useful individualized predictive information for patients with ONB.
Olfactory neuroblastoma (ONB) is an uncommon malignancy that arises from the olfactory epithelium and represents approximately 3% of all sinonasal malignancies [1, 2]. With improvement in pathological recognition, the incidence of ONB is steadily increasing in recent years . Regarding age distribution, recent studies would suggest the peak in the fifth to sixth decades demonstrating a unimodal age distribution [4, 5]. Based on several retrospective reviews [6,7,8,9,10] and meta-analyses[2, 11], surgical resection combined with radiotherapy is the current best treatment modality resulting in prolonged 5 year OS ranging from 65 to 75% [1, 2, 12,13,14]. Given the high incidence in the elderly as well as the relatively long-term survival for patients with ONB, a considerable number of patients may die of other non-cancer causes, especially for the elderly. As a result, presentation of other causes of mortality should be taken into account when evaluating the prognosis for ONB.
Although many studies have reported the prognosis of ONB, most of them focused on the overall survival and cancer-specific survival based on the Kaplan-Meier method and COX proportional approach. However, these conventional statistical methods may be inappropriate for the fact that they consider competing events as independent censoring and may overestimate the incidence of cause-specific mortality. In contrast, competing risk method based on the subdistribution hazard model could better discriminate the effects of risk factors on specific events. As a result, competing event model is recommended in the presence of competing causes of mortality . Competing risk nomogram for breast cancer, thyroid cancer and prostate cancer [16,17,18] have been developed in recent years. However, no comprehensive nomogram for ONB based on a competing risk model has been described.
In this study, we reviewed all ONB cases registered in the Surveillance, Epidemiology, and End Results (SEER) database from 1975 to 2016 and conducted a competing risk analysis. We calculated the cumulative incidence function (CIF) for cause-specific mortality and other causes of mortality, and developed a model to predict cause-specific mortality. We also established a competing risk nomogram for clinicians to predict probability of cause-specific mortality for ONB.
The study population was obtained from the records of the SEER 18 program released in 2018 of the National Cancer Institute. Patients diagnosed with ONB as a first primary malignancy between 1975 and 2016 were selected for the study. Since SEER data were anonymized and openly accessible, institutional review board approval was not needed for our study.
Tumor site and histology were grouped according to the International Classification of Diseases for Oncology, third edition (ICD-O-3). The study cohort consisted of patients with ICD-O-3 histology codes 9522/2 (ONB) and ICD-O-3 site codes as follows: C30.0 (nasal cavity), C31.0 (maxillary sinus), C31.1 (ethmoid sinus), C31.2 (frontal sinus), C31.3 (sphenoid sinus), C31.8 (overlapping lesion of accessory sinus), and C31.9 (accessory sinus, not otherwise specified [NOS]). Patients with histologically confirmed ONB were included and patients diagnosed at autopsy or by death certificate were excluded. Patients with complete data on race, age at diagnosis, gender, primary site, SEER stage, treatment (including surgery, radiotherapy, and chemotherapy) and SEER cause of death (COD) record were included in this study. Variables in the analysis included race, age, sex, primary site, SEER stage, surgery, radiotherapy and chemotherapy. Staging was grouped into three broad categories according to the SEER historical staging classification: localized, regional, and distant disease. Age was grouped as ≤ 60 years and > 60 years.
Cause-specific mortality and other causes of mortality were considered as two competing events. We used the cumulative incidence function (CIF) to describe the probability of mortality. Gray’s test was conducted to test the CIF difference between groups . We performed Fine and Gray proportional subdistribution hazards regression to build the competing risk model . We built a competing risk nomogram based on Fine and Gray’s model to predict cause-specific mortality for patients with ONB . Concordance index (c-index) value was used to assess discrimination and calibration plot was used to evaluate calibration via a bootstrap approach with 1000 resamples. All analyses were performed using R version 3.6.3 software (). The R packages cmprsk, rms, and mstate were used for building the model and nomogram and the package pec was used for evaluating model performance. All reported p values were two-sided, and the level of significance was set at 0.05.
A total of 826 patients with histologically confirmed ONB were identified in this analysis. Patients’ characteristics are shown in Table 1. The median age at diagnosis was 54 years. The majority of patients were ≤ 60 years old (65.1%), male (57.1%) and white (80.9%). The most common primary site was nasal cavity (77.6%). As to tumor stage distribution, 24.1%, 43.2% and 32.7% of patients presented with localized, regional and distant disease, respectively. Most patients (95.4%) were treated with surgery. A total of 72% of patients underwent radiotherapy, and only 30.8% of patients received chemotherapy.
The median follow-up was 122 months (interquartile range 61–188 months). At last contact, 449 patients (54.3%) had been censored, and 377 patients (45.6%) had died, including 223 deaths (27.0%) from ONB and 154 (18.6%) from other causes. The 5-year estimates of the cumulative incidence of cause-specific mortality and other causes of mortality according to patient characteristics are listed in Table 1. The corresponding CIF curves are shown in Fig. 1. Five-year cumulative incidence of cause-specific mortality was 19.5% and cumulative incidence of other causes of mortality was 11.3%. The competing risk analysis showed increased cumulative incidence of cause-specific mortality for patients with male (p = 0.02), advanced stage (p < 0.001), no surgery (p < 0.001) and chemotherapy treatment (p < 0.001). Age > 60 years (p < 0.001), no surgery (p < 0.001) and no radiotherapy (p = 0.04) were significantly associated with increased cumulative incidence of other causes of mortality.
The proportional subdistribution hazard models of probabilities of cause-specific mortality for patients with ONB are presented in Table 2. Tumor stage, surgery and chemotherapy were independent predictors of cause-specific mortality. Compared with localized disease, patients with regional disease (SHR = 2.67, 95% CI 1.64–4.34, p < 0.001) and distant disease (SHR = 5.28, 95% CI 3.11–8.95, p < 0.001) experienced higher risk of cause-specific mortality. Increased probability of mortality from ONB was observed in patients who did not receive surgery (SHR = 2.67, 95% CI 1.64–4.34, p < 0.001). Patients without chemotherapy were at lower risk of cause-specific mortality compared with those who underwent chemotherapy (SHR = 0.52, 95% CI 0.38–0.71, p < 0.001). Age was significantly predictive of other causes of mortality; compared with patients < 60 years, a significantly higher cumulative incidence of other causes of mortality was observed in patients ≥ 60 years (SHR = 1.06, 95% CI 1.05–1.08, p = 0.001).
The nomogram shown in Fig. 2 was constructed based on Fine and Gray’s model. This nomogram can predict probability of 3-, 5- and 10-year cause-specific mortality for patients with ONB by calculating the sum of points according to each patient’s characteristics. The model showed relatively good discriminative ability, with c-index of 0.79. The calibration plot of the CIF is shown in Fig. 3. The points close to the 45-degree line indicate good agreement between the nomogram-predicted probabilities and actual observations.
This study evaluated the mortality of patients with ONB registered in the SEER database from 1975 to 2016. Five-year cumulative incidence of cause-specific mortality and other causes of mortality were 19.5% and 11.3%, respectively. To our knowledge, this study is the first to develop competing risk nomogram based on the proportional subdistribution hazard approach to predict ONB specific mortality.
Previous studies have investigated the prognostic factors for ONB with inconsistent results. The widely recognized prognostic factors are tumor stage and Hyams’ histopathological grading [12, 13, 22], which is consistent with our results that advanced stage predict unfavorable cause-specific survival. However, Hyams’ grading data was not available in SEER database. The prognostic role of age for ONB is contradictory. Studies by Kadish  and Bisognoetal  demonstrated that ONB behaves differently among different age groups and tends to have a more aggressive presentation in the younger groups than in adults. Nevertheless, Eich et al.  suggested that children and adolescents with ONB could benefit from multimodal treatment with 5 year OS at 73%, which is comparable to adult population. Recently, a population based study by Yin et al.  analyzed patients with ONB in SEER database registered from 1973 to 2014 using the Cox method. The study concluded that the risk of overall mortality and cause-specific mortality increased with age by 3.1% and 1.6% per year. However, the study based on Cox method may overestimate the incidence of cause-specific mortality. In our competing risk analysis, advancing age was a strong predictor of other causes of mortality but was not associated with cause-specific mortality. Our results underscores the significance of treating other causes of mortality as a competing event in elderly patients for the fact that older patients were at greater risk of severe comorbidities and other causes of mortality.
Given the rarity of ONB, no prospective randomized clinical studies have been conducted to establish the agreed standard-of-care treatment algorithm. To date, multimodality treatment combining surgery and radiotherapy is the most widely accepted treatment approach [2, 4, 26]. In our study, surgery was associated with improved cause-specific survival, which was in consistent to previous studies indicating surgery is the mainstay treatment for ONB [26, 27]. Radiotherapy has been demonstrated to play an important role in the management of ONB. For Kadish stage A/B disease, some retrospective studies suggested that definitive radiotherapy alone could provide comparable treatment outcome with combination of surgery and radiation [22, 28, 29]. Post-operative and pre-operative radiotherapy could reduce local recurrence and improve survival by reducing local recurrence or increasing complete resection rate, especially for patients with advanced disease (Kadish stage C/D) [26, 30]. However, there is no consensus on the timing of radiotherapy when combined with surgery. The role of chemotherapy for ONB is contradictory. In our study, chemotherapy was associated with inferior cause-specific survival. This result regarding the role of chemotherapy should be interpreted with caution for the reason that lesions treated with chemotherapy had more advanced stage or higher risk of local recurrence and distant metastasis.
In our study, the five-year cumulative incidence of other causes of mortality was over half of cause-specific mortality (11.3% and 19.5%). As a result, competing causes of mortality represent a critical consideration when evaluating prognosis for decision making and patient counseling. To date, competing risk nomograms have been developed for common cancers such as breast cancer, thyroid cancer and prostate cancer [16,17,18]. To the best our knowledge, this is the first study to present CIF of cause-specific mortality and competing risk of mortality for ONB. Furthermore, this is the first attempt to establish a competing risk nomogram to predict cause-specific mortality for ONB. The strengths of our study include the population-based design, the large sample size and simplicity of competing risk nomogram model. Given the rarity of ONB, the population based SEER database can provide sufficient sample size to evaluate prognosis and develop an accurate predictive model. The nomogram can predict individual survival probability for specific outcomes at certain time points. Our nomogram by integrating a few prognostic factors showed good predictive ability, which would help doctors to make accurate individual prognosis estimates.
This study has several limitations that must be taken into account. First, some important prognostic factors such as Hyams’ grade, intracranial extension and surgical margin were unavailable in the SEER dataset. Inclusion of these prognostic factors will be a major part of our future research. In addition, patient data were collected from cases in SEER database diagnosed over the course of approximately 40 years. Pathological interpretation as well as treatment modalities including surgical technique, radiation technique and chemotherapy regimen have experienced massive changes in the past four decades. This model should be re-validated by patient data in recent years. Furthermore, we used internal validation by bootstrap approach to evaluate nomogram model performance. Although the nomogram showed good performance in cause-specific mortality prediction, external validation in other populations is still needed to estimate model accuracy.
In the present study, we calculated the CIF of cause-specific mortality and other causes of mortality for patients with ONB using a large, population-based cohort from the SEER database. We also modeled the probability of cause-specific mortality for ONB by the proportional subdistribution hazard approach, as well as built a competing risk nomogram to calculate the 3-, 5- and 10-year cause specific mortality. Our nomogram showed a relatively good performance and could be a practical tool to predict individual prognosis. However, further external validation is still needed.
Availability of data and materials
The datasets used during the present study are available from the corresponding author upon reasonable request.
Cumulative incidence function
Cause of death
Not otherwise specified
Subdistribution hazard ratio
Surveillance, Epidemiology, and End Results
Broich G, Pagliari A, Ottaviani F. Esthesioneuroblastoma: a general review of the cases published since the discovery of the tumour in 1924. Anticancer Res. 1997;17(4a):2683–706.
Dulguerov P, Allal AS, Calcaterra TC. Esthesioneuroblastoma: a meta-analysis and review. Lancet Oncol. 2001;2(11):683–90.
Jethanamest D, Morris LG, Sikora AG, Kutler DI. Esthesioneuroblastoma: a population-based analysis of survival and prognostic factors. Arch Otolaryngol Head Neck Surg. 2007;133(3):276–80.
Platek ME, Merzianu M, Mashtare TL, Popat SR, Rigual NR, Warren GW, Singh AK. Improved survival following surgery and radiation therapy for olfactory neuroblastoma: analysis of the SEER database. Radiat Oncol (Lond England). 2011;6:41.
Yin Z, Wang Y, Wu Y, Zhang X, Wang F, Wang P, Tao Z, Yuan Z. Age distribution and age-related outcomes of olfactory neuroblastoma: a population-based analysis. Cancer Manag Res. 2018;10:1359–64.
Argiris A, Dutra J, Tseke P, Haines K. Esthesioneuroblastoma: the Northwestern University experience. Laryngoscope. 2003;113(1):155–60.
Banuchi VE, Dooley L, Lee NY, Pfister DG, McBride S, Riaz N, Bilsky MH, Ganly I, Shah JP, Kraus DH, et al. Patterns of regional and distant metastasis in esthesioneuroblastoma. Laryngoscope. 2016;126(7):1556–61.
Noh OK, Lee SW, Yoon SM, Kim SB, Kim SY, Kim CJ, Jo KJ, Choi EK, Song SY, Kim JH, et al. Radiotherapy for esthesioneuroblastoma: is elective nodal irradiation warranted in the multimodality treatment approach? Int J Radiat Oncol Biol Phys. 2011;79(2):443–9.
Ow TJ, Hanna EY, Roberts DB, Levine NB, El-Naggar AK, Rosenthal DI, DeMonte F, Kupferman ME. Optimization of long-term outcomes for patients with esthesioneuroblastoma. Head Neck. 2014;36(4):524–30.
Resto VA, Eisele DW, Forastiere A, Zahurak M, Lee DJ, Westra WH. Esthesioneuroblastoma: the Johns Hopkins experience. Head Neck. 2000;22(6):550–8.
Devaiah AK, Andreoli MT. Treatment of esthesioneuroblastoma: a 16-year meta-analysis of 361 patients. Laryngoscope. 2009;119(7):1412–6.
Kane AJ, Sughrue ME, Rutkowski MJ, Aranda D, Mills SA, Buencamino R, Fang S, Barani IJ, Parsa AT. Posttreatment prognosis of patients with esthesioneuroblastoma. J Neurosurg. 2010;113(2):340–51.
Ozsahin M, Gruber G, Olszyk O, Karakoyun-Celik O, Pehlivan B, Azria D, Roelandts M, Kaanders JH, Cengiz M, Krengli M, et al. Outcome and prognostic factors in olfactory neuroblastoma: a rare cancer network study. Int J Radiat Oncol Biol Phys. 2010;78(4):992–7.
Woods RSR, Subramaniam T, Leader M, McConn-Walsh R, O’Neill JP, Lacy PD. Changing trends in the management of Esthesioneuroblastoma: irish and international perspectives. J Neurol Surg Part B Skull Base. 2018;79(3):262–8.
Carmona R, Zakeri K, Green G, Hwang L, Gulaya S, Xu B, Verma R, Williamson CW, Triplett DP, Rose BS, et al. Improved method to stratify elderly patients with cancer at risk for competing events. J Clin Oncol. 2016;34(11):1270–7.
Hanrahan EO, Gonzalez-Angulo AM, Giordano SH, Rouzier R, Broglio KR, Hortobagyi GN, Valero V. Overall survival and cause-specific mortality of patients with stage T1a,bN0M0 breast carcinoma. J Clin Oncol. 2007;25(31):4952–60.
Yang L, Shen W, Sakamoto N. Population-based study evaluating and predicting the probability of death resulting from thyroid cancer and other causes among patients with thyroid cancer. J Clin Oncol. 2013;31(4):468–74.
Brockman JA, Alanee S, Vickers AJ, Scardino PT, Wood DP, Kibel AS, Lin DW, Bianco FJ Jr, Rabah DM, Klein EA, et al. Nomogram predicting prostate cancer-specific mortality for men with biochemical recurrence after radical prostatectomy. Eur Urol. 2015;67(6):1160–7.
Gray RJ. A class of k-sample tests for comparing the cumulative incidence of a competing risk. Ann Stat. 1988;16:1141–54.
Fine JP, Gray RJ. A proportional hazards model for the subdistribution of competing risks in survival analysis. J Am Stat Assoc. 1999;94:496–509.
Zhang Z, Geskus RB, Kattan MW, Zhang H, Liu T. Nomogram for survival analysis in the presence of competing risks. Ann Transl Med. 2017;5(20):403.
Morita A, Ebersold MJ, Olsen KD, Foote RL, Lewis JE, Quast LM. Esthesioneuroblastoma: prognosis and management. Neurosurgery. 1993;32(5):706–14 discussion 714–705.
Kadish S, Goodman M, Wang CC. Olfactory neuroblastoma. A clinical analysis of 17 cases. Cancer. 1976;37(3):1571–6.
Bisogno G, Soloni P, Conte M, Podda M, Ferrari A, Garaventa A, Luksch R, Cecchetto G. Esthesioneuroblastoma in pediatric and adolescent age. A report from the TREP project in cooperation with the Italian Neuroblastoma and Soft Tissue Sarcoma Committees. BMC Cancer. 2012;12:117.
Eich HT, Müller RP, Micke O, Kocher M, Berthold F, Hero B. Esthesioneuroblastoma in childhood and adolescence. Better prognosis with multimodal treatment? Strahlentherapie und Onkologie: Organ der Deutschen Rontgengesellschaft [et al]. 2005;181(6):378–84.
Orton A, Boothe D, Evans D, Lloyd S, Monroe MM, Jensen R, Shrieve DC, Hitchcock YJ. Esthesioneuroblastoma: a patterns-of-care and outcomes analysis of the national cancer database. Neurosurgery. 2018;83(5):940–7.
Cranmer LD, Chau B, Rockhill JK, Ferreira M Jr, Liao JJ. Chemotherapy in esthesioneuroblastoma/olfactory neuroblastoma: an analysis of the surveillance epidemiology and end results (SEER) 1973–2015 database. Am J Clin Oncol. 2020;43(3):203–9.
Elkon D, Hightower SI, Lim ML, Cantrell RW, Constable WC. Esthesioneuroblastoma. Cancer. 1979;44(3):1087–94.
Yin ZZ, Gao L, Luo JW, Yi JL, Huang XD, Qu Y, Wang K, Zhang SP, Xiao JP, Xu GZ, et al. Long-term outcomes of patients with esthesioneuroblastomas: A cohort from a single institution. Oral Oncol. 2016;53:48–53.
Polin RS, Sheehan JP, Chenelle AG, Munoz E, Larner J, Phillips CD, Cantrell RW, Laws ER Jr, Newman SA, Levine PA, et al. The role of preoperative adjuvant treatment in the management of esthesioneuroblastoma: the University of Virginia experience. Neurosurgery. 1998;42(5):1029–37.
Ethics approval and consent to participate
This article does not contain any studies with human participants or animals performed by any of the authors.
Consent for publication
The authors declare no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Liu, L., Zhong, Q., Zhao, T. et al. Model to predict cause‐specific mortality in patients with olfactory neuroblastoma: a competing risk analysis. Radiat Oncol 16, 103 (2021). https://doi.org/10.1186/s13014-021-01784-8