A practical nomogram from the SEER database to predict the prognosis of hepatocellular carcinoma in patients with lymph node metastasis
Original Article

A practical nomogram from the SEER database to predict the prognosis of hepatocellular carcinoma in patients with lymph node metastasis

Kai Zhang#, Changcheng Tao#, Fan Wu, Jianxiong Wu, Weiqi Rong^

Department of Hepatobiliary Surgery, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China

Contributions: (I) Conception and design: K Zhang, W Rong; (II) Administrative support: W Rong, J Wu; (III) Provision of study materials of patients: C Tao, F Wu; (IV) Collection and assembly of data: F Wu, J Wu; (V) Data analysis and interpretation: K Zhang, C Tao; (VI) Manuscript writing: All authors; (VII) Final approval of manuscript: All authors.

#These authors contributed equally to the work.

^ORCID: 0000-0002-1127-1709.

Correspondence to: Weiqi Rong, Jianxiong Wu. Department of Hepatobiliary Surgery, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing 100021, China. Email: dr_rongweiqi@163.com; dr_wujx@163.com.

Background: The presence of lymph node (LN) metastases is associated with poor survival outcomes in hepatocellular carcinoma (HCC) patients. Because of the low probability of LN metastasis, research into the prognoses of these patients is difficult. The present study developed a nomogram model to predict the prognosis of HCC patients with LN metastasis.

Methods: This retrospective, noninterventional study enrolled patients from the Surveillance, Epidemiology, and End Results (SEER) database from 2010 to 2015. The following inclusion criteria were used: (I) site recode ICD-O-3 (International Classification of Diseases for Oncology, Third Edition) of 8170–8175 and malignant histological behavior; (II) seventh edition American Joint Committee on Cancer (AJCC) stage N1; (III) older than 18 years; and (IV) available information. Potential prognostic factors were collected from the SEER database; the primary outcomes of interest were overall survival (OS) and disease status. Cox and Lasso regression were used to investigate independent prognostic factors for survival. A prognostic nomogram using these independent risk factors was constructed. The concordance index (C-index) and calibration curves were used to evaluate the model's predictive performance. The clinical benefit was assessed via decision curve analysis (DCA).

Results: Patients were randomized into a training group (944 patients) and a validation group (402 patients) in a 70:30 ratio. Grade, T stage, liver surgery, chemotherapy, radiation recode, alpha-fetoprotein level, fibrosis score, tumor size group, and M stage were selected as independent prognostic factors, and a nomogram was developed using these variables. The C-indices of the training and validation groups were 0.70 and 0.73, respectively. Calibration curves for the probability of survival showed good agreement. DCA indicated that the nomogram had positive net benefits.

Conclusions: The constructed nomogram may assist clinicians in predicting the prognosis of HCC patients with LN metastasis and may provide a rationale for treatment options.

Keywords: Hepatocellular carcinoma (HCC); prognosis; lymph nodes metastasis; prediction model; nomogram


Submitted Sep 19, 2020. Accepted for publication Jan 18, 2021.

doi: 10.21037/apm-20-1876


Introduction

Hepatocellular carcinoma (HCC) is the most common primary liver cancer and the seventh most prevalent tumor worldwide, with 841,080 new cases annually (1,2). The dominant pathogenic factors vary according to countries and regions, including hepatitis B infection in China (3), hepatitis C infection in Japan and Africa, and alcohol intake in Western countries (4). Extrahepatic metastasis occurs in 30–50% of patients during the course of the disease (5). The lymph nodes (LN) are the second most common site of extrahepatic metastases in HCC (6), but the incidence of LN metastasis varies. In some studies with large sample sizes, an incidence ranging from 1.23% to 7.5% has been reported (7-9). Other studies have shown that this incidence may reach approximately 30% of the average rate (10,11). Although a large proportion of the data were derived from autopsies, the occurrence of LN metastasis may be underestimated, and more patients may have LN metastasis.

The Barcelona staging assigns patients with LN metastasis to the C phase (12), and the primary treatment for these patients is systemic therapy. The same situation is also observed in other staging systems, such as the AJCC staging system and the National Comprehensive Cancer Network (NCCN) guidelines (13), which may be due the fact that HCC patients with LN metastasis have a poor prognosis. A recent study of 2,043 cases showed that the median progression-free survival (PFS) after surgery was 16.3 months for HCC patients without nodal involvement, but only 5.8 months for the group with LN metastasis (9). The 1- and 3-year survival rates of HCC patients who do not have LN metastasis were 81% and 62%, respectively. However, the 1- and 3-year overall survival (OS) rates were only 62% and 31%, respectively, for HCC patients with nodal involvement (14). It is undeniable that LN metastasis is a poor prognostic factor for HCC (8,15). Nevertheless, the prognosis of HCC patients with LN metastases has improved with the development of various treatments and drugs in recent years (16-18). Previous studies have shown that patients diagnosed with stage IV HCC had a different prognosis (17). The prognosis of HCC patients with LN metastases was different in one study, although all HCC patients were treated with similar external beam radiotherapy (19). Selection of the appropriate treatment should be based on accurate identification of different prognostic groups. Therefore, it is essential to accurately stratify patients according to different prognoses. Because of LN metastasis low probability, grouping of patients requires a large sample size, which contributes to the difficulty of the implementation process of these studies. In summary, no study to date has constructed a prognostic model for risk assessment of HCC patients with LN metastasis despite evidence supporting different prognostic outcomes of HCC patients with LN metastases. Accordingly, it is essential to distinguish the different prognostic groups of HCC patients with LN metastasis to allow clinicians to make reasonable treatment decisions.

The nomogram is an efficient statistical tool that uses a graphical method to achieve a model that accurately predicts the outcomes of individual patients (20). To the best of our knowledge, a nomogram model that predicts OS in HCC patients with LN metastases does not exist. As previously mentioned, this type of study is difficult because of the reported low incidence of LN and the need for a large sample size. To obtain an expanded sample size and comprehensively identify the factors affecting the prognosis of HCC patients with LN metastasis, we analyzed medical records from the Surveillance, Epidemiology, and End Result (SEER) database. We present the following article in accordance with the TRIPOD reporting checklist (available at http://dx.doi.org/10.21037/apm-20-1876).


Methods

Ethics statement

This study was exempted by the Ethics Committee of Cancer Hospital, Chinese Academy of Medical Sciences (Beijing, China). The study was conducted in accordance with the Declaration of Helsinki (as revised in 2013). Because the data were obtained from a publicly available database, this study was recognized as a retrospective, non-interventional study.

Patient selection

The data were obtained from the SEER database (SEER 18 Regs Custom Data, with additional treatment fields), Nov 2018 sub (1973–2016 varying). The SEER database collects several types of data from electronic pathology reports of cancer patients and is an authoritative source of information on cancer, covering approximately 34.6% of the population in the United States of America (http://seer.cancer.gov/). The data were obtained using the SEER*Stat software (version 8.3.6). Because some essential prognostic factors were not available before 2010, patients diagnosed with HCC with LN metastases from 2010 to 2015 were finally included in our study. We divided these patients into a training group and a validation group.

The following inclusion criteria were used: (I) HCC patients from 2010 to 2015 (histological type ICD-O-3=8170-8175), for whom the site recode ICD-O-3/WHO 2008 was liver, and the histological behavior was malignant; (II) lymph-node metastasis (N1) patients were enrolled based on the seventh edition of the AJCC TNM staging; (III) patients older than 18 years old; and (IV) follow-up data were available. The following exclusion criteria were used: (I) survival months were unknown or zero; (II) samples without follow-up information data; (III) demographic information was not complete; (IV) treatment data were missing; (V) data on vital prognostic factors and tumor staging information were missing; and (VI) cause of death classification was not the primary tumor. Patients were randomized into a training group (accounting for 70%) and validation group (accounting for 30%) using the caret package and the seed was set at 1988. Additional details are shown in Figure 1. The primary outcomes in our study were OS and clinical status. Nineteen potential prognostic factors for HCC were included in the present study, comprising the following three aspects: (I) the general condition of the patient (e.g., sex, age, marital status, race, and liver fibrosis score); (II) tumor-specific factors (e.g., tumor size, tumor grade, alpha-fetoprotein (AFP) level, metastasis status); and (III) treatment factors (e.g., surgery to the liver or LN and whether chemotherapy and/or radiotherapy was administered). Detailed information on potential prognostic factors is listed in Table 1. The SEER database is an authoritative source of follow-up information for cancer patients. Clinical follow-up was obtained from the hospital electronic records.

Figure 1 The flow diagram of the research selection process.
Table 1
Table 1 Comparison of the demographics of the training and validation groups
Full table

Statistical analysis

The data from the SEER database comprised information on sex, age group, race, grade, T stage, diagnostic confirmation information, surgery to the liver, surgery to LN, bone metastasis, brain metastasis, liver metastasis, pulmonary metastasis, chemotherapy, radiation, insurance, marital status, AFP, fibrosis score, tumor size group, and M stage. The patients were censored as alive or dead due to other causes. Categorical variables were compared between different groups using the chi-squared test or Fisher’s exact test when necessary. The Mann-Whitney U-test was used for comparisons of numerical variables. Survival curves were generated using the Kaplan-Meier method, and survival distributions were compared using the log-rank test. Univariate and multivariate Cox regression models were used to screen for prognostic factors associated with survival in the training group. According to the multivariate analysis results, we developed a nomogram using R software (version 3.4.3, https://www.r-project.org/), which was internally validated by bootstrapping in 1000 bootstrap samples. The C-index and area under the receiver operating characteristic curve (AUC) of different times were used to compare the discriminative ability of the nomogram and the AJCC seventh edition (IVA/IVB) in the training and validation groups. Calibration curves were created to assess the predictive accuracy in the two groups (21). Statistical analyses were performed using SPSS software, version 25 (IBM) and R software (version 3.3.4). All of the tests were two-sided, and a P value of less than 0.05 was considered statistically significant.


Results

Patient characteristics in the training and validation groups

The flow diagram of the research selection process is shown in Figure 1. A total of 40,173 HCC patients from 2010 to 2015 were included in our study, including 2,662 cases (6.6%) with LN metastasis, and 37,511 cases (94.3%) without LN metastasis. According to the exclusion criteria, 1,346 patients were ultimately enrolled. We allocated 944 patients to the training group, and the other patients to the validation group. Table 1 summarizes the clinical information of the enrolled patients.

Among all the 1,346 patients, 81.7% were male, and 69.5% were white. Patients older than 60 years accounted for 54.3%, which was the largest proportion of the population. The AFP level was increased in 74.8% of patients, and 14.0% were grade III/IV based on the Edmondson-Steiner classification. A total of 86.3% of the patients did not receive radiation treatment. The same trend was observed for surgery to the liver/LNs. More than 90% of patients did not undergo surgery or LN dissection. The median (Q1–Q3) follow-up time of the patients was 5 [2–12] months. We found no significant differences in sex, age group, race, grade, T stage, diagnostic confirmation, surgery to the liver, surgery to LNs, brain metastasis, intrahepatic metastasis, bone metastasis, chemotherapy, radiation recode, insurance recode, marital status, AFP, fibrosis score, tumor size group, M stage, or survival months between the training group and validation group. The incidence of pulmonary metastasis was different between the two groups and was higher in the training group than the validation group, although there was no significant difference between the training group and the overall population.

Prognostic factors for HCC patients with lymph node metastasis (N1)

As shown in Table 2, univariate analysis revealed that grade, T stage, surgery to the liver, surgery to LN, bone metastasis, brain metastases, pulmonary metastasis, chemotherapy, radiation recode, Insurance recode, AFP, tumor size group, fibrosis score, and M stage were associated with OS.

Table 2
Table 2 Univariate analysis of overall survival for the primary group
Full table

We used the Lasso regression method to reduce the risk of over-fitting of our model, which compresses partial factorial regression coefficients to zero (22). The glmnet package was used in R software. A 10× cross-validation was applied to search for the least partial likelihood deviance, which represented the complexity of the model. A simplified model avoids over-fitting as much as possible. The variables that we chose when the partial likelihood deviance was lowest (lambda =−4.37) were age group, grade, T stage, surgery to the liver, surgery to LNs, bone metastasis, brain metastasis, pulmonary metastasis, intrahepatic metastasis, chemotherapy, radiation recode, insurance recode, AFP, tumor size group, fibrosis score, and M stage. Combined with the results of the univariate Cox analysis, we removed the variables of age group and intrahepatic metastasis, and 14 variables were included in multivariate analysis (Figure 2).

Figure 2 Lasso regression to determine the variables included in the model. (A) Lasso regression search for the optimal coefficient when lambda was −4.37. (B) A 10× cross-validation approach used to determine lambda at the least partial likelihood deviance.

Multivariate analysis revealed that grade, T Stage, surgery to the liver, chemotherapy, radiation recode, AFP, fibrosis score, tumor size group, and M stage remained independently associated with OS. The details are summarized in Table 3. Collinearity diagnostics were examined for the potential presence of collinearity between independent variables and VIF (variance inflation factors) ≤5.

Table 3
Table 3 Multivariate analysis of overall survival for the primary group
Full table

Construction and validation of the nomogram

A nomogram was created based on the significant variables determined by multivariate Cox regression analysis, as shown in Figure 3. In the training group, the Harrell’s C-index for OS prediction was 0.70 (95% CI, 0.68 to 0.72), and the AUC values for 1 and 2 years were 0.76 and 0.80, respectively. Harrell's C index for OS prediction in the validation group was 0.73 (95% CI, 0.70 to 0.76), and the AUC values for 1 and 2 years were 0.79 and 0.75, respectively. However, the C-index values of the AJCC staging system were only 0.58 (95% CI, 0.56 to 0.60) and 0.59 (95% CI, 0.56 to 0.62) in the training and validation groups, respectively. The nomogram model showed good discrimination.

Figure 3 Nomogram predictions of 1- and 2-year overall survival probability.

We further assessed the accuracy of our model predictions using a calibration plot. The calibration curves were drawn according to the training and validation groups. The calibration plots for the probability of survival at 1 and 2 years showed good agreement between the prediction by nomogram and actual observations (Figure 4).

Figure 4 Calibration curves for 1- and 2-year survival in the training group (A,B) and in the validation group (C,D).

The decision curve analysis (DCA) was plotted to observe the clinical benefits to the patient. The DCA indicated that our nomogram had a positive net benefit with a wide scale of threshold probabilities in the training and validation groups (Figure 5).

Figure 5 Clinical decision curve analysis (DCA) of the training group (A,B) and validation group (C,D) for 1- and 2-year clinical benefits.

Discussion

According to previous reports, the incidence of LN metastasis during the treatment of liver cancer varied from 1.6% to 5.9%, and was 25.5% on autopsy, which indicates that incidence of LN metastasis may be overlooked during clinical assessment (11). In our study, 6.6% of all HCC patients presented LN metastasis, which is consistent with previous studies. The emergence of novel treatments, including radiation, ablation, interventional therapy, and sorafenib, has improved the prognosis of these patients (18,23-25). Our study also showed that HCC patients with LN metastasis benefited from radiation and chemotherapy; we also found that patients with LN metastasis did not benefit from lymphadenectomy, and previous studies showed similar results (26-28). However, a benefit for surgery at the primary site (i.e., the liver) was detected in our study. We considered three possible reasons for these findings. First, over 38% of the patients included in our study were diagnosed without histology or cytology evaluation. The diagnosis of primary liver cancer is made via clinical diagnosis, imaging, and laboratory examinations (29-31). Therefore, we included patients whose diagnoses were established according to clinical diagnostic criteria. The diagnosis of LN metastasis in many patients was based on clinical and radiographic findings, and many patients may not have had cancerous LN metastasis. HCC patients often have chronic inflammation of the liver, such as hepatitis B, hepatitis C, and non-alcoholic fatty liver disease. Inflammation of the liver may also enlarge LNs, and one study showed that the proportion of enlarged LNs in hepatitis B virus-infected patients reached 9.4% (32). Hence, HCC patients with LN metastasis may be classified with cancerous metastasis and benign perihepatic LN enlargement (PLNE) in the absence of pathological diagnosis of the LN. One study showed that PLNE was an independent positive prognostic factor that may improve the prognosis of HCC patients (33). Some patients may benefit from surgery to the primary site in these cases. Second, only a few patients underwent liver surgery, which may have affected our statistical analysis. Third, patients undergoing surgery may have better basic indicators, such as performance status and liver function, than non-surgical patients. These facts may affect patient outcome. In summary, cytological or histological confirmation is recommended to determine whether LN metastasis is truly present, especially in patients with hepatitis, and thus we should choose treatment more carefully for HCC patients without pathological diagnosis of LN metastasis.

The Edmondson-Steiner classification scores pathological grade, whereby a higher grade indicates a lower degree of differentiation and a higher degree of malignancy. Some reports have reported a relationship between the Edmondson-Steiner classification and HCC patient prognosis. A higher grade indicates that the prognosis is likely to be worse (34,35). Zhang et al. reviewed whether the degree of cirrhosis affected the prognosis of patients. They found that the histological severity of cirrhosis was a vital adverse factor that affected the long-term outcomes of HCC patients undergoing liver surgery (36). Similar results have been found in three reports (37-39). The effects of AFP levels on patient prognosis are controversial. Some studies found that elevated AFP levels indicated a worse HCC patient prognosis (40-42). Other scholars found that AFP exerted no significant effect on patient survival (43), perhaps because the studies were performed in different populations. Our findings indicated that elevated AFP levels were an adverse prognostic factor.

With respect to pathological stage and tumor characteristics, T stage, M stage, and tumor size were associated with the prognosis of HCC patients with LN metastasis. Wu et al. determined that tumor size may be used as an independent risk predictor associated with survival in HCC (44). In combination with the T stage, we grouped patients according to different tumor sizes and obtained similar conclusions. The effects of the M stage on patient prognosis is not in doubt. Previous studies have shown that the prognosis of HCC patients with different metastatic sites was different (45,46). We included the following prognostic indicators: bone metastasis, brain metastasis, intrahepatic metastasis, pulmonary metastasis, and M stage, and our findings showed that only the M stage was an independent risk factor, which suggests that differences in the metastatic site may not be as significant in these patients compared to HCC without LN metastasis. The T stage was also an independent risk factor for worse prognosis. In general, the prognosis of patients worsened with an increase in the T stage. However, T3 stage patients exhibited greater reduced survival than T4 stage patients in our analysis. The AJCC stage was used by SEER in the original data. According to the seventh edition of AJCC staging (47), the T stage includes information about the size of the tumor, visceral vessel invasion and the number of hepatic tumors. T3a indicates multiple tumors, at least one of which is >5 cm. T3b indicates that cancer has invaded the main trunk of the portal vein or/and hepatic vein, which would lead to worse prognosis (48,49), and has been included in stage T4 of the eighth AJCC cancer staging manual. In the seventh edition AJCC staging manual, T4 was defined as the tumor invading adjacent organs, except the gallbladder, or penetrating the serous membrane. Therefore, for patients with liver cancer with LN metastasis, the prognostic significance of the number of liver tumors and vascular invasion may be greater than the invasion of adjacent organs.

As previously mentioned, the prognosis of HCC patients with LN metastasis is improving, and some studies have shown that stage IV HCC patients had a different prognosis (16-18). Thus, it is essential to distinguish differences in the prognosis of these patients.

In this study, we identified risk factors and constructed and validated a nomogram model that distinguished differences in the prognoses of HCC patients with LN metastasis, and thus provides a basis for the choice of treatment for these patients. Only by reasonable stratification of patients with different prognoses can a reasonable treatment plan be proposed. The establishment of the model may help to distinguish the differential prognoses of HCC patients with LN metastasis and may provide a basis for follow-up treatment. To the best of our knowledge, no similar studies have been performed. Compared to other models that require some technology to generate scores, our model used several clinically accessible indicators. We evaluated predictors that were clinically relevant so that the model could easily be applied in clinical practice.

However, our study has some limitations. First, a bias is inevitable in this type of retrospective study. For example, we removed many patients with LN metastasis for whom important clinical data were not available. This omission would cause a selection bias in our study because the enrolled patients may not be representative of this patient subset. Details relative to many important prognostic factors were also missing from the enrolled patients. Some significant prognostic values were not recorded in the SEER database, such as liver function tests, history of hepatitis B or hepatitis C infections, details of chemotherapy, radiation therapy, and surgery. Second, internal validation was used for the model, which may in general affect the accuracy of models HCC patients with LN metastasis. We will validate this model in the future using our clinical data. Prospective, randomized, controlled studies should also be performed.


Conclusions

In summary, our study showed that grade, surgery to the liver, T stage, chemotherapy, radiation recode, AFP, fibrosis score, tumor size group, and M stage were independent risk factors for the prognosis of HCC patients with LN metastases. Furthermore, we established a nomogram that may assist clinicians in predicting the prognosis of HCC patients with LN metastasis in order to provide a practical rationale for patient treatment.


Acknowledgments

Funding: National Key Research and Development Program of China (No. 2016YFD0400604), CAMS Innovation Fund for Medical Science (CIFMS) (CAMS-2016-I2M-3-025).


Footnote

Reporting Checklist: The authors have completed the TRIPOD reporting checklist. Available at http://dx.doi.org/10.21037/apm-20-1876

Conflicts of Interest: All authors have completed the ICMJE uniform disclosure form (available at http://dx.doi.org/10.21037/apm-20-1876). The authors have no conflicts of interest to declare.

Ethical Statement: The authors are accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. The study was conducted in accordance with the Declaration of Helsinki (as revised in 2013).

Open Access Statement: This is an Open Access article distributed in accordance with the Creative Commons Attribution-NonCommercial-NoDerivs 4.0 International License (CC BY-NC-ND 4.0), which permits the non-commercial replication and distribution of the article with the strict proviso that no changes or edits are made and the original work is properly cited (including links to both the formal publication through the relevant DOI and the license). See: https://creativecommons.org/licenses/by-nc-nd/4.0/.


References

  1. . Global epidemiology of hepatocellular carcinoma: an emphasis on demographic and regional variability. Clin Liver Dis 2015;19:223-38. [Crossref] [PubMed]
  2. , et al. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin 2018;68:394-424. [Crossref] [PubMed]
  3. , et al. Attributable causes of liver cancer mortality and incidence in china. Asian Pac J Cancer Prev 2013;14:7251-6. [Crossref] [PubMed]
  4. . Epidemiology and risk factors of biliary tract and primary liver tumors. Surg Oncol Clin N Am 2014;23:171-88. [Crossref] [PubMed]
  5. , et al. Clinical features of hepatocellular carcinoma with extrahepatic metastases. J Gastroenterol Hepatol 2005;20:1781-7. [Crossref] [PubMed]
  6. , et al. Clinical features and prognosis of patients with extrahepatic metastases from hepatocellular carcinoma. World J Gastroenterol 2007;13:414-20. [Crossref] [PubMed]
  7. , et al. Analysis of 6381 hepatocellular carcinoma patients in southern Taiwan: prognostic features, treatment outcome, and survival. J Gastroenterol 2008;43:159-70. [Crossref] [PubMed]
  8. , et al. Clinical significance of lymph node metastasis in patients undergoing partial hepatectomy for hepatocellular carcinoma. World J Surg 2010;34:1028-33. [Crossref] [PubMed]
  9. , et al. Hepatic resection for hepatocellular carcinoma with lymph node metastasis: clinicopathological analysis and survival outcome. Asian J Surg 2011;34:53-62. [Crossref] [PubMed]
  10. Liver Cancer Study Group of Japan. Primary liver cancer in Japan. Clinicopathologic features and results of surgical treatment. Ann Surg 1990;211:277-87. [PubMed]
  11. . Clinicopathologic study on lymph node metastasis of hepatocellular carcinoma: a retrospective study of 660 consecutive autopsy cases. Jpn J Clin Oncol 1994;24:37-41. [PubMed]
  12. . Prognosis of hepatocellular carcinoma: the BCLC staging classification. Semin Liver Dis 1999;19:329-38. [Crossref] [PubMed]
  13. , et al. Staging systems of hepatocellular carcinoma: A review. Indian J Gastroenterol 2018;37:481-91. [Crossref] [PubMed]
  14. , et al. Incidence and prognostic values of lymph node metastasis in operable hepatocellular carcinoma and evaluation of routine complete lymphadenectomy. J Surg Oncol 2007;96:37-45. [Crossref] [PubMed]
  15. , et al. The clinical significance of lymph node metastases in patients undergoing surgery for hepatocellular carcinoma. Surg Today 2000;30:892-5. [Crossref] [PubMed]
  16. , et al. Consideration of role of radiotherapy for lymph node metastases in patients with HCC: retrospective analysis for prognostic factors from 125 patients. Int J Radiat Oncol Biol Phys 2005;63:1067-76. [Crossref] [PubMed]
  17. , et al. Extrahepatic metastasectomy for hepatocellular carcinoma_ Predictors of long-term survival. J Surg Oncol 2016;114:469-74. [Crossref] [PubMed]
  18. , et al. Safety and technical feasibility of percutaneous ablation for lymph node metastases of hepatocellular carcinoma. Int J Hyperthermia 2019;36:160-8. [Crossref] [PubMed]
  19. , et al. Prognostic stratification and nomogram for survival prediction in hepatocellular carcinoma patients treated with radiotherapy for lymph node metastasis. Br J Radiol 2016;89:20160383 [Crossref] [PubMed]
  20. , et al. Nomograms in oncology: more than meets the eye. Lancet Oncol 2015;16:e173-80. [Crossref] [PubMed]
  21. , et al. Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology 2010;21:128-38. [Crossref] [PubMed]
  22. . The lasso method for variable selection in the Cox model. Stat Med 1997;16:385-95. [Crossref] [PubMed]
  23. , et al. Efficacy and safety of sorafenib in patients with advanced hepatocellular carcinoma according to baseline status: subset analyses of the phase III Sorafenib Asia-Pacific trial. Eur J Cancer 2012;48:1452-65. [Crossref] [PubMed]
  24. , et al. SIRveNIB: Selective Internal Radiation Therapy Versus Sorafenib in Asia-Pacific Patients With Hepatocellular Carcinoma. J Clin Oncol 2018;36:1913-21. [Crossref] [PubMed]
  25. , et al. Image-guided intensity-modulated radiotherapy improves short-term survival for abdominal lymph node metastases from hepatocellular carcinoma. Ann Palliat Med 2019;8:717-27. [Crossref] [PubMed]
  26. , et al. Management of lymph nodes during resection of hepatocellular carcinoma and intrahepatic cholangiocarcinoma: a systematic review. J Gastrointest Surg 2014;18:2136-48. [Crossref] [PubMed]
  27. , et al. Hepatectomy Versus Hepatectomy With Lymphadenectomy in Hepatocellular Carcinoma: A Prospective, Randomized Controlled Clinical Trial. J Clin Gastroenterol 2015;49:520-8. [Crossref] [PubMed]
  28. , et al. Prevalence and clinical significance of regional lymphadenectomy in patients with hepatocellular carcinoma. ANZ J Surg 2019;89:393-8. [Crossref] [PubMed]
  29. , et al. Imaging Techniques for the Diagnosis of Hepatocellular Carcinoma: A Systematic Review and Meta-analysis. Ann Intern Med 2015;162:697-711. [Crossref] [PubMed]
  30. , et al. Biomarkers: evaluation of clinical utility in surveillance and early diagnosis for hepatocellular carcinoma. Scand J Clin Lab Invest Suppl 2016;245:S70-6. [Crossref] [PubMed]
  31. , et al. Hepatocellular carcinoma: ESMO Clinical Practice Guidelines for diagnosis, treatment and follow-up. Ann Oncol 2019;30:871-3. [Crossref]
  32. , et al. Potential associations between perihepatic lymph node enlargement and liver fibrosis, hepatocellular injury or hepatocarcinogenesis in chronic hepatitis B virus infection. Hepatol Res 2015;45:397-404. [Crossref] [PubMed]
  33. . Prognostic Factors and Clinical Characteristics for Hepatocellular Carcinoma Patients with Benign Enlarged Perihepatic Lymph Nodes: a Single-Center Experience from China. J Gastrointest Surg 2015;19:1822-32. [Crossref] [PubMed]
  34. , et al. Prognostic factors of solitary large hepatocellular carcinoma: the importance of differentiation grade. Eur J Surg Oncol 2011;37:521-5. [Crossref] [PubMed]
  35. , et al. Edmondson-Steiner grade: A crucial predictor of recurrence and survival in hepatocellular carcinoma without microvascular invasio. Pathol Res Pract 2017;213:824-30. [Crossref] [PubMed]
  36. , et al. Severity of liver cirrhosis: a key role in the selection of surgical modality for Child-Pugh A hepatocellular carcinoma. World J Surg Oncol 2015;13:148. [Crossref] [PubMed]
  37. , et al. Influence of coexisting cirrhosis on long-term prognosis after surgery in patients with hepatocellular carcinoma. Surgery 1992;112:515-21. [PubMed]
  38. , et al. Influence of cirrhosis on long-term outcomes after liver resection in patients with a single small hepatocellular carcinoma. Zhonghua Wai Ke Za Zhi 2012;50:865-9. [PubMed]
  39. , et al. Forns index predicts recurrence and death in patients with hepatitis B-related hepatocellular carcinoma after curative resection. Liver Int 2015;35:1992-2000. [Crossref] [PubMed]
  40. , et al. Changes of serum alpha-fetoprotein and alpha-fetoprotein-L3 after hepatectomy for hepatocellular carcinoma: prognostic significance. Hepatobiliary Pancreat Dis Int 2012;11:618-23. [Crossref] [PubMed]
  41. , et al. Survival outcomes of liver transplantation for hepatocellular carcinoma in patients with normal, high and very high preoperative alpha-fetoprotein levels. World J Hepatol 2018;10:308-18. [Crossref] [PubMed]
  42. , et al. Diagnostic and prognostic significance of α-fetoprotein in hepatocellular carcinoma. Chirurg 2020;91:769-77. [Crossref] [PubMed]
  43. , et al. Alpha-fetoprotein has no prognostic role in small hepatocellular carcinoma identified during surveillance in compensated cirrhosis. Hepatology 2012;56:1371-9. [Crossref] [PubMed]
  44. , et al. Importance of tumor size at diagnosis as a prognostic factor for hepatocellular carcinoma survival: a population-based study. Cancer Manag Res 2018;10:4401-10. [Crossref] [PubMed]
  45. , et al. Prognostic value of site-specific extra-hepatic disease in hepatocellular carcinoma: a SEER database analysis. Expert Rev Gastroenterol Hepatol 2017;11:695-701. [Crossref] [PubMed]
  46. . The prognostic analysis of different metastatic patterns in advanced liver cancer patients: A population based analysis. PLoS One 2018;13:e0200909 [Crossref] [PubMed]
  47. Edge SB. American Joint Committee on Cancer. AJCC cancer staging manual. 7th ed. New York: Springer 2010.
  48. , et al. Simplified staging for hepatocellular carcinoma. J Clin Oncol 2002;20:1527-36. [Crossref] [PubMed]
  49. Kamarajah SK, Frankel TL, Sonnenday C, et al. Critical evaluation of the American Joint Commission on Cancer (AJCC) 8th edition staging system for patients with Hepatocellular Carcinoma (HCC): A Surveillance, Epidemiology, End Results (SEER) analysis. J Surg Oncol 2018;117:644-50.
Cite this article as: Zhang K, Tao C, Wu F, Wu J, Rong W. A practical nomogram from the SEER database to predict the prognosis of hepatocellular carcinoma in patients with lymph node metastasis. Ann Palliat Med 2021;10(4):3847-3863. doi: 10.21037/apm-20-1876