Review
Abstract
Background: Screening for prostate cancer has long been a debated, complex topic. The use of risk calculators for prostate cancer is recommended for determining patients’ individual risk of cancer and the subsequent need for a prostate biopsy. These tools could lead to better discrimination of patients in need of invasive diagnostic procedures and optimized allocation of health care resources
Objective: The goal of the research was to systematically review available literature on the performance of current prostate cancer risk calculators in healthy populations by comparing the relative impact of individual items on different cohorts and on the models’ overall performance.
Methods: We performed a systematic review of available prostate cancer risk calculators targeted at healthy populations. We included studies published from January 2000 to March 2021 in English, Spanish, French, Portuguese, or German. Two reviewers independently decided for or against inclusion based on abstracts. A third reviewer intervened in case of disagreements. From the selected titles, we extracted information regarding the purpose of the manuscript, analyzed calculators, population for which it was calibrated, included risk factors, and the model’s overall accuracy.
Results: We included a total of 18 calculators from 53 different manuscripts. The most commonly analyzed ones were the Prostate Cancer Prevention Trial (PCPT) and European Randomized Study on Prostate Cancer (ERSPC) risk calculators developed from North American and European cohorts, respectively. Both calculators provided high diagnostic ability of aggressive prostate cancer (AUC as high as 0.798 for PCPT and 0.91 for ERSPC). We found 9 calculators developed from scratch for specific populations that reached a diagnostic ability as high as 0.938. The most commonly included risk factors in the calculators were age, prostate specific antigen levels, and digital rectal examination findings. Additional calculators included race and detailed personal and family history.
Conclusions: Both the PCPR and ERSPC risk calculators have been successfully adapted for cohorts other than the ones they were originally created for with no loss of diagnostic ability. Furthermore, designing calculators from scratch considering each population’s sociocultural differences has resulted in risk tools that can be well adapted to be valid in more patients. The best risk calculator for prostate cancer will be that which has been calibrated for its intended population and can be easily reproduced and implemented.
Trial Registration: PROSPERO CRD42021242110; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=242110
doi:10.2196/30430
Keywords
Introduction
According to the World Health Organization, the 2020 global incidence of prostate cancer was 1,414,259 cases, which represented 7.3% of all the new cancer cases. It represents the fourth most common type of cancer [
]. In Mexico, prostate cancer is the leading type of cancer death in men 50 years and older [ ]. Early prostate cancer detection could help to accurately discriminate indolent from aggressive cancers and significantly reduce the overuse of invasive diagnostic techniques and the side effects associated with cancer treatment [ ]. A randomized study on the European population who underwent screening showed a progressive 51% reduction in prostate cancer mortality in individuals up to age 75 years [ ].Currently, there is no evidence to support or refute the implementation of widespread early screening programs for prostate cancer; and the position of international guidelines on who and when to screen has constantly pivoted. Thus, active surveillance must be based carefully on individualized weight of risk factors [
, ]. For example, the combination of family history of prostate cancer, personal medical history, serum biomarker levels, and sociocultural aspects has led to the creation of tools that can more accurately predict individual risk for prostate cancer and focalize screening strategies for populations at higher risk. These tools, or risk calculators, could lead to a reduction in the overdiagnosis of prostate cancer and its subsequent overtreatment [ ]. The European Randomized Study of Prostate Cancer (ERSPC) risk calculator (RC) and the Prostate Cancer Prevention Trial (PCPT) RC are two well-known prostate cancer risk calculators that have been extensively validated in independent cohorts in their original versions; recent, updated versions of both calculators have shown promising results in populations other than the ones for which they were originally developed [ ]. Other well-known, externally validated predictive models like the Prostate Health Index (PHI), which includes more biomarkers, are important tools in reducing unnecessary prostate biopsies [ ]. All of these predictive models have been used among diverse populations with different results regarding each risk factor’s individual predictive value for prostate cancer, as well as the models’ overall performance.Prostate cancer screening is based in the combination of serum prostate specific antigen (PSA), digital rectal examination (DRE), and sometimes additional urine biomarkers. Additional tools such as magnetic resonance imaging (MRI) and risk calculators may help decide the need for a biopsy [
]. Advanced imaging techniques and access to biopsy are not always available, particularly in lower- and middle-income countries, which renders risk calculators a viable option to decide which patients are in need of additional screening and for optimizing allocation of health care resources. A systematic review on prostate cancer risk calculators in a healthy population could summarize current tools available to primary care physicians and encourage the adaptation or creation of new risk calculators adjusted to each population’s sociocultural variations [ ].The aim of our study was to systematically review available literature on current prostate cancer risk calculators in healthy population by comparing the relative impact of individual items on different cohorts and the models’ overall performance.
Methods
Search Methods
A systematic review was performed in April 2021. We searched MEDLINE via PubMed and Latin American and Caribbean Health Sciences via LILACS for publications between January 1, 2000 and April 1, 2021. We used 3 combined queries as follows: (“2000/01/01”[Date–Publication]: “2021/04/01”[Date–Publication]) AND ((cancer of prostate [MeSH terms]) OR (prostate cancer [MeSH terms])) OR (prostate cancer [text word]) AND ((risk prediction [text word]) OR (risk model [text word])) OR (risk calculator [text word]). We extracted the resulting titles and abstracts into a spreadsheet. This systematic review was registered at PROSPERO [CRD42021242110].
Selection Criteria
Articles were included if they met the following criteria:
- Authors presented a new risk calculator for prostate cancer OR authors validated or modified an existing risk calculator in a different population OR authors compared predictive capabilities of 2 or more risk calculators
- Article was in either Spanish, English, French, Portuguese, or German
- Article explicitly described the calculator’s predictive capability
Articles were excluded if any of the following were true:
- Article presented or analyzed a calculator for nonhealthy population such as models to predict aggressiveness or relapse in a population already diagnosed with prostate cancer
- Reported risk factors were mainly genomic (eg, polymorphisms) or considered inaccessible for general practitioners or in settings with limited resourced (eg, MRI)
Data Extraction and Analysis
Using the listed criteria, two authors independently reviewed the titles and abstracts and decided for or against inclusion. We included titles if both reviewers agreed on inclusion and vice versa for exclusion. If the reviewers disagreed, a third reviewer decided on the article’s inclusion. We then obtained the full text for selected titles, screened them for final inclusion eligibility, and extracted the data from selected articles. From each included article, we extracted the objective, study design, number of participants and their inclusion criteria, name of the proposed or analyzed model, methodology for the development or analysis of each model’s included risk factors and their impact measurements, validation methodology, and each model’s prediction capability. From the extracted data, we then summarized the risk factors and their impact measurements for prostate cancer according to each model that included them.
Results
Our search resulted in 460 articles after excluding duplicates. We reviewed all results and agreed on 53 articles that passed the title and abstract stage, in which we evaluated the complete text. We then excluded an additional 17 titles: 5 that focused on biomarkers as predictors, 4 that evaluated the use of MRI techniques, 4 on nonhealthy population that predicted recurrence of disease, and 4 that did not specify risk or prediction ability. We then extracted information on the remaining 36 studies and classified them as articles that evaluated or calibrated risk calculators in a new population, studies that compared 2 or more existing risk calculators in a specific population, and studies that proposed and validated a novel risk calculator. We identified a total of 18 risk calculators in the 36 included studies. We did not perform a metanalysis of the individual risk factors as the reported impact measurements were too heterogenous (
).We first identified the most commonly studied risk calculators and the risk factors they include in their original versions. The most mentioned risk calculators were the ERSPC, PCPT, and PHI.
The ERSPC RC, in its original version for use by medical personnel (R3 version), includes MRI information if available, PSA levels, results of a prior biopsy, and results of a DRE and prostate volume measured by transrectal ultrasound [
]. In its original version, the PCPT RC includes age, race, PSA levels, family history of prostate cancer, results of a DRE, results of a prior biopsy, and when available, free PSA, prostate cancer antigen 3, and T2:ERG [ ]. On the other hand, the PHI calculates risk with a mathematical approach that includes PSA, free PSA, and prostate specific antigen isoform p2 [ ]. Since their introduction, all these calculators have undergone external modifications with additional risk factors. Additionally, we found calculators that were developed de novo and that include different risk factors from the canonical ERPSC and PCPT RCs. For example, the Lifestyle Risk Prediction Model for Prostate Cancer by Kim et al [ ] includes height, weight, glucose levels, meat and alcohol consumption, smoking status, and physical activity. The risk calculator by Albright et al [ ] incorporates a detailed extended family history to calculate the risk of prostate cancer, and the risk calculator by Jalali et al [ ] combines traditional measurements of PSA and DRE with family history.In
, we present the summary of all articles in the systematic review. A single article may have evaluated multiple risk calculators or may have had multiple purposes. A total of 18 articles evaluated the PCPT RC (1 optimized it with the prostate health index, 1 optimized it with detailed family history, 14 calibrated or assessed it in a new population, and 2 assessed it in a new population while also comparing it with a different calculator). Similarly, 14 articles evaluated the ERSPC RC in its level 3 version (1 optimized it with the PHI, and 13 calibrated it in a new population, out of which 7 also compared it to a different calculator [essentially the PCPT RC or a new calculator]). We found 9 articles describing a new risk calculator as well as their area under the curve (AUC) and calibration. The table also describes the predictive capacity that each study found for the analyzed risk calculators. For example, depending on the populations in which they were used, the PCPT RC had AUCs ranging from as low as 0.562 to as high as 0.813, while the ERSPC RC reported AUCs from 0.68 to 0.86. These AUCs also varied depending on whether the calculator was applied to any prostate cancer or to high-grade prostate cancer. AUCs are generally higher when looking for high-grade cancers. For example, for the PCPT RC, AUCs for prostate cancer peaked at 0.783, while those for high-grade prostate cancer could be as high as 0.813. Furthermore, risk calculators created from scratch also showed high predictive capabilities on their target population, such as the Korean Prostate Cancer Risk Calculator (AUC 0.887) by Kim et al [ ], which uses socioenvironmental aspects of their population to create the predictive models, and the risk calculator by Albright et al [ ], which stratifies risk depending on the number of extended family members with prostate cancer.In
, we detail the reported impact measures associated with each risk factor by risk calculator. Not all studies specified the impact measures of each individual risk factor but rather reported only the calculator’s overall predictive ability, as described in . For those that did specify, elevated PSA levels and a positive DRE conferred the highest risk for prostate cancer. For example, log PSA as a predictor in the PCPT RC conferred an HR of 5.42 and an OR of 1.8 for prostate cancer, while a positive DRE showed significant ORs from 2.2 to as high as 8.22 in the Korean Prostate Cancer RC. A positive family history of prostate cancer also conferred higher odds in the PCPT RC. On the other hand, and as is expected, a prior negative biopsy was found as a protective factor for prostate cancer (with HRs of 0.14 and 0.64 as found in the PCPT RC). Race was not significant in any of the calculators that specified its impact measures.Model and country | Article | Year | Purpose | End point | Sample size | Study type | AUCa | Notes | |||||||||
PCPTbRCc | |||||||||||||||||
Ireland | Loeb, et al [ | ]2017 | Ad | Gleason ≥7 | 892 | 1e | 0.697 | Inclusion of PHIf into an existing calculator | |||||||||
US | Auffenberg, et al [ | ]2017 | Bg | Absence of cancer, Gleason <7, Gleason ≥7 | 11,809 | 2h | 0.621 (0.607-0.64) | —i | |||||||||
Ireland | Lundon, et al [ | ]2015 | B | Risk of any prostate cancer diagnosis and risk of high-grade disease | 556 | 2 | PCj: 0.628; high-grade PC: 0.798 | — | |||||||||
Switzerland | Poyet, et al [ | ]2016 | B | Gleason ≥7 and/or T stage ≥T2b | 1615 | 2 | PC: 0.66; high-grade PC: 0.69 | Validation in a Swiss cohort | |||||||||
North America and Europe | Ankerst, et al [ | ]2018 | B,Ck | Gleason ≥7, <7, or no cancer | 15,611 | 2 | 0.723 (0.709-0.737) | Compares AUC to PBCGl RC | |||||||||
Switzerland | Poyet, et al [ | ]2016 | B | PC or significant PC (Gleason ≥7) | 1996 | 2 | PC: 0.66; significant PC: 0.70 | Compares and calibrates new versions of PCPT and ERSPCm | |||||||||
US | Kaplan, et al [ | ]2010 | B | PC or significant PC (Gleason ≥7) | 624 | 1 | Not specified | Validates PCPT in high-risk individuals | |||||||||
International | Ankerst, et al [ | ]2012 | B | Each cohort’s criteria | 25,733 | 2 | ERSPC Goeteborg 1: 0.72; ERSPC Goeteborg 2-6: 0.562; ERSPC Rotterdam 1: 0.7; ERSPC Rotterdam 2-3: 0.61; ERSPC Tarn: 0.667; SABORn: 0.654; Cleveland Clinic: 0.588; ProtecT: 0.639; Tyrol: 0.667; Durham: 0.715 | — | |||||||||
Portugal | Cavadas, et al [ | ]2010 | B,C | Positive biopsy | 493 | 2 | 0.744 (0.705-0.781) | — | |||||||||
Sweden | Grill, et al [ | ]2015 | A | Same as PCPT RC | 55,158 cases + 632,218 controls | 3o | Not specified | Adds detailed family history to PCPT RC | |||||||||
Canada | Trottier, el al [ | ]2011 | B,C | PC or high-grade PC | 982 | 2 | 0.63 | — | |||||||||
US | Carbunaru, et al [ | ]2019 | B,C | PC and significant PC | 954 | 2 | Significant PC: 0.64 (0.61-0.68) | — | |||||||||
Mexico | Liang, et al [ | ]2013 | B | PC and significant PC | 826 | 2 | PC: 0.785; high-grade PC: 0.766 | — | |||||||||
US | Nguyen, et al [ | ]2010 | B | PC or high-grade PC | 3482 | 2 | PC: 0.57; high-grade PC: 0.6 | — | |||||||||
China | Zhu, et al [ | ]2012 | B,C | PC or high-grade PC | 495 | 2 | PC: 0.783 (0.737-0.83); high-grade PC: 0.813 (0.764-0.862) | — | |||||||||
US | Liang, et al [ | ]2013 | B | PC or high-grade PC | 1021 | 2 | Not specified | — | |||||||||
US | Nam, et al [ | ]2011 | B,C | PC or high-grade PC | 2130 | 2 | PC: 0.61 (0.59-0.64); aggressive PC: 0.67 (0.64-0.7) | — | |||||||||
US | Parekh, et al [ | ]2006 | B | PC or high-grade PC | 446 | 2 | 0.655 (0.602-0.708) | Uses PCPT in an ethnically diverse population | |||||||||
Finasteride-adjusted PCPT RC | |||||||||||||||||
Mexico | Liang, et al [ | ]2012 | B | PC | 837 | 2 | PC: 0.784; high-grade PC: 0.768 | — | |||||||||
ERSPC RC (level 3) | |||||||||||||||||
US | Loeb, et al [ | ]2017 | A | Gleason ≥7 | 892 | 1 | 0.711 | Inclusion of PHI into an existing calculator | |||||||||
Europe | Van Vugt, et al [ | ]2010 | B | Positive sextant prostate biopsy | 1825 Finnish men + 531 Swedish men | 2 | Finnish cohort 0.76 (0.74-0.79), Swedish cohort 0.78 (0.73-0.83) | — | |||||||||
Netherlands | Gayet, et al [ | ]2018 | B | Gleason ≥7 and/or T stage ≥T2b | 1812 | 2 | PC: 0.78 (0.76-0.8); significant PC: 0.91 (0.89-0.92) | — | |||||||||
Ireland | Lundon, et al [ | ]2015 | B,C | Risk of any PC diagnosis and risk of high-grade disease | 556 | 2 | PC: 0.588; high-grade PC: 0.69 | — | |||||||||
South Africa | Kowlessur, et al [ | ]2020 | B | Gleason ≥7 and/or T stage ≥T2b | 475 | 2 | PC: 0.738 (0.695-0.781); significant PC: 0.833 (0.789-0.876) | Calibration of ERSPC for South African Population | |||||||||
Switzerland | Poyet, et al [ | ]2016 | B | Gleason ≥7 and/or T stage ≥T2b | 1615 | 2 | PC: 0.64; high-grade PC: 0.70 | Validation in a Swiss cohort | |||||||||
Spain | Gómez-Gómez, et al [ | ]2017 | B,Dp | Gleason ≥7 and/or T stage ≥T2b | 749 | 2 | PC: 0.69 (0.65-0.74), high-grade PC: 0.74 (0.70-0.79) | Also evaluates variability with a subsequent PSAq sample | |||||||||
Switzerland | Poyet, et al [ | ]2016 | B,C | PC or high-grade PC | 1996 | 2 | PC: 0.65; significant PC: 0.73 | Compares and calibrates new versions of PCPT and ERSPC | |||||||||
Canada | Trottier, et al [ | ]2011 | B,C | PC or high-grade PC | 982 | 2 | 0.71 | — | |||||||||
China, Netherlands | Chen, et al [ | ]2021 | B,C | PC or high-grade PC | 6741 | 2 | European cohort: PC: 0.79 (0.77-0.81); high-grade PC: 0.86 (0.84-0.89); Chinese cohort: PC: 0.74 (0.72-0.76); high-grade PC: 0.74 (0.72-0.76) | Compares CPCCr RC to ERSPC RC | |||||||||
Portugal | Cavadas, et al [ | ]2010 | B,C | Positive biopsy | 493 | 2 | 0.801 (0.764-0.834) | — | |||||||||
Netherlands | Van Vugt, et al [ | ]2012 | B | Positive sextant prostate biopsy | 320 | 2 | 0.77 (0.72-0.83) | — | |||||||||
China | Zhu, et al [ | ]2012 | B,C | PC or high-grade PC | 495 | 2 | PC: 0.831 (0.79-0.872); high-grade PC: 0.852 (0.807-0.897) | — | |||||||||
Europe | Roobol, et al [ | ]2015 | B,C,D | Positive sextant prostate biopsy | 1185 | 2 | PC: 0.72; clinically relevant PC: 0.68 | Uses an ERSPC model that includes PHI | |||||||||
ERSPC RC (level 4) | |||||||||||||||||
Netherlands | Gayet, et al [ | ]2018 | B | Gleason ≥7 and/or T stage ≥T2b | 1812 | 2 | PC: 0.62 (0.56-0.67); significant PC: 0.74 (0.66-0.81) | — | |||||||||
Europe | Roobol, et al [ | ]2015 | B,C,D | Positive sextant prostate biopsy | 1185 | 2 | PC: 0.72 (0.67-0.77) | Uses an ERSPC model that includes PHI | |||||||||
MUSICsmodel | |||||||||||||||||
US | Auffenberg, et al [ | ]2017 | A,C | Absence of cancer, Gleason <7, Gleason ≥7 | 11,809 | 2 | 0.63 (0.613-0.65) | — | |||||||||
CPCC RC | |||||||||||||||||
China | Chen, et al [ | ]2016 | A,C | PC or high-grade PC | 924 patients for model development + 911 patients for model validation | 2 | PC: 0.801 (0.771-0.831); high-grade PC: 0.826 (0.796-0.857) | Compares CPCC RC to ERSPC RC | |||||||||
China, Netherlands | Chen, et al [ | ]2021 | B,C | PC or high-grade PC | 6741 | 2 | European cohort: PC: 0.77 (0.75-0.79); high-grade PC: 0.86 (0.83-0.88); Chinese cohort: PC 0.77 (0.74-0.77); high-grade PC: 0.77 (0.75-0.79) | — | |||||||||
ProstateCheck | |||||||||||||||||
Switzerland | Poyet, et al [ | ]2016 | B,C | Gleason ≥7 and/or T stage ≥T2b | 1615 | 2 | PC: 0.69 (0.67-0.73); high-grade PC: 0.72 (0.69-0.77) | ProstateCheck is based on the ERSPC | |||||||||
Sunnybrook normogram-based PC RC | |||||||||||||||||
US | Nam, et al [ | ]2011 | B,C | PC or high-grade PC | 2130 | 2 | PC: 0.67 (0.65-0.69); aggressive PC: 0.72 (0.7-0.75) | — | |||||||||
PHI model | |||||||||||||||||
Ireland | Foley, et al [ | ]2016 | D | Low grade PCA: Gleason 6; High-grade PCA: Gleason ≥7. | 250 | 2 | PC: 0.71; high-grade PC: 0.78 | Development of a model that incorporates PHI score | |||||||||
PBCG RC | |||||||||||||||||
North America and Europe | Ankerst, et al [ | ]2018 | D,C | Gleason ≥7, <7, or no cancer | 15,611 | 2 | 0.755 (0.742-0.768) | Compares AUC to PCPT RC | |||||||||
US | Carbunaru, et al [ | ]2019 | B,C | PC and significant PC | 954 | 2 | Significant PC: 0.65 (0.62-0.68) | ||||||||||
Next-generation PC RC | |||||||||||||||||
Canada | Nam, et al [ | ]2018 | D | Gleason ≥7 | 5639 patients with a prostate biopsy + 979 patients with PC | 2 | Model 1: concordance index 0.74 (0.72-0.76); model 2: concordance index 0.71 (0.69-0.72) | — | |||||||||
Seoul National University PC RC | |||||||||||||||||
South Korea | Jeong, et al [ | ]2014 | D,C | PC | 3482 | 2 | Development cohort: 0.786; validation cohort: 0.811 | Mobile app-based RC | |||||||||
Indonesian PC RC | |||||||||||||||||
Indonesia | Yuri, et al [ | ]2015 | D,C | Not specified | 1957 | 2 | 0.938 (0.93-0.95) | — | |||||||||
Korean PC RC | |||||||||||||||||
South Korea | Yoon, et al [ | ]2012 | D | Positive biopsy | 602 | 2 | 0.9 (0.89-0.92) | — | |||||||||
Unnamed model by Albright, et al | |||||||||||||||||
US | Albright, et al [ | ]2015 | D | PC | 635,433 | 2 | Not specified | Model uses extended detailed family history | |||||||||
Unnamed model by Loeb, et al | |||||||||||||||||
US | Loeb, et al [ | ]2017 | D | Gleason ≥7 | 892 | 1 | 0.746 | Development of a model that incorporates PHI score | |||||||||
Unnamed model by Kim, et al | |||||||||||||||||
South Korea | Kim, et al [ | ]2018 | D | ICD-10 code C61 | 1,179,172 for model development + 389,539 for model validation | 2 | 0.887 (0.879-0.895) | Based on epidemiologic factors rather than PSA | |||||||||
Unnamed model by Jalali, et al | |||||||||||||||||
Ireland | Jalali, et al [ | ]2020 | D,C | PC or high-grade PC | 4801 | 2 | PC: 0.674 (0.659-0.689); high-grade PC: 0.721 (0.701-0.741) | Calculator informs need for prostate biopsy | |||||||||
Unnamed model by Chen, et al | |||||||||||||||||
Taiwan | Chen, et al [ | ]2020 | A,D | PC or high-grade PC | 1545 | 2 | PC: 0.795; high-grade PC: 0.869 | App-based calculator |
aAUC: area under the curve.
bPCPT: Prostate Cancer Prevention Trial.
cRC: risk calculator.
dA: optimizes an existing model.
e1: clinical trial.
fPHI: prostate health index.
gB: calibrates and/or assesses discrimination of an existing model in a specific population.
h2: cohort.
iPC: prostate cancer.
jC: compares two or more existing models in a specific population.
kPBCG: Prostate Biopsy Collaborative Group.
lERSPC: European Randomized Study on Screening for Prostate Cancer.
mSABOR: San Antonio Center of Biomarkers of Risk for Prostate Cancer.
n3: case control.
oD: presents and validates a new model.
pPSA: prostate specific antigen.
qCPCC: Chinese Prostate Cancer Consortium.
rMUSIC: Michigan Urological Surgery Improvement Collaborative.
Risk factor and model | Author | Impact measure | P value | Notes | |
Age | |||||
ERSPCa RCb | Trottier, et al [ | ]Mean risk 0.31 | —c | Age >70 | |
PCPTd RC | Trottier, et al [ | ]Mean risk 0.53 | — | Age >70 | |
CPCCe RC model 1 | Chen, et al [ | ]ORf 1.074 (1.050-1.098) | <.001 | — | |
Unnamed model by Kim, et al | Kim, et al [ | ]HRg 1.26 (1.245-1.276) | <.001 | As “age-mean_age” | |
Korean PCh RC | Yoon, et al [ | ]OR 1.06 (1.04-1.08) | <.001 | — | |
Race | |||||
ERSPC RC | Trottier, et al [ | ]Mean risk 0.25 | — | Hispanic | |
PCPT RC | Kaplan, et al [ | ]HR 1.1 (0.58-2.08) | .76 | African American race | |
— | Trottier, et al [ | ]Mean risk 0.48 | — | Hispanic | |
Family history of PC | |||||
ERSPC RC | Trottier, et al [ | ]Mean risk 0.28 | — | — | |
PCPT RC | Kaplan, et al [ | ]HR 1.16 (0.60-2.25) | .67 | — | |
— | Trottier, et al [ | ]Mean risk 0.51 | — | — | |
— | Yuang, et al [ | ]OR 1.31 (1.11-1.55) | <.001 | — | |
Unnamed model by Liang Y, et al | Yuang, et al [ | ]OR 3.23 (1.89-5.54) | <.001 | — | |
PSAi | |||||
ERSPC RC | Trottier, et al [ | ]Mean risk 0.35 | — | >6 ng/mL | |
PCPT RC | Kaplan, et al [ | ]HR 5.42 (3.90-7.52) | — | As log PSA | |
— | Trottier, et al [ | ]Mean risk 0.56 | — | >6 ng/mL | |
— | Yuang, et al [ | ]OR 1.8 (1.46-2.21) | <.001 | As log PSA | |
CPCC RC model 1 | Chen, et al [ | ]OR 7.7219 (4.3644-13.6625) | <.001 | As log PSA | |
Korean PC RC | Yoon, et al [ | ]OR 4.31 (3.29-5.65) | <.001 | As log PSA | |
Unnamed model by Liang Y, et al | Yuang, et al [ | ]OR 2.34 (2.13-2.56) | <.001 | As log PSA | |
Free PSA | |||||
CPCC RC model 1 | Chen, et al [ | ]OR 0.015 (0.0016-0.1407) | <.001 | As free PSA ratio | |
Korean PC RC | Yoon, et al [ | ]OR 2.74 (2.12-3.40) | <.001 | As log free PSA | |
DRE [+]j | |||||
ERSPC RC | Trottier, et al [ | ]Mean risk 0.45 | — | — | |
PCPT RC | Kaplan, et al [ | ]HR 0.45 (0.16-1.24) | .12 | — | |
— | Trottier, et al [ | ]Mean risk 0.61 | — | — | |
— | Yuang, et al [ | ]OR 2.47 (2.03-3.01) | <.001 | — | |
CPCC RC model 1 | Chen, et al [ | ]OR 2.2031 (1.5268-3.1788) | <.001 | — | |
Unnamed model by Liang Y, et al | Yuang, et al [ | ]OR 4.22 (2.91-6.14) | <.001 | — | |
Korean PC RC | Yoon, et al [ | ]OR 8.22 (5.44-12.4) | <.001 | — | |
Previous biopsy | |||||
ERSPC RC | Trottier, et al [ | ]Mean risk 0.15 | — | — | |
PCPT RC | Kaplan, et al [ | ]HR 0.14 (0.05-0.37) | <.001 | Prior negative biopsy | |
— | Trottier, et al [ | ]Mean risk 0.45 | — | — | |
— | Yuang, et al [ | ]OR 0.64 (0.53-0.78) | <.001 | Prior negative biopsy | |
Unnamed model by Liang Y, et al | Yuang, et al [ | ]OR 0.13 (0.07-0.23) | <.001 | Prior negative biopsy | |
TRUk | |||||
ERSPC RC | Trottier, et al [ | ]Mean risk 0.2 | — | ≥42 mL | |
PCPT RC | Trottier, et al [ | ]Mean risk 0.49 | — | ≥42 mL | |
Korean PC RC | Yoon, et al [ | ]OR 4.05 (2.79-5.88) | — | — |
aERSPC: European Randomized Study on Screening for Prostate Cancer.
bRC: risk calculator.
cNot applicable.
dPCPT: Prostate Cancer Prevention Trial.
eCPCC: Chinese Prostate Cancer Consortium.
fOR: odds ratio.
gHR: hazard ratio.
hPC: prostate cancer.
iPSA: prostate specific antigen.
jDRE [+]: positive/altered digital rectal examination.
kTRU: transrectal ultrasound.
Discussion
Principal Findings
Our study’s most important findings were that most available risk prediction tools for prostate cancer are optimizations (ie, improvement of the predictive capacity of existing calculators) or recalibration (ie, applying an existing one to a different population) of the PCPT RC or ERSPC RC. Furthermore, some authors presented and validated a new calculator from scratch. Whatever the mechanism, all risk calculators that have been optimized, calibrated, or created with a specific population in mind seem to have adequately high prediction capabilities.
In our study, we have provided a comprehensive description of available risk calculators for prostate cancer and their predictive capability in healthy population. Due to the nature of prostate cancer; when, who, and even if, to screen, has always been a controversial topic. Before the PSA era, overdiagnosis and overtreatment were major concerns. Since the implementation of PSA screening, there has been a reported decrease of 53% in prostate cancer mortality in the United States. However, North American guidelines have shifted between their position to screen or not using PSA [
]. Furthermore, the recent introduction of novel serum-based models that complement PSA, such as the PHI, have improved the detection capability of clinically significant prostate cancer. A combination of several individual factors into a prediction model could more accurately predict cases of prostate cancer that need to be treated and reduce the number of unnecessary biopsies and their complications [ ].Although there have been recent improvements in detection of prostate cancer with the use of novel biomarkers and advanced imaging techniques, these are not widely available, especially in low- and middle-resource settings, and cannot be widely applicable at the primary level, which renders the use of reproducible predictive models based on data available at primary settings essential for decision making at a larger scale. Despite this, the two most commonly used models for predicting prostate cancer, the PCPT RC and ERSPC RC, were created and validated with North American and European populations and may not have the same predictive capabilities when applied as they are, in different populations. To further emphasize this, people of non-European ancestries make up less than 15% of the available genome-wide association study of prostate cancer [
]. However, our systematic review found numerous cases of calibration of these tools for different population with results similar to the originals. One of such examples is the external validation by Chen et al [ ] of the ERSPC RC in a Chinese cohort, in which they found an AUC of 0.74 for any prostate cancer and a similar AUC of 0.74 for high-grade prostate cancer, while also finding in the same cohort an AUC of 0.77 for any or high-grade prostate cancer using the Chinese Prostate Cancer Consortium (CPCC) RC. They thus concluded that an Asian-adapted ERSPC RC and application of the CPCC RC in a European PSA-based screening reduce unnecessary biopsies; however, they stress the need for external validation before implementing a risk calculator.Still, our review found that fewer than 10 of the included articles focused on calibrating these calculators on non-European or non–North American populations: most of them in Asia, 1 in South Africa, and 1 in Mexico. The underrepresentation of an ethnically diverse population for the calibration of these tools results in fewer available predictive models in the settings where they would be most beneficial. For example, the study by Liang et al [
] of the PCPT RC in a Mexican population resulted in an AUC of 0.785 for high-grade prostate cancer, even higher than the tool’s AUC when applied to European populations in other studies. Similarly, the calibration by Kowlessur et al [ ] of the ERSPC RC for a South African population resulted in a high AUC of 0.833 for high-grade prostate cancer. Knowing that these tools can be easily adapted and calibrated for populations in lower-resource settings could encourage researchers to adjust these calculators to settings that still struggle with the overperformance of invasive biopsies.Although the characteristics of the included studies did not allow for a meta-analysis of the individual risk factors or the tools’ overall predictive capabilities, it seems that both the ERSPC RC and PCPT RC have similarly high predictive capabilities. Zhu et al [
] reported an AUC of up to 0.813 for the PCPT RC in a Chinese cohort, and Gayet et al [ ] reported an AUC of 0.91 in the ERSPC RC in a Dutch cohort. Either of these calculators could be potentially adapted to new populations depending on the availability of transrectal ultrasound, which is one of the included items for calculating risk in the ERSPC RC that the PCPT RC does not include. In the end, it is not about determining which risk calculator is best but about making sure that whichever one is used is calibrated and adapted to its intended recipients. That is, the best calculator will be one that is accessible, valid, and reproducible.The creation of new tools targeted at new populations is also a valid alternative to calibrating existing ones, and this can also yield optimal results. For example, the calculator by Yuri et al [
] designed for an Indonesian population resulted in an AUC of 0.938 when using a simple list of 5 items. Similarly, the calculator by Kim et al [ ] designed for a South Korean population reached an AUC of 0.887 and focused on epidemiologic factors over serum markers.Limitations
Our study’s main limitation is that the nature of the included articles did not allow for the evaluation of bias as per the Cochrane manual. However, we find that the potential risk for bias is low as each author describes the specific way the calculators are calibrated. Its main strength is that it provides a comprehensive description of available risk calculators and how they can be successfully adapted for different target populations.
Conclusion
Although most existing risk calculators for prostate cancer were developed with European or North American populations, their calibration for populations in different settings leads to equally high predictive capacities and yields tools that could be used in resource-limited settings. Risk calculators that included multiple items should be used over prior techniques using markers alone in order to decrease unnecessary procedures in healthy populations at lower risk for prostate cancer. Although screening for prostate cancer remains a shared decision based on individual preference and apparent risk, the development and improvement of predictive tools could lead to optimal algorithms that consider patients’ greatest benefit and help for better allocation of health care resources.
Authors' Contributions
NRN and ABJ conceived and designed the trial. ABJ, FPH, and NRN reviewed extracted titles and abstracts. All authors extracted data from the included studies into the review proper. ABJ and NRN analyzed the data. ABJ wrote the manuscript. All authors critically reviewed the manuscript.
Conflicts of Interest
None declared.
References
- Sung H, Ferlay J, Siegel RL, Laversanne M, Soerjomataram I, Jemal A, et al. Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin 2021 Feb 04;71(3):209-249 [FREE Full text] [CrossRef] [Medline]
- Castillejos-Molina RA, Gabilondo-Navarro FB. Prostate cancer. Salud Publica Mex 2016 Apr;58(2):279-284. [CrossRef] [Medline]
- Wolf AMD, Wender RC, Etzioni RB, Thompson IM, D'Amico AV, Volk RJ, American Cancer Society Prostate Cancer Advisory Committee. American Cancer Society guideline for the early detection of prostate cancer: update 2010. CA Cancer J Clin 2010;60(2):70-98 [FREE Full text] [CrossRef] [Medline]
- Bokhorst LP, Bangma CH, van Leenders GJLH, Lous JJ, Moss SM, Schröder FH, et al. Prostate-specific antigen-based prostate cancer screening: reduction of prostate cancer mortality after correction for nonattendance and contamination in the Rotterdam section of the European Randomized Study of Screening for Prostate Cancer. Eur Urol 2014 Feb;65(2):329-336. [CrossRef] [Medline]
- Ilic D, O'Connor D, Green S, Wilt T. Screening for prostate cancer. Cochrane Database Syst Rev 2006 Jul 19(3):CD004720. [CrossRef] [Medline]
- Mohler JL, Antonarakis ES, Armstrong AJ, D'Amico AV, Davis BJ, Dorff T, et al. NCCN Clinical Practice Guidelines in Oncology: prostate cancer, version 2.2019. J Natl Compr Canc Netw 2019 May 01;17(5):479-505. [CrossRef] [Medline]
- Pereira-Azevedo N, Osório L, Fraga A, Roobol M. Rotterdam prostate cancer risk calculator: development and usability testing of the mobile phone app. JMIR Cancer 2017 Jan 06;3(1):e1 [FREE Full text] [CrossRef] [Medline]
- Roobol MJ, van Vugt HA, Loeb S, Zhu X, Bul M, Bangma CH, et al. Prediction of prostate cancer risk: the role of prostate volume and digital rectal examination in the ERSPC risk calculators. Eur Urol 2012 Mar;61(3):577-583. [CrossRef] [Medline]
- Ankerst DP, Hoefler J, Bock S, Goodman PJ, Vickers A, Hernandez J, et al. Prostate Cancer Prevention Trial risk calculator 2.0 for the prediction of low- vs high-grade prostate cancer. Urology 2014 Jun;83(6):1362-1367 [FREE Full text] [CrossRef] [Medline]
- Mottet N, Bellmunt J, Bolla M, Briers E, Cumberbatch MG, De Santis M, et al. EAU-ESTRO-SIOG guidelines on prostate cancer. Part 1: screening, diagnosis, and local treatment with curative intent. Eur Urol 2017 Dec;71(4):618-629. [CrossRef] [Medline]
- Poyet C, Nieboer D, Bhindi B, Kulkarni GS, Wiederkehr C, Wettstein MS, et al. Prostate cancer risk prediction using the novel versions of the European Randomised Study for Screening of Prostate Cancer (ERSPC) and Prostate Cancer Prevention Trial (PCPT) risk calculators: independent validation and comparison in a contemporary European cohort. BJU Int 2016 Mar;117(3):401-408. [CrossRef] [Medline]
- Study Book Originally designed for the Rotterdam section. European Randomized Study of Screening for Prostate Cancer (ERSPC). 1994. URL: http://www.erspc.org/wp-content/uploads/Study-protocol-ERSPC.pdf [accessed 2021-08-22]
- Ankerst DP, Boeck A, Freedland SJ, Thompson IM, Cronin AM, Roobol MJ, et al. Evaluating the PCPT risk calculator in ten international biopsy cohorts: results from the Prostate Biopsy Collaborative Group. World J Urol 2012 Apr;30(2):181-187 [FREE Full text] [CrossRef] [Medline]
- Parekh DJ, Ankerst DP, Higgins BA, Hernandez J, Canby-Hagino E, Brand T, et al. External validation of the Prostate Cancer Prevention Trial risk calculator in a screened population. Urology 2006 Dec;68(6):1152-1155. [CrossRef] [Medline]
- Kim SH, Kim S, Joung JY, Kwon W, Seo HK, Chung J, et al. Lifestyle risk prediction model for prostate cancer in a Korean population. Cancer Res Treat 2018 Oct;50(4):1194-1202 [FREE Full text] [CrossRef] [Medline]
- Albright F, Stephenson RA, Agarwal N, Teerlink CC, Lowrance WT, Farnham JM, et al. Prostate cancer risk prediction based on complete prostate cancer family history. Prostate 2015 Mar 01;75(4):390-398 [FREE Full text] [CrossRef] [Medline]
- Jalali A, Foley RW, Maweni RM, Murphy K, Lundon DJ, Lynch T, et al. A risk calculator to inform the need for a prostate biopsy: a rapid access clinic cohort. BMC Med Inform Decis Mak 2020 Jul 03;20(1):148 [FREE Full text] [CrossRef] [Medline]
- Loeb S, Shin SS, Broyles DL, Wei JT, Sanda M, Klee G, et al. Prostate Health Index improves multivariable risk prediction of aggressive prostate cancer. BJU Int 2017 Jul;120(1):61-68 [FREE Full text] [CrossRef] [Medline]
- Auffenberg GB, Merdan S, Miller DC, Singh K, Stockton BR, Ghani KR, et al. Evaluation of prostate cancer risk calculators for shared decision making across diverse urology practices in Michigan. Urology 2017 Jun;104:137-142. [CrossRef] [Medline]
- Lundon DJ, Kelly BD, Foley R, Loeb S, Fitzpatrick JM, Watson RWG, et al. Prostate cancer risk assessment tools in an unscreened population. World J Urol 2015 Jun;33(6):827-832. [CrossRef] [Medline]
- Poyet C, Wettstein MS, Lundon DJ, Bhindi B, Kulkarni GS, Saba K, et al. External evaluation of a novel prostate cancer risk calculator (ProstateCheck) based on data from the Swiss arm of the ERSPC. J Urol 2016 Nov;196(5):1402-1407 [FREE Full text] [CrossRef] [Medline]
- Ankerst DP, Straubinger J, Selig K, Guerrios L, De Hoedt A, Hernandez J, et al. A contemporary prostate biopsy risk calculator based on multiple heterogeneous cohorts. Eur Urol 2018 Aug;74(2):197-203 [FREE Full text] [CrossRef] [Medline]
- Kaplan DJ, Boorjian SA, Ruth K, Egleston BL, Chen DYT, Viterbo R, et al. Evaluation of the Prostate Cancer Prevention Trial Risk calculator in a high-risk screening population. BJU Int 2010 Feb;105(3):334-337 [FREE Full text] [CrossRef] [Medline]
- Cavadas V, Osório L, Sabell F, Teves F, Branco F, Silva-Ramos M. Prostate cancer prevention trial and European randomized study of screening for prostate cancer risk calculators: a performance comparison in a contemporary screened cohort. Eur Urol 2010 Oct;58(4):551-558. [CrossRef] [Medline]
- Grill S, Fallah M, Leach RJ, Thompson IM, Freedland S, Hemminki K, et al. Incorporation of detailed family history from the Swedish Family Cancer Database into the PCPT risk calculator. J Urol 2015 Feb;193(2):460-465 [FREE Full text] [CrossRef] [Medline]
- Trottier G, Roobol MJ, Lawrentschuk N, Boström PJ, Fernandes KA, Finelli A, et al. Comparison of risk calculators from the Prostate Cancer Prevention Trial and the European Randomized Study of Screening for Prostate Cancer in a contemporary Canadian cohort. BJU Int 2011 Oct;108(8 Pt 2):E237-E244 [FREE Full text] [CrossRef] [Medline]
- Carbunaru S, Nettey OS, Gogana P, Helenowski IB, Jovanovic B, Ruden M, et al. A comparative effectiveness analysis of the PBCG vs. PCPT risks calculators in a multi-ethnic cohort. BMC Urol 2019 Nov 27;19(1):121 [FREE Full text] [CrossRef] [Medline]
- Liang Y, Messer JC, Louden C, Jimenez-Rios MA, Thompson IM, Camarena-Reynoso HR. Prostate cancer risk prediction in a urology clinic in Mexico. Urol Oncol 2013 Oct;31(7):1085-1092 [FREE Full text] [CrossRef] [Medline]
- Nguyen CT, Yu C, Moussa A, Kattan MW, Jones JS. Performance of prostate cancer prevention trial risk calculator in a contemporary cohort screened for prostate cancer and diagnosed by extended prostate biopsy. J Urol 2010 Feb;183(2):529-533. [CrossRef] [Medline]
- Zhu Y, Wang J, Shen Y, Dai B, Ma C, Xiao W, et al. External validation of the Prostate Cancer Prevention Trial and the European Randomized Study of Screening for Prostate Cancer risk calculators in a Chinese cohort. Asian J Androl 2012 Sep;14(5):738-744 [FREE Full text] [CrossRef] [Medline]
- Liang Y, Ankerst DP, Feng Z, Fu R, Stanford JL, Thompson IM. The risk of biopsy-detectable prostate cancer using the prostate cancer prevention Trial Risk Calculator in a community setting. Urol Oncol 2013 Nov;31(8):1464-1469 [FREE Full text] [CrossRef] [Medline]
- Nam RK, Kattan MW, Chin JL, Trachtenberg J, Singal R, Rendon R, et al. Prospective multi-institutional study evaluating the performance of prostate cancer risk calculators. J Clin Oncol 2011 Aug 01;29(22):2959-2964. [CrossRef] [Medline]
- Liang Y, Ketchum NS, Louden C, Jimenez-Rios MA, Thompson IM, Camarena-Reynoso HR. The use of the finasteride-adjusted Prostate Cancer Prevention Trial Prostate Cancer Risk Calculator in a Mexican referral population: a validation study. Urol Int 2012;89(1):9-16. [CrossRef] [Medline]
- van Vugt HA, Roobol MJ, Kranse R, Määttänen L, Finne P, Hugosson J, et al. Prediction of prostate cancer in unscreened men: external validation of a risk calculator. Eur J Cancer 2011 Apr;47(6):903-909. [CrossRef] [Medline]
- Gayet M, Mannaerts CK, Nieboer D, Beerlage HP, Wijkstra H, Mulders PFA, et al. Prediction of prostate cancer: external validation of the ERSPC risk calculator in a Contemporary Dutch Clinical Cohort. Eur Urol Focus 2018 Mar;4(2):228-234. [CrossRef] [Medline]
- Kowlessur B, Phull M, Patel B, Henry M, Lazarus J. Validating the European randomised study for screening of prostate cancer (ERSPC) risk calculator in a contemporary South African cohort. World J Urol 2020 Jul;38(7):1711-1718. [CrossRef] [Medline]
- Gómez-Gómez E, Carrasco-Valiente J, Blanca-Pedregosa A, Barco-Sánchez B, Fernandez-Rueda JL, Molina-Abril H, et al. European randomized study of screening for prostate cancer risk calculator: external validation, variability, and clinical significance. Urology 2017 Apr;102:85-91. [CrossRef] [Medline]
- Chen R, Verbeek JFM, Yang Y, Song Z, Sun Y, Roobol MJ. Comparing the prediction of prostate biopsy outcome using the Chinese Prostate Cancer Consortium (CPCC) Risk Calculator and the Asian adapted Rotterdam European Randomized Study of Screening for Prostate Cancer (ERSPC) Risk Calculator in Chinese and European men. World J Urol 2021 Jan;39(1):73-80. [CrossRef] [Medline]
- van Vugt HA, Kranse R, Steyerberg EW, van der Poel HG, Busstra M, Kil P, et al. Prospective validation of a risk calculator which calculates the probability of a positive prostate biopsy in a contemporary clinical cohort. Eur J Cancer 2012 Aug;48(12):1809-1815. [CrossRef] [Medline]
- Roobol MJ, Vedder MM, Nieboer D, Houlgatte A, Vincendeau S, Lazzeri M, et al. Comparison of two prostate cancer risk calculators that include the prostate health index. Eur Urol Focus 2015 Sep;1(2):185-190. [CrossRef] [Medline]
- Chen R, Xie L, Xue W, Ye Z, Ma L, Gao X, Chinese Prostate Cancer Consortium. Development and external multicenter validation of Chinese Prostate Cancer Consortium prostate cancer risk calculator for initial prostate biopsy. Urol Oncol 2016 Sep;34(9):416-417. [CrossRef] [Medline]
- Foley RW, Gorman L, Sharifi N, Murphy K, Moore H, Tuzova AV, et al. Improving multivariable prostate cancer risk assessment using the Prostate Health Index. BJU Int 2016 Mar;117(3):409-417. [CrossRef] [Medline]
- Nam RK, Satkunavisam R, Chin JL, Izawa J, Trachtenberg J, Rendon R, et al. Next-generation prostate cancer risk calculator for primary care physicians. Can Urol Assoc J 2018 Feb 01;12(2):E64-E70 [FREE Full text] [CrossRef] [Medline]
- Jeong CW, Lee S, Jung J, Lee BK, Jeong SJ, Hong SK, et al. Mobile application-based Seoul National University Prostate Cancer Risk Calculator: development, validation, and comparative analysis with two Western risk calculators in Korean men. PLoS One 2014;9(4):e94441 [FREE Full text] [CrossRef] [Medline]
- Yuri P, Wangge G, Abshari F, Satjakoesoemah A, Perdana N, Wijaya C, et al. Indonesian prostate cancer risk calculator (IPCRC): an application for predicting prostate cancer risk (a multicenter study). Acta Med Indones 2015 Apr;47(2):95-103 [FREE Full text] [Medline]
- Yoon DK, Park JY, Yoon S, Park MS, Moon DG, Lee JG, et al. Can the prostate risk calculator based on Western population be applied to Asian population? Prostate 2012 May 15;72(7):721-729. [CrossRef] [Medline]
- Chen IHA, Chu C, Lin J, Tsai J, Yu C, Sridhar AN, et al. Comparing a new risk prediction model with prostate cancer risk calculator apps in a Taiwanese population. World J Urol 2021 Mar 20;39(3):797-802. [CrossRef] [Medline]
- Catalona WJ. Prostate cancer screening. Med Clin North Am 2018 Mar;102(2):199-214 [FREE Full text] [CrossRef] [Medline]
- Tan GH, Nason G, Ajib K, Woon DTS, Herrera-Caceres J, Alhunaidi O, et al. Smarter screening for prostate cancer. World J Urol 2019 Jun;37(6):991-999. [CrossRef] [Medline]
- Fiorica PN, Schubert R, Morris JD, Abdul Sami M, Wheeler HE. Multi-ethnic transcriptome-wide association study of prostate cancer. PLoS One 2020;15(9):e0236209 [FREE Full text] [CrossRef] [Medline]
Abbreviations
AUC: area under the curve |
CPCC: Chinese Prostate Cancer Consortium |
DRE: digital rectal examination |
ERSPC: European Randomized Study on Prostate Cancer |
MRI: magnetic resonance imaging |
PCPT: Prostate Cancer Prevention Trial |
PHI: Prostate Health Index |
PSA: prostate specific antigen |
RC: risk calculator |
Edited by D Vollmer Dahlke; submitted 13.05.21; peer-reviewed by C Bonner, J Walsh, K Zhai, C Choi, P Banik; comments to author 07.07.21; revised version received 12.07.21; accepted 28.07.21; published 03.09.21
Copyright©Antonio Bandala-Jacques, Kevin Daniel Castellanos Esquivel, Fernanda Pérez-Hurtado, Cristobal Hernández-Silva, Nancy Reynoso-Noverón. Originally published in JMIR Cancer (https://cancer.jmir.org), 03.09.2021.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Cancer, is properly cited. The complete bibliographic information, a link to the original publication on https://cancer.jmir.org/, as well as this copyright and license information must be included.