Development and validation of risk score for predicting positive repeat prostate biopsy in patients with a previous negative biopsy in a UK population
© Rochester et al; licensee BioMed Central Ltd. 2009
Received: 03 March 2009
Accepted: 16 July 2009
Published: 16 July 2009
Little evidence is available to determine which patients should undergo repeat biopsy after initial benign extended core biopsy (ECB). Attempts have been made to reduce the frequency of negative repeat biopsies using PSA kinetics, density, free-to-total ratios and Kattan's nomogram, to identify men more likely to harbour cancer but no single tool accurately predicts biopsy outcome. The objective of this study was to develop a predictive nomogram to identify men more likely to have a cancer diagnosed on repeat prostate biopsy.
Patients with previous benign ECB undergoing repeat biopsy were identified from a database. Association between age, volume, stage, previous histology, PSA kinetics and positive repeat biopsy was analysed. Variables were entered stepwise into logistic regression models. A risk score giving the probability of positive repeat biopsy was estimated. The performance of this score was assessed using receiver characteristic (ROC) analysis.
110 repeat biopsies were performed in this period. Cancer was detected in 31% of repeat biopsies at Hospital (1) and 30% at Hospital (2). The most accurate predictive model combined age, PSA, PSA velocity, free-to-total PSA ratio, prostate volume and digital rectal examination (DRE) findings. The risk model performed well in an independent sample, area under the curve (AUCROC) was 0.818 (95% CI 0.707 to 0.929) for the risk model and 0.696 (95% CI 0.472 to 0.921) for the validation model. It was calculated that using a threshold risk score of > 0.2 to identify high risk individuals would reduce repeat biopsies by 39% while identifying 90% of the men with prostate cancer.
An accurate multi-variable predictive tool to determine the risk of positive repeat prostate biopsy is presented. This can be used by urologists in an outpatient setting to aid decision-making for men with prior benign histology for whom a repeat biopsy is being considered.
The majority of the 35000 new diagnoses of prostate cancer annually in the UK  are made as a result of transrectal ultrasound-guided (TRUS) biopsies of the prostate performed to investigate an elevated serum PSA or abnormal digital rectal examination. Seventy-five percent of cancers identified are detected at the first biopsy . The majority of men undergoing this procedure, however, will not have a cancer detected and doubt will remain both in their minds and in those of the clinician as to whether a further biopsy is required in the setting of a persistently abnormal or rising serum PSA. Prostate biopsy is not without morbidity  carrying a 1% risk of sepsis or severe haemorrhage, and 5% risk of urinary tract infection, and the need to reduce unnecessary repeat biopsies was further highlighted recently in the UK with the publication of NICE guidelines for prostate cancer . This document estimated that 89000 prostate biopsies are performed annually in the UK. Twenty percent of cancers are detected at the second biopsy session , and a number of parameters have been promoted to reduce the frequency of benign repeat biopsy. Abnormal digital rectal examination (DRE) , PSA , PSA velocity > 0.75 ng/ml/yr , PSA density > 0.15 [5, 7] transition zone density > 0.25 [5, 8], and free-to-total PSA ratio [5, 7], as well as initial histological findings of high grade prostatic intraepithelial neoplasia (HGPIN) [6, 8] or suspicious histology  have all been used to identify those men at higher risk of positive repeat biopsy. These individual parameters when taken alone, have poor positive and negative predictive value . Kattan has produced a number of predictive nomograms to aid decision making in prostate cancer , including one intended to enhance prediction of positive repeat biopsies, based on sextant prostate biopsy data . It was suggested that the model could be improved through adding free-to-total PSA ratio and prostate volume to the calculation. The aim of this study was to use a similar approach for a United Kingdom population in order to produce a more accurate predictive tool to be used in the outpatient setting when faced with a patient who may be a candidate for a second TRUS and biopsy of the prostate.
All patients who underwent first repeat prostate biopsy sessions at two hospitals in the former West Anglia Cancer Network with a combined catchment population of more that 1.25 million were studied. Those who had an initial negative biopsy were analysed. Indications for repeat biopsy and the number of biopsy cores taken were similar in both hospitals according to local guidelines, with an extended core biopsy template (at least 10 cores including anterior horn of the peripheral zone). Prostate biopsies were performed using TRUS guidance with a 7.5 MHz probe (B&K), biopsy gun (Bard) and an 18 gauge biopsy needle with local anesthesia.
The clinical parameters recorded for each patient were age, serum PSA, PSA velocity in ng/ml/year (measured over 18 months), prostate volume, DRE findings, time interval between biopsy sessions, and history of HGPIN or suspicious histology. Data was collected from an anonymised database. Research was carried out in compliance with the Helsinki Declaration.
Developing the risk score
This was based on data obtained from patients undergoing repeat biopsy at Hospital (1) in the former West Anglia Cancer Network during 2007. Using univariate analysis, the association between the study variables (age, prostate volume, DRE findings (clinically benign referred to as stage 1, and a palpable abnormality stage 2), previous suspicious biopsy, previous high grade PIN, PSA, free-to-total PSA, PSA density, PSA velocity) and the outcome of repeat biopsy was studied. These variables were subsequently entered stepwise into logistic regression models. For each model, the mean probability of having a positive repeat biopsy was estimated for each individual. These results were compared with the true status and the coefficients from the model that best discriminated between positive and negative biopsy were used to estimate the risk score. Risk factors that were not statistically significant predictors of positive repeat biopsy were also included into the risk predictor model and to the risk score estimation as this could increase predictive power. Although DRE findings and previous HGPIN did not increase the predictive power of the statistical model, they were included in the risk score calculations as a consequence of their assumed clinical importance.
Probability of positive repeat biopsy was estimated as the expit (α + β 1 x 1 + β 2 x 2 ... β n x n ) of the model where, β represents the coefficient and x the variable used in the risk score: age at biopsy, previous HGPIN, DRE findings, volume of the prostate, serum level of PSA and free-to-total PSA, and PSA velocity. The risk score was calculated for each subject with no missing data points in the selected risk factors.
To assess performance of the risk score with respect to predicting positive repeat biopsy, receiver operating characteristic (ROC) curves were plotted for the risk scores. The area under the curve (AUC) and 95% confidence intervals (CI) were then estimated. A larger area under the ROC curve reflects better performance of a diagnostic test. Sensitivity, specificity, and positive (PPV) and negative predictive values (NPV) and their 95% CI were calculated for various cut-off points of the calculated risk score. The sensitivity of the risk score is the proportion of men with prostate cancer correctly identified as such by the risk score (percentage true positives). The specificity of the risk score is the proportion of men without prostate cancer who are correctly identified as such by the risk score (percentage true negatives). The positive predictive value of the risk score is the proportion of men with a positive result on the risk score who indeed have prostate cancer identified on biopsy.
Analyses were performed using the statistics package Stata 9. (Stata Corp. Stata Statistical Software: release 9. 2005. Texas: Stata Corporation)
Testing the risk score
The performance of the risk score in predicting prostate cancer diagnosis on repeat biopsy was evaluated in an independent sample of patients who had their repeat prostate biopsy at Hospital (2) in the former West Anglia Cancer Network.
The risk score for each subject was calculated. The scores were tested for sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) in differentiating men with and without prostate cancer diagnosis on repeat biopsy.
Developing the risk score -Hospital (1)
B Repeat prostate biopsy outcome and patient and prostate related factors, Hospital (1) sample
Prostate cancer detected
Prostate cancer not detected
No of patients
No of patients
N = 27
N = 59
Mean Age (years)
Prostate volume (ml)
Free-to-total PSA (%)
Adjusted β-coefficients and 95% confidence intervals for each risk factor, Hospital (1) sample
A model that included the variables age, DRE findings, previous HGPIN, volume of the prostate gland, serum levels of PSA and free/total PSA, and PSA velocity had a probability of predicting prostate cancer of 51% compared to 24% in predicting absence of cancer on prostate repeat biopsy.
The coefficients obtained from the logistic regression model are shown in Table 2.
Sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV) and 95% confidence intervals (CI) at different risk score cut points, Hospital (1) sample
Risk score cut point
Validation of the risk score
The association between the outcome of prostate biopsy and patient and prostate related factors, Hospital (2) sample
Prostate cancer detected
Prostate cancer not detected
No of patients
No of patients
N = 7
N = 16
Free/total PSA (%)
Clinicians use various triggers for proceeding to repeat prostate biopsies. Serum PSA, (which may be age-adjusted), age, DRE findings, free-to-total PSA ratio, transition zone PSA density, standard PSA density, PSA velocity and the finding of HGPIN on initial biopsy have all been used in this setting [1–5].
The predictive value of these individual factors is limited, however, and this has led to attempts to refine the prediction process and reduce the frequency of unnecessary repeat biopsies. Artificial neural networks and nomograms have been used to this end [11–14] but have not gained wide acceptance in clinical practice.
The detection rate of cancer on second and further biopsies is thought to be lower than the initial procedure. Kattan's group showed that the rate decreased from 19.5% in the second biopsy to 13.5% after 5 or more biopsy sessions . This data and previous studies were, however, based on initial sextant biopsies. In our study, the rate of positive biopsies remained steady at 30%, and the distribution of cancer grade did not change suggesting that even in the era of extended core prostate biopsies initial benign biopsies do not preclude a diagnosis of significant cancer on subsequent investigation.
Identifying those men who require repeat biopsy whilst avoiding unnecessary biopsies is not straightforward. Djavan found that free-to-total PSA ratio and transition zone PSA density were useful predictive factors with AUCs of 74% and 69% . Keetch et al have shown PSA density and PSA velocity to be better predictors  suggesting that using more than one variable in determining further biopsy is beneficial, but that the ideal combination is unknown.
The Kattan nomogram included a selection of risk factors that can predict the presence of cancer, and this model was validated in a second repeat biopsy population with an AUC of 71% .
Gallo  and Akhavan  have recently questioned the predictive value of HGPIN in repeat biopsy, and our model supports this view, as adding this variable to the regression model did not increase the accuracy of prediction. However, other authors have suggested that the finding of multifocal HGPIN should be viewed with more suspicion .
Kattan showed that incorporating multiple variables can vastly improve on the predicted probability of having prostate cancer . We have adapted this approach to the extended core repeat prostate biopsy population in a UK setting, and improved the accuracy through adding the additional variables of prostate volume and free-to-total PSA ratio.
This nomogram (AUC 0.82, 95%CI 0.71 – 0.93) performed favourably when compared with Kattan's which had an AUC of 0.75. This may be a result of the incorporation of additional variables to the model. This predictive tool is based on men who present either with symptoms, or as a result of opportunistic screening. Whether this predictive tool is applicable to a setting where PSA testing for screening purposes is more widely available needs to be investigated. This model has been internally validated, but re-validation on external populations should be the next step.
The decision to repeat a prostate biopsy must be made after informed discussion between clinician and patient, following a multi-disciplinary team meeting case discussion. A nomogram can aid decision making in this setting. The probability of cancer on repeat biopsy generated by this predictive tool reflects the probability that a man with the same clinical parameters investigated in the same manner as those included in this retrospective analysis would have a positive repeat biopsy. This figure will be interpreted by the patient according to his perception of risk to inform his choice. A precise cut-off to trigger a repeat biopsy is difficult to produce, and will vary according to an individual patient's and urologist's perception of risk, however, using a calculated risk score threshold for re-biopsy of 0.45 (sensitivity 70%, specificity 83%) would reduce the number of unnecessary biopsies in this study (absolute reduction 69%) while identifying 65% of the cancers. Alternatively a more conservative approach using a risk-score threshold for biopsy of > 0.2 would reduce the number of biopsies by 39% while identifying 90% of patients with cancer. As such this study has policy implications. Implementing such a threshold risk score to trigger repeat biopsy could reduce the number of repeat biopsies in the UK by up to 4100 per year, equating to a saving of €1.25 million, prevention of 40 life-threatening hospital admissions for urinary sepsis, and 200 fewer urinary tract infections.
Strengths of the study
The risk prediction model and the validation are based on a small sample size. Nevertheless, the model had high predictive accuracy of 82% and has been validated on a small external sample. This is a pilot model pending further work on a larger sample size from different regions of the UK. Repeat prostate biopsy is clearly not performed on all patients and as such a true sensitivity and specificity for the test are impossible to determine. Patients were filtered through clinical judgement. However, as the data are derived over a short period of time, then clinical decision and investigation are likely to be comparable among the patients undertaking repeat biopsy.
This tool is not designed to replace clinical judgement. Once biopsy is considered, the tool will assist in informed decision making.
We have developed a web-based predictive tool for a UK population which is comparable to previous published predictive nomograms to aid decision-making in men with persistently abnormal PSA who are considering a repeat prostate biopsy. Using such risk score prediction model in clinical practice, could help in forming a strategy for reducing the number of unnecessary repeat biopsies.
The authors are grateful to Mr Chris Kelly, University of Cambridge School of Clinical Medicine, for his assistance with the creation of the web-based predictive tool.
- Cancer Research UK: UK Prostate Cancer incidence statistics. Incidence UK, [http://info.cancerresearchuk.org/cancerstats/types/prostate/incidence/]
- Djavan B, Margreiter M: Biopsy standards for detection of prostate cancer. World J Urol. 2007, 25 (1): 11-7. 10.1007/s00345-007-0151-1.View ArticlePubMedGoogle Scholar
- Rodriguez LV, Terris MK: Risks and complications of transrectal ultrasound guided prostate needle biopsy: a prospective study and review of the literature. J Urol. 1998, 160 (6 Pt 1): 2115-20.PubMedGoogle Scholar
- Graham J, Baker M, Macbeth F, Titshall V: Diagnosis and treatment of prostate cancer: summary of NICE guidance. Bmj. 2008, 336 (7644): 610-2. 10.1136/bmj.39498.525706.AD.View ArticlePubMedPubMed CentralGoogle Scholar
- Djavan B, Zlotta A, Remzi M, Ghawidel K, Basharkhah A, Schulman CC, Marberger M: Optimal predictors of prostate cancer on repeat prostate biopsy: a prospective study of 1,051 men. J Urol. 2000, 163 (4): 1144-8. 10.1016/S0022-5347(05)67711-7. discussion 1148–9.View ArticlePubMedGoogle Scholar
- Eggener SE, Roehl KA, Catalona WJ: Predictors of subsequent prostate cancer in men with a prostate specific antigen of 2.6 to 4.0 ng/ml and an initially negative biopsy. J Urol. 2005, 174 (2): 500-4. 10.1097/01.ju.0000165203.40973.0f.View ArticlePubMedGoogle Scholar
- Fowler JE, Bigler SA, Miles D, Yalkut DA: Predictors of first repeat biopsy cancer detection with suspected local stage prostate cancer. J Urol. 2000, 163 (3): 813-8. 10.1016/S0022-5347(05)67810-X.View ArticlePubMedGoogle Scholar
- Singh H, Canto EI, Shariat SF, Kadmon D, Miles BJ, Wheeler TM, Slawin KM: Predictors of prostate cancer after initial negative systematic 12 core biopsy. J Urol. 2004, 171 (5): 1850-4. 10.1097/01.ju.0000119667.86071.e7.View ArticlePubMedGoogle Scholar
- Montironi R, Scattoni V, Mazzucchelli R, Lopez-Beltran A, Bostwick DG, Montorsi F: Atypical foci suspicious but not diagnostic of malignancy in prostate needle biopsies (also referred to as "atypical small acinar proliferation suspicious for but not diagnostic of malignancy"). Eur Urol. 2006, 50 (4): 666-74. 10.1016/j.eururo.2006.07.048.View ArticlePubMedGoogle Scholar
- Kattan MW, Scardino PT: Evidence for the usefulness of nomograms. Nat Clin Pract Urol. 2007, 4 (12): 638-9. 10.1038/ncpuro0968.View ArticlePubMedGoogle Scholar
- Lopez-Corona E, Ohori M, Scardino PT, Reuter VE, Gonen M, Kattan MW: A nomogram for predicting a positive repeat prostate biopsy in patients with a previous negative biopsy session. J Urol. 2003, 170 (4 Pt 1): 1184-8. 10.1097/01.ju.0000087451.64657.fa. discussion 1188.View ArticlePubMedGoogle Scholar
- Carlson GD, Calvanese CB, Partin AW: An algorithm combining age, total prostate-specific antigen (PSA), and percent free PSA to predict prostate cancer: results on 4298 cases. Urology. 1998, 52 (3): 455-61. 10.1016/S0090-4295(98)00205-2.View ArticlePubMedGoogle Scholar
- Djavan B, Remzi M, Zlotta A, Seitz C, Snow P, Marberger M: Novel artificial neural network for early detection of prostate cancer. J Clin Oncol. 2002, 20 (4): 921-9. 10.1200/JCO.20.4.921.View ArticlePubMedGoogle Scholar
- Yanke BV, Gonen M, Scardino PT, Kattan MW: Validation of a nomogram for predicting positive repeat biopsy for prostate cancer. J Urol. 2005, 173 (2): 421-4. 10.1097/01.ju.0000150522.82760.00.View ArticlePubMedGoogle Scholar
- Keetch DW, Catalona WJ, Smith DS: Serial prostatic biopsies in men with persistently elevated serum prostate specific antigen values. J Urol. 1994, 151 (6): 1571-4.PubMedGoogle Scholar
- Gallo F, Chiono L, Gastaldi E, Venturino E, Giberti C: Prognostic Significance of High-Grade Prostatic Intraepithelial Neoplasia (HGPIN): Risk of Prostatic Cancer on Repeat Biopsies. Urology. 2008, 72 (3): 628-32. 10.1016/j.urology.2007.11.115.View ArticlePubMedGoogle Scholar
- Akhavan A, Keith JD, Bastacky SI, Cai C, Wang Y, Nelson JB: The proportion of cores with high-grade prostatic intraepithelial neoplasia on extended-pattern needle biopsy is significantly associated with prostate cancer on site-directed repeat biopsy. BJU Int. 2007, 99 (4): 765-9. 10.1111/j.1464-410X.2006.06681.x.View ArticlePubMedGoogle Scholar
- Schoenfield L, Jones JS, Zippe CD, Reuther AM, Klein E, Zhou M, Magi-Galluzzi C: The incidence of high-grade prostatic intraepithelial neoplasia and atypical glands suspicious for carcinoma on first-time saturation needle biopsy, and the subsequent risk of cancer. BJU Int. 2007, 99 (4): 770-4. 10.1111/j.1464-410X.2006.06728.x.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2490/9/7/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.