Effects of surgeon variability on oncologic and functional outcomes in a population-based setting
© Carlsson et al.; licensee BioMed Central Ltd. 2014
Received: 23 July 2013
Accepted: 27 February 2014
Published: 6 March 2014
Oncologic and functional outcomes after radical prostatectomy (RP) can vary between surgeons to a greater extent than is expected by chance. We sought to examine the effects of surgeon variation on functional and oncologic outcomes for patients undergoing RP for prostate cancer in a European center.
The study comprised 1,280 men who underwent open retropubic RP performed by one of nine surgeons at an academic institution in Sweden between 2001 and 2008. Potency and continence outcomes were measured preoperatively and 18 months postoperatively by patient-administered questionnaires. Biochemical recurrence (BCR) was defined as a prostate-specific antigen (PSA) value > 0.2 ng/mL with at least one confirmatory rise. Multivariable random effect models were used to evaluate heterogeneity between surgeons, adjusting for case mix (age, PSA, pathological stage and grade), year of surgery, and surgical experience.
Of 679 men potent at baseline, 647 provided data at 18 months with 122 (19%) reporting potency. We found no evidence for heterogeneity of potency outcomes between surgeons (P = 1). The continence rate for patients at 18 months was 85%, with 836 of the 979 patients who provided data reporting continence. There was statistically significant heterogeneity between surgeons (P = 0.001). We did not find evidence of an association between surgeons’ adjusted probabilities of functional recovery and 5-year probability of freedom from BCR.
Our data support previous studies regarding a large heterogeneity among surgeons in continence outcomes for patients undergoing RP. This indicates that some patients are receiving sub-optimal care. Quality assurance measures involving performance feedback, should be considered. When surgeons are aware of their outcomes, they can improve them to provide better care to patients.
KeywordsProstate cancer Radical prostatectomy Erectile function Urinary function
Radical prostatectomy (RP) with curative intent is the most common treatment for men with localized prostate cancer . A prospective, randomized Swedish trial demonstrated that surgery provides a survival benefit in men with mainly clinically diagnosed, palpable tumors when compared to watchful waiting . However, surgical treatment is associated with long-term morbidity, mainly erectile dysfunction (ED) and urinary incontinence, which affect a patient’s quality of life (QoL) substantially [3, 4].
Previous studies performed in high-volume referral centers in the United States (US) have shown that both oncologic  and functional outcomes [6, 7] after RP vary between surgeons to a greater extent than is expected by chance. In the present validation study, we sought to explore whether such heterogeneity exists in long-term functional and oncologic outcomes among surgeons in a European center who operate in a population-based academic setting. Another rationale for the present study is that there is limited data on variability in patient-reported outcomes (PRO). Therefore, the present study provides a unique opportunity to explore any variability in outcomes as assessed by validated PRO instruments.
The original database consisted of 1,447 men who were scheduled for open retropubic RP at Sahlgrenska University Hospital in Göteborg, Sweden, during the study period 2001–2008, when standardized data recording into a quality assurance database was performed.
The quality control program was approved by the Ethical Committee at Göteborg University in 2001. Patients were mailed questionnaires, a cover letter with information regarding the quality assurance program, and a statement of voluntary participation in the study.
Of the 58 patients excluded, 38 were enrolled in another clinical RP trial (LAPPRO) , 4 underwent surgery outside the university hospital, 7 did not undergo surgery (with 4 switching to radiotherapy and 3 receiving hormonal therapy), and 9 did not undergo surgery but may have had surgery elsewhere for unknown reasons (moved or loss-to-follow-up). This left 1,389 patients in the cohort. Surgery dates ranged from Jan 2, 2001 through July 16, 2008.
Biochemical recurrence (BCR) post-prostatectomy was defined as a prostate-specific antigen (PSA) value > 0.2 ng/mL with at least one confirmatory rise. Measurements were obtained from medical charts.
Of 1,389 patients, an additional 109 were excluded from analysis since they were never administered any questionnaires, leaving 1,280 patients available for analysis of functional outcomes. Patients responded to questionnaires regarding continence and potency on 4 occasions, approximately 2 weeks preoperatively and at 6, 18, and 36 months after surgery.
Patients were administered questionnaires assessing urinary continence using pads . Continence was defined as no leakage or occasional leakage associated with physical activity requiring sporadic use of pads (score 0–1 on a 0–4 point scale, where 2–4 implies incontinence with regular use of pads).
Erectile function was assessed by the standardized International Index of Erection Function questionnaire IIEF-5 . The IIEF-5 score consists of 5 items with 6 responses. The total score is the sum of the 5 items and ranges from 5–25, the higher the score the better potency. For patients missing responses for an item, the sum of the remaining items was used. Potency was defined as an IIEF-5 score of ≥ 17, which corresponds to Rosen et al.’s categorization of mild ED (17–21) and no ED (22–25) . This also makes our study comparable to functional outcomes reported in an earlier study by Vickers et al. where postoperative potency was defined as 1 = normal, full erections and 2 = full, but diminished erections .
Missing data on potency status (potent/impotent) and continence (incontinent/continent) at 18 months were imputed following an algorithm assuming that few men regain and then lose function as well as that recovery of function can occur beyond 18 months. If a patient was missing a questionnaire at 18 months but reported potency at 6 months, he was assumed to be potent at 18 months. Comparably, a patient reporting impotence at 6 and 36 months was considered impotent at 18 months. A similar approach was used for the continence endpoint.
Patients reporting use of alprostadil injections for erectile aid were categorized as impotent (3 men preoperatively, 222 men at 18 months, and 198 men at 36 months). Men reporting use of PDE5-inhibitors were included in the analysis.
Data on a total of 25 individual surgeons working at the hospital during the study period were included in the database. We analyzed patient-reported functional outcomes for 9 surgeons who performed ≥ 20 surgeries during the study period. Data for these surgeons were entered both as random and fixed effects.
Logistic regression models were adjusted for age at surgery, PSA at diagnosis, pathologic stage (pT0, pT2, pT3), pathologic Gleason score (≤ 6, 7, ≥ 8), year of surgery, and surgical experience. We defined surgical experience as a variable that took into account both the surgeon’s prior experience, i.e., number of RPs before 2001, and the annual number of prostatectomies performed during the study period . To statistically test for heterogeneity, a random effect following an inverse Gaussian distribution was included in the model.
The logistic regression model used to predict the probability of potency at 18 months was restricted to men who were potent preoperatively and also adjusted for the IIEF-5 score as a continuous variable. The model for continence at 18 months was restricted to men who were continent preoperatively. Since there have been changes in patient characteristics as well as operative technique, we also included year of surgery as a covariate. Nerve sparing status was not included in the model since it is a surgical decision. Take the case of two surgeons, one of whom only spared nerves if the cancer was very low risk and accordingly resected far from the neurovascular bundles, the other of whom only resected nerves for advanced disease. Overall, the former surgeon would have far lower potency rates, but adjusting for nerve sparing would lead to higher apparent rates.
A log-logistic distributed parametric regression survival model was used to model BCR rates following adjustment for the same covariates as for functional outcomes. To statistically test for heterogeneity, a shared frailty survival model was fitted.
For each surgeon studied, forest plots were created for the adjusted predicted probability of potency and continence, respectively, using the mean value for the covariates from the fixed regression model with a 95% confidence interval.
A scatter plot was created for adjusted rates of continence and potency with the size of each surgeon’s data point proportional to the number of RPs (prior experience and during the study period) performed by each surgeon. Spearman’s rank correlation was applied to test the correlation between surgeons’ adjusted probabilities of potency and continence at 18 months as well as BCR.
Statistical analyses were performed using Stata v. 12.0 (Stata Corp, College Station, TX, USA).
Clinical characteristics for all patients who underwent radical prostatectomy
All patients N = 1,280
Age at surgery, median years (IQR)
PSA at diagnosis, median (IQR) ng/mL (Missing n=3)
Follow-up for biochemical recurrence, median years (IQR)
Pathological Gleason score (Missing n=2)
No tumor found
Nerve-sparing surgery (Missing n=3)
Surgical margins (Missing n=5)
Seminal vesicle invasion (Missing n=16)
Pathological stage (Missing n=7)
Preoperative erectile function (Missing n=241)
Postoperative erectile function at 18 months (Missing n=633)
Preoperative urinary function (Missing n=202)
Postoperative urinary function at 18 months (Missing n=301)
Unadjusted functional outcome rates per surgeon (among preoperatively potent and continent men) in relation to prior experience and number of cases performed during study period
Prior experience, number of RPs performed before study (n)
Number of cases during study period (n)
Potent at 18 months, n (%)
Impotent at 18 months, n (%)
Missing potency information at 18 months, n (%)
Continent at 18 months, n (%)
Incontinent at 18 months, n (%)
Missing continence information at 18 months, n (%)
Regarding functional outcomes, a total of 1,039 men responded to the IIEF-5 questionnaire, with 679 reporting being potent preoperatively (65%). Data were available for 647 (95%) patients at 18 months with 122 (19%) reporting potency (without alprostadil).
Crude potency rates at 18 months were higher for men who underwent bilateral nerve-sparing RP (31.8%) and for those < 60 years of age (45.7%) (data not shown).
Of the 1,078 patients who responded preoperatively to the continence question, 25 were considered incontinent (2%). Of the 979 (91%) patients responding at 18 months, 836 were continent (85%). The degrees of incontinence at 18 months among preoperatively continent men were as follows: never urinary leakage (39.0%), sometimes urinary leakage when coughing, sneezing or performing physical exercise with sporadic use of pads (46.4%), regular use of pads but they are not always wet (9.4%), regular use of pads that are wet (3.3%), and constant urinary leakage (1.7%).
Postoperatively, the 5-year probability of freedom from BCR adjusted for case mix was 86%. We observed a weak and non-significant association between surgeons’ adjusted probabilities of functional recovery (i.e., both potent and continent) and 5-year probability of freedom from BCR (P = 0.9) (Figure 2B). The present findings were not altered when the correlation between functional recovery and BCR was assessed separately; continence and potency, respectively (Figure 2C and 2D).
In the present validation study, we explored whether heterogeneity in long-term functional outcomes in a European academic center is comparable to that previously reported in a very high-volume referral center in the US . Our data confirms prior studies on the existence of surgeon heterogeneity for continence, but not for potency [5–7].
Continence rates were similar when comparing our present study to the Vickers et al. study in which 1,910 patients were treated with RP by 1 of 11 surgeons between 1997 and 2007 at a high-volume US referral center , with a rate of 85% at 18 months vs. 83% at 12 months, respectively. However, potency rates were lower in the present study, with a rate of 19% at 18 months compared to 43% at 12 months in Vickers et al. Overall, the rate of impotence at 18 months postoperatively was high in the present study, with less than two-thirds of patients being potent preoperatively. The lower rate of potency is most plausibly explained by the fact that the men in this study were considerably older, with a median age of 64 years, as compared to the median age of 58 years in the Vickers et al. study. Another possible explanation is that the study cohort was derived from a population-based sample in an area where active surveillance is frequently used, implying that only the most aggressive tumors are treated; this likely results in more advanced tumor features leading to more radical surgery with wider resection and lower potency rates. This is exemplified in that only one third of patients underwent a bilateral nerve-sparing procedure. Additionally, center-specific differences in indication for nerve-sparing procedures may explain these results.
A major strength of the current study is that potency and continence outcomes were assessed from patient-administered questionnaires in contrast to the study by Vickers et al., where the same outcomes were evaluated by the treating surgeon. PROs provide an assessment of functional outcomes from the patient’s perspective. Therefore, collecting data from the patient may protect against bias due to patients minimizing symptoms when they are asked by the treating physician directly. Published rates of impotence after RP based on physician reports may be underestimates, since patients may not report this side effect accurately and completely to their doctor .
Furthermore, the patient-reported potency rate in the present study is in line with other population-based series on unselected patients in the literature [11–15]. In the Scandinavian Prostate Cancer Group Study 4 (SPCG-4) trial, the prevalence of ED 12 years after RP was 84% .
We found no evidence of heterogeneity in potency by surgeon. Our failure to replicate a prior finding of heterogeneity for potency outcomes  may be related to a floor effect of low overall rates as well as limited power (9 surgeons). Other possible explanations are that potency postoperatively is more a question of inherent patient factors or also dependent upon the individual decision of the surgeon and patient to elect for a nerve-sparing procedure.
For continence outcomes at 18 months, we found evidence of significant heterogeneity between surgeons. The difference was quite remarkable (7%–30% incontinence rates). This finding is in line with a previous US study. Using the SEER-Medicare database (patients ≥ 65 years old); Begg et al. found that case mix-adjusted incontinence rates 1 year after RP were lower in very high-volume hospitals than in low-volume hospitals. They also studied, in detail, long-term incontinence in patients for 159 surgeons in the 2 highest-volume categories (20–32 RPs per surgeon and 33–121 RPs per surgeon during the study period) and noted significant surgeon-to-surgeon variations in outcome .
Urinary incontinence and impotence after RP have a major impact on QoL  and these side effects, especially in the long-term, are one of the major drawbacks of PSA screening . In the present study the average incontinence rate was 15%, which is very similar to the 17% reported by Vickers et al. . The large variation between surgeons suggests a need for formal quality assurance programs and performance feedback systems. Surgeons need to know their results so that they can evaluate and find ways to improve them .
Previous studies have shown heterogeneity between surgeons regarding not only functional outcomes but also risk for BCR and clinical recurrence [5, 6, 18]. In particular, Vickers et al. found that functional preservation did not come at the expense of cancer control . Indeed, there was a positive correlation between oncologic and functional outcomes, suggesting that both are markers of surgical quality. We were not able to replicate this finding, possibly due to a floor effect for potency.
RP is associated with long-term side effects such as incontinence and ED. In this study we replicated prior findings that individual surgeon technique is related to the risk of permanent incontinence; we were unable to replicate findings relating surgical technique to erectile dysfunction and oncologic outcome. Quality assurance measures involving performance feedback should be considered. When surgeons are aware of their outcomes, they can improve them to provide better care to patients.
Quality of life
International index of erectile function 5 questionnaire
Scandinavian prostate cancer group study 4.
We thank study nurse Maria Nyberg for extensive medical charts review. We sincerely thank Joyce Tsoi for her assistance with editing this manuscript.
S.C. is supported by funding from the Swedish Society for Medical Research, the Swedish Cancer Society, the Sweden America Foundation and the Swedish Council for Working Life and Social Research. Further support was received from NIH grant P50-CA92629, the Sidney Kimmel Center for Prostate and Urologic Cancers; David H. Koch through the Prostate Cancer Foundation.
- Cooperberg MR, Broering JM, Carroll PR: Time trends and local variation in primary treatment of localized prostate cancer. J Clin Oncol. 2010, 28 (7): 1117-1123. 10.1200/JCO.2009.26.0133.View ArticlePubMedPubMed CentralGoogle Scholar
- Bill-Axelson A, Holmberg L, Ruutu M, Garmo H, Stark JR, Busch C, Nordling S, Häggman M, Andersson SO, Bratell S, Spångberg A, Palmgren J, Steineck G, Adami HO, Johansson JE: SPCG-4 Investigators: radical prostatectomy versus watchful waiting in early prostate cancer. New Engl J Med. 2011, 364 (18): 1708-1717. 10.1056/NEJMoa1011967.View ArticlePubMedGoogle Scholar
- Johansson E, Steineck G, Holmberg L, Johansson JE, Nyberg T, Ruutu M, Bill-Axelson A, SPCG-4 Investigators: Long-term quality-of-life outcomes after radical prostatectomy or watchful waiting: the Scandinavian Prostate Cancer Group-4 randomised trial. Lancet Oncol. 2011, 12 (9): 891-899. 10.1016/S1470-2045(11)70162-0.View ArticlePubMedGoogle Scholar
- Sanda MG, Dunn RL, Michalski J, Sandler HM, Northouse L, Hembroff L, Lin X, Greenfield TK, Litwin MS, Saigal CS, Mahadevan A, Klein E, Kibel A, Pisters LL, Kuban D, Kaplan I, Wood D, Ciezki J, Shah N, Wei JT: Quality of life and satisfaction with outcome among prostate-cancer survivors. New Engl J Med. 2008, 358 (12): 1250-1261. 10.1056/NEJMoa074311.View ArticlePubMedGoogle Scholar
- Bianco FJ, Vickers AJ, Cronin AM, Klein EA, Eastham JA, Pontes JE, Scardino PT: Variations among experienced surgeons in cancer control after open radical prostatectomy. J Urol. 2010, 183 (3): 977-982. 10.1016/j.juro.2009.11.015.View ArticlePubMedPubMed CentralGoogle Scholar
- Vickers A, Savage C, Bianco F, Mulhall J, Sandhu J, Guillonneau B, Cronin A, Scardino P: Cancer control and functional outcomes after radical prostatectomy as markers of surgical quality: analysis of heterogeneity between surgeons at a single cancer center. Eur Urol. 2011, 59 (3): 317-322. 10.1016/j.eururo.2010.10.045.View ArticlePubMedGoogle Scholar
- Begg CB, Riedel ER, Bach PB, Kattan MW, Schrag D, Warren JL, Scardino PT: Variations in morbidity after radical prostatectomy. New Engl J Med. 2002, 346 (15): 1138-1144. 10.1056/NEJMsa011788.View ArticlePubMedGoogle Scholar
- Thorsteinsdottir T, Stranne J, Carlsson S, Anderberg B, Bjorholt I, Damber JE, Hugosson J, Wilderäng U, Wiklund P, Steineck G, Haglind E: LAPPRO: a prospective multicentre comparative study of robot-assisted laparoscopic and retropubic radical prostatectomy for prostate cancer. Scand J Urol Nephrol. 2011, 45 (2): 102-112. 10.3109/00365599.2010.532506.View ArticlePubMedGoogle Scholar
- Wallerstedt A, Carlsson S, Nilsson AE, Johansson E, Nyberg T, Steineck G, Wiklund NP: Pad use and patient reported bother from urinary leakage after radical prostatectomy. J Urol. 2012, 187 (1): 196-200. 10.1016/j.juro.2011.09.030.View ArticlePubMedGoogle Scholar
- Rosen RC, Cappelleri JC, Smith MD, Lipsky J, Pena BM: Development and evaluation of an abridged, 5-item version of the International Index of Erectile Function (IIEF-5) as a diagnostic tool for erectile dysfunction. Int J Impot Res. 1999, 11 (6): 319-326.View ArticlePubMedGoogle Scholar
- Talcott JA, Rieker P, Propert KJ, Clark JA, Wishnow KI, Loughlin KR, Richie JP, Kantoff PW: Patient-reported impotence and incontinence after nerve-sparing radical prostatectomy. J Natl Cancer Inst. 1997, 89 (15): 1117-1123. 10.1093/jnci/89.15.1117.View ArticlePubMedGoogle Scholar
- Steineck G, Helgesen F, Adolfsson J, Dickman PW, Johansson JE, Norlén BJ, Holmberg L, Scandinavian Prostatic Cancer Group Study Number 4: Quality of life after radical prostatectomy or watchful waiting. New Engl J Med. 2002, 347 (11): 790-796. 10.1056/NEJMoa021483.View ArticlePubMedGoogle Scholar
- Madalinska JB, Essink-Bot ML, de Koning HJ, Kirkels WJ, van der Maas PJ, Schröder FH: Health-related quality-of-life effects of radical prostatectomy and primary radiotherapy for screen-detected or clinically diagnosed localized prostate cancer. J Clin Oncol. 2001, 19 (6): 1619-1628.PubMedGoogle Scholar
- Potosky AL, Legler J, Albertsen PC, Stanford JL, Gilliland FD, Hamilton AS, Eley JW, Stephenson RA, Harlan LC: Health outcomes after prostatectomy or radiotherapy for prostate cancer: results from the prostate cancer outcomes study. JNCI. 2000, 92 (19): 1582-1592. 10.1093/jnci/92.19.1582.View ArticlePubMedGoogle Scholar
- Stanford JL, Feng Z, Hamilton AS, Gilliland FD, Stephenson RA, Eley JW, Albertsen PC, Harlan LC, Potosky AL: Urinary and sexual function after radical prostatectomy for clinically localized prostate cancer: the prostate cancer outcomes study. JAMA. 2000, 283 (3): 354-360. 10.1001/jama.283.3.354.View ArticlePubMedGoogle Scholar
- Heijnsdijk EA, Wever EM, Auvinen A, Hugosson J, Ciatto S, Nelen V, Kwiatkowski M, Villers A, Páez A, Moss SM, Zappa M, Tammela TL, Mäkinen T, Carlsson S, Korfage IJ, Essink-Bot ML, Otto SJ, Draisma G, Bangma CH, Roobol MJ, Schröder FH, de Koning HJ: Quality-of-life effects of prostate-specific antigen screening. New Engl J Med. 2012, 367 (7): 595-605. 10.1056/NEJMoa1201637.View ArticlePubMedGoogle Scholar
- Vickers AJ, Sjoberg D, Basch E, Sculli F, Shouery M, Laudone V, Touijer K, Eastham J, Scardino PT: How do you know if you are any good? A surgeon performance feedback system for the outcomes of radical prostatectomy. Eur Urol. 2012, 61 (2): 284-289. 10.1016/j.eururo.2011.10.039.View ArticlePubMedGoogle Scholar
- Vickers AJ, Bianco FJ, Gonen M, Cronin AM, Eastham JA, Schrag D, Klein EA, Reuther AM, Kattan MW, Pontes JE, Scardino PT: Effects of pathologic stage on the learning curve for radical prostatectomy: evidence that recurrence in organ-confined cancer is largely related to inadequate surgical technique. Eur Urol. 2008, 53 (5): 960-966. 10.1016/j.eururo.2008.01.005.View ArticlePubMedPubMed CentralGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2490/14/25/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited.