- Research article
- Open Access
Effects of surgeon variability on oncologic and functional outcomes in a population-based setting
BMC Urology volume 14, Article number: 25 (2014)
Oncologic and functional outcomes after radical prostatectomy (RP) can vary between surgeons to a greater extent than is expected by chance. We sought to examine the effects of surgeon variation on functional and oncologic outcomes for patients undergoing RP for prostate cancer in a European center.
The study comprised 1,280 men who underwent open retropubic RP performed by one of nine surgeons at an academic institution in Sweden between 2001 and 2008. Potency and continence outcomes were measured preoperatively and 18 months postoperatively by patient-administered questionnaires. Biochemical recurrence (BCR) was defined as a prostate-specific antigen (PSA) value > 0.2 ng/mL with at least one confirmatory rise. Multivariable random effect models were used to evaluate heterogeneity between surgeons, adjusting for case mix (age, PSA, pathological stage and grade), year of surgery, and surgical experience.
Of 679 men potent at baseline, 647 provided data at 18 months with 122 (19%) reporting potency. We found no evidence for heterogeneity of potency outcomes between surgeons (P = 1). The continence rate for patients at 18 months was 85%, with 836 of the 979 patients who provided data reporting continence. There was statistically significant heterogeneity between surgeons (P = 0.001). We did not find evidence of an association between surgeons’ adjusted probabilities of functional recovery and 5-year probability of freedom from BCR.
Our data support previous studies regarding a large heterogeneity among surgeons in continence outcomes for patients undergoing RP. This indicates that some patients are receiving sub-optimal care. Quality assurance measures involving performance feedback, should be considered. When surgeons are aware of their outcomes, they can improve them to provide better care to patients.
Radical prostatectomy (RP) with curative intent is the most common treatment for men with localized prostate cancer . A prospective, randomized Swedish trial demonstrated that surgery provides a survival benefit in men with mainly clinically diagnosed, palpable tumors when compared to watchful waiting . However, surgical treatment is associated with long-term morbidity, mainly erectile dysfunction (ED) and urinary incontinence, which affect a patient’s quality of life (QoL) substantially [3, 4].
Previous studies performed in high-volume referral centers in the United States (US) have shown that both oncologic  and functional outcomes [6, 7] after RP vary between surgeons to a greater extent than is expected by chance. In the present validation study, we sought to explore whether such heterogeneity exists in long-term functional and oncologic outcomes among surgeons in a European center who operate in a population-based academic setting. Another rationale for the present study is that there is limited data on variability in patient-reported outcomes (PRO). Therefore, the present study provides a unique opportunity to explore any variability in outcomes as assessed by validated PRO instruments.
The original database consisted of 1,447 men who were scheduled for open retropubic RP at Sahlgrenska University Hospital in Göteborg, Sweden, during the study period 2001–2008, when standardized data recording into a quality assurance database was performed.
The quality control program was approved by the Ethical Committee at Göteborg University in 2001. Patients were mailed questionnaires, a cover letter with information regarding the quality assurance program, and a statement of voluntary participation in the study.
Of the 58 patients excluded, 38 were enrolled in another clinical RP trial (LAPPRO) , 4 underwent surgery outside the university hospital, 7 did not undergo surgery (with 4 switching to radiotherapy and 3 receiving hormonal therapy), and 9 did not undergo surgery but may have had surgery elsewhere for unknown reasons (moved or loss-to-follow-up). This left 1,389 patients in the cohort. Surgery dates ranged from Jan 2, 2001 through July 16, 2008.
Biochemical recurrence (BCR) post-prostatectomy was defined as a prostate-specific antigen (PSA) value > 0.2 ng/mL with at least one confirmatory rise. Measurements were obtained from medical charts.
Of 1,389 patients, an additional 109 were excluded from analysis since they were never administered any questionnaires, leaving 1,280 patients available for analysis of functional outcomes. Patients responded to questionnaires regarding continence and potency on 4 occasions, approximately 2 weeks preoperatively and at 6, 18, and 36 months after surgery.
Patients were administered questionnaires assessing urinary continence using pads . Continence was defined as no leakage or occasional leakage associated with physical activity requiring sporadic use of pads (score 0–1 on a 0–4 point scale, where 2–4 implies incontinence with regular use of pads).
Erectile function was assessed by the standardized International Index of Erection Function questionnaire IIEF-5 . The IIEF-5 score consists of 5 items with 6 responses. The total score is the sum of the 5 items and ranges from 5–25, the higher the score the better potency. For patients missing responses for an item, the sum of the remaining items was used. Potency was defined as an IIEF-5 score of ≥ 17, which corresponds to Rosen et al.’s categorization of mild ED (17–21) and no ED (22–25) . This also makes our study comparable to functional outcomes reported in an earlier study by Vickers et al. where postoperative potency was defined as 1 = normal, full erections and 2 = full, but diminished erections .
Missing data on potency status (potent/impotent) and continence (incontinent/continent) at 18 months were imputed following an algorithm assuming that few men regain and then lose function as well as that recovery of function can occur beyond 18 months. If a patient was missing a questionnaire at 18 months but reported potency at 6 months, he was assumed to be potent at 18 months. Comparably, a patient reporting impotence at 6 and 36 months was considered impotent at 18 months. A similar approach was used for the continence endpoint.
Patients reporting use of alprostadil injections for erectile aid were categorized as impotent (3 men preoperatively, 222 men at 18 months, and 198 men at 36 months). Men reporting use of PDE5-inhibitors were included in the analysis.
Data on a total of 25 individual surgeons working at the hospital during the study period were included in the database. We analyzed patient-reported functional outcomes for 9 surgeons who performed ≥ 20 surgeries during the study period. Data for these surgeons were entered both as random and fixed effects.
Logistic regression models were adjusted for age at surgery, PSA at diagnosis, pathologic stage (pT0, pT2, pT3), pathologic Gleason score (≤ 6, 7, ≥ 8), year of surgery, and surgical experience. We defined surgical experience as a variable that took into account both the surgeon’s prior experience, i.e., number of RPs before 2001, and the annual number of prostatectomies performed during the study period . To statistically test for heterogeneity, a random effect following an inverse Gaussian distribution was included in the model.
The logistic regression model used to predict the probability of potency at 18 months was restricted to men who were potent preoperatively and also adjusted for the IIEF-5 score as a continuous variable. The model for continence at 18 months was restricted to men who were continent preoperatively. Since there have been changes in patient characteristics as well as operative technique, we also included year of surgery as a covariate. Nerve sparing status was not included in the model since it is a surgical decision. Take the case of two surgeons, one of whom only spared nerves if the cancer was very low risk and accordingly resected far from the neurovascular bundles, the other of whom only resected nerves for advanced disease. Overall, the former surgeon would have far lower potency rates, but adjusting for nerve sparing would lead to higher apparent rates.
A log-logistic distributed parametric regression survival model was used to model BCR rates following adjustment for the same covariates as for functional outcomes. To statistically test for heterogeneity, a shared frailty survival model was fitted.
For each surgeon studied, forest plots were created for the adjusted predicted probability of potency and continence, respectively, using the mean value for the covariates from the fixed regression model with a 95% confidence interval.
A scatter plot was created for adjusted rates of continence and potency with the size of each surgeon’s data point proportional to the number of RPs (prior experience and during the study period) performed by each surgeon. Spearman’s rank correlation was applied to test the correlation between surgeons’ adjusted probabilities of potency and continence at 18 months as well as BCR.
Statistical analyses were performed using Stata v. 12.0 (Stata Corp, College Station, TX, USA).
Table 1 shows clinical characteristics for all 1,280 men who underwent RP. The median age at surgery was 64 years. Crude functional outcome rates per surgeon along with prior experience and the number of cases operated upon during the study period are shown in Table 2. Nine surgeons performed ≥ 20 surgeries during the study period, with a maximum of 248 cases. The prior experience of these surgeons ranged between 0 and 360 cases (Table 2).
Regarding functional outcomes, a total of 1,039 men responded to the IIEF-5 questionnaire, with 679 reporting being potent preoperatively (65%). Data were available for 647 (95%) patients at 18 months with 122 (19%) reporting potency (without alprostadil).
Crude potency rates at 18 months were higher for men who underwent bilateral nerve-sparing RP (31.8%) and for those < 60 years of age (45.7%) (data not shown).
Of the 1,078 patients who responded preoperatively to the continence question, 25 were considered incontinent (2%). Of the 979 (91%) patients responding at 18 months, 836 were continent (85%). The degrees of incontinence at 18 months among preoperatively continent men were as follows: never urinary leakage (39.0%), sometimes urinary leakage when coughing, sneezing or performing physical exercise with sporadic use of pads (46.4%), regular use of pads but they are not always wet (9.4%), regular use of pads that are wet (3.3%), and constant urinary leakage (1.7%).
Between-surgeon variation in functional outcomes is shown in the forest plots for potency in Figure 1A and continence in Figure 1B. For potency at 18 months, we found no evidence for heterogeneity between surgeons (random effects variance = 0.0002, P = 1). For continence at 18 months, there was a statistically significant heterogeneity between surgeons, (random effects variance = 0.0318; 95% CI 0.0125 – 0.1649, P = 0.001) with continence rates varying from 70 to 93% between surgeons. For BCR at a mean follow-up of 5.12 years (SD 0.07), heterogeneity between surgeons was not observed (random effects variance = 0.0133, P = 0.484) (Figure 1C).
The correlation between surgeons’ adjusted probabilities of potency and continence was not statistically significant (Spearman’s rho -0.20, P = 0.61) (Figure 2A).
Postoperatively, the 5-year probability of freedom from BCR adjusted for case mix was 86%. We observed a weak and non-significant association between surgeons’ adjusted probabilities of functional recovery (i.e., both potent and continent) and 5-year probability of freedom from BCR (P = 0.9) (Figure 2B). The present findings were not altered when the correlation between functional recovery and BCR was assessed separately; continence and potency, respectively (Figure 2C and 2D).
In the present validation study, we explored whether heterogeneity in long-term functional outcomes in a European academic center is comparable to that previously reported in a very high-volume referral center in the US . Our data confirms prior studies on the existence of surgeon heterogeneity for continence, but not for potency [5–7].
Continence rates were similar when comparing our present study to the Vickers et al. study in which 1,910 patients were treated with RP by 1 of 11 surgeons between 1997 and 2007 at a high-volume US referral center , with a rate of 85% at 18 months vs. 83% at 12 months, respectively. However, potency rates were lower in the present study, with a rate of 19% at 18 months compared to 43% at 12 months in Vickers et al. Overall, the rate of impotence at 18 months postoperatively was high in the present study, with less than two-thirds of patients being potent preoperatively. The lower rate of potency is most plausibly explained by the fact that the men in this study were considerably older, with a median age of 64 years, as compared to the median age of 58 years in the Vickers et al. study. Another possible explanation is that the study cohort was derived from a population-based sample in an area where active surveillance is frequently used, implying that only the most aggressive tumors are treated; this likely results in more advanced tumor features leading to more radical surgery with wider resection and lower potency rates. This is exemplified in that only one third of patients underwent a bilateral nerve-sparing procedure. Additionally, center-specific differences in indication for nerve-sparing procedures may explain these results.
A major strength of the current study is that potency and continence outcomes were assessed from patient-administered questionnaires in contrast to the study by Vickers et al., where the same outcomes were evaluated by the treating surgeon. PROs provide an assessment of functional outcomes from the patient’s perspective. Therefore, collecting data from the patient may protect against bias due to patients minimizing symptoms when they are asked by the treating physician directly. Published rates of impotence after RP based on physician reports may be underestimates, since patients may not report this side effect accurately and completely to their doctor .
Furthermore, the patient-reported potency rate in the present study is in line with other population-based series on unselected patients in the literature [11–15]. In the Scandinavian Prostate Cancer Group Study 4 (SPCG-4) trial, the prevalence of ED 12 years after RP was 84% .
We found no evidence of heterogeneity in potency by surgeon. Our failure to replicate a prior finding of heterogeneity for potency outcomes  may be related to a floor effect of low overall rates as well as limited power (9 surgeons). Other possible explanations are that potency postoperatively is more a question of inherent patient factors or also dependent upon the individual decision of the surgeon and patient to elect for a nerve-sparing procedure.
For continence outcomes at 18 months, we found evidence of significant heterogeneity between surgeons. The difference was quite remarkable (7%–30% incontinence rates). This finding is in line with a previous US study. Using the SEER-Medicare database (patients ≥ 65 years old); Begg et al. found that case mix-adjusted incontinence rates 1 year after RP were lower in very high-volume hospitals than in low-volume hospitals. They also studied, in detail, long-term incontinence in patients for 159 surgeons in the 2 highest-volume categories (20–32 RPs per surgeon and 33–121 RPs per surgeon during the study period) and noted significant surgeon-to-surgeon variations in outcome .
Urinary incontinence and impotence after RP have a major impact on QoL  and these side effects, especially in the long-term, are one of the major drawbacks of PSA screening . In the present study the average incontinence rate was 15%, which is very similar to the 17% reported by Vickers et al. . The large variation between surgeons suggests a need for formal quality assurance programs and performance feedback systems. Surgeons need to know their results so that they can evaluate and find ways to improve them .
Previous studies have shown heterogeneity between surgeons regarding not only functional outcomes but also risk for BCR and clinical recurrence [5, 6, 18]. In particular, Vickers et al. found that functional preservation did not come at the expense of cancer control . Indeed, there was a positive correlation between oncologic and functional outcomes, suggesting that both are markers of surgical quality. We were not able to replicate this finding, possibly due to a floor effect for potency.
RP is associated with long-term side effects such as incontinence and ED. In this study we replicated prior findings that individual surgeon technique is related to the risk of permanent incontinence; we were unable to replicate findings relating surgical technique to erectile dysfunction and oncologic outcome. Quality assurance measures involving performance feedback should be considered. When surgeons are aware of their outcomes, they can improve them to provide better care to patients.
Quality of life
International index of erectile function 5 questionnaire
Scandinavian prostate cancer group study 4.
Cooperberg MR, Broering JM, Carroll PR: Time trends and local variation in primary treatment of localized prostate cancer. J Clin Oncol. 2010, 28 (7): 1117-1123. 10.1200/JCO.2009.26.0133.
Bill-Axelson A, Holmberg L, Ruutu M, Garmo H, Stark JR, Busch C, Nordling S, Häggman M, Andersson SO, Bratell S, Spångberg A, Palmgren J, Steineck G, Adami HO, Johansson JE: SPCG-4 Investigators: radical prostatectomy versus watchful waiting in early prostate cancer. New Engl J Med. 2011, 364 (18): 1708-1717. 10.1056/NEJMoa1011967.
Johansson E, Steineck G, Holmberg L, Johansson JE, Nyberg T, Ruutu M, Bill-Axelson A, SPCG-4 Investigators: Long-term quality-of-life outcomes after radical prostatectomy or watchful waiting: the Scandinavian Prostate Cancer Group-4 randomised trial. Lancet Oncol. 2011, 12 (9): 891-899. 10.1016/S1470-2045(11)70162-0.
Sanda MG, Dunn RL, Michalski J, Sandler HM, Northouse L, Hembroff L, Lin X, Greenfield TK, Litwin MS, Saigal CS, Mahadevan A, Klein E, Kibel A, Pisters LL, Kuban D, Kaplan I, Wood D, Ciezki J, Shah N, Wei JT: Quality of life and satisfaction with outcome among prostate-cancer survivors. New Engl J Med. 2008, 358 (12): 1250-1261. 10.1056/NEJMoa074311.
Bianco FJ, Vickers AJ, Cronin AM, Klein EA, Eastham JA, Pontes JE, Scardino PT: Variations among experienced surgeons in cancer control after open radical prostatectomy. J Urol. 2010, 183 (3): 977-982. 10.1016/j.juro.2009.11.015.
Vickers A, Savage C, Bianco F, Mulhall J, Sandhu J, Guillonneau B, Cronin A, Scardino P: Cancer control and functional outcomes after radical prostatectomy as markers of surgical quality: analysis of heterogeneity between surgeons at a single cancer center. Eur Urol. 2011, 59 (3): 317-322. 10.1016/j.eururo.2010.10.045.
Begg CB, Riedel ER, Bach PB, Kattan MW, Schrag D, Warren JL, Scardino PT: Variations in morbidity after radical prostatectomy. New Engl J Med. 2002, 346 (15): 1138-1144. 10.1056/NEJMsa011788.
Thorsteinsdottir T, Stranne J, Carlsson S, Anderberg B, Bjorholt I, Damber JE, Hugosson J, Wilderäng U, Wiklund P, Steineck G, Haglind E: LAPPRO: a prospective multicentre comparative study of robot-assisted laparoscopic and retropubic radical prostatectomy for prostate cancer. Scand J Urol Nephrol. 2011, 45 (2): 102-112. 10.3109/00365599.2010.532506.
Wallerstedt A, Carlsson S, Nilsson AE, Johansson E, Nyberg T, Steineck G, Wiklund NP: Pad use and patient reported bother from urinary leakage after radical prostatectomy. J Urol. 2012, 187 (1): 196-200. 10.1016/j.juro.2011.09.030.
Rosen RC, Cappelleri JC, Smith MD, Lipsky J, Pena BM: Development and evaluation of an abridged, 5-item version of the International Index of Erectile Function (IIEF-5) as a diagnostic tool for erectile dysfunction. Int J Impot Res. 1999, 11 (6): 319-326.
Talcott JA, Rieker P, Propert KJ, Clark JA, Wishnow KI, Loughlin KR, Richie JP, Kantoff PW: Patient-reported impotence and incontinence after nerve-sparing radical prostatectomy. J Natl Cancer Inst. 1997, 89 (15): 1117-1123. 10.1093/jnci/89.15.1117.
Steineck G, Helgesen F, Adolfsson J, Dickman PW, Johansson JE, Norlén BJ, Holmberg L, Scandinavian Prostatic Cancer Group Study Number 4: Quality of life after radical prostatectomy or watchful waiting. New Engl J Med. 2002, 347 (11): 790-796. 10.1056/NEJMoa021483.
Madalinska JB, Essink-Bot ML, de Koning HJ, Kirkels WJ, van der Maas PJ, Schröder FH: Health-related quality-of-life effects of radical prostatectomy and primary radiotherapy for screen-detected or clinically diagnosed localized prostate cancer. J Clin Oncol. 2001, 19 (6): 1619-1628.
Potosky AL, Legler J, Albertsen PC, Stanford JL, Gilliland FD, Hamilton AS, Eley JW, Stephenson RA, Harlan LC: Health outcomes after prostatectomy or radiotherapy for prostate cancer: results from the prostate cancer outcomes study. JNCI. 2000, 92 (19): 1582-1592. 10.1093/jnci/92.19.1582.
Stanford JL, Feng Z, Hamilton AS, Gilliland FD, Stephenson RA, Eley JW, Albertsen PC, Harlan LC, Potosky AL: Urinary and sexual function after radical prostatectomy for clinically localized prostate cancer: the prostate cancer outcomes study. JAMA. 2000, 283 (3): 354-360. 10.1001/jama.283.3.354.
Heijnsdijk EA, Wever EM, Auvinen A, Hugosson J, Ciatto S, Nelen V, Kwiatkowski M, Villers A, Páez A, Moss SM, Zappa M, Tammela TL, Mäkinen T, Carlsson S, Korfage IJ, Essink-Bot ML, Otto SJ, Draisma G, Bangma CH, Roobol MJ, Schröder FH, de Koning HJ: Quality-of-life effects of prostate-specific antigen screening. New Engl J Med. 2012, 367 (7): 595-605. 10.1056/NEJMoa1201637.
Vickers AJ, Sjoberg D, Basch E, Sculli F, Shouery M, Laudone V, Touijer K, Eastham J, Scardino PT: How do you know if you are any good? A surgeon performance feedback system for the outcomes of radical prostatectomy. Eur Urol. 2012, 61 (2): 284-289. 10.1016/j.eururo.2011.10.039.
Vickers AJ, Bianco FJ, Gonen M, Cronin AM, Eastham JA, Schrag D, Klein EA, Reuther AM, Kattan MW, Pontes JE, Scardino PT: Effects of pathologic stage on the learning curve for radical prostatectomy: evidence that recurrence in organ-confined cancer is largely related to inadequate surgical technique. Eur Urol. 2008, 53 (5): 960-966. 10.1016/j.eururo.2008.01.005.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2490/14/25/prepub
We thank study nurse Maria Nyberg for extensive medical charts review. We sincerely thank Joyce Tsoi for her assistance with editing this manuscript.
S.C. is supported by funding from the Swedish Society for Medical Research, the Swedish Cancer Society, the Sweden America Foundation and the Swedish Council for Working Life and Social Research. Further support was received from NIH grant P50-CA92629, the Sidney Kimmel Center for Prostate and Urologic Cancers; David H. Koch through the Prostate Cancer Foundation.
None of the authors have any competing interest to declare.
AV, JH and SC conceived the study concept and design. The data acquisition was performed by JH and SC. AV supervised the statistical methods and analyses. AB and DS carried out the statistical analyses and plotted the figures. SC and AV drafted the manuscript. SC, JH and AV obtained funding. AK, JH, SB, PL, GA and JH performed the radical prostatectomies in the study. All authors interpreted the data and critically revised the manuscript for important intellectual content. All authors read and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Carlsson, S., Berglund, A., Sjoberg, D. et al. Effects of surgeon variability on oncologic and functional outcomes in a population-based setting. BMC Urol 14, 25 (2014). https://doi.org/10.1186/1471-2490-14-25
- Prostate cancer
- Radical prostatectomy
- Erectile function
- Urinary function