Skip to main content

Main menu

  • Home
  • Content
    • Current
    • Ahead of print
    • Past Issues
    • JNM Supplement
    • SNMMI Annual Meeting Abstracts
    • Continuing Education
    • JNM Podcasts
  • Subscriptions
    • Subscribers
    • Institutional and Non-member
    • Rates
    • Journal Claims
    • Corporate & Special Sales
  • Authors
    • Submit to JNM
    • Information for Authors
    • Assignment of Copyright
    • AQARA requirements
  • Info
    • Reviewers
    • Permissions
    • Advertisers
  • About
    • About Us
    • Editorial Board
    • Contact Information
  • More
    • Alerts
    • Feedback
    • Help
    • SNMMI Journals
  • SNMMI
    • JNM
    • JNMT
    • SNMMI Journals
    • SNMMI

User menu

  • Subscribe
  • My alerts
  • Log in
  • Log out
  • My Cart

Search

  • Advanced search
Journal of Nuclear Medicine
  • SNMMI
    • JNM
    • JNMT
    • SNMMI Journals
    • SNMMI
  • Subscribe
  • My alerts
  • Log in
  • Log out
  • My Cart
Journal of Nuclear Medicine

Advanced Search

  • Home
  • Content
    • Current
    • Ahead of print
    • Past Issues
    • JNM Supplement
    • SNMMI Annual Meeting Abstracts
    • Continuing Education
    • JNM Podcasts
  • Subscriptions
    • Subscribers
    • Institutional and Non-member
    • Rates
    • Journal Claims
    • Corporate & Special Sales
  • Authors
    • Submit to JNM
    • Information for Authors
    • Assignment of Copyright
    • AQARA requirements
  • Info
    • Reviewers
    • Permissions
    • Advertisers
  • About
    • About Us
    • Editorial Board
    • Contact Information
  • More
    • Alerts
    • Feedback
    • Help
    • SNMMI Journals
  • View or Listen to JNM Podcast
  • Visit JNM on Facebook
  • Join JNM on LinkedIn
  • Follow JNM on Twitter
  • Subscribe to our RSS feeds
Research ArticleTheranostics

68Ga-PSMA-11 PET/CT Interobserver Agreement for Prostate Cancer Assessments: An International Multicenter Prospective Study

Wolfgang Peter Fendler, Jeremie Calais, Martin Allen-Auerbach, Christina Bluemel, Nina Eberhardt, Louise Emmett, Pawan Gupta, Markus Hartenbach, Thomas A. Hope, Shozo Okamoto, Christian Helmut Pfob, Thorsten D. Pöppel, Christoph Rischpler, Sarah Schwarzenböck, Vanessa Stebner, Marcus Unterrainer, Helle D. Zacho, Tobias Maurer, Christian Gratzke, Alexander Crispin, Johannes Czernin, Ken Herrmann and Matthias Eiber
Journal of Nuclear Medicine October 2017, 58 (10) 1617-1623; DOI: https://doi.org/10.2967/jnumed.117.190827
Wolfgang Peter Fendler
1Department of Molecular and Medical Pharmacology, David Geffen School of Medicine at UCLA, Los Angeles, California
2Department of Nuclear Medicine, Ludwig-Maximilians-University Munich, Munich, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jeremie Calais
1Department of Molecular and Medical Pharmacology, David Geffen School of Medicine at UCLA, Los Angeles, California
3Department of Nuclear Medicine, Bichat University Hospital, AP-HP, University of Paris VII, Paris, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Martin Allen-Auerbach
1Department of Molecular and Medical Pharmacology, David Geffen School of Medicine at UCLA, Los Angeles, California
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Christina Bluemel
4Department of Nuclear Medicine, Julius-Maximilians-University of Würzburg, Würzburg, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nina Eberhardt
5Department of Nuclear Medicine, Ulm University, Ulm, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Louise Emmett
6Department of Diagnostic Imaging, St. Vincent's Public Hospital, Sydney, Australia, and University of New South Wales, Sydney, New South Wales, Australia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Pawan Gupta
1Department of Molecular and Medical Pharmacology, David Geffen School of Medicine at UCLA, Los Angeles, California
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Markus Hartenbach
7Division of Nuclear Medicine, Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna, Austria
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Thomas A. Hope
8Department of Radiology and Biomedical Imaging, University of California, San Francisco, California
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Shozo Okamoto
9Department of Nuclear Medicine, Hokkaido University Graduate School of Medicine, Sapporo, Japan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Christian Helmut Pfob
10Department of Nuclear Medicine, Klinikum Rechts der Isar, Technical University of Munich, Munich, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Thorsten D. Pöppel
11Department of Nuclear Medicine, Medical Faculty, University Duisburg-Essen, University Hospital Essen, Essen, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Christoph Rischpler
10Department of Nuclear Medicine, Klinikum Rechts der Isar, Technical University of Munich, Munich, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sarah Schwarzenböck
12Department of Nuclear Medicine, Rostock University Medical Centre, Rostock, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Vanessa Stebner
11Department of Nuclear Medicine, Medical Faculty, University Duisburg-Essen, University Hospital Essen, Essen, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Marcus Unterrainer
2Department of Nuclear Medicine, Ludwig-Maximilians-University Munich, Munich, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Helle D. Zacho
13Department of Nuclear Medicine, Aalborg University Hospital, Aalborg, Denmark
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tobias Maurer
14Department of Urology, Klinikum Rechts der Isar, Technical University of Munich, Munich, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Christian Gratzke
15Department of Urology, Ludwig-Maximilians-University of Munich, Munich, Germany; and
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Alexander Crispin
16Institute of Medical Informatics, Biometry, and Epidemiology, Ludwig-Maximilians-University Munich, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Johannes Czernin
1Department of Molecular and Medical Pharmacology, David Geffen School of Medicine at UCLA, Los Angeles, California
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ken Herrmann
1Department of Molecular and Medical Pharmacology, David Geffen School of Medicine at UCLA, Los Angeles, California
11Department of Nuclear Medicine, Medical Faculty, University Duisburg-Essen, University Hospital Essen, Essen, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Matthias Eiber
1Department of Molecular and Medical Pharmacology, David Geffen School of Medicine at UCLA, Los Angeles, California
10Department of Nuclear Medicine, Klinikum Rechts der Isar, Technical University of Munich, Munich, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • PDF
Loading

Abstract

The interobserver agreement for 68Ga-PSMA-11 PET/CT study interpretations in patients with prostate cancer is unknown. Methods: 68Ga-PSMA-11 PET/CT was performed in 50 patients with prostate cancer for biochemical recurrence (n = 25), primary diagnosis (n = 10), biochemical persistence after primary therapy (n = 5), or staging of known metastatic disease (n = 10). Images were reviewed by 16 observers who used a standardized approach for interpretation of local (T), nodal (N), bone (Mb), or visceral (Mc) involvement. Observers were classified as having a low (<30 prior 68Ga-PSMA-11 PET/CT studies; n = 5), intermediate (30–300 studies; n = 5), or high level of experience (>300 studies; n = 6). Histopathology (n = 25, 50%), post–external-beam radiation therapy prostate-specific antigen response (n = 15, 30%), or follow-up PET/CT (n = 10, 20%) served as a standard of reference. Observer groups were compared by overall agreement (% patients matching the standard of reference) and Fleiss' κ with mean and corresponding 95% confidence interval (CI). Results: Agreement among all observers was substantial for T (κ = 0.62; 95% CI, 0.59–0.64) and N (κ = 0.74; 95% CI, 0.71–0.76) staging and almost perfect for Mb (κ = 0.88; 95% CI, 0.86–0.91) staging. Level of experience positively correlated with agreement for T (κ = 0.73/0.66/0.50 for high/intermediate/low experience, respectively), N (κ = 0.80/0.76/0.64, respectively), and Mc staging (κ = 0.61/0.46/0.36, respectively). Interobserver agreement for Mb was almost perfect irrespective of prior experience (κ = 0.87/0.91/0.88, respectively). Observers with low experience, when compared with intermediate and high experience, demonstrated significantly lower median overall agreement (54% vs. 66% and 76%, P = 0.041) and specificity for T staging (73% vs. 88% and 93%, P = 0.032). Conclusion: The interpretation of 68Ga-PSMA-11 PET/CT for prostate cancer staging is highly consistent among observers with high levels of experience, especially for nodal and bone assessments. Initial training on at least 30 patient cases is recommended to ensure acceptable performance.

  • prostate cancer
  • agreement
  • reproducibility
  • PET/CT
  • PSMA
  • interobserver

See an invited perspective on this article on page 1615.

The radioligand 68Ga-PSMA-11 (Glu-NH-CO-NH-Lys-(Ahx)-[68Ga(HBED-CC)]) binds with high affinity to prostate-specific membrane antigen (PSMA) (1). High PSMA expression together with little or no background uptake enables accurate imaging of prostate cancer by PET (2,3). Current evidence strongly suggests that 68Ga-PSMA-11 PET/CT adds value to current diagnostic approaches (4). Large, mainly retrospective trials demonstrate superior detection rates and higher accuracy for the localization of biochemical recurrence when compared with morphologic imaging or choline PET/CT (5–9). A recent systematic review supports the use of 68Ga-PSMA-11 PET/CT in patients with biochemical recurrence and low prostate-specific antigen (PSA) values (<2 ng/mL) (10). Moreover, there is evidence for additional value for primary staging (11–13), stratification for PSMA-targeted radioligand therapy, and management of metastatic disease (14–18).

Multicenter trials to evaluate accuracy and impact on management of 68Ga-PSMA-11 PET/CT are currently under way in Europe and the United States (e.g., NCT02940262, NCT02918357, NCT02919111).

Before widespread clinical adoption of PSMA-targeted PET imaging, its interobserver variability and agreement need to be established (19,20). This information has thus far not been available for 68Ga-PSMA-11 PET/CT interpretations. To address this unmet need, we evaluated prospectively the interobserver agreement for 68Ga-PSMA-11 PET/CT interpretations and compared findings among readers with various levels of experience.

MATERIALS AND METHODS

Patients and Standard of Reference (SOR)

From 2 institutional databases (Ludwig-Maximilians-University and Technical University Munich), 50 patients who underwent 68Ga-PSMA-11 PET/CT for the following indications were selected retrospectively: biochemical recurrence (n = 25), primary diagnosis (n = 10), biochemical persistence after primary therapy (n = 5), or staging of known metastatic disease (n = 10). Patient characteristics are given in Table 1. Twenty-five of 50 patients (50%) had histologic verification of PET/CT-positive lesions. In the remaining patients, PSA response after external-beam radiation (n = 15) or 68Ga-PSMA-11 PET/CT follow-up (n = 10) served as SOR. PET/CT-positive lesions were defined during a joint reading session by consensus of 2 expert readers, each with more than 1,000 prior clinical or research 68Ga-PSMA-11 PET/CT interpretations. Expert readers had access to all clinical data. Cases were selected to represent clinical routine, ranging from negative cases (n = 6, 12%) to extensive disease (n = 10, 20%), with typical pitfalls. Pitfalls included 68Ga-PSMA-11 PET/CT false-positive (unspecific bone uptake, n = 4; celiac ganglia, n = 2; inflammatory or postinflammatory, n = 4; benign tumor, n = 2) and false-negative lesions (n = 8) to resemble a total of 20 challenges in 15 patients (Table 2).

View this table:
  • View inline
  • View popup
TABLE 1

Patient Characteristics

View this table:
  • View inline
  • View popup
TABLE 2

Notable Pitfalls for 68Ga-PSMA-11 PET/CT Interpretation Included in Study

The prospective study was approved by the Institutional Review Board at the Ludwig-Maximilians-University Munich, Munich, Germany, and registered in the ISRCTN registry (number ISRCTN13499475).

Image Acquisition and Reconstruction

Patient preparation and image acquisition were performed as previously described (8,13). In brief, 68Ga-PSMA-11 was injected intravenously at a median dose of 182 MBq (interquartile range, 80 MBq) along with 20 mg of furosemide. A median tracer uptake period of 57 min (interquartile range, 14 min) was allowed before imaging with either a Siemens Biograph mCT (n = 22, 44%), Siemens True Point 64 (n = 22, 44%), or GE Discovery 690 (n = 6, 12%) scanner.

In all patients, a diagnostic CT scan (reference mAs, 200–240; 120 kV) was obtained in the portal venous phase 80 s after intravenous injection of contrast agent followed by the PET scan. All patients received diluted oral contrast.

PET images were reconstructed with an axial 168 × 168 matrix based on the TrueX algorithm (3 iterations, 21 subsets; Biograph 64) and a 256 × 256 matrix based on the TrueX algorithm (4 iterations, 8 subsets; Biograph mCT) or on the VUE Point FX algorithm (2 iterations, 36 subsets; Discovery 690).

Observers

Sixteen physicians from 13 centers located in Europe (n = 9), North America (n = 2), Asia (n = 1), and Australia (n = 1) were recruited prospectively as research participants based on their training (nuclear medicine physician or radiologist) and prior experience with PET/CT. The research participants, that is, the observers, reviewed 50 68Ga-PSMA-11 PET/CT datasets. Each dataset included diagnostic CT and attenuation-corrected PET images.

Observers reported the number of previous clinical 68Ga-PSMA-11 PET/CT interpretations. On the basis of this information, observers were classified as having a low (<30 prior 68Ga-PSMA PET/CT studies; n = 5), intermediate (30–300 studies; n = 5), or high level of experience (>300 studies; n = 6).

Guidelines for Visual Interpretation

A written guide (supplemental materials [available at http://jnm.snmjournals.org]), 4 teaching cases, an electronic case report form, and 1 test patient dataset with disclosed data entries were provided to each observer. In addition, observers were asked to learn about 68Ga-PSMA-11 PET/CT pitfalls (21) and the typical nomenclature for lymph node regions (22) to achieve best possible agreement.

The following patient information was disclosed to each observer before image interpretation: indication (biochemical recurrence, primary diagnosis, biochemical persistence after primary therapy, staging of metastatic disease), age (y), weight (kg), injected dose (MBq), uptake time (min), PET/CT device, and PSA level (ng/mL). Observers were masked to all other clinical data. Visual image interpretation for the presence or absence of malignant disease was reported for predefined categories (Supplemental Table 1).

Semiquantitative Measurements

Each observer recorded SUVmax for 1 diseased target region per T, N, Mb, and Mc category. The target region for SUV measurement was automatically identified in the electronic case report form.

Each observer measured background activity by defining SUVmax and SUVmean using a 1.5-cm-diameter circular region of interest placed in the center of the aortic arch and the left gluteus muscle. To exclude variability among different image software used for interpretation, observers were asked to repeat tumor and background SUV for 1 test patient dataset to exclude deviation greater than 10%.

Statistical Analysis and Reference Standard

For binary data, agreement among observer groups was evaluated using Fleiss’ κ (23). For nonbinary data with more than 10 observations, agreement among observer groups was evaluated by intraclass correlation coefficient (ICC) using a 2-way mixed model for absolute agreement (average measures) (24). Ninety-five percent confidence intervals (CIs) are reported for κ and ICC values. Interpretation of κ and ICC was based on a classification provided by Landis and Koch (25): 0.0, poor; 0.0–0.20, slight; 0.21–0.40, fair; 0.41–0.60, moderate; 0.61–0.80, substantial; 0.81–1.00, almost-perfect reproducibility.

Overall agreement, defined as complete agreement of an observer for all categories (T, N, Mb, Mc), and sensitivity and specificity compared with the SOR, respectively, were calculated for each observer. Group median and range were reported for overall agreement, sensitivity, and specificity. Difference between 2 groups was assessed by Student t test. The significance level was 5%.

Discrepancies in semiquantitative measurements between observer groups and the SOR were expressed as mean difference (Δ) ± SD. Statistical analyses were performed using R software (R Core Team 2015, R Foundation for Statistical Computing) with the package “irr” (Gamer et al., version 0.84) for Fleiss’ κ and SPSS (version 15.0; SPSS Inc.) for all other statistical analyses.

At least substantial agreement for visual and semiquantitative interpretation of all scans for the 3 major staging categories (T, N, Mb) was defined as acceptable performance.

RESULTS

Patient Characteristics

Table 1 summarizes the patient characteristics. 68Ga-PSMA-11 PET/CT studies were interpreted as positive for prostate cancer presence in 44 of 50 (88%) patients by the reference readers: local tumor was present in 9 patients (18%); 30 patients (60%) had lymph node (N)–positive disease, whereas 15 (30%) and 6 (12%) were staged as bone (Mb) and organ (Mc) positive, respectively.

Image Interpretation: Interobserver Agreement

The interobserver agreement for visual image interpretation is shown in Figure 1A and Table 3. Highly experienced observers agreed substantially or almost perfectly for all categories (T, N, Mb, Mc). Intermediate- and low-experienced observers provided substantially or almost-perfectly reproducible assessments for the T, N, and Mb categories and N and Mb categories, respectively.

FIGURE 1.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 1.

Interobserver agreement for visual image interpretation. (A) Fleiss’ κ with corresponding 95% CI for T, N, Mb, and Mc staging is shown separately for observer groups. (B) Overall agreement for T, N, Mb, and Mc staging drawn separately for observer groups. High- and intermediate-experience groups had significantly higher agreement than low-experience group (P = 0.041).

View this table:
  • View inline
  • View popup
TABLE 3

Interobserver Agreement for Visual Image Interpretation

Interobserver agreement was analyzed separately for patients with biochemical recurrence or persistence after primary definitive treatment: high-experienced observers agreed substantially or almost perfectly for all categories (T, N, Mb, Mc) whereas intermediate- and low-experienced observers agreed substantially or almost perfectly only for the N and Mb categories, and Mb category, respectively.

Image Interpretation: Comparison to SOR

Median overall agreement with SOR for T, N, Mb, and Mc staging was 69% (range, 48–84) for the entire group of observers. High- or intermediate-experienced observers performed significantly better than low-experienced observers for T, N, Mb, and Mc staging (median, 76 or 66 vs. 54%, P = 0.041; Fig. 1B).

Table 4 summarizes sensitivity and specificity for the entire group and separated for low-, intermediate-, or high-experienced observers, each stratified by staging category. All observer groups were highly sensitive in detection of local tumor. However, on the basis of a higher rate for false-positive local findings, median specificity was significantly lower for observers with low versus intermediate or high experience (73% vs. 88% and 93%, P = 0.032). For lymph node and bone metastases performance compared with the SOR was almost identical (all P > 0.05). In assessing organ metastases, sensitivity was slightly higher for high-experienced observers (median, 58%) versus observers with intermediate or low experience (median, 50%).

View this table:
  • View inline
  • View popup
TABLE 4

Sensitivity and Specificity for Observer with High, Intermediate, or Low Experience and for All Observers (Any)

Three patient examples for low degree of observer agreement are given in Figure 2. Notable sources for disagreement were among other false-negative findings due to low 68Ga-PSMA-11 uptake and false-positive findings due to 68Ga-PSMA-11 uptake in benign entities (Table 2). For instance, low 68Ga-PSMA-11 uptake (SUVmax < 5) in lymph node metastases resulted in false-negative findings in 3 patients for 4 (25%), 8 (50%), and 13 (81%) observers, respectively (Fig. 2A). Degenerative or posttraumatic bone uptake resulted in false-positive Mb stage in 4 patients for 2 (13%), 2 (13%), 11 (69%), and 13 (81%) observers, respectively. Hepatic metastases resulted in false-negative Mc stage in 2 patients for 11 (69%) and 12 (75%) observers, respectively. Metastases to the thyroid cartilage and to the penis in 2 patients were missed by 9 (56%) and 16 (100%) observers, respectively, resulting in false-negative Mc stage. Celiac ganglia with high 68Ga-PSMA-11 uptake in 2 patients resulted in false-positive N stage by 1 (6%) and 9 (56%) observers, respectively.

FIGURE 2.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 2.

68Ga-PSMA-11 PET/CT lymph node and bone findings with low degree of interobserver agreement. Axial fused 68Ga-PSMA-11 PET/CT (middle), PET (left), and CT (right) are shown for 3 patients (1 row per patient). (A) Retroperitoneal lymph node metastasis with low tracer uptake (SUVmax, 4.6; PET arrow) was confirmed by histopathology, however judged negative by 4 of 16 (25%) observers (false negative). (B) Pelvic bone metastasis with small sclerotic lesion (CT arrow) but faint 68Ga-PSMA-11 uptake (SUVmax, 3.7; PET arrow) was confirmed by adequate PSA drop after external-beam radiation therapy, however judged negative by 6 of 16 (38%) observers (false negative). (C) Right L1 hemangioma with moderate uptake (SUVmax, 5.6; PET arrow) was judged positive by 8 of 16 (50%) observers (false positive). Bone metastasis was ruled out by follow-up imaging.

Semiquantitative Measurements

Interobserver agreement including mean Δ differences for SUV measurement is given in Table 5. Agreement was almost perfect for SUVmax of local tumor, lymph node, and bone metastases. Agreement was not associated with tumor lesion uptake (ICC, 1.00 for SUVmax < 10; 0.94 for 10 ≤ SUVmax < 20; 0.98 for SUVmax ≥ 20). SUVmax and SUVmean of mediastinal blood pool and muscle were highly reproducible. Figure 3 illustrates agreement among individual SUV measurements.

View this table:
  • View inline
  • View popup
TABLE 5

Interobserver Agreement for SUVs

FIGURE 3.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 3.

Interobserver agreement for tumor SUVmax shown separately for T (A, n = 184), N (B, n = 401), and Mb (C, n = 203) lesions. SUVs were sorted by SUV obtained from SOR. Dashed diagonal lines indicate perfect agreement. ICC and corresponding 95% CI are given. Two y-axis outliers were drawn in relative position outside scale, and absolute Y value is given. Observers 3 and 7 systematically measured false target bone region and were excluded from SUVmax Mb analysis.

Overall, observers with high or intermediate experience fulfilled our criteria for acceptable performance, whereas observers with low experience did not, based on fair agreement for local staging.

DISCUSSION

This prospective study on 50 68Ga-PSMA-11 PET/CT scans demonstrated that readings are highly reproducible for high- and intermediate-experienced observers. Observers in the low-experience group provided highly reproducible reads for bone metastases but achieved lower agreement for local tumor, lymph node, and organ metastases assessments.

Semiquantitative analyses of tumor lesions and background activity was highly reproducible for all levels of observer experience. On the basis of our predefined criteria, we recommend initial training on at least 30 representative patient cases to reach acceptable diagnostic performance for clinical and research interpretations of 68Ga-PSMA-11 PET/CT scans. Training cases should include routine findings (ranging from unremarkable to extensive disease) and typical pitfalls, such as PET-positive ganglia or degenerative/posttraumatic bone lesions.

Interobserver agreement is an important aspect of clinical applicability. 68Ga-PSMA-11 PET/CT scan interpretation is not without pitfalls: PSMA expression has been observed in tissues other than prostate cancer. Common examples are ganglia, hemangioma, Paget’s bone disease, and other benign and malignant tumors (26–32). Sources of misinterpretations include normal and variable PSMA ligand uptake due to background activity in salivary glands, liver, spleen, small intestine, colon, and kidney or in the urinary system. In general, the list of false-positive pitfalls is still evolving, prompting any clinician to stay vigilant with the current literature. Visceral metastases to the liver can occasionally exhibit no to low uptake, which cannot always be differentiated reliably from background activity. Approximately 5%–10% of all primary prostate cancers as well as their metastases do not exhibit significant PSMA expression (11,33), stressing the importance of reader experience for interpretation of the PET/CT study.

To reduce error rates, reported studies used consensus readings by multiple physicians (7–9,11,34,35). However, this does not solve the issue of observer variability in the clinical setting. The current cases, selected from 2 databases, contained a considerable proportion of pitfalls (Table 2). This approach was chosen to also challenge readers with difficult cases. Despite this additional level of difficulty, readers with intermediate and high experience levels achieved substantial to almost-perfect agreement for all clinically relevant categories.

Intermediate- and low-experienced observers demonstrated substantial or almost-perfect agreement for the N and Mb categories. This may be a result of high tumor-to-background uptake for 68Ga-PSMA-11 and basic understanding of common metastatic pathways. False-positive findings for local involvement with potential implication on management, such as substantial changes of a salvage radiation therapy plan, occurred more often in the low-experience group. Thus observers with low experience (<30 previous 68Ga-PSMA-11 PET/CT readings) showed only moderate interobserver agreement for T staging with somewhat reduced specificity. Indeed, the judgment of local tumor can be challenging because small recurrence frequently occurs near the base of the bladder, causing problems with signal overlay by excreted tracer; and background uptake in normal prostate especially in benign hypertrophy as well as after local radiation therapy decreases signal-to-noise ratio (13,35,36).

Agreement for Mc staging was lower than for T, N, and Mb for all observer groups. In particular, intermediate- and low-experienced observers exhibited only fair to moderate agreement. This is likely due to a low number of observations (6 patients were true positive) combined with the relatively high portion of pitfalls: metastasis in the thyroid cartilage was missed by more than half of observers, especially those with intermediate and low experience. In general, false-negative visceral findings were triggered by reader bias due to low incidence (e.g., 5% in patients with biochemical recurrence (8)) and absent or low PSMA expression (37–39) impeding 68Ga-PSMA-11 PET interpretation.

Observer agreement levels of the current study are in line with PET procedures using high-affinity radioligands. Two recent studies reported almost-perfect reproducibility for 68Ga-DOTATATE PET/CT interpretations (κ = 0.82 and 0.80) in patients with neuroendocrine tumors (40,41). Thus, interpretations of radioligand PET/CT studies in patients with neuroendocrine and prostate cancer, respectively, are equally robust. 68Ga-DOTATATE and 68Ga-PSMA-11 PET/CT are characterized by specific and high tumor signal. These hallmarks contribute to a high level of reader agreement even after short training period.

The present study has several limitations. First, observers were grouped on the basis of experience with 68Ga-PSMA-11 PET/CT interpretation. However, the skill of a reader is determined by multiple factors, including clinical knowledge and general experience in imaging of prostate cancer. This may have led to a relatively broad variance in overall agreement, for example, observed for the low-experienced observers in our study (Fig. 1B). Second, the sensitivities reported might be overestimated because it is difficult to identify false-negative lesions especially in the setting of recurrence when histologic validation is image driven. Third, lymph node metastases within versus outside the pelvis were not separated in our staging system, which was organ-focused to analyze findings based on their PET/CT appearance. American Joint Committee on Cancer staging focuses on patient prognosis and thus discriminates intra- from extrapelvic lymph node metastases. Fourth, intraobserver agreement was not assessed, which might have given insight into reliability and confidence for individual judgments. However, applicability of our findings is supported by selection of representative patients and pitfalls as well as inclusion of a high number of observers from Europe, the United States, Asia, and Australia.

CONCLUSION

Both visual and semiquantitative 68Ga-PSMA-11 PET/CT interpretations in prostate cancer patients are highly reproducible among observers with intermediate and high experience. Our findings indicate acceptable reader performance after initial training on at least 30 representative patient cases.

DISCLOSURE

This study was partially funded by the U.S. Department of Energy, Office of Science Award DE-SC0012353. Wolfgang Peter Fendler received a scholarship from the German Research Foundation (Deutsche Forschungsgemeinschaft, DFG, grant 807122). Jeremie Calais received a grant from the Fondation ARC pour la recherche sur le cancer (grant no. SAE20160604150). No other potential conflict of interest relevant to this article was reported.

Footnotes

  • Published online Apr. 13, 2017.

  • © 2017 by the Society of Nuclear Medicine and Molecular Imaging.

REFERENCES

  1. 1.↵
    1. Eder M,
    2. Schafer M,
    3. Bauder-Wust U,
    4. et al
    . 68Ga-complex lipophilicity and the targeting property of a urea-based PSMA inhibitor for PET imaging. Bioconjug Chem. 2012;23:688–697.
    OpenUrlCrossRefPubMed
  2. 2.↵
    1. Bostwick DG,
    2. Pacelli A,
    3. Blute M,
    4. Roche P,
    5. Murphy GP
    . Prostate specific membrane antigen expression in prostatic intraepithelial neoplasia and adenocarcinoma: a study of 184 cases. Cancer. 1998;82:2256–2261.
    OpenUrlCrossRefPubMed
  3. 3.↵
    1. Mannweiler S,
    2. Amersdorfer P,
    3. Trajanoski S,
    4. Terrett JA,
    5. King D,
    6. Mehes G
    . Heterogeneity of prostate-specific membrane antigen (PSMA) expression in prostate carcinoma with distant metastasis. Pathol Oncol Res. 2009;15:167–172.
    OpenUrlCrossRefPubMed
  4. 4.↵
    1. Perera M,
    2. Papa N,
    3. Christidis D,
    4. et al
    . Sensitivity, specificity, and predictors of positive 68Ga-prostate-specific membrane antigen positron emission tomography in advanced prostate cancer: a systematic review and meta-analysis. Eur Urol. 2016;70:926–937.
    OpenUrl
  5. 5.↵
    1. Afshar-Oromieh A,
    2. Malcher A,
    3. Eder M,
    4. et al
    . PET imaging with a [68Ga]gallium-labelled PSMA ligand for the diagnosis of prostate cancer: biodistribution in humans and first evaluation of tumour lesions. Eur J Nucl Med Mol Imaging. 2013;40:486–495.
    OpenUrlCrossRefPubMed
  6. 6.
    1. Afshar-Oromieh A,
    2. Haberkorn U,
    3. Eder M,
    4. Eisenhut M,
    5. Zechmann CM
    . [68Ga]gallium-labelled PSMA ligand as superior PET tracer for the diagnosis of prostate cancer: comparison with 18F-FECH. Eur J Nucl Med Mol Imaging. 2012;39:1085–1086.
    OpenUrlCrossRefPubMed
  7. 7.↵
    1. Afshar-Oromieh A,
    2. Avtzi E,
    3. Giesel FL,
    4. et al
    . The diagnostic value of PET/CT imaging with the 68Ga-labelled PSMA ligand HBED-CC in the diagnosis of recurrent prostate cancer. Eur J Nucl Med Mol Imaging. 2015;42:197–209.
    OpenUrlCrossRefPubMed
  8. 8.↵
    1. Eiber M,
    2. Maurer T,
    3. Souvatzoglou M,
    4. et al
    . Evaluation of hybrid 68Ga-PSMA ligand PET/CT in 248 patients with biochemical recurrence after radical prostatectomy. J Nucl Med. 2015;56:668–674.
    OpenUrlAbstract/FREE Full Text
  9. 9.↵
    1. Morigi JJ,
    2. Stricker PD,
    3. van Leeuwen PJ,
    4. et al
    . Prospective comparison of 18F-fluoromethylcholine versus 68Ga-PSMA PET/CT in Prostate cancer patients who have rising PSA after curative treatment and are being considered for targeted therapy. J Nucl Med. 2015;56:1185–1190.
    OpenUrlAbstract/FREE Full Text
  10. 10.↵
    1. Evangelista L,
    2. Briganti A,
    3. Fanti S,
    4. et al
    . New clinical indications for 18F/11C-choline, new tracers for positron emission tomography and a promising hybrid device for prostate cancer staging: a systematic review of the literature. Eur Urol. 2016;70:161–175.
    OpenUrlCrossRefPubMed
  11. 11.↵
    1. Maurer T,
    2. Gschwend JE,
    3. Rauscher I,
    4. et al
    . Diagnostic efficacy of 68gallium-PSMA positron emission tomography compared to conventional imaging for lymph node staging of 130 consecutive patients with intermediate to high risk prostate cancer. J Urol. 2016;195:1436–1443.
    OpenUrlCrossRefPubMed
  12. 12.
    1. van Leeuwen PJ,
    2. Emmett L,
    3. Ho B,
    4. et al
    . Prospective evaluation of 68gallium-PSMA positron emission tomography/computerized tomography for preoperative lymph node staging in prostate cancer. BJU Int. 2017;119:209–215.
    OpenUrl
  13. 13.↵
    1. Fendler WP,
    2. Schmidt DF,
    3. Wenter V,
    4. et al
    . 68Ga-PSMA PET/CT Detects the location and extent of primary prostate cancer. J Nucl Med. 2016;57:1720–1725.
    OpenUrlAbstract/FREE Full Text
  14. 14.↵
    1. Kratochwil C,
    2. Giesel FL,
    3. Eder M,
    4. et al
    . [177Lu]lutetium-labelled PSMA ligand-induced remission in a patient with metastatic prostate cancer. Eur J Nucl Med Mol Imaging. 2015;42:987–988.
    OpenUrlCrossRefPubMed
  15. 15.
    1. Rahbar K,
    2. Ahmadzadehfar H,
    3. Kratochwil C,
    4. et al
    . German multicenter study investigating 177Lu-PSMA-617 radioligand therapy in advanced prostate cancer patients. J Nucl Med. 2017;58:85–90.
    OpenUrlAbstract/FREE Full Text
  16. 16.↵
    1. Fendler WP,
    2. Reinhardt S,
    3. Ilhan H,
    4. et al
    . Preliminary experience with dosimetry, response and patient reported outcome after 177Lu-PSMA-617 therapy for metastatic castration-resistant prostate cancer. Oncotarget. 2017;8:3581–3590.
    OpenUrl
  17. 17.
    1. Heck MM,
    2. Retz M,
    3. D’Alessandria C,
    4. et al
    . Systemic radioligand therapy with 177Lu labeled prostate specific membrane antigen ligand for imaging and therapy in patients with metastatic castration resistant prostate cancer. J Urol. 2016;196:382–391.
    OpenUrlCrossRefPubMed
  18. 18.↵
    1. Pyka T,
    2. Okamoto S,
    3. Dahlbender M,
    4. et al
    . Comparison of bone scintigraphy and 68Ga-PSMA PET for skeletal staging in prostate cancer. Eur J Nucl Med Mol Imaging. 2016;43:2114–2121.
    OpenUrl
  19. 19.↵
    1. Reid MC,
    2. Lachs MS,
    3. Feinstein AR
    . Use of methodological standards in diagnostic test research. Getting better but still not good. JAMA. 1995;274:645–651.
    OpenUrlCrossRefPubMed
  20. 20.↵
    1. Bankier AA,
    2. Levine D,
    3. Halpern EF,
    4. Kressel HY
    . Consensus interpretation in imaging research: is there a better way? Radiology. 2010;257:14–17.
    OpenUrlCrossRefPubMed
  21. 21.↵
    1. Rauscher I,
    2. Maurer T,
    3. Fendler WP,
    4. Sommer WH,
    5. Schwaiger M,
    6. Eiber M
    . 68Ga-PSMA ligand PET/CT in patients with prostate cancer: how we review and report. Cancer Imaging. 2016;16:14.
    OpenUrl
  22. 22.↵
    1. Taylor A,
    2. Rockall AG,
    3. Powell ME
    . An atlas of the pelvic lymph node regions to aid radiotherapy target volume definition. Clin Oncol (R Coll Radiol). 2007;19:542–550.
    OpenUrlCrossRefPubMed
  23. 23.↵
    1. Hale CA,
    2. Fleiss JL
    . Interval estimation under two study designs for kappa with binary classifications. Biometrics. 1993;49:523–534.
    OpenUrlCrossRefPubMed
  24. 24.↵
    1. Scheffe H
    . The Analysis of Variance. New York, NY: Wiley; 1959.
  25. 25.↵
    1. Landis JR,
    2. Koch GG
    . The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–174.
    OpenUrlCrossRefPubMed
  26. 26.↵
    1. Krohn T,
    2. Verburg FA,
    3. Pufe T,
    4. et al
    . [68Ga]PSMA-HBED uptake mimicking lymph node metastasis in coeliac ganglia: an important pitfall in clinical practice. Eur J Nucl Med Mol Imaging. 2015;42:210–214.
    OpenUrlCrossRefPubMed
  27. 27.
    1. Sawicki LM,
    2. Buchbender C,
    3. Boos J,
    4. et al
    . Diagnostic potential of PET/CT using a 68Ga-labelled prostate-specific membrane antigen ligand in whole-body staging of renal cell carcinoma: initial experience. Eur J Nucl Med Mol Imaging. 2017;44:102–107.
    OpenUrl
  28. 28.
    1. Verburg FA,
    2. Krohn T,
    3. Heinzel A,
    4. Mottaghy FM,
    5. Behrendt FF
    . First evidence of PSMA expression in differentiated thyroid cancer using [68Ga]PSMA-HBED-CC PET/CT. Eur J Nucl Med Mol Imaging. 2015;42:1622–1623.
    OpenUrlCrossRefPubMed
  29. 29.
    1. Demirci E,
    2. Ocak M,
    3. Kabasakal L,
    4. et al
    . 68Ga-PSMA PET/CT imaging of metastatic clear cell renal cell carcinoma. Eur J Nucl Med Mol Imaging. 2014;41:1461–1462.
    OpenUrlCrossRefPubMed
  30. 30.
    1. Silver DA,
    2. Pellicer I,
    3. Fair WR,
    4. Heston WD,
    5. Cordon-Cardo C
    . Prostate-specific membrane antigen expression in normal and malignant human tissues. Clin Cancer Res. 1997;3:81–85.
    OpenUrlAbstract
  31. 31.
    1. Chang SS,
    2. O’Keefe DS,
    3. Bacich DJ,
    4. Reuter VE,
    5. Heston WD,
    6. Gaudin PB
    . Prostate-specific membrane antigen is produced in tumor-associated neovasculature. Clin Cancer Res. 1999;5:2674–2681.
    OpenUrlAbstract/FREE Full Text
  32. 32.↵
    1. Chang SS,
    2. Reuter VE,
    3. Heston WD,
    4. Bander NH,
    5. Grauer LS,
    6. Gaudin PB
    . Five different anti-prostate-specific membrane antigen (PSMA) antibodies confirm PSMA expression in tumor-associated neovasculature. Cancer Res. 1999;59:3192–3198.
    OpenUrlAbstract/FREE Full Text
  33. 33.↵
    1. Budäus L,
    2. Leyh-Bannurah SR,
    3. Salomon G,
    4. et al
    . Initial Experience of 68Ga-PSMA PET/CT imaging in high-risk prostate cancer patients prior to radical prostatectomy. Eur Urol. 2016;69:393–396.
    OpenUrlCrossRefPubMed
  34. 34.↵
    1. Verburg FA,
    2. Pfister D,
    3. Heidenreich A,
    4. et al
    . Extent of disease in recurrent prostate cancer determined by [68Ga]PSMA-HBED-CC PET/CT in relation to PSA levels, PSA doubling time and Gleason score. Eur J Nucl Med Mol Imaging. 2016;43:397–403.
    OpenUrlCrossRefPubMed
  35. 35.↵
    1. Meredith G,
    2. Wong D,
    3. Yaxley J,
    4. et al
    . The use of 68 Ga-PSMA PET CT in men with biochemical recurrence after definitive treatment of acinar prostate cancer. BJU Int. 2016;118:49–55.
    OpenUrl
  36. 36.↵
    1. Eiber M,
    2. Weirich G,
    3. Holzapfel K,
    4. et al
    . Simultaneous 68Ga-PSMA HBED-CC PET/MRI improves the localization of primary prostate cancer. Eur Urol. 2016;70:829–836.
    OpenUrl
  37. 37.↵
    1. Laidler P,
    2. Dulinska J,
    3. Lekka M,
    4. Lekki J
    . Expression of prostate specific membrane antigen in androgen-independent prostate cancer cell line PC-3. Arch Biochem Biophys. 2005;435:1–14.
    OpenUrlPubMed
  38. 38.
    1. Parimi V,
    2. Goyal R,
    3. Poropatich K,
    4. Yang XJ
    . Neuroendocrine differentiation of prostate cancer: a review. Am J Clin Exp Urol. 2014;2:273–285.
    OpenUrl
  39. 39.↵
    1. Yuan TC,
    2. Veeramani S,
    3. Lin MF
    . Neuroendocrine-like prostate cancer cells: neuroendocrine transdifferentiation of prostate adenocarcinoma cells. Endocr Relat Cancer. 2007;14:531–547.
    OpenUrlAbstract/FREE Full Text
  40. 40.↵
    1. Deppen SA,
    2. Liu E,
    3. Blume JD,
    4. et al
    . Safety and efficacy of 68Ga-DOTATATE PET/CT for diagnosis, staging and treatment management of neuroendocrine tumors. J Nucl Med. 2016;57:708–714.
    OpenUrlAbstract/FREE Full Text
  41. 41.↵
    1. Fendler WP,
    2. Barrio M,
    3. Spick C,
    4. et al
    . 68Ga-DOTATATE PET/CT interobserver agreement for neuroendocrine tumor assessments: results from a prospective study on 50 patients. J Nucl Med. 2017;58:307–311.
    OpenUrlAbstract/FREE Full Text
  • Received for publication January 26, 2017.
  • Accepted for publication April 3, 2017.
PreviousNext
Back to top

In this issue

Journal of Nuclear Medicine: 58 (10)
Journal of Nuclear Medicine
Vol. 58, Issue 10
October 1, 2017
  • Table of Contents
  • Table of Contents (PDF)
  • About the Cover
  • Index by author
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on Journal of Nuclear Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
68Ga-PSMA-11 PET/CT Interobserver Agreement for Prostate Cancer Assessments: An International Multicenter Prospective Study
(Your Name) has sent you a message from Journal of Nuclear Medicine
(Your Name) thought you would like to see the Journal of Nuclear Medicine web site.
Citation Tools
68Ga-PSMA-11 PET/CT Interobserver Agreement for Prostate Cancer Assessments: An International Multicenter Prospective Study
Wolfgang Peter Fendler, Jeremie Calais, Martin Allen-Auerbach, Christina Bluemel, Nina Eberhardt, Louise Emmett, Pawan Gupta, Markus Hartenbach, Thomas A. Hope, Shozo Okamoto, Christian Helmut Pfob, Thorsten D. Pöppel, Christoph Rischpler, Sarah Schwarzenböck, Vanessa Stebner, Marcus Unterrainer, Helle D. Zacho, Tobias Maurer, Christian Gratzke, Alexander Crispin, Johannes Czernin, Ken Herrmann, Matthias Eiber
Journal of Nuclear Medicine Oct 2017, 58 (10) 1617-1623; DOI: 10.2967/jnumed.117.190827

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
68Ga-PSMA-11 PET/CT Interobserver Agreement for Prostate Cancer Assessments: An International Multicenter Prospective Study
Wolfgang Peter Fendler, Jeremie Calais, Martin Allen-Auerbach, Christina Bluemel, Nina Eberhardt, Louise Emmett, Pawan Gupta, Markus Hartenbach, Thomas A. Hope, Shozo Okamoto, Christian Helmut Pfob, Thorsten D. Pöppel, Christoph Rischpler, Sarah Schwarzenböck, Vanessa Stebner, Marcus Unterrainer, Helle D. Zacho, Tobias Maurer, Christian Gratzke, Alexander Crispin, Johannes Czernin, Ken Herrmann, Matthias Eiber
Journal of Nuclear Medicine Oct 2017, 58 (10) 1617-1623; DOI: 10.2967/jnumed.117.190827
Twitter logo Facebook logo LinkedIn logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One
Bookmark this article

Jump to section

  • Article
    • Abstract
    • MATERIALS AND METHODS
    • RESULTS
    • DISCUSSION
    • CONCLUSION
    • DISCLOSURE
    • Footnotes
    • REFERENCES
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • PDF

Related Articles

  • Accuracy in the Eye of the Beholder: Can We Improve Agreement in Prostate Cancer Diagnostics with PSMA PET/CT?
  • This Month in JNM
  • PubMed
  • Google Scholar

Cited By...

  • Fibroblast Activation Protein-Directed Imaging Outperforms 18F-FDG PET/CT in Malignant Mesothelioma: A Prospective, Single-Center, Observational Trial
  • A VISION Substudy of Reader Agreement on 68Ga-PSMA-11 PET/CT Scan Interpretation to Determine Patient Eligibility for 177Lu-PSMA-617 Radioligand Therapy
  • A VISION Substudy of Reader Agreement on 68Ga-PSMA-11 PET/CT Scan Interpretation to Determine Patient Eligibility for 177Lu-PSMA-617 Radioligand Therapy
  • A VISION Substudy of Reader Agreement on 68Ga-PSMA-11 PET/CT Scan Interpretation to Determine Patient Eligibility for 177Lu-PSMA-617 Radioligand Therapy
  • 68Ga-FAPI PET/CT Interobserver Agreement on Tumor Assessment: An International Multicenter Prospective Study
  • Utility of 18F-rhPSMA-7.3 PET for Imaging of Primary Prostate Cancer and Preoperative Efficacy in N-Staging of Unfavorable Intermediate- to Very High-Risk Patients Validated by Histopathology
  • aPROMISE: A Novel Automated PROMISE Platform to Standardize Evaluation of Tumor Burden in 18F-DCFPyL Images of Veterans with Prostate Cancer
  • Identification of PCWG3 Target Populations Is More Accurate and Reproducible with PSMA PET Than with Conventional Imaging: A Multicenter Retrospective Study
  • High Interobserver Agreement for the Standardized Reporting System SSTR-RADS 1.0 on Somatostatin Receptor PET/CT
  • PSMA-Ligand PET for Early Castration-Resistant Prostate Cancer: A Retrospective Single-Center Study
  • Impact of 68Ga-PSMA-11 PET/CT on Staging and Management of Prostate Cancer Patients in Various Clinical Settings: A Prospective Single-Center Study
  • Mapping Prostate Cancer Lesions Before and After Unsuccessful Salvage Lymph Node Dissection Using Repeat PSMA PET
  • Comparison of 3 Interpretation Criteria for 68Ga-PSMA11 PET Based on Inter- and Intrareader Agreement
  • Total-Body 68Ga-PSMA-11 PET/CT for Bone Metastasis Detection in Prostate Cancer Patients: Potential Impact on Bone Scan Guidelines
  • Observer Agreement and Accuracy of 18F-Sodium Fluoride PET/CT in the Diagnosis of Bone Metastases in Prostate Cancer
  • Prostate-Specific Membrane Antigen Ligand Positron Emission Tomography in Men with Nonmetastatic Castration-Resistant Prostate Cancer
  • Intention-to-Treat Analysis of 68Ga-PSMA and 11C-Choline PET/CT Versus CT for Prostate Cancer Recurrence After Surgery
  • 68Ga-PSMA-11 PET/MR Detects Local Recurrence Occult on mpMRI in Prostate Cancer Patients After HIFU
  • Prospective, Multisite, International Comparison of 18F-Fluoromethylcholine PET/CT, Multiparametric MRI, and 68Ga-HBED-CC PSMA-11 PET/CT in Men with High-Risk Features and Biochemical Failure After Radical Prostatectomy: Clinical Performance and Patient Outcomes
  • Interobserver Agreement for the Standardized Reporting System PSMA-RADS 1.0 on 18F-DCFPyL PET/CT Imaging
  • Potential Impact of 68Ga-PSMA-11 PET/CT on the Planning of Definitive Radiation Therapy for Prostate Cancer
  • Aetna and 68Ga-DOTATATE: A Sequel to "The Injustice of Being Judged by the Errors of Others" (1)
  • Prostate Cancer Molecular Imaging Standardized Evaluation (PROMISE): Proposed miTNM Classification for the Interpretation of PSMA-Ligand PET/CT
  • Impact of 68Ga-PSMA-11 PET/CT on the Management of Prostate Cancer Patients with Biochemical Recurrence
  • 68Ga-PSMA-11 PET/CT Mapping of Prostate Cancer Biochemical Recurrence After Radical Prostatectomy in 270 Patients with a PSA Level of Less Than 1.0 ng/mL: Impact on Salvage Radiotherapy Planning
  • Accuracy in the Eye of the Beholder: Can We Improve Agreement in Prostate Cancer Diagnostics with PSMA PET/CT?
  • Google Scholar

More in this TOC Section

Theranostics

  • Determination of the Intralesional Distribution of Theranostic 124I-Omburtamab Convection-Enhanced Delivery in Treatment of Diffuse Intrinsic Pontine Glioma
  • Evidence-Based Clinical Protocols to Monitor Efficacy of [177Lu]Lu-PSMA Radiopharmaceutical Therapy in Metastatic Castration-Resistant Prostate Cancer Using Real-World Data
  • 177Lu-Labeled Anticlaudin 6 Monoclonal Antibody for Targeted Therapy in Esophageal Cancer
Show more Theranostics

Clinical

  • TauIQ: A Canonical Image Based Algorithm to Quantify Tau PET Scans
  • Dual PET Imaging in Bronchial Neuroendocrine Neoplasms: The NETPET Score as a Prognostic Biomarker
  • Addition of 131I-MIBG to PRRT (90Y-DOTATOC) for Personalized Treatment of Selected Patients with Neuroendocrine Tumors
Show more Clinical

Similar Articles

Keywords

  • prostate cancer
  • agreement
  • reproducibility
  • PET/CT
  • PSMA
  • interobserver
SNMMI

© 2025 SNMMI

Powered by HighWire