Skip to main content

Main menu

  • Home
  • Content
    • Current
    • Ahead of print
    • Past Issues
    • JNM Supplement
    • SNMMI Annual Meeting Abstracts
    • Continuing Education
    • JNM Podcasts
  • Subscriptions
    • Subscribers
    • Institutional and Non-member
    • Rates
    • Journal Claims
    • Corporate & Special Sales
  • Authors
    • Submit to JNM
    • Information for Authors
    • Assignment of Copyright
    • AQARA requirements
  • Info
    • Reviewers
    • Permissions
    • Advertisers
  • About
    • About Us
    • Editorial Board
    • Contact Information
  • More
    • Alerts
    • Feedback
    • Help
    • SNMMI Journals
  • SNMMI
    • JNM
    • JNMT
    • SNMMI Journals
    • SNMMI

User menu

  • Subscribe
  • My alerts
  • Log in
  • My Cart

Search

  • Advanced search
Journal of Nuclear Medicine
  • SNMMI
    • JNM
    • JNMT
    • SNMMI Journals
    • SNMMI
  • Subscribe
  • My alerts
  • Log in
  • My Cart
Journal of Nuclear Medicine

Advanced Search

  • Home
  • Content
    • Current
    • Ahead of print
    • Past Issues
    • JNM Supplement
    • SNMMI Annual Meeting Abstracts
    • Continuing Education
    • JNM Podcasts
  • Subscriptions
    • Subscribers
    • Institutional and Non-member
    • Rates
    • Journal Claims
    • Corporate & Special Sales
  • Authors
    • Submit to JNM
    • Information for Authors
    • Assignment of Copyright
    • AQARA requirements
  • Info
    • Reviewers
    • Permissions
    • Advertisers
  • About
    • About Us
    • Editorial Board
    • Contact Information
  • More
    • Alerts
    • Feedback
    • Help
    • SNMMI Journals
  • View or Listen to JNM Podcast
  • Visit JNM on Facebook
  • Join JNM on LinkedIn
  • Follow JNM on Twitter
  • Subscribe to our RSS feeds
Research ArticleBasic Science Investigation

Repeatability of 68Ga-PSMA-HBED-CC PET/CT–Derived Total Molecular Tumor Volume

Robert Seifert, Patrick Sandach, David Kersting, Wolfgang P. Fendler, Boris Hadaschik, Ken Herrmann, John J. Sunderland and Janet H. Pollard
Journal of Nuclear Medicine May 2022, 63 (5) 746-753; DOI: https://doi.org/10.2967/jnumed.121.262528
Robert Seifert
1Department of Nuclear Medicine, University of Duisburg–Essen and German Cancer Consortium–University Hospital, Essen, Germany;
2West German Cancer Center, Essen, Germany;
3Department of Nuclear Medicine, University Hospital Münster, University of Münster, Münster, Germany;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Patrick Sandach
1Department of Nuclear Medicine, University of Duisburg–Essen and German Cancer Consortium–University Hospital, Essen, Germany;
2West German Cancer Center, Essen, Germany;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
David Kersting
1Department of Nuclear Medicine, University of Duisburg–Essen and German Cancer Consortium–University Hospital, Essen, Germany;
2West German Cancer Center, Essen, Germany;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Wolfgang P. Fendler
1Department of Nuclear Medicine, University of Duisburg–Essen and German Cancer Consortium–University Hospital, Essen, Germany;
2West German Cancer Center, Essen, Germany;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Boris Hadaschik
2West German Cancer Center, Essen, Germany;
4Department of Urology, University Hospital Essen, and German Cancer Consortium–University Hospital, Essen, Germany;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ken Herrmann
1Department of Nuclear Medicine, University of Duisburg–Essen and German Cancer Consortium–University Hospital, Essen, Germany;
2West German Cancer Center, Essen, Germany;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
John J. Sunderland
5Department of Radiology, University of Iowa Carver College of Medicine, Iowa City, Iowa; and
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Janet H. Pollard
5Department of Radiology, University of Iowa Carver College of Medicine, Iowa City, Iowa; and
6Department of Radiology, Iowa City Veterans Healthcare Center, Iowa City, Iowa
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • PDF
Loading

Visual Abstract

Figure
  • Download figure
  • Open in new tab
  • Download powerpoint

Abstract

Molecular tumor volume (MTV) is a parameter of interest in prostate cancer for assessing total disease burden on prostate-specific membrane antigen (PSMA) PET. Although software segmentation tools can delineate whole-body MTV, a necessary step toward meaningful monitoring of total tumor burden and treatment response through PET is establishing the repeatability of these metrics. The present study assessed the repeatability of total MTV and related metrics for 68Ga-PSMA-HBED-CC in prostate cancer. Methods: Eighteen patients from a prior repeatability study who underwent 2 test–retest PSMA PET/CT scans within a mean interval of 5 d were reanalyzed. Within-subject coefficient of variation and repeatability coefficients (RCs) were analyzed on a per-lesion and per-patient basis. For the per-lesion analysis, individual lesions were segmented for analysis by a single reader. For the per-patient analysis, subgroups of up to 10 lesions (single reader) and the total tumor volume per patient were segmented (independently by 2 readers). Image parameters were MTV, SUVmax, SUVpeak, SUVmean, total lesion PSMA, and the related metric PSMA quotient (which integrates lesion volume and PSMA avidity). Results: In total, 192 segmentations were analyzed for the per-lesion analysis and 1,662 segmentations for the per-patient analysis (combining the 2 readers and 2 scans). The RC of the MTV of single lesions was 77% (95% CI, 63%–96%). The RC improved to 33% after aggregation of up to 10 manually selected lesions into subgroups assessed per patient (95% CI, 25%–46%). The RC of the semiautomatic MTVtotal (the sum of all voxels in the whole-body total tumor segmentation per patient) was 35% (95% CI, 25%–50%), the Bland-Altman bias was −6.70 (95% CI, −14.32–0.93). Alternating readers between scans led to a comparable RC of 37% (95% CI, 28%–49%) for MTVtotal, meaning that the metric is robust between scanning sessions and between readers. Conclusion: 68Ga-PSMA-HBED-CC PET–derived semiautomatic MTVtotal is repeatable and reader-independent, with a change of ±35% representing a true change in tumor volume. Volumetry of single manually selected lesions has considerably lower repeatability, and volumetry based on subgroups of these lesions, although showing acceptable repeatability, is less systematic. The semiautomatic analysis of MTVtotal used in this study offers an efficient and robust means of assessing response to therapy.

  • PSMA PET
  • tumor volume
  • repeatability

Prostate cancer is a leading cause of death in men (1). Especially in advanced prostate cancer, therapy monitoring is challenging. The blood tumor marker prostate-specific antigen is routinely used to monitor disease progression (2). However, prostate-specific antigen levels may be influenced by tumor dedifferentiation and androgen deprivation therapy, which raises the need for image-based methods for global tumor assessment (3,4). For now, bone scanning and CT are the established methods for assessing treatment response in advanced disease (2). More recently, prostate-specific membrane antigen (PSMA) imaging with PET has been shown to be superior to conventional imaging for both initial and recurrent cancer staging (5,6). Therefore, PSMA PET seems to be a promising methodology to quantify the prostate cancer tumor volume over time.

The recently proposed PSMA PET progression criteria, as well as a recently published consensus meeting, recommended consideration of PSMA PET–derived volumetric measurements to detect progressive disease (7,8). Indeed, several studies have shown that the quantification of the total tumor volume using PSMA PET is feasible and that it is a statistically significant negative predictor for overall survival in patients with advanced prostate cancer (9–12). Total tumor uptake values analogous to total lesion glycolysis for 18F-FDG can also be assessed with PSMA PET.

To date, the repeatability of PSMA PET–derived volumetric and total tumor uptake measurements has not been sufficiently investigated. Previously, Pollard et al. reported 68Ga-PSMA-HBED-CC PET repeatability for SUVmax in bone and nodal metastases from prostate cancer (13). A variety of factors beyond true change in tumor can lead to variability in quantitative PET imaging, including the segmentation methods used. To reliably assess quantitative change between PSMA PET scans, it is necessary to understand the normal variability within the patient, radiotracer, and imaging system. The present study evaluates the repeatability of volumetric and uptake measurements for individual tumors and total tumor volume on test–retest 68Ga-PSMA-HBED-CC PET/CT.

MATERIALS AND METHODS

Patients and Image Acquisition

Eighteen patients were included in the analysis. The institutional review board approved the study protocol (NCT02952469), and all subjects gave written informed consent. Dataset details were previously reported by Pollard et al. in their study of test–retest repeatability (13). Here, the identical dataset was used. Briefly, all patients underwent 2 PSMA PET/CT acquisitions within a mean interval of 5 d (range, 2–14 d). Patient characteristics are shown in Table 1. 68Ga-gallium-PSMA-HBED-CC (also known as PSMA-11 and referred to simply as PSMA in the remainder of this paper) was synthesized as previously published (13). Either a Biograph mCT (with FlowMotion) or a Biograph TruePoint PET/CT system was used for image acquisition (Siemens Healthineers). The follow-up scan was performed on the same scanner as the initial scan. PET data were acquired using a previously published protocol (PET scan starting 60 min after tracer injection with scan coverage from vertex to mid thigh, 3- to 4-min scan time per bed position) (13). A 3-dimensional ordered-subset expectation maximization algorithm was used for image reconstruction (with time-of-flight information in case of the mCT).

View this table:
  • View inline
  • View popup
TABLE 1.

Patient Characteristics and MTVtotal Reported for Each Scan and Reader

Tumor Analysis per Lesion

For the repeatability analysis of individual lesions, up to 10 metastases (skeletal or nodal) or primary tumor lesions were segmented in both the first and second scans by a single reader using a manual segmentation with a 50% isocontour. A single-reader model was chosen for the single-lesion and the subgroup analysis portions of the study. Because the same small number of lesions needed to be selected on each PET scan, the single-reader approach minimized variability introduced by interrater differences in lesion selection and segmentation. Lesions were identified as nonphysiologic sites of uptake with an SUV exceeding the regional background activity. Lesions were selected at random from the regions segmented by the whole-body molecular tumor volume (MTV) analysis, described in detail in the section on total tumor analysis. For each lesion, SUVmax, SUVpeak, SUVmean, lesion MTV (MTVlesion), total lesion PSMA (PSMA-TLlesion), and total lesion quotient (PSMA-TLQlesion) were measured. MTVlesion was determined by the sum of the voxels (Eq. 1) within a threshold 50% isocontour of the local SUVmax. PSMA-TLlesion and PSMA-TLQlesion were calculated as in Equations 2 and 3. Embedded ImageEq. 1 Embedded ImageEq. 2 Embedded ImageEq. 3

Tumor Subgroup Analysis per Patient

One reader manually selected at random a group of up to 10 lesions per patient from the regions segmented by the whole-body MTV analysis technique (described in the next section). In patients with a large number of metastatic lesions, lesions were selected randomly to reflect a broad distribution of anatomic regions. The lesions in this subgroup were individually manually segmented and were assessed as an aggregate. The mean of SUVmax and SUVmean (subgroup mean SUVmax and subgroup mean SUVmean, respectively) were calculated. The sum and mean of MTVlesion, the sum of PSMA-TLlesion, and the sum of PSMA-TLQlesion (MTVsubgroup, subgroup MTVmean, PSMA-TLsubgroup, and PSMA-TLQsubgroup, respectively) were calculated as in Equations 4–7, where n is the number of lesions within the subgroup and i is the ordinal number of the lesion. PSMA-TLlesion is analogous to total lesion glycolysis for 18F-FDG and, when calculated for aggregate tumors, the individual PSMA-TLlesion values are summed. Embedded ImageEq. 4 Embedded ImageEq. 5 Embedded ImageEq. 6 Embedded ImageEq. 7

Total Tumor Analysis per Patient

For the total tumor analysis, all lesions were segmented using a semiautomatic approach as previously published (9). The investigational MICIIS research software prototype was used for the single lesion and total tumor analyses (previously named MI Whole-Body Analysis Suite; Siemens Healthineers). Briefly, all voxels with an SUVpeak exceeding the following liver-specific threshold were selected as candidate foci: Embedded ImageEq. 8where the liver-specific threshold was calculated as previously described and SUVSD is the SD of the SUV distribution in the liver volume of interest (9,10). The threshold described in Equation 8 adjusts for the tumor sink effect, which has a tendency to lower liver uptake; the first part of the formula is a corrective coefficient for the SUV reduction due to the sink effect, and the second part is the calculation for the uncorrected liver threshold. Individual-lesion segmention was based on a threshold 50% isocontour of the local SUVmax. In analogy to the European Association of Nuclear Medicine recommendations for 18F-FDG PET imaging, a threshold 50% isocontour-based approach was chosen for this study (14). Segmentation errors such as inclusion of sites of normal physiologic uptake or exclusion of tumor lesions were adjusted manually. There were no adjustments of segmented tumor contours in addition to inclusion or exclusion of lesions. Example whole-body tumor segmentations and segmentation errors are shown in Figures 1 and 2. Two readers with PET experience independently delineated all tumor lesions, and their delineated PET data were analyzed separately.

FIGURE 1.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 1.

Semiautomatic total tumor segmentations with red overlay designating sites of segmented lesions in scans 1 and 2 for patient with disease limited to prostate and left pelvic lymph nodes (A) and patient with extensive skeletal metastases (B). Interval between scans was 2 d for both patients.

FIGURE 2.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 2.

Examples of segmentation challenges on 68Ga-PSMA-HBED-CC PET/CT. Segmented tumor metastases are shown in red. (A) Metastasis in os ilium was segmented as single lesion on first scan but as 3 separate lesions in second scan (encircled). (B) Metastasis in rib was segmented accurately on first scan but inaccurately on second scan, with isocontour including portion of lung (encircled). Error was resolved manually.

The sum of all voxels in the whole-body total tumor segmentation per patient was designated MTVtotal. The mean of the volume of the individual segmented volumes comprising the MTVtotal was calculated as in Equation 5 and was designated total MTVmean. Likewise, the mean of SUVmax and SUVmean of these component volumes was designated total mean SUVmax and total mean SUVmean, respectively. The PSMA-TLlesion and PSMA-TLQlesion values for the component volumes were summed as in Equations 6 and 7 and were designated PSMA-TLtotal and PSMA-TLQtotal, respectively.

Statistical Analysis

Statistical methods for the sample size of the original dataset used in this analysis were reported by Pollard et al. (13). The Pearson correlation coefficient was used for descriptive statistics. Bland–Altman plots were created for absolute (rather than relative percent) differences in MTVtotal and mean SUVmax (15). Correlation in MTVtotal between readers for the same scan and between scans for the same reader was evaluated with intraclass correlation coefficients. The repeatability assessment using a relative comparison approach was done as described by Obuchowski (16). The within-subject coefficient of variation (wCV) is given by Embedded ImageEq. 9where n is the number of subjects and scans A and B are the quantitative PET measurements from the first and second PET scans, respectively. The repeatability coefficient (RC) is given by Embedded ImageEq. 10The CIs for wCV and RC were determined by bootstrapping with 1,000 replicates. RC variability in relation to lesion SUVmax was evaluated by an exploratory approach for subsets of lesions in multiple steps. For each step, all lesions that had an SUVmax below an arbitrarily defined SUVmax threshold were included. A distinct threshold was used for each step; the lowest SUVmax threshold was 1, and the increment was 5. Statistical analyses were performed using R, version 3.5.2 (The R Foundation, https://www.r-project.org/) and Microsoft Excel 2016, version 16.0.5110.1000. Statistical analysis was done by David Kersting and Robert Seifert.

RESULTS

Test–Retest Scan Parameters

As previously published for the same cohort, the median interval between scans 1 and 2 was 5 d (range, 2–14 d). No statistically significant difference between scans 1 and 2 was observed regarding injected dose (mean, 133.1 vs. 133.1 MBq; P = 1.0) or image delay (mean, 60. 6 vs. 60.7 min; P = 0.9). Patient characteristics are shown in Table 1.

Repeatability of Manually Segmented Individual Lesions

For the per-lesion analysis, 96 metastases from 18 patients were manually delineated by a single reader, resulting in a total number of 192 segmentations from the 2 scans. Segmented lesions were regarded as independent observations. The RCs of MTVlesion and related metrics are shown in Table 2. Linear regression and Bland–Altman scatterplots for MTVlesion on scans 1 and 2 showed a relatively strong correlation (P < 0.001, R2 = 0.85) and no significant bias based on visual analysis (Figs. 3A and 3B). However, MTVlesion demonstrated poor repeatability, with an RC of 76.9% (95% CI, 62.9%–95.9%), and similarly poor repeatability when accounting for differences in lesion volume, with an RC of 64.7% (range, 49.3%–91.6%), for lesions 5 cm3 or larger and 83.9% (range, 65.5%–110.7%) for lesions smaller than 5 cm3. The Bland–Altman bias of MTVlesion was −0.39 (95% CI, −1.00 to 0.22) for all lesions. The deviation in MTVlesion between scans 1 and 2 correlated to a statistically significantly extent with the deviation in SUVmax between scans 1 and 2 (P < 0.001, R2 = 0.17) (Fig. 3C).

View this table:
  • View inline
  • View popup
TABLE 2.

Repeatability of Manually Segmented Individual Lesions (MTVlesion)

FIGURE 3.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 3.

Analysis of individual manually segmented 68Ga-PSMA-HBED-CC–avid lesions. Linear regression and Bland–Altman plots (A and B) of MTVlesion show correlation between scans. (C) Association is noted between MTVlesion and SUVmax changes between scans 1 and 2.

Repeatability of Manually Segmented Subgroup of Lesions per Patient

Given the poor repeatability of MTVlesion, a larger subgroup of manually selected and segmented lesions was evaluated for repeatability per patient. Inclusion of multiple lesions for assessment as a subgroup allows for mitigation of individual lesion variability by averaging positive and negative variation across a larger number of lesions. The repeatability of MTVsubgroup and related metrics is presented in Table 3. MTVsubgroup demonstrated improved repeatability, with an RC of 33.1% (95% CI, 24.2%–46.2%), compared with MTVlesion and showed a repeatability comparable to that of the semiautomatic whole-body approach of MTVtotal. The Bland–Altman bias of MTVsubgroup was −2.32 (95% CI, −5.81 to 1.17). Supplemental Table 1 shows the association of RC, with SUVmax RC decreasing with increasing minimum SUVmax of segmented lesions (supplemental materials are available at http://jnm.snmjournals.org). This finding indicates that the repeatability was better when lesions with a low SUVmax were discarded from the manually segmented subgroup of lesions.

View this table:
  • View inline
  • View popup
TABLE 3.

Repeatability of Manually Selected Lesion Subgroup per Patient (MTVsubgroup)

Repeatability of Semiautomatic Segmentation of Total Tumor Volume per Patient

In total, 1,662 segmentations were performed for the per-patient analysis, including segmentations for the 2 readers and 2 scans. The MTVtotal for each reader for scans 1 and 2 is presented in Table 1. The RCs of the whole-body MTVtotal and related metrics are shown separately for both readers in Table 4. The RC of MTVtotal was 35.0% (95% CI, 24.9%–49.7%) in mean; the RCs for each reader were 37% and 33%. Linear regression and Bland–Altman scatterplots for MTVtotal and mean SUVmax for scans 1 and 2 showed a strong correlation (P < 0.001, R2 = 0.99) and no significant bias based on visual analysis (Fig. 4). The corresponding Bland–Altman bias of MTVtotal was −6.70 (95% CI, −14.32 to 0.93). The RC of MTVtotal and related metrics remained robust even when readers were hypothetically exchanged between scan timepoints with an RC of MTVtotal of 37.3% (95% CI, 27.9%–49.3%) (Table 5). A high correlation of MTVtotal between scans for the same reader (intraclass correlation coefficient, 0.998; P < 0.001) and between readers for the same scan (intraclass correlation coefficient, 0.993; P < 0.001) was noted (Fig. 5). MTVtotal showed a moderate correlation with prostate-specific antigen values (P < 0.002, R2 = 0.53) (Fig. 6). Other metrics using the semiautomatic technique, such as total mean SUVmax, total mean SUVmean, and PSMA-TLtotal, also showed improved repeatability as compared with individual lesion segmentation, with RC ranging from 23.6% to 28.4%.

View this table:
  • View inline
  • View popup
TABLE 4.

Repeatability of Semiautomatic MTVtotal per Patient

FIGURE 4.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 4.

Analysis of semiautomatic whole-body segmentation of 68Ga-PSMA-HBED-CC–avid lesions. Linear regression (A and C) and Bland–Altman plots (B and D) of MTVtotal and mean SUVmax show excellent correlation between scans and suggest no association between total tumor volume or lesion intensity and test–retest differences. Results for readers 1 and 2 were averaged for purposes of these graphs. (A and C) MTVtotal and mean SUVmax for scan 1 are plotted separately against same metric for scan 2. (B and D) Mean of MTVtotal or mean SUVmax between scans 1 and 2 was plotted against absolute difference in metric between 2 scans.

View this table:
  • View inline
  • View popup
TABLE 5.

Repeatability of MTVtotal with Different Readers Between Scans

FIGURE 5.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 5.

Graphical analysis of intra- and interreader agreement in reporting MTVtotal, showing high correlation in measures between scans 1 and 2 for same reader (reader 1) (A) and showing high correlation in measures between 2 independent readers for same scan (scan 1) (B).

FIGURE 6.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 6.

Graphical analysis of prostate-specific antigen vs. MTVtotal, with log–log plot showing moderate correlation.

DISCUSSION

PSMA PET is now widely used to monitor patients with prostate cancer (5,6,17,18). Especially for recurrent prostate cancer, PSMA PET has demonstrated high sensitivity and specificity for localizing prostate cancer cells in the body (5,6). Growing evidence suggests that PSMA PET is also a useful clinical tool in patients with more advanced prostate cancer (19–21).

Measures of total tumor volume and total uptake on PSMA PET have been described, but its use in prostate cancer monitoring remains under debate (9,10). Analogous to the TNM system, a molecular imaging TNM (miTNM) system has been proposed, which scores extent of disease with regard to local tumor, regional lymph node metastases, bone metastases, and other distant metastases. (22). Given the distinct biologic aggressiveness and survival implications of various metastatic sites, the TNM-based system will likely remain an important prognostic tool in prostate cancer (23). However, because progressive disease is not always accompanied only by the occurrence of new metastases but also can include enlargement of existing metastases, the best assessment tools would therefore encompass assessment of both anatomic and total tumor volume, enabling consideration of both global disease status and aggressiveness of the involved sites. Studies have shown the prognostic value of PET volumetry and measures of total uptake. PSMA MTVtotal of high volume disease is a statistically significant poor prognostic factor for overall survival, and PSMA uptake of all metastases (SUVmean per patient) improves prognostication of overall survival in patients treated with 177Lu-lutetium-PSMA-617 therapy (12,24–27).

The recently proposed PSMA PET progression criteria recommend assuming progressive prostate cancer in the setting of a 30% tumor volume increase (8). However, this threshold was chosen arbitrarily in the absence of volume-based PSMA repeatability data. Also, there are currently no consensus recommendations for PSMA PET segmentation algorithms among the various approaches that have been proposed for quantifying the PSMA tumor volume (9,10). A necessary step toward use of PSMA PET for reliable monitoring of disease is development of reliable and efficient methods for measuring total disease burden and determination of their repeatability.

Our analysis of repeatability evaluated PET volumetric and uptake measures using 3 different approaches to segmentation: manual segmentation of individual tumors, manual selection of a subgroup of tumors per patient, and semiautomatic segmentation of total tumor burden per patient. The repeatability of individual tumor volumes (MTVlesion) was poor (RC, 77%). An explanation may be that the reported wCV for SUVmax (12%–14%, Pollard et al. (13)), combined with a volumetric measurement in which a small change in radius from the 50% SUVmax threshold results in a large change in volume, predictably results in large variability. Therefore, monitoring disease on the basis of individual manually segmented tumors does not appear to be a reliable marker for treatment response. The RC for subgroup MTVmean and total MTVmean was 33% and 35%, respectively, which is similar to that reported in the literature for 18F-FDG for other cancers (28,29). An MTV based on a larger sample of tumors or total tumor volume rather than individual tumors appears to be more reliable, likely because the noise-sensitive SUVmax-based thresholds and resulting volume differences have both plus and minus biases across all lesions, resulting in a tendency to cancel out. Although robust, the method based on selection of a subgroup of tumors would be time-consuming in clinical practice and prone to bias in lesion selection. Because of the limited data available, no clear recommendation for a minimum number of lesions for the subgroup of lesions can be made; moreover, the repeatability of quantified volume is likely influenced by the characteristics of the chosen lesions (e.g., lesion size and tissue type). MTVtotal remains robust even when alternating readers between baseline and follow-up scans, suggesting that this method would hold up in clinical practice when scans are not always read by the same person. Therefore, the standardized semiautomatic segmentation method for MTVtotal proposed by Seifert et al., which worked well in this study, may be a solution (9). Future investigation should focus on the fully automatic analysis of PSMA PET scans in analogy to 18F-FDG PET approaches (30). MTVtotal showed a moderate correlation with prostate-specific antigen, suggesting that further assessment of this metric for use as a surrogate biomarker for disease status is warranted.

Besides volumetry, we evaluated SUV measures, which showed repeatability similar to that reported by Pollard et al. (13). We also evaluated PSMA-TL and PSMA-TLQ, metrics that integrate tumor volume and uptake analogous to total lesion glycolysis for 18F-FDG. These metrics showed poor repeatability in individual lesions, but improved repeatability for the subgroup of tumors and total tumor burden, and thus warrant further investigation (12). Interestingly, PMA-TLQ had greater variability than PSMA-TL. This might be partly explained by the fact that the tumor volume is normalized with the relatively stable (i.e., high-repeatability) SUVmean. Thereby, changes in the tumor volume have a larger influence on the resulting composite metric.

The present study had some limitations. The fact that patient number was relatively small might influence the translatability to a larger patient population. The results might not be directly translatable to other PSMA ligands, especially to those that are conjugates with nongallium radioisotopes. The segmentation technique may cause difficulties when single lesions are segmented separately in follow-up scans or when confluent lesions occur (Fig. 2). However, manual user-dependent adjustments can eliminate those artifacts. Finally, the test–retest dataset was performed under carefully controlled conditions (e.g., ensuring the same scanner for scans 1 and 2, minimizing variation in uptake time and dose), which do not reflect the potential variations encountered in the real-world clinic setting.

CONCLUSION

68Ga-PSMA-HBED-CC PET–derived MTVtotal with semiautomatic whole-body segmentation is highly repeatable and suitable for monitoring disease in advanced prostate cancer. Other methods evaluated in this study, such as single-lesion volumes and subgroup of lesions per patient, are limited by inferior repeatability (MTVlesion) or labor intensiveness (MTVsubgroup). MTVtotal therefore presents an efficient and robust means of monitoring disease longitudinally. A change of greater than 35% in the magnitude of MTVtotal can be viewed as a real change in tumor status progression or response to therapy.

DISCLOSURE

Janet H. Pollard has been an investigator for Progenics (Advanced Accelerator Applications) and Endocyte (Novartis) and has received compensation for work done for KEOSYS/Exini. Boris Hadaschik reports a consulting or advisory role at ABX, Astellas Pharma, Bayer, Bristol-Myers Squibb, Janssen, and Lightpoint Medical, Inc.; research funding from Astellas Pharma, Bristol-Myers Squibb, German Cancer Aid, and the German Research Foundation; and travel accommodations and expenses from Astellas Pharma, AstraZeneca, and Janssen. Wolfgang Fendler was a consultant for BTG and received fees from RadioMedix, Bayer, and Parexel outside the submitted work. No other potential conflict of interest relevant to this article was reported.

KEY POINTS

QUESTION: What is the estimated test–retest repeatability of whole-body MTVtotal for 68Ga-PSMA-HBED-CC PET/CT in patients with metastatic prostate cancer?

PERTINENT FINDINGS: This study evaluated the test–retest repeatability of semiautomatic segmentation of whole-body MTVtotal, showing a wCV of 12.7% and an RC of ±35%. The repeatability of manually segmented individual tumors (MTVlesion) was poor, whereas the repeatability of a manually selected subgroup of tumors per patient (MTVsubgroup) was robust but limited by labor intensiveness.

IMPLICATIONS FOR PATIENT CARE: Understanding test–retest repeatability for metrics of metastatic disease burden is important for the development of 68Ga PSMA HBED-CC PET/CT as a quantitative imaging biomarker. This study suggests that semiautomatically segmented whole-body MTVtotal is efficient and robust for monitoring disease status.

Footnotes

  • Published online Aug. 26, 2021.

  • © 2022 by the Society of Nuclear Medicine and Molecular Imaging.

REFERENCES

  1. 1.↵
    1. Siegel RL,
    2. Miller KD,
    3. Jemal A.
    Cancer statistics, 2020. CA Cancer J Clin. 2020;70:7–30.
    OpenUrlCrossRefPubMed
  2. 2.↵
    1. Scher HI,
    2. Morris MJ,
    3. Stadler WM,
    4. et al
    . Trial design and objectives for castration-resistant prostate cancer: updated recommendations from the prostate cancer clinical trials working group 3. J Clin Oncol. 2016;34:1402–1418.
    OpenUrlAbstract/FREE Full Text
  3. 3.↵
    1. Denmeade SR,
    2. Sokoll LJ,
    3. Dalrymple S,
    4. et al
    . Dissociation between androgen responsiveness for malignant growth vs. expression of prostate specific differentiation markers PSA, hK2, and PSMA in human prostate cancer models. Prostate. 2003;54:249–257.
    OpenUrlCrossRefPubMed
  4. 4.↵
    1. Yuan TC,
    2. Veeramani S,
    3. Lin MF.
    Neuroendocrine-like prostate cancer cells: neuroendocrine transdifferentiation of prostate adenocarcinoma cells. Endocr Relat Cancer. 2007;14:531–547.
    OpenUrlAbstract/FREE Full Text
  5. 5.↵
    1. Fendler WP,
    2. Calais J,
    3. Eiber M,
    4. et al
    . Assessment of 68Ga-PSMA-11 PET accuracy in localizing recurrent prostate cancer: a prospective single-arm clinical trial. JAMA Oncol. 2019;5:856–863.
    OpenUrl
  6. 6.↵
    1. Hofman MS,
    2. Lawrentschuk N,
    3. Francis RJ,
    4. et al
    . Prostate-specific membrane antigen PET-CT in patients with high-risk prostate cancer before curative-intent surgery or radiotherapy (proPSMA): a prospective, randomised, multicentre study. Lancet. 2020;395:1208–1216.
    OpenUrlCrossRefPubMed
  7. 7.↵
    1. Fanti S,
    2. Goffin K,
    3. Hadaschik BA,
    4. et al
    . Consensus statements on PSMA PET/CT response assessment criteria in prostate cancer. Eur J Nucl Med Mol Imaging. 2021;48:469–476.
    OpenUrl
  8. 8.↵
    1. Fanti S,
    2. Hadaschik B,
    3. Herrmann K.
    Proposal for systemic-therapy response-assessment criteria at the time of PSMA PET/CT imaging: the PSMA PET progression criteria. J Nucl Med. 2020;61:678–682.
    OpenUrlAbstract/FREE Full Text
  9. 9.↵
    1. Seifert R,
    2. Herrmann K,
    3. Kleesiek J,
    4. et al
    . Semiautomatically quantified tumor volume using 68Ga-PSMA-11 PET as a biomarker for survival in patients with advanced prostate cancer. J Nucl Med. 2020;61:1786– 1792 .
    OpenUrlAbstract/FREE Full Text
  10. 10.↵
    1. Gafita A,
    2. Bieth M,
    3. Krönke M,
    4. et al
    . qPSMA: semiautomatic software for whole-body tumor burden assessment in prostate cancer using 68Ga-PSMA11 PET/CT. J Nucl Med. 2019;60:1277–1283.
    OpenUrl
  11. 11.
    1. Grubmüller B,
    2. Senn D,
    3. Kramer G,
    4. et al
    . Response assessment using 68Ga-PSMA ligand PET in patients undergoing 177Lu-PSMA radioligand therapy for metastatic castration-resistant prostate cancer. Eur J Nucl Med Mol Imaging. 2019;46:1063–1072.
    OpenUrl
  12. 12.↵
    1. Seifert R,
    2. Kessel K,
    3. Schlack K,
    4. et al
    . PSMA PET total tumor volume predicts outcome of patients with advanced prostate cancer receiving [177Lu]Lu-PSMA-617 radioligand therapy in a bicentric analysis. Eur J Nucl Med Mol Imaging. 2021;48:1200–1210.
  13. 13.↵
    1. Pollard JH,
    2. Raman C,
    3. Zakharia Y,
    4. et al
    . Quantitative test-retest measurement of 68Ga-PSMA-HBED-CC in tumor and normal tissue. J Nucl Med. 2020;61:1145–1152.
    OpenUrl
  14. 14.↵
    1. Boellaard R,
    2. Delgado-Bolton R,
    3. Oyen WJG,
    4. et al
    . FDG PET/CT: EANM procedure guidelines for tumour imaging—version 2.0. Eur J Nucl Med Mol Imaging. 2015;42:328–354.
    OpenUrlCrossRefPubMed
  15. 15.↵
    1. Bland JM,
    2. Altman DG.
    Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1:307–310.
    OpenUrlCrossRefPubMed
  16. 16.↵
    1. Obuchowski NA.
    Interpreting change in quantitative imaging biomarkers. Acad Radiol. 2018;25:372–379.
    OpenUrl
  17. 17.↵
    1. Rahbar K,
    2. Afshar-Oromieh A,
    3. Jadvar H,
    4. Ahmadzadehfar H.
    PSMA theranostics: current status and future directions. Mol Imaging. 2018;17:1536012118776068.
    OpenUrl
  18. 18.↵
    1. Rahbar K,
    2. Weckesser M,
    3. Ahmadzadehfar H,
    4. Schafers M,
    5. Stegger L,
    6. Bogemann M.
    Advantage of 18F-PSMA-1007 over 68Ga-PSMA-11 PET imaging for differentiation of local recurrence vs. urinary tracer excretion. Eur J Nucl Med Mol Imaging. 2018;45:1076–1077.
    OpenUrl
  19. 19.↵
    1. Fendler WP,
    2. Weber M,
    3. Iravani A,
    4. et al
    . Prostate-specific membrane antigen ligand positron emission tomography in men with nonmetastatic castration-resistant prostate cancer. Clin Cancer Res. 2019;25:7448–7454.
    OpenUrlAbstract/FREE Full Text
  20. 20.
    1. Farolfi A,
    2. Hirmas N,
    3. Gafita A,
    4. et al
    . Identification of PCWG3 target populations is more accurate and reproducible with PSMA PET than with conventional imaging: a multicenter retrospective study. J Nucl Med. 2021;62:675–678.
    OpenUrlAbstract/FREE Full Text
  21. 21.↵
    1. Weber M,
    2. Kurek C,
    3. Barbato F,
    4. et al
    . PSMA-ligand PET for early castration-resistant prostate cancer: a retrospective single-center study. J Nucl Med. 2021;62:88–91.
    OpenUrlAbstract/FREE Full Text
  22. 22.↵
    1. Eiber M,
    2. Herrmann K,
    3. Calais J,
    4. et al
    . Prostate cancer molecular imaging standardized evaluation (PROMISE): proposed miTNM classification for the interpretation of PSMA-ligand PET/CT. J Nucl Med. 2018;59:469–478.
    OpenUrlAbstract/FREE Full Text
  23. 23.↵
    1. Halabi S,
    2. Kelly WK,
    3. Ma H,
    4. et al
    . Meta-analysis evaluating the impact of site of metastasis on overall survival in men with castration-resistant prostate cancer. J Clin Oncol. 2016;34:1652–1659.
    OpenUrlAbstract/FREE Full Text
  24. 24.↵
    1. Kyriakopoulos CE,
    2. Chen Y-H,
    3. Carducci MA,
    4. et al
    . Chemohormonal therapy in metastatic hormone-sensitive prostate cancer: long-term survival analysis of the randomized phase III E3805 CHAARTED trial. J Clin Oncol. 2018;36:1080–1087.
    OpenUrlCrossRefPubMed
  25. 25.
    1. Chi KN,
    2. Agarwal N,
    3. Bjartell A,
    4. et al
    . Apalutamide for metastatic, castration-sensitive prostate cancer. N Engl J Med. 2019;381:13–24.
    OpenUrlCrossRefPubMed
  26. 26.
    1. Sweeney CJ,
    2. Chen Y-H,
    3. Carducci M,
    4. et al
    . Chemohormonal therapy in metastatic hormone-sensitive prostate cancer. N Engl J Med. 2015;373:737–746.
    OpenUrlCrossRefPubMed
  27. 27.↵
    1. Seifert R,
    2. Seitzer K,
    3. Herrmann K,
    4. et al
    . Analysis of PSMA expression and outcome in patients with advanced prostate cancer receiving 177Lu-PSMA-617 radioligand therapy. Theranostics. 2020;10:7812–7820.
    OpenUrl
  28. 28.↵
    1. Kramer GM,
    2. Frings V,
    3. Hoetjes N,
    4. et al
    . Repeatability of quantitative whole-body 18F-FDG PET/CT uptake measures as function of uptake interval and lesion selection in non-small cell lung cancer patients. J Nucl Med. 2016;57:1343–1349.
    OpenUrlAbstract/FREE Full Text
  29. 29.↵
    1. Kruse V,
    2. Mees G,
    3. Maes A,
    4. et al
    . Reproducibility of FDG PET based metabolic tumor volume measurements and of their FDG distribution within. Q J Nucl Med Mol Imaging. 2015;59:462–468.
    OpenUrl
  30. 30.↵
    1. Sibille L,
    2. Seifert R,
    3. Avramovic N,
    4. et al
    . 18F-FDG PET/CT uptake classification in lymphoma and lung cancer by using deep convolutional neural networks. Radiology. 2020;294:445–452.
    OpenUrl
  • Received for publication May 3, 2021.
  • Revision received August 5, 2021.
PreviousNext
Back to top

In this issue

Journal of Nuclear Medicine: 63 (5)
Journal of Nuclear Medicine
Vol. 63, Issue 5
May 1, 2022
  • Table of Contents
  • Table of Contents (PDF)
  • About the Cover
  • Index by author
  • Complete Issue (PDF)
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on Journal of Nuclear Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Repeatability of 68Ga-PSMA-HBED-CC PET/CT–Derived Total Molecular Tumor Volume
(Your Name) has sent you a message from Journal of Nuclear Medicine
(Your Name) thought you would like to see the Journal of Nuclear Medicine web site.
Citation Tools
Repeatability of 68Ga-PSMA-HBED-CC PET/CT–Derived Total Molecular Tumor Volume
Robert Seifert, Patrick Sandach, David Kersting, Wolfgang P. Fendler, Boris Hadaschik, Ken Herrmann, John J. Sunderland, Janet H. Pollard
Journal of Nuclear Medicine May 2022, 63 (5) 746-753; DOI: 10.2967/jnumed.121.262528

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Repeatability of 68Ga-PSMA-HBED-CC PET/CT–Derived Total Molecular Tumor Volume
Robert Seifert, Patrick Sandach, David Kersting, Wolfgang P. Fendler, Boris Hadaschik, Ken Herrmann, John J. Sunderland, Janet H. Pollard
Journal of Nuclear Medicine May 2022, 63 (5) 746-753; DOI: 10.2967/jnumed.121.262528
Twitter logo Facebook logo LinkedIn logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One
Bookmark this article

Jump to section

  • Article
    • Visual Abstract
    • Abstract
    • MATERIALS AND METHODS
    • RESULTS
    • DISCUSSION
    • CONCLUSION
    • DISCLOSURE
    • Footnotes
    • REFERENCES
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • PDF

Related Articles

  • PubMed
  • Google Scholar

Cited By...

  • Evaluation of 177Lu-PSMA-617 SPECT/CT Quantitation as a Response Biomarker Within a Prospective 177Lu-PSMA-617 and NOX66 Combination Trial (LuPIN)
  • The VISION Forward: Recognition and Implication of PSMA-/18F-FDG+ mCRPC
  • Google Scholar

More in this TOC Section

  • [11C]ZTP-1: An Effective Short-Lived Radioligand for PET of Rat and Monkey Brain Phosphodiesterase Type 4 Subtype B
  • Reduced Renal Uptake of Various Radiopharmaceuticals with Sodium Paraaminohippurate Coadministration in a Rat Model
  • In Vivo Visualization and Quantification of Brain Heat Shock Protein 90 with [11C]HSP990 in Healthy Aging and Neurodegeneration
Show more Basic Science Investigation

Similar Articles

Keywords

  • PSMA PET
  • tumor volume
  • repeatability
SNMMI

© 2025 SNMMI

Powered by HighWire