Skip to main content

Main menu

  • Home
  • Content
    • Current
    • Ahead of print
    • Past Issues
    • JNM Supplement
    • SNMMI Annual Meeting Abstracts
    • Continuing Education
    • JNM Podcasts
  • Subscriptions
    • Subscribers
    • Institutional and Non-member
    • Rates
    • Journal Claims
    • Corporate & Special Sales
  • Authors
    • Submit to JNM
    • Information for Authors
    • Assignment of Copyright
    • AQARA requirements
  • Info
    • Reviewers
    • Permissions
    • Advertisers
  • About
    • About Us
    • Editorial Board
    • Contact Information
  • More
    • Alerts
    • Feedback
    • Help
    • SNMMI Journals
  • SNMMI
    • JNM
    • JNMT
    • SNMMI Journals
    • SNMMI

User menu

  • Subscribe
  • My alerts
  • Log in
  • My Cart

Search

  • Advanced search
Journal of Nuclear Medicine
  • SNMMI
    • JNM
    • JNMT
    • SNMMI Journals
    • SNMMI
  • Subscribe
  • My alerts
  • Log in
  • My Cart
Journal of Nuclear Medicine

Advanced Search

  • Home
  • Content
    • Current
    • Ahead of print
    • Past Issues
    • JNM Supplement
    • SNMMI Annual Meeting Abstracts
    • Continuing Education
    • JNM Podcasts
  • Subscriptions
    • Subscribers
    • Institutional and Non-member
    • Rates
    • Journal Claims
    • Corporate & Special Sales
  • Authors
    • Submit to JNM
    • Information for Authors
    • Assignment of Copyright
    • AQARA requirements
  • Info
    • Reviewers
    • Permissions
    • Advertisers
  • About
    • About Us
    • Editorial Board
    • Contact Information
  • More
    • Alerts
    • Feedback
    • Help
    • SNMMI Journals
  • View or Listen to JNM Podcast
  • Visit JNM on Facebook
  • Join JNM on LinkedIn
  • Follow JNM on Twitter
  • Subscribe to our RSS feeds
Research ArticleOncology

Reproducibility and Repeatability of Semiquantitative 18F-Fluorodihydrotestosterone Uptake Metrics in Castration-Resistant Prostate Cancer Metastases: A Prospective Multicenter Study

Hebert Alberto Vargas, Gem M. Kramer, Andrew M. Scott, Andrew Weickhardt, Andreas A. Meier, Nicole Parada, Bradley J. Beattie, John L. Humm, Kevin D. Staton, Pat B. Zanzonico, Serge K. Lyashchenko, Jason S. Lewis, Maqsood Yaqub, Ramon E. Sosa, Alfons J. van den Eertwegh, Ian D. Davis, Uwe Ackermann, Kunthi Pathmaraj, Robert C. Schuit, Albert D. Windhorst, Sue Chua, Wolfgang A. Weber, Steven M. Larson, Howard I. Scher, Adriaan A. Lammertsma, Otto S. Hoekstra and Michael J. Morris
Journal of Nuclear Medicine October 2018, 59 (10) 1516-1523; DOI: https://doi.org/10.2967/jnumed.117.206490
Hebert Alberto Vargas
1Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, New York
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Gem M. Kramer
2Department of Radiology and Nuclear Medicine, VU University Medical Centre, Amsterdam, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Andrew M. Scott
3Department of Molecular Imaging and Therapy, The University of Melbourne, Heidelberg, Victoria, Australia
4Department of Medicine, The University of Melbourne, Olivia Newton-John Cancer Research Institute, and La Trobe University, Austin Hospital, Heidelberg, Victoria, Australia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Andrew Weickhardt
5Department of Medical Oncology, Olivia Newton-John Cancer Research Institute, Austin Hospital, Melbourne, Victoria, Australia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Andreas A. Meier
1Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, New York
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nicole Parada
6Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, New York
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Bradley J. Beattie
7Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, New York
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
John L. Humm
7Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, New York
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kevin D. Staton
1Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, New York
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Pat B. Zanzonico
1Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, New York
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Serge K. Lyashchenko
1Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, New York
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jason S. Lewis
1Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, New York
8Department of Radiology, Weill Cornell Medicine, New York, New York
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Maqsood Yaqub
2Department of Radiology and Nuclear Medicine, VU University Medical Centre, Amsterdam, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ramon E. Sosa
1Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, New York
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Alfons J. van den Eertwegh
9Department of Medical Oncology, VU University Medical Centre, Amsterdam, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ian D. Davis
10Monash University and Eastern Health, Eastern Health Clinical School, Box Hill, Australia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Uwe Ackermann
11Department of Nuclear Medicine and Centre for PET, Austin Health, Heidelberg, Victoria, Australia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kunthi Pathmaraj
11Department of Nuclear Medicine and Centre for PET, Austin Health, Heidelberg, Victoria, Australia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Robert C. Schuit
2Department of Radiology and Nuclear Medicine, VU University Medical Centre, Amsterdam, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Albert D. Windhorst
2Department of Radiology and Nuclear Medicine, VU University Medical Centre, Amsterdam, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sue Chua
12Department of Nuclear Medicine, Royal Marsden NHS Foundation Trust, Sutton, United Kingdom; and
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Wolfgang A. Weber
1Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, New York
8Department of Radiology, Weill Cornell Medicine, New York, New York
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Steven M. Larson
1Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, New York
8Department of Radiology, Weill Cornell Medicine, New York, New York
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Howard I. Scher
6Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, New York
13Department of Medicine, Weill Cornell Medicine, New York, New York
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Adriaan A. Lammertsma
2Department of Radiology and Nuclear Medicine, VU University Medical Centre, Amsterdam, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Otto S. Hoekstra
2Department of Radiology and Nuclear Medicine, VU University Medical Centre, Amsterdam, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Michael J. Morris
6Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, New York
13Department of Medicine, Weill Cornell Medicine, New York, New York
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • PDF
Loading

Abstract

18F-fluorodihydrotestosterone (18F-FDHT) is a radiolabeled analog of the androgen receptor’s primary ligand that is currently being credentialed as a biomarker for prognosis, response, and pharmacodynamic effects of new therapeutics. As part of the biomarker qualification process, we prospectively assessed its reproducibility and repeatability in men with metastatic castration-resistant prostate cancer. Methods: We conducted a prospective multiinstitutional study of metastatic castration-resistant prostate cancer patients undergoing 2 (test/retest) 18F-FDHT PET/CT scans on 2 consecutive days. Two independent readers evaluated all examinations and recorded SUVs, androgen receptor–positive tumor volumes, and total lesion uptake for the most avid lesion detected in each of 32 predefined anatomic regions. The relative absolute difference and reproducibility coefficient (RC) of each metric were calculated between the test and retest scans. Linear regression analyses, intraclass correlation coefficients (ICCs), and Bland–Altman plots were used to evaluate repeatability of 18F-FDHT metrics. The coefficient of variation and ICC were used to assess interobserver reproducibility. Results: Twenty-seven patients with 140 18F-FDHT–avid regions were included. The best repeatability among 18F-FDHT uptake metrics was found for SUV metrics (SUVmax, SUVmean, and SUVpeak), with no significant differences in repeatability among them. Correlations between the test and retest scans were strong for all SUV metrics (R2 ≥ 0.92; ICC ≥ 0.97). The RCs of the SUV metrics ranged from 21.3% (SUVpeak) to 24.6% (SUVmax). The test and retest androgen receptor–positive tumor volumes and TLU, respectively, were highly correlated (R2 and ICC ≥ 0.97), although variability was significantly higher than that for SUV (RCs > 46.4%). The prostate-specific antigen levels, Gleason score, weight, and age did not affect repeatability, nor did total injected activity, uptake measurement time, or differences in uptake time between the 2 scans. Including the most avid lesion per patient, the 5 most avid lesions per patient, only lesions 4.2 mL or more, only lesions with an SUV of 4 g/mL or more, or normalizing of SUV to area under the parent plasma activity concentration–time curve did not significantly affect repeatability. All metrics showed high interobserver reproducibility (ICC > 0.98; coefficient of variation < 0.2%–10.8%). Conclusion: Uptake metrics derived from 18F-FDHT PET/CT show high repeatability and interobserver reproducibility.

  • prostate cancer
  • PET
  • FDHT
  • reproducibility
  • repeatability

Prostate cancer is driven by the androgen receptor (AR) signaling axis, including the terminal phase of the disease, metastatic castration-resistant prostate cancer (mCRPC). This AR addiction is the basis of numerous AR-targeted therapies for mCRPC that prolong survival and improve quality of life (1,2).

Given the central role the AR axis has in mCRPC and its treatment, there is a pressing need to credential noninvasive biomarkers capable of monitoring the pharmacologic targeting and effect of these drugs. 18F-fluorodihydrotestosterone (18F-FDHT) is a radiolabeled analog of dihydrotestosterone, the primary ligand of the AR, which offers an innovative way of directly imaging the primary molecular engine of castration-resistant prostate cancer with PET/CT. Preliminary studies using 18F-FDHT PET/CT in patients with castration-resistant prostate cancer have demonstrated safety, feasibility, favorable pharmacokinetic properties, accuracy at identifying tumor localizations, and associations with survival (3–7). Furthermore, 18F-FDHT was instrumental for demonstrating AR targeting in the early-phase clinical trials of enzalutamide and apalutamide, 2 AR-directed therapies that have demonstrated substantial clinical activity in mCRPC (8,9).

This international collaboration was undertaken to assess the repeatability and reproducibility of 18F-FDHT uptake measures, a crucial component of biomarker development (10,11). Repeatability is defined as the measurement precision under a set of repeatability conditions (e.g., repeated scans within 1 subject) and reproducibility as the measurement precision under a set of different conditions in similar subjects (e.g., different locations, operators, readers) (12,13).

The aim of this study was to prospectively assess repeatability and reproducibility of whole-body 18F-FDHT uptake metrics of mCRPC metastases.

MATERIALS AND METHODS

Patients were recruited prospectively from 3 tertiary academic centers: Memorial Sloan Kettering Cancer Center (United States), VU University Medical Center (The Netherlands), and Austin Health (Australia). Each site opened its own study and managed the regulatory requirements specific to each institution and country. The trials, by prospective intent, were to collect and combine data under a predefined statistical plan. The lead site (Memorial Sloan Kettering) holds a U.S. Food and Drug Administration Investigational New Drug application for 18F-FDHT (#66115) and provided letters of cross-reference to facilitate submission for regulatory approval for the other sites. The institutional review boards of each center approved the study, and all patients provided written informed consent before inclusion. The clinicaltrials.gov identifier is NCT00588185 (this number applies only to Memorial Sloan Kettering, the only U.S.-based site).

Patient Eligibility and Study Design

Eligibility criteria included pathologically proven mCRPC, castrate serum testosterone (≤50 ng/dL), 4 wk or more since patients’ last anticancer pharmacologic therapy, and progressive disease based on a rise in prostate-specific antigen or on RECIST 1.1 imaging evidence of progressive disease or 2 or more new metastatic lesions on bone scan not attributable to the flair phenomenon.

Patients without surgical or medical castration remained on androgen depletion therapy with gonadotropin-releasing hormone analogs/inhibitors. Patients on enzalutamide or other antiandrogens within 4 wk were excluded, as this therapy directly competes with 18F-FDHT uptake. The design included means to evaluate the effect of time between the test and retest 18F-FDHT injections on the uptake measurements. Up to 3 cohorts were planned for test–retest scans (cohort 1: days 1 and 2; cohort 2: days 1 and 8; and cohort 3: days 1 and 22). Initially, patients would be studied in cohort 1. If unstable test–retest 18F-FDHT uptake (defined as a relative difference > 0.15) was present in 5 or more patients at any time, the study would proceed to the subsequent cohort. However, as a relative difference greater than 0.15 was not observed in 5 or more patients in cohort 1, there was no indication to proceed to subsequent cohorts, and all patients underwent 18F-FDHT PET/CT scans on 2 consecutive days.

Image Acquisition

Images were acquired using a GE690 or GE710 (GE Healthcare) or Gemini TF64 or Ingenuity TF128 (both from Philips) PET/CT scanner. For each scan, a low-dose CT scan (120–140 kV, 80 mA) was obtained, followed by a dynamic 30-min PET scan over the thorax after intravenous 18F-FDHT administration. All scans were corrected for decay, scatter, random coincidences, and photon attenuation. During the dynamic scans, 3 intravenous samples were drawn at 5, 10, and 30 min after injection. Whole-blood activity concentration, plasma activity concentration, and parent and metabolite fractions (by high-pressure liquid chromatography) of 18F-FDHT were measured. A whole-body PET/CT (mid thigh to mid skull) followed, starting approximately 45 min after injection. A whole-body low-dose CT scan (120–140 kV, 80 mA) was acquired with a section thickness and reconstruction interval of 5 mm and pitch of 0.75–1.5. No oral or intravenous contrast material was administered.

Data Management and Analysis

The Clinical Trials Network from the Society of Nuclear Medicine and Molecular Imaging provided both centralized data management and access to Imagys®, a web-based Imaging Clinical Trial management system by Keosys, for secure uploading, storage, downloading, and analysis of images.

All images were evaluated independently by a dually trained radiologist/nuclear medicine physician and a nuclear medicine resident (8 and 3 y experience in PET/CT, respectively). Lesions were considered suggestive of metastases when uptake was visually higher than blood-pool activity measured in the thoracic aorta or background tissue specific to the site of the lesion and separate from known physiologic uptake (blood pool, biliary, urinary, and gastrointestinal tracts). Lesion type (bone, nodal, or other soft tissue) and anatomic site (grouped into 11 regions for bone, 11 regions for nodes, and 10 regions for other soft tissue) were recorded (Supplemental Fig. 1; supplemental materials are available at http://jnm.snmjournals.org). The most visually prominent 18F-FDHT–avid lesion in each predefined anatomic region was delineated and a volume of interest generated semiautomatically using a 50% isocontour of SUVmax corrected for local background. The following 18F-FDHT uptake metrics were recorded: SUVmax, SUVpeak (1.2 cm3 spheric region positioned within the lesion to maximize its mean value), and SUVmean (all voxels within the lesion) corrected for body weight. Additionally, these metrics were normalized to the area under the parent plasma time–activity concentration curve (AUC) at 30 min (SUVAUCpp) (14). Androgen receptor–positive tumor volume ([ARTV] derived using a 50% threshold of SUVmax corrected for local background) and total lesion uptake ([TLU] defined as SUVmean × ARTV) of 18F-FDHT were calculated.

Statistical Analysis

Repeatability and interobserver reproducibility were determined by calculating the relative absolute difference in 18F-FDHT uptake metrics between the test and retest scans, and between the values of the uptake metrics measured by the 2 readers. The relative absolute difference was computed as:Embedded ImageIf no lesion was identified in a patient, the absolute change was set to zero but was not considered when calculating quantitative repeatability coefficients (RCs). The RC was calculated as 1.96*SD of the relative absolute differences per lesion and per patient for all uptake metrics. Normality was evaluated visually using a quantile-quantile plot and histogram analyses. Significance of differences in uptake metrics between the 2 scans and between the 2 readers was assessed using a paired t test. To assess differences in RCs, a Levene test was performed; differences were deemed significant if the P value was less than 0.05. Linear regression analyses, intraclass correlation coefficients (ICCs), and Bland–Altman plots were used to evaluate repeatability. Additionally, the coefficient of variation (COV) and ICC were used to investigate interobserver reproducibility.

A Levene test was performed to assess the effect of various lesion selection strategies on repeatability and reproducibility: lesions of 4.2 mL or more (diameter ≥ 2 cm), SUV of 4.0 g/mL or more, and up to the 5 most radiotracer-avid lesions, as suggested by the PERCIST guidelines (15). In addition, the uptake values of these 5 individual target lesions were averaged per patient to obtain mean uptake values. A post hoc linear regression analysis was performed to evaluate the influence of prostate-specific antigen levels, Gleason score, weight, and differences in total injected activity and uptake time between both scans on a per-patient basis. On the basis of previous reports on repeatability of 18F-FDG uptake in malignant tumors, 30% or less variability between the test and retest was considered acceptable (15,16). All statistical analyses were performed using SPSS 22.0 (SPSS).

Additional details on study design, image acquisition and processing, radio–high-performance liquid chromatography, and analysis of 18F-FDHT metabolism are available on request.

RESULTS

Thirty-two patients were included. The minimum number of paired evaluations per patient (i.e., per the anatomic regions described in the “Materials and Methods” section) was 1; the maximum was 12. Five patients were excluded from the RC calculations, because no lesions were detected on PET. Overall, 27 patients with a total of 140 18F-FDHT–avid lesions were evaluated. No significant differences in patient characteristics were observed between the test and retest scans. The total injected activities at center 2 were significantly lower than those of centers 1 and 3; however, no systematic differences were found in the SUVs from centers 1 and 3 (Tables 1 and 2).

View this table:
  • View inline
  • View popup
TABLE 1

Patient Characteristics

View this table:
  • View inline
  • View popup
TABLE 2

Descriptive Statistics of Several Uptake Measures

Repeatability

The best repeatability of 18F-FDHT PET/CT uptake metrics was found for SUV, where the predefined threshold of variability of 30% or less was met (Table 3; Fig. 1). No significant differences in variability were found between SUVmax, SUVmean, and SUVpeak, and correlations between the test and retest scans were strong (R2 ≥ 0.92; ICC ≥ 0.97). Bland–Altman graphs did not show skewness of the data (Figs. 2 and 3). The RCs of the overall SUV metrics ranged from 21.3% (SUVpeak) to 24.6% (SUVmax). Significantly smaller RCs were found between SUVmean and SUVpeak at center 3 and those of centers 1 and 2 (P = 0.03–0.04). Only for SUVmax, the variability was significantly less in soft tissue versus bone lesions (RCs 18.2% vs. 26.1%; P = 0.04). Repeatability of the uptake metrics showed a trend toward dependency on lesion size, but not on absolute SUVs (Fig. 4).

View this table:
  • View inline
  • View popup
TABLE 3

Mean Relative Differences and RCs on Lesion Level for Several Uptake Metrics

FIGURE 1.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 1.

Box plots of percentage differences on lesion level between test and retest scans for several quantitative uptake values. Effect of normalizing to AUCpp is shown.

FIGURE 2.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 2.

Bland–Altman plots showing repeatability SUVmax on lesion (A) and patient (B) level. Blue = center 1; red = center 2; green = center 3.

FIGURE 3.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 3.

Bland–Altman plots showing repeatability of SUVpeak on lesion (A) and patient (B) level. Blue = center 1; red = center 2; green = center 3.

FIGURE 4.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 4.

Bland–Altman plots showing influence of ARTV on repeatability of SUVmax on lesion level. Log scale is used on x-axis. Blue = center 1; red = center 2; green = center 3.

Test and retest TLU and ARTV values also showed good correlation (R2 and ICC ≥ 0.97), although variability was significantly larger than for SUV, and the predefined variability threshold of 30% or less was not met (RCs > 46.4%) (Fig. 5). Mean TLU was significantly larger in patients from center 2, yet variability was only significantly lower than that of center 1 (40.5 vs. 56.0%; P = 0.02). Even when evaluated on a per-region basis, RCs remained significantly higher compared with those from the SUV metrics and were not influenced by lesion type.

FIGURE 5.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 5.

Bland–Altman plots showing repeatability of TLU (A and B) and ARTV (C and D) on lesion (A and C) and patient (B and D) level. For TLU and lesion-level ARTV: log scale is used on x-axis. Blue = center 1; red = center 2; green = center 3.

Assessing variability of the 18F-FDHT uptake metrics on a per-patient basis improved repeatability of all uptake metrics (Table 3; Fig. 6). RCs of SUV decreased 6% on average, which was significant for SUVmax and SUVmean. The improvement of volumetric measures was larger, with changes in RCs of TLU and ARTV being 12.7 and 23.1%, respectively. This was mainly caused by a large decrease in variability of ARTV of centers 2 and 3 after averaging the data. Prostate-specific antigen level, Gleason score, weight, and age did not affect repeatability, nor did differences in total injected activity or uptake time after injection between both scans (R2: < 0.08) (Fig. 7).

FIGURE 6.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 6.

Box plots of percentage differences on patient level between test and retest scans for several quantitative uptake values. Effect of normalizing to AUC is shown.

FIGURE 7.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 7.

Scatterplot showing effect of differences in uptake time (mins) between test and retest scans on differences in uptake at patient level. Similar patterns are seen for other quantitative uptake metrics. Blue = center 1; red = center 2; green = center 3.

Normalization to Parent Plasma Input Curve

Adequate blood samples were available from 21 of the 27 patients with a total of 103 lesions. Normalizing SUV to AUC significantly decreased the overall repeatability on both lesion and patient bases for centers 1 and 3 (Tables 3 and 4). This was mainly due to large differences (>50%) in whole-blood activity concentrations between samples in the test and retest samples from 2 patients. When these outliers were removed, the repeatability for centers 1 and 3 improved and only a slight change in RCs on an overall lesional basis was observed after normalization (SUVmax: 29.9%; SUVmean: 30.3%; SUVpeak: 21.6%). This was also seen for RCs on a per-patient level (SUVmax: 25.6%; SUVmean: 23.8%; and SUVpeak: 16.3%).

View this table:
  • View inline
  • View popup
TABLE 4

Mean Relative Differences and RCs on Patient Level for Several Uptake Metrics

Lesion Selection

Inclusion of up to the 5 most avid lesions per patient did not significantly affect repeatability for any of the uptake metrics. If these lesions were assessed on a per-patient basis, RCs were similar to those before lesion selection. Likewise, only including the single most avid lesion, lesions of 4.2 mL or more, or lesions with an SUV of 4 g/mL or more did not significantly affect repeatability. Decrease in RCs ranged from 0% to 6.5% for all uptake metrics.

Reproducibility

Reproducibility between readers was excellent for SUVmax and SUVpeak, with discrepancies in measurements between the readers found in only 2 of 300 measurements and 12 of 140 lesions for SUVmax and SUVpeak, respectively. Lesions showing discrepancies were close to regions of high physiologic uptake (e.g., liver, urinary tract, or vascular structures) or showed diffuse uptake (e.g., diffuse disease in the pelvis). Both metrics showed high reproducibility (ICC: 1.00) and a low COV (≤0.20%).

The remaining semiquantitative uptake measures were more dependent on volume-of-interest definition. The correlation between both readers for SUVmean was still excellent (ICC: 0.99), but the variation was significantly higher (COV: 2.3%). TLU and ARTV were less reproducible than all SUV metrics (COV: 10.8% and 10.4%, respectively), yet the ICCs remained above 0.98.

DISCUSSION

This multicenter prospective study assessed repeatability and reproducibility of 18F-FDHT, both of which are key components of the tracer’s analytic validation as a clinical biomarker. Repeatability of SUV metrics was superior to that of volumetric metrics, with repeatability coefficients ranging between 16.4% and 17.8% on a patient basis and 21.3%–24.6% on a region basis. As a necessary step in biomarker development, this study demonstrated the feasibility of 18F-FDHT PET/CT imaging in a multiinstitutional setting and satisfied the requirement to evaluate the biomarker’s test–retest repeatability (17). In the current era of AR-directed mCRPC drug development, such biomarkers can serve as a pharmacodynamic, a prognostic, and a response indicator (6–9).

Most studies on test–retest repeatability in PET/CT have evaluated 18F-FDG uptake. The PERCIST guidelines recommend a more than 30% change in SUV to define a meaningful change in clinical status for both disease response and progression (15). Weber et al. evaluated 18F-FDG PET/CT imaging in 74 patients with non–small cell lung cancer in a multiinstitutional (n = 9) clinical trial and reported thresholds of 28%/32% decrease and 39%/47% increase in SUVmax and SUVpeak, respectively, to be most indicative of actual therapeutic effects (16). However, multiple technical and logistic factors can affect these measurements, including differences in volume of interest, delineation, magnitude of uptake metrics, and uptake time after intravenous injection, as well as difficulties related to adherence to protocol design in a multiinstitutional setting (18,19). Similar studies in patients with prostate cancer have been conducted with other radiotracers. Variation coefficients of 14% and 7% were reported on 18F-NaF PET/CT in patients with mCRPC for SUVmax and SUVmean, respectively (20). In a study using 18F-fluoromethylcholine in patients with mCRPC, repeatability coefficients ranging between 22% and 26% were reported for different SUV metrics (21). Additionally, this study also reported that RCs of metabolically active tumor volume and TLU were significantly larger than those for SUV (36% and 33%, respectively). Other studies also using SUVmax-based thresholds showed similar results (22,23), yet a significant decrease in repeatability was seen when only lesions of 4.2 mL or less were included in the analysis. Studies have also shown decreased variability when evaluating repeatability on a per-patient (as opposed to a per-lesion) basis (14,21).

Normalization to Parent Plasma Input Curve

Two studies have shown a correlation (R2: 0.6–0.7) between nonlinear regression analysis of dynamic 18F-FDHT data and SUV (5,14). Additionally, preliminary results showed a near-perfect correlation when the SUV was normalized to the AUC (R2: 0.99). A potential advantage of normalization to the parent plasma input curves is that the uptake metrics are corrected for any treatment-induced or other changes in the radiotracer’s metabolism, albeit at the expense of an additional dynamic PET scan, venous blood samples, and metabolite analysis. Moreover, including an additional variable into uptake metric calculations can increase uncertainty (14,21), although in the present study, SUVAUCpp did not significantly affect overall variability of any of the SUV metrics on a lesion level. One outlier was seen with unexplained large differences in whole-blood activity concentrations between test and retest scans, which could not be accounted for by sample measurement errors, suggesting the need for caution in the case of response assessment.

Our study had limitations. To overcome possible confounders in our study, all lesions were delineated by 2 independent readers. For SUVmax and SUVpeak, reproducibility was nearly perfect, and differences in SUVmean between readers were small. Moreover, differences in uptake time between the test and retest scans did not affect repeatability, suggesting that the influence of this factor was minor. However, repeatability data from 2 readers are insufficient to make strong statements about agreement across a larger pool of readers and will require validation. Patients with castration-resistant prostate cancer often present with numerous metastatic lesions and, ideally, each lesion should be delineated and assessed. However, this is impractical in routine clinical scenarios and therefore we predefined anatomic regions. Yet, this still resulted in 10 or more evaluable regions in 20% of the patients. Several other (simpler) lesion selection criteria were also investigated; those regions did not result in a change in variability.

CONCLUSION

Metrics derived from 18F-FDHT PET/CT show high repeatability and interobserver reproducibility. Among 18F-FDHT uptake metrics, SUV had the best repeatability, and although ARTV and TLU showed good correlation, variability was higher.

DISCLOSURE

This study was funded by a Movember Foundation Global Action Plan award. Memorial Sloan Kettering Cancer Center is supported by NIH/NCI Cancer Center Support Grant P30 CA008748. No other potential conflict of interest relevant to this article was reported.

Footnotes

  • Published online Apr. 6, 2018.

  • © 2018 by the Society of Nuclear Medicine and Molecular Imaging.

REFERENCES

  1. 1.↵
    1. Huggins C,
    2. Hodges CV
    . Studies on prostatic cancer: I—the effect of castration, of estrogen and of androgen injection on serum phosphatases in metastatic carcinoma of the prostate. 1941. J Urol. 2002;168:9–12.
    OpenUrlCrossRefPubMed
  2. 2.↵
    1. Graham L,
    2. Schweizer MT
    . Targeting persistent androgen receptor signaling in castration-resistant prostate cancer. Med Oncol. 2016;33:44.
    OpenUrl
  3. 3.↵
    1. Larson SM,
    2. Morris M,
    3. Gunther I,
    4. et al
    . Tumor localization of 16beta-18F-fluoro-5alpha-dihydrotestosterone versus 18F-FDG in patients with progressive, metastatic prostate cancer. J Nucl Med. 2004;45:366–373.
    OpenUrlAbstract/FREE Full Text
  4. 4.
    1. Zanzonico PB,
    2. Finn R,
    3. Pentlow KS,
    4. et al
    . PET-based radiation dosimetry in man of 18F-fluorodihydrotestosterone, a new radiotracer for imaging prostate cancer. J Nucl Med. 2004;45:1966–1971.
    OpenUrlAbstract/FREE Full Text
  5. 5.↵
    1. Beattie BJ,
    2. Smith-Jones PM,
    3. Jhanwar YS,
    4. et al
    . Pharmacokinetic assessment of the uptake of 16beta-18F-fluoro-5alpha-dihydrotestosterone (FDHT) in prostate tumors as measured by PET. J Nucl Med. 2010;51:183–192.
    OpenUrlAbstract/FREE Full Text
  6. 6.↵
    1. Vargas HA,
    2. Wassberg C,
    3. Fox JJ,
    4. et al
    . Bone metastases in castration-resistant prostate cancer: associations between morphologic CT patterns, glycolytic activity, and androgen receptor expression on PET and overall survival. Radiology. 2014;271:220–229.
    OpenUrlCrossRefPubMed
  7. 7.↵
    1. Fox JJ,
    2. Gavane SC,
    3. Blanc-Autran E,
    4. et al
    . Positron emission tomography/computed tomography-based assessments of androgen receptor expression and glycolytic activity as a prognostic biomarker for metastatic castration-resistant prostate cancer. JAMA Oncol. 2018;4:217–224.
  8. 8.↵
    1. Rathkopf DE,
    2. Morris MJ,
    3. Fox JJ,
    4. et al
    . Phase I study of ARN-509, a novel antiandrogen, in the treatment of castration-resistant prostate cancer. J Clin Oncol. 2013;31:3525–3530.
    OpenUrlAbstract/FREE Full Text
  9. 9.↵
    1. Scher HI,
    2. Beer TM,
    3. Higano CS,
    4. et al
    . Antitumour activity of MDV3100 in castration-resistant prostate cancer: a phase 1-2 study. Lancet. 2010;375:1437–1446.
    OpenUrlCrossRefPubMed
  10. 10.↵
    1. Amur SG,
    2. Sanyal S,
    3. Chakravarty AG,
    4. et al
    . Building a roadmap to biomarker qualification: challenges and opportunities. Biomark Med. 2015;9:1095–1105.
    OpenUrl
  11. 11.↵
    1. Woodcock J,
    2. Buckman S,
    3. Goodsaid F,
    4. Walton MK,
    5. Zineh I
    . Qualifying biomarkers for use in drug development: a US Food and Drug Administration overview. Expert Opin Med Diagn. 2011;5:369–374.
    OpenUrlCrossRefPubMed
  12. 12.↵
    1. Raunig DL,
    2. McShane LM,
    3. Pennello G,
    4. et al
    . Quantitative imaging biomarkers: a review of statistical methods for technical performance assessment. Stat Methods Med Res. 2015;24:27–67.
    OpenUrlCrossRefPubMed
  13. 13.↵
    1. Kessler LG,
    2. Barnhart HX,
    3. Buckler AJ,
    4. et al
    . The emerging science of quantitative imaging biomarkers terminology and definitions for scientific studies and regulatory submissions. Stat Methods Med Res. 2015;24:9–26.
    OpenUrlCrossRefPubMed
  14. 14.↵
    1. Kramer G,
    2. Yaqub M,
    3. Schuit R,
    4. et al
    . Assessment of simplified methods for quantification of [18F]FDHT uptake in patients with metastasized castrate resistant prostate cancer [abstract]. J Nucl Med. 2016;57(suppl 2):464.
    OpenUrl
  15. 15.↵
    O JH. Lodge MA, Wahl RL. Practical PERCIST: a simplified guide to PET response criteria in solid tumors 1.0. Radiology. 2016;280:576–584.
    OpenUrl
  16. 16.↵
    1. Weber WA,
    2. Gatsonis CA,
    3. Mozley PD,
    4. et al
    . Repeatability of 18F-FDG PET/CT in advanced non-small cell lung cancer: prospective assessment in 2 multicenter trials. J Nucl Med. 2015;56:1137–1143.
    OpenUrlAbstract/FREE Full Text
  17. 17.↵
    1. O’Connor JP,
    2. Aboagye EO,
    3. Adams JE,
    4. et al
    . Imaging biomarker roadmap for cancer studies. Nat Rev Clin Oncol. 2017;14:169–186.
    OpenUrlCrossRefPubMed
  18. 18.↵
    1. Lodge MA
    . Repeatability of SUV in oncologic 18F-FDG PET. J Nucl Med. 2017;58:523–532.
    OpenUrlAbstract/FREE Full Text
  19. 19.↵
    1. Kaneta T,
    2. Sun N,
    3. Ogawa M,
    4. et al
    . Variation and repeatability of measured standardized uptake values depending on actual values: a phantom study. Am J Nucl Med Mol Imaging. 2017;7:204–211.
    OpenUrl
  20. 20.↵
    1. Lin C,
    2. Bradshaw TJ,
    3. Perk TG,
    4. et al
    . Repeatability of quantitative 18F-NaF PET: a multicenter study. J Nucl Med. 2016;57:1872–1879.
    OpenUrlAbstract/FREE Full Text
  21. 21.↵
    1. Oprea-Lager DE,
    2. Kramer G,
    3. van de Ven PM,
    4. et al
    . Repeatability of quantitative 18F-fluoromethylcholine PET/CT studies in prostate cancer. J Nucl Med. 2016;57:721–727.
    OpenUrlAbstract/FREE Full Text
  22. 22.↵
    1. Hatt M,
    2. Cheze-Le Rest C,
    3. Aboagye EO,
    4. et al
    . Reproducibility of 18F-FDG and 3′-deoxy-3′-18F-fluorothymidine PET tumor volume measurements. J Nucl Med. 2010;51:1368–1376.
    OpenUrlAbstract/FREE Full Text
  23. 23.↵
    1. Frings V,
    2. de Langen AJ,
    3. Smit EF,
    4. et al
    . Repeatability of metabolically active volume measurements with 18F-FDG and 18F-FLT PET in non-small cell lung cancer. J Nucl Med. 2010;51:1870–1877.
    OpenUrlAbstract/FREE Full Text
  • Received for publication December 4, 2017.
  • Accepted for publication January 20, 2018.
PreviousNext
Back to top

In this issue

Journal of Nuclear Medicine: 59 (10)
Journal of Nuclear Medicine
Vol. 59, Issue 10
October 1, 2018
  • Table of Contents
  • Table of Contents (PDF)
  • About the Cover
  • Index by author
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on Journal of Nuclear Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Reproducibility and Repeatability of Semiquantitative 18F-Fluorodihydrotestosterone Uptake Metrics in Castration-Resistant Prostate Cancer Metastases: A Prospective Multicenter Study
(Your Name) has sent you a message from Journal of Nuclear Medicine
(Your Name) thought you would like to see the Journal of Nuclear Medicine web site.
Citation Tools
Reproducibility and Repeatability of Semiquantitative 18F-Fluorodihydrotestosterone Uptake Metrics in Castration-Resistant Prostate Cancer Metastases: A Prospective Multicenter Study
Hebert Alberto Vargas, Gem M. Kramer, Andrew M. Scott, Andrew Weickhardt, Andreas A. Meier, Nicole Parada, Bradley J. Beattie, John L. Humm, Kevin D. Staton, Pat B. Zanzonico, Serge K. Lyashchenko, Jason S. Lewis, Maqsood Yaqub, Ramon E. Sosa, Alfons J. van den Eertwegh, Ian D. Davis, Uwe Ackermann, Kunthi Pathmaraj, Robert C. Schuit, Albert D. Windhorst, Sue Chua, Wolfgang A. Weber, Steven M. Larson, Howard I. Scher, Adriaan A. Lammertsma, Otto S. Hoekstra, Michael J. Morris
Journal of Nuclear Medicine Oct 2018, 59 (10) 1516-1523; DOI: 10.2967/jnumed.117.206490

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Reproducibility and Repeatability of Semiquantitative 18F-Fluorodihydrotestosterone Uptake Metrics in Castration-Resistant Prostate Cancer Metastases: A Prospective Multicenter Study
Hebert Alberto Vargas, Gem M. Kramer, Andrew M. Scott, Andrew Weickhardt, Andreas A. Meier, Nicole Parada, Bradley J. Beattie, John L. Humm, Kevin D. Staton, Pat B. Zanzonico, Serge K. Lyashchenko, Jason S. Lewis, Maqsood Yaqub, Ramon E. Sosa, Alfons J. van den Eertwegh, Ian D. Davis, Uwe Ackermann, Kunthi Pathmaraj, Robert C. Schuit, Albert D. Windhorst, Sue Chua, Wolfgang A. Weber, Steven M. Larson, Howard I. Scher, Adriaan A. Lammertsma, Otto S. Hoekstra, Michael J. Morris
Journal of Nuclear Medicine Oct 2018, 59 (10) 1516-1523; DOI: 10.2967/jnumed.117.206490
Twitter logo Facebook logo LinkedIn logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One
Bookmark this article

Jump to section

  • Article
    • Abstract
    • MATERIALS AND METHODS
    • RESULTS
    • DISCUSSION
    • CONCLUSION
    • DISCLOSURE
    • Footnotes
    • REFERENCES
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • PDF

Related Articles

  • This Month in JNM
  • PubMed
  • Google Scholar

Cited By...

  • No citing articles found.
  • Google Scholar

More in this TOC Section

Oncology

  • Considerations and approach prior to treatment with 177Lutetium DOTATATE Radionuclide Therapy
  • Expanding Role of Positron Emission Tomography in Management of Prostate Cancer: Current Status and Future Directions
  • A Sheep in Wolf’s Clothing: Beware of Physiologic Ureteric Activity Mimicking a Pathologic Lymph Node!
Show more Oncology

Clinical

  • Considerations and approach prior to treatment with 177Lutetium DOTATATE Radionuclide Therapy
  • Expanding Role of Positron Emission Tomography in Management of Prostate Cancer: Current Status and Future Directions
  • A Sheep in Wolf’s Clothing: Beware of Physiologic Ureteric Activity Mimicking a Pathologic Lymph Node!
Show more Clinical

Similar Articles

Keywords

  • prostate cancer
  • PET
  • FDHT
  • reproducibility
  • repeatability
SNMMI

© 2025 SNMMI

Powered by HighWire