Visual Abstract
Abstract
Amino acid PET is an established method to assist differential diagnosis of therapy-related changes versus recurrence in gliomas. However, its diagnostic value in brain metastases is yet to be determined. The goal of this study was to summarize evidence on the diagnostic utility of amino acid PET in recurrent brain metastases. Methods: The medical databases MEDLINE, EMBASE, and the Cochrane Library were screened for English-language studies with at least 10 patients who had undergone first-line treatment including radiotherapy and in whom a final diagnosis had been determined by histologic examination or imaging and clinical follow-up. Pooled estimates with 95% CIs were calculated. Heterogeneity was assessed using I2 statistics. Results: Following the above criteria, 12 studies with the tracers methyl-[11C]-methionine (n = 6), O-(2-[18F]fluoroethyl)-l-tyrosine (n = 3), methyl-[11C]-methionine and O-(2-[18F]fluoroethyl)-l-tyrosine (n = 1), and 6-[18F]fluoro-L-dopa (n = 2), with a total of 547 lesions in 397 patients, were included. Pooled sensitivity and specificity were 82% (95% CI, 76–86) and 84% (95% CI, 79–88), respectively. Pooled positive and negative predictive values were 84% (95% CI, 77–90) and 83% (95% CI, 77–88), respectively. Positive and negative likelihood ratios, and diagnostic odds ratio were 3.8 (95% CI 3.0–4.8), 0.3 (95% CI 0.2–0.3), and 16.7 (95% CI 10.8–25.9), respectively. Heterogeneity was overall low. Conclusion: The present meta-analysis indicates a good accuracy of amino acid PET in the differential diagnosis of recurrent brain metastases. In particular, specificity of 84% suggests that amino acid PET may reduce the number of invasive procedures and overtreatment in patients with treatment-related changes. This study provides class IIa evidence on the utility of amino acid PET in the differential diagnosis of recurrent brain metastases.
Brain metastases occur in 20%–40% of all tumor patients (1). The primary tumors most likely to metastasize to the brain are bronchial carcinoma (40%–50%), breast carcinoma (15%–20%), malignant melanoma (5%–20%), renal cancer (5%–10%), and cancers of the gastrointestinal tract (5%) (2). Management of patients with brain metastases usually includes surgery, radiation, and chemotherapy. Therapy is selected on an individual basis, taking into account the primary tumor and location, and number of metastases. Still, most patients with cerebral metastases receive primary, concomitant, or curative radiotherapy during the disease course. After radiation treatment, patients are followed clinically and radiographically with serial MRI. Some develop treatment-related changes (TRCs) such as radiation necrosis and pseudoprogression (3). The true incidence of TRCs is hard to estimate, with values varying widely in the literature, depending on diagnostic criteria, duration of follow-up, radiation modality, and regimen. Radiation necrosis may underlie up to half of lesions that progress radiologically after stereotactic radiosurgery (4,5). Differentiation between recurrent or progressive brain metastasis (RPBM) and TRCs is challenging. Both can manifest with similar clinical symptoms and MRI features, such as rimlike contrast enhancement, perilesional edema, and central hypointensity on T2-weighted imaging (6). For this clinical question, conventional MRI was shown to deliver a pooled sensitivity and specificity of 76% and 59%, respectively (7). As the management of patients with RPBM versus TRCs differs (4), accurate and early differential diagnosis is essential.
Originally, 18F-FDG was used to differentiate benign and low-grade tumors from high-grade tumors (8). However, the utility of 18F-FDG PET was shown to be limited by high uptake in normal gray matter and nonspecific uptake in inflammatory lesions (9). Amino acid PET takes advantage of the fact that brain malignancies often overexpress amino acid transport proteins. Common amino acid tracers include methyl-[11C]-methionine (11C-MET), 6-[18F]fluoro-L-dopa (18F-FDOPA), and O-(2-[18F]fluoroethyl)-l-tyrosine (18F-FET).
In recent years, several single-center studies have investigated the utility of amino acid PET in the differential diagnosis of recurrent brain metastases. The aim of the present work was to summarize existing evidence in the form of a meta-analysis.
MATERIALS AND METHODS
A literature search was performed in the online medical databases MEDLINE (via PubMed), EMBASE, the Cochrane Library (Cochrane Central Register of Controlled Trials), and Google Scholar. The search was limited to studies on humans. The following key words were used: Positron Emission Tomography; PET AND recurrence, recurrent, relapse, neoplasm, metastasis, metastatic progression AND radionecrosis, radiation necrosis, radiation-induced necrosis, posttreatment necrosis, radiation injury, radionecrotic, postradiotherapy necrosis AND radiation therapy, radiation treatment, radiosurgery. The searches were performed in various combinations, both with “AND” and “OR.” The last search was performed on December 1, 2021.
Inclusion Criteria
Studies in English with at least 10 patients who had received PET with amino acid tracers for differentiation of RPBM from TRCs after radiotherapy were included. In addition, follow-up data had to allow creation of a contingency table. Histologic examination or continuous follow-up with radiologic imaging and clinical findings served as reference standards for the final diagnosis. Due to lack of information about primary tumors and clinical outcomes at a single-subject level in most studies, a differential analysis according to the primary tumor was impossible. Figure 1 depicts a flowchart of the selection procedure.
Identification of studies as PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) flow diagram.
Data Extraction
The following data were extracted from the included studies: first author, publication year, tracers, number of patients, number of lesions, number of true-positives, number of true-negatives, number of false-positives, and number of false-negatives. The calculation of the endpoints was based on the number of lesions. Some studies in addition provided estimates from kinetic analyses (10,11), but for consistency, only estimates of tumor-to-background ratio (TBR) were considered. If studies provided both mean TBR and maximum TBR, we considered mean TBR only, as the threshold was based on mean TBR in most overviewed studies (Table 2 of Galldiks et al. (12)). To assess the quality of the selected studies, we used Quality Assessment of Diagnostic Accuracy Studies 2 (13).
Statistics
Common and random-effects bivariate models were used. Heterogeneity was assessed using I2 statistics (the percentage of variation across studies that is due to heterogeneity rather than chance). Pooled estimates of sensitivity, specificity, and predictive values, as well as positive likelihood ratio (posLR), negative likelihood ratio (negLR), and diagnostic odds ratio (DOR) with 95% CIs, were calculated. PosLR above 3.0 were considered acceptable, above 10.0 good; NegLR below 0.3 were considered acceptable, below 0.1 good (14). DOR is used as an indicator of the effectiveness of medical tests with a binary classification. Values for DOR may range from zero to infinity; higher values indicate better test performance. DOR values above 1.0 are considered good (14). All statistical analyses were performed using the statistical software R, version 4.0.4 (15), with the meta (16) and mada (17) packages.
RESULTS
Twelve studies were included in the meta-analysis (Table 1). These were performed with the tracers 11C-MET (n = 6), 18F-FET (n = 3), both 18F-FET and 11C-MET (n = 1), and 18F-FDOPA (n = 2). Although other amino acid tracers have been used in neurooncology, for example, α-[11C]-methyl-L-tryptophan, they have not been applied with the above clinical question (18). Of 18 selected full-text articles (Fig. 1), six had to be excluded: one study with the tracer 18F-fluciclovine (19) was too small, that is, fewer than 10 patients; one study was limited to pseudoprogression (20); and one dealt with a cost-effectiveness analysis (21). Two further studies (22,23) had to be excluded because of overlapping patient cohorts. One more study was excluded (24), because reported data did not allow creation of a contingency table.
Study Characteristics
Finally, twelve studies (10,11,25–34) with a total of 397 patients with 547 lesions were assessed (Table 1). Overall, 269 lesions (49%) were found to be RPBM.
Supplemental Table 1 summarizes the methodologic quality of the selected studies (supplemental materials are available at http://jnm.snmjournals.org). Overall, the study quality can be regarded as moderate. In each of the 12 included studies, the time point of tracer injection and the time period of data acquisition meet the recent practice guidelines of the European Association of Nuclear Medicine, the European Association of Neurooncology, and the working group for Response Assessment in Neurooncology with PET (35). The cutoffs and verification method (histologic confirmation vs. clinical–neuroradiologic follow-up) of the selected studies are summarized in Table 2.
Cutoffs and Verification Method (Histologic Confirmation vs. Clinical–Neuroradiologic Follow-up) as Percentage of Histologic Confirmation
As shown in Figure 2, the heterogeneity among the studies regarding sensitivity appeared to be an I2 of 0%. Consequently, the common-effect and random-effect models provided identical results for pooled sensitivity of 0.82 (95% CI, 0.76–0.86).
Forest plot for sensitivity. Events column lists the number of true-positives. Total column shows sum of true-positives and false-negatives. Proportion column lists reported sensitivity of individual publications and 95% CI. Weight columns indicate contribution of given study according to sample size. Area of gray squares is proportional to weight of study in the meta-analysis. Length of diamonds corresponds to corresponding CI. Vertical line represents pooled sensitivity.
The analyses of specificity are summarized in Figure 3. An I2 of 25% means that 25% of the variability is explained by heterogeneity among the studies. This resulted in an identical estimate for pooled specificity but a slightly different estimate for 95% CI in the common-effect and random-effect models: 0.84 (95% CI, 0.79–0.88) and 0.84 (95% CI, 0.78–0.90), respectively. Table 3 summarizes the values of DOR and likelihood ratios. DOR was 16.7 (95% CI, 10.8–25.9)—that is, good. PosLR and negLR were 3.8 (95% CI, 3.0–4.8) and 0.3 (95% CI, 0.2–0.3), respectively—that is, both within the acceptable range (14).
Forest plot for specificity. Events column lists the number of true-negatives. Total column shows sum of true-negatives and false-positives. Proportion column lists reported specificity of individual publications and 95% CI. Weight columns indicate contribution of given study according to sample size. Area of gray squares is proportional to weight of study in the meta-analysis. Length of diamonds corresponds to corresponding CI. Vertical line represents pooled specificity.
Pooled Estimates of DOR, Positive Likelihood Ratio (posLR), and Negative Likelihood Ratio (negLR) with Corresponding 95% CIs
Pooled diagnostic accuracy was 0.82 (95% CI, 0.78–0.85). Pooled positive and negative predictive values were 84% (95% CI, 77–90) and 83% (95% CI, 77–88), respectively. A summary receiver-operating characteristic curve as calculated using the bivariate model is shown in Supplemental Figure 1. Because the biodistribution of 18F-FDOPA differs from that of 11C-MET and 18F-FET, we in addition performed the same analyses only for studies with 11C-MET and 18F-FET (n = 10). The results did not change substantially (Supplemental Figs. 2 and 3; Supplemental Table 2). There was also no statistically significant difference between the studies with 11C-MET and 18F-FET (data not shown).
DISCUSSION
To our knowledge, this is the first meta-analysis on the utility of amino acid PET in the differential diagnosis of RPBM and TRCs. It includes 12 studies with a total of 547 lesions in 397 patients. Using histologic examination or radiologic and clinical follow-up as reference, we found a pooled sensitivity and specificity of 82% and 84%, respectively. Although values for posLR and negLR were acceptable, DOR appeared to be good.
As compared with gliomas, sensitivity of amino acid PET for differentiation of RPBM from TRCs seems to be lower. In particular, a recent meta-analysis of 39 studies with amino acid PET (36) reported a sensitivity of 85%–93% and specificity of 82%–100%, depending on the tracer, that is, 18F-FET, 11C-MET, or 18F-FDOPA. Given a large variance in the amino acid transporter expression of brain metastases (37), some might primarily be PET-negative. Yet, despite a large variance in 18F-FET uptake, most (89%) newly diagnosed and untreated brain metastases were reported to be PET-positive (38). Another explanation of the lower sensitivity is the impact of systemic therapy; that is, some agents may reduce tumor vitality or amino acid transporter expression. In this regard, it is noticeable that one of the lowest sensitivities (73%) among the included studies was in patients who had undergone immune checkpoint inhibition and targeted therapy (11). The impact of this modern, increasingly available therapy on tracer uptake warrants further studies. We found a pooled diagnostic specificity of 84%, which is well within the range of values reported for gliomas (36). That is, TRCs are more likely to be PET-negative. Similar to gliomas, however, specificity is far from perfect, as inflammatory processes such as reactive astrocytosis after radiation therapy or immunotherapy may result in tracer uptake above the level of normal brain tissue (39), in some cases leading to false-positive findings on PET (40). Pooled positive and negative predictive values were 84% and 83%, respectively. Although, from a clinical perspective, positive and negative predictive values are more helpful for decision making than conventional sensitivity and specificity, the former indices are dependent on the prevalence of a pathologic condition—that is, recurrent brain metastases in the included studies. Therefore, these results should be treated with caution.
So far, just one meta-analysis has addressed the diagnostic utility of PET in the differentiation between RPBM and TRCs (41). Yet, that work analyzed a pool of studies (n = 15) with 18F-FDG (n = 6) and amino acid tracers (n = 9) without a separate analysis for the latter. Among these 9 studies, only 5 fulfilled our selection criteria and were therefore included in the present work (10,31–34). Thus, the current meta-analysis includes substantially more studies and coveres the amino acid tracers only, following recent recommendations of the RANO/PET group on PET imaging in patients with brain metastasis (12). Because of a low lesion-to-background ratio, that report rated 18F-FDG PET as a test with limited diagnostic accuracy (Table 3 of Galldiks et al. (12)).
This study had certain limitations. Because brain metastases are often multifocal, and biopsy or resection is usually performed on single lesions, radiologic and clinical criteria were used as a reference for more than two thirds of lesions. Second, the included studies varied widely regarding the follow-up duration (range, 3–23 mo). Third, most studies did not report the lesion size. Thus, it remains unclear how far the reported values of sensitivity might have been compromised by partial-volume effects in small lesions. In this respect, the maximal diameter of contrast enhancement in T1-weighted MRI (10 mm)—that is, at least double the spatial resolution (full width at half maximum) of modern PET scanners—was proposed as the minimal lesion size (29). Fourth, although we carefully checked for patient overlap, it cannot be excluded (26,28). Finally, most studies had a retrospective design.
CONCLUSION
The present meta-analysis suggestes good accuracy for amino acid PET in the differential diagnosis of recurrent brain metastases. In particular, specificity of 84% indicates that amino acid PET may reduce the number of invasive procedures and overtreatment in patients with TRCs. This study provides class IIa evidence on the utility of amino acid PET in the differential diagnosis of RPBM. Further studies—preferably multicenter ones—should investigate the dependence of tracer uptake on the origin, histologic type, and molecular biomarkers of the primary tumor, as well as on the character and regime of local and systemic therapy.
DISCLOSURE
Igor Yakushev has received consultant or lecture fees from ABX-CRO, Blue Earth Diagnostics, and Piramal, as well as grants from the Alzheimer Research Initiative Germany, the German Research Foundation (DFG), and the Federal Ministry of Education and Research Germany (BMBF). No other potential conflict of interest relevant to this article was reported.
KEY POINTS
QUESTION: How accurate is amino acid PET in the differential diagnosis of recurrent brain metastases and TRCs?
PERTINENT FINDINGS: The present study summarized, in the form of a meta-analysis, the existing evidence on the diagnostic utility of amino acid PET in recurrent brain metastases. Across 12 included studies, pooled sensitivity and specificity were 82% and 84%, respectively.
IMPLICATIONS FOR PATIENT CARE: Amino acid PET is able to assist the differential diagnosis of recurrent brain metastases versus TRCs.
Footnotes
Published online Dec. 2, 2022.
- © 2023 by the Society of Nuclear Medicine and Molecular Imaging.
REFERENCES
- Received for publication December 27, 2021.
- Revision received November 28, 2022.