Skip to main content

Main menu

  • Home
  • Content
    • Current
    • Ahead of print
    • Past Issues
    • JNM Supplement
    • SNMMI Annual Meeting Abstracts
    • Continuing Education
    • JNM Podcasts
  • Subscriptions
    • Subscribers
    • Institutional and Non-member
    • Rates
    • Journal Claims
    • Corporate & Special Sales
  • Authors
    • Submit to JNM
    • Information for Authors
    • Assignment of Copyright
    • AQARA requirements
  • Info
    • Reviewers
    • Permissions
    • Advertisers
  • About
    • About Us
    • Editorial Board
    • Contact Information
  • More
    • Alerts
    • Feedback
    • Help
    • SNMMI Journals
  • SNMMI
    • JNM
    • JNMT
    • SNMMI Journals
    • SNMMI

User menu

  • Subscribe
  • My alerts
  • Log in
  • My Cart

Search

  • Advanced search
Journal of Nuclear Medicine
  • SNMMI
    • JNM
    • JNMT
    • SNMMI Journals
    • SNMMI
  • Subscribe
  • My alerts
  • Log in
  • My Cart
Journal of Nuclear Medicine

Advanced Search

  • Home
  • Content
    • Current
    • Ahead of print
    • Past Issues
    • JNM Supplement
    • SNMMI Annual Meeting Abstracts
    • Continuing Education
    • JNM Podcasts
  • Subscriptions
    • Subscribers
    • Institutional and Non-member
    • Rates
    • Journal Claims
    • Corporate & Special Sales
  • Authors
    • Submit to JNM
    • Information for Authors
    • Assignment of Copyright
    • AQARA requirements
  • Info
    • Reviewers
    • Permissions
    • Advertisers
  • About
    • About Us
    • Editorial Board
    • Contact Information
  • More
    • Alerts
    • Feedback
    • Help
    • SNMMI Journals
  • View or Listen to JNM Podcast
  • Visit JNM on Facebook
  • Join JNM on LinkedIn
  • Follow JNM on Twitter
  • Subscribe to our RSS feeds
Research ArticleBasic Science Investigation

Deep Learning Coronary Artery Calcium Scores from SPECT/CT Attenuation Maps Improve Prediction of Major Adverse Cardiac Events

Robert J.H. Miller, Konrad Pieszko, Aakash Shanbhag, Attila Feher, Mark Lemley, Aditya Killekar, Paul B. Kavanagh, Serge D. Van Kriekinge, Joanna X. Liang, Cathleen Huang, Edward J. Miller, Timothy Bateman, Daniel S. Berman, Damini Dey and Piotr J. Slomka
Journal of Nuclear Medicine April 2023, 64 (4) 652-658; DOI: https://doi.org/10.2967/jnumed.122.264423
Robert J.H. Miller
1Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California;
2Department of Cardiac Sciences, University of Calgary, Calgary, Alberta, Canada;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Konrad Pieszko
1Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California;
3Department of Interventional Cardiology and Cardiac Surgery, University of Zielona Góra, Zielona Góra, Poland;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Aakash Shanbhag
1Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Attila Feher
4Section of Cardiovascular Medicine, Department of Internal Medicine, Yale University School of Medicine, New Haven, Connecticut; and
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mark Lemley
1Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Aditya Killekar
1Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Paul B. Kavanagh
1Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Serge D. Van Kriekinge
1Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Joanna X. Liang
1Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Cathleen Huang
1Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Edward J. Miller
4Section of Cardiovascular Medicine, Department of Internal Medicine, Yale University School of Medicine, New Haven, Connecticut; and
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Timothy Bateman
5Cardiovascular Imaging Technologies LLC, Kansas City, Missouri
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Daniel S. Berman
1Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Damini Dey
1Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Piotr J. Slomka
1Departments of Medicine (Division of Artificial Intelligence in Medicine), Imaging, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • PDF
Loading

Visual Abstract

Figure
  • Download figure
  • Open in new tab
  • Download powerpoint

Abstract

Low-dose ungated CT attenuation correction (CTAC) scans are commonly obtained with SPECT/CT myocardial perfusion imaging. Despite the characteristically low image quality of CTAC, deep learning (DL) can potentially quantify coronary artery calcium (CAC) from these scans in an automatic manner. We evaluated CAC quantification derived with a DL model, including correlation with expert annotations and associations with major adverse cardiovascular events (MACE). Methods: We trained a convolutional long short-term memory DL model to automatically quantify CAC on CTAC scans using 6,608 studies (2 centers) and evaluated the model in an external cohort of patients without known coronary artery disease (n = 2,271) obtained in a separate center. We assessed agreement between DL and expert annotated CAC scores. We also assessed associations between MACE (death, revascularization, myocardial infarction, or unstable angina) and CAC categories (0, 1–100, 101–400, or >400) for scores manually derived by experienced readers and scores obtained fully automatically by DL using multivariable Cox models (adjusted for age, sex, past medical history, perfusion, and ejection fraction) and net reclassification index. Results: In the external testing population, DL CAC was 0 in 908 patients (40.0%), 1–100 in 596 (26.2%), 100–400 in 354 (15.6%), and >400 in 413 (18.2%). Agreement in CAC category by DL CAC and expert annotation was excellent (linear weighted κ, 0.80), but DL CAC was obtained automatically in less than 2 s compared with about 2.5 min for expert CAC. DL CAC category was an independent risk factor for MACE with hazard ratios in comparison to a CAC of zero: CAC of 1–100 (2.20; 95% CI, 1.54–3.14; P < 0.001), CAC of 101–400 (4.58; 95% CI, 3.23–6.48; P < 0.001), and CAC of more than 400 (5.92; 95% CI, 4.27–8.22; P < 0.001). Overall, the net reclassification index was 0.494 for DL CAC, which was similar to expert annotated CAC (0.503). Conclusion: DL CAC from SPECT/CT attenuation maps agrees well with expert CAC annotations and provides a similar risk stratification but can be obtained automatically. DL CAC scores improved classification of a significant proportion of patients as compared with SPECT myocardial perfusion alone.

  • cardiology
  • artificial intelligence
  • coronary artery calcification
  • deep learning
  • myocardial perfusion imaging
  • risk stratification

SPECT myocardial perfusion imaging (MPI) is a well-established and widely used noninvasive imaging modality for the diagnosis and prognostication of coronary artery disease (1,2). SPECT MPI is frequently obtained with ungated, unenhanced CT attenuation correction (CTAC) scans. SPECT/CT scanners use a common bed to move the patient sequentially through both scanners (3), with some models incorporating solid-state detector arrays. CTAC allows correction for soft-tissue attenuation artifacts, leading to improved diagnostic accuracy of SPECT MPI (4).

However, CTAC scans can also potentially be used to provide an anatomic assessment that includes evaluation of coronary artery calcium (CAC) (5). CAC scores are a well-established marker of the extent of coronary atherosclerosis (6–8). Integrating CAC scores from dedicated, gated CT scans with assessments of myocardial perfusion can improve the diagnostic accuracy of SPECT (7) and PET MPI (9). Additionally, CAC from dedicated electrocardiography-gated scans can provide incremental risk stratification when combined with SPECT MPI perfusion (10,11). However, CTAC scans are typically acquired with lower radiation doses and without cardiac gating, leading to worse image quality and often thicker slices than for dedicated CAC scans, which may influence CAC scores (12). Although it is possible to quantify CAC manually from CTAC scans, this can be time-consuming and is not common. It is also possible to visually estimate CAC (13,14), but visual estimation is inherently subjective and requires experience to be performed accurately. Deep learning (DL) has been applied to image segmentation, including models for automated measures of CAC primarily from dedicated CAC scans. We developed a novel convolutional long short-term model (convLSTM) that integrates adjacent image slices, mimicking the clinical approach of scrolling between slices, to quantify CAC more efficiently. We evaluated the correlation between DL and expert annotated CAC scores in patients undergoing SPECT/CT MPI. We then evaluated the prognostic significance of DL and expert annotated CAC scores for major adverse cardiovascular events (MACE), including incremental risk stratification over traditional SPECT MPI parameters, in an external population imaged with solid-state SPECT/CT MPI.

MATERIALS AND METHODS

Study Population

Patients who underwent SPECT/CT MPI with CTAC at 1 of 2 centers (Yale and Cardiovascular Imaging Technologies) were used to train the convLSTM. Patients who underwent SPECT/CT MPI from a third center (University of Calgary) were used as an external testing cohort. Patients without CTAC were excluded. For external testing, patients with a history of coronary artery disease (n = 673), defined as previous myocardial infarction or revascularization with either percutaneous coronary intervention or coronary artery bypass grafting (15), were excluded. Details of the clinical data acquisition are provided in the supplemental materials (available at http://jnm.snmjournals.org). The study protocol complied with the Declaration of Helsinki. The study was approved by the institutional review board at all sites. To the extent allowed by data sharing agreements and institutional review board protocols, data and codes used in this article will be shared on written request.

Image Acquisition and Interpretation

Details of MPI and CTAC image acquisition and interpretation are available in the supplemental materials (16). Additional details on the training population are in Supplemental Table 1.

Two separate cohorts (each comprising 10% of the total number of available scans, n = 661) of the initial training cohort were sampled, with an equal number of cases in each CAC score category. One of those cohorts was held out as a validation set during training, and the model parameters were tuned to this set, whereas the second was held out for internal testing.

All the training, internal validation, internal testing, and external testing cases were annotated on-site by 2 expert readers with at least 5 years of experience in CAC scoring using dedicated quantitative software (Cardiac Suite; Cedars Sinai Medical Center). DL annotations were processed using a custom-developed pipeline, and both expert and DL annotated CAC scores were calculated according to the standard clinical algorithm (6), with additional details in the supplemental materials.

The DL and expert annotated cases were categorized on the basis of the CAC score (category 1, CAC score = 0; category 2, CAC score = 1–100; category 3, CAC score = 101–400; category 4, CAC score > 400).

Model Architecture

The model architecture is outlined in Figure 1. The model was built using PyTorch, version 3.7.4. We automatically segmented CAC from CTAC using a cascaded convLSTM system (17). This system consists of 2 networks, the first of which was trained for segmentation of the heart silhouette and the second of which was trained to segment the CAC. The heart convLSTM was trained on a subset of training data with expert reader annotations from QFAT software (18). A supervised learning regime was used for both segmentation networks. The heart mask was applied to the final CAC prediction to reduce any spurious bone overcalling or calcification in noncardiac regions. To imitate the physician approach of aggregating information from adjacent slices, 3 slices were provided to both networks as input (19). This network architecture was shown previously to have significantly reduced memory consumption and to have inference times almost 2 times faster, with similar accuracy to U-Net on a typical central processing unit (17). Case examples with expert and DL annotations are shown in Figure 2.

FIGURE 1.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 1.

Outline of model architecture. ConvLSTM includes network trained to segment CAC, as well as second network for segmentation of heart, which limits CAC scoring. Softmax argmax function normalizes output of network to expected probabilities. Model identifies coronary calcium (red) and noncoronary calcium (green) within heart mask.

FIGURE 2.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 2.

Examples of expert scores compared with DL CAC scores. Model identifies coronary calcium (red) and noncoronary calcium (green). In case 1, expert and DL annotations identified similar left circumflex CAC as well as ascending aorta calcium. No CAC was identified by either expert or DL scoring in case 2. In case 3, expert and DL annotations identified similar right coronary artery CAC as well as mitral annular calcification. BMI = body mass index.

Statistical Analysis

Details of the statistical analysis are provided in the supplemental materials (20,21). The Proposed Requirements for Cardiovascular Imaging–Related Machine Learning Evaluation (22) checklist is shown in Supplemental Table 2. Improvements in likelihood ratio χ2 and area under the receiver-operating-characteristic curve were also assessed.

RESULTS

Population Characteristics

In total, 6,608 patients were included in the training population. The external testing population included 2,271 patients, with population characteristics by DL CAC category shown in Table 1. On the basis of the DL model results, CAC was 0 in 908 (40.0%) patients, 1–100 in 596 (26.2%) patients, 100–400 in 354 (15.6%) patients, and more than 400 in 413 (18.2%) patients.

View this table:
  • View inline
  • View popup
TABLE 1.

External Testing: Patient Characteristics According to CAC Category Determined by Deep-Learning Model

DL Versus Expert Annotated CAC

DL CAC was obtained fully automatically in less than 2 s per scan (time required to load the study, select slices, and annotate lesions for the entire CTAC volume). This compares with approximately 2.5 min for expert annotations, including the time required to load the study, review all slices, and annotate lesions on selected slices. Figure 3 outlines concordance between DL CAC and expert annotation CAC categories. The categorywise agreement (Fig. 3) between DL CAC and expert CAC was excellent (linear weighted κ, 0.80). There was also good pairwise correlation between DL CAC and expert annotated CAC as continuous measures (r2 = 0.693, P < 0.001; Supplemental Fig. 1). Summary of categorization by visual CAC estimation compared with DL and expert annotated CAC is shown in Supplemental Table 3. Review of discrepant cases is shown in the Supplemental Results and Supplemental Figure 2.

FIGURE 3.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 3.

Concordance matrix between DL and expert CAC categories in external testing population.

Associations with MACE

During a median follow-up of 2.8 years (interquartile range, 1.7–4.1 years), 320 patients experienced at least 1 MACE. Supplemental Table 4 outlines the characteristics of patients who experienced MACE compared with those who did not. Patients who experienced MACE had a higher median CAC (178 vs. 11, P < 0.001) and were more likely to have a CAC of more than 400 (35.9% vs. 15.3%, P < 0.001). Patients who experienced MACE were also older (median, 70.7 vs. 66.1; P < 0.001) and more likely to have a history of diabetes (31.6% vs. 22.1%, P < 0.001) in addition to higher rates of other cardiovascular risk factors.

Increasing DL CAC and expert CAC category were associated with an increased risk of MACE (Fig. 4). Compared with patients with a DL CAC of 0, patients with scores of 1–100 (unadjusted hazard ratio [HR], 2.20; 95% CI, 1.54–3.14), 101–400 (unadjusted HR, 4.58; 95% CI, 3.23–6.48), and more than 400 (unadjusted HR, 5.92; 95% CI, 4.27–8.22) were at significantly increased risk of MACE. The risk was similar across categories of expert annotated CAC categories. Kaplan–Meier survival curves stratified by visually estimated CAC are shown in Supplemental Figure 3.

FIGURE 4.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 4.

Kaplan–Meier survival curves for MACE. Increasing CAC category was associated with increasing risk of MACE for DL and expert annotated CAC scores on SPECT/CT attenuation maps.

Associations with MACE in the multivariable model are outlined in Table 2. DL CAC category continued to be associated with an increased risk of MACE in adjusted analyses for patients with a CAC of 1–100 (adjusted HR, 1.90; 95% CI, 1.32–2.73; P < 0.001), 101–400 (adjusted HR, 3.32; 95% CI, 2.29–4.81; P < 0.001), and more than 400 (adjusted HR, 3.58; 95% CI, 2.47–5.19; P < 0.001) compared with a CAC of 0. This risk stratification was similar to the risk associated with mild stress perfusion abnormalities (stress total perfusion deficit, 5%–10%; adjusted HR, 1.70; 95% CI, 1.19–2.44; P = 0.004) and moderate to severe stress perfusion abnormalities (stress total perfusion deficit, >10%; adjusted HR, 4.73; 95% CI, 3.02–7.46; P < 0.001). The risk associated with expert annotated CAC categories was similar to DL categories (CAC of 1–100: adjusted HR, 2.20; 95% CI, 1.52–3.19; P < 0.001; CAC of 101–400: adjusted HR, 3.57; 95% CI, 2.45–5.20; P < 0.001; CAC > 400: adjusted HR, 4.05; 95% CI, 2.78–5.90; P < 0.001).

View this table:
  • View inline
  • View popup
TABLE 2.

Associations with MACE

Associations with primary outcome were similar if patients who underwent early revascularization were excluded (DL CAC of 1–100: adjusted HR, 2.00; 95% CI, 1.34–2.94; P = 0.001; DL CAC of 101–400: adjusted HR, 2.98; 95% CI, 1.97–4.49; P < 0.001; DL CAC > 400: adjusted HR, 3.07; 95% CI, 2.03–4.66; P < 0.001). Results were also similar for associations with death or myocardial infarction as well as associations with death (Supplemental Table 5).

Net Reclassification

We assessed patient reclassification with the addition of CAC categories to all other components of the multivariable model outlined in Table 2. The results of the net reclassification index (NRI) analysis are shown in Figure 5. Both DL CAC and expert annotated CAC significantly improved model fit and AUC (all P < 0.01) (Supplemental Table 6). DL CAC categories improved the risk classification of patients with events (event NRI, 0.230; 95% CI, 0.142–0.314), patients without events (nonevent NRI, 0.264; 95% CI, 0.204–0.309), and overall patient classification (overall NRI, 0.494; 95% CI, 0.363–0.607). Event, nonevent, and overall NRI were similar for both measures, as shown in Supplemental Table 6. Additionally, overall NRI was lower for visually estimated CAC (overall NRI, 0.409; 95% CI, 0.278–0.537).

FIGURE 5.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 5.

Results of net-reclassification analysis. We assessed addition of CAC categories to full multivariable model outlined in Table 2.

DISCUSSION

We demonstrated that DL-derived CAC scores from CTAC imaging could be used to stratify the risk of MACE, with scores derived rapidly (∼2 s) in a completely automated manner. There was good agreement between CAC score categorization by DL and expert annotations, as evaluated in a large external population with different characteristics. Lastly, we demonstrated that DL CAC categories provided prognostic information additional to clinical information and quantitative assessment of perfusion and ventricular function, with improved classification of a quarter of patients who experienced MACE and a quarter of patients who did not experience MACE. DL CAC scores from CTAC could be used clinically to significantly improve risk stratification in patients undergoing SPECT/CT MPI, without the need for physician or technician time for manual annotation.

We demonstrated that the convLSTM network was able to quantify CAC from CTAC imaging, with excellent agreement with and risk stratification similar to expert annotated CAC. Importantly, the model was trained with data from 2 sites that have CTAC imaging protocols different from that of the external testing site. This training has not been commonly done in other studies reported in the existing literature, providing evidence that the convLSTM and associated DL CAC scores should be generalizable to a variety of acquisition protocols. We also previously demonstrated that this approach has faster inference times than a U-net model and therefore should not negatively impact clinical workflow. Another major strength of the current study is the large number of expert annotations performed on CTAC scans, which are not typically performed clinically. This strength allowed us to evaluate agreement with expert CAC scores more precisely and to robustly compare the risk stratification provided by the 2 measures, including their improvements for risk prediction of traditional SPECT/CT variables.

Several other approaches to CAC scoring with artificial intelligence have been applied previously (23–27). The agreement between CAC categories in our study (Cohen κ, 0.80) is similar to agreement demonstrated using dedicated electrocardiography-gated scans with other DL approaches (25). Isgum et al. developed a convolutional neural network that quantified CAC from low-dose CT scans obtained for lung cancer screening (26). When the same model was applied to patients undergoing PET MPI, the agreement between manual and automated scoring in CTAC was lower than in the present study (linear weighted κ, 0.70–0.74), and the testing was on a much smaller patient population (n = 133) (28). Sartoretti et al. also demonstrated good agreement between expert annotated and DL CAC scores in a cohort of 56 patients undergoing SPECT/CT MPI (29). Importantly, these methods demonstrate rates of agreement similar to what would be expected between 2 expert readers scoring CAC from low-dose CT scans (30). High noise levels and partial-volume effects impact the appearance of CAC lesions (12), leading to frequent false-negative physician interpretations, as evidenced by our finding that physician interpretation of the presence or absence of calcium was discrepant in about 10% of patients. Additionally, we identified cases in which DL annotations differed from expert annotations for calcium in coronary ostia versus adjacent aorta and for valvular calcification versus adjacent coronary arteries.

Although agreement between DL and expert CAC categories is important in itself, we demonstrated that significant improvements in risk stratification are possible with DL annotated CAC scores. We demonstrated that increasing DL CAC category was associated with an increased risk of MACE, similar to recent findings from Zeleznik et al. in both symptomatic and asymptomatic populations (27). However, in the present study we demonstrated that the risk associated with each category was similar to the corresponding category of expert annotated CAC. Additionally, both DL and expert reader CAC categories were significantly associated with MACE after correcting for relevant confounders, including age, sex, medical history, and SPECT MPI results. Lastly, we demonstrated that improvement in patient risk classification with DL CAC was similar to that achieved by expert annotated categories of CAC, with both being higher than is possible with subjective expert visual estimates. Importantly, visually estimated CAC was performed at the time of clinical reporting and was informed by clinical history and perfusion findings. Improved classification compared with expert visual estimate is particularly relevant since nuclear cardiology laboratories more frequently rely on this method for CAC classification given the time required for expert annotation. Although Dekker et al. found that DL CAC scores had an NRI of 0.13 in patients undergoing PET MPI (31), in our study about 1 in 4 patients who experienced MACE would have their risk correctly reclassified, with a similar proportion of patients who did not experience MACE correctly reclassified. Therefore, this approach could be applied to automatically improve risk classification in a substantial proportion of patients.

Our work adds to a growing body of literature supporting integration of CAC scores when interpreting MPI. Chang et al. demonstrated that quantitative CAC combined with SPECT MPI findings provided independent and complementary prognostic information among a cohort of 1,126 patients without prior coronary artery disease (11). Engbers et al. evaluated a combination of the Agatston CAC score and SPECT MPI in 4,897 symptomatic patients without prior coronary artery disease (10), demonstrating a stepwise increase in MACE with increasing CAC score among patients with both normal and abnormal perfusion. Visually estimated CAC (13) can also provide risk stratification in patients undergoing SPECT/CT MPI (14). However, in the present work we demonstrate that the improvement in risk classification is higher with DL CAC, which is rapidly and automatically derived from SPECT/CT attenuation maps.

Our study had a few important limitations. CT attenuation imaging was used clinically to visually assess coronary calcification, and knowledge of CAC can influence patient management (32). However, results were similar for associations with hard outcomes, and this bias would be expected to—if anything—decrease the associations between CAC and hard outcomes. Additionally, it is unknown whether associations with outcomes would differ significantly between CAC from dedicated gated studies and CAC from CT attenuation imaging; however, previous studies have demonstrated close agreement between the measures (33). We trained the convLSTM model using scans with acquisition parameters different from those for the external testing population. More precise quantification of CAC may be possible if the model is trained with similar data, but this also suggests that the model should be broadly generalizable. The model was trained to differentiate coronary from noncoronary calcifications using expert annotations. However, some lesions are challenging for expert readers to annotate (such as ostial calcium compared with adjacent aortic calcifications), and the DL model would also be expected to have difficulties with these areas. Although the DL method provides fully automated results, they will still need to be verified by a physician. The training population included patients with previous revascularization; however, we excluded patients with known coronary artery disease from the external testing population, and dedicated studies are needed to evaluate the model’s ability to differentiate CAC from coronary stents. Lastly, we were not able to ascertain cardiovascular mortality in this large, retrospective population.

CONCLUSION

DL CAC derived from SPECT/CT attenuation maps agrees well with expert CAC annotations. DL and expert annotated CAC are associated with MACE, but DL scores can be obtained automatically in a few seconds. DL CAC scores can be quantified automatically after SPECT/CT MPI, without impeding clinical workflow, to improve classification of a significant proportion of patients.

DISCLOSURE

This research was supported in part by grants R01HL089765 and R35HL161195 from the National Heart, Lung, and Blood Institute/National Institutes of Health (NHLBI/NIH) (principal investigator, Piotr Slomka). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. Robert Miller has received consulting fees and research support from Pfizer. Daniel Berman, Piotr Slomka, and Paul Kavanagh participate in software royalties for QPS software at Cedars-Sinai Medical Center. Piotr Slomka has received research grant support from Siemens Medical Systems. Daniel Berman and Edward Miller have served as consultants for GE Healthcare. No other potential conflict of interest relevant to this article was reported.

KEY POINTS

QUESTION: Do CAC scores quantified automatically with a DL model provide risk stratification similar to that of expert annotated scores?

PERTINENT FINDINGS: In this retrospective multicenter study with dedicated training and external testing populations, DL CAC scores agreed well with expert annotated scores. DL and expert annotated CAC are associated with MACE, but DL scores can be obtained automatically in a few seconds.

IMPLICATIONS FOR PATIENT CARE: DL CAC scores could be used to improve risk prediction of a significant proportion of patients, without impeding clinical workflow.

Footnotes

  • Published online Oct. 7, 2022.

  • © 2023 by the Society of Nuclear Medicine and Molecular Imaging.

REFERENCES

  1. 1.↵
    1. Berman DS,
    2. Hachamovitch R,
    3. Kiat H,
    4. et al
    . Incremental value of prognostic testing in patients with known or suspected ischemic heart disease. J Am Coll Cardiol. 1995;26:639–647.
    OpenUrlFREE Full Text
  2. 2.↵
    1. Fihn SD,
    2. Gardin JM,
    3. Abrams J,
    4. et al
    . 2012 ACCF/AHA/ACP/AATS/PCNA/SCAI/STS guideline for the diagnosis and management of patients with stable ischemic heart disease. J Am Coll Cardiol. 2012;60:e44–e164.
    OpenUrlFREE Full Text
  3. 3.↵
    1. Dorbala S,
    2. Di Carli MF,
    3. Delbeke D,
    4. et al
    . SNMMI/ASNC/SCCT guideline for cardiac SPECT/CT and PET/CT 1.0. J Nucl Med. 2013;54:1485–1507.
    OpenUrlFREE Full Text
  4. 4.↵
    1. Huang JY,
    2. Huang CK,
    3. Yen RF,
    4. et al
    . Diagnostic performance of attenuation-corrected myocardial perfusion imaging for coronary artery disease. J Nucl Med. 2016;57:1893–1898.
    OpenUrlAbstract/FREE Full Text
  5. 5.↵
    1. Patchett ND,
    2. Pawar S,
    3. Miller EJ
    . Visual identification of coronary calcifications on attenuation correction CT improves diagnostic accuracy of SPECT/CT myocardial perfusion imaging. J Nucl Cardiol. 2017;24:711–720.
    OpenUrl
  6. 6.↵
    1. Agatston AS,
    2. Janowitz WR,
    3. Hildner FJ,
    4. Zusmer NR,
    5. Viamonte M,
    6. Detrano R
    . Quantification of coronary artery calcium using ultrafast computed tomography. J Am Coll Cardiol. 1990;15:827–832.
    OpenUrlFREE Full Text
  7. 7.↵
    1. Schepis T,
    2. Gaemperli O,
    3. Koepfli P,
    4. et al
    . Added value of coronary artery calcium score as an adjunct to gated SPECT for the evaluation of coronary artery disease in an intermediate-risk population. J Nucl Med. 2007;48:1424–1430.
    OpenUrlAbstract/FREE Full Text
  8. 8.↵
    1. Blaha MJ,
    2. Blankstein R,
    3. Nasir K
    . Coronary artery calcium scores of zero and establishing the concept of negative risk factors. J Am Coll Cardiol. 2019;74:12–14.
    OpenUrlFREE Full Text
  9. 9.↵
    1. Brodov Y,
    2. Gransar H,
    3. Dey D,
    4. et al
    . Combined quantitative assessment of myocardial perfusion and coronary artery calcium score by hybrid 82Rb PET/CT improves detection of coronary artery disease. J Nucl Med. 2015;56:1345–1350.
    OpenUrlAbstract/FREE Full Text
  10. 10.↵
    1. Engbers EM,
    2. Timmer JR,
    3. Ottervanger JP,
    4. Mouden M,
    5. Knollema S,
    6. Jager PL
    . Prognostic value of coronary artery calcium scoring in addition to single-photon emission computed tomographic myocardial perfusion imaging in symptomatic patients. Circ Cardiovasc Imaging. 2016;9:e003966.
    OpenUrlAbstract/FREE Full Text
  11. 11.↵
    1. Chang SM,
    2. Nabi F,
    3. Xu J,
    4. et al
    . The coronary artery calcium score and stress myocardial perfusion imaging provide independent and complementary prediction of cardiac risk. J Am Coll Cardiol. 2009;54:1872–1882.
    OpenUrlFREE Full Text
  12. 12.↵
    1. Mühlenbruch G,
    2. Thomas C,
    3. Wildberger JE,
    4. et al
    . Effect of varying slice thickness on coronary calcium scoring with multislice computed tomography in vitro and in vivo. Invest Radiol. 2005;40:695–699.
    OpenUrlCrossRefPubMed
  13. 13.↵
    1. Einstein AJ,
    2. Johnson LL,
    3. Bokhari S,
    4. et al
    . Agreement of visual estimation of coronary artery calcium from low-dose CT attenuation correction scans in hybrid PET/CT and SPECT/CT with standard Agatston score. J Am Coll Cardiol. 2010;56:1914–1921.
    OpenUrlFREE Full Text
  14. 14.↵
    1. Trpkov C,
    2. Savtchenko A,
    3. Liang Z,
    4. et al
    . Visually estimated coronary artery calcium score improves SPECT-MPI risk stratification. Int J Cardiol Heart Vasc. 2021;35:100827.
    OpenUrl
  15. 15.↵
    1. Miller RJH,
    2. Klein E,
    3. Gransar H,
    4. et al
    . Prognostic significance of previous myocardial infarction and previous revascularization in patients undergoing SPECT MPI. Int J Cardiol. 2020;313:9–15.
    OpenUrl
  16. 16.↵
    1. Slomka PJ,
    2. Nishina H,
    3. Berman DS,
    4. et al
    . Automated quantification of myocardial perfusion SPECT using simplified normal limits. J Nucl Cardiol. 2005;12:66–77.
    OpenUrlCrossRefPubMed
  17. 17.↵
    1. Pieszko K,
    2. Shanbhag A,
    3. Killekar A,
    4. et al
    . Calcium scoring in low-dose ungated chest CT scans using convolutional long-short term memory networks. Proc SPIE Int Soc Opt Eng. 2022;12032:120323A.
    OpenUrl
  18. 18.↵
    1. Eisenberg E,
    2. McElhinney PA,
    3. Commandeur F,
    4. et al
    . Deep learning-based quantification of epicardial adipose tissue volume and attenuation predicts major adverse cardiovascular events in asymptomatic subjects. Circ Cardiovasc Imaging. 2020;13:e009829.
    OpenUrlPubMed
  19. 19.↵
    1. Lin TY,
    2. Goyal P,
    3. Girshick R,
    4. He K,
    5. Dollar P
    . Focal loss for dense object detection. IEEE Trans Pattern Anal Mach Intell. 2020;42:318–327.
    OpenUrlCrossRefPubMed
  20. 20.↵
    1. Miller RJH,
    2. Bonow RO,
    3. Gransar H,
    4. et al
    . Percutaneous or surgical revascularization is associated with survival benefit in stable coronary artery disease. Eur Heart J Cardiovasc Imaging. 2020;21:961–970.
    OpenUrl
  21. 21.↵
    1. Azadani PN,
    2. Miller RJH,
    3. Sharir T,
    4. et al
    . Impact of early revascularization on major adverse cardiovascular events in relation to automatically quantified ischemia. JACC Cardiovasc Imaging. 2021;14:644–653.
    OpenUrl
  22. 22.↵
    1. Sengupta PP,
    2. Shrestha S,
    3. Berthon B,
    4. et al
    . Proposed requirements for cardiovascular imaging-related machine learning evaluation (PRIME). JACC Cardiovasc Imaging. 2020;13:2017–2035.
    OpenUrlAbstract/FREE Full Text
  23. 23.↵
    1. Kurkure U,
    2. Chittajallu DR,
    3. Brunner G,
    4. Le YH,
    5. Kakadiaris IA
    . A supervised classification-based method for coronary calcium detection in non-contrast CT. Int J Cardiovasc Imaging. 2010;26:817–828.
    OpenUrlPubMed
  24. 24.
    1. Isgum I,
    2. Rutten A,
    3. Prokop M,
    4. van Ginneken B
    . Detection of coronary calcifications from computed tomography scans for automated risk assessment of coronary artery disease. Med Phys. 2007;34:1450–1461.
    OpenUrlCrossRefPubMed
  25. 25.↵
    1. Wolterink JM,
    2. Leiner T,
    3. de Vos BD,
    4. et al
    . An evaluation of automatic coronary artery calcium scoring methods with cardiac CT using the orCaScore framework. Med Phys. 2016;43:2361.
    OpenUrl
  26. 26.↵
    1. Isgum I,
    2. Prokop M,
    3. Niemeijer M,
    4. Viergever MA,
    5. van Ginneken B
    . Automatic coronary calcium scoring in low-dose chest computed tomography. IEEE Trans Med Imaging. 2012;31:2322–2334.
    OpenUrlCrossRefPubMed
  27. 27.↵
    1. Zeleznik R,
    2. Foldyna B,
    3. Eslami P,
    4. et al
    . Deep convolutional neural networks to predict cardiovascular risk from computed tomography. Nat Commun. 2021;12:715.
    OpenUrlCrossRefPubMed
  28. 28.↵
    1. Išgum I,
    2. de Vos BD,
    3. Wolterink JM,
    4. et al
    . Automatic determination of cardiovascular risk by CT attenuation correction maps in Rb-82 PET/CT. J Nucl Cardiol. 2018;25:2133–2142.
    OpenUrl
  29. 29.↵
    1. Sartoretti T,
    2. Gennari AG,
    3. Sartoretti E,
    4. et al
    . Fully automated deep learning powered calcium scoring in patients undergoing MPI. J Nucl Cardiol. May 17, 2022 [Epub ahead of print].
  30. 30.↵
    1. Jacobs PC,
    2. Isgum I,
    3. Gondrie MJ,
    4. et al
    . Coronary artery calcification scoring in low-dose ungated CT screening for lung cancer. AJR. 2010;194:1244–1249.
    OpenUrlCrossRefPubMed
  31. 31.↵
    1. Dekker M,
    2. Waissi F,
    3. Bank IEM,
    4. et al
    . The prognostic value of automated coronary calcium derived by a deep learning approach on non-ECG gated CT images from 82Rb-PET/CT MPI. Int J Cardiol. 2021;329:9–15.
    OpenUrl
  32. 32.↵
    1. Rozanski A,
    2. Gransar H,
    3. Shaw Leslee J,
    4. et al
    . Impact of coronary artery calcium scanning on coronary risk factors and downstream testing. J Am Coll Cardiol. 2011;57:1622–1632.
    OpenUrlFREE Full Text
  33. 33.↵
    1. Pieszko K,
    2. Shanbhag AD,
    3. Lemley M,
    4. et al
    . Reproducibility of quantitative coronary calcium scoring from PET/CT attenuation maps: comparison to ECG-gated CT scans. Eur J Nucl Med Mol Imaging. June 25, 2022 [Epub ahead of print].
  • Received for publication May 20, 2022.
  • Revision received October 4, 2022.
PreviousNext
Back to top

In this issue

Journal of Nuclear Medicine: 64 (4)
Journal of Nuclear Medicine
Vol. 64, Issue 4
April 1, 2023
  • Table of Contents
  • Table of Contents (PDF)
  • About the Cover
  • Index by author
  • Complete Issue (PDF)
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on Journal of Nuclear Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Deep Learning Coronary Artery Calcium Scores from SPECT/CT Attenuation Maps Improve Prediction of Major Adverse Cardiac Events
(Your Name) has sent you a message from Journal of Nuclear Medicine
(Your Name) thought you would like to see the Journal of Nuclear Medicine web site.
Citation Tools
Deep Learning Coronary Artery Calcium Scores from SPECT/CT Attenuation Maps Improve Prediction of Major Adverse Cardiac Events
Robert J.H. Miller, Konrad Pieszko, Aakash Shanbhag, Attila Feher, Mark Lemley, Aditya Killekar, Paul B. Kavanagh, Serge D. Van Kriekinge, Joanna X. Liang, Cathleen Huang, Edward J. Miller, Timothy Bateman, Daniel S. Berman, Damini Dey, Piotr J. Slomka
Journal of Nuclear Medicine Apr 2023, 64 (4) 652-658; DOI: 10.2967/jnumed.122.264423

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Deep Learning Coronary Artery Calcium Scores from SPECT/CT Attenuation Maps Improve Prediction of Major Adverse Cardiac Events
Robert J.H. Miller, Konrad Pieszko, Aakash Shanbhag, Attila Feher, Mark Lemley, Aditya Killekar, Paul B. Kavanagh, Serge D. Van Kriekinge, Joanna X. Liang, Cathleen Huang, Edward J. Miller, Timothy Bateman, Daniel S. Berman, Damini Dey, Piotr J. Slomka
Journal of Nuclear Medicine Apr 2023, 64 (4) 652-658; DOI: 10.2967/jnumed.122.264423
Twitter logo Facebook logo LinkedIn logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One
Bookmark this article

Jump to section

  • Article
    • Visual Abstract
    • Abstract
    • MATERIALS AND METHODS
    • RESULTS
    • DISCUSSION
    • CONCLUSION
    • DISCLOSURE
    • Footnotes
    • REFERENCES
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • PDF

Related Articles

  • PubMed
  • Google Scholar

Cited By...

  • AI-based volumetric six-tissue body composition quantification from CT cardiac attenuation scans enhances mortality prediction: multicenter study
  • Holistic AI analysis of hybrid cardiac perfusion images for mortality prediction
  • Google Scholar

More in this TOC Section

  • [11C]ZTP-1: An Effective Short-Lived Radioligand for PET of Rat and Monkey Brain Phosphodiesterase Type 4 Subtype B
  • Reduced Renal Uptake of Various Radiopharmaceuticals with Sodium Paraaminohippurate Coadministration in a Rat Model
  • In Vivo Visualization and Quantification of Brain Heat Shock Protein 90 with [11C]HSP990 in Healthy Aging and Neurodegeneration
Show more Basic Science Investigation

Similar Articles

Keywords

  • cardiology
  • artificial intelligence
  • coronary artery calcification
  • deep learning
  • myocardial perfusion imaging
  • risk stratification
SNMMI

© 2025 SNMMI

Powered by HighWire