Skip to main content

Main menu

  • Home
  • Content
    • Current
    • Ahead of print
    • Past Issues
    • JNM Supplement
    • SNMMI Annual Meeting Abstracts
    • Continuing Education
    • JNM Podcasts
  • Subscriptions
    • Subscribers
    • Institutional and Non-member
    • Rates
    • Journal Claims
    • Corporate & Special Sales
  • Authors
    • Submit to JNM
    • Information for Authors
    • Assignment of Copyright
    • AQARA requirements
  • Info
    • Reviewers
    • Permissions
    • Advertisers
  • About
    • About Us
    • Editorial Board
    • Contact Information
  • More
    • Alerts
    • Feedback
    • Help
    • SNMMI Journals
  • SNMMI
    • JNM
    • JNMT
    • SNMMI Journals
    • SNMMI

User menu

  • Subscribe
  • My alerts
  • Log in
  • Log out
  • My Cart

Search

  • Advanced search
Journal of Nuclear Medicine
  • SNMMI
    • JNM
    • JNMT
    • SNMMI Journals
    • SNMMI
  • Subscribe
  • My alerts
  • Log in
  • Log out
  • My Cart
Journal of Nuclear Medicine

Advanced Search

  • Home
  • Content
    • Current
    • Ahead of print
    • Past Issues
    • JNM Supplement
    • SNMMI Annual Meeting Abstracts
    • Continuing Education
    • JNM Podcasts
  • Subscriptions
    • Subscribers
    • Institutional and Non-member
    • Rates
    • Journal Claims
    • Corporate & Special Sales
  • Authors
    • Submit to JNM
    • Information for Authors
    • Assignment of Copyright
    • AQARA requirements
  • Info
    • Reviewers
    • Permissions
    • Advertisers
  • About
    • About Us
    • Editorial Board
    • Contact Information
  • More
    • Alerts
    • Feedback
    • Help
    • SNMMI Journals
  • View or Listen to JNM Podcast
  • Visit JNM on Facebook
  • Join JNM on LinkedIn
  • Follow JNM on Twitter
  • Subscribe to our RSS feeds
Meeting ReportPhysics, Instrumentation & Data Sciences - Image Generation

Early-to-late frame conversion using a temporally informed GAN for cardiac dynamic PET motion correction

Xueqi Guo, Luyao Shi, Xiongchao Chen, Qiong Liu, Huidong Xie, Bo Zhou, Yi-Hwa Liu, Richard Palyo, Adam Liu, Edward Miller, Albert Sinusas, Bruce Spottiswoode, Chi Liu and Nicha Dvornek
Journal of Nuclear Medicine June 2023, 64 (supplement 1) P524;
Xueqi Guo
1Yale University
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Luyao Shi
2IBM Research
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Xiongchao Chen
1Yale University
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Qiong Liu
1Yale University
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Huidong Xie
1Yale University
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Bo Zhou
1Yale University
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Yi-Hwa Liu
1Yale University
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Richard Palyo
3Yale New Haven Hospital
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Adam Liu
4Amity School
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Edward Miller
1Yale University
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Albert Sinusas
5Yale University School of Medicine
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Bruce Spottiswoode
6Siemens Medical Solutions USA, Inc., Knoxville, Tennessee, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Chi Liu
1Yale University
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nicha Dvornek
1Yale University
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Info & Metrics
Loading

Abstract

P524

Introduction: Due to the rapid tracer kinetics of Rubidium-82 (Rb-82) in cardiac dynamic PET, the significant cross-frame tracer distribution difference introduces substantial challenges to inter-frame motion estimation and correction, especially for the early frames, where traditional intensity-based image registration methods do not apply. We aim to develop a generative adversarial network (GAN) informed by temporal features to convert the early frames to the late reference frame for the purpose of improving the accuracy of frame-wise registration and parametric quantification.

Methods: The study includes a total of 85 clinical Rb-82 PET scans (55 rest and 30 stress) from 59 patients that were acquired at Yale New Haven Hospital using a GE Discovery 690 PET/CT scanner and identified as motion-free by technologists. List-mode data of each scan in the first 6 min 10 s were rebinned into 27 dynamic frames. 17 scans were randomly selected for evaluation and the remaining 68 were for network training. The generator of the proposed GAN converts the input early frame to the corresponding late frame, employing the structure of a 3D U-Net with temporal feature-wise linear modulation (FiLM) at the bottleneck. A linear layer encodes the right ventricle (RV) and left ventricle (LV) blood pool time activity curves as well as the temporal frame index (Temp Index) as the auxiliary information and generates channel-wise parameters γ and β for the bottleneck FiLM manipulation. The discriminator of the proposed model encodes either the real or converted last frames and classifies them as either true or synthetic, using a PatchGAN architecture. The loss function consists of an adversarial loss and a voxel-wise L2 loss. The network is trained to convert all the early frames where the LV activity is equal to or higher than RV activity, to the last frame which was also the reference frame of the inter-frame registration. Qualitative visual comparison and quantitative image similarity metrics including structural similarity index measure (SSIM), mean squared error (MSE), and normalized mean absolute error (NMAE) were included for frame conversion evaluation. Following early-to-late frame conversion, three types (square, triangle, and spike) of simulated translational motion were added to both the original and converted frame sequences, resulting in 51 with-motion samples. Inter-frame motion correction was then implemented by mutual information-based registration implemented in BioImage Suite (BIS). The mean absolute motion prediction errors were calculated to measure motion estimation accuracy. After applying motion correction on the original motion-affected dynamic frames, we generated LV and myocardium (Myo) time activity curves and then fit the one-tissue compartment model for K1 quantification. The mean K1 percentage difference and fitting error were compared as the parametric fitting evaluation.

Results: The converted early frames had comparable visual quality to the reference last frames. With the newly introduced FiLM and L2 loss, the proposed network significantly improved SSIM, MSE, and NMAE compared with those of a vanilla GAN baseline. After frame conversion, the overall mean motion prediction error of BIS across all cases decreased from 0.90 ± 2.04 mm to 0.83 ± 2.06 mm. The LV and Myo time activity curves were closer to the groundtruth. In parametric quantification, the K1 percentage difference further decreased from 5.19% to 2.21%, and K1 fitting error further reduced from 7.81e-4 to 7.06e-4.

Conclusions: Temporally informed GAN could successfully perform early-to-late frame conversion for cardiac dynamic PET. The frame conversion could facilitate inter-frame motion correction with improved motion estimation accuracy and reduced parametric fitting error.

Figure
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure
  • Download figure
  • Open in new tab
  • Download powerpoint
Previous
Back to top

In this issue

Journal of Nuclear Medicine
Vol. 64, Issue supplement 1
June 1, 2023
  • Table of Contents
  • Index by author
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on Journal of Nuclear Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Early-to-late frame conversion using a temporally informed GAN for cardiac dynamic PET motion correction
(Your Name) has sent you a message from Journal of Nuclear Medicine
(Your Name) thought you would like to see the Journal of Nuclear Medicine web site.
Citation Tools
Early-to-late frame conversion using a temporally informed GAN for cardiac dynamic PET motion correction
Xueqi Guo, Luyao Shi, Xiongchao Chen, Qiong Liu, Huidong Xie, Bo Zhou, Yi-Hwa Liu, Richard Palyo, Adam Liu, Edward Miller, Albert Sinusas, Bruce Spottiswoode, Chi Liu, Nicha Dvornek
Journal of Nuclear Medicine Jun 2023, 64 (supplement 1) P524;

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Early-to-late frame conversion using a temporally informed GAN for cardiac dynamic PET motion correction
Xueqi Guo, Luyao Shi, Xiongchao Chen, Qiong Liu, Huidong Xie, Bo Zhou, Yi-Hwa Liu, Richard Palyo, Adam Liu, Edward Miller, Albert Sinusas, Bruce Spottiswoode, Chi Liu, Nicha Dvornek
Journal of Nuclear Medicine Jun 2023, 64 (supplement 1) P524;
Twitter logo Facebook logo LinkedIn logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One
Bookmark this article

Jump to section

  • Article
  • Figures & Data
  • Info & Metrics

Related Articles

  • No related articles found.
  • Google Scholar

Cited By...

  • No citing articles found.
  • Google Scholar

More in this TOC Section

  • Human Subject Study of a Transmission Source Enhanced Attenuation Correction for Precision PET Neuroimaging
  • PyTomography: Advancements in AI-Based Image Reconstructions
  • Robust contactless dual-gating in cardiac PET/CT imaging using ultra-fast listmode reconstruction with high temporal resolution frames
Show more Physics, Instrumentation & Data Sciences - Image Generation

Similar Articles

SNMMI

© 2025 SNMMI

Powered by HighWire