Skip to main content

Main menu

  • Home
  • Content
    • Current
    • Ahead of print
    • Past Issues
    • JNM Supplement
    • SNMMI Annual Meeting Abstracts
    • Continuing Education
    • JNM Podcasts
  • Subscriptions
    • Subscribers
    • Institutional and Non-member
    • Rates
    • Journal Claims
    • Corporate & Special Sales
  • Authors
    • Submit to JNM
    • Information for Authors
    • Assignment of Copyright
    • AQARA requirements
  • Info
    • Reviewers
    • Permissions
    • Advertisers
  • About
    • About Us
    • Editorial Board
    • Contact Information
  • More
    • Alerts
    • Feedback
    • Help
    • SNMMI Journals
  • SNMMI
    • JNM
    • JNMT
    • SNMMI Journals
    • SNMMI

User menu

  • Subscribe
  • My alerts
  • Log in
  • My Cart

Search

  • Advanced search
Journal of Nuclear Medicine
  • SNMMI
    • JNM
    • JNMT
    • SNMMI Journals
    • SNMMI
  • Subscribe
  • My alerts
  • Log in
  • My Cart
Journal of Nuclear Medicine

Advanced Search

  • Home
  • Content
    • Current
    • Ahead of print
    • Past Issues
    • JNM Supplement
    • SNMMI Annual Meeting Abstracts
    • Continuing Education
    • JNM Podcasts
  • Subscriptions
    • Subscribers
    • Institutional and Non-member
    • Rates
    • Journal Claims
    • Corporate & Special Sales
  • Authors
    • Submit to JNM
    • Information for Authors
    • Assignment of Copyright
    • AQARA requirements
  • Info
    • Reviewers
    • Permissions
    • Advertisers
  • About
    • About Us
    • Editorial Board
    • Contact Information
  • More
    • Alerts
    • Feedback
    • Help
    • SNMMI Journals
  • View or Listen to JNM Podcast
  • Visit JNM on Facebook
  • Join JNM on LinkedIn
  • Follow JNM on Twitter
  • Subscribe to our RSS feeds
Meeting ReportPoster - PhysicianPharm

PET and fMRI Assessment of 3-D Striatal Segmentation using Multi-Task Learning

Mario Serrano-Sosa, Jared Van Snellenberg, Jiayan Meng, Karl Spuhler, Jacob Luceno, Jodi Weinstein, Anissa Abi-Dargham, Mark Slifstein and Chuan Huang
Journal of Nuclear Medicine May 2021, 62 (supplement 1) 1175;
Mario Serrano-Sosa
1Stony Brook Medicine Stony Brook NY United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jared Van Snellenberg
1Stony Brook Medicine Stony Brook NY United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jiayan Meng
2Department of Psychiatry and Behavioral Health Stony Brook Medicine Stony Brook NY United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Karl Spuhler
3NYU Langone Medical Center New York NY United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jacob Luceno
1Stony Brook Medicine Stony Brook NY United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jodi Weinstein
1Stony Brook Medicine Stony Brook NY United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Anissa Abi-Dargham
1Stony Brook Medicine Stony Brook NY United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mark Slifstein
1Stony Brook Medicine Stony Brook NY United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Chuan Huang
1Stony Brook Medicine Stony Brook NY United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Info & Metrics
Loading

Abstract

1175

Introduction: Segmenting the human striatum to assess functionality has proven to be critical in studying neurological and neuropsychiatric diseases. Studies in nonhuman primates have established a clear functional organization of projections to and from complex striatal subregions1. . Imaging researchers, particularly in positron emission tomography (PET), have translated this functional organization into operationally defined substructures that can be manually traced on T1-weighted MR images2,3. Nevertheless, this manual segmentation is time-consuming. More rapid atlas-based methods have been developed such as the Imperial College London Clinical Imaging Center (CIC). Although easy to implement, atlas-based methods typically nonlinear warp the input volume which may affect smaller ROI’s such as striatal subregions4. We have developed a deep learning technique using Multi-Task Learning (MTL) that jointly learns how to segment striatal subregions consisting of pre-commissural putamen (prePU), pre-commissural caudate (preCA), post-commissural putamen (postPU), post-commissural caudate (postCA), and ventral striatum (VST) using a convolutional neural network (CNN). In this work, we employ a 3-D U-Net architecture with single MRI input and multiple segmentation outputs and compare it to CIC segmentations using PET and fMRI objective assessment.

Methods: 68 3D T1-weighted images and their corresponding manually drawn striatal subregion segmentations were used to train the network. The datasets consisted of patients with schizophrenia and matched controls. As shown in Figure 1, this MTL network consisted of a 3D U-Net architecture. This model was trained to minimize the sparse softmax cross entropy. An independent dataset of 19 volunteers imaged with [11C]raclopride PET and MRI were used for the testing set. For additional comparison, striatal substructure ROIs from the CIC atlas5 were retrieved from the MIAKAT (Imanova, Ltd; London, UK) software package, and applied to the test data. Dice Similarity Coefficients (DSC) were utilized to initially evaluate the performance of the automated methods. Multi-modal assessment consisted of PET and fMRI analysis. 60 min of dynamic emission data were acquired on an Siemens mCT scanner, following a bolus injection of 349 +/- 109 MBq of [11C]raclopride. Data were reconstructed by FBP with CT used for attenuation correction. Binding Potential (BPND) was derived in each ROI using simplified reference tissue model (SRTM)6 with cerebellum as reference tissue. Linear Regression was performed with BPND obtained from manual and MTL-generated ROIs and R2 was reported. fMRI test dataset consisted of multiband blood oxygen level dependent (BOLD) MR sequences. Raw timeseries and whole-brain RSFC were extracted from both hand-drawn and automated ROIs following preprocessing. Finally, the correlation across voxels in RSFC was calculated between hand-drawn and automated ROIs. Results: Striatal segmentations from manual and automated methods can be seen in Figure 2. When comparing DSC, MTL-generated segmentations were more comparable to manual segmentations than CIC across all ROI’s (Table 1). When comparing PET quantification, R-square show that MTL is more comparable to manual segmentations than CIC across all ROI’s (Table 2). In terms of fMRI connectivity, MTL segmentations also had closer correlation to manually drawn ROI’s (rMTL > 0.87 ; rCIC > 0.76) across all ROI's. Conclusion: The developed MTL framework for striatal subregion segmentation shown here provides reliable segmentations with more comparable PET and fMRI results that more closely match those obtained with manually drawn ROIs than atlas-based segmentations.

View this table:
  • View inline
  • View popup

Mean Dice Similarity Coefficient (DSC) with standard deviations for all ROIs in both CNN and CIC ana

View this table:
  • View inline
  • View popup

. Regression coefficients from correlative analysis between BPND calculated from manually drawn ROIs

Figure
  • Download figure
  • Open in new tab
  • Download powerpoint

Figure
  • Download figure
  • Open in new tab
  • Download powerpoint
Previous
Back to top

In this issue

Journal of Nuclear Medicine
Vol. 62, Issue supplement 1
May 1, 2021
  • Table of Contents
  • Index by author
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on Journal of Nuclear Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
PET and fMRI Assessment of 3-D Striatal Segmentation using Multi-Task Learning
(Your Name) has sent you a message from Journal of Nuclear Medicine
(Your Name) thought you would like to see the Journal of Nuclear Medicine web site.
Citation Tools
PET and fMRI Assessment of 3-D Striatal Segmentation using Multi-Task Learning
Mario Serrano-Sosa, Jared Van Snellenberg, Jiayan Meng, Karl Spuhler, Jacob Luceno, Jodi Weinstein, Anissa Abi-Dargham, Mark Slifstein, Chuan Huang
Journal of Nuclear Medicine May 2021, 62 (supplement 1) 1175;

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
PET and fMRI Assessment of 3-D Striatal Segmentation using Multi-Task Learning
Mario Serrano-Sosa, Jared Van Snellenberg, Jiayan Meng, Karl Spuhler, Jacob Luceno, Jodi Weinstein, Anissa Abi-Dargham, Mark Slifstein, Chuan Huang
Journal of Nuclear Medicine May 2021, 62 (supplement 1) 1175;
Twitter logo Facebook logo LinkedIn logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One
Bookmark this article

Jump to section

  • Article
  • Figures & Data
  • Info & Metrics

Related Articles

  • No related articles found.
  • Google Scholar

Cited By...

  • No citing articles found.
  • Google Scholar

More in this TOC Section

Poster - PhysicianPharm

  • Preliminary result of Texture Analysis on prediction of overall outcome of neuroendocrine tumors based on pre-therapy heterogeneity of somatostatin receptors on 68Ga Dotatate PET/CT scans.
  • Predictive value of the proportion of hibernating myocardium in total perfusion defect on reversing remodeling in patients with ischemic cardiomyopathy and treated by revascularization
  • High incidence of atherosclerosis in smokers demonstrated by NaF-PET/CT imaging of the major arteries
Show more Poster - PhysicianPharm

PIDS - Data Sciences

  • Prediction of human papillomavirus associated oropharyngeal cancer using multiple machine learning algorithms and PET/CT image radiomics features.
  • Automatic hierarchical classification and additional CT suggestion by deep convolutional neural networks for bone scintigraphy
  • Early Phase F18-Florbetaben Imaging Can Be Used to Improve Alzheimer's Disease Detection
Show more PIDS - Data Sciences

Similar Articles

SNMMI

© 2025 SNMMI

Powered by HighWire