Skip to main content

Main menu

  • Home
  • Content
    • Current
    • Ahead of print
    • Past Issues
    • JNM Supplement
    • SNMMI Annual Meeting Abstracts
    • Continuing Education
    • JNM Podcasts
  • Subscriptions
    • Subscribers
    • Institutional and Non-member
    • Rates
    • Journal Claims
    • Corporate & Special Sales
  • Authors
    • Submit to JNM
    • Information for Authors
    • Assignment of Copyright
    • AQARA requirements
  • Info
    • Reviewers
    • Permissions
    • Advertisers
  • About
    • About Us
    • Editorial Board
    • Contact Information
  • More
    • Alerts
    • Feedback
    • Help
    • SNMMI Journals
  • SNMMI
    • JNM
    • JNMT
    • SNMMI Journals
    • SNMMI

User menu

  • Subscribe
  • My alerts
  • Log in
  • Log out
  • My Cart

Search

  • Advanced search
Journal of Nuclear Medicine
  • SNMMI
    • JNM
    • JNMT
    • SNMMI Journals
    • SNMMI
  • Subscribe
  • My alerts
  • Log in
  • Log out
  • My Cart
Journal of Nuclear Medicine

Advanced Search

  • Home
  • Content
    • Current
    • Ahead of print
    • Past Issues
    • JNM Supplement
    • SNMMI Annual Meeting Abstracts
    • Continuing Education
    • JNM Podcasts
  • Subscriptions
    • Subscribers
    • Institutional and Non-member
    • Rates
    • Journal Claims
    • Corporate & Special Sales
  • Authors
    • Submit to JNM
    • Information for Authors
    • Assignment of Copyright
    • AQARA requirements
  • Info
    • Reviewers
    • Permissions
    • Advertisers
  • About
    • About Us
    • Editorial Board
    • Contact Information
  • More
    • Alerts
    • Feedback
    • Help
    • SNMMI Journals
  • View or Listen to JNM Podcast
  • Visit JNM on Facebook
  • Join JNM on LinkedIn
  • Follow JNM on Twitter
  • Subscribe to our RSS feeds
Research ArticleClinical Investigations

Individual-Reader Diagnostic Performance and Between-Reader Agreement in Assessment of Subjects with Parkinsonian Syndrome or Dementia Using 123I-Ioflupane Injection (DaTscan) Imaging

John P. Seibyl, Andreas Kupsch, Jan Booij, Donald G. Grosset, Durval C. Costa, Robert A. Hauser, Jacques Darcourt, Nin Bajaj, Zuzana Walker, Kenneth Marek, Ian McKeith, John T. O’Brien, Klaus Tatsch, Eduardo Tolosa, Rudi A. Dierckx and Igor D. Grachev
Journal of Nuclear Medicine August 2014, 55 (8) 1288-1296; DOI: https://doi.org/10.2967/jnumed.114.140228
John P. Seibyl
1Institute for Neurodegenerative Disorders, New Haven, Connecticut
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Andreas Kupsch
2Department of Neurology and Stereotactic Neurosurgery, Otto-von-Guericke-University, Magdeburg, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jan Booij
3Department of Nuclear Medicine, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Donald G. Grosset
4Institute of Neurological Sciences, Southern General Hospital and University of Glasgow, Glasgow, Scotland
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Durval C. Costa
5Nuclear Medicine-Radiopharmacology, Champalimaud Centre for the Unknown, Champalimaud Foundation, Lisbon, Portugal
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Robert A. Hauser
6Departments of Neurology, Molecular Pharmacology and Physiology, USF Health Byrd Parkinson’s Disease and Movement Disorders Center, National Parkinson Foundation Center of Excellence, Tampa, Florida
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jacques Darcourt
7Department of Nuclear Medicine, Centre Antoine Lacassagne, TIRO Research Group, University of Nice Sophia-Antipolis, Nice, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nin Bajaj
8Department of Clinical Neurology, National Parkinson's Foundation International Centre of Excellence, Nottingham University Hospitals NHS Trust and University of Nottingham, Queen's Medical Centre Campus, Nottingham, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Zuzana Walker
9Division of Psychiatry, University College London, London, United Kingdom
10North Essex Partnership University NHS Foundation Trust, Essex, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kenneth Marek
1Institute for Neurodegenerative Disorders, New Haven, Connecticut
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ian McKeith
11Campus for Ageing and Vitality, Newcastle University, Newcastle upon Tyne, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
John T. O’Brien
12Department of Psychiatry, University of Cambridge School of Clinical Medicine and Cambridgeshire and Peterborough Foundation NHS Trust, Cambridge, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Klaus Tatsch
13Department of Nuclear Medicine, Municipal Hospital Karlsruhe, Inc., Karlsruhe, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Eduardo Tolosa
14Neurology Service, Hospital Clínic de Barcelona, Universitat de Barcelona, IDIBAPS, Centro de Investigación Biomédica en Red sobre Enfermedades Neurodegenerativas (CIBERNED), Barcelona, Catalonia, Spain
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Rudi A. Dierckx
15Departments of Radiology, Nuclear Medicine, and Molecular Imaging, University Medical Centre Groningen, Groningen, The Netherlands; and
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Igor D. Grachev
16Medical Affairs, Life Sciences, GE Healthcare, Princeton, New Jersey
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • PDF
Loading

Abstract

Establishing an early, accurate diagnosis is fundamental for appropriate clinical management of patients with movement disorders or dementia. Ioflupane 123I Injection (DaTscan, 123I-ioflupane) is an important adjunct to support the clinical diagnosis. Understanding individual-reader diagnostic performance of 123I-ioflupane in a variety of clinical scenarios is essential. Methods: Sensitivity, specificity, interreader, and intrareader data from 5 multicenter clinical studies were reviewed. The different study designs offered an assortment of variables to assess the effects on the diagnostic performance of 123I-ioflupane: on-site versus 3–5 blinded image readers, number of image evaluations, early/uncertain versus late/confirmed clinical diagnosis as reference standard, and subjects with movement disorders versus dementia. Results: Eight hundred eighteen subjects had individual-reader efficacy data available for analysis. In general, sensitivity and specificity were high and comparable between on-site versus blinded independent readers. In subjects with dementia, when the clinical diagnosis was made at month 12 versus baseline, specificity improved from 77.4%–91.2% to 81.6%–95.0%. In subjects with movement disorders, this effect was observed to an even greater extent, when diagnostic performance using month-18 diagnosis as a reference standard (sensitivity, 67.0%–73.7%; specificity, 75.0%–83.3%) was compared versus month-36 diagnosis (77.5%–80.3% and 90.3%–96.8%, respectively). Diagnostic performance was similar in subjects with dementia (74.4%–89.9% and 77.4%–95.0%, respectively) and subjects with movement disorders (67.0%–97.9% and 71.4%–98.4%, respectively). In most of the comparisons, between-reader agreement was very good (almost perfect), with κ ranging from 0.81 to 1.00. Within-reader agreement, measured in 1 study, was 100% for 3 blinded readers. Conclusion: Individual-reader diagnostic performance, as assessed by measuring sensitivity and specificity of 123I-ioflupane to detect the presence or absence of striatal dopaminergic deficit, using the clinical diagnosis as a reference standard, was high in subjects with either movement disorders or dementia and was similar in on-site readers versus blinded analyses. Between- and within-reader agreements were very good (almost perfect). Longer follow-up between imaging and clinical diagnosis improved the diagnostic accuracy, most likely due to improvement in the clinical diagnosis reference standard, rather than changes in reader accuracy.

  • sensitivity
  • specificity
  • diagnostic performance
  • Ioflupane 123I Injection
  • DaTscan

Clinical diagnosis of movement disorders is challenging, particularly to the general neurologist, because of the subtlety and the lack of specificity of signs and symptoms in the early stages of the disease (1,2). In some clinical situations, definitive diagnosis is only possible through postmortem neuropathology, and all in-life diagnoses are probable. The advent of in vivo imaging agents that reflect relevant pathophysiology, such as presynaptic nigrostriatal dopaminergic reduction, provides specialists and general practitioners a diagnostic tool that may increase diagnostic confidence and guide treatment. Conceivably, this critically depends on the reliability of individual image readers to accurately identify a normal versus abnormal scan findings.

Numerous clinical trials have been performed to assess the diagnostic accuracy of Ioflupane 123I Injection (DaTscan or DaTSCAN or 123I-ioflupane [GE Healthcare] or 123I-FP-CIT) in detecting the presence or absence of striatal dopaminergic deficit (SDD). These trials varied in their clinical design, providing several variables that can be assessed to determine their impact on diagnostic accuracy. We identified the 5 available phase 3/4 multicenter clinical trials. They assessed variables that are potentially relevant to individual-reader diagnostic performance, including on-site versus blinded-image-evaluation (BIE) readers; diagnostic cohort, for example, subjects with movement disorders (Parkinsonian syndrome [PS]) versus dementia (dementia with Lewy bodies [DLB]); early/uncertain versus late/confirmed diagnosis; duration of follow-up period after imaging to establish a final clinical diagnosis as a reference standard; and serial imaging over the course of disease progression. Between- and within-reader agreement, when available, were also evaluated to gain better insight regarding the efficacy of 123I-ioflupane imaging in disparate clinical scenarios, to establish best practices, based on evidence.

MATERIALS AND METHODS

The 5 available clinical studies (3 phase 3 and 2 phase 4) (1–8) were used for this pooled analysis (not a meta-analysis of peer-reviewed publications). All studies were prospective trials with similar designs and objectives—namely, to evaluate the sensitivity and specificity of 123I-ioflupane in detecting the presence or absence of an SDD. Expert clinical diagnosis by a consensus panel or on-site clinical evaluation was used as the reference standard in all studies; however, the timing of when the diagnosis was made relative to duration of illness varied. All of these studies complied with the current version of the Declaration of Helsinki, the International Conference on Harmonization Good Clinical Practice Consolidated Guideline, and applicable laws. Ethics committees or institutional review boards approved each study’s protocol and amendments. Subjects or their guardians signed written informed consent forms, which included a provision for subsequent analyses, of which this work is an example.

The 5 studies have been published (1–8), including the inclusion/exclusion criteria. Table 1 provides a summary of the details of the studies. In brief, subjects received 1 dose of 111–287 MBq of 123I-ioflupane, with a small number of subjects receiving up to 3 doses (at baseline, month 18, and month 36). Supplemental Tables 1, 2, and 3 (supplemental materials are available at http://jnm.snmjournals.org) provide details of radioactive dose per study and illustrate the consistent acquisition, reconstruction, and processing methods across the studies. SPECT images were acquired using a variety of devices, including both multi- and single-head γ cameras and multidetector single-slice systems. Each γ camera system was capable of SPECT acquisition and reconstruction to produce transverse slices, including a clear visualization of the striatum (i.e., the head of the caudate nucleus and putamen). Images were acquired within 3–6 h after radiotracer injection (1–8). Images were read on-site or by 3 or 5 BIE readers and classified as normal (SDD absent) or abnormal (SDD present) (9). Image readers had several years’ neuroimaging experience and had been trained in person by an expert nuclear medicine physician in the evaluation of 123I-ioflupane images; BIE readers were blinded to patient information with the exception of age, because striatal 123I-ioflupane binding decreases normally with aging (10–12). The content of in-person training was consistent across the 5 studies, with only small differences based on the evolving experience obtained from previous trials (13,14).

View this table:
  • View inline
  • View popup
TABLE 1

Details of 3 Phase-3 and 2 Phase-4 123I-Ioflupane SPECT Studies Included in This Analysis

The studies, although methodologically similar, differed from one another to allow assessment of how common variables encountered in clinical practice might affect the diagnostic performance of the readers. These include comparing blinded (study E (2,7)) with unblinded (study D (3,8)) on-site, institutional readers and comparing on-site with BIE readers (study A (4), study B (5,6), and study C (1)). Disease state, specifically movement disorders (study A (4), study C (1), study D (3,8), and study E (2,7)) versus dementia (study B (5,6)), was evaluated. We also assessed early/uncertain (study C (1), study D (3,8), and study E (2,7)) versus late/confirmed (study A (4)) clinical diagnosis of PS. The timing of when clinical diagnoses (reference standard) were made was evaluated, with all studies including an initial diagnosis at baseline, with others at month 12 (study B (5,6), study E (2,7)), month 18 (study C (1)), month 24 (study D (3,8)), or month 36 (study C (1)). Timing of 123I-ioflupane SPECT imaging was also evaluated, with imaging performed at baseline (all 5 studies), month 18 (study C (1)), and month 36 (study C (1)). Between-reader agreement (BIE vs. BIE and BIE vs. on-site) was evaluated in 3 of the studies (study A (4), study B (5,6), and study C (1)). Within-reader agreement was assessed in 1 of the studies (study B (5,6)).

Statistical Analysis Software (SAS Institute Inc.) was used to perform the statistical analyses of the studies. Descriptive statistics were used to present demographic data. Populations reported in this paper include intent to diagnose (ITD; all dosed subjects who underwent SPECT imaging and reference clinical diagnosis assessment) and per protocol (PP; all subjects in the ITD populations without a major protocol violation). Sensitivity (equivalent to positive percentage agreement) and specificity (equivalent to negative percentage agreement) were calculated and are reported with 95% confidence intervals (CIs). Individual logistic regression analysis was performed on the effects of duration of follow-up as a continuous variable and reader type (blinded versus on-site). Pairwise between-reader agreements were analyzed using Cohen κ statistic. The Fleiss κ statistic was used as the multiple-summary coefficient for all BIE readers.

RESULTS

Table 2 summarizes the demographic characteristics and clinical diagnoses of the subjects by study. Eight hundred eighteen subjects were included in the ITD efficacy analysis; sex and SDD present/absent were equally represented. The PP population comprised 714 subjects. Reasons for exclusion (subjects may have had more than one) included failure to meet inclusion/exclusion criteria (25), image obtained outside 3- to 6-h window (4), radioactivity dose exceeded 185 MBq (47), lost to follow-up (2), adverse event (1), technical image acquisition issues (11), no final diagnosis available(28), and protocol violation (3). No images were excluded from reading because of movement artifacts caused by inability to lie still during the scanning procedure.

View this table:
  • View inline
  • View popup
TABLE 2

Demographic Characteristics and Clinical Diagnosis (per Reference Standard) by Study

Diagnostic Accuracy in Dementia and Movement Disorders: On-Site Versus BIE Readers

Sensitivity and specificity were high in subjects with dementia (Fig. 1A) for both the ITD and the PP populations (Supplemental Table 4 provides 95% CIs). On-site reader sensitivity tended to be slightly higher than BIE reader sensitivity in these subjects, whereas specificity tended to be slightly lower (study B (5,6)). However, for subjects with movement disorders (Figs. 1C, 2A and 2B, and 3A and 3B), diagnostic performance for on-site versus BIE readers was similar (Supplemental Table 5 provides 95% CIs). Regression analysis indicated that reader type significantly affected sensitivity (P = 0.0063 for ITD and P = 0.0081 for PP) and specificity (P < 0.0001 for ITD and PP). For phase-4 studies with on-site readers only, sensitivity and specificity were high and similar to other phase-3 studies. One exception was specificity, being lower in study D (nonblinded on-site readers with regard to clinical patient information) (3,8) than in study E (blinded on-site readers with regard to clinical patient information) (2,7). Sensitivity and specificity were equally high and comparable in subjects with movement disorders or with dementia.

FIGURE 1.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 1.

(A) Sensitivity (blue) and specificity (gold) for individual BIE (solid bars) and on-site (open bars) readers comparing 123I-ioflupane SPECT images taken at baseline using clinical diagnosis made at baseline with those at month 12 as reference standard for both ITD and PP populations in subjects with dementia (study B (5,6)). (B) Change in sensitivity (blue) and specificity (gold) for individual BIE (solid bars) and on-site (open bars) readers for 123I-ioflupane SPECT images taken at baseline using clinical diagnosis made at baseline vs. at month 12 in subjects with dementia for ITD and PP populations (study B (5,6)). (C) Sensitivity (blue) and specificity (gold) for individual BIE (solid bars) and on-site (open bars) readers comparing 123I-ioflupane SPECT images taken at baseline using clinical diagnosis made at baseline for ITD and PP populations in subjects with movement disorders (study A (4)). M = month; N = number of subjects; OS = on-site.

FIGURE 2.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 2.

Sensitivity (blue) and specificity (gold) for individual BIE (solid bars) and on-site (open bars) readers comparing 123I-ioflupane SPECT images taken at baseline with those at month 18 using clinical diagnosis made individually by 2 clinical experts at month 18 as reference standard for ITD (A) and PP (B) populations in subjects with movement disorders (study C (1)). M = month; N = number of subjects.

FIGURE 3.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 3.

Sensitivity (blue) and specificity (gold) for individual BIE (solid bars) and on-site (open bars) readers comparing 123I-ioflupane SPECT images taken at baseline with those at month 18 versus at month 36 using clinical diagnosis made at month 36 as reference standard for ITD (A) and PP (B) populations in subjects with movement disorders (study C (1)). M = month; N = number of subjects; OS = on-site.

Timing of Clinical Follow-up

Considering the timing of clinical follow-up and the timing of the clinical diagnosis, there was a slight effect on the diagnostic performance of the reads. Figure 1A shows the sensitivity and specificity across BIE and on-site readers using a clinical diagnosis of DLB made at baseline versus at month 12, and Figure 1B depicts the changes in sensitivity and specificity. Slight improvements in specificity were observed. Figure 2 shows the sensitivity and specificity using the clinical diagnosis of PS made individually by 2 clinical experts at month 18 as the reference standard, whereas Figure 3 depicts results using the month-36 consensus clinical diagnosis. Changes in sensitivity and specificity are displayed in Figure 4. Although the differences are small, reader performance overall improved when the clinical diagnosis was made later in the disease process. Regression analysis indicated that duration of follow-up significantly affected sensitivity (P < 0.0001 for ITD and PP) and specificity in the ITD population (P = 0.0491 for ITD and 0.0546 for PP).

FIGURE 4.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 4.

Change in sensitivity (blue) and specificity (gold) for individual BIE (solid bars) and on-site (open bars) readers for 123I-ioflupane SPECT images taken at baseline using clinical diagnosis made by individual clinical experts at month 18 versus consensus panel at month 36 in subjects with movement disorders for ITD (A) and PP (B) populations (study C (1)). Improvement observed is most likely due to greater accuracy of clinical diagnosis reference standard and not due to changes in interpretation of images.

Effect of Serial Imaging over Course of Disease on Diagnostic Performance

In 1 of the studies (study C (1)), subjects with movement disorders underwent up to three 123I-ioflupane imaging sessions—that is, at baseline, month 18, and month 36. Figure 3 compares BIE and on-site reader diagnostic performance for each of these imaging sessions using the month 36 clinical diagnosis as the reference standard. Changes in sensitivity and specificity are displayed in Figure 5, showing consistent and stable sensitivity and specificity during the 3-y observation period, independent from the time point of the acquisition of the scans.

FIGURE 5.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 5.

Change in sensitivity (blue) and specificity (gold) for individual BIE (solid bars) and on-site (open bars) readers for 123I-ioflupane SPECT images taken at baseline versus month 18, baseline versus month 36, and month 18 versus month 36 using clinical diagnosis made at month 36 in subjects with movement disorders for ITD (A) and PP (B) populations (study C (1)). BL = baseline; M = month; N = number of subjects; OS = on-site.

Between-Reader Agreement

Figures 6 and 7 depict the between-reader agreement for 3 studies for the ITD and PP populations, respectively, using the Altman method for assessing the strength of agreement (95% CIs available in Supplemental Tables 6 and 7) (15). The κ for most comparisons were consistently very good (almost perfect using Landis and Koch categorizations) (16) whether comparing between BIE readers or BIE versus on-site readers. Agreement dropped slightly, demonstrating moderate, good, and very good correlation between BIE and on-site readers for reading images from subjects with dementia (Figs. 6C and 7C).

FIGURE 6.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 6.

Between-reader agreement for 3 studies. κ coefficient (95% CIs)—ITD populations. (A) Strength of agreement for κ. (B) Study A (4)—123I-ioflupane images taken at baseline in subjects with movement disorders (n = 220). (C) Study B (5,6)—123I-ioflupane images taken at baseline in subjects with dementia (n = 272–292). (D) Study C (1)—123I-ioflupane images taken at baseline (n = 98–102), month 18 (n = 100–103), and month 36 (n = 92–97) in subjects with movement disorders. N = number of subjects.

FIGURE 7.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 7.

Between-reader agreement for 3 studies. κ coefficient (95% CIs)—PP populations. (A) Study A (4)—123I-ioflupane images taken at baseline in subjects with movement disorders (n = 157) . (B) Study B (5,6)—123I-ioflupane images taken at baseline in subjects with dementia (n = 249–272). (C) Study C (1)—123I-ioflupane images taken at baseline (n = 96–100), month 18 (n = 98–100), and month 36 (n = 90–95) in subjects with movement disorders. N = number of subjects.

Within-Reader Agreement

In 1 of the studies (study B (5,6)), within-reader agreement was measured. Each of the 3 BIE readers had complete (i.e., 100%) agreement for the 24–26 images read (Supplemental Table 8).

DISCUSSION

This analysis of 5 prospective studies provides a large dataset (n = 818) and multiple clinical scenarios in which to evaluate individual 123I-ioflupane SPECT image reader performance. Both on-site readers and BIE readers demonstrated consistently high diagnostic performance. Reader type significantly affected sensitivity and specificity, but the differences did not compromise the diagnostic value of 123I-ioflupane SPECT imaging for either reader types. A slightly higher sensitivity and slightly lower specificity, observed in on-site reading of images from subjects with dementia (study B (5,6)), may be attributed to challenges in maintaining comprehensive blinding. Access to clinical information may have contributed to some loss of objectivity. This trend for lower specificity was also observed in the phase-4 study D (3,8), in which the on-site readers were not blinded. In both study B (5,6) and study D (3,8), the subjects studied had uncertain diagnoses (DLB and clinically uncertain PS, respectively). Conceivably, access to clinical information in these cases of questionable diagnoses may have contributed to reductions in accuracy of the readings. Walker et al. reported that the tendency to overdiagnose DLB contributed to the lack of agreement between the clinical diagnosis and 123I-ioflupane image results (17). Marshall et al. reported a similar tendency in PS (1). We observed that if the clinical diagnosis of DLB was made 12 mo later, with subsequent greater confidence in the diagnosis, slight improvements in specificity were observed. More dramatic increases in sensitivity and specificity were observed when a clinical diagnosis of PS was made at month 36 versus month 18, which again can likely be attributed to greater accuracy when the clinical diagnosis is made later in the disease process. This observed improvement over time was statistically significant by regression analysis. Nonetheless, overall sensitivity and specificity were high in subjects with both movement disorders and dementia.

When patients with movement disorders were serially scanned 3 times over the course of 3 y and the month-36 clinical diagnosis was used as the reference standard, the sensitivity and specificity of the 123I-ioflupane SPECT imaging results were consistently high. These results suggest that significant changes are noted on scans, even early in the course of illness, providing high diagnostic accuracy early in the disease process, and accuracy persists as disease progression occurs.

Between-reader agreement was very good (15) (almost perfect) (16), with κ exceeding 0.8 in most comparisons. Agreement dropped to a combination of very good, good, and moderate when comparing BIE readers with on-site readers of images from subjects with DLB, which may be attributable to compromised blinding of the on-site readers or to differences between different disease entities (DLB vs. PS). Overall, the very good between-reader agreement may reflect adequate experience and training of the readers. This interpretation complies with the complete within-reader agreement observed for the 3 readers in the DLB study.

The present analysis has some limitations. Several of the studies summarized in this analysis were performed more than 10 y ago, when there was limited experience with 123I-ioflupane SPECT imaging. Training methods available today (13,14) had not yet been developed or validated, and nuclear medicine physicians had not yet acquired extensive experience in reading the images (18). However, the strong between-reader agreement observed supports previous conclusions (1) that, on the basis of correct imaging procedures and processing, the visual interpretation of the image is independent of the expert conducting the analysis. Another limitation was that scans were only scored visually; the value of quantitative analysis is evolving and will be incorporated into future studies. Clinical diagnosis was used as the reference standard rather than autopsy. This approach was taken because it is not feasible to wait for neuropathologic confirmation in the clinical research setting with patients in the early stages of disease. Furthermore, expert clinical diagnosis is considered an acceptable reference standard for biomarker validation studies (19). Last, the use of clinical diagnosis as the reference standard may have contributed to minor reductions in specificity, most likely due to potential uncertainties in the clinical diagnosis and possible contribution of subjects who have scans without evidence of dopaminergic deficit. Studies have shown that 11%–21% of patients with an initial diagnosis of Parkinson disease eventually have their diagnoses changed to essential or dystonic tremor (1,20,21). Autopsy confirmation studies have shown 123I-ioflupane SPECT imaging to be very accurate (17,22). The minor reductions observed in specificity in this pooled analysis can be more likely attributed to the uncertainties associated with the clinical diagnoses and less likely to inaccuracies in the diagnostic performance of 123I-ioflupane SPECT imaging. This notion is supported by the improved diagnostic performance of 123I-ioflupane SPECT imaging at longer clinical follow-ups, because initially subtle clinical symptoms may progress to a more characteristic clinical picture (8,23).

CONCLUSION

This combined analysis demonstrates that individual-reader sensitivity and specificity were high for patients with movement disorders and dementia. Slightly lower sensitivities were observed in patients with dementia, most probably due to greater complexity of pathology and less precise clinical diagnosis, the reference standard. These differences were small and do not compromise the value of 123I-ioflupane SPECT imaging. Diagnostic performance was accurate early in the disease process and remained consistently accurate with progression of disease. The sensitivity and specificity were high and relatively stable over the 3-y period of clinical follow-up in PS, regardless of when the scan was taken. Between-reader agreement, for both blinded readers and on-site image readers, was very good (almost perfect) in all populations studied. Within-reader agreement, measured in 1 of the studies, showed complete agreement. This analysis illustrates the utility and robust diagnostic performance of individual readers of 123I-ioflupane SPECT images across a broad variety of clinical scenarios.

DISCLOSURE

The costs of publication of this article were defrayed in part by the payment of page charges. Therefore, and solely to indicate this fact, this article is hereby marked “advertisement” in accordance with 18 USC section 1734. Financial support to develop this work was provided by GE Healthcare.

Dr. Seibyl is a consultant of GE Healthcare, Piramal, and Navidea and reports personal fees from Molecular Neuroimaging, outside the submitted work. Dr. Kupsch has nothing to disclose. Dr. Booij reports that he is a consultant of GE Healthcare. Dr. Grosset reports grants and personal fees from Merz Pharma and personal fees from Astellas, Civitas, InVentiv Health, AbbVie, GE Healthcare, Teva, and UCB Pharma, outside the submitted work. Dr. Costa has nothing to disclose. Dr. Hauser reports grants from GE Healthcare, personal fees from GE Healthcare, during the conduct of the study; personal fees from Zanbon Company S.p.A, Teva Pharmaceuticals, INC, UCB BIOSCIENCES GmbH, Amdamte Steering Committee, AbbVie, Eli Lilly, Cleveland Company, PPMI, Novartis, Biotie, Lundbeck, PharmStrat LLC, GE Healthcare, Allergan, University of Houston, DSMB, Ipsen, Consensus Medical Communications, Pfizer, Azilect Strategic Advisory, Neurocrine Meeting, and Gerson Lehrman; and grants from LS-1, outside the submitted work. Dr. Darcourt has nothing to disclose. Dr. Bajaj reports grants and personal fees from GE Healthcare, outside the submitted work. Dr. Walker reports personal fees from GE Healthcare and Bayer Healthcare, grants from GE Healthcare, grants from Lundbeck, other from GE Healthcare, and personal fees from Novartis, outside the submitted work. Dr. Marek reports personal fees from GE Healthcare and personal fees from Molecular NeuroImaging, outside the submitted work. Dr. McKeith reports grants and personal fees from GE Healthcare, during the conduct of the study; grants and personal fees from GE Healthcare, outside the submitted work. Dr. O'Brien reports grants and other from GE Healthcare, grants and other from Lilly, other from Bayer Healthcare, other from TauRx, other from Cytox, outside the submitted work. Dr. Tatsch reports personal fees from GE HealthCare, during the conduct of the study, and personal fees from GE Healthcare, outside the submitted work. Dr. Tolosa reports personal fees from Novartis, TEVA, Boehringer Ingelheim, UCB, Solvay, Lundbeck, and TEVA; grants from Spaniard Network for research on neurodegenerative Disorders (CIBERNED)—instituto Carlos III (ISCIII), grants from The Michael J. Fox Foundation for Parkinson’s Research (MJFF), and grants from Fondo de Investigaciones Sanitarias de la Seguridad Social (FISS), outside the submitted work. Dr. Dierckx has nothing to disclose. Dr. Grachev reports employment at GE Healthcare, during the conduct of the study. No other potential conflict of interest relevant to this article was reported.

Acknowledgments

We acknowledge the writing assistance provided by Stacy Simpson Logan, CMPP, of Winfield Consulting, funded by GE Healthcare.

Footnotes

  • ↵* Contributed equally to this work.

  • Published online Jun. 12, 2014.

  • © 2014 by the Society of Nuclear Medicine and Molecular Imaging, Inc.

REFERENCES

  1. 1.↵
    1. Marshall VL,
    2. Reininger CB,
    3. Marquardt M,
    4. et al
    . Parkinson's disease is overdiagnosed clinically at baseline in diagnostically uncertain cases: a 3-year European multicenter study with repeat [123I]FP-CIT SPECT. Mov Disord. 2009;24:500–508.
    OpenUrlCrossRefPubMed
  2. 2.↵
    1. Kupsch AR,
    2. Bajaj N,
    3. Weiland F,
    4. et al
    . Impact of DaTscan SPECT imaging on clinical management, diagnosis, confidence of diagnosis, quality of life, health resource use and safety in patients with clinically uncertain parkinsonian syndromes: a prospective 1-year follow-up of an open-label controlled study. J Neurol Neurosurg Psychiatry. 2012;83:620–628.
    OpenUrlAbstract/FREE Full Text
  3. 3.↵
    1. Catafau AM,
    2. Tolosa E
    . Impact of dopamine transporter SPECT using 123I-ioflupane on diagnosis and management of patients with clinically uncertain Parkinsonian syndromes. Mov Disord. 2004;19:1175–1182.
    OpenUrlCrossRefPubMed
  4. 4.↵
    1. Benamer TS,
    2. Patterson J,
    3. Grosset DG,
    4. et al
    . Accurate differentiation of parkinsonism and essential tremor using visual assessment of [123I]-FP-CIT SPECT imaging: the [123I]-FP-CIT study group. Mov Disord. 2000;15:503–510.
    OpenUrlCrossRefPubMed
  5. 5.↵
    1. McKeith I,
    2. O'Brien J,
    3. Walker Z,
    4. et al
    . Sensitivity and specificity of dopamine transporter imaging with 123I-FP-CIT SPECT in dementia with Lewy bodies: a phase III, multicentre study. Lancet Neurol. 2007;6:305–313.
    OpenUrlCrossRefPubMed
  6. 6.↵
    1. O'Brien JT,
    2. McKeith IG,
    3. Walker Z,
    4. et al
    . Diagnostic accuracy of 123I-FP-CIT SPECT in possible dementia with Lewy bodies. Br J Psychiatry. 2009;194:34–39.
    OpenUrlAbstract/FREE Full Text
  7. 7.↵
    1. Seibyl J,
    2. Grosset DG,
    3. Bajaj N,
    4. Hauser RA,
    5. Marek K,
    6. Grachev ID
    . Accuracy of DaTscan™ [Ioflupane I 123 Injection] in diagnosis of early parkinsonian syndromes (PS) [abstract]. J Nucl Med. 2013;54(suppl 2):58.
    OpenUrl
  8. 8.↵
    1. Tolosa E,
    2. Borght TV,
    3. Moreno E
    . Accuracy of DaTSCAN (123I-ioflupane) SPECT in diagnosis of patients with clinically uncertain parkinsonism: 2-year follow-up of an open-label study. Mov Disord. 2007;22:2346–2351.
    OpenUrlCrossRefPubMed
  9. 9.↵
    Full Prescribing Information for DaTscan (US). GE Healthcare. http://www3.gehealthcare.com/en/Products/Categories/Nuclear_Imaging_Agents/∼/media/Downloads/us/Product/Product-Categories/Nuclear-Imaging-Agents_Non-Gatekeeper/DaTscan/GEHealthcare_DaTscan-Prescribing-Information.pdf. April 2013. Accessed May 18, 2014.
  10. 10.↵
    1. Varrone A,
    2. Dickson JC,
    3. Tossici-Bolt L,
    4. et al
    . European multicentre database of healthy controls for [123I]FP-CIT SPECT (ENC-DAT): age-related effects, gender differences and evaluation of different methods of analysis. Eur J Nucl Med Mol Imaging. 2013;40:213–227.
    OpenUrlCrossRefPubMed
  11. 11.
    1. Lavalaye J,
    2. Booij J,
    3. Reneman L,
    4. Habraken JB,
    5. van Royen EA
    . Effect of age and gender on dopamine transporter imaging with [123I]FP-CIT SPET in healthy volunteers. Eur J Nucl Med. 2000;27:867–869.
    OpenUrlCrossRefPubMed
  12. 12.↵
    1. Eusebio A,
    2. Azulay JP,
    3. Ceccaldi M,
    4. Girard N,
    5. Mundler O,
    6. Guedj E
    . Voxel-based analysis of whole-brain effects of age and gender on dopamine transporter SPECT imaging in healthy subjects. Eur J Nucl Med Mol Imaging. 2012;39:1778–1783.
    OpenUrlCrossRefPubMed
  13. 13.↵
    Information for Nuclear Imagers. US.datscan.com. http://us.datscan.com/imagers. January 2013. Accessed May 18, 2014.
  14. 14.↵
    1. Simuni T
    . Advances in mulitdisciplinary imaging. Is it essential tremor or a Parkinsonian Syndrome? Medscape.com. http://www.medscape.org/sites/advances/multidisciplinary-imaging. June 2013. Accessed June 2, 2014.
  15. 15.↵
    1. Altman DG
    . Practical Statistics for Medical Research. London, U.K.: Chapman and Hall; 1991.
  16. 16.↵
    1. Landis JR,
    2. Koch GG
    . The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–174.
    OpenUrlCrossRefPubMed
  17. 17.↵
    1. Walker Z,
    2. Jaros E,
    3. Walker RW,
    4. et al
    . Dementia with Lewy bodies: a comparison of clinical diagnosis, FP-CIT single photon emission computed tomography imaging and autopsy. J Neurol Neurosurg Psychiatry. 2007;78:1176–1181.
    OpenUrlAbstract/FREE Full Text
  18. 18.↵
    1. Söderlund TA,
    2. Dickson JC,
    3. Prvulovich E,
    4. et al
    . Value of semiquantitative analysis for clinical reporting of 123I-2-beta-carbomethoxy-3beta-(4-iodophenyl)-N-(3-fluoropropyl)nortropane SPECT studies. J Nucl Med. 2013;54:714–722.
    OpenUrlAbstract/FREE Full Text
  19. 19.↵
    1. Gorovets A,
    2. Marzella L,
    3. Rieves D,
    4. Yang L
    . Efficacy considerations for U.S. Food and Drug Administration approval of diagnostic radiopharmaceuticals. J Nucl Med. 2013;54:1479–1484.
    OpenUrlAbstract/FREE Full Text
  20. 20.↵
    1. Whone AL,
    2. Watts RL,
    3. Stoessl AJ,
    4. et al
    . Slower progression of Parkinson's disease with ropinirole versus levodopa: the REAL-PET study. Ann Neurol. 2003;54:93–101.
    OpenUrlCrossRefPubMed
  21. 21.↵
    1. Schneider SA,
    2. Edwards MJ,
    3. Mir P,
    4. et al
    . Patients with adult-onset dystonic tremor resembling parkinsonian tremor have scans without evidence of dopaminergic deficit (SWEDDs). Mov Disord. 2007;22:2210–2215.
    OpenUrlCrossRefPubMed
  22. 22.↵
    1. Colloby SJ,
    2. McParland S,
    3. O'Brien JT,
    4. Attems J
    . Neuropathological correlates of dopaminergic imaging in Alzheimer's disease and Lewy body dementias. Brain. 2012;135:2798–2808.
    OpenUrlAbstract/FREE Full Text
  23. 23.↵
    1. Jennings DL,
    2. Seibyl JP,
    3. Oakes D,
    4. Eberly S,
    5. Murphy J,
    6. Marek K
    . (123I)beta-CIT and single-photon emission computed tomographic imaging vs clinical evaluation in Parkinsonian syndrome: unmasking an early diagnosis. Arch Neurol. 2004;61:1224–1229.
    OpenUrlCrossRefPubMed
  • Received for publication March 22, 2014.
  • Accepted for publication April 28, 2014.
PreviousNext
Back to top

In this issue

Journal of Nuclear Medicine: 55 (8)
Journal of Nuclear Medicine
Vol. 55, Issue 8
August 1, 2014
  • Table of Contents
  • Table of Contents (PDF)
  • About the Cover
  • Index by author
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on Journal of Nuclear Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Individual-Reader Diagnostic Performance and Between-Reader Agreement in Assessment of Subjects with Parkinsonian Syndrome or Dementia Using 123I-Ioflupane Injection (DaTscan) Imaging
(Your Name) has sent you a message from Journal of Nuclear Medicine
(Your Name) thought you would like to see the Journal of Nuclear Medicine web site.
Citation Tools
Individual-Reader Diagnostic Performance and Between-Reader Agreement in Assessment of Subjects with Parkinsonian Syndrome or Dementia Using 123I-Ioflupane Injection (DaTscan) Imaging
John P. Seibyl, Andreas Kupsch, Jan Booij, Donald G. Grosset, Durval C. Costa, Robert A. Hauser, Jacques Darcourt, Nin Bajaj, Zuzana Walker, Kenneth Marek, Ian McKeith, John T. O’Brien, Klaus Tatsch, Eduardo Tolosa, Rudi A. Dierckx, Igor D. Grachev
Journal of Nuclear Medicine Aug 2014, 55 (8) 1288-1296; DOI: 10.2967/jnumed.114.140228

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Individual-Reader Diagnostic Performance and Between-Reader Agreement in Assessment of Subjects with Parkinsonian Syndrome or Dementia Using 123I-Ioflupane Injection (DaTscan) Imaging
John P. Seibyl, Andreas Kupsch, Jan Booij, Donald G. Grosset, Durval C. Costa, Robert A. Hauser, Jacques Darcourt, Nin Bajaj, Zuzana Walker, Kenneth Marek, Ian McKeith, John T. O’Brien, Klaus Tatsch, Eduardo Tolosa, Rudi A. Dierckx, Igor D. Grachev
Journal of Nuclear Medicine Aug 2014, 55 (8) 1288-1296; DOI: 10.2967/jnumed.114.140228
Twitter logo Facebook logo LinkedIn logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One
Bookmark this article

Jump to section

  • Article
    • Abstract
    • MATERIALS AND METHODS
    • RESULTS
    • DISCUSSION
    • CONCLUSION
    • DISCLOSURE
    • Acknowledgments
    • Footnotes
    • REFERENCES
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • PDF

Related Articles

  • This Month in JNM
  • PubMed
  • Google Scholar

Cited By...

  • Determining the Degree of Dopaminergic Denervation Based on the Loss of Nigral Hyperintensity on SMWI in Parkinsonism
  • The Future of Nuclear Medicine as an Independent Specialty
  • Diagnostic Performance of the Visual Reading of 123I-Ioflupane SPECT Images With or Without Quantification in Patients With Movement Disorders or Dementia
  • Google Scholar

More in this TOC Section

  • Feasibility of Ultra-Low-Activity 18F-FDG PET/CT Imaging Using a Long–Axial-Field-of-View PET/CT System
  • Cardiac Presynaptic Sympathetic Nervous Function Evaluated by Cardiac PET in Patients with Chronotropic Incompetence Without Heart Failure
  • Validation and Evaluation of a Vendor-Provided Head Motion Correction Algorithm on the uMI Panorama PET/CT System
Show more Clinical Investigations

Similar Articles

Keywords

  • Sensitivity
  • Specificity
  • diagnostic performance
  • Ioflupane 123I Injection
  • DaTscan
SNMMI

© 2025 SNMMI

Powered by HighWire