Skip to main content

Main menu

  • Home
  • Content
    • Current
    • Ahead of print
    • Past Issues
    • JNM Supplement
    • SNMMI Annual Meeting Abstracts
    • Continuing Education
    • JNM Podcasts
  • Subscriptions
    • Subscribers
    • Institutional and Non-member
    • Rates
    • Journal Claims
    • Corporate & Special Sales
  • Authors
    • Submit to JNM
    • Information for Authors
    • Assignment of Copyright
    • AQARA requirements
  • Info
    • Reviewers
    • Permissions
    • Advertisers
  • About
    • About Us
    • Editorial Board
    • Contact Information
  • More
    • Alerts
    • Feedback
    • Help
    • SNMMI Journals
  • SNMMI
    • JNM
    • JNMT
    • SNMMI Journals
    • SNMMI

User menu

  • Subscribe
  • My alerts
  • Log in
  • My Cart

Search

  • Advanced search
Journal of Nuclear Medicine
  • SNMMI
    • JNM
    • JNMT
    • SNMMI Journals
    • SNMMI
  • Subscribe
  • My alerts
  • Log in
  • My Cart
Journal of Nuclear Medicine

Advanced Search

  • Home
  • Content
    • Current
    • Ahead of print
    • Past Issues
    • JNM Supplement
    • SNMMI Annual Meeting Abstracts
    • Continuing Education
    • JNM Podcasts
  • Subscriptions
    • Subscribers
    • Institutional and Non-member
    • Rates
    • Journal Claims
    • Corporate & Special Sales
  • Authors
    • Submit to JNM
    • Information for Authors
    • Assignment of Copyright
    • AQARA requirements
  • Info
    • Reviewers
    • Permissions
    • Advertisers
  • About
    • About Us
    • Editorial Board
    • Contact Information
  • More
    • Alerts
    • Feedback
    • Help
    • SNMMI Journals
  • View or Listen to JNM Podcast
  • Visit JNM on Facebook
  • Join JNM on LinkedIn
  • Follow JNM on Twitter
  • Subscribe to our RSS feeds
Research ArticleClinical Investigation
Open Access

Quality Assurance Considerations in Radiopharmaceutical Therapy Dosimetry Using PLANETDose: An International Atomic Energy Agency Study

Gunjan Kayal, Nathaly Barbosa, Carlos Calderón Marín, Ludovic Ferrer, José-Alejandro Fragoso-Negrín, Darko Grosev, Santosh Kumar Gupta, Nur Rahmah Hidayati, Tumelo C.G. Moalosi, Gian Luca Poli, Parul Thakral, Virginia Tsapaki, Sébastien Vauclin, Alex Vergara-Gil, Peter Knoll, Robert F. Hobbs and Manuel Bardiès
Journal of Nuclear Medicine January 2024, 65 (1) 125-131; DOI: https://doi.org/10.2967/jnumed.122.265340
Gunjan Kayal
1CRCT, UMR 1037, INSERM, Université Toulouse III Paul Sabatier, Toulouse, France;
2SCK CEN, Belgian Nuclear Research Centre, Mol, Belgium;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nathaly Barbosa
3Instituto Nacional de Cancerología, Bogotá, Colombia;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Carlos Calderón Marín
4Instituto de Oncología y Radiobiología, Havana, Cuba;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ludovic Ferrer
5Medical Physics Department, ICO René Gauducheau, Nantes, France;
6CRCINA, UMR 1232, INSERM, France;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
José-Alejandro Fragoso-Negrín
7DOSIsoft SA, Cachan, France;
8IRCM, UMR 1194 INSERM, Universite de Montpellier and Institut Regional du Cancer de Montpellier, Montpellier, France;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Darko Grosev
9Department of Nuclear Medicine and Radiation Protection, University Hospital Centre Zagreb, Zagreb, Croatia;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Santosh Kumar Gupta
10Department of Nuclear Medicine and PET, Mahamana Pandit Madanmohan Malviya Cancer Centre and Homi Bhabha Cancer Centre, Varanasi, India;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nur Rahmah Hidayati
11Research Center and Technology for Radiation Safety and Metrology–National Research and Innovation Agency, Jakarta, Indonesia;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tumelo C.G. Moalosi
12Department of Medical Imaging and Clinical Oncology, Medical Physics, Nuclear Medicine Division, Faculty of Medicine and Health Science, Stellenbosch University, Tygerberg Hospital, Cape Town, South Africa;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Gian Luca Poli
13Department of Medical Physics, ASST Papa Giovanni XXIII, Bergamo, Italy;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Parul Thakral
14Department of Nuclear Medicine, Fortis Memorial Research Institute, Gurugram, India;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Virginia Tsapaki
15Dosimetry and Medical Radiation Physics, International Atomic Energy Agency, Vienna, Austria;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sébastien Vauclin
7DOSIsoft SA, Cachan, France;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Alex Vergara-Gil
1CRCT, UMR 1037, INSERM, Université Toulouse III Paul Sabatier, Toulouse, France;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Peter Knoll
15Dosimetry and Medical Radiation Physics, International Atomic Energy Agency, Vienna, Austria;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Robert F. Hobbs
16Johns Hopkins Medical Institute, Baltimore, Maryland; and
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Manuel Bardiès
8IRCM, UMR 1194 INSERM, Universite de Montpellier and Institut Regional du Cancer de Montpellier, Montpellier, France;
17Département de Médecine Nucléaire, Institut Régional du Cancer de Montpellier, Montpellier, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • PDF
Loading

Visual Abstract

Figure
  • Download figure
  • Open in new tab
  • Download powerpoint

Abstract

Implementation of radiopharmaceutical therapy dosimetry varies depending on the clinical application, dosimetry protocol, software, and ultimately the operator. Assessing clinical dosimetry accuracy and precision is therefore a challenging task. This work emphasizes some pitfalls encountered during a structured analysis, performed on a single-patient dataset consisting of SPECT/CT images by various participants using a standard protocol and clinically approved commercial software. Methods: The clinical dataset consisted of the dosimetric study of a patient administered with [177Lu]Lu-DOTATATE at Tygerberg Hospital, South Africa, as a part of International Atomic Energy Agency–coordinated research project E23005. SPECT/CT images were acquired at 5 time points postinjection. Patient and calibration images were reconstructed on a workstation, and a calibration factor of 122.6 Bq/count was derived independently and provided to the participants. A standard dosimetric protocol was defined, and PLANETDose (version 3.1.1) software was installed at 9 centers to perform the dosimetry of 3 treatment cycles. The protocol included rigid image registration, segmentation (semimanual for organs, activity threshold for tumors), and dose voxel kernel convolution of activity followed by absorbed dose (AD) rate integration to obtain the ADs. Iterations of the protocol were performed by participants individually and within collective training, the results of which were analyzed for dosimetric variability, as well as for quality assurance and error analysis. Intermediary checkpoints were developed to understand possible sources of variation and to differentiate user error from legitimate user variability. Results: Initial dosimetric results for organs (liver and kidneys) and lesions showed considerable interoperator variability. Not only was the generation of intermediate checkpoints such as total counts, volumes, and activity required, but also activity-to-count ratio, activity concentration, and AD rate-to-activity concentration ratio to determine the source of variability. Conclusion: When the same patient dataset was analyzed using the same dosimetry procedure and software, significant disparities were observed in the results despite multiple sessions of training and feedback. Variations due to human error could be minimized or avoided by performing intensive training sessions, establishing intermediate checkpoints, conducting sanity checks, and cross-validating results across physicists or with standardized datasets. This finding promotes the development of quality assurance in clinical dosimetry.

  • clinical dosimetry
  • SPECT/CT
  • quality assurance
  • PLANETDose
  • variability assessment

Radiopharmaceutical therapy (RPT) is based on the administration of radiolabeled vectors designed to concentrate cytotoxic levels of radiation in targets while preserving the surrounding healthy tissues. In comparison to external-beam radiation therapy, which involves personalized treatment regimens, most RPT administers a fixed activity. For example, the European Medicines Agency and the Food and Drug Administration approved [177Lu]Lu-DOTATATE (Lutathera; Novartis) for treatment of neuroendocrine tumors as four 7.4-GBq injections separated by 8-wk intervals (1,2).

A patient-specific treatment approach would allow a major paradigm shift from the one-size-fits-all approach to personalized medicine in which the optimal activity is specifically assessed for each patient. In article 56 (Optimization) (3), Euratom Directive 2013/59 (applicable within the European Union) requests that “For all medical exposure of patients for radiotherapeutic purposes, exposures of target volumes shall be individually planned, and their delivery appropriately verified taking into account that doses to non-target volumes and tissues shall be as low as reasonably achievable and consistent with the intended radiotherapeutic purpose of the exposure.” Even though personalized planning cannot be achieved with fixed activities, the verification of irradiation delivered can always be assessed. Also, several authors (4–7) have advocated the feasibility of patient-specific RPT dosimetry. Evidence of the absorbed dose (AD)–effect relationship has been published in several clinical indications (8–11).

The clinical dosimetry workflow consists of several steps, from radiopharmaceutical pharmacokinetics determination in the volumes of interest (VOIs), most often through sequential quantitative imaging, to AD or other standardized dosimetry quantity computation, such as biologic effective dose or equieffective dose (12). Currently, RPT dosimetry either is not widely implemented in clinical facilities (13–15) or, if implemented, may differ in objectives and sophistication among centers, thereby resulting in a large variability of dosimetric approaches and results (16).

However, there are 2 facets of variability. Clinical choices that govern dosimetric approaches induce natural variability and should not preclude the use of personalized dosimetry. More concerning is the potential variability of results for a given clinical application, due to different methodologies or even to general lack of expertise. It is therefore desirable to be able to compare results obtained in different clinical centers for a given therapeutic approach.

The Society of Nuclear Medicine and Molecular Imaging presented the preliminary results of a study aiming to standardize and harmonize dosimetry procedures by assessing the variability introduced in various dosimetry steps. The study revealed large differences in time-integrated activity (TIA) and in ADs. The participants in this study chose their own methodologies for VOI delineation, TIA integration, TIA dosimetry, and reported volumes, TIA, AD rates (ADRs), and AD; however, neither the sources of variation nor the origins of the outliers were obvious (17). Subsequent detailed analysis (18) demonstrated that there were transcription, methodologic, and reporting errors and differences in methods and decisions that contributed substantially to the large variations. In this analysis (18) for pure SPECT data, removing variabilities due to errors resulted in quartile coefficients of dispersion of 10%–30% in the organs and 10%–40% in the lesions for the 2 patients used in the study. Variabilities were further reduced when participants were given VOIs or TIAs.

In 2017, the International Atomic Energy Agency initiated coordinated research project (CRP) E2.30.05, “Dosimetry in Radiopharmaceutical Therapy for Personalized Patient Treatment,” to educate and train volunteer medical physicists and implement harmonized dosimetric procedures, along with assessing the global accuracy of RPT dosimetry. This was done by conducting multiple training sessions and iterations using a clinical SPECT/CT patient dataset.

Consequently, the ground truth activity and ADs of the dataset are not known and the study cannot assess for accuracy. The goal of this work is to assess variability or precision of results and to identify and eliminate methodologic errors that increase variability as part of an overall educational goal.

MATERIALS AND METHODS

Participants

The participating institutions were from Colombia, Croatia, Cuba, France, India, Indonesia, South Africa, and the United States. Each performed dosimetry with its respective expertise and the specific training acquired throughout this work. The selection of institutions was based on International Atomic Energy Agency reviews of proposals to join the CRP, except for the United States and France, whose participation was based on their substantial experience in this field.

Clinical Dataset

The clinical dataset was derived from the dosimetric study of a [177Lu]Lu-DOTATATE patient from Tygerberg Hospital, South Africa. Activities of 6.24, 6.67, 6.85, and 6.03 GBq were administered in a first, second, third, and fourth therapy cycle, respectively, with an interval of 11 wk between cycles. Patient SPECT/CT images were acquired at 5 time points after injection (1–2, 4, 24, 48, and 96 h) on a GE Healthcare Infinia Hawkeye 4 (9.5-mm [3/8-in] NaI crystal thickness and medium-energy collimator) with calibration images and reconstructed on a Hermes Medical Solutions (version 4.15) workstation. A calibration phantom was imaged using the same acquisition and reconstruction settings. All parameters were specified by Kayal et al. (19). A calibration factor of 122.6 Bq/count (or 4.53 cps/MBq with 1,800 s of acquisition time) was obtained and provided to each center.

Definition of Standard Protocol

A standard dosimetric protocol was defined, and PLANETDose (version 3.1.1) from DOSIsoft SA was used for the first 3 therapy cycles. The fourth cycle was not examined because there was no adequate SPECT/CT imaging. Since reconstructed patient images were circulated to each center, the common dosimetry protocol was defined beginning at the registration step. All steps of the protocol were followed by all participants independently on their workstations.

Registration and Segmentation

Automatic rigid registration for all time points was performed by each site considering the first CT scan as the reference. The segmented VOIs included lesions (anterior, lateral, posterior, and inferior) along with both kidneys and whole and healthy liver. Each participating center contoured the normal organs (kidneys and liver) semimanually on the first CT scan with an interpolation process and then propagated in a rigid way through all registered CT scans while performing lesion segmentation on SPECT images at each time point using a 40% threshold of the maximal uptake. Afterward, a 4-dimensional exclusion Boolean operation between the anatomic liver (or whole liver) and the 4 lesions gave the contour of normal liver.

ADR and AD

ADRs were obtained for each VOI and cycle using the dose voxel kernel convolution algorithm with density correction within PLANETDose. ADs were obtained by integrating ADR over time. Each participant selected a fit among mono-, bi-, or triexponential fitting or trapezoidal fitting, on the basis of the participant’s expertise. The fit functions and parameters used by each participant can be provided on request.

Data Exportation

For each VOI, the volume, total counts, and activity per time point were exported. The values for normal organs and lesions were taken from the anatomic and functional contouring result tables, respectively (PLANETDose uses a dual anatomic/functional mode system). The fitting parameters (fitting equation and R2) along with the ADs in each VOI were generated and stored.

Statistics

To quantify the variations among participants, the mean and median along with the associated uncertainties were computed using previously published equations (20). The t-test was performed to examine the significance of the difference between the fitting techniques used among participants (P ≤ 0.05) (21,22).

Optimization Procedure

The CRP project aimed to contribute to the standardization of RPT dosimetry and help participants develop and implement harmonized dosimetric procedures.

During each brainstorming session, the results were discussed, and further training was provided to the participants, resulting in an iteration of the dosimetry calculations. The number of iterations for the first, second, and third therapy cycles was 1–4, 2–3, and 4 or more, respectively. Even though the results for each center were not available to all, the procedure was not a masked intercomparison but rather evolved to an elaborate training procedure, with the objective of ensuring proper dosimetric understanding and application while allowing for limited individual choices in registration, contouring, and integration.

The identification of outlier results led participants to evaluate the integrity of their results as shown in Figure 1. Other variations observed consistently throughout the data necessitated the inclusion of additional quality assurance (QA) metrics (or checkpoints) in the dosimetric procedure with subsequent iterations of results. The results presented here are therefore the best that could be obtained within the time frame of the CRP, after extensive training and iterations.

FIGURE 1.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 1.

Workflow used for analyzing data and computing final results and recommendations. SOP = standard operating procedure.

RESULTS

Results were obtained for each time point and VOI for the first 3 cycles. In this section, the salient results are highlighted as coefficients of variation of the median (CVmed) among participants (ratio of median uncertainty to median); however, all results are available in Supplemental Tables 1 and 2 and Supplemental Figures 1–8 (supplemental materials are available at http://jnm.snmjournals.org).

Activity Quantification

Volume Segmentation

The liver and the kidneys along with the 4 lesions defined in the patient SPECT/CT images are shown in Figure 2 for the first cycle.

FIGURE 2.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 2.

(A) Anatomic segmentation (for whole liver and kidneys). (B) Functional segmentation for lesions. (C) Normal liver from Boolean subtraction.

The volumes obtained by the 9 centers (C1–C9) for each VOI for the first cycle are plotted in Figure 3. The CVmed among time points and cycles ranged from 6% to 13% for normal organs and from 3% to 20% for lesions, with the smallest lesions exhibiting the largest variability. The variations in normal-organ volumes as a function of time at each center constitute evidence of error according to the propagation process defined in the protocol, since the volume—once defined on the first time point—is propagated to the other time points. Similarly, variations of the lesion volumes between time points may be expected, and each center, in principle, should have the same volume at each time point because the lesion volumes were defined using a predefined threshold (40% of maximum activity uptake relative to each time point). The range of volumes (along with the uncertainties) obtained by various participants for each VOI and each cycle is specified in Supplemental Table 1.

FIGURE 3.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 3.

Organ and lesion volumes in first treatment cycle for 5 time points (1–5). Whole liver signifies anatomic liver, whereas normal liver represents healthy liver (whole liver − 4 lesions).

Derivation of Counts and Activity

The total counts and activity in normal organs (kidneys, normal liver, and whole liver) and lesions are illustrated in Figures 4A and 4B for the third cycle. Counts and activities within each VOI tend to follow a similar trend for most time intervals and participants, although they are not identical as would be anticipated.

FIGURE 4.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 4.

Total counts (A), activity (B), and activity-to-count ratio (C) for each VOI in third cycle for time points 1–5. Whole liver signifies anatomic liver, whereas normal liver represents healthy liver (whole liver − 4 lesions).

The whole liver demonstrated a significantly lower CVmed in volume and activity (∼5% and 3%–5%, respectively) at each time point and cycle analyzed. The lateral lesion had the widest range in volume (8%–59%) and activity (10%–49%). The other smaller lesions had a relatively lower activity (CVmed, 2%–15%) comparable to that in the kidneys.

Outlier data are discernible. The counts and the activity for the lateral lesion were significantly higher at C6 than at the other centers (Fig. 4A) and can be attributed to this center’s larger lesion segmentation. In parallel, a significant activity decrease was seen in the lesions and the normal liver for the first time point for C8. A common trend in counts and activity was not systematically observed, thereby necessitating the generation of a new checkpoint activity-to-count ratio (Fig. 4C). The activity fluctuation for C8 might be attributed to incorrect calibration factor input or a software flaw linked with a particular time point, but these possibilities require further investigation.

ADRs

Notable anomalies were observed for the third cycle (Fig. 5A). Except for results from C6, the ADR for time points for each organ was reasonably consistent between time points and participants. Unexpected ADR variability in lesions among participants initiated the generation of additional checkpoints: activity concentration (AC) and ADR-to-AC ratio. Since ADR is proportional to AC (for self-dose contributions to the AD dominating in regions of high uptake), it was hypothesized that the ADR-to-AC ratio would be relatively constant for each VOI.

FIGURE 5.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 5.

ADR (A), AC (B), and ADR-to-AC ratio (C) for each VOI in third cycle for time points 1–5. Whole liver signifies anatomic liver, whereas normal liver represents healthy liver (whole liver − 4 lesions).

Figure 5B shows the AC at each time point for the third cycle. All centers, including C6, had a fairly consistent AC for the liver and kidneys. Consequently, the ADR deviation of C6 in the liver and kidneys (6%–73%) cannot be directly related to volume segmentation or activity quantification but was most likely due to a transcriptional error. Additionally, the calculation of AC revealed that C8 likely overlooked some systematic error at the first time point.

The ADR-to-AC ratio (Fig. 5C) had nearly constant values (despite the presence of a few outliers) for the organs but not necessarily for the lesions. Because of the incoherent ADR and AC of C6, its ADR-to-AC ratio varied significantly. Variability in this ratio for lesions at the first time point for C8 is a consequence of error propagation from the activity quantification. Other variations were ascribed to transcriptional error.

AD Calculations

The ADRs were integrated using either monoexponential (corresponding to washout or decay curve) or biexponential (including one uptake and one washout phase) fitting models to obtain the ADs in each VOI. The fits chosen by centers for different VOIs are presented in Table 1. ADs for the first cycle are plotted in Figure 6. Low ADs (2–4 Gy) were obtained for the liver and kidneys, whereas ADs of up to 41 Gy were obtained for lesions. The AD obtained from monoexponential ADR fitting was substantially higher than that from biexponential ADR fitting (whole liver: 3.76 ± 0.15 Gy vs. 3.21 ± 0.24 Gy with P < 0.01; anterior lesion: 37.85 ± 3.98 Gy vs. 29.97 ± 1.42 Gy; P < 0.01).

View this table:
  • View inline
  • View popup
TABLE 1.

Fitting Chosen by Different Centers to Obtain AD for Each VOI

FIGURE 6.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 6.

AD (in Gy) for each VOI (organs and lesions) in first cycle. Whole liver signifies anatomic liver, whereas normal liver represents healthy liver (whole liver − 4 lesions).

Although ADRs from one site (C6) varied by up to 73% for the third cycle, variability in organ ADs was generally acceptable across participants (Table 2). For lesions, several outliers in the AD were identified and most probably arose from the centers’ respective high or low ADR (C6 and C8). The high AD in the inferior lesion from C6 was not plausible given the reduced ADR and AC and was likely a consequence of a transcriptional error or mishandling of the software.

View this table:
  • View inline
  • View popup
TABLE 2.

AD in Each VOI for Each Treatment Cycle

Mean variations in the AD calculation for each cycle in each VOI can be seen in Table 2. The coefficient of variation in AD was up to 15% in the case of organs and up to 33% for the lesions.

DISCUSSION

This work presents the dosimetry performed on patient image datasets acquired at different time points using PLANETDose software. Such a multicentric dosimetry comparison on a single clinical patient dataset using the same protocol and software by various centers appraises the precision of the dosimetry chain. The impact of reconstruction and calibration phases on the dosimetry chain was not considered in this work (23). The possibility of exporting intermediate results offered by PLANETDose facilitated the assessment of variations at each clinical dosimetry workflow step (24).

Although variations (CVmed) in organ volumes ranged from 6% to 13% for normal organs, CVmed increased to 38% for lesions. Even though the conversion of counts to activity was merely a reflection of the calibration factor, it was remarkable to see higher variations in counts (3%–29% for normal organs and ≤46% for lesions) but not a similar trend in discrepancies in activity, particularly for normal organs (13%). The ADR varied by a maximum of 12% and 17%, respectively, for normal organs and lesions, whereas the integration of ADR to obtain ADs reduced the variation in normal organs (<8%) and increased it in lesions (≤33%).

Every iteration evidenced significant disparities among participants, mostly derived from the heterogeneity of their initial level of expertise. To obtain more explainable results, these discrepancies were identified and addressed until the last iteration. Some of the observed issues were transcriptional error (improper unit conversions, use of a comma to represent decimals, errors in copying and pasting exported data), improper segmentation (inappropriate use of the thresholding technique, resulting in smaller segmented volumes; Fig. 7), and software mishandling (software data output formats were multiple and confusing, leading to incorrect reporting). However, since this was an educational and learning experience, most of these errors were deemed to be correctable.

FIGURE 7.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 7.

Typical error illustrating selection of small bounding box (in red) for anterior lesion while performing threshold-based segmentation. Blue VOI represents correct segmentation. Bounding box refers to predetermined subregion or selection in which thresholding is performed. By performing single click in area of high uptake, it is possible to generate tumor contour, thus preventing any potential correlation with uptake regions that are near tumor (e.g., organ, another tumor).

Several additional checkpoints were defined during this dosimetric analysis: activity-to-count ratio, AC, and ADR-to-AC ratio. The 2 latter checkpoints could be incorporated in the software.

Even after compensation for obvious methodologic errors, the user-dependent fitting model generated significant variability. Providing users with additional leeway to choose their preferred methodologic dosimetric approach will probably lead to an even wider range of outcomes. This was seen in recently published data from Society of Nuclear Medicine and Molecular Imaging challenge users when allowed to choose the methodology (17) and when segmentation and TIA were provided (18).

The initial hypothesis that the same patient data, with the same processing workflow and using the same software, would yield relatively low interoperator variability proved to be false. Variable results were examined closely in peer review training sessions, the source of the discrepancy was searched for, and it was decided whether an avoidable error had been made, warranting a teaching moment, or whether the discrepancy was a justified user variation.

The large number of iterations needed to increase the proficiency of each user with the software highlighted the importance of training. Often, insufficient training is delivered to users after the acquisition of new software packages. Several practical training sessions (along with theory) could increase proficiency in clinical dosimetry. Also, having access to a benchmark clinical dataset that comes with a set of expected results, or at least a range of acceptable results, would be an invaluable asset of the training.

Best practices in RPT should be adopted to ensure that results are reliable, traceable, and reproducible—in other words, that they include robust QA. This comprises (but is not limited to) double processing using independent software (or free open-source tools) and cross-verification across physicists, as is current practice in external-beam radiation therapy. Because most clinical dosimetry software companies, even those with a long history in imaging, are relatively new to the field, a critical eye (and QA) on the procedure implemented by the user should also be accompanied by an equally critical use, including commissioning and regular QA of the software. In the present case, no commissioning or QA was performed initially, although several checks evolved to account for possible software inconsistencies (e.g., count-to-activity ratio).

Also, collaboration between physicists and physicians and between external-beam radiation therapy and RPT physicists would be a good starting point for implementing dosimetry QA since external-beam radiation therapy physicists are more experienced with error and failure mode analysis, therapeutic QA, and procedures. This requires a willingness to adapt to a new workplace culture of increasing cooperation (25).

It is vital to assess not only the precision but also the accuracy of the clinical dosimetry workflow. A possible way forward for this objective is the DosiTest project, in which simulated patient datasets (with activity being perfectly characterized at the voxel level for each time point) are used as the ground truth (26).

Finally, although not implemented here, using biologic effective dose or equieffective dose along with AD is an essential part of standardizing the dosimetric process and reporting (27,28).

CONCLUSION

This paper illustrates how dosimetric analysis performed by various operators using the same protocol and software on one patient dataset may still result in large variations, as well as how practice and experience are needed after initial training to obtain reliable results in RPT dosimetry. Making the distinction between expected variability (related to legitimate operator choices) and erroneous processing (due to a variety of causes) was deemed crucial. The analysis of the results revealed the following important points.

Software Commissioning

Use of software for calculation of AD and other dosimetric quantities requires a rigorous validation of the software itself, including checks on intermediate results and an end-to-end test.

Checkpoints

The possibility to extract results at various intermediate steps of the clinical dosimetry workflow should be integrated, such as activity-to-count ratio or ADR-to-AC ratio.

Sanity Checks

Internal checks implemented in the dosimetry package should minimize human mistakes: when obviously aberrant results are obtained, warning messages or even fatal errors should be generated.

Result Validation

Most errors could be related to the fact that dosimetry was performed by single individuals. Cross-verification of results among physicists and clinicians should be systematically implemented, when possible.

This CRP enabled defining some aspects to include in a clinical dosimetry QA procedure. As such, it represents a stepping stone toward the definition of reliable and reproducible dosimetry procedures. This project also resulted in the creation of a benchmark dosimetry dataset that is adapted for training individuals in dosimetry. This should set a model for other clinical indications and software. The expected results and associated variability are now available for this patient dataset and procedure and will be the topic of further communication.

DISCLOSURE

Sébastien Vauclin is employed by DOSIsoft. The PhD work of José-Alejandro Fragoso-Negrín is sponsored by DOSIsoft and supervised by Manuel Bardiès and Sébastien Vauclin. This work was partially funded by the ENEN+ project, which received funding from EURATOM research and training program 2016-2017-1 under grant agreement 75576. Alex Vergara-Gil was supported by the MEDIRAD project, which received funding from EURATOM research and training program 2014-2018 under grant agreement 755523. No other potential conflict of interest relevant to this article was reported.

KEY POINTS

QUESTION: How can the sources of variation associated with clinical dosimetry be evaluated?

PERTINENT FINDINGS: Dosimetry performed by several users on a single patient dataset with the same software and the same standard protocol resulted nonetheless in high variations and discrepancies among participants. The in-depth analysis required implementing checkpoints and internal sanity checks.

IMPLICATIONS FOR PATIENT CARE: Implementing QA in clinical dosimetry starts with providing sufficient training and implementing cross validation of dosimetry results.

Footnotes

  • ↵* Contributed equally to this work.

  • ↵† Contributed equally to this work.

  • Published online Oct. 26, 2023.

  • © 2024 by the Society of Nuclear Medicine and Molecular Imaging.

Immediate Open Access: Creative Commons Attribution 4.0 International License (CC BY) allows users to share and adapt with attribution, excluding materials credited to previous publications. License: https://creativecommons.org/licenses/by/4.0/. Details: http://jnm.snmjournals.org/site/misc/permission.xhtml

REFERENCES

  1. 1.↵
    1. Hennrich U,
    2. Kopka K
    . Lutathera®: the first FDA- and EMA-approved radiopharmaceutical for peptide receptor radionuclide therapy. Pharmaceuticals. 2019;12:114.
    OpenUrl
  2. 2.↵
    1. Glatting G,
    2. Bardiès M,
    3. Lassmann M
    . Treatment planning in molecular radiotherapy. Z Med Phys. 2013;23:262–269.
    OpenUrlCrossRefPubMed
  3. 3.↵
    Council of the European Union. European Council Directive 2013/59/Euratom on basic safety standards for protection against the dangers arising from exposure to ionising radiation and repealing Directives 89/618/Euratom, 90/641/Euratom, 96/29/Euratom, 97/43/Euratom and 2003/122/Euratom. Official J Eur Union. 2014;L13:1–73.
    OpenUrl
  4. 4.↵
    1. Flux G,
    2. Bardiès M,
    3. Monsieurs M,
    4. et al
    . The impact of PET and SPECT on dosimetry for targeted radionuclide therapy. Z Med Phys. 2006;16:47–59.
    OpenUrlPubMed
  5. 5.
    1. McGowan DR,
    2. Guy MJ
    . Time to demand dosimetry for molecular radiotherapy? Br J Radiol. 2015;88:20140720.
    OpenUrl
  6. 6.
    1. Ljungberg M,
    2. Sjögreen Gleisner K
    . Personalized dosimetry for radionuclide therapy using molecular imaging tools. Biomedicines. 2016;4:25.
    OpenUrl
  7. 7.↵
    1. Stokke C,
    2. Gabiña PM,
    3. Solný P,
    4. et al
    . Dosimetry-based treatment planning for molecular radiotherapy: a summary of the 2017 report from the Internal Dosimetry Task Force. EJNMMI Phys. 2017;4:27.
    OpenUrl
  8. 8.↵
    1. Sundlöv A,
    2. Gleisner KS,
    3. Tennvall J,
    4. et al
    . Phase II trial demonstrates the efficacy and safety of individualized, dosimetry-based 177Lu-DOTATATE treatment of NET patients. Eur J Nucl Med Mol Imaging. 2022;49:3830–3840.
    OpenUrl
  9. 9.
    1. Strigari L,
    2. Konijnenberg M,
    3. Chiesa C,
    4. et al
    . The evidence base for the use of internal dosimetry in the clinical practice of molecular radiotherapy. Eur J Nucl Med Mol Imaging. 2014;41:1976–1988.
    OpenUrlCrossRefPubMed
  10. 10.
    1. Wahl RL,
    2. Sgouros G,
    3. Iravani A,
    4. et al
    . Normal-tissue tolerance to radiopharmaceutical therapies, the knowns and the unknowns. J Nucl Med. 2021;62(suppl 3):23S–35S.
    OpenUrlFREE Full Text
  11. 11.↵
    1. Sgouros G,
    2. Dewaraja YK,
    3. Escorcia F,
    4. et al
    . Tumor response to radiopharmaceutical therapies: the knowns and the unknowns. J Nucl Med. 2021;62(suppl 3):12S–22S.
    OpenUrlAbstract/FREE Full Text
  12. 12.↵
    1. Bardiès M,
    2. Gear JI
    . Scientific developments in imaging and dosimetry for molecular radiotherapy. Clin Oncol. 2021;33:117–124.
    OpenUrl
  13. 13.↵
    1. Haug AR
    . PRRT of neuroendocrine tumors: individualized dosimetry or fixed dose scheme? EJNMMI Res. 2020;10:35.
    OpenUrl
  14. 14.
    1. Sgouros G,
    2. Bodei L,
    3. McDevitt MR,
    4. Nedrow JR
    . Radiopharmaceutical therapy in cancer: clinical advances and challenges. Nat Rev Drug Discov. 2020;19:589–608.
    OpenUrlPubMed
  15. 15.↵
    1. Gear JI,
    2. Cox MG,
    3. Gustafsson J,
    4. et al
    . EANM practical guidance on uncertainty analysis for molecular radiotherapy absorbed dose calculations. Eur J Nucl Med Mol Imaging. 2018;45:2456–2474.
    OpenUrl
  16. 16.↵
    1. Sjögreen Gleisner K,
    2. Spezi E,
    3. Solny P,
    4. et al
    . Variations in the practice of molecular radiotherapy and implementation of dosimetry: results from a European survey. EJNMMI Phys. 2017;4:28.
    OpenUrl
  17. 17.↵
    1. Uribe C,
    2. Peterson A,
    3. Van B,
    4. et al
    . An international study of factors affecting variability of dosimetry calculations, part 1: design and early results of the SNMMI dosimetry challenge. J Nucl Med. 2021;62(suppl 3):36S–47S.
    OpenUrlAbstract/FREE Full Text
  18. 18.↵
    1. Brosch-Lenz J,
    2. Ke S,
    3. Wang H,
    4. et al
    . An international study of factors affecting variability of dosimetry calculations, part 2: overall variabilities in absorbed dose. J Nucl Med. 2023;64:1–7.
    OpenUrlFREE Full Text
  19. 19.↵
    1. Kayal G,
    2. Chauvin M,
    3. Vergara-Gil A,
    4. et al
    . Generation of clinical 177Lu SPECT/CT images based on Monte Carlo simulation with GATE. Phys Med. 2021;85:24–31.
    OpenUrl
  20. 20.↵
    1. Müller JW
    . Possible advantages of a robust evaluation of comparisons. J Res Natl Inst Stand Technol. 2000;105:551–555.
    OpenUrlCrossRef
  21. 21.↵
    1. Meyers N,
    2. Jadoul A,
    3. Bernard C,
    4. et al
    . Inter-observer variability of 90Y PET/CT dosimetry in hepatocellular carcinoma after glass microspheres transarterial radioembolization. EJNMMI Phys. 2020;7:29.
    OpenUrl
  22. 22.↵
    1. Cicone F,
    2. Denoël T,
    3. Gnesin S,
    4. et al
    . Preclinical evaluation and dosimetry of [111In]CHX-DTPA- scFv78-Fc targeting endosialin/tumor endothelial marker 1 (TEM1). Mol Imaging Biol. 2020;22:979–991.
    OpenUrl
  23. 23.↵
    1. Zimmerman BE,
    2. Grošev D,
    3. Buvat I,
    4. et al
    . Multi-centre evaluation of accuracy and reproducibility of planar and SPECT image quantification: an IAEA phantom study. Z Med Phys. 2017;27:98–112.
    OpenUrl
  24. 24.↵
    1. Della Gala G,
    2. Bardiès M,
    3. Tipping J,
    4. Strigari L
    . Overview of commercial treatment planning systems for targeted radionuclide therapy. Phys Med. 2021;92:52–61.
    OpenUrl
  25. 25.↵
    1. Lawhn-Heath C,
    2. Hope TA,
    3. Martinez J,
    4. et al
    . Dosimetry in radionuclide therapy: the clinical role of measuring radiation dose. Lancet Oncol. 2022;23:e75–e87.
    OpenUrl
  26. 26.↵
    1. Kayal G,
    2. Clayton N,
    3. Vergara-Gil A,
    4. Struelens L,
    5. Bardiès M
    . Proof-of-concept of DosiTest: a virtual multicentric clinical trial for assessing uncertainties in molecular radiotherapy dosimetry. Phys Med. 2022;97:25–35.
    OpenUrl
  27. 27.↵
    1. Barone R,
    2. Borson-Chazot F,
    3. Valkema R,
    4. et al
    . Patient-specific dosimetry in predicting renal toxicity with 90Y-DOTATOC: relevance of kidney volume and dose rate in finding a dose-effect relationship. J Nucl Med. 2005;46(supp 1):99S–106S.
    OpenUrlAbstract/FREE Full Text
  28. 28.↵
    1. Wessels BW,
    2. Konijnenberg MW,
    3. Dale RG,
    4. et al
    . MIRD pamphlet no. 20: the effect of model assumptions on kidney dosimetry and response–implications for radionuclide therapy. J Nucl Med. 2008;49:1884–1899.
    OpenUrlAbstract/FREE Full Text
  • Received for publication January 17, 2023.
  • Revision received July 25, 2023.
PreviousNext
Back to top

In this issue

Journal of Nuclear Medicine: 65 (1)
Journal of Nuclear Medicine
Vol. 65, Issue 1
January 1, 2024
  • Table of Contents
  • Table of Contents (PDF)
  • About the Cover
  • Index by author
  • Complete Issue (PDF)
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on Journal of Nuclear Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Quality Assurance Considerations in Radiopharmaceutical Therapy Dosimetry Using PLANETDose: An International Atomic Energy Agency Study
(Your Name) has sent you a message from Journal of Nuclear Medicine
(Your Name) thought you would like to see the Journal of Nuclear Medicine web site.
Citation Tools
Quality Assurance Considerations in Radiopharmaceutical Therapy Dosimetry Using PLANETDose: An International Atomic Energy Agency Study
Gunjan Kayal, Nathaly Barbosa, Carlos Calderón Marín, Ludovic Ferrer, José-Alejandro Fragoso-Negrín, Darko Grosev, Santosh Kumar Gupta, Nur Rahmah Hidayati, Tumelo C.G. Moalosi, Gian Luca Poli, Parul Thakral, Virginia Tsapaki, Sébastien Vauclin, Alex Vergara-Gil, Peter Knoll, Robert F. Hobbs, Manuel Bardiès
Journal of Nuclear Medicine Jan 2024, 65 (1) 125-131; DOI: 10.2967/jnumed.122.265340

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Quality Assurance Considerations in Radiopharmaceutical Therapy Dosimetry Using PLANETDose: An International Atomic Energy Agency Study
Gunjan Kayal, Nathaly Barbosa, Carlos Calderón Marín, Ludovic Ferrer, José-Alejandro Fragoso-Negrín, Darko Grosev, Santosh Kumar Gupta, Nur Rahmah Hidayati, Tumelo C.G. Moalosi, Gian Luca Poli, Parul Thakral, Virginia Tsapaki, Sébastien Vauclin, Alex Vergara-Gil, Peter Knoll, Robert F. Hobbs, Manuel Bardiès
Journal of Nuclear Medicine Jan 2024, 65 (1) 125-131; DOI: 10.2967/jnumed.122.265340
Twitter logo Facebook logo LinkedIn logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One
Bookmark this article

Jump to section

  • Article
    • Visual Abstract
    • Abstract
    • MATERIALS AND METHODS
    • RESULTS
    • DISCUSSION
    • CONCLUSION
    • DISCLOSURE
    • Footnotes
    • REFERENCES
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • PDF

Related Articles

  • PubMed
  • Google Scholar

Cited By...

  • No citing articles found.
  • Google Scholar

More in this TOC Section

  • Detection of HER2-Low Lesions Using HER2-Targeted PET Imaging in Patients with Metastatic Breast Cancer: A Paired HER2 PET and Tumor Biopsy Analysis
  • First-in-Human Study of 18F-Labeled PET Tracer for Glutamate AMPA Receptor [18F]K-40: A Derivative of [11C]K-2
  • [11C]Carfentanil PET Whole-Body Imaging of μ-Opioid Receptors: A First in-Human Study
Show more Clinical Investigation

Similar Articles

Keywords

  • clinical dosimetry
  • SPECT/CT
  • Quality Assurance
  • PLANETDose
  • variability assessment
SNMMI

© 2025 SNMMI

Powered by HighWire