Abstract
Hybrid PET/MR systems have rapidly progressed from the prototype stage to systems that are increasingly being used in the clinics. This review provides an overview of developments in hybrid PET/MR systems and summarizes the current state of the art in PET/MR instrumentation, correction techniques, and data analysis. The strong magnetic field requires considerable changes in the manner by which PET images are acquired and has led, among others, to the development of new PET detectors, such as silicon photomultipliers. During more than a decade of active PET/MR development, several system designs have been described. The technical background of combined PET/MR systems is explained and related challenges are discussed. The necessity for PET attenuation correction required new methods based on MR data. Therefore, an overview of recent developments in this field is provided. Furthermore, MR-based motion correction techniques for PET are discussed, as integrated PET/MR systems provide a platform for measuring motion with high temporal resolution without additional instrumentation. The MR component in PET/MR systems can provide functional information about disease processes or brain function alongside anatomic images. Against this background, we point out new opportunities for data analysis in this new field of multimodal molecular imaging.
With nuclear imaging, biologic processes can be visualized and measured at the molecular level. There is ever-increasing interest in pushing the limits of multimodal molecular/anatomic imaging, and there is now the new hybrid of PET/MR. The combination of these 2 modalities into a single machine reduces registration errors and, for simultaneous scanning, can reduce the imaging time. Although the resolution of modern PET scanners is reasonably high, at approximately 4–5 mm full width at half maximum at the center of the field of view (FOV) for clinical systems, additional anatomic information is beneficial, especially when tracers with a high specificity for a certain target are used. For this purpose, combined PET/CT was introduced more than 10 y ago (1). However, MR can provide anatomic information with much higher soft-tissue contrast without the additional radiation dose from CT. Another major advantage of MR is that it can provide functional information in addition to anatomic data. However, the sensitivity of PET is much higher than that of MR (∼10−12 mol/L for PET vs. ∼10−5 mol/L for MR); thus, PET remains an essential component of molecular imaging. Nevertheless, combining the functional data obtained with both modalities can provide complementary information about, for example, disease processes and the function of the brain as well as aid in reaching a diagnosis. MR can provide the following types of functional information, among others: perfusion, diffusion, and spectroscopy to reveal metabolites. Additional advantages of PET/MR are the potential for motion correction, as well as reconstruction driven by anatomic information (2,3).
Another advantage of PET/MR, which was a driving force in the initial development of combined PET/MR, is the reduction of the positron range in a magnetic field. The distance positrons travel before annihilation, especially for higher field strengths, is reduced in the direction orthogonal to the magnetic field, leading to in-plane improvement in the resolution proportional to the field strength (4).
The first attempts to combine MR and PET were performed with images acquired on separate machines; the images were subsequently coregistered (5). This works well in the brain but is more cumbersome in organs that have more motion. The use of a single imaging device to acquire both modalities makes image registration more straightforward and enables whole-body imaging with multiple modalities. Early PET/MR devices were described and designed (4,6) even before the introduction of PET/CT (1). Hybrid PET/CT scanners have greatly improved the usefulness of PET by enabling accurate anatomic localization of pathologies and have completely replaced stand-alone PET devices. In the meantime, hybrid PET/MR has remained a field of active research.
Despite more than 2 decades of ongoing research and interest in combined PET/MR, only a small number of systems are currently commercially available (Table 1). Several technical difficulties make combining the 2 modalities challenging. It requires a careful design of both modalities to achieve performance and specifications similar to their stand-alone imaging counterparts. The main challenge is that the modalities interfere with each other; additionally, there are constraints on the space available for the components and absolute PET quantification has been challenging in PET/MR, mainly because correct attenuation maps are difficult to obtain with MR. Bone, metallic implants, MR hardware, and other dense materials significantly attenuate radiation but are difficult, if not impossible, to see on MR images.
Abbreviated* Overview of PET/MR Systems Described in Literature
Most of the challenges complicating PET/MR have, at least partially, been solved. In this review, we discuss the principles of combined PET/MR, the variety of available designs, recent and current detector technologies, and several PET/MR–specific software approaches. Moreover, the foreseeable future of this recent hybrid technology is briefly discussed.
SYSTEM DESIGNS
Since the development of the first working prototype in 1997, various approaches have been taken to acquire PET and MR data with a single machine (6,7). There is a general distinction between systems that acquire images sequentially and those that can acquire images simultaneously, as well as between preclinical and clinical systems. Table 1 presents an overview of the systems reported in the literature, summarizing the different approaches and some of their major properties.
For systems that enable simultaneous data acquisition, there is a distinction between fully integrated systems and those with a PET insert that fits inside a standard MR scanner gantry. Sequential geometry is easier to implement because the 2 modalities can be placed at a distance that reduces mutual interference. However, simultaneous acquisition is a more promising approach given the much larger number of simultaneous systems presented in the literature. Simultaneously acquired images are intrinsically coregistered, both temporally and spatially, and the scanning time can be reduced with an integrated device.
The first hybrid PET/MR systems were designed for preclinical imaging, followed by clinical systems more than a decade later. One clinical PET/MR prototype was developed as an insert for brain imaging, and it used avalanche photodiode (APD) detectors (8) instead of the photomultiplier tubes (PMTs) traditionally used in PET. Two commercial PET/MR systems have since been introduced, and their overall designs are substantially different. One of these systems features simultaneous PET/MR acquisition, and it is based on a wide-gantry MR scanner with integrated APD PET detectors (9). The second scanner is a sequential system, which was built using 2 slightly modified standard scanners with a motorized bed in between (10). This scanner contains standard PMTs with additional shielding to detect the scintillation light. A third clinical system has recently been presented but has not been introduced commercially (11). The first commercially available combined system for preclinical research offers sequential imaging with PMT-based PET detectors, and the gantry is attached to a permanent 1-T MR magnet (12). In the following sections, the different technologies used in PET/MR are discussed in more detail.
PET
In hybrid PET/MR approaches, the 2 modalities can have mutual interference, degrading the image quality. The MR radiofrequency pulses or switching gradients can influence the PET electronics, and conversely, the PET components can distort the main magnetic field.
PET Detectors
Since the beginning of PET development, PMTs have been the devices of choice for detecting scintillation light. However, their strong sensitivity to magnetic fields hinders their use inside an MR scanner. Even the earth’s magnetic field (∼50 μT) affects PMTs, but low fields such as this can easily be shielded by covering the outside glass. However, the static magnetic field used in MR is several orders of magnitude stronger, making shielding a viable option only at a certain distance from the magnet. Figure 1 illustrates the effect of increasing field strengths on the operation of a PMT-based PET detector.
Effect of increasing magnetic field strength on crystal maps of PMT-based PET detector at 1 mT (A), 3 mT (B), and 5 mT (C). (Reprinted with permission of (79).)
In some hybrid systems, only the scintillators have been placed inside the MR imager. The light is guided to PMTs through optical fibers; the PMTs have been placed outside the magnetic fringe field, at field strengths of less than 500 μT. Simultaneous imaging with this configuration is possible, but approximately 90% of the scintillation light is lost (13). With the loss of scintillation light, the energy resolution is drastically degraded.
To avoid the use of light fibers and their accompanying disadvantages, APDs have been used to replace PMTs because they are unaffected by magnetic fields. Their introduction has paved the way for new hybrid scanner designs that include photon detectors in the main MR magnetic field (14). In some instances, relatively short light fibers between scintillators and APDs have been used to move components that have a low magnetic permeability, such as front-end electronics, out of the FOV to reduce magnetic field disturbances (15). With the scintillator’s low level of light energy flux and the low intrinsic amplification of APDs, a charge-sensitive preamplifier is required to convert the electron charge into a measureable voltage signal. The charge-sensitive preamplifier integrates the APD charge over several nanoseconds to achieve high conversion factors, with the disadvantage of pile-up events at high counting rates. The lower gain in APD-based systems requires more advanced front-end electronics. Therefore, most systems use an application-specific integrated circuit to help meet the electrical requirements, complexity, compactness, and performance. Because of the noise and the time variation in the electron drift during the avalanche multiplication process of APDs, the timing resolution is limited to approximately 1.8 ns in a block readout (16), which hinders the use of APDs in time-of-flight applications.
Approximately 10 y ago, the first Geiger-mode APD (G-APD) arrays were studied for low-light-level detection in high-energy physics. A single photon can trigger a self-sustaining ionization cascade, also called Geiger discharge, analogous to the operation of Geiger-Müller tubes. G-APD arrays feature a gain comparable to that for PMTs; they are therefore commonly known as silicon photomultipliers (SiPM). Other names include solid-state photomultipliers and multipixel photon counters.
The signal generated by a single G-APD does not carry any information about the energy or quantity of incoming particles. In PET scintillation detectors, γ-photon energy information is carried via the number of photons generated by the scintillator rather than by the photon wavelength or energy. To discern the amount of incident light, SiPMs consist of a grid of small G-APDs, or cells, at a level of 100 to 10,000 per mm2. All individual cells are connected in parallel, and their signals are combined. The number of cells per surface area increases the dynamic range of the detector, and its output can provide information about the quantity of photons.
The main noise contribution in an SiPM output signal is from the so-called dark counts, which are signals generated by the detector itself. These signals are partly due to the optical crosstalk between cells, but they are mainly thermally generated. The dark counts increase by a factor of approximately 2 every 8°C (17). Also, the SiPM gain is strongly affected by the temperature (18). This is especially relevant for its application in an MR scanner because rapid gradient switching, the application of radiofrequency pulses, and the confined environment can induce large temperature variations. Therefore, temperature control is of particular importance for SiPM detectors in PET/MR.
Because of the high gain and fast response times of SiPMs, front-end electronics can be straightforward and do not necessarily require charge-sensitive preamplifiers and application-specific integrated circuits. Wehner et al. (19) recently showed an insert based on SiPM technology with fully front-end digitizers. The signals from PET detectors are directly digitized and processed within the magnetic field. The single-photon detection capability of G-APDs enables triggering on the first photo electron, allowing for coincidence timing resolutions of 100 ps full width at half maximum or lower (20). Placement of SiPMs in strong magnetic fields has no effect on the energy and time resolutions (21). Because of their favorable properties, SiPMs are likely to replace PMTs, in PET/CT scanners as well, as demonstrated by a system recently introduced by Philips featuring digital SiPMs. More details about the 3 types of PET detectors have been listed by Lecomte (22).
Shielding
PET detector systems require sensitive preamplifiers and front-end electronics, which are also highly sensitive to electromagnetic interferences, such as the radiofrequency pulses generated by MR. To prevent MR sequences or gradient switching from degrading the PET signal quality or from generating false events, the electronic components should be placed at a distance or should be shielded (23). The integration of a PET system in an MR scanner requires a careful design of the radiofrequency shielding to avoid introducing eddy currents. These currents are introduced in conductors by changing magnetic fields, for example, applied gradients. Eddy currents create an additional magnetic field that can induce local magnetic field inhomogeneities as well as affect the gradient speed (slew rate) and the spatial encoding ability of the system (23). Furthermore, the PET components should consist of materials with a low magnetic susceptibility. Most integrated circuits fulfill this requirement, but components such as resistors, inductors, capacitors, or connectors should be equipped with nonmagnetic terminals to reduce artifacts.
Most PET systems do not cover the object or patient entirely; as a result, some of the radioactivity remains outside the FOV. Naturally, events caused by this radiation cannot be resolved because no coincidences will be detected. However, this radiation will increase the rate of scattered and random events. γ-ray shielding can be used to reduce this effect, but there are specific limitations on the materials used inside an MR scanner (24). Shielding materials should clearly be of high density to sufficiently attenuate γ photons, but shielding should have low conductivity to prevent the induction of eddy currents and to avoid influencing the radiofrequency signals. Moreover, the material should have a low magnetic susceptibility to guarantee a homogeneous magnetic field. Materials that fulfill these characteristics are lead and tungsten powders in combination with epoxy to reduce the conductivity (24).
MR
Significant modifications have to be made to the PET hardware to permit the acquisition of images in the presence of a strong magnetic field and radiofrequency pulses. In contrast, changes in the MR hardware are less obvious. Many of the various PET/MR prototype systems consist of a PET scanner that fits within the bore of a standard, unmodified MR scanner. Nevertheless, modifications to some of the MR components may improve the acquisition by reducing crosstalk between the 2 modalities and improving image quality.
Magnet
PET images have been acquired at different magnetic field strengths, from the 0.15-T permanent magnet setup used by Yamamoto et al. (25) to the 9.4-T systems for preclinical (26) and clinical applications (27). Hybrid systems usually consist of a commercially available stand-alone MR scanner combined with a custom built PET system. A notable exception was built with an only slightly modified, commercially available PMT-based PET system, but it features a 1-T split-magnet specifically designed for combined PET/MR (28). Another noteworthy example operates a PET scanner in a field-cycled MR system (29). During PET acquisition, the magnet is ramped down to enable normal operation of the PMT-based PET detectors.
The additional components required for PET acquisition result in a reduction in the bore size in hybrid systems. For example, the Siemens mMR system is based on a 70-cm, wide-bore MR scanner; however, the installed PET hardware reduces the bore diameter to 60 cm (9). In addition, the added components may distort the main magnetic field in simultaneous systems. A distorted magnetic field can decrease the MR image quality, especially for sequences that particularly rely on field uniformity, such as MR spectroscopy and echo planar imaging. However, several studies have shown that with sufficient shimming, the presence of additional PET hardware does not significantly affect the magnetic field homogeneity (8,9,30).
Gradient and Radiofrequency Coils
The gradient system is an essential component of an MR system. In the integrated or insert-based PET/MR scanners that have been described thus far, the PET detectors, electronics, and shielding reside within the gradient coils. This design can reduce the effectiveness of the gradients, decreasing the signal-to-noise ratio in the MR images (14). Rapid switching of the gradient coils, particularly evident in sequences such as echo planar imaging, produces resistive heat when the coils are energized (31). The heat can cause additional warming of the PET components. Because the operation of PET detectors, such as SiPMs, is strongly temperature-dependent, strict temperature control is required. Thus far, proposed hybrid systems have not used gradient coils specifically designed for combined PET/MR, with the exception of a gradient system for the split magnet proposed by Poole et al. (32). The gradient system and the magnet are split into 2 parts to house the PET detectors.
An integrated radiofrequency body coil can be used for whole-body imaging in MR scanners. However, because only weak radiofrequency signals emanate from the tissues during MR acquisition, and this particular coil is positioned relatively far away, this setup results in a low signal-to-noise ratio. Higher signal-to-noise ratios in MR images can be achieved with radiofrequency receiver coils that are placed closer to the object of interest.
All coils placed in the FOV significantly attenuate radiation. It is worthwhile to optimize the coil design in PET/MR to reduce the attenuation losses. Still, even optimized coils attenuate and scatter radiation to some extent. For accurate quantification, attenuation maps of the coil elements in the FOV should be estimated and used during reconstruction. Because of a loss in counts, the global activity concentration will be underestimated when the coil is not accounted for in the attenuation correction (AC), but errors will be especially prevalent near the coil (33–35). The problem with the coils and other objects in the FOV, such as the bed, is that they provide no MR signal although they attenuate radiation. Coils with a fixed position can easily be measured beforehand, for example, with CT, and used as a template in the AC (34,36). In a similar manner, the bed can be included in the AC. However, coil placement should be fairly accurate because small misalignments could already create image artifacts and incorrect quantification (33,36). Additionally, the CT scan of the coils may have artifacts due to the metal components, which in turn can affect the PET images (34). An even more difficult challenge is attenuation due to flexible coils that can be placed in variable positions and orientations. In most cases, these coils are not included in the AC, but not including them could introduce significant deviations in the activity concentration. Attempts have been made to identify the coils using ultrashort echo time sequences or markers attached to the coil that are visible by both MR and CT (37).
Specially designed, low-attenuation coils in combination with accurate localization techniques can improve quantification of PET images. The standard coils available for MR have never been designed specifically for PET/MR; instead, they have been designed for optimal signal-to-noise ratio. PET/MR coils should have low attenuation for γ photons while still performing adequately. The optimization of radiofrequency coils for use in PET/MR is still a relatively young field, but initial studies show promising results (38). The homogeneity of the radiofrequency field could be influenced by the additional PET components, affecting the flip angle. Only very small radiofrequency field map differences have been reported in preclinical (30) and clinical (8) insert-based PET/MR systems.
CORRECTION METHODS AND RECONSTRUCTION
Standard MR protocols can be used for hybrid scanner acquisition, possibly supplemented with additional sequences for attenuation or motion correction. Standard clinical MR protocols can already require long acquisition times, especially when functional images are also acquired. In sequential scanners, PET and sequences for AC prolong the total acquisition, which could lead to unacceptably long acquisition times. Moreover, because of the time delay between MR and PET acquisition, differences in, for example, bladder filling between the 2 scans can lead to misregistrations (39). In simultaneous systems, images are more accurately registered (40) and the total acquisition times can be shorter because the anatomic images, AC sequences, and additional functional imaging can be acquired during the PET acquisition (41). However, misregistrations can occur because of the spatial deformation inherent to certain MR sequences (40).
Clinical considerations in PET/MR acquisition protocols are discussed for the Biograph mMR (Siemens) by Martinez-Möller et al. (41) and for the Ingenuity (Philips) by Vargas et al. (39). In preclinical imaging, both PET and MR images are usually acquired in 1 bed position (42,43).
AC
For quantitative PET imaging, the reconstructed data need to be corrected for the γ-photon attenuation. Direct measurement of linear attenuation coefficients is not possible in integrated PET/MR systems, and the problem needs to be addressed differently. MR information has to be converted to linear attenuation coefficients; however, because the MR signal relates to the proton density instead of to the γ-photon attenuation, this conversion is challenging. The available methods for MR-based AC can be grouped into the following 3 categories: segmentation-based methods, which segment the MR data into tissue classes and assign uniform linear attenuation coefficients to each tissue class; methods that use coregistered MR images and corresponding attenuation maps; and methods that use PET emission data and MR anatomic information to create attenuation maps. The AC possibilities depend on the subject of study, and the requirements differ between clinical and preclinical imaging.
Clinical Imaging
In brain imaging, the cranial bone significantly contributes to attenuation of the radioactivity in the brain because most lines of response intersect with the bone. Therefore, MR-based AC methods designed for brain imaging need to account for bone attenuation (44,45). However, it is not possible to delineate bone tissue solely from the intensity of single voxels with standard MR sequences because of its short T2 relaxation times.
With ultrashort echo time sequences, signal can still be acquired from bone and used to create attenuation maps. Proposed methods segment ultrashort echo time brain data into 3 (46) or 4 (45) tissue classes, including bone tissue. Using such methods, a high correlation with the reference PET data using CT-based AC can be achieved, but regions with fine structure such as nasal cavities and cerebrospinal fluid are occasionally misclassified. AC methods for whole-body imaging need to address several challenges. Bone detection with MR is difficult because the current ultrashort echo time sequences are too time consuming to be applied for whole-body acquisitions in the clinical setting. However, unlike for brain imaging, whole-body applications are less affected when bone tissue is not properly discriminated from soft tissue in attenuation maps. Therefore, multiple groups have developed segmentation-based methods for whole-body MR-based AC that do not account for the bone without compromising the quantification accuracy for regions that are not close to osseous tissue. Lung segmentation needs to be addressed because the lung density between patients is highly variable, which can affect the quantification results (47). However, the lung signal intensity is generally low in images acquired with conventional MR sequences.
Martinez-Möller et al. (48) proposed a segmentation-based method that discriminates between air, lungs, fat, and soft tissue with intensity-based segmentation using fixed thresholds and connected component analysis to detect the lungs. The AC for the Biograph mMR system is based on this method. Figure 2 shows an attenuation map that was created on this system and the corresponding PET image for an example patient. Approaches that perform segmentation of 3 classes without distinguishing between fat and nonfat soft tissues have also been developed. The AC for the Ingenuity TF PET/MR system is based on such a method (49).
PET/MR image of patient with enteric melanoma metastasis (arrow): MR-based attenuation map (A), T2-weighted short-τ inversion recovery sequence (B), 18F-FDG PET image (C), and PET overlaid on short-τ inversion recovery image (D). Data were acquired on a Biograph mMR system.
Atlas-based methods predict bone tissue without requiring specialized MR sequences. The attenuation maps can be created by deforming a single template image to match the patient anatomy (50) or averaging multiple coregistered attenuation template datasets (51). These methods can work well in brain imaging, but regions with high anatomic variability, such as the sinuses, prove to be challenging. Machine learning-based approaches offer another way to account for bone attenuation by learning a mapping from the MR to either the linear attenuation coefficient or CT data (44).
Atlas approaches or machine learning methods are more challenging for whole-body imaging than for brain imaging because of the high anatomic variability between patients and differences in the body position. Although segmentation-based methods that do not account for bone generally provide accurate quantification results for soft-tissue lesions (52), such methods can be complemented with bone prediction using an atlas or machine learning–based method.
Finally, the transaxial FOV of MR scanners is smaller than the patient cross section, which can lead to truncation artifacts in the MR images at the arm areas. These artifacts propagate to the attenuation maps created from the MR data if they are not adequately corrected. The truncation artifacts can be corrected using reconstructed PET images to derive the body outline (53) or by applying alternate emission and attenuation reconstruction techniques to estimate the missing parts of the attenuation map (54). Blumhagen et al. (55) proposed a method for extending the FOV via homogenization gradient enhancement, which might be an alternative to truncation artifact reduction without resorting to the PET data. Watson (56) proposed an approach for correcting truncation artifacts using supplemental transmission line sources placed around the periphery, whereas Mollet et al. (57) obtained a full attenuation map using an external radiation source. In addition to truncation artifacts, attenuation maps created from MR data can be affected by susceptibility artifacts in MR images. Metallic objects can cause nearby large image distortions or signal loss and affect the attenuation maps. Other intensity variations in MR images can also cause tissue misclassification, whereby, for example, the lungs may be falsely classified as air (58). A review of various MR-based AC techniques was given by Bezrukov et al. (59).
Preclinical Imaging
PET systems for preclinical small-animal imaging have less stringent attenuation map requirements due to the smaller subject size and shorter lines of response. An evaluation by Konik et al. (60) suggested that a uniform attenuation map computed by segmenting uncorrected PET data could provide sufficient accuracy below 6% for subjects smaller than 4 cm in diameter. Deriving attenuation maps from MR data is potentially more robust than segmenting uncorrected PET data, especially if highly specific tracers, such as 11C-raclopride, are used. In studies with larger animals, additional tissue classes can be considered.
Motion Correction
Motion artifacts can significantly degrade the effective resolution of PET systems (2). A distinction between rigid motion (i.e., only rotation and translation), such as head movements, and nonrigid motion (i.e., changes in shape) can be made. Although patient motion can be reduced through patient cooperation or the use of positioning aids, nonrigid cardiac and respiratory motion needs to be accounted for with gating techniques or motion correction approaches.
In gating, list-mode data are filtered on the basis of the respiratory state or cardiac phase such that only counts from a single cardiac or respiratory state are used for image reconstruction. Because a large fraction of the acquired counts is discarded, the signal-to-noise ratio of the resulting images decreases unless the acquisition time is also prolonged. To prevent this decrease, techniques that keep the counts for all states by transforming them to a reference gating state have been developed. The transformation can be performed after the reconstruction, such that the images of different gating states are deformed to a reference state and summed (61), as well as during (62) or before the reconstruction (63,64).
The required deformation fields for performing the transformation can be obtained directly from the PET data by coregistering the individual reconstructed gating states. However, this approach is limited by the availability of the PET anatomic information. In simultaneous PET/MR systems, the deformation fields can instead be derived from MR data. For respiratory gating, the respiration signal can be extracted from navigator images (64), obviating an additional measurement device. Cardiac gating has been applied to PET/MR data using a trigger signal based on electrocardiography (65). Self-gated cardiac imaging has been developed for MR (66), but this method has yet to be applied for simultaneous PET/MR.
Several groups have proposed and evaluated methods for generating motion correction information from MR data using tagged MR sequences (2), embedded cloverleaf navigator–derived motion estimates (63), and 2-dimensional gradient echo images (64), with an example displayed in Figure 3.
PET images and profiles through lung lesion: uncorrected (A), gated (B), and motion-corrected (C). (Reprinted with permission of (64).)
MR-Guided PET Reconstruction
Because of the limited spatial resolution, PET images suffer from the partial-volume effect, which degrades their quantitative accuracy. Many approaches have been described to correct for the partial-volume effect, including deconvolution (67) and methods using the recovery coefficient of small objects (68). With hybrid PET/MR, the available anatomic information can be used for partial-volume correction. Some of these methods are applied after reconstruction (69,70), whereas other methods are integrated into the reconstruction process using anatomic images as prior information (71) or use wavelets (72). Reconstruction algorithms that incorporate MR-based anatomic information promote the formation of edges in the PET image at the transition between different tissue types. Recent approaches calculate the mutual information between PET and anatomic images to guide the reconstruction process and do not require prior segmentation of the anatomic images (73). Methods that use anatomic information in the PET reconstruction require good registration of the 2 imaging modalities. This registration is most easily achieved in the brain, and most of the proposed methods have therefore been applied only to brain imaging. Bai et al. (3) recently wrote an overview of MR–driven PET reconstruction.
DATA ANALYSIS
Although hybrid PET/MR scanners are commercially available, a significant proportion of PET/MR research has been performed on separate scanners, requiring registration of the images after acquisition. The registration quality depends on the region of interest; for example, the brain is relatively easy in that it requires only linear transformations, whereas whole-body imaging may be much more challenging. However, good results can be obtained when the subject does not have to be repositioned between scans, as has been shown in patients (74) and animals (75).
For a long time, it has been clear that MR information can facilitate defining PET regions of interest, thus facilitating PET image analysis (76). Atlases that map specific regions in the brain can be generated, and these can be registered to individual patients or animals. The high-resolution, high-contrast images acquired with MR are well suited for atlas registration, after which the PET images can be analyzed. With predefined regions of interest, brain function analysis can be performed in a more automated fashion, making the results less operator-dependent, more reproducible, and easier to compare with other studies. For image analysis of organs and tissues other than the brain, these approaches are not feasible because of the anatomic variations (including pathologies) between individuals and different positioning between scans. However, MR provides higher soft-tissue contrast than CT, making it easier to define regions of interest.
Apart from the anatomic information, which is useful for defining regions of interest, functional information can be obtained with MR. Although the sensitivity of MR is a few orders of magnitude lower than that of PET, substantial functional information can be collected simultaneously or in quick succession with PET. Both PET and MR provide information on equivalent or similar physiologic parameters, but the 2 modalities complement each other. Discrepancies can still be seen in direct comparisons, for example, between MR spectroscopy of endogenous choline and 11C-choline PET (77).
The signal intensity in MR images has no absolute quantitative value but depends on many factors. Some of these, such as the T1 and T2 relaxation times and proton density, are tissue-related, but many others, such as the echo and repetition times and sensitivity of the coil, are not. However, quantification of MR is emerging; quantitative parameters such as the apparent diffusion coefficient and T1 or T2 relaxometry are being used not only in research but also in daily clinical practice (78). Advances in MR quantification will also be beneficial for hybrid PET/MR and may complement standard anatomic sequences.
The drawbacks of acquiring functional imaging data are the increased duration of studies and the large datasets that are obtained. It may become difficult to evaluate and use the data to their full potential. There is a clear role for machine learning approaches and medical informatics to improve analysis of PET/MR datasets. Techniques such as clustering could be used to identify or quantify irregularities in multimodal, multiparametric imaging data.
Combining PET with MR offers new opportunities for studying disease processes and biologic functions. Other imaging modalities may contribute additional information, but they too require image registration.
CONCLUSION
After more than a decade of continuous development, focusing mainly on new PET detector technology and the hardware integration of a PET scanner into an MR system, PET/MR has recently rapidly emerged from the first prototype systems into Food and Drug Administration–approved clinical scanners. Although there have been many technical challenges, PET/MR has matured to a reliable technology that can provide quantitative PET data, full MR functional imaging capabilities, and high-resolution anatomic MR images with superb soft-tissue contrast. The transition from research prototypes into clinical scanners, which provide all imaging options and perform the same as stand-alone systems, was rapid, given that a completely new generation of PET detectors able to operate in high magnetic fields had to be developed. Interestingly, these novel and compact semiconductor G-APD light detectors will likely replace the conventional PMTs used in PET/CT systems. Therefore, the development of PET/MR technology might have initiated a new generation of PET scanners.
In addition to the changes in hardware, which are based on new concepts, there have been new developments in the image correction methods, such as MR-based attenuation or motion correction. Retrieving attenuation coefficients from the MR information might also be beneficial for future radiation therapy–planning projects that are based on MR images.
The development of PET/MR has triggered a shift in the PET detector technology and image correction paradigms. Most of the technical challenges have been solved, but clinical studies have yet to show the areas of patient care for which PET/MR is advantageous over other diagnostic methods.
DISCLOSURE
No potential conflict of interest relevant to this article was reported.
Footnotes
Published online May 12, 2014.
- © 2014 by the Society of Nuclear Medicine and Molecular Imaging, Inc.
REFERENCES
- 1.↵
- 2.↵
- 3.↵
- 4.↵
- 5.↵
- 6.↵
- 7.↵
- 8.↵
- 9.↵
- 10.↵
- 11.↵
- 12.↵
- 13.↵
- 14.↵
- 15.↵
- 16.↵
- 17.↵
- 18.↵
- 19.↵
- 20.↵
- 21.↵
- 22.↵
- 23.↵
- 24.↵
- 25.↵
- 26.↵
- 27.↵
- 28.↵
- 29.↵
- 30.↵
- 31.↵
- 32.↵
- 33.↵
- 34.↵
- 35.↵
- 36.↵
- 37.↵
- 38.↵
- 39.↵
- 40.↵
- 41.↵
- 42.↵
- 43.↵
- 44.↵
- 45.↵
- 46.↵
- 47.↵
- 48.↵
- 49.↵
- 50.↵
- 51.↵
- 52.↵
- 53.↵
- 54.↵
- 55.↵
- 56.↵
- 57.↵
- 58.↵
- 59.↵
- 60.↵
- 61.↵
- 62.↵
- 63.↵
- 64.↵
- 65.↵
- 66.↵
- 67.↵
- 68.↵
- 69.↵
- 70.↵
- 71.↵
- 72.↵
- 73.↵
- 74.↵
- 75.↵
- 76.↵
- 77.↵
- 78.↵
- 79.↵
- 80.
- 81.
- 82.
- 83.
- 84.
- 85.
- 86.
- 87.
- Received for publication March 21, 2014.
- Accepted for publication April 24, 2014.