|
|
|||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Clinical Investigation |
1 Office of the Dean and Department of Radiology, Weill Cornell Medical College and Methodist Hospital, Houston, Texas; 2 Department of Critical Care, Section of Respiratory Medicine, University of Florence, Florence, Italy; 3 Department of Radiology, Michigan State University, East Lansing, Michigan; and 4 Department of Research, St. Joseph Mercy Oakland Hospital, Pontiac, Michigan, and Department of Medicine, Wayne State University, Detroit, Michigan
Correspondence: For correspondence or reprints contact: H. Dirk Sostman, Methodist Hospital, 6565 Fannin St., Houston, TX 77030. E-mail: dsostman{at}tmhs.org
| ABSTRACT |
|---|
|
|
|---|
Key Words: respiratory vascular PIOPED II perfusion scintigraphy pulmonary embolism
| INTRODUCTION |
|---|
|
|
|---|
The decline of V/Q use is due primarily to a high frequency of nondiagnostic readings. However, V/Q is definitive in some circumstances. A normal perfusion scan excludes PE with a negative predictive value close to 100% (4,5), and in patients with no history of prior PE, a high-probability scan has a positive predictive value greater than 90% (6). The V/Q scan has proven value, but the challenge is to increase its value by increasing the proportion of definitive results or by reducing its complexity, cost, and radiation dose.
Research on V/Q scintigraphy after the PIOPED I trial suggested that accuracy could be improved (7,8) by refining diagnostic criteria and reducing the number of diagnostic categories (in particular, by combining "intermediate" and "low probability" into a "nondiagnostic" category). The sensitivity and specificity of such an approach was recently reported to be 78% and 98% (9), after excluding nondiagnostic readings that occurred in 27% of patients. Preliminary data suggested that the ventilation scan can be omitted without affecting diagnostic accuracy (10,11). It is reasonable to suppose that this may be particularly true in patients with normal findings on chest radiography (12). Finally, the Prospective Investigative Study of Pulmonary Embolism Diagnosis (PISAPED) trial suggested a new set of diagnostic criteria to diagnose or exclude PE using the perfusion scan and chest radiograph (13) with promising accuracy and few nondiagnostic readings. If corroborated, such developments could increase the value of scintigraphy by increasing accuracy and technical simplicity while reducing cost and risk.
These considerations prompted us to evaluate further the diagnostic accuracy of perfusion scintigraphy combined with chest radiography. We report the results of reading PIOPED II perfusion scans and chest radiographs using both modified PIOPED II and PISAPED criteria to assess the accuracy of this modality for acute PE.
| MATERIALS AND METHODS |
|---|
|
|
|---|
Readers and Criteria
Four experienced readers of pulmonary scintigrams independently interpreted the perfusion scans and chest radiographs. The readers had no clinical information and were not aware of the PIOPED II CTA or study classification results for any of the patients.
Two readers interpreted the perfusion scans according to the PIOPED II criteria, modified for the absence of the ventilation images (Table 1). Scan findings classified by the modified PIOPED II criteria were reported as "PE present" (high probability), "PE absent" (very low probability or normal), or "nondiagnostic" (intermediate or low probability). Two other readers interpreted the same scans according to the PISAPED criteria (Table 1) as "PE present," "PE absent," or "nondiagnostic."
|
In examining the chest radiographs, the PISAPED readers considered the size and shape of the heart and hilar arteries, position of the diaphragm, presence or absence of pulmonary parenchymal abnormalities (consolidation, atelectasis, oligemia, edema), and pleural effusion. For the hilar arteries, attention was paid to the presence of abrupt vascular amputation that gives the hilum a "plump" appearance (15). Pulmonary consolidations were considered suggestive of infarction if they had a semicircular or half-spindle shape and were arranged peripherally along the pleural surface (15). Oligemia was considered to be present if, in a given lung region, the pulmonary vasculature was greatly diminished with or without concomitant hyperlucency of the lung parenchyma (15). Chest radiographs were rated as abnormal if one or more of the following were present: enlargement of the heart or hilar vessels; elevated diaphragm (unilateral or bilateral); pleural effusion (including intrafissural liquid); increased lung density (focal or diffuse); pulmonary edema; oligemia with or without pleonemia in the contralateral lung; consolidation suggestive of infarction; emphysema; or fibrothorax.
If the quality of the images was poor, the chest radiographs were rated as "nondiagnostic" by both groups of readers according to the reader's subjective impression of whether the images were evaluable for the purposes of the study.
Data Recording
Each reader completed an electronic form directly on a personal computer, recording the reader's identity, the patient's identification code, the chest radiography category, the scan category, and comments.
Data Analysis
The primary analysis compared the present study perfusion scan results with the PIOPED II V/Q scan results (9). We computed the sensitivity and specificity of the perfusion scan using the same diagnostic reference standard adopted in a recent analysis of the sensitivity and specificity of the V/Q scan (9). The reference standard was the PIOPED II DSA result, if available. If DSA was not done or was not definitive, the reference standard was the PIOPED II CTA results that were concordant with the Wells' score (16) (i.e., CTA positive and Wells' score > 2, or CTA negative and Wells' score < 6), which (in a comparable sample in PIOPED II) resulted in positive and negative predictive values of 93% (14). Patients with discordance between CTA and Wells' score were excluded from the analysis. Sensitivity, specificity, and confidence intervals (CIs) were computed with an online calculator (http://www.causascientia.org/math_stat/ProportionCI.html) for each reader and also for pooled modified PIOPED II and PISAPED readings. We excluded "nondiagnostic" scintigram readings from the computation of sensitivity and specificity (17), as was done for computing CTA sensitivity and specificity in PIOPED II and for a recent analysis of V/Q scan accuracy (9,14). We computed interobserver variability for modified PIOPED II and PISAPED scan readings using the
-statistic (18).
We performed 2 prespecified subgroup analyses. We compared the sensitivity and specificity of perfusion scan readings in patients who had normal or nearly normal chest radiography findings with the sensitivity and specificity of perfusion scan readings in patients with abnormal or nondiagnostic chest radiographs and in patients younger than or older than 50 y of age.
Finally, we compared the concordance of perfusion scan readings with the PIOPED II CTA consensus central reading. We used the
-statistic as an index of concordance between CTA and perfusion scan results.
| RESULTS |
|---|
|
|
|---|
|
Table 2 delineates the sensitivity and specificity for each reader, as well as the proportion of nondiagnostic readings. The modified PIOPED II readings and PISAPED readings showed no statistically significant difference in sensitivity and specificity. The modified PIOPED II readings had significantly more nondiagnostic readings (20.6%) than did the PISAPED readings (0%). Interobserver agreement was moderate between the 2 PIOPED readers (
= 0.537) and almost perfect between the 2 PISAPED readers (
= 0.903). A summary comparison of the perfusion scan readings with the PIOPED II V/Q scan readings is shown in Table 3. The results of both the modified PIOPED II and the PISAPED perfusion scan readings were similar to the PIOPED II V/Q scan results that were reported previously (9). Table 4 shows the predictive values for modified PIOPED II and PISAPED readings and compares them with the PIOPED II data for CTA (14).
|
|
|
In the subgroup analysis of patients under 50 y old and patients 50 y old or older, we did not find a strong or consistent trend in perfusion scan accuracy as a function of age. The results are shown in Table 5. The PIOPED readers, but not the PISAPED readers, categorized scans as "nondiagnostic" more frequently in patients aged 50 y or older than in patients younger than 50 y (25.9% vs. 14.7% nondiagnostic).
|
-statistic of agreement between CTA and perfusion scanning was 0.693 and 0.799 for the 2 PIOPED readings and 0.765 and 0.774 for the 2 PISAPED readings, indicating "substantial" agreement (18). | DISCUSSION |
|---|
|
|
|---|
However, V/Q use has declined, compared with CTA, primarily because of a high frequency of nondiagnostic readings. In PIOPED I (32% outpatients), V/Q scans gave a definitive diagnosis in only 28% of patients (6). More recently, in a mixed population of inpatients and outpatients, 46% had a definitive diagnosis by V/Q scanning (27). However, V/Q has long been accepted as definitive in some circumstances. A normal perfusion scan excludes PE with a negative predictive value close to 100% (4,5), whereas a high-probability scan has a positive predictive value of 88% and, in patients without a history of prior PE, 91% (6). Accordingly, the V/Q scan has proven value, but the challenge is to increase its value by increasing the proportion of definitive results or by reducing the cost, radiation dose, and time required for testing by eliminating the ventilation scan.
Research on scintigraphy since the PIOPED I trial has suggested that the accuracy of interpretation could be improved (7,8) by refining diagnostic criteria and reducing the number of diagnostic categories. A very-low-probability interpretation of the V/Q scan was found to be as reliable as CTA in excluding PE when the Wells' clinical prediction rule indicated either a low or a moderate probability of PE (8). Retrospective analysis of data from PIOPED II (75% outpatients) showed a definitive V/Q scan result in 74% of patients, with sensitivity of 78% and specificity of 98%, after exclusion of the nondiagnostic scans (9). In some populations, scintigraphy may result in over 90% of definitive diagnoses (28). Finally, a recent randomized trial showed equivalent outcomes for patients evaluated with a clinical prediction rule who were randomized to either CTA or V/Q scintigraphy, although more cases of PE were detected by CTA (27). Accordingly, although an enormous amount of past investigation has been done regarding scintigraphy, further improvements in its clinical value appear to be achievable and important.
A noteworthy change since the PIOPED I trial has been reduction in "nondiagnostic" readings; PIOPED I had 76.6% nondiagnostic scans (32.6% low-probability and 44.0% intermediate-probability), whereas PIOPED II had only 26.5% (9.8% low-probability and 16.7% intermediate-probability). Elimination of the ventilation scan reduces both cost and radiation exposure (21). The ventilation scan can be eliminated in many patients without reducing diagnostic accuracy (4,5,11,13). However, a more systematic and complete evaluation of the perfusion scan–only approach was needed to assess sensitivity and specificity rigorously and to evaluate whether eliminating the ventilation scan affects the proportion of "nondiagnostic" readings. Our data show that in the PIOPED II population, eliminating the ventilation scan does not reduce overall accuracy. If outcome studies confirm the safety of this approach, perfusion scintigraphy could be highly beneficial for patients in whom CTA may not be preferred. The highest priority for outcome analysis of perfusion-only scintigraphy should be in young women, since the risks of radiation are higher in women (2,24) and in younger individuals (2,24). Of course, in clinical practice it is universally accepted that all patients should be spared needless exposure to radiation and financial cost, irrespective of age and sex.
The main goal of the present study was to evaluate the sensitivity, specificity, and rate of nondiagnostic perfusion scans read with chest radiographs. We wished to determine whether it is possible to increase the value of scintigraphy by, first, providing definite interpretations with reasonable accuracy and, second, eliminating routine use of the ventilation scan to reduce the cost, complexity, and radiation dose of scintigraphy. In addition, we wished to evaluate different criteria for interpreting perfusion scans and the accuracy of perfusion scans in patients with normal or abnormal chest radiography findings and in younger or older patients.
The PIOPED II composite reference standard was not used in this study, because the V/Q scan was often a definitive or influential component of it and, thus, incorporation bias would have been present. We chose to use the DSA result when available, since DSA is the most widely accepted imaging reference standard. If no DSA result was available, we used the CTA result if it was concordant with the Wells' score. The V/Q scan had some influence on selection of patients to undergo DSA in PIOPED II and thus affected the spectrum of patients who had a diagnosis by DSA, but the PIOPED II DSA readings were independent of other imaging or clinical information. The CTA readings and Wells' score determinations also were independent observations. We chose to use only those CTA results that were concordant with the Wells' scores, since the PIOPED II study showed that CTA–Wells' concordance was associated with high positive and negative predictive values (14).
In a separate analysis, we also evaluated the concordance between the perfusion scan findings and CTA diagnoses, since one of the clinical issues is whether perfusion scanning can be substituted for CTA. The high concordance indicated that this is the case, consistent with the results from a recent outcome study of V/Q scans and CTA (27).
The results of the PISAPED and modified PIOPED II readings have both similarities to and differences from CTA and each other. When modified PIOPED II criteria were used, there were more nondiagnostic results with perfusion scans (20.6% of patients) than there were with CTA in PIOPED II (6.2% of patients). Further, virtually all nondiagnostic CTA results were due to technically inadequate scans (28), whereas the nondiagnostic perfusion scan results were primarily due to inconclusive interpretations. Once nondiagnostic studies were removed from the study sample, the sensitivity and specificity of perfusion scans read using the modified PIOPED II criteria (85% and 93%, pooled data from the 2 readings) were similar to those reported in PIOPED II for CTA (83% and 96%). When the PISAPED criteria were used, there were fewer nondiagnostic results with perfusion scans (0% of patients) than there were with CTA in PIOPED II (6.2% of patients), yet sensitivity and specificity were still similar to CTA (80% and 97%, pooled data from the 2 readings). The PISAPED readers also had higher interobserver agreement than the PIOPED readers, possibly because of the use of the "nondiagnostic" category in the modified PIOPED II readings, or the fact that the 2 PISAPED readers worked together daily in the same institution, or the greater simplicity of the PISAPED criteria. An additional factor influencing the results may be the level of experience of the PIOPED readers with perfusion-only images; one PIOPED reader had been an interpreter in the PISAPED study (13) and thus had more experience using scintigraphy without ventilation images than did the other PIOPED reader, who had no prior experience.
As in PIOPED I (12), the data did not indicate a consistent relationship between normal findings on chest radiographs and more accurate perfusion scans. The accuracy of the modified PIOPED II readings was slightly higher when the chest radiography findings were normal or nearly normal; however, the proportion of nondiagnostic scans was much lower for normal chest radiography findings than when the findings were abnormal. Accordingly, if one uses the modified PIOPED II criteria, the perfusion scan could be expected to be more clinically useful in patients with normal or near-normal chest radiography findings. With the PISAPED readings, there was no difference in accuracy between the normal and abnormal subgroups. Comparison between the modified PIOPED II and PISAPED results for chest radiograph subgroups is confounded by the differences in criteria for normal and abnormal chest radiography findings. It may well be that the chest radiography interpretation has a significant effect on perfusion scan accuracy. The modified PIOPED II chest radiograph classification was quite simple and was primarily used as a ventilation scan surrogate, whereas the PISAPED chest radiograph classification was more sophisticated and likely to introduce additional useful diagnostic information. However, harvesting such information likely requires skill and experience with chest radiography interpretation at a level that many readers may not possess. In addition, the data do not indicate a clear relationship between younger age and more accurate perfusion scans. The PIOPED readers, but not the PISAPED readers, more frequently rated the scans of patients aged 50 y or older as "nondiagnostic"; hence, the trends for modified PIOPED II and PISAPED readings were inconsistent. Accordingly, young age and normal chest radiography findings can predict that the perfusion scan will give more clinically useful results with the modified PIOPED II criteria, because of fewer nondiagnostic readings, but accuracy did not vary with age or chest radiography findings, and the nondiagnostic rate of the PISAPED readings did not vary.
Our study has limitations. That DSA was not done on all patients is a limitation, albeit one that all future studies of PE will share because of the vanishing use of invasive pulmonary angiography in clinical practice. The use of concordant CTA and Wells' score as an alternate diagnostic reference standard has not been prospectively validated in an independent study. However, in the PIOPED II study (14), the concordant CTA and Wells' score had positive and negative predictive values of 93% (predictive value is the relevant statistic when one is considering a reference standard test in a population with comparable composition). It has even been suggested that CTA may be a better reference standard than DSA (29). Furthermore in the PISAPED study (13), perfusion scans were compared with an angiographic reference standard in all patients, and the sensitivity and specificity were comparable to those determined in the present study.
Another limitation relates to imaging technique. First, the V/Q scans in PIOPED II often used aerosols to image ventilation, and in several cases activity from the ventilation images was present on the perfusion scans, potentially confounding the interpretation (either by obscuring perfusion defects or, alternatively, by providing some information about regional ventilation). Second, regardless of the use of ventilation images, the PIOPED II scintigrams were planar, and (in principle) better results might be obtained with tomographic perfusion imaging. Finally, the majority of the PIOPED II patients were outpatients, in contrast to the population of the PIOPED I study; thus, we cannot be sure our results would apply to a more severely ill population of inpatients. However, the PISAPED study (13) did have a majority of inpatients, with a 39% prevalence of PE, and the PISAPED study also included rereading by a single interpreter of 723 perfusion scans from the PIOPED I study, with a perfusion scan sensitivity of 80% and specificity of 83% (13). Accordingly, we would not anticipate substantial degradation of diagnostic results in a more severely ill population. Of course, the prevalence of PE in the population will affect the predictive values of the scan for any given sensitivity and specificity.
Our study has implications regarding the role of scintigraphy in patients with suspected acute PE. The advantages of CTA—rapid and widely available examinations, the ability to perform lower-extremity venous imaging concurrently if needed, the high proportion of definitive diagnostic results, and the ability of CT to provide additional diagnostic information (30,31) that may be of clinical importance—secure a place for CTA as a first-line diagnostic imaging modality in appropriately selected patients. However, the advantages of perfusion scintigraphy—lower cost, much lower radiation dose, avoidance of iodinated contrast material, and technical simplicity—can now be considered together with a contemporary characterization of the diagnostic accuracy of the test in a predominantly outpatient population. Increased use of scintigraphy appears warranted in centers that recently have relegated it to a minor supporting role (32).
As to whether the results of this study support the current clinical use of the PISAPED criteria rather than the modified PIOPED criteria, our data do not suffice to resolve this issue definitively. With the readers in this study, PISAPED had comparable sensitivity and specificity to the modified PIOPED II while greatly reducing the number of nondiagnostic scans. However, it remains to be shown that readers without extensive experience using the PISAPED methodology could achieve these results. Clinical care should be guided by local expertise and results.
| CONCLUSION |
|---|
|
|
|---|
| ACKNOWLEDGMENTS |
|---|
| FOOTNOTES |
|---|
| References |
|---|
|
|
|---|
Related articles in JNM:
This article has been cited by other articles:
![]() |
P. D. Stein, L. M. Freeman, H. D. Sostman, L. R. Goodman, P. K. Woodard, D. P. Naidich, A. Gottschalk, D. L. Bailey, F. Matta, A. Y. Yaekoub, et al. SPECT in Acute Pulmonary Embolism J. Nucl. Med., December 1, 2009; 50(12): 1999 - 2007. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. A. Parker Improving Lung Scintigraphy J. Nucl. Med., December 1, 2009; 50(12): 1919 - 1920. [Full Text] [PDF] |
||||
![]() |
P. Reinartz To PIOPED, or Not to PIOPED J. Nucl. Med., November 1, 2008; 49(11): 1739 - 1740. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | RSS | TABLE OF CONTENTS |
| JOURNAL OF NUCLEAR MEDICINE TECHNOLOGY | THE JOURNAL OF NUCLEAR MEDICINE |