We present the results of utilizing aligned anatomical information from CT images to locally adjust image smoothness during the reconstruction of three-dimensional (3D) whole-body positron emission tomography (PET) data. The ability of whole-body PET imaging to detect malignant neoplasms is becoming widely recognized. Potentially useful, however, is the role of whole-body PET in quantitative estimation of tracer uptake. The utility of PET in oncology is often limited by the high level of statistical noise in the images. Reduction in noise can be obtained by incorporating a priori image smoothness information from correlated anatomical information during the reconstruction of PET data. A combined PET/CT scanner allows the acquisition of accurately aligned PET and x-ray CT whole-body data. We use the Fourier rebinning algorithm (FORE) to accurately convert the 3D PET data to two-dimensional (2D) data to accelerate the image reconstruction process. The 2D datasets are reconstructed with successive over-relaxation of a penalized weighted least squares (PWLS) objective function to model the statistics of the acquisition, data corrections, and rebinning. A 3D voxel label model is presented that incorporates the anatomical information via the penalty weights of the PWLS objective function. This combination of FORE + PWLS + labels was developed as it allows for both reconstruction of 3D whole-body data sets in clinically feasible times and also the inclusion of anatomical information in such a way that convergence can be guaranteed. Since mismatches between anatomical (CT) and functional (PET) data are unavoidable in practice, the labels are 'blurred' to reflect the uncertainty associated with the anatomical information. Simulated and experimental results show the potential advantage of incorporating anatomical information by using blurred labels to calculate the penalty weights. We conclude that while the effect of this method on detection tasks is complicated and unclear, there is an improvement on the estimation task.