TABLE 1.

Definitions of Quality Scores for Visual Assessment of Segmentation Quality

Quality score	Level	Definition
Completeness of selection	Complete	All visible tumor lesions are selected.
	Missing minor lesions	Missing lesions are < 3 mL and within the selected VOI region (e.g., considered not to influence the Dmax).
	Missing major lesions	Lesions are missing that are either ≥ 3 mL or outside the selected VOI region (e.g., considered to influence the Dmax).
Manual adaptation	No adaptation	No manual adaptation is required. Adding lesions with single mouse clicks is not considered manual adaptation.
	Minor adaptation	Manual adaptation is required to obtain a representative selection of the VOI by removing a maximum of 1 nontumor region.
	Major adaptation	Extensive manual adaptation is required by removing > 1 nontumor region.
Delineation	Representative	Delineation of VOI borders is representative of the visual interpretation of the tumor.
	Underestimation	Delineation of VOI borders is underestimated.
	Overestimation	Delineation of VOI borders is overestimated.