Visibility-Driven Processing of Streaming Volume Data
Abstract
In real-time volume data acquisition, such as 4D ultrasound, the raw data is challenging to visualize directly without additional processing. Noise removal and feature detection are common operations, but many methods are too costly to compute over the whole volume when dealing with live streamed data. In this paper, we propose a visibility-driven processing scheme for handling costly on-the-fly processing of volumetric data in real-time. In contrast to the traditional visualization pipeline, our scheme utilizes a fast computation of the potentially visible subset of voxels which significantly reduces the amount of data required to process. As filtering operations modify the data values which may affect their visibility, our method for visibility-mask generation ensures that the set of elements deemed visible does not change after processing. Our approach also exploits the visibility information for the storage of intermediate values when multiple operations are performed in sequence, and can therefore significantly reduce the memory overhead of longer filter pipelines. We provide a thorough technical evaluation of the approach and demonstrate it on several typical scenarios where on-the-fly processing is required.
V. Šoltészová, AA, I. Viola, and S. Bruckner, "Visibility-Driven Processing of Streaming Volume Data," in Proceedings of VCBM 2014, 2014, p. 127–136. doi:10.2312/vcbm.20141198
[BibTeX]
In real-time volume data acquisition, such as 4D ultrasound, the raw data is challenging to visualize directly without additional processing. Noise removal and feature detection are common operations, but many methods are too costly to compute over the whole volume when dealing with live streamed data. In this paper, we propose a visibility-driven processing scheme for handling costly on-the-fly processing of volumetric data in real-time. In contrast to the traditional visualization pipeline, our scheme utilizes a fast computation of the potentially visible subset of voxels which significantly reduces the amount of data required to process. As filtering operations modify the data values which may affect their visibility, our method for visibility-mask generation ensures that the set of elements deemed visible does not change after processing. Our approach also exploits the visibility information for the storage of intermediate values when multiple operations are performed in sequence, and can therefore significantly reduce the memory overhead of longer filter pipelines. We provide a thorough technical evaluation of the approach and demonstrate it on several typical scenarios where on-the-fly processing is required.
@INPROCEEDINGS {Solteszova-2014-VPS,
author = "Veronika \v{S}olt{\'e}szov{\'a} and {\AA}smund Birkeland and Ivan Viola and Stefan Bruckner",
title = "Visibility-Driven Processing of Streaming Volume Data",
booktitle = "Proceedings of VCBM 2014",
year = "2014",
pages = "127--136",
month = "sep",
abstract = "In real-time volume data acquisition, such as 4D ultrasound, the raw data is challenging to visualize directly without additional processing. Noise removal and feature detection are common operations, but many methods are too costly to compute over the whole volume when dealing with live streamed data. In this paper, we propose a visibility-driven processing scheme for handling costly on-the-fly processing of volumetric data in real-time. In contrast to the traditional visualization pipeline, our scheme utilizes a fast computation of the potentially visible subset of voxels which significantly reduces the amount of data required to process. As filtering operations modify the data values which may affect their visibility, our method for visibility-mask generation ensures that the set of elements deemed visible does not change after processing. Our approach also exploits the visibility information for the storage of intermediate values when multiple operations are performed in sequence, and can therefore significantly reduce the memory overhead of longer filter pipelines. We provide a thorough technical evaluation of the approach and demonstrate it on several typical scenarios where on-the-fly processing is required.",
pdf = "pdfs/Solteszova-2014-VPS.pdf",
images = "images/Solteszova-2014-VPS.jpg",
thumbnails = "images/Solteszova-2014-VPS.png",
youtube = "https://www.youtube.com/watch?v=WJgc6BX1qig",
note = "VCBM 2014 Best Paper Award",
doi = "10.2312/vcbm.20141198",
event = "VCBM 2014",
keywords = "ultrasound, visibility-driven processing, filtering",
location = "Vienna, Austria"
}