Ray prioritization using stylization and visual saliency

This paper presents a new method to control scene sampling in complex ray-based rendering environments. It proposes to constrain image sampling density with a combination of object features, which are known to be well perceived by the human visual system, and image space saliency, which captures effects that are not based on the object's geometry. The presented method uses Non-Photorealistic Rendering techniques for the object space feature evaluation and combines the image space saliency calculations with image warping to infer quality hints from previously generated frames. In order to map different feature types to sampling densities, we also present an evaluation of the object space and image space features' impact on the resulting image quality. In addition, we present an efficient, adaptively aligned fractal pattern that is used to reconstruct the image from sparse sampling data. Furthermore, this paper presents an algorithm which uses our method in order to guarantee a desired minimal frame rate. Our scheduling algorithm maximizes the utilization of each given time slice by rendering features in the order of visual importance values until a time constraint is reached. We demonstrate how our method can be used to boost or stabilize the rendering time in complex ray-based image generation consisting of geometric as well as volumetric data.

Graphical abstractFigure optionsDownload full-size imageDownload high-quality image (93 K)Download as PowerPoint slideHighlights► We optimize the ratio between the sampling rate and the resulting perceptual image quality. ► A progressively refineable sampling pattern for reconstruction of sparsely sampled regions. ► A method to guarantee frame rates while maximizing the visual quality within the available time. ► An evaluation of different object space lines according to their ability to enhance image quality.