State of the ‘Art’: A Taxonomy of Artistic Stylization Techniques for Images and Video

Abstract

This paper surveys the field of non-photorealistic rendering (NPR), focusing on techniques for transforming 2D input (images and video) into artistically stylized renderings. We first present a taxonomy of the 2D NPR algorithms developed over the past two decades, structured according to the design characteristics and behavior of each technique. We then describe a chronology of development from the semi-automatic paint systems of the early nineties, through to the automated painterly rendering systems of the late nineties driven by image gradient analysis. Two complementary trends in the NPR literature are then addressed, with reference to our taxonomy. First, the fusion of higher level computer vision and NPR, illustrating the trends toward scene analysis to drive artistic abstraction and diversity of style. Second, the evolution of local processing approaches toward edge-aware filtering for real-time stylization of images and video. The survey then concludes with a discussion of open challenges for 2D NPR identified in recent NPR symposia, including topics such as user and aesthetic evaluation.

DOI,   CSDL,   PDF

Citation

Kyprianidis, J. E., Collomosse, J., Wang, T., & Isenberg, T. (2013). State of the ‘Art’: A Taxonomy of Artistic Stylization Techniques for Images and Video. IEEE Transactions on Visualization and Computer Graphics, vol. 19, no. 5, pp. 866-885.

@ARTICLE{Kyprianidis:2013:TAS,
 author = {Kyprianidis, Jan Eric and Collomosse, John and Wang, Tinghuai and Isenberg, Tobias},
 title  = {State of the ‘Art’: A Taxonomy of Artistic Stylization Techniques for Images and Video},
 journal= {IEEE Transactions on Visualization and Computer Graphics},
 year   = {2013},
 volume = {19},
 number = {5}, 
 pages  = {866--885},
 doi    = {10.1109/TVCG.2012.160}
}

Related

• Collomosse, J., & Kyprianidis, J. E. (2011). Artistic Stylization of Images and Video. Tutorial at Eurographics 2011.