Selective Video Enhancement in the Laguerre-Gauss Domain

Abstract:

Traditional image and video enhancement techniques do not consider the subjective preferences of the user, who might be interested in modifying or highlighting specific elements of a scene. In fact, most image or video post-processing techniques are applied to the entire image or frame.
In this work, a framework for selective video enhancement is presented. It is based on an adaptive multi-resolution edge enhancement technique performed in the Laguerre-Gauss complex wavelet domain. In the proposed scheme, edges are selectively enhanced or attenuated according to the inputs of the user, taking into account the characteristics of the content, the response of the human visual system, and the masking effects induced by textured background. Two scenarios have been implemented and tested: i) an interactive video editing system, where the user selects the objects to enhance through a graphical interface and the system automatically propagates the selection through the following video frames belonging to the same shot, ii) a perceptually-driven technique to improve the quality of RGB plus Depth videos, which uses depth maps as additional features to guide the enhancement.

Source code

The source code for the enhancement method implemented in the Laguerre-Gauss domain can be found at: https://github.com/michelebrizzi/enhancement_LG

Citation

If you use our work in your research, please consider citing as below:

Results

Images from the MIT-Adobe FiveK dataset [1]:

References

[1] Bychkovsky, V., Paris, S., Chan, E., Durand, F., “Learning photographic global tonal adjustment with a database of input / output image pairs,” 2011 IEEE Conference on Computer Vision and Pattern Recognition, 2011, pp. 97-104.