Structure and Texture-Aware Image Decomposition via Training a Neural Network
Structure-texture image decomposition is a fundamental but challenging topic in computational graphics and image processing. In this paper, we introduce a structure-aware and a texture-aware measures to facilitate the structure-texture decomposition (STD) of images. Edge strengths and spatial scales that have been widely-used in previous STD researches cannot describe the structures and textures of images well. The proposed two measures differentiate image textures from image structures based on their distinctive characteristics. Specifically, the first one aims to measure the anisotropy of local gradients, and the second one is designed to measure the repeatability degree of signal patterns in a neighboring region. Since these two measures describe different properties of image structures and textures, they are complementary to each other. The STD is achieved by optimizing an objective function based on the two new measures.
As using traditional optimization methods to solve the optimization problem will require designing different optimizers for different functional spaces, we employ an architecture of deep neural network to optimize the STD cost function in a unified manner. The experimental results demonstrate that, as compared with some state-of-the-art methods, our method can better separate image structure and texture and result in shaper edges in the structural component. Furthermore, to demonstrate the usefulness of the proposed STD method, we have successfully applied it to several applications including detail enhancement, edge detection, and visual quality assessment of super-resolved images.
Objective Function
Network Architecture
Results
Citation
@ARTICLE{8944300,
author={F. {Zhou} and Q. {Chen} and B. {Liu} and G. {Qiu}},
journal={IEEE Transactions on Image Processing},
title={Structure and Texture-Aware Image Decomposition via Training a Neural Network},
year={2019},
volume={},
number={},
pages={1-1},
keywords={Structure-texture decomposition;image layer separation;structure descriptor;texture descriptor},
doi={10.1109/TIP.2019.2961232},
ISSN={1941-0042},
month={},}