Image super-resolution (SR) is a classic image reconstruction problem in computer vision (CV), which aims at recovering a high-resolution image from a low-resolution image. As a type of supervised generative problem, image SR attracts wide attention due to its strong connection with other CV topics, such as object recognition, object alignment, texture synthesis and so on. Besides, it has extensive applications in real world, for example, medical diagnosis, remote sensing, biometric information identification, etc.
For the state-of-the-art approaches for SR, typically there are two mainstreams: 1) example-based learning methods, and 2) Deep Learning (CNN-based) methods. Example-based methods either exploit external low-high resolution exemplar pairs [1], or learn internal similarity of the same image with different resolution scales [2]. However, features used in example-based methods are usually traditional gradient-related or just handcraft, which may affect model performance. While CNN-based SR methods (e.g. SRCNN [3]) does not really distinguish between feature extraction and decision making. Lots of basic CNN models/blocks are applied to SR problem, e.g. GAN, residual learning, attention network, and provide superior SR results. Nevertheless, the non-explainable process and exhaustive training cost are serious drawbacks of CNN-based methods.
We propose a Successive-Subspace-Learning-based (SSL-based) method to gradually partition data into subspaces by feature statistics. In addition, we utilize spatial-spectral compatible cw-Saab features to express exemplar pairs by taking advantage of reasonable feature extraction [4]. In the future, we aim at providing such a SSL-based explainable method with high efficiency for SR problem.
— By Wei Wang
Reference:
[1] Timofte, Radu, Vincent De Smet, and Luc Van Gool. “A+: Adjusted anchored neighborhood regression for fast super-resolution.” Asian conference on computer vision. Springer, Cham, 2014.
[2] Huang, Jia-Bin, Abhishek Singh, and Narendra Ahuja. “Single image super-resolution from transformed self-exemplars.” Proceedings of the IEEE conference on computer vision and pattern recognition. 2015.
[3] Dong, Chao, et al. “Image super-resolution using deep convolutional networks.” IEEE transactions on pattern analysis and machine intelligence 38.2 (2015): 295-307.
[4] Chen, Yueru, et al. “PixelHop++: A Small Successive-Subspace-Learning-Based (SSL-based) Model for Image Classification.” arXiv preprint arXiv:2002.03141 (2020).
Image credits:
Fig.1: Reference[3]
Fig.2: Reference[2]
