Your browser does not support the NLM PubReader view.
Go to this page to see a list of supporting browsers.

A Method of Coupling Expected Patch Log Likelihood and Guided Filtering for Image De-noising

Shunfeng Wang* , Jiacen Xie* , Yuhui Zheng** , Jin Wang*** and Tao Jiang*

Article Information

Corresponding Author: Shunfeng Wang* (wsfnuist@126.com)

Shunfeng Wang*, College of Math and Statistics, Nanjing University of Information Science and Technology, Nanjing, China, wsfnuist@126.com

Jiacen Xie*, College of Math and Statistics, Nanjing University of Information Science and Technology, Nanjing, China, xjc_nuist@163.com

Yuhui Zheng**, Jiangsu Engineering Center of Network Monitoring, College of Computer and Software, Nanjing University of Information Science andTechnology, Nanjing, China, nuistjt@163.com

Jin Wang***, School of Computer Communication Engineering, Changsha University of Science Technology, Changsha 410004, China, zhengyh@vip.126.com

Tao Jiang*, College of Math and Statistics, Nanjing University of Information Science and Technology, Nanjing, China, jinwang@csust.edu.cn

Received: January 3 2018

Revision received: March 20 2018

Accepted: April 5 2018

Published (Print): April 30 2018

Published (Electronic): April 30 2018

Abstract

Abstract: With the advent of the information society, image restoration technology has aroused considerable interest. Guided image filtering is more effective in suppressing noise in homogeneous regions, but its edge-preserving property is poor. As such, the critical part of guided filtering lies in the selection of the guided image. The result of the Expected Patch Log Likelihood (EPLL) method maintains a good structure, but it is easy to produce the ladder effect in homogeneous areas. According to the complementarity of EPLL with guided filtering, we propose a method of coupling EPLL and guided filtering for image de-noising. The EPLL model is adopted to construct the guided image for the guided filtering, which can provide better structural information for the guided filtering. Meanwhile, with the secondary smoothing of guided image filtering in image homogenization areas, we can improve the noise suppression effect in those areas while reducing the ladder effect brought about by the EPLL. The experimental results show that it not only retains the excellent performance of EPLL, but also produces better visual effects and a higher peak signal-to-noise ratio by adopting the proposed method.

Keywords: Edge Preserving , Expected Patch Log Likelihood , Image De-noising , Guided Filtering

1. Introduction

The image is the most direct form by which humans perceive the world, and it has been widely applied in various fields. However, images are unavoidably polluted by noise in the process of acquisition and transmission. Therefore, image de-noising plays an indispensable role in our daily life.

In order to remove the noise from images effectively, numerous image de-noising approaches have been presented, such as the traditional Bayes method [1-4] and various regularization methods. Among these, total variation (TV) regularization [5], as a representative regularization de-noising method, has attracted considerable attention because of its low computational complexity and well-understood mathematical behavior. Since the introduction of TV regularization in the context of image processing, many researchers have recently presented various mature algorithms and extended the applications of TV functional [6-12].

With the observation that similar image patches are ubiquitous in the whole image, a non-local type of average filtering has been proposed [13-15]. Since then, a self-similarity-based non-local method has been widely studied for image regularization [16]. Protter et al. [17] proposed a non-local total variational regularization model.Gao et al. [18] used the Zernike moment to identify the similarity between image patches. A better image restoration effect can be obtained by using these methods.

Other de-noising methods based on non-local information include K-SVD [19] and BM3D [20,21] among others. Beyond that, classical filters like Wiener filtering [22,23] and Kalman filtering [24] have been used till now. The principle of Wiener filtering is to transform the problem into the minimizing of the mean square error between the original and estimated values.

The Expected Patch Log Likelihood (EPLL) image restoration techniques proposed by Zoran and Weiss [25], who utilized a mixture model to learn image patch prior, have attracted a lot of attention. As one of the most popular methods in the field of non-local information de-noising, it is characterized by a higher peak signal-to-noise ratio (PSNR) and a better visual effect. Many scholars have been keen to improve it [26-30], but there is still great potential for improvement in terms of the quality of denoising. For example, when the noise level is high, the de-noising results of EPLL tend to exhibit the ladder effect in the smooth regions.

Guided image filtering [31] can establish the filter kernel explicitly, and its guided image can be the input image or the related of input, while the output image is a local linear transformation of the guided image. When using guided filtering to de-noise an image, we usually use the input image as the guided image to smooth and de-noise the image. But in the process of an experiment, it is found that when the noise level is low, guided filtering can remove the noise and keep the edge well. With the increase of noise, such details as the edge and texture of the image are polluted by noise, which has a great impact on the de-noising results rather than providing effective guidance information, when using this filtering.

In summary, we consider that guided image filtering has a better noise suppression effect in homogeneous regions, whereas its edge-preserving property is poor. The key to guided filtering is the selection of the guided image. The result of EPLL de-noising helps achieve a good structure, but it is easy to cause the ladder effect in homogeneous areas. For this reason, we propose a method of coupling the EPLL and guided filtering for image de-noising that incorporates these two methods, which complement and promote each other, thus enhancing the effect of image de-noising.

The remainder of this paper is organized as follows. Section 2 presents a brief summary of the basic theory of the EPLL model and guided filtering; Section 3 elaborates upon the details of how to integrate the EPLL with guided filtering and analyze the benefits of such a process; Section 4 presents the experimental results of image de-noising as supporting evidence for the effectiveness of the proposed method; and Section 5 presents some conclusions about the method of coupling EPLL and guided filtering for image de-noising, as well as directions for future studies.

2. Guided Image Filtering and Expected Patch Log Likelihood

2.1 Guided Image Filtering

The guided filter supposes that the output image q has a local linear relationship with the guided image I[31]. That is, in the window ωk centered on the pixel k, q is satisfied with a linear transformation associated with I:

(1)
[TeX:] $$q _ { i } = a _ { k } I _ { i } + b _ { k } , \forall i \in \omega _ { k }$$

where (ak,bk) is the linear constant coefficient in the square window ωk, the radius of ωk is r. In order to determine the linear coefficient (ak,bk) , the following cost functions are introduced in [3]:

(2)
[TeX:] $$\left( a _ { k } , b _ { k } \right) = \sum _ { i \in \omega _ { k } } \left( \left( a _ { k } I _ { i } + b _ { k } - p _ { i } \right) ^ { 2 } + \varepsilon a _ { k } ^ { 2 } \right)$$

where ε is a regularization parameter, [TeX:] $$q _ { i } = p _ { i } - n _ { i } ; p _ { i }$$ is the pixel of the input image, and ni is the noise of this pixel. (ak,bk) can be obtained by minimizing Eq. (2):

(3)
[TeX:] $$a _ { k } = \frac { \frac { 1 } { | \omega | } \sum _ { i \in \omega _ { k } } I _ { i } p _ { i } - \mu _ { k } \overline { p } _ { k } } { \sigma _ { k } ^ { 2 } + \varepsilon }$$

(4)
[TeX:] $$b _ { k } = \overline { p } _ { k } - a _ { k } \mu _ { k }$$

where [TeX:] $$\mu _ { k } \text { and } \sigma _ { k } ^ { 2 }$$ represent the mean and variance of the guided image I in the window ωk respectively; |ω| is the number of pixels in the window ωk, and pk is the mean of the input image p in the window ωk.

The output value qi of the pixel i is related to all the windows containing the pixel i. Therefore, in order to obtain a stable qi, we need to average it. So the final output image qi is:

(5)
[TeX:] $$q _ { i } = \overline { a } _ { i } I _ { i } + \overline { b } _ { i } = \frac { 1 } { | \omega | } \sum _ { k \in \omega _ { i } } \left( a _ { k } I _ { i } + b _ { k } \right) , \forall i \in I$$

2.2 Expected Patch Log Likelihood

EPLL is a method of restoring an image by using the statistical information of the external image patch. The basic idea is to maximize the likelihood probability of the image patch, and make the restored image patch close to the prior. For a degraded image X and a known prior knowledge, EPLL is defined as:

(6)
[TeX:] $$E P L L _ { P } ( X ) = \sum _ { i } \log p \left( P _ { i } X \right)$$

where Pi is an operator to extract image patch on the i the pixel, then PiX is the extracted patch. logp(PiX) indicates the logarithmic value of the likelihood probability of the i th patch under a given prior distribution.

For a given degraded image Y, the cost function i:

(7)
[TeX:] $$f _ { p } ( X | Y ) = \frac { \lambda } { 2 } \| A X - Y \| ^ { 2 } - E P L L _ { p } ( X )$$

where A is a degenerate matrix and λ is the regularization parameter. The “Half Quadratic Splitting” [25] method can be used to optimize Eq. (7). A set of auxiliary variables {zi} is introduced to be equal to PiX, yielding the following cost function:

(8)
[TeX:] $$f _ { p , \beta } \left( X , \left\{ z _ { i } \right\} | Y \right) = \frac { \lambda } { 2 } \| A X - Y \| ^ { 2 } + \sum _ { i } \frac { \beta } { 2 } \left( \left\| P _ { i } X - z _ { i } \right\| ^ { 2 } - \log p \left( z _ { i } \right) \right)$$

As β tends to infinity, we obtain that {zi} will be equal to PiX and the solutions to Eq. (8) and Eq. (7) converge.

We know that many popular image priors can be regarded as a special case of Gaussian Mixture Model (GMM). The GMM can also be used in EPLL, and the non-Gaussian distribution is represented by the combination of several single Gaussian distributions.

Thus, the log likelihood of a given patch PiX is:

(9)
[TeX:] $$\log p \left( P _ { i } X \right) = \log \left( \sum _ { k = 1 } ^ { K } \pi _ { k } N \left( P _ { i } X | \mu _ { k } , \Sigma _ { k } \right) \right)$$

where K is the number of mixture components, πk is the mixing weight for each mixture component, and μk and Σk are the corresponding mean and covariance matrix.

To solve Eq. (6), we choose the most likely Gaussian mixing weight kmax for each patch PiX, and then Eq. (6) is minimized by alternatively updating zi and X:

(10)
[TeX:] $$z _ { i } ^ { n + 1 } = \left( \Sigma _ { k _ { \max } } + \frac { 1 } { \beta } I \right) ^ { - 1 } \left( P _ { i } X ^ { n } \Sigma _ { k _ { \max } } + \frac { 1 } { \beta } I \mu _ { k _ { \max } } \right)$$

(11)
[TeX:] $$X ^ { n + 1 } = \left( \lambda A ^ { T } A + \beta \sum _ { j } P _ { j } ^ { T } P _ { j } \right) ^ { - 1 } \left( \lambda A ^ { T } y + \beta \sum _ { j } P _ { j } ^ { T } z _ { j } ^ { n + 1 } \right)$$

where μkmax and Σkmax are the corresponding mean and covariance matrix with the mixing weight kmax, and I is an identity matrix.

3. Proposed Method with the Combination of EPLL and Guided Filtering

Guided image filtering has two advantages: it has good edge-preserving properties, so it will not cause a “gradient reversal”, and it can also be used for other purposes than smoothing. Moreover, with the help of the guiding image, the output image is more structured. The image obtained by EPLL has a better structure and can provide better auxiliary information for the guided filter. Based on the advantages of the two models, this study proposes a method of coupling the expected patch log likelihood and guided filtering for image de-noising, with the aim of improving the de-noising performance. The algorithm implementation steps (Table 1) are as follows:

This method is mainly used to eliminate Gaussian additive noise. It has a very good smoothing effect while maintaining the edge information effectively, which may be attributable to the fact that it performs the second smoothing filtering for homogeneous regions on the basis of EPLL. When the guided image is fixed, the filtering results mainly depend on the coefficients (ak,bk).

Table 1.
Algorithm implementation steps

In the iteration process, the input image is the same as the guided image, and Eqs. (3) and (4) can be simplified as:

(12)
[TeX:] $$a _ { k } = \frac { \sigma _ { k } ^ { 2 } } { \sigma _ { k } ^ { 2 } + \varepsilon }$$

(13)
[TeX:] $$b _ { k } = \left( 1 - a _ { k } \right) \mu _ { k }$$

The parameter ε determines whether a pixel is in a boundary region (Table 2).

Table 2.
Performance of algorithms in different regions

It can been seen from the above analysis that the edge-preserving effect of the guided filter depends on the guided image, while the EPLL model can present a better guiding image for guided filtering. In contrast, the second smoothing of flat regions obtained by the guided filtering can improve the noise suppression effect of the EPLL and avoid the ladder effect. These two methods complement and reinforce each other perfectly. The next sections prove the validity of the proposed method via experiments.

4. Experimental Results

In this section, we discuss the performance of the proposed method. In this study’s experiments, the GMM with 200 mixture components was learned from a set of 2 × 106 images patches, which were sampled from the Berkeley Segmentation Database Benchmark (BSDS300). In order to verify the effectiveness of the proposed method, it was compared with guided filtering and EPLL in terms of visual effects and numerical results. To the images used in this study’s experiments were added Gaussian noise with zero mean and standard variance, σ = 15 or σ = 30. The parameters for EPLL in the experiments were as follows: image patch size √L = 8, regularization parameter λ = L/σ2, and penalty parameter β = 1⁄σ2 ∗ [1 2 4 8 16]. Meanwhile, the parameters of guided filtering were as follows: radius r = 2, and regularization parameter ε = 0.022. The results are as follows:

Fig. 1 displays the de-noised results of the three methods on Couple image with dimensions of 512×512. Here, Fig. 1(a) is the original clean image; Fig. 1(b) is the noisy image generated by adding Gaussian white noise with zero mean and standard variance σ = 30 to the original image; Fig. 1(c) shows the result of the guider filtering, but the edges, details, and other information have not been preserved well; Fig. 1(d) shows the de-noising results of the EPLL model, where it can be seen that mottling occurs in certain areas; and Fig. 1(e) shows the de-noising result of the proposed method. This shows a better visual effect at the boundary of the wall. The boundary is preserved and the transition is more natural in the smooth region. As shown in Fig. 2, the local enlargement of the results of the three algorithms confirms the above analysis. Figs. 3 and 4 show the same result. The proposed method makes the restoration result smoother and preserves more details. Thus, it is reasonable to conclude that the proposed method is superior to EPLL in terms of numerical results, as shown in Table 3.

Fig. 1.
Image de-noising performance comparison on Couple image and σ = 30: (a) original image, (b) noisy image, (c) guider filtering, (d) EPLL, and (e) proposed method.
Fig. 2.
Enlargement of local Boat image: (a) original image, (b) noisy image, (c) guider filtering, (d) EPLL, and (e) proposed method.
Fig. 3.
Image de-noising performance comparison on Plane image and σ = 15: (a) original image, (b) noisy image, (c) guider filtering, (d) EPLL, and (e) proposed method.
Fig. 4.
Image de-noising performance comparison of Barbara image and σ = 15: (a) original image, (b) noisy image, (c) guider filtering, (d) EPLL, and (e) proposed method.

5. Conclusion

Based on the complementarity of EPLL and guided filtering, this paper proposes a method of coupling the expected patch log likelihood and guided filtering for image de-noising. It uses the EPLL model to construct the guided image for guided filtering, which can provide better structural information for guided filtering. Meanwhile, by the secondary smoothing of guided image filtering in the image homogenization areas, we can improve the noise suppression effect in those areas, and reduce the ladder effect brought about by EPLL.

The experimental results show that the proposed method is better than the previous two methods, in terms of both the visual effect and numerical performance. This combination makes full use of the advantages of the two methods while making up for their shortcomings, which makes the two complement and progress each other. Of course, there are still some shortcomings in this method. For example, the selection of the parameters ε and iteration times are all artificially set, and their values directly determine whether the algorithm will be overly smooth or not. As such, any future research will focus on this aspect.

Acknowledgement

This work was partly supported by the National Natural Science Foundation of China (Grant No. 61672293).

Biography

Shunfeng Wang
https://orcid.org/0000-0002-9482-7775

bio1.png

She received the M.S. degree in the Nanjing University of Information Science and Technology, China in 2002. Now she is a Professor at the College of Mathematics and Statistics, Nanjing University of Information Science and Technology. Her research interests cover pattern recognition, and information processing.

Biography

Jiacen Xie
https://orcid.org/0000-0002-5424-0363

bio2.png

She received the B.S. degree in information and computation science from Nanjing University of Information Science and Technology (NUIST), China in 2011. Now, she is a postgraduate in the College of Math and Statistics, NUIST. Her research interests cover image processing and pattern recognition.

Biography

Yuhui Zheng
https://orcid.org/0000-0002-1709-3093

bio3.png

He received the Ph.D. degree in the Nanjing University of Science and Technology, China in 2009. Now, he is an associate professor in the School of Computer and Software, Nanjing University of Information Science and technology. His research interests cover information system.

Biography

Jin Wang
https://orcid.org/0000-0002-6516-6787

bio4.png

He received the B.S. and M.S. degrees from Nanjing University of Posts and Telecommunications, China in 2002 and 2005, respectively. He received Ph.D. degree from Kyung Hee University Korea in 2010. Now, he is a professor in the School of Computer Communication Engineering, Changsha University of Science Technology. His research interests mainly include routing protocol and algorithm design, performance evaluation and optimization for wireless ad hoc and sensor networks. He is a member of the IEEE and ACM.

Biography

Tao Jiang
https://orcid.org/0000-0002-7697-4974

bio5.png

He received the B.S. degree in information and computation science from Nanjing University of Information Science and Technology (NUIST), China in 2011. Now, he is a postgraduate in the College of Math and Statistics, NUIST. His research interests cover image processing and pattern recognition.

References

  • 1 R. Molina, J. Numez, F. J. Cortijo, J. Mateos, "Image restoration in astronomy: a Bayesian perspective," IEEE Signal Processing Magazine, 2001, vol. 18, no. 2, pp. 11-29. doi:[[[10.1109/79.916318]]]
  • 2 R. Molina, J. Mateos, A. K. Katsaggelos, M. Vega, "Bayesian multichannel image restoration using compound Gauss-Markov random fields," IEEE Transactions on Image Processing, 2003, vol. 12, no. 12, pp. 1642-1654. doi:[[[10.1109/TIP.2003.818015]]]
  • 3 S. P. Belekos, N. P. Galatsanos, A. K. Katsaggelos, "Maximum a posteriori video super-resolution using a new multichannel image prior," IEEE Transactions on Image Processing, 2010, vol. 19, no. 6, pp. 1451-1464. doi:[[[10.1109/TIP.2010.2042115]]]
  • 4 J. Han, R. Quan, D. Zhang, F. Nie, "Robust object co-segmentation using background prior," IEEE Transactions on Image Processing, 2018, vol. 27, no. 4, pp. 1639-1651. doi:[[[10.1109/TIP.2017.2781424]]]
  • 5 L. I. Rudin, S. Osher, E. Fatemi, "Nonlinear total variation based noise removal algorithms," Physica D: Nonlinear Phenomena, 1992, vol. 60, no. 1-4, pp. 259-268. doi:[[[10.1016/0167-2789(92)90242-f]]]
  • 6 F. Xiao, W. Liu, Z. Li, L. Chen, R. Wang, "Noise-tolerant wireless sensor networks localization via multinorms regularized matrix completion," IEEE Transactions on Vehicular Technology, 2018, vol. 67, no. 3, pp. 2409-2419. doi:[[[10.1109/TVT.2017.2771805]]]
  • 7 J. H. Park, "Efficient approaches to computer vision and pattern recognition," Journal of Information Processing Systems, 2017, vol. 13, no. 5, pp. 1043-1051. doi:[[[10.3745/JIPS.00.0007]]]
  • 8 A. Buades, B. Coll, J. M. Morel, "A non-local algorithm for image denoising," in Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, 2005;pp. 60-65. doi:[[[10.1109/cvpr.2005.38]]]
  • 9 F. Xiao, Z. Wang, N. Ye, R. Wang, X. Y. Li, "One more tag enables fine-grained RFID localization and tracking," IEEE/ACM Transactions on Networking, 2018, vol. 26, no. 1, pp. 161-174. doi:[[[10.1109/TNET.2017.2766526]]]
  • 10 J. Han, D. Zhang, G. Cheng, N. Liu, D. Xu, "Advanced deep-learning techniques for salient and category-specific object detection: a survey," IEEE Signal Processing Magazine, 2018, vol. 35, no. 1, pp. 84-100. doi:[[[10.1109/MSP.2017.2749125]]]
  • 11 Y. Zheng, K. Ma, Q. Yu, J. Zhang, J. Wang, "Regularization parameter selection for total variation model based on local spectral response," Journal of Information Processing Systems, 2017, vol. 13, no. 5, pp. 1168-1182. doi:[[[10.3745/JIPS.02.0072]]]
  • 12 J. Zhang, Q. Yu, Y. Zheng, H. Zhang, J. Wu, "Regularization parameter selection for TV image denoising using spatially adaptive local spectral response," Journal of Internet Technology, 2016, vol. 17, no. 6, pp. 1117-1124. doi:[[[10.6138/JIT.2016.17.6.20160603]]]
  • 13 A. Buades, B. Coll, J. M. Morel, "A review of image denoising algorithms, with a new one," Multiscale Modeling Simulation, 2005, vol. 4, no. 2, pp. 490-530. doi:[[[10.1137/040616024]]]
  • 14 X. Yao, J. Han, D. Zhang, F. Nie, "Revisiting co-saliency detection: a novel approach based on two-stage multi-view spectral rotation co-clustering," IEEE Transactions on Image Processing, 2017, vol. 26, no. 7, pp. 3196-3209. doi:[[[10.1109/TIP.2017.2694222]]]
  • 15 S. Zhang, H. Jing, "Fast log-Gabor-based nonlocal means image denoising methods," in Proceedings of IEEE International Conference on Image Processing, Paris, France, 2015;pp. 2724-2728. doi:[[[10.1109/icip.2014.7025551]]]
  • 16 Y. Zheng, B. Jeon, J. Zhang, Y. Chen, "Adaptively determining regularization parameters in non-local total variation regularisation for image denoising," Electronics Letters, 2015, vol. 5, no. 2, pp. 144-145. doi:[[[10.1049/el.2014.3494]]]
  • 17 M. Protter, M. Elad, H. Takeda, P. Milanfar, "Generalizing the nonlocal-means to super-resolution reconstruction," IEEE Transactions on Image Processing, 2009, vol. 18, no. 1, pp. 36-51. doi:[[[10.1109/TIP.2008.2008067]]]
  • 18 X. Gao, Q. Wang, X. Li, D. Tao, K. Zhang, "Zernike-moment-based image super resolution," IEEE Transactions on Image Processing, 2011, vol. 20, no. 10, pp. 2738-2747. doi:[[[10.1109/TIP.2011.2134859]]]
  • 19 M. Elad, M. Aharon, "Image denoising via sparse and redundant representations over learned dictionaries," IEEE Transactions on Image Processing, 2006, vol. 15, no. 12, pp. 3736-3745. doi:[[[10.1109/TIP.2006.881969]]]
  • 20 K. Dabov, A. Foi, V. Katkovnik, K. Egiazarian, "Image denoising by sparse 3-D transform-domain collaborative filtering," IEEE Transactions on Image Processing, 2007, vol. 16, no. 8, pp. 2080-2095. doi:[[[10.1109/TIP.2007.901238]]]
  • 21 I. Djurovic, "BM3D filter in salt-and-pepper noise removal," EURASIP Journal on Image and Video Processingarticle no. 13, 2016, vol. 2016, no. article 13. doi:[[[10.1186/s13640-016-0113-x]]]
  • 22 M. K. Ozkan, A. T. Erdem, M. I. Sezan, A. M. Tekalp, "Efficient multiframe Wiener restoration of blurred and noisy image sequences," IEEE Transactions on Image Processing, 1992, vol. 1, no. 4, pp. 453-476. doi:[[[10.1109/83.199916]]]
  • 23 F. Baselice, G. Ferraioli, V. Pascazio, G. Schirinzi, "Enhanced Wiener Filter for Ultrasound image denoising," Computer Methods and Programs in Biomedicine, 2018, vol. 153, pp. 71-81. doi:[[[10.1007/978-981-10-5122-7_17]]]
  • 24 S. Citrin, M. R. Azimi-Sadjadi, "A full-plane block Kalman filter for image restoration," IEEE Transactions on Image Processing, 1992, vol. 1, no. 4, pp. 488-195. doi:[[[10.1109/83.199918]]]
  • 25 D. Zoran, Y. Weiss, "From learning models of natural image patches to whole image restoration," in Proceedings of IEEE International Conference on Computer Vision, Barcelona, Spain, 2011;pp. 479-486. doi:[[[10.1109/iccv.2011.6126278]]]
  • 26 Y. Zheng, X. Zhou, B. Jeon, J. Shen, H. Zhang, "Multi-scale patch prior learning for image denoising using Student’s-t mixture model," Journal of Internet Technology, 2017, vol. 18, no. 7, pp. 1553-1560. doi:[[[10.6138/JIT.2017.18.7.20161120]]]
  • 27 J. Sulam, M. Elad, "Expected patch log likelihood with a sparse prior," in Energy Minimization Methods in Computer Vision and Pattern Recognition. Cham: Springer2015,, pp. 99-111. doi:[[[10.1007/978-3-319-14612-6_8]]]
  • 28 Y. Zheng, B. Jeon, L. Sun, J. Zhang, and H. Zhang, IEEE Transactions on Circuits and Systems for Video Technology, 2017., http://doi.org/10.1109/TCSVT.2017.2724940
  • 29 S. Wang, J. Xie, Y. Zheng, T. Jiang, S. Xue, "Expected patch log likelihood based on multi-layer prior information learning," Advances in Computer Science and Ubiquitous Computing. Singapore: Springer2017,, pp. 299-304. doi:[[[10.1007/978-981-10-7605-3_49]]]
  • 30 J. Zhang, J. Liu, T. Li, Y. Zheng, J. Wang, "Gaussian mixture model learning based image denoising method with adaptive regularization parameters," Multimedia Tools and Applications, 2017, vol. 76, no. 9, pp. 11471-11483. doi:[[[10.1007/s11042-016-4214-4]]]
  • 31 K. He, J. Sun, X. Tang, "Guided image filtering," IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013, vol. 35, no. 6, pp. 1397-1409. doi:[[[10.1109/TPAMI.2012.213]]]
  • 32 C. L. Tsai, W. C. Tu, S. Y. Chien, "Efficient natural color image denoising based on guided filter," in Proceedings of IEEE International Conference on Image Processing, Quebec, Canada, 2015;pp. 43-47. doi:[[[10.1109/icip.2015.7350756]]]

Table 1.

Algorithm implementation steps

Input.

Corrupted image Y and X(0)=Y,penalty parameter β,regularization parameters λ and ε, the radius r.
Step 1. Choose the most likely Gaussian mixing weights kmax for each patch PiX;
Calculate zi(n+1) using (10);
Pre-estimate image X(n+1) using (11);
Let I(n+1)=X(n+1), calculate μk and σk2;
LetP(n+1)=I(n+1),calculate ak,bk using (3) and (4);
Calculate q(n+1) using (5) and let q(n+1)=X(n+1);
Repeat Steps 1-6 until the stopping criterion is satisfied.
Output. De-noised image X(n+1).

Table 2.

Performance of algorithms in different regions

Boundary region.

The pixel value varies greatly, [TeX:] $$\sigma _ { k } ^ { 2 } >> \varepsilon , \text { so } a _ { k } \rightarrow \mathbf { 1 } , b _ { k } \rightarrow \mathbf { 0 } , q \rightarrow I$$ and the edge information of the image is better preserved.

Flat region.

The pixel values are almost unchanged, [TeX:] $$\sigma _ { k } ^ { 2 } \ll \varepsilon , \text { so } a _ { k } \rightarrow 0 , b _ { k } \rightarrow \mu _ { k } , q \rightarrow \overline { \mu } _ { k }$$, and the flat regions are smoother.

Table 3.

Image Noise standard variance Guided filtering EPLL Our method
Boat σ=15 29.99 31.75 31.99
σ=30 27.34 28.29 28.61
Plane σ=15 28.75 28.97 29.54
σ=30 25.34 26.10 26.60
Barbara σ=15 30.11 30.41 30.62
σ=30 27.56 27.98 28.23
Hill σ=15 30.18 31.51 31.74
σ=30 27.61 28.57 28.86
Couple σ=15 29.60 31.70 31.96
σ=30 27.12 28.07 28.35
Image de-noising performance comparison on Couple image and σ = 30: (a) original image, (b) noisy image, (c) guider filtering, (d) EPLL, and (e) proposed method.
Enlargement of local Boat image: (a) original image, (b) noisy image, (c) guider filtering, (d) EPLL, and (e) proposed method.
Image de-noising performance comparison on Plane image and σ = 15: (a) original image, (b) noisy image, (c) guider filtering, (d) EPLL, and (e) proposed method.
Image de-noising performance comparison of Barbara image and σ = 15: (a) original image, (b) noisy image, (c) guider filtering, (d) EPLL, and (e) proposed method.