Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

New dual method for elastica regularization

  • Jintao Song,

    Roles Data curation, Formal analysis, Methodology, Resources, Validation, Writing – original draft

    Affiliation College of Computer Science and Technology, Qingdao University, Qingdao, Shandong, China

  • Huizhu Pan,

    Roles Data curation, Resources, Writing – original draft

    Affiliation School of Electrical Engineering, Computing and Mathematical Sciences, Curtin University, Perth, WA, Australia

  • Jieyu Ding,

    Roles Data curation, Supervision

    Affiliation College of Computer Science and Technology, Qingdao University, Qingdao, Shandong, China

  • Weibo Wei,

    Roles Resources, Supervision

    Affiliation College of Computer Science and Technology, Qingdao University, Qingdao, Shandong, China

  • Zhenkuan Pan

    Roles Data curation, Formal analysis, Methodology, Resources, Supervision

    zkpan@126.com

    Affiliation College of Computer Science and Technology, Qingdao University, Qingdao, Shandong, China

Abstract

The Euler’s elastica energy regularizer has been widely used in image processing and computer vision tasks. However, finding a fast and simple solver for the term remains challenging. In this paper, we propose a new dual method to simplify the solution. Classical fast solutions transform the complex optimization problem into simpler subproblems, but introduce many parameters and split operators in the process. Hence, we propose a new dual algorithm to maintain the constraint exactly, while using only one dual parameter to transform the problem into its alternate optimization form. The proposed dual method can be easily applied to level-set-based segmentation models that contain the Euler’s elastic term. Lastly, we demonstrate the performance of the proposed method on both synthetic and real images in tasks image processing tasks, i.e. denoising, inpainting, and segmentation, as well as compare to the Augmented Lagrangian method (ALM) on the aforementioned tasks.

1 Introduction

Traditional variational methods have been extensively applied to image restoration problems based on image features, such as texture, edge, and region, etc. [14]. In particular, the combination of the high-order TV term and Euler regularizers in variational models addresses certain problems that cannot be addressed by low-order models. However, the complexity of the terms makes the models more difficult to implement. It has become a challenge in recent years to design simpler and more effective solutions for the combined model. Before presenting our new work, we introduce the TV term and the Euler’s elastica term below.

The problem of image restoration is finding the restored image u = u(x) given the damaged image f = f(x), x ∈ ℜd, where ℜ is a bounded domain with a Lipschitz boundary. For a grayscale image, the image repair model is f = Au + η, where η is the noise information and A is a blurring operator [57]. The image restoration problem can then be formulated as the minimization of the following energy functional, (1)

However, the minimization problem in (1) is ill-posed. To solve this, Tikhonov et. al [8] proposed a regularization technique. By adding a smoothing regularizer into the energy functional, the problem will obtain a unique solution. The side effect is that the model can no longer preserve edges in the image. The later proposed Rudin-Osher-Fatemi (ROF) model retains image edges by solving for a piecewise constant function in the space of bounded variation functions (BV). Nowadays, many methods based on TV regularization are used to deal with imaging problems such as image denoising [912] and image segmentation [13, 14].

Another downside of the TV models is that results are often accompanied by blocky (staircase) effects and loss of image contrast [1518]. Recently, scholars have proposed many solutions such as iterative regularization techniques [19] and the use of other high-order terms to mitigate the problem. Faster implementations have also been invented [20].

As for the Euler’s elastica [21], it has attracted much attention due to its good properties in mathematical and physical systems. The Euler’s elastica energy functional is defined as (2) where, . The term was first used in computer vision by Mumford [22], and has since proven to be effective in solving the problems present in the TV model. The Euler’s elastica has also been widely applied in various fields of image processing such as image denoising [2325], image segmentation [20, 2628], inpainting [24, 2931], illusory contour [32, 33], and segmentation with depth [3436]. Therefore, we believe it is important to design an efficient numerical solution for the combined model.

Due to the non-convexity, non-smoothness, and high-order of the derivatives of 2, it is a challenging task to design a fast and efficient solution. The ALM method has achieved good results in optimizing 2, Tai et al. [23] first proposed this ALM method to solve the image inpainting problems, then Zhu et al. [28] extend the ALM method to image segmentation field. So far, the primal-dual technique [20, 37] performs better in optimizing 2.

In this paper, we propose a new primal-dual method for the solution of 2, that makes it easier to use. The key points of the proposed method can be summarised below: (i) We introduce the dual variable p to circumvent the curvature term. (ii) Using appropriate indicator functionals, we reformulate 2 as a minimization problem of u and a maximization of p. (iii) The subproblem u has an analytic solution, and the subproblem p can be solved by a gradient descent algorithm. Numerical experiments demonstrate the improved efficiency of the proposed method.

Compared to the ALM method, the advantages of this method can be summarized into three points, (i) The proposed method only introduces one dual variable p, while the ALM method introduces 8 intermediate variables. (ii) Due to the fewer variables, the proposed method has a weaker dependency on parameters. (iii) The CPU running time required for each iteration is greatly reduced.

The rest of this article is organized as follows. In the next section, we introduce the previous models and the associated numerical algorithms. In section 4, we propose our model for image denoising and image segmentation. The subproblems of energy minimization are solved in section 5. In section 6, we provide some numerical results to illustrate the effectiveness of the new algorithm. The last section presents the conclusions.

2 The previous works

2.1 The TV model for image denoise and inpainting

The well-known TV model [2] for image denoising is an energy minimization problem on u, such that (3) where, γ is a penalty parameter for the summed length of the curves. To use the model in image inpainting, we need to incorporate a mask function η, which is defined as (4) where, xL = {x1, x2xl} denote the damaged regions. The classical TV model combined with this mask function is (5)

It is evident that if η is the identity matrix, then the inpainting model above is the same as the denoising model. Therefore, we only focus on the image restoration model. The evolution equation of u can be derived via variational methods as (6)

2.2 The TV model reformulated via the dual method

To simplify the TV model (3), we introduce the dual variable p to circumvent the curvature term. Substituting p into the TV model, we get (7) By using the dual method, we can successfully avoid the curvature term and significantly simplify calculations. The new evolution equations of u are (8) and p can be solved from (9)

2.3 The Euler’s elastica model for image denoising

In order to recover edges and counter the staircase effect, Tai et al. [23] proposed the Euler’s elastica model (10) The boundary produced by this method is curved rather than straight. Its solution via the ALM proposed by Tai et al. [23] simplifies the calculation and increases the optimization efficiency. The Tai-Hahn-Chung (THC) formulation is (11) where, the functions and denote the constraints |m| ≤ 1 and 0 ≤ u ≤ 1 respectively.

2.4 The Chan-Vese model with elastica for image segmentation

The task of two-phase segmentation f(x): Ω → R of a gray value image is to divide the image into two regions Ω1, Ω2. The Chan-Vese model, a classical two-phase segmentation model, [38] is a reduced piecewise constant Mumford-Shah model [4] under the variational level set framework. Its form is (12)

In the above model, ϕ is the level set function and H(ϕ) is the Heaviside function of ϕ(x), stated as (13)

Replacing the TV regularizer with the Eular’s elastica energy in the Zhu-Tai-Chan (ZTC) formulation [28] leads to the Chan-Vese model with elastica (CVE) below (14) where, Q(c1, c2) = α1(c1f)2α2(c2f)2. Adding another variable that relaxes the Heaviside function, u = H(x) and u ∈ [1, 0], we can construct the following augmented Lagrangian functional (15)

The functions and denote the constraints |m| ≤ 1 and 0 ≤ u ≤ 1 respectively.

3 The CVE model reformulated via the dual method

3.1 Image denoise and inpainting

Combining (7) and (10), we propose the dual formulation of the Chan-Vese model with elastica (16)

This minimization problem can be divided into two subproblems, and their solutions can be expressed as follows:

usubproblem. This subproblem is a minimization problem, and the objective function of optimization is (17)

We find that this function is almost identical to the TV model and get the same solution: (18)

In this formula, u has an analytic solution, so there is no need to iterate further and running time is greatly reduced.

psubproblem. The dual variable p can be solved by (19) where the value of g is directly determined by the u obtained in the previous step.

This is a good way to avoid fourth-order terms and can solve the Euler’s elastica term better. Since no additional parameters are introduced, and the iteration time required for each step is greatly reduced compared to the ALM solution.

3.2 Image segmentation

Combining (7) and (14), we propose the Chan-Vese model with elastica reformulated with the dual method shown below, (20)

c1, c2mean value. The Chan-Vese model is a two-term segmentation model, c1 and c2 are mean values of the foreground and background, (21)

usubproblem. Similar to (18), we can also obtain an exact solution for u, (22)

psubproblem. Although the meaning of u has changed, p can still be solved the same way as (19).

In this section, we presented the dual formulation of the CVE model for image denoising and segmentation. Next, we will design the discretized numerical algorithms for the models.

4 Numerical implementations of the sub-problems of minimization

4.1 Image denoising and inpainting

To compute the two subproblems numerically, we need to design discrete algorithms for each problem. For the sake of simplicity, we discretize the image domain pixel by pixel with the rows and column numbers as indices. Then, the gradients can be represented approximately by forward, backward, and central finite differences, where, The Euler’s Elastica term of u can be stated as (23)

The other variables can be expressed in similar ways. Next, we will give a detailed explanation of the solutions to the subproblems obtained in section 4.

usubproblem. The partial derivative with respect to E gives the analytic solution with respect to u as follows (24)

The u in the image inpainting model can be formulated as follows, (25)

In fact, this formulation is the same as the corresponding one in the solution of the TV model using the dual method.

psubproblem. The dual variable p also can be solved by (26) where no additional parameters have been introduced compared to the ALM, so the iteration time required for each step is greatly reduced.

In each iteration, the following error tolerance should be checked to determine convergence, i. e., (27) where, Tol = 0.001. Σk+1 are defined as (28)

In summary, the denoising al-gorithm is shown in Algorithm 1, and the inpainting algorithm is shown in Algorithm 2.

Algorithm 1: Dual elastica for denoising

1: Initialization: Set a = 3, b = 1, γ = 1, t = 0.0125.

2: while any stopping criterion is not satisfied do

  Calculate uk+1 from (24)

  Calculate pk+1 from (26)

3: end while

Algorithm 2: Dual elastica for inpainting

1: Initialization: Set a = 3, b = 1, γ = 10, t = 0.0125.

2: while any stopping criterion is not satisfied do

  Calculate uk+1 from (25)

  Calculate pk+1 from (26)

3: end while

4.2 Image segmentation

In this subsection, we will apply discretization to solve the formulas obtained in the previous image segmentation section.

c1, c2mean value. (21) can be solved by (29)

usubproblem. Same as TV model, u in (22) can be computed by (30)

psubproblem. Here, the Euler’s elastic term is solved directly by the differential equation. We can get (31)

Algorithm 3 is the summary of the dual elastica segmentation method.

Algorithm 3: Dual elastica for segmentation

1: Initialization: Set a = 0.001, b = 5, γ = 2, t = 0.0125.

2: while any stopping criterion is not satisfied do

  Calculate uk+1 from (30)

  Calculate pk+1 from (31)

3: end while

5 Numerical experiments

In this section, we show the results from numerical simulations to illustrate the effectiveness of our algorithms in image denoising, inpainting, and segmentation. All experiments are running in MATLAB R2020a.

The parameters in (11) were set by a = 1, b = 1, γ = 100, γ1 = 7, γ2 = 20, γ3 = 5, γ4 = 15 for all denoising experiments. In (15), the parameters were set to μ1 = 0.6, μ2 = 1, a = 0.1, b = 2, γ = 5, γ1 = 1.4, γ2 = 10, γ3 = 5, γ4 = 5 for all segmentation experiments.

5.1 Testing of Algorithm 1 and Algorithm 2

First of all, we tested our algorithm on three synthetic images. The size of the synthetic images is 256 x 256.

The image denoising result is shown in Fig 1, where (a) is the picture of a clipped triangle with Gaussian noise, (b) is the result of Algorithm 1, and (c) is the relative error, i.e. noise removed through denoising. Fig 2 shows the results of the inpainting experiment, where Fig 2(a) shows a circle corrupted by white areas, (b) to (f) are the results at iterations k = 100, 200, 300, 400, and 500 using Algorithm 2. It is evident that the results improved over time. Fig 3 shows the results of segmentation, where (a) is the initialization and (b) is the result of Algorithm 3, (c) is the clean segmentation contour, and (d) shows the level set function ϕ.

thumbnail
Fig 1. The denoising results for synthetic images.

(a) is the original noisy picture, (b) is the result of the proposed method, (c) is the relative error.

https://doi.org/10.1371/journal.pone.0261195.g001

thumbnail
Fig 2. The inpainting results for synthetic images.

(a) is the original broken picture, (b) to (f) is the results of 100, 200, 300, 400, 500 iterations.

https://doi.org/10.1371/journal.pone.0261195.g002

thumbnail
Fig 3. The segmentation results for synthetic images.

(a) is the original picture with the initialization level set function, (b) is the results of the proposed segmentation method, (c) is the 0 level set function, (d) is the level set function.

https://doi.org/10.1371/journal.pone.0261195.g003

Fig 4 shows the results of image denoising and inpainting by the TV method and the proposed dual elastica algorithm. Column (a) shows the original noisy images, (b) and (c) are the denoising results of the TV method and the dual Euler’s elastic algorithm, respectively. By observing the details, we can see that the our proposed algorithm can remove noises effectively without staircase effect and performed better in preserving boundaries compared to the TV model.

thumbnail
Fig 4. Image denoising and inpainting results by TV model and Euler’s elastica method.

https://doi.org/10.1371/journal.pone.0261195.g004

Fig 5 shows the main difference between the TV model and the Euler’s elastica model which is that the Euler’s elastica model performed much better in preserving boundary and corners.

thumbnail
Fig 5. Image segmentation results by TV model and Euler’s elastica method.

https://doi.org/10.1371/journal.pone.0261195.g005

Besides the qualitative performance of our algorithm in image deniosing, inpainting, and segmentation, computational efficiency is another major point of interest. In Fig 1, the algorithm took 9 iterations to satisfy (28) and the CPU running time was 0.0230 seconds to achieve a PSNR score of 27.9992. In Fig 2, our algorithm ran for 500 iterations and each iteration took 0.0034 seconds, so the total CPU time was 1.7048 seconds. The last segmentation experiment iterated through 35 steps, costing 0.9005 seconds of total CPU running time. This shows that our proposed algorithm can get arrive at good results within a short time frame.

5.2 Comparisons to ALM in real image

In this section, we compare our proposed method against the ALM solution. The images used in the denoising and inpainting experiments are taken from the Set12 dataset [39], Set14 dataset [40]and the BSD68 dataset [41], and the images in segmentation experiments are from the COVID-CT dataset [42] and PASCAL-VOC2012 dataset [43].

In Fig 6, both the THC algorithm and the proposed algorithm successfully removed noise and avoided the staircase effect. However, the THC model is more difficult to tune due to having additional parameters. As seen in the qualitative results, the dual method maintained edges better.

thumbnail
Fig 6. The denoising results for real images, from top to bottom are ‘Ball’, ‘Baboon’, ‘Castle’.

(Different from the original picture, it is only for illustrative purposes).

https://doi.org/10.1371/journal.pone.0261195.g006

In order to further compare with the ALM method, we present some quantitative results and convergence times. First, we compare the convergence speed of the two methods in Fig 7. The convergence rate of the proposed method is slightly slower than that of the THC method. The main reason is that the pk in the calculation of uk+1 in 24 uses uk, but the ALM method does not.

thumbnail
Fig 7.

The first plot (a) shows the plots of objective function values versus iterations for the example ‘Ball’; plot (b) shows the example of ‘Baboon’; plot (c) shows the example of ‘Castle’.

https://doi.org/10.1371/journal.pone.0261195.g007

In Table 1, we compare the similarity of the denoising results to the ground truths (via PSNR) and the efficiency (via the number of iterations to reach convergence) of the two algorithms over denoising the three images in Fig 6. Four resolutions of each image were used to more thoroughly investigate the two methods. Results show that proposed method requires more iterations to achieve the same quality of denoising, but requires less time each iteration compared to the THC algorithm. For example, for the 256*256 image of ‘Baboon’, the THC method required 0.081 seconds per iteration whereas the Algorithm 1 only needed 0.013 seconds. The reason why our algorithm requires less time per iteration is the reduction in variables, as our algorithm only uses two variables u and p, and neither u nor p needs to be solved iteratively. On the whole, the dual elastica algorithm is far better in efficiency with the same qualitative results.

thumbnail
Table 1. Performance comparison on different examples and different image sizes using our algorithm and the THC algorithm.

https://doi.org/10.1371/journal.pone.0261195.t001

Fig 8 shows the results of the proposed methods and ZTC method applied to image inpainting, Both methods performed well in repairing damaged areas. However, as can be seen in Table 2, less time is required of our algorithm to produce similar results as the ZTC.

thumbnail
Fig 8. The inpainting results for corrupted images of ‘Castle’.

(Different from the original picture ‘Cameraman’, it is only for illustrative purposes).

https://doi.org/10.1371/journal.pone.0261195.g008

thumbnail
Table 2. The number of iterations to reach convergence (iters) and the total CPU time in seconds (CPU(s)) for different images of different sizes by using our algorithm and the THC algorithm in the inpainting problem.

https://doi.org/10.1371/journal.pone.0261195.t002

In the next part, we will segment some COVID-CT images to show the effectiveness of our two-phase segmentation algorithm. We used the ZTC algorithm [28] for comparison with our algorithm. Fig 9 shows two examples of two-phase segmentation of real images. The column (a) is the initialization of the level set function and the original picture, (b) shows the results of the ZTC method, and (c) shows the results of the proposed method. Visually, those results appear similar. However, as shown in Table 3, our algorithm is more efficient in both the execution time per iteration and the total number of iterations.

thumbnail
Fig 9. The segmentation results for CT image.

(Different from the original picture, it is only for illustrative purposes).

https://doi.org/10.1371/journal.pone.0261195.g009

thumbnail
Table 3. The number of iterations to reach convergence (iters) and the total CPU time in seconds (CPU(s)) for different images of different sizes by using our algorithm and the ZTC algorithm in the segmentation problem.

https://doi.org/10.1371/journal.pone.0261195.t003

To further compare the segmentation results numerically, we use the Dice metric to measure the segmentation quality as, where, Ngs is the number of pixels in the object that are correctly segmented, Ng is the number of pixels in the ground truth object, Ns is the number of pixels in the segmented object.

In Table 4, we list the Dice metric numbers obtained in PASCAL-VOC2012 dataset to evaluate the quality of our segmentation results. The data shows that while the proposed method can achieve similar results as the ALM method, the runtime had been reduced to approximately one-sixth.

thumbnail
Table 4. The number of iterations to reach convergence (iters) and the total CPU time in seconds (CPU(s)) for different images of different sizes by using our algorithm and the ZTC algorithm in the segmentation problem.

https://doi.org/10.1371/journal.pone.0261195.t004

6 Concluding remarks

In this paper, we used a dual method to solve the Euler’s elastica regularizer for image denoising and segmentation. Our method can efficiently reduce the number of parameters, and formulate a more concise algorithm. There are two main contributions. Firstly, by introducing the dual operators, the optimization problem can be divided into simpler sub-problems, and the Chan-Vese model with elastica can be solved more easily. Secondly, our proposed algorithm can effectively reduce the number of parameters, to reduce the dependence on of parameter tuning. Numerical experiments show that compared with the ALM method our algorithm can obtain similar experimental results with less running time.

Acknowledgments

The author thanks useful comments and valuable suggestions of editors and anonymous commentators.

References

  1. 1. Geometric level set methods in imaging, vision, and graphics[M]. Springer Science & Business Media, 2003.
  2. 2. Chan TF, Shen JJ. Image processing and analysis: variational, PDE, wavelet, and stochastic methods[M]. Siam, 2005.
  3. 3. Mitiche A, Ayed IB. Variational and level set methods in image segmentation[M]. Springer Science & Business Media, 2010.
  4. 4. Mumford D, Shah J. Optimal approximations by piecewise smooth functions and associated variational problems[J]. Communications on pure and applied mathematics, 1989, 42(5): 577–685.
  5. 5. Chen K, Piccolomini EL, Zama F. Iterative constrained minimization for vectorial tv image deblurring[J]. Journal of Mathematical Imaging and Vision, 2016, 54(2): 240–255.
  6. 6. Liu X. Y., Lai C. H., Pericleous K. A., & Wang M. Q. (2012). On a modified diffusion model for noise removal. Journal of Algorithms & Computational Technology, 6(1), 35–57.
  7. 7. Osher S, Solé A, Vese L. Image decomposition and restoration using total variation minimization and the h[J]. Multiscale Modeling & Simulation, 2003, 1(3): 349–370.
  8. 8. Tikhonov AN, Goncharsky AV, Stepanov VV, et al. Numerical methods for the solution of ill-posed problems[M]. Springer Science & Business Media, 2013.
  9. 9. Acar R, Vogel CR. Analysis of bounded variation penalty methods for ill-posed problems[J]. Inverse problems, 1994, 10(6): 1217.
  10. 10. Agarwal V, Gribok AV, Abidi MA. Image restoration using L1 norm penalty function[J]. Inverse Problems in Science and Engineering, 2007, 15(8): 785–809.
  11. 11. Aujol JF. Some first-order algorithms for total variation based image restoration[J]. Journal of Mathematical Imaging and Vision, 2009, 34(3): 307–327.
  12. 12. Zhang J, Chen K, Yu B. An iterative Lagrange multiplier method for constrained total-variation-based image denoising[J]. SIAM Journal on Numerical Analysis, 2012, 50(3): 983–1003.
  13. 13. Bresson X, Esedoḡlu S, Vandergheynst P, et al. Fast global minimization of the active contour/snake model[J]. Journal of Mathematical Imaging and vision, 2007, 28(2): 151–167.
  14. 14. Unger M, Pock T, Trobin W, et al. TVSeg-Interactive Total Variation Based Image Segmentation[C]//BMVC. 2008, 31: 44–46.
  15. 15. Chan T, Marquina A, Mulet P. High-order total variation-based image restoration[J]. SIAM Journal on Scientific Computing, 2000, 22(2): 503–516.
  16. 16. Lysaker M, Osher S, Tai XC. Noise removal using smoothed normals and surface fitting[J]. 2004.
  17. 17. Chang Q, Tai XC, Xing L. A compound algorithm of denoising using second-order and fourth-order partial differential equations[J]. Numer. Math. Theory Methods Appl, 2009, 2: 353–376.
  18. 18. Brito-Loeza C, Chen K. Multigrid algorithm for high order denoising[J]. SIAM Journal on Imaging Sciences, 2010, 3(3): 363–389.
  19. 19. Osher S, Burger M, Goldfarb D, et al. An iterative regularization method for total variation-based image restoration[J]. Multiscale Modeling & Simulation, 2005, 4(2): 460–489.
  20. 20. Zhang J, Chen K. A new augmented Lagrangian primal dual algorithm for elastica regularization[J]. Journal of Algorithms & Computational Technology, 2016, 10(4): 325–338.
  21. 21. Levien R. The elastica: a mathematical history[J]. University of California, Berkeley, Technical Report No. UCB/EECS-2008-103, 2008.
  22. 22. Mumford D. elastica and computer vision[M]//Algebraic geometry and its applications. Springer, New York, NY, 1994: 491–506.
  23. 23. Tai XC, Hahn J, Chung GJ. A fast algorithm for Euler’s elastica model using augmented Lagrangian method[J]. SIAM Journal on Imaging Sciences, 2011, 4(1): 313–344.
  24. 24. Grimm V, McLachlan RI, McLaren DI, et al. Discrete gradient methods for solving variational image regularisation models[J]. Journal of Physics A: Mathematical and Theoretical, 2017, 50(29): 295201.
  25. 25. Zhang J, Chen R, Deng C, et al. Fast linearized augmented Lagrangian method for Euler’s elastica model[J]. Numerical Mathematics: Theory, Methods and Applications, 2017, 10(1): 98–115.
  26. 26. Bae E, Tai XC, Zhu W. Augmented Lagrangian method for an Euler’s elastica based segmentation model that promotes convex contours[J]. Inverse Problems & Imaging, 2017, 11(1): 1–23.
  27. 27. Duan Y, Huang W, Zhou J, et al. A two-stage image segmentation method using Euler’s elastica regularized Mumford-Shah model[C]//2014 22nd International Conference on Pattern Recognition. IEEE, 2014: 118-123.
  28. 28. Zhu W, Tai XC, Chan T. Image segmentation using Euler’s elastica as the regularization[J]. Journal of scientific computing, 2013, 57(2): 414–438.
  29. 29. Shen J, Kang SH, Chan TF. Euler’s elastica and curvature-based inpainting[J]. SIAM journal on Applied Mathematics, 2003, 63(2): 564–592.
  30. 30. Brito-Loeza C, Chen K. Fast numerical algorithms for Euler’s elastica inpainting model[J]. Int. J. Mod. Math, 2010, 5: 157–182.
  31. 31. Yashtini M, Kang SH. A Fast relaxed normal two split method and an effective weighted TV approach for Euler’s elastica image inpainting[J]. SIAM Journal on Imaging Sciences, 2016, 9(4): 1552–1581.
  32. 32. Kang SH, Zhu W, Jianhong J. Illusory shapes via corner fusion[J]. SIAM Journal on Imaging Sciences, 2014, 7(4): 1907–1936.
  33. 33. Tai XC, Duan J. A simple fast algorithm for minimization of the elastica energy combining binary and level set representations[J]. Int. J. Numer. Anal. Model, 2017, 14(6): 809–821.
  34. 34. Nitzberg M, Mumford D, Shiota T. Filtering, segmentation and depth[M]. Berlin: Springer-Verlag, 1993.
  35. 35. Esedoglu S, March R. Segmentation with depth but without detecting junctions[J]. Journal of Mathematical Imaging and Vision, 2003, 18(1): 7–15.
  36. 36. Zhu W, Chan T, Esedo g¯ lu S. Segmentation with depth: A level set approach[J]. SIAM journal on scientific computing, 2006, 28(5): 1957–1973.
  37. 37. Deng LJ, Glowinski R, Tai XC. A new operator splitting method for the Euler elastica model for image smoothing[J]. SIAM Journal on Imaging Sciences, 2019, 12(2): 1190–1230.
  38. 38. Chan TF, Vese LA. Active contours without edges[J]. IEEE Transactions on image processing, 2001, 10(2): 266–277. pmid:18249617
  39. 39. Roth S, Black MJ. Fields of experts: A framework for learning image priors[C]. IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05). IEEE, 2005, 2: 860-867.
  40. 40. Zeyde R, Elad M, Protter M. On single image scale-up using sparse-representations[C]. International conference on curves and surfaces. Springer, Berlin, Heidelberg, 2010: 711-730.
  41. 41. Martin D., Fowlkes C., Tal D., Malik J.: A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: ICCV (2001)
  42. 42. Zhao J Y, Zhang Y C, He X H, Xie P T. COVID-CT-Dataset: a CT scan dataset about COVID-19, PengtaoarXiv preprint arXiv:2003.13865,2020
  43. 43. Everingham, M. and Van Gool, L. and Williams, C. K. I. and Winn, J. and Zisserman, A.“The PASCAL Visual Object Classes Challenge 2012 (VOC2012) Results”, howpublished = “http://www.pascal-network.org/challenges/VOC/voc2012/workshop/index.html