Fig 1.
The proposed intrinsic image decomposition pipeline: The input image is processed for material recognition and image smoothing.
The initial reflectance and shading components are extracted from the smooth image. The residue texture of the original image is assigned to either the shading or reflectance component based on the material of each pixel.
Fig 2.
Structure-preserving image smoothing.
(A) Original image, (B) smooth image (image selected from the MINC database [18] (S2 File)).
Fig 3.
Reflectance component for the smooth input image with and without user brushes.
(A) Original image, (B) image with added user brushes, (C, D) reflectance components without and with user brushes (S3 File).
Fig 4.
Assigning texture information to shading and reflectance components based on material of pixels.
(A) Original Image, (B) result of material recognition. Colored regions in (C) and (D) show how texture should be assigned to reflectance and shading components respectively. (E) Reflectance obtained from J, (F) shading obtained from J, (G) final reflectance, and (H) final shading component (S4 File).
Fig 5.
Illustration of the intrinsic image decomposition pipe-line.
(A) Original image, (B) smooth image with added user brushes, (C) material segmentation, (D) reflectance material, (E) shading material, (F) reflectance component obtained from J, (G) reflectance component with added texture detail, (H) reflectance component obtained by applying user brushes, (I) shading component of the smooth image, (J) shading component with added texture details, and (K) shading component with added user brushes (S5 File).
Fig 6.
An illustrative comparison between image decomposition results using are method and methods of [6, 7, 16, 37].
(A) The original image. Decomposed reflectance component by: (B) our method, (c) Shen et al. [7], (d) Bousseau et al. [6], (E) Tappen et al. [16], and (F) Weiss at al. [37] (S6 File).
Fig 7.
Intrinsic image decomposition results from our method and methods of [19] and [38].
(A, F) The original image and added user brushes, (B, C) reflectance components without and with user brushes, (D) reflectance component obtained in Bi et al. [19], (E) reflectance component obtained in Bell et al. [38]. (G, H) shading component from our method without and with user brushes, (I) shading component obtained from Bi et al. [19] and (J) shading component obtained from the method of Bell et al. [38] (S7 File).
Fig 8.
Handling intense lighting conditions with user brushes.
(A) Original image, (B) user brushes, (C, D) intrinsic components with and without user brushes (S8 File).
Fig 9.
Effect of image smoothing in the intrinsic image decomposition.
(A) Original image, (B) smooth image, (C) texture image, Images (D,E,F,G) show the reflectance and shading components when using our method and Shen et al. [7] respectively (S9 File).
Table 1.
Comparison of LMSE values of our results and the results by previous works [7, 22, and 39] on the MIT dataset.
Fig 10.
Example of reflectance and shading components extracted from the MIT intrinsic image dataset.
For each example the following are shown in order: Original image, ground truth reflectance, reflectance component from our method, reflectance component from Shen et al. [7], ground truth shading component, shading component obtained from our method, shading component obtained from Shen el al. [7].
Fig 11.
Results of intrinsic image decomposition for the image of the Apple, with and without user brushes.
(A) Original image with added user brushes, (B) ground truth reflectance, (C) reflectance with user brushes, (D) reflectance without user brushes, (E, H) ground truth shading and specular components, (G) shading with user- brushes, and (H) shading without user brushes.
Fig 12.
Result of intrinsic image decomposition by applying user brushes.
Images in the left column show how the brushes were applied. Images in the second section show the reflectance components and the third section shows the shading components.