Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Analysis of multispectral polarization imaging image information based on micro-polarizer array

  • Qiang Fu ,

    Roles Writing – original draft

    cust_fuqiang@163.com

    Affiliations College of Opto-Electronic Engineering, Changchun University of Science and Technology, Changchun, China, Space Opto-Electronics Technology Institute, Changchun University of Science and Technology, Changchun, China

  • Ninglan Ma,

    Roles Writing – original draft

    Affiliations College of Opto-Electronic Engineering, Changchun University of Science and Technology, Changchun, China, Space Opto-Electronics Technology Institute, Changchun University of Science and Technology, Changchun, China

  • Xuanwei Liu,

    Roles Writing – review & editing

    Affiliations College of Opto-Electronic Engineering, Changchun University of Science and Technology, Changchun, China, Space Opto-Electronics Technology Institute, Changchun University of Science and Technology, Changchun, China

  • Yue Zhang,

    Roles Formal analysis

    Affiliations College of Opto-Electronic Engineering, Changchun University of Science and Technology, Changchun, China, Space Opto-Electronics Technology Institute, Changchun University of Science and Technology, Changchun, China

  • Juntong Zhan,

    Roles Software

    Affiliations College of Opto-Electronic Engineering, Changchun University of Science and Technology, Changchun, China, Space Opto-Electronics Technology Institute, Changchun University of Science and Technology, Changchun, China

  • Su Zhang,

    Roles Methodology

    Affiliations College of Opto-Electronic Engineering, Changchun University of Science and Technology, Changchun, China, Space Opto-Electronics Technology Institute, Changchun University of Science and Technology, Changchun, China

  • Jin Duan,

    Roles Writing – review & editing

    Affiliation College of Opto-Electronic Engineering, Changchun University of Science and Technology, Changchun, China

  • Yingchao Li

    Roles Validation

    Affiliation Space Opto-Electronics Technology Institute, Changchun University of Science and Technology, Changchun, China

Abstract

As a new detection technology, polarization imaging is of great significance in the field of target detection. At present, polarization imaging technology usually adopts visible light polarization imaging. The technique is difficult to image the target in complex background due to its narrow working spectrum and short detection distance. Therefore, based on the principle of full Stokes micro-polarizer array, this paper proposes a multi-spectral polarization imaging scheme and designs a multi-spectral polarization imaging detection system penetrating haze. Conducting indoor and outdoor polarized imaging experiments. Finally, image quality was assessed using metrics such as information entropy (EN), average gradient (AG), and standard deviation (STD). The results show that compared with traditional strength detection, the imaging system has significantly improved detection distance and imaging quality in smoky environments. The imaging system can effectively enhance the contours and details of the target object and improve detection and recognition capabilities.

Introduction

Polarization imaging detection technology is a novel optoelectronic detection technique that possesses unique advantages in target detection. Research on polarization imaging detection technology began in the 1970s in the United States. Over time, five different polarization imaging devices have been developed based on various technical schemes and core components [15]. Currently, the field of polarization imaging detection technology is developing rapidly [69]. In terms of spectral polarization detection, researchers have conducted polarization imaging experiments at different wavelength ranges. Additionally, new detection technologies specifically designed for spectral polarization imaging have been developed [1012].

In 2022, China University of Mining and Technology proposed a new image dehazing algorithm based on polarization information and deep prior learning [13]. This method achieved a 31% improvement in contrast for heavily hazy images, providing a new direction for image dehazing processing. In 2023, North China University of Technology proposed the principle of dual-channel complementary snapshot polarization spectral imaging and established a dual-channel multispectral and hyperspectral image fusion model [14]. This approach enhances the spectral and spatial resolution of snapshot polarization spectral imaging, resulting in a 3 dB improvement in spatial resolution.

In recent years, the development of micro-polarizer arrays has become a hot topic in the field of polarization imaging. By adjusting the state of the micro-polarizer array, the polarization information on the surface of the target object can be extracted. It has been widely applied in material characterization, surface topography measurement, and image enhancement [1517]. In 2018, Sony introduced a visible light zoomable focal plane polarization detector [18]. By integrating a microlens between each pixel and the micro-polarizer, crosstalk of polarized light in different directions is reduced. In 2022, researchers at Harvard University designed a metasurface diffraction grating based on the principle of selective spectral splitting according to the polarization state [19]. This can convert intensity imaging into full Stokes polarization imaging.

Many research efforts in recent years have focused on improving contrast of target images through algorithms such as deep learning, without enhancing imaging performance through advancements in detection devices. Existing detection technologies often employ linear polarization imaging, neglecting the impact of circular polarization on detection capability, and have limited spectral range and low energy utilization.

In complex environments, reflection and scattering of light severely affect the clarity and contrast of images. Linear polarization imaging only selects the vibration direction of light in one direction. When there is an angular deviation between the light and the target surface, the target’s optical properties and structure may exhibit anisotropy, making it impossible to completely eliminate the effects of reflection and scattered light. On the other hand, circular polarization imaging rotates the vibration direction of light, keeping a fixed phase difference between the sample and the vibration direction of light, reducing sensitivity to reflection and scattered light and effectively reducing interference. Therefore, circular polarization exhibits superior polarization preservation capabilities compared to linear polarization in environments with significant optical thickness, and utilizing circular polarization enhancement can improve the imaging quality of targets in complex environments.

Multispectral polarization imaging combines spectral and polarization information, enabling simultaneous acquisition of spectral and polarizing characteristics of samples. By capturing and analyzing data in different spectral bands and polarization states, rich multidimensional information can be obtained, offering a comprehensive description of sample features and properties.

Research efforts have been conducted on micro-nano wire grids and micro-nano circular grids, designing and fabricating micro-polarizer arrays embedded with circular polarization information. Real-time detection of full Stokes polarization spectral multi-parameters has been achieved in the micro-polarizer array, and imaging errors in the micro-polarizer array have been analyzed and corrected. Furthermore, a multispectral polarization imaging detection system has been designed, and experiments of multispectral polarization light transmission imaging have been conducted on targets in indoor simulated and outdoor real environments. The results have demonstrated that compared to conventional imaging detection methods, the multispectral polarization imaging haze detector based on the micro-polarizer array has achieved a 4-fold improvement in detection distance and a 30% increase in image contrast.

These research efforts provide new insights and approaches for the development of polarization imaging technology, achieving improved imaging results in complex environments. Further research and improvements can be expected to bring more breakthroughs and advancements in the field of polarization imaging.

Basic principles of polarization imaging

The Stokes vector describes the polarization state of the light wave through , which can also be written as , where I represents the total light intensity, and Q represents the intensity difference between horizontally and vertically linearly polarized light. U represents the intensity difference between linearly polarized light with different angles, and V represents the intensity difference between right-handed and left-handed circularly polarized light.

When the polarizer is used to detect the intensity of linearly polarized light at any angle, the following relationship can be obtained [20]: (1) Where MP is the reflection Mueller matrix, bringing Mp into Eq (1) yields (2) Where is the angle of the polarizer θ of the detected light intensity value. The Stokes matrix is a 4th-order matrix and requires the measurement of 4 parameters to obtain the corresponding Stokes matrix. In most natural cases, circular polarization can be ignored and does not affect the detection effect. Therefore, the Stokes matrix can be dimensionally reduced into a 3rd-order matrix, and only 3 parameters need to be measured to solve the Stokes matrix. Using the 0°, 45°, and 90° angles can provide a comprehensive description of the polarimetric properties of the target in different directions. By combining these angles, detailed information about the target can be obtained, resulting in more accurate and complete polarimetric imaging results. Therefore, the 0°, 45°, and 90° linear polarization directions are selected as the parameters to solve the Stokes matrix. When using a single polarizer to detect a target, only the linear polarization information of the target can be obtained, and circular polarization information cannot be acquired. However, when using a combination of wave plate and polarizer, not only can the linear polarization information of the target be detected, but also the circular polarization information can be obtained. Circular polarization has a pronounced effect on penetrating smoke. Therefore, by combining wave plates and polarizing films, better detection results can be achieved for targets in a smoky environment. Then there is [21]: (3) Where denotes a polarizer angle of 0° and the angle of the waveplate is θ′,

we choose the value of the detected light intensity when θ′ values as with , when the detected light intensity value is denoted by is expressed; when the detected light intensity is denoted by and the Stokes vector is obtained by calculating . From this, the Stokes expression is obtained as [21]: (4) The change of polarization parameter of light can describe the change of polarization state of light well, where the polarization degree is one of the important parameters of the polarization parameter of light, the definition of polarization degree is the proportion of the polarized light component to the whole light wave component, divided into three kinds: Degree of Polarization (DOP), Degree of Linear Polarization (DOLP) and Degree of Circular Polarization (DOCP), their expressions are [22, 23]: (5) (6) (7) Angle of Polarization (AOP) is also an important parameter in the polarization parameter, defined as the phase difference between the two radiation components, the expression is: (8) By using the above formula for the Stokes vector, the polarization parameters can be further derived, which results in the polarization information of the detection target.

Multi-spectral polarization imaging detection scheme based on micro-polarizer array

Micro-polarizer array design

Micro-polarization imaging technology uses a Micro-polarizer Array (MPA) image sensor to capture images. The MPA is integrated on the photographic chip, and the cell size of the MPA is exactly the same as the pixel cell size of the photographic chip to be integrated, and the cells of the MPA are aligned one by one with the pixel cells of the photographic chip [24]. In this study, the detector target surface is divided into 2×2 areas, and the detected light intensity is the light intensity image after the detection of 0°, 45°, 90° and circular polarizer respectively. The advantage of this detector is that it can capture four different polarization direction images–horizontal, vertical, diagonal, and circular polarization–by capturing a single frame. As shown in Fig 1, the four regions of intensity are I(0°), I(45°), I(90°) and I(R).

thumbnail
Fig 1. Image division design scheme.

(the four regions of intensity are I(0°), I(45°), I(90°) and I(R)).

https://doi.org/10.1371/journal.pone.0296397.g001

Every four image elements form a super image element. When obtaining a single frame of spatial target polarization image, it is necessary to extract the pixel units with the same polarization direction according to the arrangement of the micro-polarizer array and copy them into four different empty images. Since the image pixels with polarization spectrum multiparameter detection information are lost by half in the process of sub-regioning the pixels, the Interpolation between two adjacent pixels is used [25] to make up the number of pixels, and a bilinear interpolation method is used to make up the data of the null region between two adjacent pixels. The bilinear interpolation method is shown in Fig 2 To get the gray value value of the unknown pixel point at the point P = (x, y), it is necessary to estimate the gray value using the pixel points with known gray value using Q11 = (x1, y1), Q12 = (x1, y2), Q21 = (x2, y1) and Q22 = (x2, y2).

thumbnail
Fig 2. Schematic diagram of the bilinear interpolation method.

(To get the gray value value of the unknown pixel point at the point P).

https://doi.org/10.1371/journal.pone.0296397.g002

Compared with other interpolation methods, the bilinear interpolation method has the advantages of simple algorithm structure and easy implementation, and the obtained images have high pixel resolution, which can highlight the target details and structure and other features in the images more obviously. Four images with different detection bias directions can be obtained with light intensity values of I(0°), I(45°), I(90°) and I(R), which contain 1/2 of the null region. By convolving 2×2 pixel cells on the array, the polarization state measurements at the vacant positions can be fitted to improve the spatial resolution of the data [26]. Finally, the real-time detection of four Stokes polarization spectrum multiparametric detection parameters is achieved and the pixel size requirement is satisfied. After obtaining the polarization images with four different polarization directions by using the bilinear interpolation method, by combining the Stokes formula, spatial polarization degree image and polarization angle image of the spatial target can be obtained. The image processing method based on bilinear interpolation is shown in Fig 3.

thumbnail
Fig 3. Image processing method based on bilinear interpolation.

https://doi.org/10.1371/journal.pone.0296397.g003

This paper is a micro-polarizer array designed based on the fractional plane polarization imaging technique. Compared with the traditional fractional plane polarization imaging technique, its advantage lies in the ability to obtain micro-polarizer arrays with good performance and easy preparation of full Stokes vectors. Based on the in-depth study of the polarization selective transmission mechanism of the micro-nano grating, the structure and corresponding parameters of the micro-nano grating to obtain the full Stokes vector are optimized and designed to provide theoretical and technical support for the focal plane full polarization detection technique. The design idea is to improve the polarization selective transmission performance (high polarization transmittance, extinction ratio and wide spectral bandwidth) in the visible wavelength range by optimizing the structural parameters based on the study of polarization selective transmission characteristics of micro-nano wire grating and micro-nano circular grating. The schematic diagram of the micro-polarizer split-plane polarization imaging is shown in Fig 4.

thumbnail
Fig 4. Schematic diagram of micro-polarizer split-focal plane polarization imaging.

((a)Micropolarizer array distribution model (b)The micropolarizer array corresponds to the photosensitive chip one by one).

https://doi.org/10.1371/journal.pone.0296397.g004

In this paper, the micro-polarizer manufacturing technology based on metal micro-nano grating, which has the advantages of minimal inter-pixel crosstalk, thinner thickness, and stable polarization performance, good polarization effect and high polarization efficiency.

In addition to the manufacturing process which affects the performance of the micro-polarizer array, each design parameter of the micro-polarizer array: substrate material, grating period, grating width, grating slot depth, etc. also affects the performance of the micro-polarizer array and thus the imaging quality, so these parameters need to be designed.

Wire grids composed of low refractive index have better transmittance and extinction ratio than high refractive index. When the transmittance of the base material is comparable in a specified wavelength range, it is advisable to choose a material with a low refractive index. We choose a high transmittance glass with 92% transmittance and 1.47 refractive index as the substrate material.

When the grating period is much smaller than the incident light wavelength, the grating has only zero-level diffraction waves, at this time the grating can be used as a good polarization device, so the grating needs to meet the zero-level diffraction conditions [27]: (9) Where T is the grating period, m is the diffraction level, n is the refractive index of the substrate, θm is the corresponding diffraction angle, ni is the refractive index of air, and θi is the angle of incidence. Because there is only zero diffraction, so m = 1, θm = π/2, the refractive index of the substrate n = 1.47, when the incident angle is 0, the grating period should be less than the critical period value of 160nm. When the duty cycle is set to 0.6, and the grating period ranges from 0 to 200nm, the main transmittance with wavelength and period variation is calculated using Eqs (10) to (12) [27]. (10) (11) (12) In these equations, T represents the grating period, A represents the grating width, and λ represents the wavelength of the incident light. The simulation results are shown in Fig 5.

thumbnail
Fig 5. The effect of grating period on TM transmittance.

(simulated picture).

https://doi.org/10.1371/journal.pone.0296397.g005

From Fig 5., it can be observed that as the wavelength increases, the main transmittance gradually increases. At any given wavelength, the main transmittance shows a trend of initially increasing and then decreasing with an increase in the grating period. When the grating period is 140nm, the TM transmittance is the highest. Therefore, the grating period is set to 140nm.

The grating duty cycle is defined as the ratio of the wire grid width to the grating period, and the TM wave transmittance and extinction ratio are traded off by varying the grating duty cycle. As the duty cycle increases, the distance between the grating and the grating decreases, resulting in a decrease in TM wave transmission. However, in this process, the TM wave attenuation is relatively small, which leads to an increase in the extinction ratio. Therefore, considering the effect of the grating duty cycle on the TM wave transmittance and extinction ratio, the TM wave transmittance and extinction ratio can reach a high level when the duty cycle is f = 0.5, as shown in Fig 6.

thumbnail
Fig 6. Effect of duty cycle on TM transmittance and extinction ratio.

((a) The effect of duty cycle on TM transmittance (b) The effect of duty cycle on extinction ratio)).

https://doi.org/10.1371/journal.pone.0296397.g006

The depth of the grating groove is also a key parameter for the polarization performance of metal gratings, and the aspect ratio is the ratio of the grating groove depth to the width of the wire grating. The relationship between grating depth and grating polarization performance is shown in Fig 7 When the depth of the aluminum layer h1 is chosen to be 70 nm, the TM transmittance and extinction ratio are at a high level. Since the design is a double-layer grating, the sum of the aluminum layer depth h1 and the highly transmissive glass layer depth h2 should be 140mm. Therefore, the depth of the highly transmissive glass layer h2 is 70 nm.

thumbnail
Fig 7. Effect of grating slot depth on TM transmittance and extinction ratio.

((a) Effect of grating slot depth on TM transmittance(b) Effect of grating slot depth on extinction ratio).

https://doi.org/10.1371/journal.pone.0296397.g007

According to the imaging method of micro-polarization real-time imaging, the field of view of each image element is different, so the Instantaneous Field of View (IFOV) of adjacent pixels does not overlap in principle, and the direct calculation of polarization information will cause an alignment error of one pixel. Therefore, it is necessary to analyze and correct the instantaneous field of view error.

In this section, a method is proposed to estimate the interpolation error by combining Newton polynomial interpolation and polarization difference model, and incorporating an edge classifier in the polarization difference domain. This method aims to reduce interpolation errors caused by high-frequency information such as object edges during reconstruction, which is often overlooked in traditional polynomial interpolation methods. The equation of this algorithm is obtained using Newton’s polynomial and Taylor’s formula as follows [28]: (13) The interpolation predictor for the 45° diagonal direction in the polarization difference domain is defined as (14) The interpolation predictor for the -45° diagonal direction in the polarization difference domain is defined as (15) Let and be the loss values in the 45° and -45° diagonal directions, respectively, defined as (16) The ratio of the two loss values is used as the edge classifier and is calculated as follows: (17) Fig 8 shows the image data acquired by an infrared polarization imaging system using an array of micro-polarizers. Fig 8(A) shows the original image and Fig 8(B) shows the polarization degree image obtained after processing by the Newton polynomial interpolation algorithm. Due to the characteristics of the micro-polarization real-time imaging method, there will be transient field-of-view error, which leads to jagged false information in the image and affects the distinction of target details. Using the Newton polynomial interpolation algorithm, it can be seen that the target edges are almost jagged-free and the target surface details are displayed more clearly.

thumbnail
Fig 8. Target polarization map using Newton’s interpolation algorithm.

((a) Original image(b) Newton polynomial interpolation).

https://doi.org/10.1371/journal.pone.0296397.g008

Multi-spectral polarization imaging detection device

The multispectral polarization imaging detection system consists of four parts: visible polarization imaging subsystem, short-wave infrared imaging subsystem, long-wave infrared polarization imaging subsystem, and processing/display subsystem. The system composition is shown in Fig 9 below. The multispectral polarization imaging detection device is shown in Fig 10.

thumbnail
Fig 10. Physical diagram of multispectral polarization detection.

https://doi.org/10.1371/journal.pone.0296397.g010

Functions of the components:

  1. visible polarization imaging subsystem: the visible zoom telescope optical system to obtain the target visible band (0.4 ~ 0.8um) information, after polarization spectral components will be obtained respectively 0°, 45°, 90° and R four angle polarization light intensity, the use of visible light detector for reception.
  2. short-wave infrared imaging subsystem: the short-wave infrared zoom telescope optical system to obtain the target short-wave infrared band (0.9~1.7um) information, using the short-wave infrared detector to receive.
  3. Long-wave infrared polarization imaging subsystem: the long-wave infrared zoom telescope system to obtain the target long-wave infrared (8 ~ 12um) information, after polarization spectral components will be obtained respectively 0°, 45°, 90° and R four angle polarization light intensity, the use of long-wave infrared detector for reception.
  4. Processing/display subsystem: collect and store the three waveband images, and fuse and enhance the images, and display them in real time through the monitor.

Polarization imaging detection experiments

Polarization imaging experiment in indoor simulation environment

We simulated the smoke environment to verify the imaging effect of the designed micro-polarizer array. Fig 11 shows the field pictures of the polarization imaging experiment in the simulated indoor environment.

thumbnail
Fig 11. Physical view of polarization imaging in smoke simulation environment.

https://doi.org/10.1371/journal.pone.0296397.g011

The polarization imaging experiment was conducted in a smoky environment with a transmittance of 71.4%, using a green cart and a white metal can as the target. To reduce the effect of light from other wavelengths, a 530 nm filter (which filters out light of colors other than green) was added in front of the lens for the experiment.

First, use a regular intensity camera to obtain the intensity image of the target. Then, use a regular polarized camera to image the target, capturing intensity images at 0°, 45°, and 90° respectively. Finally, apply Eqs (4) to (8) to generate the V, DOP, DOCP, and AOP images (Fig 12).

thumbnail
Fig 12. Target image without MPA in visible smoke environment.

((a)Intensity images(b) V image(c) DOP image(d) DOCP image(e) AOP image).

https://doi.org/10.1371/journal.pone.0296397.g012

Using the designed haze-polarized imaging detection system (employing MPA), we obtained intensity images of the target at 0°, 45°, and 90° angles. By applying Eqs (4) to (8), we can calculate V, DOP, DOCP, and AOP images (Fig 13).

thumbnail
Fig 13. Target images obtained using a haze transmission polarization imaging detection system in a visible smoke environment.

((a)Intensity images(b) V image(c) DOP image(d) DOCP image(e) AOP image).

https://doi.org/10.1371/journal.pone.0296397.g013

By comparing Figs 12 and 13, it can be observed that the polarization imaging detection system using the designed MPA for haze penetration exhibits higher contrast and clearer images of the target under the same smoky conditions. In Fig 13, (a) is an intensity image that mainly focuses on the brightness information, with a contrast of 5.9%. The contrast of the DOP image is 23.5%, the contrast of the DOCP image is 21.0%, and the contrast of the AOP image is 9.4%. All of these contrast values are higher than the intensity image, enabling the enhancement of the target’s edge contours and making the target easier to identify. In the AOP image, in addition to the polarization angle information, it is also noticeable that there is a significant amount of noise. This is because the polarization angle ranges from −π/2 to π/2, corresponding to colors from black to white. If the angle exceeds π/2, the color transitions from white to black, and if it falls below -X, the color transitions from black to white. It is precisely due to these transitions that the AOP image exhibits noise, but its contrast is still higher compared to the intensity image. Therefore, in smoky environments, polarization imaging technology has certain advantages in highlighting the edge contours of the target.

The image contrast is calculated by the formula: (18) Where the target background contrast of the intensity image CW, It indicates the target area brightness, Ib is the overall brightness of the background area of the image.

Based on Fig 14, it can be observed that the imaging system with MPA provides better polarization imaging results compared to the system without MPA. The contrast of DOP, DOCP, and AOP is all improved when MPA is incorporated. Additionally, the imaging system with MPA exhibits the highest contrast in the DOP image.

thumbnail
Fig 14. Comparison of contrast between target image with MPA and without MPA.

https://doi.org/10.1371/journal.pone.0296397.g014

Polarization imaging experiment in real outdoor environment

Test experiments on polarized light transmission imaging under different haze conditions were carried out. The following figure shows the test results of the haze transmission multi-spectral polarization imaging detection system with an ordinary intensity camera and using the MPA designed in this paper in the presence of fog.

Experiment 1: With an atmospheric visibility of 1 km and a detection distance of 1 km, tests were conducted on three different wavelength bands: visible light, short-wave infrared, and long-wave infrared. After comparing Figs 1517, the results show that polarization imaging detection can highlight target edges and improve imaging quality compared to regular intensity images.

thumbnail
Fig 15. Comparison of unbiased external field and polarization experimental images in the visible range under foggy weather conditions.

((a) Normal camera intensity(b) DOP(c) AOP(d) DOCP).

https://doi.org/10.1371/journal.pone.0296397.g015

thumbnail
Fig 16. Comparison of unbiased external field and polarization experimental images in the short-wave infrared range under foggy weather conditions.

((a) Normal camera intensity(b) DOP(c) AOP(d) DOCP).

https://doi.org/10.1371/journal.pone.0296397.g016

thumbnail
Fig 17. Comparison of unbiased external field and polarization experimental images in the long-wave infrared range with foggy weather conditions.

((a) Normal camera intensity(b) DOP(c) AOP(d) DOCP).

https://doi.org/10.1371/journal.pone.0296397.g017

Second experiment: atmospheric visibility of 1km, detection range of 5km. (Figs 1820)

thumbnail
Fig 18. Comparison of visible light unbiased external field and polarization experimental images in foggy weather condition.

((a) Normal camera intensity(b) DOP(c) AOP(d) DOCP).

https://doi.org/10.1371/journal.pone.0296397.g018

thumbnail
Fig 19. Comparison of short-wave infrared unbiased external field and polarization experimental images under foggy weather conditions.

((a) Normal camera intensity(b) DOP(c) AOP(d) DOCP).

https://doi.org/10.1371/journal.pone.0296397.g019

thumbnail
Fig 20. Comparison of long-wave infrared unbiased external field and polarization experimental images under foggy weather conditions.

((a) Normal camera intensity(b) DOP(c) AOP(d) DOCP).

https://doi.org/10.1371/journal.pone.0296397.g020

From the above imaging results, it can be observed that with a detection range of 1km, a regular strength camera is unable to provide clear imaging of the buildings at that distance. Similarly, with a detection range of 5km, the regular strength camera is unable to detect the tower at that distance. However, by using an MPA imaging system with haze and multi-band polarization imaging capabilities, clear imaging at 1km and target recognition at 5km can be achieved, greatly enhancing the detection range.

In addition to this, the information entropy, mean gradient and standard deviation are calculated to objectively evaluate the polarized images of the target at different bands in the two sets of experiments.

The expression for the information entropy of an image is as follows [29]: (19) Where, L is the total number of gray levels; pi indicates the ratio between the number of pixels with a gray value of i and the total number of pixels. The EN value can be used to measure the amount of information contained in the image; the larger the EN value, the better the image quality and the richer the amount of information contained.

The average gradient is defined by the following equation [30], where M×N is the image size and P(i,j) is the pixel value at (i,j). (20) The standard deviation is expressed as follows [31]: (21) Where, is the average of the image grayscale and the expression is as follows (22) The values of EN, AG, STD of target polarization imaging under different wavelengths in the first and second group of experiments calculated by Eqs (19)~(22) are shown in Tables 14. Comparing the data in the tables, it can be seen that the multi-spectral polarization imaging detection system we designed for haze transmission can improve the imaging quality at different detection distances.

thumbnail
Table 1. Evaluation indexes of intensity camera target images in the first group of experiments.

https://doi.org/10.1371/journal.pone.0296397.t001

thumbnail
Table 2. Evaluation indexes of DOP images of different wavelengths of targets in the first group of experiments.

https://doi.org/10.1371/journal.pone.0296397.t002

thumbnail
Table 3. Evaluation indexes of intensity camera target images in the second group of experiments.

https://doi.org/10.1371/journal.pone.0296397.t003

thumbnail
Table 4. Evaluation indexes of DOP images of different wavelengths of targets in the second group of experiments.

https://doi.org/10.1371/journal.pone.0296397.t004

We take the evaluation metrics of the intensity camera imaging as the baseline to calculate the improvement rate of the image quality produced by using the Multi-Polarization Aerosol (MPA) imaging system with haze and multi-band polarization capabilities. Taking the example of the image standard deviation (STD) in the visible light wavelength at a visibility of 1km, the percentage improvement of the image quality produced by the MPA system compared to the intensity camera is: (39.5135–12.6645) / 12.6645 = 2.120 = 212.0%.The results indicate that the image evaluation metrics have improved across different spectral bands and detection distances. The maximum improvement rate for EN is 33.66%, while AG can be improved by over 200%, and the improvement rate for STD also reaches over 50%. It can be seen that the addition of the MPA-based system can significantly enhance image quality and highlight target details.

Conclusion

Based on the multi-spectral polarization imaging technology of MPA, a haze permeable multi-spectral polarization imaging detection system is designed. By combining polarization imaging experiments in simulated indoor and real outdoor environments, it was found that an imaging system with the addition of micro-polarization array (MPA) has greater advantages in imaging targets in smoky environments and possesses strong smoke penetration capabilities (S1S9 Figs). Through the analysis of EN, AG, and STD of polarized images in different spectral bands, it has been determined that the incorporation of MPA in the imaging system significantly enhances the polarization detection effectiveness for targets at different detection distances and across different spectral bands. The maximum improvement rate for EN is 33.66%, and AG showing an improvement of over 200%, and STD achieving an improvement rate of over 50% (S1S4 Tables). This enhancement can highlight the target contours and enrich the target detail information. This article focuses on imaging static targets indoors and outdoors, and emphasizes that real-time detection of dynamic targets in multiple spectral bands will be the future development direction. The application of this technology can be utilized in areas such as detector integration and industrial manufacturing, providing new technical support for fields like military reconnaissance, fire and rescue operations, and urban surveillance.

Supporting information

S1 Fig. Target image without MPA in visible smoke environment.

https://doi.org/10.1371/journal.pone.0296397.s001

(PDF)

S2 Fig. Target images obtained using a haze transmission polarization imaging detection system in a visible smoke environment.

https://doi.org/10.1371/journal.pone.0296397.s002

(PDF)

S3 Fig. Comparison of contrast between target image with MPA and without MPA.

https://doi.org/10.1371/journal.pone.0296397.s003

(PDF)

S4 Fig. Comparison of unbiased external field and polarization experimental images in the visible range under foggy weather conditions.

https://doi.org/10.1371/journal.pone.0296397.s004

(PDF)

S5 Fig. Comparison of unbiased external field and polarization experimental images in the short-wave infrared range under foggy weather conditions.

https://doi.org/10.1371/journal.pone.0296397.s005

(PDF)

S6 Fig. Comparison of unbiased external field and polarization experimental images in the long-wave infrared range with foggy weather conditions.

https://doi.org/10.1371/journal.pone.0296397.s006

(PDF)

S7 Fig. Comparison of visible light unbiased external field and polarization experimental images in foggy weather condition.

https://doi.org/10.1371/journal.pone.0296397.s007

(PDF)

S8 Fig. Comparison of short-wave infrared unbiased external field and polarization experimental images under foggy weather conditions.

https://doi.org/10.1371/journal.pone.0296397.s008

(PDF)

S9 Fig. Comparison of long-wave infrared unbiased external field and polarization experimental images under foggy weather conditions.

https://doi.org/10.1371/journal.pone.0296397.s009

(PDF)

S1 Table. Evaluation indexes of intensity camera target images in the first group of experiments.

https://doi.org/10.1371/journal.pone.0296397.s010

(PDF)

S2 Table. Evaluation indexes of DOP images of different wavelengths of targets in the first group of experiments.

https://doi.org/10.1371/journal.pone.0296397.s011

(PDF)

S3 Table. Evaluation indexes of intensity camera target images in the second group of experiments.

https://doi.org/10.1371/journal.pone.0296397.s012

(PDF)

S4 Table. Evaluation indexes of DOP images of different wavelengths of targets in the second group of experiments.

https://doi.org/10.1371/journal.pone.0296397.s013

(PDF)

References

  1. 1. Tyo J. S., Goldstein D. L., Chenault D. B., & Shaw J. A. (2006). Review of passive imaging polarimetry for remote sensing applications. Applied optics, 45(22), 5453–5469. pmid:16855644
  2. 2. Giudicotti L., & Brombin M. (2007). Data analysis for a rotating quarter-wave, far-infrared stokes polarimeter. Applied Optics, 46(14), 2638–2648. pmid:17446912
  3. 3. Matchko R. M., & Gerhart G. R. (2008). High-speed imaging chopper polarimetry. Optical Engineering, 47(1), 016001-016001–12.
  4. 4. Wm Hayden, Smith , Philip D., & Hammer . (1996). Digital array scanned interferometer: sensors and results. Applied Optics, 35(16).
  5. 5. Lucey P. G., Williams T., Horton K., & Rafert J. B. (1993). SMIFTS: A Cryogenically Cooled, Spatially Modulated, Imaging, Fourier Transform Spectrometer.
  6. 6. Zhu Yong, He Qingyi, Fu Qiang, Dong Chao, Liu Jianhua, and Duan Jin. (2023). Detection of Underwater Targets Using Polarization Laser Assisted Echo Detection Technique. Applied Sciences 13(5), 3222. https://doi.org/10.3390/app13053222
  7. 7. Wang K., Fu Q., Wang B., Shi H., Liu J., Wang Q., et al. (2023). Simplified analysis and suppression of polarization aberration in planar symmetric optical systems. Optics Express, 31(19), 30750–30766. pmid:37710612
  8. 8. Baldini L., Barbanera M., Bellazzini R., Bonino R., Borotto F., Brez A., et al. (2021). Design, construction, and test of the Gas Pixel Detectors for the IXPE mission. Astroparticle Physics, 133, 102628.
  9. 9. Zhan Z., Cantono M., Kamalov V., Mecozzi A., Müller R., Yin S., et al. (2021). Optical polarization–based seismic and water wave sensing on transoceanic cables. Science, 371(6532), 931–936. pmid:33632843
  10. 10. Lavigne D. A, Breton M, Fournier G, Pichette M, & Rivet V (2009). A new passive polarimetric imaging system collecting polarization signatures in the visible and infrared bands. In Infrared Imaging Systems: Design, Analysis, Modeling, and Testing XX (Vol. 7300, pp. 353–361). SPIE.
  11. 11. Shauloff N., Bisht R., Turkulets Y., Manikandan R., Morag A., Lehrer A.,.et al. (2023). Multispectral and Circular Polarization‐Sensitive Carbon Dot‐Polydiacetylene Capacitive Photodetector. Small, 19(31), 2206519. pmid:36504311
  12. 12. Brown J. P., Wagner M. C., Roberts R. G., & Card D. B. (2019). Experiments in detecting obscured objects using longwave infrared polarimetric passive imaging. In Infrared Imaging Systems: Design, Analysis, Modeling, and Testing XXX (Vol. 11001, pp. 73–87). SPIE.
  13. 13. Bi P., Wang D., Chen W., Yang L., Liang J., Li G., et al. (2022). Image dehazing based on polarization information and deep prior learning. Optik, 267, 169746.
  14. 14. Wang Y., Zhang R., Wang Z., Xue P., Cui M., & Li M. (2023). Snapshot-type polarization spectral imaging resolution enhancement based on dual-channel complementary microarray coding imaging fusion. IEEE Sensors Journal.
  15. 15. Fu Q., Liu X., Yang D., Zhan J., Liu Q., Zhang S., et al. (2023). Improvement of pBRDF model for target surface based on diffraction and transmission effects. Remote Sensing, 15(14), 3481.
  16. 16. Vannier N., Goudail F., Plassart C., Boffety M., Feneyrou P., Leviandier L., et al. (2016). Comparison of different active polarimetric imaging modes for target detection in outdoor environment. Applied optics, 55(11), 2881–2891. pmid:27139850
  17. 17. Fan A., Xu T., Teng G., Wang X., Zhang Y., Xu C., et al. (2023). Full-Stokes polarization multispectral images of various stereoscopic objects. Scientific Data, 10(1), 328. pmid:37244913
  18. 18. Rebhan D., Rosenberger M., & Notni G. (2019). Principle investigations on polarization image sensors. In Photonics and Education in Measurement Science 2019 (Vol. 11144, pp. 50–54). SPIE.
  19. 19. Rubin N. A., Chevalier P., Juhl M., Tamagnone M., Chipman R., & Capasso F. (2022). Imaging polarimetry through metasurface polarization gratings. Optics Express, 30(6), 9389–9412. pmid:35299368
  20. 20. Fu Q., Liu X., Wang L., Zhan J., Zhang S., Zhang T., et al. (2023). Analysis of target surface polarization characteristics and inversion of complex refractive index based on three-component model optimization. Optics & Laser Technology, 162, 109225.
  21. 21. Zhao Y., Li Y., He W., Liu Y., & Fu Y. (2021). Polarization scattering imaging experiment based on Mueller matrix. Optics Communications, 490, 126892.
  22. 22. Gruev V., Perkins R., & York T. (2010). CCD polarization imaging sensor with aluminum nanowire optical filters. Optics express, 18(18), 19087–19094. pmid:20940803
  23. 23. Ahmed A., Zhao X., Chang J., Ma H., Gruev V., & Bermak A. (2018). Four-directional adaptive residual interpolation technique for DoFP polarimeters with different micro-polarizer patterns. IEEE Sensors Journal, 18(19), 7990–7997.
  24. 24. Yongqiang Z., Yuchen Z., Wuteng L., Yan Z., Lin L., & Quan P. (2015). Polarization imaging by micro-polarizer array. Infrared and Laser Engineering, 44(10), 3117–3123.
  25. 25. Han D. (2013). Comparison of commonly used image interpolation methods. In Conference of the 2nd International Conference on Computer Science and Electronics Engineering (ICCSEE 2013) (pp. 1556–1559). Atlantis Press.
  26. 26. Brock N., Kimbrough B. T., & Millerd J. E. (2011). A pixelated micropolarizer-based camera for instantaneous interferometric measurements. In Polarization science and remote sensing V (Vol. 8160, pp. 290–298). SPIE.
  27. 27. Lalanne P., & Hugonin J. P. (1998). High-order effective-medium theory of subwavelength gratings in classical mounting: application to volume holograms. JOSA A, 15(7), 1843–1851.
  28. 28. Kalantari B. (2000). Generalization of taylor’s theorem and newton’s method via a new family of determinantal interpolation formulas and its applications. Journal of Computational and Applied Mathematics, 126(1–2), 287–318.
  29. 29. Wu Z., Guo L., & Zhu M. (2013). The Image registration method combining Image information entropy and feature points. Infrared Laser Eng, 42, 2846–2852.
  30. 30. Han P., Liu F., Wei Y., & Shao X. (2020). Optical correlation assists to enhance underwater polarization imaging performance. Optics and Lasers in Engineering, 134, 106256.
  31. 31. Bao F. (2019). Research on Underwater Polarization Imaging and Image Processing Methods. Changchun University of Science & Technology: Changchun, China.