US 12,292,367 B1
Imaging device and method for turbid oil abrasive particles based on polarized image enhancement
Liming Wang, Jinan (CN); Yu Du, Jinan (CN); Yanyan Nie, Jinan (CN); Fangyi Li, Jinan (CN); and Zihan Ye, Jinan (CN)
Assigned to SHANDONG UNIVERSITY, Jinan (CN)
Filed by SHANDONG UNIVERSITY, Jinan (CN)
Filed on Dec. 9, 2024, as Appl. No. 18/974,563.
Claims priority of application No. 202410494094.6 (CN), filed on Apr. 24, 2024.
Int. Cl. G01N 15/0227 (2024.01); G01N 15/0205 (2024.01); G01N 15/00 (2006.01); G01N 15/02 (2006.01)
CPC G01N 15/0227 (2013.01) [G01N 15/0211 (2013.01); G01N 2015/0053 (2013.01); G01N 15/0272 (2013.01)] 6 Claims
OG exemplary drawing
 
1. An imaging system for turbid oil abrasive particles based on polarized image enhancement, comprising
an equipment lubricating pipeline, a lubricating oil branch, an oil pump, a control terminal, and an imaging device for turbid oil abrasive particles based on polarized image enhancement, wherein
the equipment lubricating pipeline is in communication with the lubricating oil branch, the oil pump is connected to the lubricating oil branch, and the lubricating oil branch is in communication with an inlet and an outlet of a lubricating oil flow channel, and then is in communication with the equipment lubricating pipeline;
the control terminal is connected to a Stokes polarized CMOS sensor and the oil pump, respectively;
the imaging device for turbid oil abrasive particles based on polarized image enhancement comprises a CMOS fixing device, the Stokes polarized CMOS sensor, an optical lens sleeve and an optical magnifying glass, wherein the Stokes polarized CMOS sensor comprises a CMOS sensor and a Stokes analyzer;
the Stokes analyzer comprises a plurality of linear polarization units in different polarization directions, and all the linear polarization units are in one-to-one correspondence in pixels with the CMOS sensor;
the optical lens sleeve is connected to the CMOS fixing device, the optical magnifying glass is provided at a tail end of the optical lens sleeve, and the CMOS fixing device is fixedly connected to a housing;
a circular polarized light source is fixed inside the housing, optical glass connected to the inner wall of the housing is provided below the circular polarized light source, a gap between the bottom of the optical glass and the inner wall of the housing serves as the lubricating oil flow channel, and the inlet and the outlet of the lubricating oil flow channel are both formed in the housing;
a white diffused reflection coating is sprayed onto the flow channel bottom of the lubricating oil flow channel, the circular polarized light source comprises a circuit board, a circular white light source and a linear polarizer from top to bottom, the circuit board is connected to the circular white light source, and light from the circular white light source passes through the linear polarizer and changes from unpolarized natural white light to linearly polarized light with a specific polarization direction;
the intensity of background light and the intensity of target signal light after action by the analyzer can be expressed as:

OG Complex Work Unit Math
a relationship between a polarization direction θB of background light and Stokes vectors is:

OG Complex Work Unit Math
wherein S1 (B) is a light intensity difference between a 0° polarization component and a 90° polarization component of background scattered light, and S2 (B) is a light intensity difference between a 45° polarization component and a 135° polarization component of the background scattered light;
an image IPD of polarized abrasive particles is: IPD=S1 (T) sin 2 θB−S2 (T) cos 2 θB, wherein S1 (T) is a light intensity difference between a 0° polarization component and a 90° polarization component of the target signal light, S2 (T) is a light intensity difference between a 45° polarization component and a 135° polarization component of the target signal light, and θB is a polarization direction of the background light;
a final polarization difference image only contains Stokes vectors related to the intensity of the target signal light; to filter out the background scattered light, the entire process requires obtaining the Stokes vectors of the light and the angle of polarization of the background scattered light;
the oil pump operates at a set speed and starts the circular polarized light source with first set light intensity, the Stokes polarized CMOS sensor acquires an initial image and calculates an average gray value

OG Complex Work Unit Math
of the initial image, in the formula, M is a height of the image, N is a width of the image, and I (i, j) represents the gray value of a pixel with coordinates (i, j) in the image; then the average gray value GMean is judged:
if GMean≥130, it indicates that the overall brightness of the oil abrasive particle image is relatively high, reflected light generated by the white diffused reflection coating contributes major light intensity, indicating that oil is relatively clear, and a light scattering effect is disregarded; at this time, an imaging flow of normal oil abrasive particles is initiated: the Stokes polarized CMOS sensor records a video for a duration of t1 and saves the video in the Raspberry Pi, and parts of frames are extracted from the video to obtain an unpolarized abrasive particle image Iup;
if GMean<130, it indicates that the overall brightness of the image is dark, the oil is dark in color and high in turbidity, light generated by a light source is scattered by the turbid oil, and the intensity of the returned light is greatly reduced; at this time, an imaging flow of the turbid oil abrasive particles is initiated: firstly, the light intensity of the circular polarized light source is increased to IMAX=3/2I0 so as to compensate for scattering loss of the light and improve the brightness of the image; the Stokes polarized CMOS sensor records a video for a duration of t1 and saves the video in the Raspberry Pi, parts of frames are extracted from the video, and a single-frame image is decomposed into four images: I (0), I (45), I (90), and I (135) according to a pixel arrangement order; stokes vectors S0, S1 and S2 are calculated, and distribution probability of angle of polarizations of each pixel is calculated; the angle of polarization with the highest occurrence probability is selected as an angle of polarization of the background light; and finally, a polarization difference image corresponding to each video frame is obtained, after the imaging flow is completed, image data is uploaded to an upper computer, the Raspberry Pi turns off the oil pump, the Stokes polarized CMOS sensor, and the circular polarized light source, and a working flow is completed.