A system and method for compensating underwater object position with variable depth of field
Through the change-depth of field technology, the refractive index of the optical path is changed using spectroscopes, filters and electrovariate refractive index substances, which solves the problem of refractive index error in underwater measurements, and realizes accurate three-dimensional measurement and position compensation of underwater objects.
Patent Information
- Application Number
- CN202211705257.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-12-29
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2042-12-29
AI Technical Summary
Traditional binocular vision three-dimensional measurements are used to measure between different media due to the different refractive index of light, so the position of underwater objects cannot be accurately obtained, especially in underwater environments.
The position compensation system of underwater objects with varying depth of field is adopted, and the optical refractive index is changed through a spectrometer, filter and plane mirror design, combined with electrovariate refractive index substances, and the refractive index of the optical path is changed, using formulas to convert the virtual position into the actual position, and the average is obtained through multiple measurements. Compensate the value to eliminate errors caused by refractive index.
It realizes accurate three-dimensional measurements of underwater objects without using additional light sources, eliminating errors caused by refractive index and obtaining the most accurate position of underwater objects.
Smart Images

Figure CN116007588B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of single-pixel three-dimensional imaging, and in particular to a position compensation system and method for underwater objects with variable depth of field. Background Art
[0002] Traditional binocular vision 3D measurement uses the principle of triangulation to obtain the depth of an object through conversion between different coordinate systems. However, the two cameras of binocular vision are similar to human eyes. When measuring between different media, the light path will be offset when the light passes through materials with different refractive indices, which will cause errors and make it impossible to accurately obtain the actual position of the object. Especially underwater, for example, when measuring an object in front of a submarine, it is possible that the camera is not in direct contact with the water, and there may be air and glass blocking it, so there is this error caused by different refractive indices.
[0003] The existing binocular vision 3D measurement based on the principle of triangulation has measurement errors due to the different refractive indices of the two media, and cannot accurately obtain the position of the object. The existing underwater binocular vision measurement requires an additional light source to perform measurement. Summary of the invention
[0004] The present invention provides a position compensation system for underwater objects with variable depth of field, which can solve at least one of the above-mentioned technical problems.
[0005] To achieve the above object, the present invention adopts the following technical solutions:
[0006] A position compensation system for underwater objects with variable depth of field, comprising a beam splitter, a filter and a plane mirror, and a projector for projecting an illumination pattern, wherein the illumination pattern is divided into two left and right light paths through a beam splitter placed at 45 degrees;
[0007] The right light path passes through the beam splitter, passes through blue filter 1 and reaches the surface of the object. The reflected light intensity passes through blue filter 2 and is collected by photodetector 1.
[0008] The left light path is reflected by the beam splitter and then passes through the yellow filter 1, and then is reflected by the plane mirror to reach the front of a rectangular electro-variable refractive index material placed parallel to the projector. After being refracted in the electro-variable refractive index material, it reaches the surface of the object. The reflected light intensity passes through the yellow filter 2 and is collected by the photodetector 2.
[0009] When obtaining the position of an object with different refractive indices, the system can convert the virtual position information of the object into the actual position by transforming the formula, and obtain the accurate position information of the object by changing the refractive index multiple times through the electro-variable refractive index material through compensation.
[0010] Furthermore, the system uses a wide spectrum light source for illumination, splits the light through filters, and irradiates the object synchronously, and then simultaneously collects and restores images through different photodetectors.
[0011] On the other hand, the present invention also discloses a method for compensating the position of an underwater object with a variable depth of field, which uses the above-mentioned system for compensating the position of an underwater object with a variable depth of field, including building a light splitting structure in front of a projector, using a projector to realize two virtual projectors with different viewing angles for synchronous projection, and cooperating with two filters of different wavebands and two PDs to realize two equivalent virtual cameras with different viewing angles for synchronous acquisition;
[0012] The specific steps include:
[0013] First, the whole system is dual-targeted;
[0014] Through this system, the two-dimensional images of the stereo calibration plate of the left and right perspectives are acquired synchronously, and the two-dimensional images are calibrated, and the binocular calibration results are obtained later;
[0015] Then, the two-dimensional images of the object in the left and right perspectives are obtained synchronously, and the calibration results are used to correct and stereo match the images. Finally, the three-dimensional reconstruction of the object is completed, the virtual position of the object is obtained, and the actual position is derived.
[0016] Furthermore, completing the three-dimensional reconstruction of the object and obtaining the virtual position of the object specifically includes:
[0017] Assume plane II r It is the interface between two media with different refractive indices n and n′. The plane equation is n c X+n y Y+n z X+d1=0, its normal vector is N r =[n x ,n y ,n z ]; point P (X, Y, Z) is the actual position of the object, and the incident light C r P, the refracted light intersects CP at P r point, so P r (X r ,X r ,Z r ) is the virtual position of the object; the unit vectors of the incident light and the refracted light are V and V respectively r ;
[0018] Based on geometric considerations and the law of refraction, P and P r The conversion between them is expressed as:
[0019]
[0020] in:
[0021] The actual position coordinates of the object are solved in this way, and then the refractive index is changed by adding voltage to the electrovariable refractive index material to further obtain the virtual position of the object.
[0022] Furthermore, the steps to derive the actual position are as follows:
[0023] Suppose after changing the refractive index n times, the actual position obtained n times is P i (X i ,Y i ,Z i ), according to the formula:
[0024]
[0025] Get the actual position P′(X′, Y′, Z′) of the object with the best accuracy.
[0026] It can be seen from the above technical solutions that the position compensation system for underwater objects with variable depth of field of the present invention compensates for the three-dimensional position of underwater objects by multiple measurements with variable depth of field, thereby obtaining the precise position of underwater objects and eliminating the error caused by refractive index.
[0027] The present invention applies voltage to the electro-variable refractive index material through the design of the optical path to change its refractive index, thereby changing the optical path of the left optical path to achieve the effect of variable depth of field. The binocular vision is applied to single-pixel three-dimensional imaging to obtain the virtual position of the object underwater, and convert it into the actual position of the object through a formula. The actual position of the underwater object is obtained multiple times by changing the depth of field, and the average value is taken for compensation to eliminate the error caused by the refractive index and obtain the most accurate actual position of the object in the water.
[0028] The present invention can compensate the actual position of the underwater object by varying the depth of field, eliminate the error caused by the refractive index, and obtain the precise actual position of the object; the present invention can perform three-dimensional measurement of the underwater object without using an additional light source. BRIEF DESCRIPTION OF THE DRAWINGS
[0029] Figure 1 It is a schematic diagram of the structure of the present invention;
[0030] Figure 2 is a light path diagram of a light source passing through a rectangular electro-variable refractive index material according to an embodiment of the present invention;
[0031] Figure 3 It is a schematic diagram of the refraction of light entering different media;
[0032] 1. Projector, 2. Adjustable DC regulated power supply, 3. Spectrometer, 4. Yellow filter one, 5. Plane mirror, 6. Blue filter one, 7. Electro-variable refractive index material, 8. Photodetector one, 9. Blue filter two, 10. Photodetector two, 11. Yellow filter two, 12. Object. DETAILED DESCRIPTION
[0033] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments.
[0034] like Figure 1 The figure shows the device diagram of the whole system. The device can be regarded as two independent single-pixel imaging systems by using a beam splitter 3, a filter and a plane mirror 5. Since two pairs of filters with non-overlapping wavelength ranges are used, the two systems do not interfere with each other and can synchronously restore the two-dimensional image of the object. When obtaining the position of an object with different refractive indices, the system can convert the virtual position information of the object into the actual position by transforming the formula, and change the refractive index multiple times through the electro-variable refractive index material to obtain the accurate position information of the object through compensation.
[0035] The system uses a broad spectrum light source for illumination, splits the light through filters, illuminates the object synchronously, and then simultaneously collects and restores images through different photodetectors.
[0036] The system constructs a light splitting structure in front of the projector, uses one projector to realize two virtual projectors with different perspectives for synchronous projection, and cooperates with two filters of different bands and two PDs to realize the equivalent of two virtual cameras with different perspectives for synchronous acquisition.
[0037] The following are specific instructions:
[0038] The projector projects an illumination pattern, which is a pre-set coding pattern, which can be generated based on a Fourier basis, a Hadamard basis, or randomly generated. The illumination pattern is divided into two left and right optical paths through a 45-degree beam splitter. The right optical path passes through the beam splitter, passes through a blue filter 6, and reaches the surface of the object. The reflected light intensity passes through a blue filter 9 and is collected by a photodetector 8; the left optical path passes through a yellow filter 4 after being reflected by a beam splitter 3, and then is reflected by a plane mirror 5 to reach the front of a rectangular electro-variable refractive index material placed parallel to the projector 1, and reaches the surface of the object after being refracted in the electro-variable refractive index material. The reflected light intensity passes through a yellow filter 11 and is collected by a photodetector 1.
[0039] First, the entire system is binocularly calibrated. Through this system, the two-dimensional images of the stereo calibration plate of the left and right perspectives are synchronously obtained, and they are calibrated, and the binocular calibration results are subsequently obtained. Then, the two-dimensional images of the objects of the left and right perspectives are synchronously obtained, and the calibration results are used to correct and stereo match the images, and finally the three-dimensional reconstruction of the object is completed to obtain the virtual position of the object 12.
[0040] like Figure 2 The incident angle is α, the refraction angle is β, the thickness of the electrovariable refractive index material is L, and after passing through the electrovariable refractive index material, the incident light and the outgoing light are parallel to each other, and the offset between the actual position and the virtual position is L1. The formula can be derived to obtain
[0041] L1=L-Lcotαtanβ
[0042] According to the law of refraction, the ratio of the sine of the incident angle to the sine of the refraction angle is a constant, that is: Where n 21 It is called the relative refractive index of the second medium to the first medium. Therefore, when the incident angle is constant, when the refractive index of the first medium or the second medium is changed, the refraction angle will also change, and the position of the outgoing light will also change, thereby achieving a certain variable depth of field effect.
[0043] Since the entire device is in the air and the object to be measured is in the water, errors will occur due to the difference in refractive index. Figure 3 As shown, plane II r It is the interface between two media with different refractive indices n and n′. The plane equation is n x X+n y Y+n z Z+d1=0, its normal vector is N r =[n x ,n y ,n z Point P (X, Y, Z) is the actual position of the object, and the incident light C r P, the refracted light intersects CP at P r point, so P r (X r ,Y r ,Z r ) is the virtual position of the object. The unit vectors of the incident and refracted light are V and V respectively. r Based on geometric considerations and the law of refraction, P and P r The conversion between them can be expressed as:
[0044]
[0045] in:
[0046] From this, the actual position coordinates of the object can be solved, and then by adding voltage to the electro-variable refractive index material to change the refractive index, the virtual position of the object can be obtained and the actual position can be deduced. After changing the refractive index n times, the actual position obtained n times is P i (X i ,Y i ,Z i ), according to the formula:
[0047]
[0048] Get the actual position P′(X′, Y′, Z′) of the object with the best accuracy.
[0049] Among them, the combination of the beam splitter and the filter in the embodiment of the present invention can be replaced by a dichroic mirror; the electrovariable refractive index material can also be removed, and the effect of variable depth of field can be achieved by rotating the plane mirror or the beam splitter; the photodetector can be replaced by a photocell, a photodiode or other photoelectric device that can respond linearly to light intensity information; when the target image is encoded using a projection pattern, it can be based on Fourier transform, or on cosine transform, Hadamard transform, Radon transform, etc.
[0050] In summary, the present invention applies voltage to the electro-variable refractive index material through the design of the optical path to change its refractive index, thereby changing the optical path of the left optical path to achieve the effect of variable depth of field. Binocular vision is applied to single-pixel three-dimensional imaging to obtain the virtual position of the object underwater, and convert it into the actual position of the object through a formula. The actual position of the underwater object is obtained multiple times by changing the depth of field, and the average value is taken for compensation to eliminate the error caused by the refractive index and obtain the most accurate actual position of the object in the water.
[0051] The present invention can compensate the actual position of the underwater object by varying the depth of field, eliminate the error caused by the refractive index, and obtain the precise actual position of the object; the present invention can perform three-dimensional measurement of the underwater object without using an additional light source.
[0052] In yet another aspect, the present invention further discloses a computer-readable storage medium storing a computer program, wherein when the computer program is executed by a processor, the processor executes the steps of any of the above methods.
[0053] On the other hand, the present invention further discloses a computer device, including a memory and a processor, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor executes the steps of any of the above methods.
[0054] In another embodiment provided by the present application, a computer program product including instructions is also provided, which, when executed on a computer, enables the computer to execute the steps of any method in the above embodiments.
[0055] It is understandable that the system provided by the embodiment of the present invention corresponds to the method provided by the embodiment of the present invention, and the explanation, examples and beneficial effects of the relevant contents can refer to the corresponding parts in the above method.
[0056] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a non-volatile computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
[0057] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0058] The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims
1. A position compensation system for underwater objects with variable depth of field, comprising a beam splitter, a filter and a plane mirror, characterized in that: It also includes a projector projecting an illumination pattern, and the illumination pattern is divided into two left and right light paths through a beam splitter placed at 45 degrees; The right light path passes through the beam splitter, passes through blue filter 1 and reaches the surface of the object. The reflected light intensity passes through blue filter 2 and is collected by photodetector 1. The left light path is reflected by the beam splitter and then passes through the yellow filter 1, and then is reflected by the plane mirror to reach the front of a rectangular electro-variable refractive index material placed parallel to the projector. After being refracted in the electro-variable refractive index material, it reaches the surface of the object. The reflected light intensity passes through the yellow filter 2 and is collected by the photodetector 2. When obtaining the position of an object with different refractive indices, the position compensation system converts the virtual position information of the object into the actual position through the transformation of the formula, and changes the refractive index multiple times through the electro-variable refractive index material to obtain the accurate position information of the object through compensation, as follows: Assume plane II r Have different refractive indices and The plane equation of the interface between two media is , whose normal vector is ;point is the actual position of the object, the incident light , refracted light and Hand in point, so is the virtual position of the object; the unit vectors of the incident light and the refracted light are and ; Based on geometric considerations and the law of refraction, The conversion between them is expressed as: in: , , ; The actual position coordinates of the object are solved, and then the refractive index is changed by applying voltage to the electro-variable refractive index material, thereby further obtaining the virtual position of the object; The steps to derive the actual position are as follows: Suppose that after changing the refractive index n times, the actual position obtained n times is , according to the formula: Get the actual position of the object with the best accuracy .
2. The position compensation system for underwater objects with variable depth of field according to claim 1, characterized in that: The position compensation system uses a wide spectrum light source for illumination, splits the light through a filter, irradiates the object synchronously, and then collects and restores images simultaneously through different photodetectors.
3. A method for compensating the position of an underwater object with a variable depth of field, using the position compensation system for an underwater object with a variable depth of field according to claim 1 or 2, characterized in that: The following steps are included: By building a light splitting structure in front of the projector, one projector can be used to realize two virtual projectors with different perspectives for synchronous projection. With two filters of different wavelengths and two PDs, two equivalent virtual cameras with different perspectives for synchronous acquisition can be realized. Specifically, it includes firstly conducting a dual-target positioning of the entire system; Through this system, the two-dimensional images of the stereo calibration plate of the left and right perspectives are acquired synchronously, and the two-dimensional images are calibrated, and the binocular calibration results are obtained later; Then, the two-dimensional images of the object in the left and right perspectives are obtained synchronously, and the calibration results are used to correct and stereo match the images. Finally, the three-dimensional reconstruction of the object is completed, the virtual position of the object is obtained, and the actual position is derived.
