Split type binocular stereo system design method, device and equipment and storage medium
Through the principle of binocular stereo vision and ZEMAX non-sequence mode optimization of binocular camera parameters, the split binocular stereo system is designed, which solves the problems of high design complexity and cost in the existing technology and achieves a more efficient design process.
Patent Information
- Application Number
- CN202411228594.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-03
- Publication Date
- 2024-11-26
AI Technical Summary
The existing split binocular three-dimensional system design process is complex and costly, and lacks intuitive optical design representation and cumbersome modeling process.
Through the principle of binocular stereo vision, the binocular camera is selected, and the non-sequence mode of ZEMAX is used to simulate position information and optimize parameter, determine the target design scheme, and design a split binocular stereo system.
It effectively reduces the complexity and design cost of split binocular three-dimensional system design, and improves design efficiency and reliability.
Smart Images

Figure CN119031111A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of data processing technology, and in particular to a design method, device, equipment and storage medium for a split binocular stereo system. Background Art
[0002] With the rapid development of computer vision technology, binocular stereo vision, as an important branch, has gradually become the most important distance perception technology in computer passive ranging methods due to its advantages such as low cost, high efficiency, simple structure and moderate accuracy. Since Marr of the Artificial Intelligence Laboratory of MIT proposed the visual computing theory and applied it to binocular matching in the 1980s, binocular stereo vision technology has gradually laid its theoretical foundation and has been widely studied and applied in the following decades.
[0003] The split binocular stereo system usually consists of two independent cameras, which simultaneously capture two digital images of the object being measured from different angles. The two images are processed by a stereo vision method based on the parallax principle to restore the three-dimensional geometric information of the object, and then reconstruct the three-dimensional contour and position of the object.
[0004] At present, for split binocular vision systems, the selection of devices depends more on the design engineers' experience based on the target system, and the simulation verification in the design process is more often done using mechanical industry software such as SolidWorks. This lacks a more intuitive expression for optical design, and the modeling process is also cumbersome and the design cost is high.
[0005] Therefore, there is an urgent need for a split binocular stereo system design method that can effectively reduce the complexity and design cost of the split binocular stereo system design. Summary of the invention
[0006] The main purpose of the present invention is to provide a split binocular stereo system design method, device, equipment and storage medium, aiming to solve the technical problems of complex process and high design cost of the split binocular stereo system design in the prior art.
[0007] To achieve the above object, the present invention provides a split binocular stereo system design method, the method comprising the following steps:
[0008] Through the principle of binocular stereo vision, the binocular camera is selected according to the application scenario information and functional requirement information;
[0009] Using the non-sequential mode of ZEMAX to simulate the position information of the binocular camera to obtain a position simulation result;
[0010] Optimizing the parameters of the binocular camera based on the position simulation result to achieve parameter optimization of the binocular camera and obtain target binocular camera parameters;
[0011] A target design scheme is determined according to the target binocular camera parameters, and a split binocular stereo system is designed based on the target design scheme.
[0012] Optionally, the position information includes binocular placement width, binocular placement working distance, binocular diagonal, binocular elevation angle and binocular height, and the step of simulating the position information of the binocular camera using the non-sequential mode of ZEMAX to obtain the position simulation result includes:
[0013] Using the spatial position information of the dual-angle light source in the non-sequential mode of ZEMAX to simulate the binocular placement width and the binocular placement working distance of the binocular camera, a first simulation result is obtained;
[0014] The binocular diagonal angle and the binocular elevation angle of the binocular camera are simulated by using the spatial angle information of the binocular light source in the non-sequential mode of ZEMAX to obtain a second simulation result;
[0015] The binocular height of the binocular camera is simulated by adjusting the height difference between the binocular camera and the center of the calibration plate to obtain a third simulation result;
[0016] The first simulation result, the second simulation result and the third simulation result are used as position simulation results.
[0017] Optionally, before the step of simulating the position information of the binocular camera using the non-sequential mode of ZEMAX to obtain the position simulation result, the step further includes:
[0018] Determine the accuracy of the calibration plate according to the application scenario information and the functional requirement information;
[0019] Determine the size of the calibration plate pattern according to the resolution and shooting range of the binocular camera;
[0020] Determine the material and manufacturing process of the calibration plate according to the accuracy and preset cost requirements of the calibration plate;
[0021] The calibration plate is selected based on the calibration plate accuracy, calibration plate pattern size, calibration plate material and calibration plate manufacturing process.
[0022] Optionally, after the step of selecting a calibration plate based on the calibration plate accuracy, calibration plate pattern size, calibration plate material and calibration plate manufacturing process, the step further includes:
[0023] After obtaining the position information of the binocular camera, determining the front and rear focusing stroke of the binocular camera;
[0024] Based on the front-to-back focus stroke, determining whether the depth of field of the lens of the binocular camera covers the front-to-back focus stroke, whether the depth of field of the lens of the binocular camera needs to be increased, and whether the binocular camera needs fill light;
[0025] The binocular camera is focused and debugged according to the judgment result.
[0026] Optionally, the step of selecting a binocular camera based on the binocular stereo vision principle and application scenario information and functional requirement information includes:
[0027] Determine application scenario information and functional requirement information of the binocular camera, and analyze the application scenario information and the functional requirement information to obtain an analysis result;
[0028] Determine the lighting conditions, object motion state, field of view, and resolution requirements in the application scenario based on the analysis results;
[0029] Through the binocular stereo vision principle, the binocular camera is selected based on the lighting conditions, the object motion state, the field of view and the resolution requirements.
[0030] Optionally, the step of selecting a binocular camera based on the lighting condition, the object motion state, the field of view and the resolution requirement by using the binocular stereo vision principle includes:
[0031] Determining the camera type of the binocular camera based on the lighting conditions and the motion state of the object by using the binocular stereo vision principle;
[0032] Determining the lens and sensor size of the binocular camera according to the field of view and the resolution requirement;
[0033] Matching devices from a target database based on the camera type, the lens, and the sensor size to obtain a matching result;
[0034] The camera performance is evaluated based on the matching result, and when the evaluation result meets the functional requirement information, the binocular camera is selected based on the matching result.
[0035] Optionally, the step of optimizing the parameters of the binocular camera based on the position simulation result to optimize the parameters of the binocular camera and obtain the parameters of the target binocular camera includes:
[0036] Based on the position simulation results, corresponding calibration images and spatial calibration accuracy are respectively collected;
[0037] Restoring the spatial coefficient according to the calibration image, and recording the spatial accuracy according to the spatial calibration accuracy;
[0038] The parameters of the binocular camera are optimized by using the spatial coefficient and the spatial precision to achieve parameter optimization of the binocular camera and obtain target binocular camera parameters.
[0039] In addition, to achieve the above-mentioned purpose, the present invention also proposes a split binocular stereo system design device, the device comprising:
[0040] The hardware selection module is used to select the binocular camera based on the application scenario information and functional requirement information through the binocular stereo vision principle;
[0041] A position simulation module, used to simulate the position information of the binocular camera using a non-sequential mode of ZEMAX to obtain a position simulation result;
[0042] A parameter optimization module, used for optimizing the parameters of the binocular camera based on the position simulation result, so as to optimize the parameters of the binocular camera and obtain target binocular camera parameters;
[0043] The design confirmation module is used to determine a target design scheme according to the target binocular camera parameters, and design a split binocular stereo system based on the target design scheme.
[0044] In addition, to achieve the above-mentioned purpose, the present invention also proposes a split binocular stereo system design device, which includes: a memory, a processor, and a split binocular stereo system design program stored in the memory and executable on the processor, and the split binocular stereo system design program is configured to implement the steps of the split binocular stereo system design method as described above.
[0045] In addition, to achieve the above-mentioned purpose, the present invention also proposes a storage medium, on which a split binocular stereo system design program is stored. When the split binocular stereo system design program is executed by a processor, the steps of the split binocular stereo system design method described above are implemented.
[0046] The present invention discloses the selection of a binocular camera according to application scenario information and functional requirement information through the principle of binocular stereo vision; the position information of the binocular camera is simulated using the non-sequential mode of ZEMAX to obtain a position simulation result; the parameters of the binocular camera are optimized based on the position simulation result to optimize the parameters of the binocular camera and obtain target binocular camera parameters; a target design scheme is determined based on the target binocular camera parameters, and a split binocular stereo system is designed based on the target design scheme. Since the present invention selects the binocular camera, simulates the position information of the binocular camera using the non-sequential mode of ZEMAX, and then optimizes the parameters of the binocular camera based on the position simulation result, and finally determines the target design scheme, compared with the prior art, the present invention effectively reduces the complexity and design cost of the split binocular stereo system design. BRIEF DESCRIPTION OF THE DRAWINGS
[0047] Figure 1 It is a flow chart of the first embodiment of the split binocular stereo system design method of the present invention;
[0048] Figure 2 It is a flow chart of the second embodiment of the split binocular stereo system design method of the present invention;
[0049] Figure 3 It is a flow chart of a third embodiment of the split binocular stereo system design method of the present invention;
[0050] Figure 4 It is a structural block diagram of the first embodiment of the split binocular stereo system design device of the present invention;
[0051] Figure 5 It is a structural schematic diagram of a split binocular stereo system design device in the hardware operating environment involved in the embodiment of the present invention.
[0052] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION
[0053] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.
[0054] The embodiment of the present invention provides a split binocular stereo system design method, referring to Figure 1 , Figure 1 Schematic diagram of the flow of the first embodiment of the split binocular stereo system design method of the present invention.
[0055] In this embodiment, the split binocular stereo system design method includes the following steps, step S10 to step S40:
[0056] Step S10: Based on the binocular stereo vision principle, the binocular camera is selected according to the application scenario information and functional requirement information.
[0057] It should be noted that the execution subject of this embodiment can be a computer server device with data processing, network communication and program running functions applied to the split binocular stereo system design scenario, such as a personal computer, a laptop computer, a mobile phone, a smart watch, etc., or an electronic device capable of realizing the above functions, a split binocular stereo system design device, etc. The following takes the split binocular stereo system design device as an example to illustrate this embodiment and the following embodiments.
[0058] It should be understood that binocular stereo vision is an important form of machine vision, and its principle is mainly based on the parallax principle, that is, using an imaging device (usually two cameras) to obtain two images of the object to be measured from different positions, and then calculating the position deviation (parallax) between corresponding points in the two images to obtain the three-dimensional geometric information of the object.
[0059] It should be noted that the above-mentioned application scenario information may include but is not limited to the specific application scenario of the above-mentioned binocular camera, the lighting conditions in the application scenario, the object motion state and the field of view, etc.
[0060] The above functional requirement information may include but is not limited to the measurement accuracy, resolution, depth perception range and specific image processing functions (for example, automatic exposure, white balance adjustment, etc.) of the above binocular camera.
[0061] It should be explained that the selection of the above-mentioned binocular camera includes: the minimum resolution requirement of the binocular camera, the lens parameters of the binocular camera, the sensor size, frame rate and interface type, etc.
[0062] Step S20: simulating the position information of the binocular camera using the non-sequential mode of ZEMAX to obtain a position simulation result.
[0063] It should be noted that ZEMAX is a comprehensive optical design simulation software. ZEMAX's non-sequential mode is a powerful ray tracing function that allows light to pass through optical elements in any order and allows light to be split, scattered and reflected back to the objects it has passed through. This feature enables the non-sequential mode to analyze stray light, scattering and lighting problems in any system type.
[0064] It should be understood that in non-sequential mode, optical elements are created as true three-dimensional objects, which can exist in the form of surfaces or solids. Each object is defined by x, y, z coordinates in a global coordinate system, and the definition of each object's coordinates and orientation is independent of each other.
[0065] It should be noted that the position information of the above binocular camera includes binocular placement width, binocular placement working distance, binocular diagonal, binocular elevation angle and binocular height.
[0066] It needs to be explained that the binocular placement width comes from the width of the main light path. The minimum binocular placement width needs to be larger than the width of the main light path, and the maximum binocular placement width needs to be smaller than the base width of the system (or comes from the appearance requirements). In the simulation software, it is the spatial position (X, Y) of the dual-angle light source.
[0067] Binocular working distance: The minimum distance comes from the functional working distance, and the maximum distance depends on whether there is screen obstruction, as well as appearance and structural requirements. In the simulation software, it is the spatial position (Z) of the dual-angle light source.
[0068] Binocular diagonal: the relative angle between the two eyes. The biggest factor depends on the eye-to-eye distance and the binocular placement width. It can be adjusted. According to the algorithm calibration requirements, the larger the binocular diagonal is and the closer it is to parallel, the more friendly it is to algorithm correction and accuracy improvement. In the simulation software, it is the spatial angle of the two-angle light source (tilt X, tilt Y).
[0069] Binocular elevation angle: The binocular can have a certain elevation angle, which is determined by the overall coordination and functionality. On the one hand, the binocular elevation angle can avoid the maximum width of the main light path, reduce the maximum diameter of the measurement window, and reduce the protrusion. On the other hand, it can largely avoid the interference of eyelashes on pupil recognition in terms of functionality. However, the specific angle should be determined according to the actual situation. A large elevation angle will also affect the algorithm correction and accuracy improvement. In the simulation software, it is the spatial angle of the dual-angle light source (tilt Z).
[0070] Binocular height: For the current binocular tooling, everything is assumed to be the center of the calibration plate as the center of the main light path. Therefore, the height difference between the main light path and the binocular can be achieved by adjusting the height difference between the binocular and the center of the calibration plate. Among them, the binocular height is related to the binocular elevation angle.
[0071] It should be understood that a dual-angle light source may refer to a light source having two different angles or illumination characteristics.
[0072] It should be noted that, compared with the traditional geometric calculation method, the use of dual-angle light sources in this embodiment can better simulate the two parameters of horizontal field of view and vertical field of view used in reality; the object model can be actually placed in the front, and the spatial pixel ratio under theoretical conditions can be obtained by evaluating the number of light impacts; the actual simulation of the occlusion situation can be obtained in the actual usage scenario; the position of the current position in the binocular picture can be seen. This embodiment effectively ensures the effectiveness of the split binocular stereo system design by using dual-angle light sources.
[0073] Step S30: Optimizing the parameters of the binocular camera based on the position simulation result to achieve parameter optimization of the binocular camera and obtain target binocular camera parameters.
[0074] It is understandable that the parameters of the binocular camera may include basic camera parameters, binocular vision system-specific parameters and external parameters. The basic camera parameters may include resolution, frame rate, field of view, focal length and baseline length, etc.; the binocular vision system-specific parameters may include depth perception accuracy, stereo matching algorithm, and is an illustration; the external parameters may include the relative position relationship between the two cameras, and the relative position relationship may be represented by the rotation matrix R (describing the rotation relationship between the two camera coordinate systems) and the translation matrix T (describing the translation relationship between the two camera coordinate systems).
[0075] In a specific implementation, corresponding calibration images and spatial calibration accuracy can be collected respectively based on the position simulation results; the spatial coefficient is restored according to the calibration image, and the spatial accuracy is recorded according to the spatial calibration accuracy; the parameters of the binocular camera are optimized by the spatial coefficient and the spatial accuracy to achieve parameter optimization of the binocular camera and obtain the target binocular camera parameters.
[0076] Step S40: determining a target design scheme according to the target binocular camera parameters, and designing a split binocular stereo system based on the target design scheme.
[0077] This embodiment discloses the selection of a binocular camera according to application scenario information and functional requirement information through the principle of binocular stereo vision; the position information of the binocular camera is simulated using the non-sequential mode of ZEMAX to obtain a position simulation result; the parameters of the binocular camera are optimized based on the position simulation result to optimize the parameters of the binocular camera and obtain target binocular camera parameters; a target design scheme is determined based on the target binocular camera parameters, and a split binocular stereo system is designed based on the target design scheme. Since this embodiment selects the binocular camera, simulates the position information of the binocular camera using the non-sequential mode of ZEMAX, and then optimizes the parameters of the binocular camera based on the position simulation result, and finally determines the target design scheme, compared with the prior art, this embodiment effectively reduces the complexity and design cost of the split binocular stereo system design.
[0078] refer to Figure 2 , Figure 2 Schematic diagram of the flow chart of the second embodiment of the split binocular stereo system design method of the present invention.
[0079] Based on the above first embodiment, in this embodiment, step S20 includes steps S201 to S204:
[0080] Step S201: simulating the binocular placement width and the binocular placement working distance of the binocular camera by using the spatial position information of the dual-angle light source in the non-sequential mode of ZEMAX to obtain a first simulation result.
[0081] Step S202: simulating the binocular diagonal angle and the binocular elevation angle of the binocular camera by using the spatial angle information of the binocular light source in the non-sequential mode of ZEMAX to obtain a second simulation result.
[0082] Step S203: simulating the binocular height of the binocular camera by adjusting the height difference between the binocular camera and the center of the calibration plate to obtain a third simulation result.
[0083] Step S204: taking the first simulation result, the second simulation result and the third simulation result as position simulation results.
[0084] It should be noted that a dual-angle light source may refer to a light source having two different angles or illumination characteristics.
[0085] Binocular placement width: comes from the width of the main light path. The minimum binocular placement width needs to be larger than the width of the main light path, and the maximum binocular placement width needs to be smaller than the base width of the system (or comes from the appearance requirements). In the simulation software, it is the spatial position (X, Y) of the dual-angle light source.
[0086] Binocular working distance: The minimum distance comes from the functional working distance, and the maximum distance depends on whether there is screen obstruction, as well as appearance and structural requirements. In the simulation software, it is the spatial position (Z) of the dual-angle light source.
[0087] The spatial position information of the dual-angle light source is the spatial position (X, Y, Z) of the dual-angle light source.
[0088] Binocular diagonal: the relative angle between the two eyes. The biggest factor depends on the eye-to-eye distance and the binocular placement width. It can be adjusted. According to the algorithm calibration requirements, the larger the binocular diagonal is and the closer it is to parallel, the more friendly it is to algorithm correction and accuracy improvement. In the simulation software, it is the spatial angle of the two-angle light source (tilt X, tilt Y).
[0089] Binocular elevation angle: The binocular can have a certain elevation angle, which is determined by the overall coordination and functionality. On the one hand, the binocular elevation angle can avoid the maximum width of the main light path, reduce the maximum diameter of the measurement window, and reduce the protrusion. On the other hand, it can largely avoid the interference of eyelashes on pupil recognition in terms of functionality. However, the specific angle should be determined according to the actual situation. A large elevation angle will also affect the algorithm correction and accuracy improvement. In the simulation software, it is the spatial angle of the dual-angle light source (tilt Z).
[0090] The spatial angle information of the dual-angle light source is the spatial angle of the dual-angle light source (tilt X, tilt Y, tilt Z).
[0091] Binocular height: For the current binocular tooling, everything is assumed to be the center of the calibration plate as the center of the main light path. Therefore, the height difference between the main light path and the binocular can be achieved by adjusting the height difference between the binocular and the center of the calibration plate. Among them, the binocular height is related to the binocular elevation angle.
[0092] It should be noted that, before the step of simulating the position information of the binocular camera using the non-sequential mode of ZEMAX to obtain the position simulation result, it also includes: determining the accuracy of the calibration plate according to the application scenario information and the functional requirement information; determining the pattern size of the calibration plate according to the resolution and shooting range of the binocular camera; determining the material and manufacturing process of the calibration plate according to the accuracy of the calibration plate and the preset cost requirements; and selecting the calibration plate based on the accuracy of the calibration plate, the pattern size of the calibration plate, the material of the calibration plate and the manufacturing process of the calibration plate.
[0093] In order to ensure the reliability of the simulation, after the step of selecting the calibration plate based on the accuracy of the calibration plate, the pattern size of the calibration plate, the material of the calibration plate and the manufacturing process of the calibration plate, the method further includes: after obtaining the position information of the binocular camera, determining the front and rear focus stroke of the binocular camera (the default three-axis stroke is ±20mm front and rear); based on the front and rear focus stroke, judging whether the lens depth of field of the binocular camera covers the front and rear focus stroke, whether the binocular camera needs to increase the lens depth of field, and whether the binocular camera needs fill light; and focusing the binocular camera according to the judgment result.
[0094] It should be noted that in this embodiment, the default eye-to-eye distance and the binocular position under the default binocular width are used for focus debugging, the calibration plate is located at the binocular diagonal angle at the center of the image, there is no binocular elevation angle, and the binocular and the calibration plate are at the same height. In addition, it is necessary to record the image screen ratio of the calibration plate, the complete image range under the full stroke, and the image blind area.
[0095] This embodiment discloses using the spatial position information of the dual-angle light source in the non-sequential mode of ZEMAX to simulate the binocular placement width and the binocular placement working distance of the binocular camera to obtain a first simulation result; using the spatial angle information of the dual-angle light source in the non-sequential mode of ZEMAX to simulate the binocular diagonal and the binocular elevation angle of the binocular camera to obtain a second simulation result; simulating the binocular height of the binocular camera by adjusting the height difference between the binocular camera and the center of the calibration plate to obtain a third simulation result; the first simulation result, the second simulation result and the third simulation result are used as position simulation results. Compared with the prior art, this embodiment uses the non-sequential mode of ZEMAX to simulate the position information of the binocular camera, which not only reduces the complexity of the split binocular stereo system design, but also ensures the reliability of the split binocular stereo system design.
[0096] refer to Figure 3 , Figure 3 Schematic diagram of the flow chart of the third embodiment of the split binocular stereo system design method of the present invention.
[0097] Based on the above embodiments, in this embodiment, step S10 includes steps S101 to S103:
[0098] Step S101: determining application scenario information and functional requirement information of the binocular camera, and analyzing the application scenario information and the functional requirement information to obtain an analysis result.
[0099] Step S102: determining the lighting conditions, object motion state, field of view and resolution requirements in the application scene according to the analysis results.
[0100] Step S103: using the binocular stereoscopic vision principle, a binocular camera is selected based on the lighting conditions, the object motion state, the field of view and the resolution requirement.
[0101] It should be noted that, in order to ensure the effectiveness of the selection of the binocular camera, step S103 includes: determining the camera type of the binocular camera based on the lighting conditions and the motion state of the object through the principle of binocular stereo vision; determining the lens and sensor size of the binocular camera according to the field of view and the resolution requirements; matching devices from a target database based on the camera type, the lens and the sensor size to obtain a matching result; evaluating the camera performance of the matching result, and when the evaluation result meets the functional requirement information, selecting the binocular camera according to the matching result.
[0102] This embodiment discloses determining the application scenario information and functional requirement information of the binocular camera, and analyzing the application scenario information and the functional requirement information to obtain analysis results; determining the lighting conditions, object motion state, field of view and resolution requirements in the application scenario according to the analysis results; determining the camera type of the binocular camera based on the lighting conditions and the object motion state through the binocular stereo vision principle; determining the lens and sensor size of the binocular camera according to the field of view and the resolution requirements; matching devices from a target database based on the camera type, the lens and the sensor size to obtain matching results; evaluating the camera performance of the matching results, and when the evaluation results meet the functional requirement information, selecting the binocular camera according to the matching results. Compared with the prior art, since this embodiment evaluates the camera performance of the matching results, and when the evaluation results meet the functional requirement information, selecting the binocular camera according to the matching results, thereby effectively ensuring the effectiveness of the selection of the binocular camera.
[0103] In addition, an embodiment of the present invention further proposes a storage medium, on which a split binocular stereo system design program is stored. When the split binocular stereo system design program is executed by a processor, the steps of the split binocular stereo system design method described above are implemented.
[0104] Reference Figure 4 , Figure 4 It is a structural block diagram of the first embodiment of the split binocular stereo system design device of the present invention.
[0105] like Figure 4 As shown, the split binocular stereo system design device proposed in the embodiment of the present invention includes: a hardware selection module 401, a position simulation module 402, a parameter optimization module 403 and a design confirmation module 404.
[0106] The hardware selection module 401 is used to select a binocular camera according to application scenario information and functional requirement information based on the binocular stereo vision principle;
[0107] The position simulation module 402 is used to simulate the position information of the binocular camera using the non-sequential mode of ZEMAX to obtain a position simulation result;
[0108] The parameter optimization module 403 is used to optimize the parameters of the binocular camera based on the position simulation result to achieve parameter optimization of the binocular camera and obtain target binocular camera parameters;
[0109] The design confirmation module 404 is used to determine a target design scheme according to the target binocular camera parameters, and design a split binocular stereo system based on the target design scheme.
[0110] The parameter optimization module 403 is also used to collect corresponding calibration pictures and spatial calibration accuracy based on the position simulation results; restore the spatial coefficient according to the calibration picture, and record the spatial accuracy according to the spatial calibration accuracy; optimize the parameters of the binocular camera through the spatial coefficient and the spatial accuracy to achieve parameter optimization of the binocular camera and obtain the target binocular camera parameters.
[0111] The present device embodiment discloses the selection of a binocular camera according to application scenario information and functional requirement information through the principle of binocular stereo vision; the position information of the binocular camera is simulated using the non-sequential mode of ZEMAX to obtain a position simulation result; the parameters of the binocular camera are optimized based on the position simulation result to optimize the parameters of the binocular camera and obtain target binocular camera parameters; a target design scheme is determined based on the target binocular camera parameters, and a split binocular stereo system is designed based on the target design scheme. Since the present device embodiment selects the binocular camera, simulates the position information of the binocular camera using the non-sequential mode of ZEMAX, and then optimizes the parameters of the binocular camera based on the position simulation result, and finally determines the target design scheme, compared with the prior art, the present device embodiment effectively reduces the complexity and design cost of the split binocular stereo system design.
[0112] Based on the above-mentioned first embodiment of the split-type binocular stereo system design device of the present invention, a second embodiment of the split-type binocular stereo system design device of the present invention is proposed.
[0113] In this embodiment, the position simulation module 402 is also used to simulate the binocular placement width and the binocular placement working distance of the binocular camera using the spatial position information of the binocular light source in the non-sequential mode of ZEMAX to obtain a first simulation result; to simulate the binocular diagonal and the binocular elevation angle of the binocular camera using the spatial angle information of the binocular light source in the non-sequential mode of ZEMAX to obtain a second simulation result; to simulate the binocular height of the binocular camera by adjusting the height difference between the binocular camera and the center of the calibration plate to obtain a third simulation result; and to use the first simulation result, the second simulation result and the third simulation result as the position simulation result.
[0114] The position simulation module 402 is also used to determine the accuracy of the calibration plate according to the application scenario information and the functional requirement information; determine the pattern size of the calibration plate according to the resolution and shooting range of the binocular camera; determine the material and manufacturing process of the calibration plate according to the accuracy of the calibration plate and the preset cost requirements; select the calibration plate based on the accuracy of the calibration plate, the pattern size of the calibration plate, the material of the calibration plate and the manufacturing process of the calibration plate.
[0115] The position simulation module 402 is further used to determine the front and rear focus stroke of the binocular camera after obtaining the position information of the binocular camera; based on the front and rear focus stroke, determine whether the depth of field of the lens of the binocular camera covers the front and rear focus stroke, whether the depth of field of the lens of the binocular camera needs to be increased, and whether the binocular camera needs fill light; and perform focus debugging on the binocular camera according to the judgment result.
[0116] Other embodiments or specific implementations of the split binocular stereo system design device of the present invention can refer to the above-mentioned method embodiments, which will not be repeated here.
[0117] The present application provides a split binocular stereo system design device, which includes: at least one processor; and a memory connected to the at least one processor in communication; wherein the memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the split binocular stereo system design method in the above-mentioned embodiment 1.
[0118] Reference below Figure 5 , which shows a schematic diagram of the structure of a split binocular stereo system design device suitable for implementing the embodiment of the present application. The split binocular stereo system design device in the embodiment of the present application may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 5 The split binocular stereo system design device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.
[0119] like Figure 5As shown, the split binocular stereo system design device may include a processing device 1001 (such as a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM: Read Only Memory) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM: Random Access Memory) 1004. In RAM1004, various programs and data required for the operation of the split binocular stereo system design device are also stored. The processing device 1001, ROM1002 and RAM1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Typically, the following systems may be connected to the I / O interface 1006: input devices 1007 including, for example, a touch screen, a touchpad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; output devices 1008 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 1003 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 1009. The communication device 1009 may allow the split-type binocular stereo system design device to communicate wirelessly or wired with other devices to exchange data. Although the split-type binocular stereo system design device with various systems is shown in the figure, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems may be implemented or have alternatively.
[0120] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.
[0121] The split binocular stereo system design device provided by the present application adopts the split binocular stereo system design method in the above embodiment, which can solve the technical problems of complex process and high design cost of split binocular stereo system design in the prior art. Compared with the prior art, the beneficial effects of the split binocular stereo system design device provided by the present application are the same as the beneficial effects of the split binocular stereo system design method provided by the above embodiment, and the other technical features in the split binocular stereo system design device are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.
[0122] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.
[0123] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
[0124] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.
[0125] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.
[0126] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as a read-only memory / random access memory, a magnetic disk, or an optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present invention.
[0127] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.
Claims
1. A split binocular stereo system design method, characterized in that: The method comprises: Through the principle of binocular stereo vision, the binocular camera is selected according to the application scenario information and functional requirement information; Using the non-sequential mode of ZEMAX to simulate the position information of the binocular camera to obtain a position simulation result; Optimizing the parameters of the binocular camera based on the position simulation result to achieve parameter optimization of the binocular camera and obtain target binocular camera parameters; A target design scheme is determined according to the target binocular camera parameters, and a split binocular stereo system is designed based on the target design scheme.
2. The split binocular stereo system design method according to claim 1, characterized in that: The position information includes binocular placement width, binocular placement working distance, binocular diagonal, binocular elevation angle and binocular height. The step of simulating the position information of the binocular camera using the non-sequential mode of ZEMAX to obtain the position simulation result includes: Using the spatial position information of the dual-angle light source in the non-sequential mode of ZEMAX to simulate the binocular placement width and the binocular placement working distance of the binocular camera, a first simulation result is obtained; The binocular diagonal angle and the binocular elevation angle of the binocular camera are simulated by using the spatial angle information of the binocular light source in the non-sequential mode of ZEMAX to obtain a second simulation result; The binocular height of the binocular camera is simulated by adjusting the height difference between the binocular camera and the center of the calibration plate to obtain a third simulation result; The first simulation result, the second simulation result and the third simulation result are used as position simulation results.
3. The split binocular stereo system design method as claimed in claim 2, characterized in that: Before the step of simulating the position information of the binocular camera using the non-sequential mode of ZEMAX to obtain the position simulation result, the method further includes: Determine the accuracy of the calibration plate according to the application scenario information and the functional requirement information; Determining the size of the calibration plate pattern according to the resolution and shooting range of the binocular camera; Determine the material and manufacturing process of the calibration plate according to the accuracy and preset cost requirements of the calibration plate; The calibration plate is selected based on the calibration plate accuracy, calibration plate pattern size, calibration plate material and calibration plate manufacturing process.
4. The split binocular stereo system design method as claimed in claim 3, characterized in that: After the step of selecting the calibration plate based on the calibration plate accuracy, calibration plate pattern size, calibration plate material and calibration plate manufacturing process, the method further includes: After obtaining the position information of the binocular camera, determining the front and rear focusing stroke of the binocular camera; Based on the front-to-back focus stroke, determining whether the depth of field of the lens of the binocular camera covers the front-to-back focus stroke, whether the depth of field of the lens of the binocular camera needs to be increased, and whether the binocular camera needs fill light; The binocular camera is focused and debugged according to the judgment result.
5. The split binocular stereo system design method according to claim 1, characterized in that: The step of selecting a binocular camera based on the binocular stereo vision principle and application scenario information and functional requirement information includes: Determine application scenario information and functional requirement information of the binocular camera, and analyze the application scenario information and the functional requirement information to obtain an analysis result; Determine the lighting conditions, object motion state, field of view, and resolution requirements in the application scenario based on the analysis results; Through the binocular stereo vision principle, the binocular camera is selected based on the lighting conditions, the object motion state, the field of view and the resolution requirements.
6. The split binocular stereo system design method according to claim 5, characterized in that: The step of selecting a binocular camera based on the illumination conditions, the object motion state, the field of view and the resolution requirement by using the binocular stereo vision principle includes: Determining the camera type of the binocular camera based on the lighting conditions and the motion state of the object by using the binocular stereo vision principle; Determining the lens and sensor size of the binocular camera according to the field of view and the resolution requirement; Matching devices from a target database based on the camera type, the lens, and the sensor size to obtain a matching result; The camera performance is evaluated based on the matching result, and when the evaluation result meets the functional requirement information, the binocular camera is selected based on the matching result.
7. The split binocular stereo system design method according to claim 1, characterized in that: The step of optimizing the parameters of the binocular camera based on the position simulation result to achieve the optimization of the parameters of the binocular camera and obtain the parameters of the target binocular camera includes: Based on the position simulation results, corresponding calibration images and spatial calibration accuracy are respectively collected; Restoring the spatial coefficient according to the calibration image, and recording the spatial accuracy according to the spatial calibration accuracy; The parameters of the binocular camera are optimized by using the spatial coefficient and the spatial precision to achieve parameter optimization of the binocular camera and obtain target binocular camera parameters.
8. A split binocular stereo system design device, characterized in that: The device comprises: The hardware selection module is used to select the binocular camera based on the application scenario information and functional requirement information through the binocular stereo vision principle; A position simulation module, used to simulate the position information of the binocular camera using a non-sequential mode of ZEMAX to obtain a position simulation result; A parameter optimization module, used for optimizing the parameters of the binocular camera based on the position simulation result, so as to optimize the parameters of the binocular camera and obtain target binocular camera parameters; The design confirmation module is used to determine a target design scheme according to the target binocular camera parameters, and design a split binocular stereo system based on the target design scheme.
9. A split binocular stereo system design device, characterized in that: The device includes: a memory, a processor, and a split binocular stereo system design program stored in the memory and executable on the processor, wherein the split binocular stereo system design program is configured to implement the steps of the split binocular stereo system design method as described in any one of claims 1 to 7.
10. A storage medium, characterized in that: The storage medium stores a split binocular stereo system design program, and when the split binocular stereo system design program is executed by the processor, the steps of the split binocular stereo system design method according to any one of claims 1 to 7 are implemented.
