Three-dimensional structured light camera calibration device

By integrating structured light projection module, image acquisition module and host computer, combined with the bracket design of degree of freedom movement, the existing three-dimensional structured light camera calibration device is solved, and a high precision and flexible calibration process is achieved.

CN222125766UActive Publication Date: 2024-12-06SOUTH CHINA UNIV OF TECH
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202420097284.X
Authority / Receiving Office
CN · China
Patent Type
Utility models(China)
Current Assignee / Owner
Filing Date
2024-01-16
Publication Date
2024-12-06
Estimated Expiration
2034-01-16

AI Technical Summary

Technical Problem

The existing three-dimensional structured optical camera calibration device is large in scale and difficult to deploy. It lacks standardized projector and camera specifications and debugging processes, resulting in complex and inflexible calibration process.

Method used

An integrated three-dimensional structured light camera calibration device is designed, including structured light projection module, image acquisition module, upper computer and calibration plate. The clamping bracket and camera bracket are used to perform freedom movement, and the structured light projector is controlled by the upper computer and Industrial cameras simplify equipment installation and commissioning, reduce equipment number and improve workspace flexibility.

Benefits of technology

It realizes high-precision calibration of three-dimensional structured optical cameras, simplifies the equipment installation and debugging process, reduces workspace requirements, and improves calibration accuracy and flexibility.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN222125766U_ABST
    Figure CN222125766U_ABST
Patent Text Reader

Abstract

The utility model discloses a calibration device for a three-dimensional structured light camera. The calibration device comprises a structured light projection module, an image acquisition module, an upper computer and a calibration board, the structured light projection module comprises a projector lens and a structured light projector; the structured light projector is used for projecting a structured light pattern sequence; the image acquisition module comprises an industrial lens and an industrial camera; the working camera is used for collecting a projected structured light pattern sequence; the industrial camera is connected with the structured light projector; the calibration plate is used as a reference object for calibration of the industrial camera; the upper computer is connected with the structured light projector and the industrial camera and used for controlling the structured light projector and the industrial camera to work, receiving and processing the structured light pattern sequence collected by the industrial camera and conducting calibration of the three-dimensional structured light camera. According to the utility model, the three-dimensional structured light camera can be calibrated conveniently, the calibration result can be stored and output, and the equipment cost and the working space size are both considered.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The utility model belongs to the technical field of camera calibration, and in particular relates to a three-dimensional structured light camera calibration device. Background Art

[0002] The 3D object contour reconstruction technology plays a very important role in the field of computer vision and has been widely used. There are many methods to achieve 3D contour reconstruction technology, among which the active structured light method has become one of the most widely used methods due to its easy implementation, high accuracy and non-contact characteristics.

[0003] In a structured light system, a light pattern is projected onto the surface of an object. Each pixel in the light pattern has a unique coding value. The image point in the camera is matched with the pixel in the projection device through the coding value, which plays a matching role. Calibration of the camera can obtain information such as the coding value of the reference plane, which is the first step to obtain accurate pixel coding values. Therefore, correct calibration of the camera is a crucial part of the normal use of a 3D structured light camera.

[0004] The calibration process of structured light cameras mainly consists of four parts: calibration board, camera, light source and host computer. However, the current calibration devices are generally large in scale and have high requirements for the site. Secondly, the current calibration devices generally require the projector and camera to be installed separately, which makes deployment difficult. Finally, the current calibration devices do not standardize the specifications, installation and debugging process of projectors and cameras, making debugging difficult. Utility Model Content

[0005] The main purpose of the utility model is to overcome the shortcomings and deficiencies of the prior art and provide a 3D structured light camera calibration device, which can conveniently calibrate the 3D structured light camera, save and output the calibration results, and adjust the equipment cost and the size of the working space.

[0006] In order to achieve the above purpose, the utility model adopts the following technical solutions:

[0007] A three-dimensional structured light camera calibration device, comprising a structured light projection module, an image acquisition module, a host computer and a calibration plate;

[0008] A structured light projection module, comprising a projector lens and a structured light projector; the structured light projector is used to project a structured light pattern sequence;

[0009] An image acquisition module includes an industrial lens and an industrial camera; the working camera is used to acquire the projected structured light pattern sequence; the industrial camera is connected to the structured light projector;

[0010] Calibration plate, used as a reference for industrial camera calibration;

[0011] The host computer is connected to the structured light projector and the industrial camera respectively to control the operation of the structured light projector and the industrial camera, receive and process the structured light pattern sequence collected by the industrial camera, and calibrate the three-dimensional structured light camera.

[0012] Further, it also includes a system base, a clamping bracket and a camera bracket;

[0013] The system base is used to mount the clamping bracket and camera bracket;

[0014] The clamping bracket is used to fix the structured light projector;

[0015] The camera bracket is used to fix industrial cameras.

[0016] Furthermore, the projector lens is connected to the structured light projector to homogenize and focus the light emitted by the projector and project it onto the surface of the object or the surface of the reference plane.

[0017] Furthermore, the industrial lens is connected to the industrial camera to homogenize the light in the image field and focus it onto the photosensitive element of the industrial camera, thereby forming an image through the industrial camera.

[0018] Furthermore, it also includes a display, which is connected to the host computer and is used to operate the host computer and display the calibration results.

[0019] Furthermore, the clamping bracket and the camera bracket can perform three degrees of freedom in space.

[0020] Furthermore, the host computer is specifically connected to the structured light projector and the industrial camera via a USB data cable;

[0021] The industrial camera is connected to the structured light projector via the GPIO line;

[0022] The industrial camera communicates with the host computer through the GenICam protocol.

[0023] Furthermore, the structured light projector can project a series of preset pattern sequences at a preset time, and has a trigger function that can output a trigger level;

[0024] The typical brightness of a structured light projector is greater than 100 lumens.

[0025] Furthermore, the resolution of the industrial camera is greater than 1920*1080 and the frame rate is greater than 60 frames per second.

[0026] Furthermore, the host computer is provided with a graphics processing chip to ensure that the processing speed after acquiring the image meets the real-time requirement.

[0027] Compared with the prior art, the utility model has the following advantages and beneficial effects:

[0028] 1. The utility model reduces the number of required equipment and simplifies the installation and debugging process of the equipment by integrating the host computer, structured light projector and industrial camera.

[0029] 2. The device of the utility model is small in size and only requires a workbench or an open space to complete the calibration process, which greatly improves the flexibility of device layout.

[0030] 3. After the device of the utility model is installed, the image field of the industrial camera and the image field of the structured light projector have a large overlap, which can maximize the use of the area of ​​the camera's photosensitive element to form a clear image, thereby increasing the calibration accuracy. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] Figure 1 It is a schematic diagram of the device of the utility model;

[0032] Figure 2 It is a schematic diagram of data transmission of the utility model device;

[0033] Figure 3 It is a schematic diagram of the working scene of the device of the utility model;

[0034] Figure 4 Schematic diagram of the workflow of the calibration procedure in the embodiment;

[0035] Figure 5 Schematic diagram of the picture storage structure in the embodiment. DETAILED DESCRIPTION

[0036] The present invention is further described in detail below in conjunction with embodiments and drawings, but the implementation manner of the present invention is not limited thereto.

[0037] Example

[0038] like Figure 1 As shown, a three-dimensional structured light camera calibration device includes a structured light projection module, an image acquisition module, a host computer, a calibration board, a system base, a clamping bracket, a camera bracket and a display;

[0039] A structured light projection module, comprising a projector lens and a structured light projector; the structured light projector is used to project a structured light pattern sequence; the projector lens is connected to the structured light projector, and is used to homogenize and concentrate the light emitted by the projector and project it onto the surface of an object or a surface of a reference plane;

[0040] The image acquisition module includes an industrial lens and an industrial camera; the working camera is used to acquire the projected structured light pattern sequence; the industrial lens is connected to the industrial camera to homogenize the light of the image field and focus it on the photosensitive element of the industrial camera, thereby forming an image through the industrial camera.

[0041] Calibration plate, used as a reference for industrial camera calibration;

[0042] The host computer is connected to the structured light projector and the industrial camera respectively, and is used to control the triggering and operation of the structured light projector and the industrial camera, receive and process the structured light pattern sequence collected by the industrial camera, and run the calibration program of the 3D structured light camera;

[0043] The system base is used to mount the clamping bracket and camera bracket;

[0044] The clamping bracket is used to fix the structured light projector;

[0045] The camera bracket is used to fix the industrial camera;

[0046] When setting up, leave a certain distance between the clamping bracket and the camera bracket.

[0047] The display is connected to the host computer and is used to operate the host computer and display the calibration results output by the host computer.

[0048] In this embodiment, the clamping bracket and the camera bracket can perform three degrees of freedom in space, ensuring that the image field of the industrial camera and the image field of the structured light projector can completely cover the target image field, which is convenient for deployment in different scenarios.

[0049] In this embodiment, the structured light projector can project a series of preset pattern sequences according to a preset time, and has a trigger function and can output a trigger level; the typical brightness of the structured light projector is greater than 100 lumens, which reduces the interference of ambient light on the calibration process.

[0050] In this embodiment, the resolution of the industrial camera is greater than 1920*1080 and the frame rate is greater than 60 frames per second, ensuring that the structured light image sequence can be collected in a timely manner and is clear enough for subsequent program processing.

[0051] In this embodiment, the host computer is provided with a graphics processing chip to ensure that the processing speed after acquiring the image meets the real-time requirement.

[0052] like Figure 2As shown, the host computer and the industrial camera are connected through a USB3.0 data transmission line of the GenICam protocol, which can realize bidirectional data transmission between the industrial camera and the host computer. The host computer can control the exposure and triggering mode of the industrial camera, and the industrial camera can transmit data such as images and image metadata to the host computer; the host computer and the structured light projector are connected through a USB3.0 data line of the I2C protocol, which can realize the control of the structured light projector, including writing pattern sequences, controlling the exposure time and triggering mode of the pattern sequences, and other functions; the industrial camera is connected to the structured light projector through the GPIO line, which can realize the output of the trigger signal to the working camera when the structured light projector is triggered to realize the function of collecting the pattern sequence.

[0053] After connecting all the components of the device, place the entire 3D structured light camera calibration device in the following position: Figure 3 In the working environment shown in the figure. The calibration plate is placed in the target image field, and the target image field is ensured to surround the entire calibration plate. The structured light projection module projects the pattern sequence into the image field, and the image acquisition module captures the information of the image field including the calibration plate and the pattern sequence. During the calibration process, the position and posture of the calibration plate in the image field need to be constantly changed.

[0054] After changing the position and posture of the calibration plate, run the calibration program of the host computer. The workflow of the calibration program is as follows: Figure 4 As shown; the calibration program controls the image acquisition module and the structured light projection module to capture the pattern sequence and store it as a group of pictures; the storage structure of each group of pictures is as follows Figure 5 As shown in the figure, it includes a calibration plate picture when the structured light projection module is not working, three pictures of the four-step phase shift method, and one picture of the six-step phase shift method. The shooting operation is repeated until 20 groups of pictures are collected, and these 20 groups of pictures are saved in sequence. The calibration program will read these pictures and classify them, specifically:

[0055] The image group when the projector is not projecting is read and the industrial camera is calibrated based on these images. Then, the phase of the pattern sequence is calculated using the phase shift method, and the structured light projector is calibrated based on the calculated phase value. Finally, the entire 3D structured light camera is calibrated based on the internal and external parameters of the structured light projector and the industrial camera.

[0056] It should also be noted that in this specification, terms such as "comprises", "includes" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of more restrictions, an element defined by the sentence "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device including the element.

[0057] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A three-dimensional structured light camera calibration device, characterized in that: It includes structured light projection module, image acquisition module, host computer and calibration board; A structured light projection module, including a projector lens and a structured light projector; The structured light projector is used to project a sequence of structured light patterns; An image acquisition module includes an industrial lens and an industrial camera; the working camera is used to acquire the projected structured light pattern sequence; the industrial camera is connected to the structured light projector; Calibration plate, used as a reference for industrial camera calibration; The host computer is connected to the structured light projector and the industrial camera respectively to control the operation of the structured light projector and the industrial camera, receive and process the structured light pattern sequence collected by the industrial camera, and calibrate the three-dimensional structured light camera.

2. A three-dimensional structured light camera calibration device according to claim 1, characterized in that: Also included are the system base, clamping bracket, and camera mount; The system base is used to mount the clamping bracket and camera bracket; The clamping bracket is used to fix the structured light projector; The camera bracket is used to fix industrial cameras.

3. The three-dimensional structured light camera calibration device according to claim 1, characterized in that: The projector lens is connected to the structured light projector and is used to uniformize and focus the light emitted by the projector and project it onto the surface of the object or the surface of the reference plane.

4. The three-dimensional structured light camera calibration device according to claim 1, characterized in that: The industrial lens is connected to the industrial camera to homogenize the light in the image field and focus it onto the photosensitive element of the industrial camera, thereby forming an image through the industrial camera.

5. The three-dimensional structured light camera calibration device according to claim 1, characterized in that: It also includes a display, which is connected to the host computer and is used to operate the host computer and display the calibration results.

6. The three-dimensional structured light camera calibration device according to claim 2, characterized in that: The clamping bracket and the camera bracket allow for three degrees of freedom of spatial movement.

7. The three-dimensional structured light camera calibration device according to claim 1, characterized in that: The host computer is specifically connected to the structured light projector and the industrial camera via a USB data cable; The industrial camera is connected to the structured light projector via the GPIO line; The industrial camera communicates with the host computer through the GenICam protocol.

8. The three-dimensional structured light camera calibration device according to claim 1, characterized in that: The structured light projector can project a series of preset pattern sequences at a preset time, and has a trigger function that can output a trigger level; The typical brightness of a structured light projector is greater than 100 lumens.

9. The three-dimensional structured light camera calibration device according to claim 1, characterized in that: The resolution of industrial cameras is greater than 1920*1080 and the frame rate is greater than 60 frames per second.

10. The three-dimensional structured light camera calibration device according to claim 1, characterized in that: The host computer is equipped with a graphics processing chip to ensure that the processing speed after acquiring the image meets the real-time requirements.