Structured light camera and object three-dimensional shape reconstruction equipment
By using the IIC bus simulation module in the structured optical camera to control the communication between the projection optical machine and the 2D camera, the problem of 3D information solving errors caused by false triggering is solved, miniaturization and cost reduction of the structured optical camera is achieved, and HDR shooting is supported. technology.
Patent Information
- Application Number
- CN202420555851.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Utility models(China)
- Current Assignee / Owner
- Filing Date
- 2024-03-20
- Publication Date
- 2024-11-01
- Estimated Expiration
- 2034-03-20
AI Technical Summary
Existing structured light cameras are prone to errors in 3D information solving due to errors during shooting, and the hardware costs are high and the volume cannot be miniaturized.
By designing a structured optical camera, in which the projection optical machine and the 2D camera are connected by ground wire, serial clock line SCL, serial data line SDA and trigger signal line, the projection optical machine and 2D camera are controlled by the IIC bus simulation module. Communication, reduces false triggering errors and reduces hardware costs.
It effectively reduces 3D information solution errors caused by false triggering, realizes miniaturization and cost reduction of structured optical cameras, and supports HDR shooting technology.
Smart Images

Figure CN221945154U_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the utility model relate to the technical field of structured light cameras, and in particular to a structured light camera and a device for reconstructing the three-dimensional shape of an object. Background Art
[0002] Structured light camera is a method of measuring the surface shape of an object by projecting a specific light spot or light pattern through DLP (Digital Light Processing) technology. In a DLP structured light camera, structured light is usually a light with a specific pattern generated by a projector. DLP is a digital micromirror technology that controls the projection of light through a tiny mirror array. The DLP array micromirror chip adjusts the projection direction of light by controlling the tilt angle of the mirror according to the input image data. These projected structured lights will illuminate the surface of the object to be measured. The surface of the object to be measured will produce different deformations or reflections according to the projection of the structured light, and the 2D camera will capture the image of these reflected lights. By processing and analyzing the captured structured light image, the three-dimensional coordinate information of the object surface can be obtained. Structured light cameras usually reconstruct the three-dimensional shape of the object by calculating the deformation or reflection information of different points on the surface of the object. However, the existing structured light cameras have the problem of false triggering leading to 3D information solution errors, high hardware cost and inability to miniaturize the volume. Utility Model Content
[0003] The embodiments of the utility model provide a structured light camera and a device for reconstructing the three-dimensional shape of an object, so as to reduce the problem of 3D information calculation errors caused by false triggering of camera shooting, and at the same time make the overall volume of the structured light camera miniaturized and reduce costs.
[0004] According to one aspect of the utility model, a structured light camera is provided, the structured light camera comprising: a projection light engine and a 2D camera;
[0005] The projection optical machine is connected to the 2D camera via a ground line, a serial clock line SCL, a serial data line SDA and a trigger signal line.
[0006] According to another aspect of the present invention, a device for reconstructing a three-dimensional shape of an object is provided, the device comprising: an industrial computer and the structured light camera provided in any embodiment of the present invention;
[0007] The industrial computer is connected to the structured light camera via USB.
[0008] The embodiment of the utility model designs a structured light camera, including: a projection light machine and a 2D camera, and the projection light machine and the 2D camera are connected through a ground line, a serial clock line SCL, a serial data line SDA, and a trigger signal line. Through the technical solution of the utility model, the problem of 3D information calculation errors caused by false triggering of camera shooting can be reduced, and the overall volume of the structured light camera can be miniaturized to reduce costs.
[0009] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present utility model, nor are they intended to limit the scope of the present utility model. Other features of the present utility model will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0010] In order to more clearly illustrate the technical solutions of the embodiments of the utility model, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the utility model and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other relevant drawings can be obtained based on these drawings without paying creative work.
[0011] Figure 1 It is a schematic diagram of the structure of a DLP structured light 3D camera and a PC / industrial computer;
[0012] Figure 2 This is a schematic diagram of the structure of another DLP structured light 3D camera and PC / industrial computer;
[0013] Figure 3 is a schematic structural diagram of a structured light camera in an embodiment of the utility model;
[0014] Figure 4 It is a structural schematic diagram of a device for reconstructing the three-dimensional shape of an object in an embodiment of the utility model;
[0015] Figure 5 It is a structural schematic diagram of another device for reconstructing the three-dimensional shape of an object in an embodiment of the utility model. DETAILED DESCRIPTION
[0016] In order to enable those skilled in the art to better understand the solution of the utility model, the technical solution in the embodiment of the utility model will be clearly and completely described below in conjunction with the drawings in the embodiment of the utility model. Obviously, the described embodiment is only a part of the embodiment of the utility model, not all of the embodiments. Based on the embodiment of the utility model, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the utility model.
[0017] It should be noted that the terms "first", "second", etc. in the specification and claims of the utility model and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the utility model described here can be implemented in an order other than those illustrated or described here. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0018] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.
[0019] Embodiment 1
[0020] The currently common DLP (Digital Light Processing) structured light 3D camera consists of three main components: DLP projection optical machine, industrial 2D camera, and main control and computing module.
[0021] Different DLP structured light 3D cameras are composed of these three main components to form the following two hardware structures:
[0022] Figure 1 This is a schematic diagram of the structure of a DLP structured light 3D camera and a PC / industrial computer. Figure 1 As shown in the figure, the DLP structured light 3D camera only includes a DLP projector and an industrial 2D camera, and does not include a main control and computing module. The DLP projector and the industrial 2D camera are connected through a ground wire and a trigger signal wire. The connection line between the entire DLP structured light 3D camera and the PC / industrial computer is a USB / Ethernet cable of the industrial camera and a power cable ( Figure 1 not shown).
[0023] In this solution, the industrial 2D camera communicates directly with the PC / industrial computer. At the same time, there is also a trigger signal connection between the industrial 2D camera and the DLP projector. The signal is sent by the industrial 2D camera and received by the DLP projector. The DLP projector has no communication channel with the PC / industrial computer and can only passively receive the trigger signal sent by the industrial 2D camera.
[0024] The advantage of this solution is its low cost, but the disadvantages are: (a) When the DLP projector receives the trigger signal from the industrial 2D camera, if the trigger signal is disturbed by external factors and the level fluctuates, the DLP projector will be triggered by mistake, causing the number of the projected pattern and the pattern captured by the industrial 2D camera to be misaligned, resulting in errors in the 3D information solution. After the error occurs, the industrial 2D camera cannot notify the DLP projector to reset its internal counter, causing the subsequent projection and shooting sequence to remain misaligned and unable to recover on its own. In this case, it can only be restored by powering on again. (b) The DLP projector cannot switch the order of the projected patterns, nor can it change the exposure time and light intensity of the projection, which makes it impossible to implement HDR (High Dynamic Range Imaging) shooting technology.
[0025] Figure 2 This is another schematic diagram of the structure of a DLP structured light 3D camera and a PC / industrial computer. Figure 2 As shown in the figure, the DLP structured light 3D camera includes a DLP projector, an industrial 2D camera and a main control module. The connection line between the entire DLP structured light 3D camera and the PC / industrial computer is a USB / Ethernet cable connected to the main control module and a power cable ( Figure 2 not shown).
[0026] In this solution, the PC / industrial computer only communicates with the main control module, and the main control module communicates with the industrial 2D camera and the DLP projector respectively. The connection between the main control module and the industrial 2D camera is a separate USB / Ethernet cable. The communication between the main control module and the DLP projector is carried out through a 3-core cable for IIC (Inter-Integrated Circuit) bus communication. The 3-core wires are ground, SDA (Serial Data Line) signal and SCL (Serial Clock Line) signal. At the same time, the industrial 2D camera and the DLP projector are also connected by the ground and trigger signal lines. The signal can be sent by the industrial 2D camera or the DLP projector.
[0027] When the trigger signal is sent by the 2D camera, the main control module sends a shooting command to the industrial 2D camera to shoot a series of pictures. The industrial 2D camera sends a trigger signal for each frame. The DLP projector passively receives the trigger signal and projects a frame of image each time it receives a signal.
[0028] When the trigger signal is sent by the DLP projector, the main control module sends a projection command to the DLP projector through the IIC bus to project a series of patterns. Each time a frame of pattern is projected, a trigger signal is sent. At this time, the industrial 2D camera passively receives the trigger signal and takes a frame of image each time it receives a signal.
[0029] The advantages of this solution are: (a) The main control module can be used to communicate with the industrial 2D camera and DLP projector separately. The counters of both can be reset before each projection and shooting. Even if the trigger signal is disturbed during a certain shooting, the level jumps, and the projection and shooting sequence is misplaced, this will only affect the result of the current shooting, and the subsequent projection and shooting sequence will not be wrong. (b) The main control module can communicate with the DLP projector through the IIC bus and can transmit richer information, including: changing the order of the projection pattern, changing the exposure time and light intensity of the projection, etc. This makes HDR shooting technology possible. However, the disadvantage of this solution is that it includes the main control module, the hardware cost is increased, and the volume cannot be miniaturized, and the size and weight of the shell cannot be reduced, which further increases the cost.
[0030] On the basis of the above two DLP structured light 3D cameras, the utility model has made an innovation. The utility model uses a DLP projection optical machine and an industrial 2D camera to form a monocular DLP structured light 3D camera.
[0031] Figure 3 is a schematic diagram of the structure of a structured light camera in an embodiment of the utility model. This embodiment is applicable to the case where a DLP structured light 3D camera is used to reconstruct the three-dimensional shape of an object, such as Figure 3 As shown, the structured light camera 1 includes: a projector 11 and a 2D camera 12. Preferably, the projector can be a DLP projector, and the 2D camera can be an industrial 2D camera. In actual operation, the structured light camera can be a DLP structured light 3D camera.
[0032] The projection optical machine 11 and the 2D camera 12 are connected via a ground line, a serial clock line SCL, a serial data line SDA and a trigger signal line.
[0033] Among them, SCL and SDA are used to represent the two signal lines on the IIC bus. The full name of SCL in English is Serial Clock Line, which is the serial clock line. In I2C communication, SCL is generated by the master device (such as a microcontroller or processor) and is used to synchronize data transmission. It determines the rate and timing of data transmission. All devices are synchronized on SCL to ensure correct data transmission. The full name of SDA in English is Serial Data Line, which is used to transmit actual data bits on the I2C bus. Data transmission is achieved by changing the state of SDA on or off the clock edge of SCL. These state changes represent the transmission of binary data bits. I2C is a commonly used serial communication protocol, which is widely used in communication between various electronic devices. It allows multiple devices (master and slave) to transmit data by sharing two signal lines (SCL and SDA), thereby reducing the number of connecting lines and saving system resources.
[0034] The embodiment of the utility model designs a structured light camera, including: a projection light machine and a 2D camera, and the projection light machine and the 2D camera are connected through a ground line, a serial clock line SCL, a serial data line SDA, and a trigger signal line. Through the technical solution of the utility model, the problem of 3D information calculation errors caused by false triggering of camera shooting can be reduced, and the overall volume of the structured light camera can be miniaturized to reduce costs.
[0035] Optionally, the projection optical engine 11 includes a first ground pin, a first SCL signal pin, a first SDA signal pin, a first input pin and a first output pin; the 2D camera 12 includes a second ground pin, a second SCL signal pin, a second SDA signal pin, a second input pin and a second output pin.
[0036] Optionally, the projection optical machine 11 is connected to the 2D camera 12 via a ground line, a serial clock line SCL, and a serial data line SDA, including:
[0037] The first ground pin of the projection optical machine 11 is connected to the second ground pin of the 2D camera 12;
[0038] The first SCL signal pin of the projection optical machine 11 is connected to the second SCL signal pin of the 2D camera 12;
[0039] The first SDA signal pin of the projection optical machine 11 is connected to the second SDA signal pin of the 2D camera 12;
[0040] The first SCL signal pin of the projector 11 is connected to the second SCL signal pin of the 2D camera 12 .
[0041] Optionally, the projection optical machine 11 and the 2D camera 12 are connected via a trigger signal line, including:
[0042] The first output pin of the projector 11 is connected to the second input pin of the 2D camera 12;
[0043] The first input pin of the projector 11 is connected to the second output pin of the 2D camera 12 .
[0044] In the present invention, the projection optical machine 11 includes the following features:
[0045] a) It can receive or send out level trigger signals. When sending out a trigger signal, a signal is sent out for each frame of pattern projected; when receiving a trigger signal, a frame of pattern is projected for each signal received.
[0046] b) The characteristics of the DLP projection light engine can be configured through the IIC bus, including: changing the order of projection patterns, changing the projection exposure time and light intensity, etc.
[0047] In the present invention, the 2D camera 12 includes the following features:
[0048] a) Include at least one level output or input or GPIO (General Purpose Input Output, i.e., configurable input / output pin) for sending or receiving a trigger signal.
[0049] b) In addition to the output or input or GPIO pins, two more pins should be included to simulate the communication of the IIC bus. The ground line of the IIC bus can be connected by the ground line of the 2D camera 12 itself, and there is no need to occupy a communication pin. The data line of the IIC bus includes two lines, SDA (serial data) and SCL (serial clock), where SCL is the clock signal of the bus, and its pin must be an output pin (or a GPIO pin configured in output mode). SDA is the data signal of the bus, and its pin must be a GPIO pin, that is, it must have both input and output modes.
[0050] There are at least four connecting lines between the 2D camera 12 and the projector 11: 1) Ground line, connecting the ground lines of the two; 2) SCL, a pin of the 2D camera 12 simulates the SCL signal of the IIC bus and is connected to the SCL signal of the projector 11; 3) SDA, a pin of the 2D camera 12 simulates the SDA signal of the IIC bus and is connected to the SDA signal of the projector 11; 4) Trigger signal, which can be connected from the output pin of the 2D camera 12 to the input pin of the projector 11, or from the output pin of the projector 11 to the input pin of the 2D camera 12.
[0051] The embodiment of the utility model designs a structured light camera, including: a projection light machine and a 2D camera, connects the projection light machine and the 2D camera through a ground line, a serial clock line SCL, a serial data line SDA, and a trigger signal line, and controls the 2D camera to simulate an IIC bus to trigger the projection light machine, thereby reducing the configuration of the main control module. The technical solution of the utility model can reduce the problem of 3D information calculation errors caused by mis-triggering the camera shooting, and at the same time, the overall volume of the structured light camera can be miniaturized to reduce costs.
[0052] Embodiment 2
[0053] Figure 4 3D shape reconstruction device of an object in an embodiment of the utility model is a schematic diagram of the structure. This embodiment is applicable to the case where the 3D shape of an object is reconstructed by a DLP structured light 3D camera, such as Figure 4 As shown, the object three-dimensional shape reconstruction device includes: an industrial computer 2 and a structured light camera 1, wherein the industrial computer 2 is connected to the structured light camera 1 via a USB.
[0054] like Figure 4 As shown, the industrial computer 2 includes: a bus simulation module 21 and a 3D point cloud solution module 22.
[0055] The bus simulation module 21 is connected to the 2D camera in the structured light camera 1 via a USB;
[0056] The bus simulation module 21 is used to control the 2D camera in the structured light camera 1 to send a trigger signal to the projection optical machine in the structured light camera 1 .
[0057] In actual operation, the industrial computer 2 may also be a PC. In addition, the PC or industrial computer may be connected to the structured light camera not only via USB but also via Ethernet. Preferably, the structured light camera may be a DLP structured light 3D camera, the projection optical machine may be a DLP projection optical machine, the 2D camera may be an industrial 2D camera, and the bus simulation module may be an IIC bus simulation module.
[0058] Figure 5 Schematic diagram of another device for reconstructing the three-dimensional shape of an object in an embodiment of the present utility model. Figure 5 As shown in the figure, the DLP structured light 3D camera includes: a DLP projector and an industrial 2D camera. The DLP projector is connected to the industrial 2D camera through a ground line, SCL, SDA and a trigger signal line. The PC / industrial computer includes: an IIC bus simulation module and a 3D point cloud solution module. The connection line between the industrial 2D camera and the PC / industrial computer includes a USB or ETHERNET cable for the industrial camera and a power cable ( Figure 5(not shown in the figure, the power cord is not necessary because the USB or Ethernet cable can also provide power), the industrial 2D camera can communicate with the PC or industrial computer via a USB or Ethernet cable.
[0059] In addition to the hardware connection, corresponding control software is also required on the PC or industrial computer to control the pins of the industrial 2D camera to simulate the signal of the IIC bus.
[0060] The software simulation of IIC bus signals must be carried out in accordance with the IIC bus standards:
[0061] 1. In the IIC bus, the conditions defined as start (S) and stop (P):
[0062] a) Start (S): When the SCL line is high, the SDA line switches from high to low;
[0063] b) Stop (P): When the SCL line is high, the SDA line switches from low to high.
[0064] 2. Except for the two cases specified in 1, the data on the SDA line must remain stable during the high level period of the SCL line clock. The high or low level state of the data line SDA can only change when the clock signal of the SCL line is low.
[0065] 3. Each byte sent to the SDA line must be 8 bits. There is no limit to the number of bytes that can be sent per transmission. Each byte must be followed by a response bit.
[0066] 4. Data transmission must be accompanied by a response, and the relevant response clock pulse is generated by the host. During the response clock pulse, the transmitter releases the SDA line (high) (at this time, the corresponding pin of the industrial 2D camera SDA is set to input mode). During the response clock pulse, the receiver must pull the SDA line low to keep it at a stable low level during the high level of this clock pulse, so as to confirm that the communication is successful.
[0067] Optionally, when the bus simulation module controls the 2D camera to send a trigger signal to the projection optical machine,
[0068] The 2D camera is used to capture images and send trigger signals to the projector.
[0069] The projection optical machine is used to project a pattern after receiving a trigger signal.
[0070] Optionally, the bus simulation module is connected to the projection optical machine via USB;
[0071] The bus simulation module is used to control the projection optical machine to send a trigger signal to the 2D camera.
[0072] In actual operation, the bus simulation module is connected to the projection optical machine through USB, which can be understood as the IIC bus simulation module simulating the IIC bus by controlling the industrial 2D camera, and then controlling the DLP projection optical machine to send a trigger signal to the industrial 2D camera.
[0073] Optionally, when the bus simulation module controls the projection optical machine to send a trigger signal to the 2D camera,
[0074] The projection optical machine is used to project the pattern and send a trigger signal to the 2D camera after projecting the pattern;
[0075] The 2D camera is used to capture images after receiving a trigger signal.
[0076] Optionally, the 3D point cloud solution module is connected to the 2D camera via USB;
[0077] The 2D camera is used to send the captured images to the 3D point cloud solution module;
[0078] The 3D point cloud solution module is used to receive images sent by the 2D camera and perform point cloud settlement based on the images to achieve 3D shape reconstruction of the object.
[0079] The technical solution of the utility model has a significant advantage in the overall cost of the DLP structured light 3D camera because it does not include a main control module. At the same time, its overall volume can be miniaturized, and the size and weight of the shell can be further reduced, which further reduces the cost. In addition, since the industrial 2D camera no longer communicates with the main control module, but directly communicates with the PC or industrial computer, the overall communication link is simplified, which further reduces the problem of data transmission errors caused by signal interference. The technical solution of the utility model can send a projection command to the DLP projection optical machine through the industrial 2D camera, and the counters of the two can be reset before each projection and shooting. Even if the trigger signal is interfered with during a certain shooting, the level jumps, and the projection and shooting sequence is misaligned, this will only affect the result of the current shooting, and the subsequent projection and shooting sequence will not be wrong. At the same time, the IIC bus analog module can send configuration information to the DLP projection optical machine through the industrial 2D camera. This information includes: changing the order of the projection pattern, changing the exposure time and light intensity of the projection, etc., which enables HDR shooting technology to be realized.
[0080] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be performed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.
[0081] The above specific implementations do not constitute a limitation on the protection scope of the present utility model. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present utility model shall be included in the protection scope of the present utility model.
Claims
1. A structured light camera, characterized in that: The structured light camera includes: a projection light machine and a 2D camera; The projection optical machine is connected to the 2D camera via a ground line, a serial clock line SCL, a serial data line SDA and a trigger signal line.
2. The structured light camera according to claim 1, characterized in that: The projection optical engine includes a first ground pin, a first SCL signal pin, a first SDA signal pin, a first input pin and a first output pin; the 2D camera includes a second ground pin, a second SCL signal pin, a second SDA signal pin, a second input pin and a second output pin.
3. The structured light camera according to claim 2, characterized in that: The projection optical machine is connected to the 2D camera via a ground line, a serial clock line SCL and a serial data line SDA, including: The first ground pin of the projector is connected to the second ground pin of the 2D camera; The first SCL signal pin of the projection optical machine is connected to the second SCL signal pin of the 2D camera; The first SDA signal pin of the projection optical machine is connected to the second SDA signal pin of the 2D camera.
4. The structured light camera according to claim 2, characterized in that: The projection optical machine is connected to the 2D camera via a trigger signal line, including: The first output pin of the projector is connected to the second input pin of the 2D camera; The first input pin of the projector is connected to the second output pin of the 2D camera.
5. A device for reconstructing the three-dimensional shape of an object, characterized in that: The device comprises: an industrial computer and a structured light camera as described in any one of claims 1 to 4; The industrial computer is connected to the structured light camera via USB.
6. The device according to claim 5, characterized in that The industrial computer includes: a bus simulation module and a 3D point cloud solution module; The bus simulation module is connected to the 2D camera via the USB; The bus simulation module is used to control the 2D camera to send a trigger signal to the projection optical machine.
7. The device according to claim 6, characterized in that When the bus simulation module controls the 2D camera to send a trigger signal to the projection optical machine, The 2D camera is used to capture images and send a trigger signal to the projection light machine; The projection optical machine is used to project a pattern after receiving a trigger signal.
8. The device according to claim 6, characterized in that The bus simulation module is connected to the projection optical machine via the USB; The bus simulation module is used to control the projection optical machine to send a trigger signal to the 2D camera.
9. The device according to claim 8, characterized in that When the bus simulation module controls the projection optical machine to send a trigger signal to the 2D camera, The projection optical machine is used to project a pattern and send a trigger signal to the 2D camera after projecting the pattern; The 2D camera is used to capture images after receiving a trigger signal.
10. The device according to claim 6, characterized in that The 3D point cloud solution module is connected to the 2D camera via the USB; The 2D camera is used to send the captured image to the 3D point cloud solution module; The 3D point cloud solution module is used to receive the image sent by the 2D camera and perform point cloud settlement based on the image to achieve three-dimensional shape reconstruction of the object.
