Uniform light supplementing depth camera and electronic equipment
By using uniform light assembly and multiple fill lights in the depth camera, the problem of changes in exposure conditions and insufficient illumination intensity when measuring human bodies in close range in the prior art is solved, and a more uniform and safer Filling light effect.
Patent Information
- Application Number
- CN202323452608.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Utility models(China)
- Current Assignee / Owner
- Filing Date
- 2023-12-18
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2033-12-18
AI Technical Summary
When existing depth cameras measure human bodies at close range, due to changes in exposure conditions due to the movement of the human body, a single fill light is difficult to meet the irradiation intensity requirements of infrared and visible light at the same time. Especially under the safety power limit of the human eye, it is difficult to achieve uniform fill light. .
The uniform light component is combined with the fill light lamp. The uniform light component makes the fill light emitted with uniform light, reducing the single point intensity, meeting the safety limit of the human eye power, and achieving better illumination through the uniform arrangement of multiple fill light lamps. Effect.
It realizes a more uniform fill light, reduces single point intensity, meets the safety requirements of human eyes, and improves the structural flexibility and integration of depth cameras, and is suitable for different application scenarios.
Smart Images

Figure CN221977115U_ABST
Abstract
Description
Technical Field
[0001] The utility model relates to the technical field of depth cameras, and in particular to a uniform fill-light depth camera and electronic equipment. Background Art
[0002] Depth camera technologies mainly include structured light, time-of-flight (ToF), binocular stereo and other methods. Structured light depth camera is a new type of depth camera, which actively emits IR infrared light invisible to the naked eye to the surface of the object to be measured through a projector, and then uses one or more cameras to capture the structured light image of the object to be measured, sends the data to the calculation unit, and obtains the depth information of the object to be measured through triangulation principle.
[0003] Time-of-Flight (ToF) depth cameras transmit signals, receive reflected signals, and calculate distance based on the speed of light and time. Binocular stereo depth cameras use two cameras to photograph the same object from different angles, and then calculate distance by comparing the differences between the two photos.
[0004] In addition, some depth cameras also use Light Coding technology, a structured light solution that projects pseudo-random speckle infrared light spots invisible to the human eye onto objects. Each pseudo-random speckle light spot and the point set within a certain range around it are unique at each position in the spatial distribution and are stored in advance. The size and shape of these speckle projections on the observed object vary depending on the distance and direction between the object and the camera, and the depth information is calculated from this.
[0005] Various depth calculation technologies have their own advantages and disadvantages. For example, structured light depth camera technology is mature, with low power consumption, low cost, active projection, suitable for low light use, and high accuracy at close range, at the millimeter level. However, the accuracy at long distances is poor. As the distance increases, the projection pattern becomes larger and the accuracy also deteriorates. It is not suitable for use in strong outdoor light, as strong light can easily interfere with the projection light. Depth cameras using Light Coding technology have higher accuracy at close ranges, so they have great advantages in face recognition and gesture recognition.
[0006] When a depth camera is used to measure the human body, especially at close range, the optimal exposure conditions of the camera often change because the human body usually moves within a certain range. For example, faces and palms are difficult to remain still. In some application scenarios, fill light technology is required to illuminate the target object.
[0007] Depth cameras in the prior art usually use a single fill light to illuminate the target object. For example, depth cameras using active light technology often place a fill light between the projector and the receiver, and set the FOV of the fill light to be larger than the FOV of the projector, so as to achieve the purpose of fill light for the target object. However, for RGBD cameras, it is necessary to obtain infrared signals and RGB signals that meet the requirements at the same time, so the illumination intensity of visible light and infrared light must be met at the same time. However, due to the limitation of eye-safe power, the power used for the fill light needs to be limited to a certain range, and in some application scenarios, a single fill light is difficult to meet the illumination intensity requirements.
[0008] The disclosure of the above background technology content is only used to assist in understanding the inventive concept and technical solution of the utility model. It does not necessarily belong to the prior art of this patent application. In the absence of clear evidence that the above content has been disclosed on the filing date of this patent application, the above background technology should not be used to evaluate the novelty and creativity of the present application. Utility Model Content
[0009] To this end, the utility model proposes a uniform fill light depth camera, which uses a fill light to fill light the target object, uses a uniform light component to make the fill light emit in a uniform light, and reduces the intensity of a single point to meet the power safety limit of the human eye, making the fill light more uniform and more friendly to the human eye.
[0010] In a first aspect, the utility model provides a uniform fill light depth camera, characterized by comprising:
[0011] A projector for projecting infrared light;
[0012] An infrared receiver, used for receiving an infrared reflection signal of a target object;
[0013] A visible light receiver, used to receive a visible light reflection signal of the target object;
[0014] A fill light, used for emitting fill light for fill lighting;
[0015] A light homogenizing component, used for emitting the fill light in a homogenous manner;
[0016] A panel, located on the surface, including a light-transmitting portion to allow light to pass through;
[0017] The light-transmitting portion at least covers the projector, the infrared receiver, the visible light receiver and the light homogenizing component;
[0018] The controller is electrically connected to the projector, the infrared receiver, the visible light receiver, and the fill light.
[0019] Optionally, the uniform fill light depth camera is characterized in that the uniform light component is a uniform light ring.
[0020] Optionally, the uniform fill light depth camera is characterized in that the uniform light ring is flat on a side close to the panel and is in contact with the panel.
[0021] Optionally, the uniform fill light depth camera is characterized in that there are multiple fill lights, and they are uniformly irradiated on the uniform light ring.
[0022] Optionally, the uniform fill light depth camera is characterized in that the light path of the fill light is arranged perpendicular to the panel.
[0023] Optionally, the uniform fill light depth camera is characterized in that the light path of the fill light is arranged parallel to the panel, and one side of the uniform light ring is a total reflection surface, so that the visible light is uniformly emitted toward the panel.
[0024] Optionally, the uniform fill light depth camera is characterized in that the uniform light component is a reflector.
[0025] Optionally, the uniform fill light depth camera is characterized in that there are multiple fill lights, which evenly illuminate the reflector.
[0026] Optionally, the uniform fill light depth camera is characterized in that the reflector is a total reflection surface so that the fill light is uniformly emitted along the panel.
[0027] In a second aspect, the utility model provides an electronic device, comprising a uniform fill light depth camera as described in any one of the above items.
[0028] Compared with the prior art, the utility model has the following beneficial effects:
[0029] The utility model uses a fill light to fill in light for a target object, utilizes a light uniforming component to make the fill light emit in a uniform light, and reduces the intensity of a single point to meet the power safety limit of the human eye, making the fill light more uniform and more friendly to the human eye.
[0030] The utility model arranges the light homogenizing component under the panel and hides it inside the depth camera, which has a better integration effect and protects the light homogenizing component from being scratched and damaged by the panel.
[0031] The utility model makes the setting of the fill light more flexible by arranging the light uniforming component, and the fill light can be designed in different directions to achieve different structural characteristics such as thinner and smaller. BRIEF DESCRIPTION OF THE DRAWINGS
[0032] In order to more clearly illustrate the embodiments of the utility model or the technical solutions in the prior art, the following will briefly introduce the drawings required for use in the embodiments or the prior art descriptions. Obviously, the drawings described below are only embodiments of the utility model. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without creative work. By reading the detailed description of the non-limiting embodiments with reference to the following drawings, other features, purposes and advantages of the utility model will become more obvious:
[0033] Figure 1 This is a schematic diagram of the structure of a uniform fill light depth camera in an embodiment of the present utility model;
[0034] Figure 2 It is a schematic diagram of the arrangement of a fill light in an embodiment of the utility model;
[0035] Figure 3 This is a structural schematic diagram of a light uniforming ring in an embodiment of the utility model;
[0036] Figure 4 This is a schematic diagram of the structure of another light-uniforming ring in an embodiment of the utility model;
[0037] Figure 5 This is a schematic structural diagram of a reflector in an embodiment of the utility model;
[0038] Figure 6 This is a schematic diagram of the structure of a robot in an embodiment of the utility model;
[0039] Figure 7 This is a schematic diagram of the structure of a smart phone in an embodiment of the utility model;
[0040] Figure 8 It is a structural schematic diagram of a payment terminal in an embodiment of the utility model.
[0041] 1- housing;
[0042] 2- projector;
[0043] 3- Infrared receiver;
[0044] 4-Visible light receiver;
[0045] 5-Fill light;
[0046] 6-light homogenization component;
[0047] 7- Panel;
[0048] 8-light-transmitting part;
[0049] 9- Controller;
[0050] 10-uniform light ring;
[0051] 11-Reflector;
[0052] 601-depth camera;
[0053] 602-Robot body;
[0054] 603-display screen;
[0055] 701- mobile phone body;
[0056] 702-depth camera;
[0057] 510-Uniform fill light depth camera;
[0058] 530 - processor;
[0059] 540-input interface;
[0060] 550-display screen;
[0061] 560-Scanning device; DETAILED DESCRIPTION
[0062] The utility model is described in detail below in conjunction with specific embodiments. The following embodiments will help those skilled in the art to further understand the utility model, but do not limit the utility model in any form. It should be pointed out that for those of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the utility model. These all fall within the scope of protection of the utility model.
[0063] The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present utility model and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the utility model described here, for example, can be implemented in an order other than those illustrated or described here. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0064] The embodiment of the utility model provides a uniform fill light depth camera, which aims to solve the problems existing in the prior art.
[0065] The following specific embodiments are used to describe in detail the technical solution of the utility model and how the technical solution of the present application solves the above technical problems. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the utility model will be described below in conjunction with the accompanying drawings.
[0066] The utility model proposes a uniform fill-light depth camera, which fills light for a target object through a fill-light lamp, uses a uniform light component to make the fill light emit in a uniform light, and reduces the intensity of a single point to meet the power safety limit of the human eye, making the fill light more uniform and more friendly to the human eye.
[0067] Figure 1 Schematic diagram of the structure of a uniform fill light depth camera in the embodiment of the utility model. Figure 1 As shown, a uniform fill light depth camera in an embodiment of the utility model includes:
[0068] The projector 2 is used for projecting infrared light.
[0069] Specifically, the projector can project a structured light spot or a flood light. The projector is used to project infrared light to obtain a more stable infrared image. The projector can be various infrared projectors, such as VCSEL, EEL, etc.
[0070] The infrared receiver 3 is used to receive the infrared reflection signal of the target object.
[0071] Specifically, an infrared receiver is a device used to receive infrared reflected signals from a target object. When infrared light is irradiated onto a target object, part of the infrared light is absorbed by the object, while the other part is reflected back to the sensor. The receiver receives the reflected infrared light and converts it into a corresponding electrical signal.
[0072] The visible light receiver 4 is used to receive the visible light reflection signal of the target object.
[0073] Specifically, a visible light receiver is a device for receiving visible light reflection signals from a target object. Its main function is to capture and convert visible light reflections from a target object and convert them into electrical signals. This device is often used in visible light communication technology, which modulates information into visible light emitted by an LED lamp under normal lighting. The receiving end uses a photodetector to convert visible light and electrical signals, and demodulates the corresponding modulated information from it. In addition, the optical receiver based on the Fresnel lens has a simple structure, which can meet the technical requirements of the visible light communication system, and has high basic technical requirements for the light source and the optical receiver. This embodiment can also decide whether to install an LED lamp for visible light irradiation according to the specific application scenario. In some application scenarios, the visible light is relatively sufficient, and human body information can be effectively identified in most cases. Only fill light is needed at some times, so LED lamps can be installed. In some application scenarios, the visible light varies greatly, and it is difficult to obtain stable visible light, so it is necessary to install LED lamps for active irradiation.
[0074] The fill light 5 is used to emit fill light for fill lighting.
[0075] Specifically, the fill light can emit infrared light or visible light. Those skilled in the art can specifically select the fill light to be an infrared fill light or a visible light fill light, and can also equip an infrared fill light and a visible light fill light at the same time. Regardless of the type of fill light used in the specific solution, it belongs to the protection scope of the present utility model. The fill light can be one or more.
[0076] The light homogenizing component 6 is used to emit the fill light in a homogenous manner.
[0077] Specifically, the light-homogenizing component is adapted to the structure of the fill light. When there is only one fill light, the light-homogenizing component disperses the light from one optical path entrance and emits it in a specific direction as uniform light. When there are multiple fill lights, the light-homogenizing component evenly processes the light from multiple optical path entrances within a certain range, achieving the same light intensity and uniform distribution in multiple areas, thereby achieving the same uniform light effect for the light emitted from different positions of the light-homogenizing component.
[0078] The panel 7, located on the surface, includes a light-transmitting portion 8 to allow light to pass through.
[0079] Specifically, the panel is connected to the shell 1, fixing other components inside and playing a protective role. Light is emitted and incident from one side of the panel. The projector, infrared receiver, visible light receiver, and light homogenization component are all arranged toward the panel. The panel includes at least a light-transmitting portion. The light-transmitting portion allows the fill light to pass through. When the fill light is visible light, the light-transmitting portion allows the visible light to pass through. When the fill light is infrared light, the light-transmitting portion allows the infrared light to pass through. The panel can be made of various materials such as tempered glass and plastic. The surface of materials such as tempered glass can also be covered with a corresponding film so that only infrared light can pass through, but visible light cannot. The specific settings of the panel can be selected according to product requirements.
[0080] The light-transmitting portion at least covers the projector, the infrared receiver, the visible light receiver and the light homogenizing component, so as to allow various types of light to pass through. If the light-transmitting portion is a whole, it can pass both infrared light and visible light. If the light-transmitting portion is composed of different regions, each different light-transmitting portion can only allow corresponding light to pass through. For example, the light-transmitting portion in front of the projector allows infrared light to pass through; the light-transmitting portion in front of the visible light receiver allows visible light to pass through.
[0081] The controller 9 is electrically connected to the projector, the infrared receiver, the visible light receiver, and the fill light.
[0082] Specifically, the controller controls the operation of the depth camera, including the projection of the projector, the fill light, and the operation of the infrared receiver and the visible light receiver. The controller enables the same type of light source and receiver to work simultaneously, so that a clear image can be obtained. The controller also controls the fill light to perform fill light according to the image quality generated by the infrared receiver and the visible light receiver. When the fill light has both infrared light and visible light, the controller also selectively performs infrared fill light or visible light fill light.
[0083] This embodiment can be applied to various depth cameras, including depth cameras that generate RGBD images, and depth cameras that obtain different information from RGB images and infrared images.
[0084] In some embodiments, Figure 2 As shown, there are multiple fill lights and they are evenly distributed. Figure 2 The fill lights in the system are arranged in a circle, so that the fill lights are uniform. When the fill lights are not in a circle, they can be in other symmetrical shapes, such as two parallel line segments, ellipses, etc. Multiple fill lights can reduce the intensity of a single fill light, which is beneficial to reduce the temperature and ensure the stability of the product.
[0085] In some embodiments, different fill lights have different color temperatures. The controller calls fill lights with different color temperatures according to the reflection of the photo of the visible light receiver. The controller can identify the image quality, and if overexposure occurs locally, a warmer fill light is used to fill in the light, so that the image color fits the environment, thereby avoiding the "overexposure" phenomenon caused by reflection.
[0086] In some embodiments, Figure 3 As shown in the figure, the cross section of the light-uniforming ring is fan-shaped. The fill light is arranged parallel to the panel. One of the two straight sides of the light-uniforming ring is perpendicular to the fill light, and the other is parallel to the panel. The arc surface of the light-uniforming ring is a full-reflection arc surface, which can reflect the light emitted by the fill light from the other side and penetrate the panel to illuminate the target object. The light-uniforming ring fits the panel to minimize optical loss. The material of the light-uniforming ring is optical grade polycarbonate material to obtain a more stable light-uniforming effect.
[0087] In some embodiments, Figure 4 As shown, the cross section of the uniform light ring is square, and the two opposite sides are the panel and the fill light. The fill light can also be embedded in the uniform light ring, so that the light emitted by the fill light is uniformly emitted from the panel. The distance between adjacent fill lights is designed based on the parameters of the fill light and the uniform light ring, so that the light emitted by the uniform light ring is uniform.
[0088] In some embodiments, Figure 5 As shown, the uniform light component is a reflector. There are multiple fill lights, and they are uniformly irradiated on the reflector. The cross-section of the reflector is a total reflection surface, so that the fill light can be uniformly emitted along the panel. The light of the fill light shines on the reflector with air as the medium. The reflector changes the propagation direction of the light and changes it into uniform light that shines on the panel. After penetrating the panel, it shines on the target object. The reflector is divided into n areas according to the distance from the fill light. n is equal to the number of fill lights. Within an area, there is a complete light path processing unit, which is used to emit the light emitted by the nearest fill light as uniform light. In order to ensure the effect of the uniform light, the parameters of multiple fill lights are consistent, the multiple areas are also completely consistent, and the positional relationship between the fill lights and the areas is also consistent.
[0089] Figure 6 The figure is a schematic diagram of the structure of a robot in an embodiment of the utility model. Figure 6The robot shown in the figure includes a depth camera 601, a robot body 602 and a display screen 603. The depth camera 601 includes the uniform fill light depth camera described in any of the above embodiments. The depth camera 601 can obtain the scene in front of the robot, so as to obtain three-dimensional information. Generally, the depth camera 601 also includes an RGB camera, which can obtain an RGB image, so as to combine it with the depth image to generate an RGBD image. The robot body 602 can select different functions according to different robot types. For example, a food delivery robot can have a tray, a bracket, a driving wheel, etc.; a welcoming robot can have a driving wheel, a human body shape, etc. The display screen 603 is used to display information and interact with the user. The display screen 603 can be either unidirectional or bidirectional. Due to the use of a highly integrated uniform fill light depth camera, the robot can accommodate more sensors in the same size, so as to have better environmental perception capabilities. Of course, the robot can also reduce its size to adapt to more scenes with strict size requirements. The uniform fill light depth camera can also use the monitoring range to set different trigger distances to realize the function of automatically starting the uniform fill light depth camera at a close distance and shutting down the uniform fill light depth camera at a long distance, thereby saving energy consumption.
[0090] Figure 7 It is a schematic diagram of the structure of a smart phone in an embodiment of the utility model. The smart phone includes a mobile phone body 701 and a depth camera 702. The depth camera 702 includes the uniform fill light depth camera described in any of the above embodiments. The mobile phone body 701 includes a display screen and a shell. The depth camera 702 is arranged behind the display screen to increase the screen-to-body ratio. The display screen can be made by digging holes so that the light of the depth camera 702 can pass through better and collect data. At this time, the processing technology requirements for the display screen are relatively high, and the whole display screen can be dug or two display screens can be spliced. In some embodiments, through the reasonable design of the laser emitter, the laser can penetrate the display screen, so that the display screen no longer needs to dig holes, so that the screen-to-body ratio reaches the theoretical maximum value. At this time, the emission power of the structured light is required to be large, and it can directly penetrate the display screen. Due to the use of a highly integrated uniform fill light depth camera, on the one hand, better human body photos can be obtained, and on the other hand, the mobile phone space can be better utilized to improve the performance of the mobile phone.
[0091] Figure 8 Schematic diagram of the structure of a payment terminal in the embodiment of the utility model. Figure 8 As shown, a payment terminal in an embodiment of the utility model includes:
[0092] The uniform fill-light depth camera 510 is used to obtain biometric information of the target object.
[0093] The processor 530 is used to detect the reflection signal of the target object, send the detection result to the server, and confirm the payment status according to the result returned by the server.
[0094] The input interface 540 is used to obtain the amount to be paid.
[0095] Display screen 550 is used to display the information to be paid and the information captured by the RGB camera.
[0096] The scanning device 560 is used to scan the commodity barcode to obtain the commodity price and quantity information, thereby determining the amount to be paid.
[0097] Specifically, in order to improve the convenience of the terminal, a scanning device 560 can be provided, which is particularly convenient for self-service checkout terminals. Self-service checkout terminals are generally large, with a large height difference. If users are asked to pull up the goods for scanning, it will be inconvenient, especially when users purchase heavy goods. Therefore, providing a scanning device and placing it at the bottom of the payment terminal can greatly improve convenience.
[0098] This embodiment uses a uniform fill-light depth camera to improve the integration of the device, which is beneficial to reducing the size of the payment terminal and making it more convenient for users to operate.
[0099] In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same and similar parts between the embodiments can be referred to each other. The above description of the disclosed embodiments enables professionals and technicians in this field to implement or use the utility model. Various modifications to these embodiments will be obvious to professionals and technicians in this field, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the utility model. Therefore, the utility model will not be limited to the embodiments shown herein, but will conform to the widest range consistent with the principles and novel features disclosed herein.
[0100] The above describes the specific embodiments of the present invention. It should be understood that the present invention is not limited to the above specific embodiments, and those skilled in the art can make various modifications or variations within the scope of the claims, which does not affect the essence of the present invention.
Claims
1. A uniform fill light depth camera, characterized in that: include: A projector for projecting infrared light; An infrared receiver, used for receiving an infrared reflection signal of a target object; A visible light receiver, used to receive a visible light reflection signal of the target object; A fill light, used for emitting fill light for fill lighting; A light homogenizing component, used for emitting the fill light in a homogenous manner; A panel, located on the surface, including a light-transmitting portion to allow light to pass through; The light-transmitting portion at least covers the projector, the infrared receiver, the visible light receiver and the light homogenizing component; The controller is electrically connected to the projector, the infrared receiver, the visible light receiver, and the fill light.
2. The uniform fill light depth camera according to claim 1, characterized in that: The light homogenizing component is a light homogenizing ring.
3. The uniform fill light depth camera according to claim 2, characterized in that: The side of the light uniforming ring close to the panel is flat and fits the panel.
4. The uniform fill light depth camera according to claim 2, characterized in that: There are multiple fill lights, which evenly illuminate the uniform light ring.
5. The uniform fill light depth camera according to claim 4, characterized in that: The light path of the fill light is arranged perpendicular to the panel.
6. The uniform fill light depth camera according to claim 4, characterized in that: The optical path of the fill light is arranged parallel to the panel, and one side of the uniform light ring is a total reflection surface, so that the visible light is uniformly emitted toward the panel.
7. The uniform fill light depth camera according to claim 1, characterized in that: The light homogenizing component is a reflector.
8. The uniform fill light depth camera according to claim 7, characterized in that: There are multiple fill lights, which evenly illuminate the reflector.
9. The uniform fill light depth camera according to claim 7, characterized in that: The reflector is a total reflection surface, so that the fill light is emitted evenly along the panel.
10. An electronic device, characterized in that: A uniform fill light depth camera comprising any one of claims 1-9.
