Distance detection device, imaging system, and electronic apparatus
By setting multiple units and modes in the signal transmitting and receiving modules, rapid zooming of electronic devices is achieved, solving the problem of slow mechanical zooming speed and improving the zooming speed and angular resolution of depth images in the imaging system.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-06
- Publication Date
- 2026-03-17
AI Technical Summary
Existing electronic devices' TOF systems use mechanical zoom, which prevents the focal length from reaching the optimal state, resulting in long zoom times and affecting the shooting effect.
Multiple transmitting units are set in the signal transmitting module and multiple receiving modes are set in the receiving module to transmit and receive light from different field of view angles, thereby achieving rapid zoom.
By using fast zoom, the problems of slow speed and long time of mechanical zoom are avoided, and the zoom speed of the imaging system and the angular resolution of depth images are improved.
Smart Images

Figure CN121679598A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of distance detection, and in particular to a distance detection device, an imaging system and an electronic device. BACKGROUND
[0002] Currently, an imaging system or a camera module of an electronic device is usually provided with a time of flight (TOF) device, and the TOF device acquires the distance of a target object by using a time of flight technology. The TOF device includes a signal transmitting module (also referred to as a transmitter) and a signal receiving module (receiver), the signal transmitting module is used to emit a light signal to the target object, and the light signal is reflected by the target object and can be received by the signal receiving module. According to the time of flight of the light signal between the signal transmitting module and the signal receiving module, the distance between the target object and the TOF device can be determined.
[0003] When the ToF system is used to assist in taking pictures by a mobile phone, different camera lenses need to be matched, which requires the ToF system to dynamically adjust the working field of view and the depth of field according to the application scenario. The current mainstream solution is mostly a mechanical zoom method, that is, the position of the focus is changed by moving the internal lens of the camera lens to change the length of the focal length of the camera lens, so as to realize the magnification and reduction of the image. Since the electronic device has strict limitations on power consumption and volume, the mechanical zoom solution needs to move parts, and its structure is complex and large in size, which leads to certain spatial limitations of the mechanical zoom method, and thus the focal length may not reach the best state, and because the movement process of the mechanical components is relatively slow, the zooming time is relatively long, thereby affecting the shooting effect. SUMMARY
[0004] In order to solve the foregoing technical problems, the present application provides a distance detection device capable of fast zooming, an imaging system and an electronic device.
[0005] In a first aspect, the present application provides a distance detection device, comprising a signal transmitting module and a signal receiving module, the signal transmitting module is used for transmitting light to a target object, the signal receiving module is used for receiving reflected light reflected by the target object, and the distance of the target object is determined according to the transmission time of the light. The signal transmitting module comprises a first transmitting unit and a second transmitting unit, and the signal receiving module comprises a first receiving mode and a second receiving mode. The first transmitting unit is used for transmitting light of a first field of view to the target object, the signal receiving module receives the reflected light of the first field of view in the first receiving mode, the second transmitting unit is used for transmitting light of a second field of view to the target object, and the signal receiving module receives the reflected light of the second field of view in the second receiving mode. The first field of view is smaller than the second field of view. By setting the first transmitting unit and the second transmitting unit of the signal transmitting module to transmit light of the first field of view and the second field of view at different times respectively, fast and effective zooming can be realized, and the problem of slow mechanical zooming speed and long time is avoided.
[0006] Optionally, the first transmitting unit comprises a first light source and a first light adjusting component, the first light source and the first light adjusting component are arranged at a preset distance along the light emitting direction, the first light source is used for transmitting light to the first light adjusting component, and the first light adjusting component adjusts the received light to the first field of view and then transmits it to the target object; the second transmitting unit comprises a second light source and a second light adjusting component, the second light source and the second light adjusting component are arranged at a preset distance along the light emitting direction, the second light source is used for transmitting light to the second light adjusting component, and the second light adjusting component adjusts the received light to the second field of view and then transmits it to the target object. The first transmitting unit and the second transmitting unit are respectively provided with different light sources, and the field of view is adjusted through different light adjusting components, so that the focal length switching can be realized simply and quickly.
[0007] Optionally, the signal transmitting module further comprises a third transmitting unit, the third transmitting unit comprises a third light source and a third light adjusting component, the third light source and the third light adjusting component are arranged at a preset distance along the light emitting direction, and the third transmitting unit is used for transmitting light of the first field of view or light of the second field of view; the third light source comprises a first light emitting area and a second light emitting area, the first light emitting area and the second light emitting area are used for transmitting light to the third light adjusting component, when the first light emitting area transmits light, the third light adjusting component adjusts the received light to the first field of view and then transmits it to the target object, when the second light emitting area transmits light, the third light adjusting component adjusts the received light to the second field of view and then transmits it to the target object, and the area of the first light emitting area is smaller than the area of the second light emitting area. The third light source is divided into different light emitting areas, and the field of view of the light is adjusted by cooperating with the third light adjusting component, so that light of different fields of view can be transmitted, the setting of the transmitting unit can be reduced, and the space occupation is reduced.
[0008] Optionally, the signal receiving module includes at least one sensing component. The sensing component includes a first receiving area and a second receiving area, with the second receiving area surrounding the first receiving area. Each of the first and second receiving areas includes multiple sensing elements. The sensing component controls the sensing elements within the first receiving area to activate and receive light from a first field of view according to a first command corresponding to a first receiving mode. Similarly, the sensing component controls the sensing elements within both the first and second receiving areas to activate and receive light from a second field of view according to a second command corresponding to a second receiving mode. By dividing the area of the sensing component that receives reflected light, and controlling areas of different sizes to receive reflected light from different field of view angles, the number of light receiving units is reduced, thus lowering the space occupied.
[0009] Optionally, the signal receiving module further includes a light receiving component. The sensing component and the light receiving component are set at a preset distance apart. The light receiving component is used to receive light rays reflected from the target object at a first field of view or a second field of view, and then converge and transmit them to the sensing component. The sensing component is used to convert the received light rays into electrical signals to determine the distance to the target object.
[0010] Optionally, the first receiving area and the second receiving area are provided with a plurality of sensing elements arranged in an array. A first number of sensing elements arranged adjacently in the first receiving area constitute a first sensing unit. The plurality of sensing elements in the first receiving area are also multiplexed with the plurality of sensing elements in the second receiving area to form a second sensing unit. A second number of sensing elements arranged adjacently in the first receiving area and the second receiving area constitute a second sensing unit. Each first sensing unit is used to receive reflected light from a first field of view and output an electrical signal accordingly. Each second sensing unit is used to receive reflected light from a second field of view and output an electrical signal accordingly. The first number is less than the second number. The electrical signal is used to characterize the distance of the target object.
[0011] Optionally, the first sensing unit includes a×a sensing elements arranged in an array, and the second sensing unit includes b×b sensing elements arranged in an array. The a×a sensing elements jointly output an electrical signal, and the b×b sensing elements jointly output an electrical signal, wherein b>a≥1.
[0012] By controlling multiple first sensing units in the first receiving area to receive light from the first field of view, controlling multiple second sensing units in the second receiving area to receive light from the second field of view, and controlling the number of sensing elements in the first sensing unit to be less than the number in the second sensing unit, the distance detection device can also follow the focus when switching focus between different zoom magnifications, thereby improving the angular resolution of the depth image.
[0013] Secondly, this application also provides an imaging system, including at least one image acquisition module and the aforementioned distance detection device, wherein the distance detection device is used to adjust to a preset field of view to obtain a distance signal of the target object, and is used to cooperate with the image acquisition module to acquire images.
[0014] Optionally, the image acquisition module includes a first camera and a second camera. The first camera has a first zoom ratio, and the second camera has a second zoom ratio, where the first zoom ratio is smaller than the second zoom ratio. A second transmitting unit emits light with a second field of view to the target object. A signal receiving module controls multiple second sensing units in a second receiving area to receive reflected light, cooperating with the first camera to acquire images. A first reflecting unit emits light with the first field of view to the target object, and the signal receiving module controls multiple first sensing units in the first receiving area to receive reflected light, cooperating with the second camera to acquire images. The first and second transmitting units emit light with different field of view to detect the target object, cooperating with cameras with different zoom ratios to acquire images.
[0015] Thirdly, this application also provides an electronic device, including a processor and the aforementioned imaging system, wherein the processor is electrically connected to the imaging system, and the processor forms an image of the target object based on the signal output by the imaging system.
[0016] Compared to the problems of existing technologies, the embodiments of this application, by setting a first reflection unit and a second reflection unit in the signal transmission module to emit light with different field of view angles to detect the distance of the target object, enable the imaging system to quickly switch focal lengths when focusing during image acquisition, thus avoiding the problem of slow and long mechanical zoom.
[0017] It should be understood that the beneficial effects achieved by the second to third aspects of the technical solutions of the embodiments of this application can be referred to the above-described technical effects of the first aspect and its corresponding possible implementations, and will not be repeated here. Attached Figure Description
[0018] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0019] Figure 1 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application;
[0020] Figure 2 This is a schematic diagram illustrating the field of view principle of a camera.
[0021] Figure 3 This is a schematic diagram of the structure of a signal transmission module in related technologies;
[0022] Figure 4 A schematic diagram of the circuit architecture of a distance detection device provided in an embodiment of this application;
[0023] Figure 5 for Figure 4 Schematic diagram of the mid-range detection device;
[0024] Figure 6 A schematic diagram of the structure of a signal transmitting module provided in another embodiment;
[0025] Figure 7 for Figure 6 A schematic diagram of the planar layout of the third light source;
[0026] Figure 8a for Figure 5 A schematic diagram of the energy intensity distribution of the projected light field in the first transmitting unit;
[0027] Figure 8b for Figure 5 A schematic diagram of the energy intensity distribution of the projected light field in the second transmitting unit;
[0028] Figure 9 for Figure 5 A schematic diagram of the planar layout of the sensing components;
[0029] Figure 10 A schematic diagram illustrating how a second or third camera assists a distance detection device in capturing images.
[0030] Figure 11 A schematic diagram illustrating how the first camera assists the distance detection device in capturing images. Detailed Implementation
[0031] To facilitate a clear description of the technical solutions of this application, the terms "first" and "second" are used to distinguish identical or similar items with essentially the same function and effect. Those skilled in the art will understand that the terms "first" and "second" do not limit the quantity or execution order, and that the terms "first" and "second" do not necessarily imply that they are different.
[0032] References to "one embodiment" or "some embodiments" as described in this application specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this application specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.
[0033] Before providing a detailed explanation of the distance detection device provided in the embodiments of this application, the application scenarios of the embodiments of this application will be described first. The embodiments of this application provide an electronic device that is an electronic device with a camera, specifically including handheld devices with image processing functions, vehicle-mounted devices, etc. For example, some electronic devices include: mobile phones, tablets, PDAs, laptops, mobile internet devices (MIDs), wearable devices, virtual reality (VR) devices, augmented reality (AR) devices, wireless terminals in industrial control, wireless terminals in self-driving, wireless terminals in remote surgical surgery, wireless terminals in smart grids, wireless terminals in transportation safety, wireless terminals in smart cities, wireless terminals in smart homes, cellular phones, cordless phones, session initiation protocol (SIP) phones, wireless local loop (WLL) stations, personal digital assistants (PDAs), handheld devices with wireless communication capabilities, computing devices or other processing devices connected to wireless modems, in-vehicle devices, terminal devices in 5G networks, or future evolution of public land mobile communication networks. Terminal devices in a network (PLMN), etc., are not limited to this in the embodiments of this application.
[0034] By way of example and not limitation, in this embodiment, the electronic device can also be a wearable device. Wearable devices, also known as wearable smart devices, are a general term for devices that utilize wearable technology to intelligently design and develop everyday wearables, such as glasses, gloves, watches, clothing, and shoes. Wearable devices are portable devices worn directly on the body or integrated into a user's clothing or accessories. Wearable devices are not merely hardware devices; they achieve powerful functions through software support, data interaction, and cloud interaction. Broadly defined, wearable smart devices include those with comprehensive functions, large size, and the ability to perform complete or partial functions without relying on a smartphone, such as smartwatches or smart glasses, as well as those focused on a specific application function that require interaction with other devices such as smartphones, such as various smart bracelets and smart jewelry for vital sign monitoring.
[0035] Furthermore, in this embodiment of the application, the electronic device can also be a terminal device in the Internet of Things (IoT) system. IoT is an important part of the future development of information technology. Its main technical feature is to connect objects to the network through communication technology, thereby realizing an intelligent network of human-machine interconnection and object-to-object interconnection.
[0036] The electronic devices in the embodiments of this application may also be referred to as: terminal equipment, user equipment (UE), mobile station (MS), mobile terminal (MT), access terminal, user unit, user station, mobile station, mobile station, remote station, remote terminal, mobile device, user terminal, terminal, wireless communication equipment, user agent, or user device, etc.
[0037] Please see Figure 1 , Figure 1 This is a schematic diagram of the structure of the electronic device 100 provided in the embodiments of this application.
[0038] The electronic device 100 can be an electronic device with camera or photo-taking function. For ease of understanding, this application embodiment uses a mobile phone as an example for illustration. Figure 1 The diagram shows the structure of the electronic device from both the front and back views.
[0039] like Figure 1As shown, the electronic device 100 may include a display screen 10 and a housing 20. The housing 20 may include a frame 21 and a back cover 22. The display screen 10 and the back cover 22 are located on both sides of the frame 21, which may surround the outer periphery of the display screen 10 and the outer periphery of the back cover 22. The display screen 10, the frame 21, and the back cover 22 may together form the internal cavity of the device. The frame 21 and the back cover 22 may be assembled into an integrated structure or be a single-piece molded structure. The display screen 10 may include a glass cover and a display panel fixed to the glass cover, the display panel being used to display images.
[0040] The electronic device 100 may also include a front-facing camera module 30, an earpiece module 40, a rear-facing camera module 50, a processor 70, etc., housed within the internal cavity of the device. The processor 70 is electrically connected to the display screen 10, the front-facing camera module 30, the earpiece module 40, and the rear-facing camera module 50.
[0041] like Figure 1 As shown in the left figure, for example, the front-facing camera module 30 and the earpiece module 40 can be installed in the upper middle part of the display screen 10. The display screen 10 may have a front-facing camera hole and an earpiece hole. The front-facing camera module 30 can collect external light from the electronic device 100 through the front-facing camera hole for taking selfies, and the earpiece module 40 can output sound through the earpiece hole so that the user can answer calls, voice messages, etc.
[0042] like Figure 1 As shown in the right figure, for example, the rear camera module 50 can be mounted on the upper middle part of the back cover 22. The electronic device 100 may also include a camera trim 80, which is mounted on the back cover 22 and has multiple light-transmitting holes. The rear camera module 50 can collect external light through the light-transmitting holes on the camera trim 80 to capture images of the scene around the electronic device 100.
[0043] Understandable. Figure 1 The installation positions of the front-facing camera module 30 and the rear-facing camera module 50 shown are merely illustrative, and this application does not limit the installation positions of the camera modules. In some other embodiments, the front-facing camera module 30 and the rear-facing camera module 50 may also be installed in other locations on the electronic device 100. For example, the front-facing camera module 30 may be installed on the upper left or upper right of the display screen 10. Similarly, the rear-facing camera module 50 may be installed on the upper left or upper right of the back cover 22. Furthermore, the front-facing camera module 30 or the rear-facing camera module 50 may be disposed on a movable component within the electronic device 100. By moving this movable component, it can be hidden within the electronic device 100 or protrude outside the electronic device 100.
[0044] Understandable. Figure 1 The number of front-facing camera modules 30 and rear-facing camera modules 50 shown is merely illustrative, and this application does not limit the number of camera modules. The electronic device 100 may include more or fewer camera modules.
[0045] The rear camera module 50 includes a first camera 51, a second camera 52, a third camera 53, and a distance detection device 60. The first camera 51 can be a telephoto camera with a long focal length, which can be used to photograph distant targets.
[0046] The second camera 52 can be a wide-angle camera or a main camera. It features a large amount of light intake, high resolution, and a central field of view. It is generally used as the default camera of electronic device 100, that is, it is used to respond to the user's operation of launching the "camera" application. It can start the main camera by default and display the image captured by the main camera in the preview interface.
[0047] The third camera 53 can be an ultra-wide-angle camera, used to capture wide scenes at close range, as well as larger subjects (such as buildings or landscapes). That is, the focal lengths of the first camera 51, the second camera 52, and the third camera 53 decrease sequentially.
[0048] The distance detection device 60 is used to measure the distance to the object to be photographed, or in other words, to measure the depth signal of the object to be photographed, in order to assist the first camera 51, the second camera 52, and the third camera 53 in taking pictures. The distance detection device 60 may include a signal transmitting module and a signal receiving module. The signal transmitting module may be located near the signal receiving module. The signal transmitting module can emit infrared light, and the signal receiving module may be a lens capable of detecting (capturing, receiving) infrared light. The infrared light emitted by the signal transmitting module is transmitted to the target object and reflected by the target object. The signal receiving module is used to receive the infrared light reflected by the target object, thereby measuring the distance to the target object.
[0049] It is understood that the rear camera module 50 in this application embodiment can be an imaging system, and the first camera 51, the second camera 52 and the third camera 53 are used to take pictures and images in cooperation with the distance detection device 60.
[0050] For example, the rear camera module 50 may also include a flash 55, which may be positioned near the main camera and the wide-angle camera to provide illumination to the main camera or the wide-angle camera when it is taking a picture. For example, in nighttime or low-light scenes, the light emitted by the flash 55 can illuminate the object being photographed by the main camera or the wide-angle camera, enabling the main camera or the wide-angle camera to capture the object.
[0051] In other embodiments, the rear camera module 50 may also include a macro camera, a fisheye camera, an infrared camera, and a monochrome camera, etc.
[0052] A macro camera is a special lens used for macro photography, primarily for photographing very small objects such as flowers and insects. Using a macro lens to capture small natural scenes allows for the capture of microscopic views that are normally invisible to the naked eye. A fisheye camera is an auxiliary lens with a focal length of 16mm or less and a field of view close to or equal to 180°.
[0053] A fisheye camera can be considered an extreme wide-angle camera. The front lens of this camera has a very short diameter and protrudes parabolically towards the front of the lens, resembling a fish's eye, hence the name "fisheye camera." The images captured by a fisheye camera differ significantly from the real world as seen by humans; therefore, fisheye cameras are generally used to achieve special shooting effects.
[0054] Infrared cameras have a wide spectral range. For example, they are used to sense infrared light. In low-light conditions (where visible light is weak), the ability of infrared cameras to sense infrared light can improve image quality when capturing images.
[0055] Black and white cameras do not have filters. Therefore, compared to color cameras, black and white cameras allow more light to pass through. However, images captured by black and white cameras can only display different levels of grayscale and cannot reproduce the true colors of the subject.
[0056] Please see Figure 2 , Figure 2 This is a schematic diagram illustrating the field of view principle of a camera.
[0057] like Figure 2As shown, the field of view of a camera is determined by its field of view (FOV). The larger the FOV, the larger the field of view. The FOV is the angle between the two edges of the optical instrument, with the lens as the vertex, representing the maximum range through which the image of the target object can pass through the lens. The size of the FOV determines the field of view of the optical instrument; a larger FOV results in a larger field of view and a smaller optical magnification (i.e., a shorter focal length). Therefore, the field of view of the first camera 51, the second camera 52, and the third camera 53 increase sequentially. In other words, if the target object exceeds this angle, it will not be captured by the lens. For optical devices such as cameras and camcorders, since their photosensitive surfaces are rectangular, the FOV is often calculated using the diameter of the image formed by the diagonal of the rectangular photosensitive surface. Alternatively, the FOV can also be calculated using the longer side of the rectangle.
[0058] The relevant technologies of this application are described below.
[0059] Please see Figure 3 , Figure 3 This is a schematic diagram of the structure of a signal transmission module in related technologies.
[0060] like Figure 3 As shown, the signal transmitting module 61 is used to emit infrared light to the target object. The signal transmitting module 61 includes a light-emitting component 601, a lens 602, and a motor component 603. The light-emitting component 601 is used to emit infrared light, and the lens 602 is fixed to the motor component 603. The motor component 603 is a movable part used to drive the lens 602 to move in the optical axis direction to realize the zoom of the lens 602.
[0061] However, as the imaging quality requirements of mobile phone camera modules become increasingly demanding, the size and weight of the lens 602 are also increasing, placing higher demands on the driving force of the motor assembly 603. Current electronic devices (such as mobile phones) also impose significant limitations on the size of their camera modules, and the volume occupied by the motor assembly 603 increases accordingly with the increase in the size of the lens 602. In other words, while the lens 602 is trending towards larger size and greater weight, the driving force provided by the motor assembly 603 cannot be increased accordingly. With limited driving force, the heavier the lens 602, the shorter the stroke that the motor assembly 603 can use to move the lens 602, severely impacting the zoom range. Furthermore, the heavier the lens 602, the slower the speed at which the motor assembly 603 can move the lens 602, and the longer it takes for the lens 602 to reach the predetermined compensation position, resulting in slower focusing and thus affecting the user experience.
[0062] Based on this, this application provides a distance detection device that can effectively reduce space occupation and improve zoom speed.
[0063] Please seeFigure 4 , Figure 4 This is a schematic diagram of the circuit architecture of a distance detection device 60 provided in an embodiment of this application.
[0064] like Figure 4 As shown, the distance detection device 60 includes a signal transmitting module 61, a signal receiving module 62, and a control module 63. The signal transmitting module 61 is used to emit light, and the signal receiving module 62 is used to receive the reflected light emitted by the signal transmitting module 61. The distance to the object being photographed is detected based on the time of flight of the light.
[0065] The signal transmitting module 61 includes at least two transmitting units, each emitting light with a different field of view. The signal receiving module 62 includes at least two receiving modes for receiving reflected light from different field of view angles. The number of transmitting units in the signal transmitting module 61 is the same as the number of receiving modes in the signal receiving module 62; that is, light emitted by one transmitting unit is received by the signal receiving module 62 in a corresponding receiving mode. The control module 63 controls one of the transmitting units to emit light and controls the signal receiving module 62 to adjust to the corresponding receiving mode to receive reflected light from a preset field of view angle.
[0066] In other embodiments, the signal transmitting module 61 may also include three, four, five, or N transmitting units for transmitting light from different field angles. Correspondingly, the signal receiving module 62 includes three, four, five, or N receiving modes for receiving reflected light from different field angles. The number of transmitting units and receiving modes can be set according to specific needs, and this application does not limit this.
[0067] Taking two transmitting units and two receiving modes as an example, such as Figure 5 As shown, Figure 5 for Figure 4A schematic diagram of the mid-range detection device shows that the signal transmitting module 61 includes a first transmitting unit 611 and a second transmitting unit 612. The first transmitting unit 611 emits light from a first field of view (FOV1), and the second transmitting unit 612 emits light from a second field of view (FOV2). The signal receiving module 62 receives the reflected light from the first field of view (FOV1) in a first receiving mode and the reflected light from the second field of view (FOV2) in a second receiving mode. The first field of view (FOV1) is smaller than the second field of view (FOV2), meaning the focal length corresponding to the first field of view (FOV1) is greater than the focal length corresponding to the second field of view (FOV2). Therefore, when the control module 63 controls the first transmitting unit 611 to emit light and correspondingly controls the signal receiving module 62 to receive the corresponding reflected light in the first receiving mode, the distance detection device 60 can cooperate with the first camera 51 to acquire images, making it suitable for long-range telephoto shooting. When the control module 63 controls the second transmitting unit 612 to emit light and the corresponding control signal receiving module 62 receives the corresponding reflected light in the second signal receiving mode, the distance detection device 60 can cooperate with the second camera 52 or the third camera 53 to perform image acquisition, which is applicable to wide-angle main camera or ultra-wide-angle shooting.
[0068] Specifically, the first emitting unit 611 includes a first light source 611a and a first dimming component 611b. The first light source 611a is used to emit light, such as invisible light like infrared light. The first dimming component 611b is set at a preset distance from the first light source 611a along the light emission direction. The first dimming component 611b is used to receive the light emitted by the first light source 611a, adjust it to a first field of view (FOV1), and then emit it to the target object to adapt to the first camera 51 (telephoto), that is, to adjust the focal length, thereby cooperating with the first camera 51 to perform image acquisition.
[0069] The second emitting unit 612 includes a second light source 612a and a second dimming component 612b. The second light source 612a is used to emit light, such as invisible light like infrared light. The second dimming component 612b is set at a preset distance from the second light source 612a. The second dimming component 612b is used to receive the light emitted by the second light source 612a, adjust it to a second field of view FOV2, and then emit it to the target object to adapt to the second camera 52 (wide-angle main camera) or the third camera 53 (ultra-wide-angle), that is, to adjust the focus, so as to cooperate with the second camera 52 or the third camera 53 to collect images.
[0070] In this embodiment, the first light source 611a and the second light source 612a can be any one of a vertical-cavity surface-emitting laser (VCSEL), a laser diode (LD), or a light-emitting diode (LED), but are not limited to.
[0071] In another embodiment, the first transmitting unit 611 and the second transmitting unit 612 may also share the same light source and dimming component, for example, Figure 6 and Figure 7 As shown, Figure 6 A schematic diagram of the structure of a signal transmitting module provided in another embodiment. Figure 7 for Figure 6 A schematic diagram of the planar layout of the third light source 613a is shown. The signal transmitting module 61 may further include a third transmitting unit 613, which transmits light from a first field of view (FOV1) or a second field of view (FOV2) to the target object for detection. The third transmitting unit 613 includes a third light source 613a and a third dimming component 613b, which are spaced at a preset distance along the light emission direction. The third light source 613a includes a first light emission area LA and a second light emission area LB. When the first light emission area LA emits light, the third transmitting unit 613 emits light from the first field of view (FOV1). When the second light emission area LB emits light, the third transmitting unit 613 emits light from the second field of view (FOV2). The third dimming component 613b receives the light from the first light emission area LA or the second light emission area LB, adjusts the field of view, and homogenizes the received light before transmitting it to the target object. In this configuration, the first light-emitting region LA is located at the center of the second light-emitting region LB, or in other words, the second light-emitting region LB surrounds the first light-emitting region LA. When the second light-emitting region LB emits light, the first light-emitting region LA also emits light. Of course, depending on specific needs, the third light source 613a can be configured with three, four, or five light-emitting regions to emit light from three, four, or five different field-of-view angles, respectively. This application does not impose any limitations on this.
[0072] In another embodiment, when the first light-emitting region LA is controlled to emit light, the second light-emitting region LB remains closed, and the third emitting unit 613 is used to emit light at the first field of view FOV1. When the second light-emitting region LB is controlled to emit light, the first light-emitting region LA is controlled to remain closed, and the third emitting unit 613 is used to emit light at the second field of view FOV2.
[0073] In an exemplary embodiment, the dimming components (first dimming component 611b, second dimming component 612b, and third dimming component 613b) may include a phase modulation element (not shown) and a light homogenizer (not shown). The phase modulation element is used to adjust the light emitted by the light source to a preset field of view, and the light homogenizer is used to shape the light emitted by the light source, making the shaped beam more uniform. The light homogenizer can be a microlens diffuser. The microlens array can achieve light homogenization based on geometric optics, and its transmission efficiency can reach over 80%. It consists of a series of microlenses arranged in an array. The microlens array is used to shape the light emitted by the light source, making the shaped beam more uniform, thereby making the light emitted by the signal transmitting module 61 more uniform. The microlenses in the microlens array can be arranged in a regular array, for example, the microlenses can be arranged in a rectangular, circular, regular polygonal, or linear array, and the distance between each adjacent pair of microlenses is equal. Alternatively, the microlenses in the microlens array can be arranged in an irregular array. For example, the microlenses can be arranged in an asymmetrical pattern, with the distance between any two adjacent microlenses not being exactly equal. This application does not limit the specific distribution of the microlens array. Of course, the first dimming component 611b and the second dimming component 612b can also be other devices that can make the beam more uniform, and this application does not limit them here.
[0074] In an exemplary embodiment, the dimming components (first dimming component 611b, second dimming component 612b, and third dimming component 613b) may also be diffractive optical elements (DOEs) used to shape the light beam emitted by the light source into more uniform light. Specifically, the DOE can be used to shape the light beam emitted by the light source into a uniform square light source or a uniform rectangular light source with a certain field of view (FOV) (e.g., a 5° × 5° FOV).
[0075] In an exemplary embodiment, the dimming components (first dimming component 611b, second dimming component 612b, and third dimming component 613b) may also be metasurface elements. A metasurface is an artificial material composed of an ultrathin two-dimensional array plane with subwavelength macroscopic basic units of a specific geometry arranged periodically or non-periodically. It is composed of multiple metamaterial structural units. By controlling the structure and arrangement period of the metamaterial structural units, the wavefront phase, amplitude, and polarization of the optical beam can be flexibly adjusted, thereby achieving the adjustment of the beam field of view.
[0076] Please refer to the following: Figure 8a and Figure 8b , Figure 8a for Figure 5 A schematic diagram of the energy intensity distribution of the projected light field in the first transmitting unit. Figure 8b for Figure 5A schematic diagram of the energy intensity distribution of the projected light field in the second transmitting unit.
[0077] like Figure 8a As shown, when the first transmitting unit 611 emits light with a first field of view FOV1, the area of the light field it projects is small, that is, the field of view is small. According to the radiation intensity values of the x and y axes, it can be seen that the radiation intensity at the center of the light field is higher than that at the edge, which is used to improve the detection distance of the light and is suitable for telephoto shooting mode, that is, suitable for assisting the first camera 51 in shooting.
[0078] like Figure 8b As shown, when the second emitting unit 612 emits light with a second field of view FOV2, the area of the light field it projects is large, that is, the field of view is large. According to the radiation intensity values of the x and y axes, it can be seen that the radiation intensity is higher at the edge of the light field and relatively lower at the center of the light field. It is suitable for close-range wide-angle or ultra-wide-angle shooting, that is, it is suitable for shooting by the second camera 52 or the third camera 53.
[0079] By setting at least two transmitting units to emit light from different field angles for detection, zooming can be effectively achieved. The field angle of light emitted by each transmitting unit can be set according to specific needs, avoiding the problem of limited zoom range caused by short lens travel in mechanical zooming. At the same time, by switching the operation of different transmitting units to switch light from different field angles, the zooming speed can be effectively improved, avoiding the problem of long zooming time caused by slow lens movement in mechanical zooming. Furthermore, by setting different receiving modes in the signal receiving module to receive light from different field angles, the space occupation can be effectively reduced.
[0080] Please continue reading. Figure 5 The signal receiving module 62 includes a sensing component 621 and a light receiving component 622, which are set at a preset distance apart. The light emitted by the signal transmitting module 61 is reflected by the target object and transmitted to the light receiving component 622. The light receiving component 622 is used to converge the received reflected light and transmit it to the sensing component 621. The sensing component 621 is used to convert the received reflected light into an electrical signal to provide distance information for the camera.
[0081] The sensing component 621 is a depth sensor, which can be any sensor capable of directly or indirectly acquiring a depth image, also known as a distance image. Each pixel in the depth image represents the distance between an object at a specific coordinate within the depth sensor's field of view and the depth sensor itself. In other words, a depth image is an image that uses the distance (depth) from the depth sensor to various points in the shooting scene as its pixel value. The pixel value (or grayscale value) of each pixel in the depth image can represent either relative depth or absolute depth (i.e., depth value). Relative depth can be understood as the logical relationship between the pixels. The distance between the real object corresponding to a pixel and the depth sensor or reference plane is called the depth value of that pixel; that is, the depth value of a pixel is the distance from the real object corresponding to that point to the depth sensor.
[0082] In this embodiment, the sensing component 621 can be a semiconductor chip. Its photosensitive surface has hundreds of thousands to millions of photodiodes, such as single-photon avalanche diodes (SPADs). When illuminated, the photodiodes generate an electrical charge, thereby converting the light signal into an electrical signal. The sensing component 621 can also be a charge-coupled device (CCD), a complementary metal-oxide semiconductor (CMOS), or the like.
[0083] like Figure 9 As shown, Figure 9 for Figure 5 A schematic diagram of the planar layout of the middle sensing component 621.
[0084] The sensing component 621 includes a first receiving area RA and a second receiving area RB. The first receiving area RA and the second receiving area RB include a plurality of arrayed sensing elements s. The sensing elements s are used to convert the received light signal into an electrical signal, thereby obtaining the distance signal or depth signal of the target object through the reflected light of the target object. The arrayed sensing elements s are used to generate an analog signal characterizing the image of the shooting scene based on the received light signal, or in other words, to generate an analog signal image.
[0085] The electronic device 100 also includes at least a memory (not shown), which stores at least two sets of selection area data, each corresponding to a different receiving mode. When the signal receiving module 62 receives reflected light in the first receiving mode, the control unit 63 controls the sensing element s in the first receiving area RA to receive the reflected light according to the selection area data in the memory. When the signal receiving module 62 receives reflected light in the second receiving mode, the control unit 63 controls the sensing element s in the second receiving area RB to receive the reflected light according to the selection area data in the memory. The first receiving area RA is located at the center of the second receiving area RB. That is, when the second receiving area RB is turned on to receive light, the sensing element s in the first receiving area RA is multiplexed to receive reflected light in the second receiving mode.
[0086] By selectively turning on sensing elements s in different regions under different receiving modes, unused sensing elements s can be turned off. That is, in the first receiving mode, some sensing elements s in the second receiving region RB can be turned off, thereby reducing power consumption.
[0087] The sensing component 621 can output images using a binning mode. Binning mode involves adding the charges sensed by adjacent sensing elements s together and reading them out as a single pixel. For example, in binning mode, the sensing component 621 can sum and average pixel values such as 1×1, 2×2, 3×3, 4×4, and 5×5 to obtain a single pixel value, which is then output as the processed pixel value. Of course, other calculation methods can also be used to calculate pixel values; this application does not impose any limitations on this.
[0088] In this embodiment, a first number of sensing elements s arranged adjacently in the first receiving area RA constitutes a first sensing unit SU1, meaning the first receiving area RA includes multiple first sensing units SU1. Each first sensing unit SU1 receives reflected light from a first field of view (FOV1) and outputs an electrical signal representing the distance to the target object. The multiple sensing elements s in the first receiving area RA are also multiplexed with multiple sensing elements s in the second receiving area RB to form a second sensing unit SU2. That is, a second number of sensing elements arranged adjacently in the first receiving area RA and the second receiving area RB constitutes a second sensing unit SU2. Each second sensing unit SU2 receives emitted light from a second field of view (FOV2) and outputs an electrical signal representing the distance to the target object. The first number is less than the second number, meaning the number of sensing elements s in each first sensing unit SU1 is greater than the number of sensing elements s in the second sensing unit SU2.
[0089] In an exemplary embodiment, the plurality of sensing elements s in the first sensing unit SU1 and the second sensing unit SU2 can be arranged in a horizontal arrangement, a vertical arrangement, or an array arrangement, etc., and this application does not limit this.
[0090] When the distance detection device 60 assists the first camera 51 in shooting, that is, in high zoom shooting, when the signal receiving module 62 receives the reflected light in the first receiving mode, each first sensing unit SU1 in the first receiving area RA outputs an electrical signal or a depth signal. When the distance detection device 60 assists the second camera 52 or the third camera 53 in shooting, that is, in low zoom shooting, each second sensing element SU2 in the second receiving area RB outputs an electrical signal or a depth signal.
[0091] In other embodiments, a plurality of third sensing units (not shown) may be provided in the first receiving area RA and the second receiving area RB. Each third sensing unit includes a third number of sensing elements s arranged adjacent to each other, wherein the third number is greater than the first number and less than the second number. When the first receiving area RA is opened to receive reflected light from the first field of view (FOV1), the plurality of first sensing units SU1 and the plurality of third sensing units in the first receiving area RA simultaneously receive the reflected light from the first field of view (FOV1), and each first sensing unit SU1 and each third sensing unit outputs a corresponding electrical signal. When the second receiving area RB is opened to receive reflected light from the second field of view (FOV2), the plurality of second sensing units SU2 and the plurality of third sensing units in the first receiving area RA and the second receiving area RB simultaneously receive the reflected light from the second field of view (FOV2), and each second sensing unit SU2 and each third sensing unit outputs a corresponding electrical signal. By providing third sensing units that are different from the first sensing units SU1 and the second sensing units SU2, the power consumption of the sensing component 621 can be reduced in the first receiving mode, and the angular resolution of the depth image can be improved in the second receiving mode.
[0092] Please refer to the following: Figure 10 and Figure 11 , Figure 10 A schematic diagram illustrating how the distance detection device 60 is assisted by a second camera 52 or a third camera 53 to capture images. Figure 11 A schematic diagram illustrating how the distance detection device 60 assists the first camera 51 in capturing images.
[0093] like Figure 10As shown, when the user takes a picture of the target object at the first zoom level (1x zoom level in this embodiment), i.e., a low zoom level, wide-angle or ultra-wide-angle shooting is mainly performed. This corresponds to the second camera 52 and the third camera 53. A larger field of view is obtained through a smaller focal length. At this time, the control module 63 controls the second transmitting unit 612 to emit light with a second field of view (FOV2) to the target object. Simultaneously, the signal receiving module 62 receives the reflected light in a second receiving mode. That is, the control module 63 controls multiple second sensing units SU2 in the sensing component 612 to open to receive the reflected light and convert the received reflected light into electrical signals to cooperate with the second camera 52 or the third camera 53 to generate an image. The image acquired at this time mainly includes the person and the surrounding scenery. The second sensing unit SU2 can be composed of b×b sensing elements s arranged in an array, i.e., each adjacent b×b sensing elements s outputs a depth signal.
[0094] like Figure 11 As shown, when the user takes a picture of the target object at the second zoom level (2.5x zoom level in this embodiment, i.e., high zoom level), the main focus is on long-distance shooting. This corresponds to the first camera 51, which uses a larger focal length and a smaller field of view to capture images from a greater distance. At this time, the control module 63 controls the first transmitting unit 611 to emit light with a first field of view (FOV1) to the target object. Simultaneously, the signal receiving module 62 receives the reflected light in a first receiving mode. That is, the control module 63 controls multiple first sensing units (SU1) in the first receiving area RA of the sensing component 621 to open and receive the reflected light, converting the received reflected light into electrical signals to cooperate with the first camera 51 in generating an image. The image acquired at this time is mainly a person image. The first sensing unit (SU1) in the first receiving area RA can be composed of a×a arrayed sensing elements (s), meaning that each adjacent a×a sensing elements (s) outputs a depth signal.
[0095] When a user switches from 1x zoom to 2.5x zoom, that is, from the second camera 52 or the third camera 53 to the first camera 51 for shooting, if the distance detection device 60 does not adjust the merged sensing element s, an image magnification problem will occur, but the angular resolution will decrease. Figure 11The problem in the left-hand diagram is that, in this embodiment, when the user controls the second camera 52 or the third camera 53 to switch to the first camera 51 for shooting, the distance detection device 60 also controls the switch from the second transmitting unit 612 to the first transmitting unit 611, and simultaneously controls the sensor component 621 to switch from the second receiving mode to the first receiving mode. That is, the simultaneous reception of reflected light by the first receiving area RA and the second receiving area RB is adjusted to the first receiving area BA receiving reflected light, and the output of a depth signal per b×b sensing elements s is switched to the output of a depth signal per a×a sensing elements s. By reducing the number of sensing elements s in each sensing unit, the first receiving area RA contains more first sensing elements SU1 than the second sensing unit SU2, that is, the number of first sensing elements SU1 is increased, thereby increasing the number of depth signals output by the first receiving area RA, and thus improving the angular resolution of the depth image when shooting at the second zoom magnification. Figure 11 As shown in the middle right figure. Furthermore, when controlling the first receiving area RA to receive reflected light, controlling the second receiving area RB to turn off can reduce power consumption during telephoto shooting. In addition, when shooting portraits, the sensing element s in areas other than the portrait can be turned off, or the sensing element s in areas other than the portrait can be controlled to turn off, or detection can be performed in the mode of the second sensing unit SU2, thereby further reducing power consumption during telephoto shooting.
[0096] For example, when shooting at 1x zoom, every 5×5 adjacent sensing elements s in the second receiving area RB jointly output a depth signal. When switching to 2.5x zoom, every 2×2 adjacent sensing elements in the first receiving area RA jointly output a depth signal. By adjusting the number of merging sensing elements when switching zoom levels, the angular resolution of the depth image is effectively improved, eliminating the problem of insufficient resolution when the distance detection device 60 assists different cameras. At the same time, it avoids increasing the number of pixels to ensure angular resolution, reduces the cost of sensing components, reduces power consumption, and increases space utilization.
[0097] The above-disclosed embodiments are merely some of the embodiments of this application, and should not be construed as limiting the scope of this application. Those skilled in the art can understand that all or part of the processes for implementing the above embodiments, and equivalent changes made in accordance with the claims of this application, still fall within the scope of this application.
Claims
1. A distance detection device, comprising a signal transmitting module and a signal receiving module, wherein the signal transmitting module is used to transmit light to a target object, and the signal receiving module is used to receive reflected light reflected from the target object, and to determine the distance to the target object based on the transmission time of the light. Its features are, The signal transmitting module includes a first transmitting unit and a second transmitting unit, and the signal receiving module includes a first receiving mode and a second receiving mode. The first transmitting unit is used to transmit light with a first field of view to the target object, and the signal receiving module receives the reflected light with the first field of view in the first receiving mode. The second transmitting unit is used to transmit light with a second field of view to the target object, and the signal receiving module receives the reflected light with the second field of view in the second receiving mode. The first field of view is smaller than the second field of view.
2. The distance detection device as described in claim 1, characterized in that, The first emitting unit includes a first light source and a first dimming component. The first light source and the first dimming component are arranged at a preset distance along the light emission direction. The first light source is used to emit light to the first dimming component. The first dimming component adjusts the received light to the first field of view and then emits it to the target object. The second emitting unit includes a second light source and a second dimming component. The second light source and the second dimming component are set at a preset distance along the light emission direction. The second light source is used to emit light to the second dimming component, and the second dimming component adjusts the received light to the second field of view and then emits it to the target object.
3. The distance detection device as described in claim 2, characterized in that, The signal transmitting module further includes a third transmitting unit, which includes a third light source and a third dimming component. The third light source and the third dimming component are arranged at a preset distance along the light emission direction. The third transmitting unit is used to emit light from the first field of view or light from the second field of view. The third light source includes a first light-emitting area and a second light-emitting area. The first light-emitting area and the second light-emitting area are used to emit light to the third dimming component. When the first light-emitting area emits light, the third dimming component adjusts the received light to the first field of view and then emits it to the target object. When the second light-emitting area emits light, the third dimming component adjusts the received light to the second field of view and then emits it to the target object. The area of the first light-emitting area is smaller than the area of the second light-emitting area.
4. The distance detection device according to any one of claims 1-3, characterized in that, The signal receiving module includes at least one sensing component. The sensing component includes a first receiving area and a second receiving area. The second receiving area is arranged around the first receiving area. The first receiving area and the second receiving area each include a plurality of sensing elements. The sensing component controls the sensing elements in the first receiving area to activate according to a first instruction corresponding to the first receiving mode in order to receive light from the first field of view. The sensing component controls the sensing elements in the first receiving area and the second receiving area to activate according to a second instruction corresponding to the second receiving mode in order to receive light from the second field of view.
5. The distance detection device as described in claim 4, characterized in that, The signal receiving module further includes a light receiving component. The sensing component and the light receiving component are set at a preset distance apart. The light receiving component is used to receive light rays reflected from the target object at the first field of view or the second field of view, and then converge and transmit them to the sensing component. The sensing component is used to convert the received light rays into electrical signals to determine the distance to the target object.
6. The distance detection device as described in claim 5, characterized in that, The first receiving area and the second receiving area are provided with a plurality of sensing elements arranged in an array. A first number of sensing elements arranged adjacently in the first receiving area constitute a first sensing unit. The plurality of sensing elements in the first receiving area are also multiplexed with the plurality of sensing elements in the second receiving area to form a second sensing unit. A second number of sensing elements arranged adjacently in the first receiving area and the second receiving area constitute a second sensing unit. Each of the first sensing units is used to receive the reflected light from the first field of view and output an electrical signal accordingly, and each of the second sensing units is used to receive the reflected light from the second field of view and output an electrical signal accordingly, wherein the first number is less than the second number, and the electrical signal is used to characterize the distance of the target object.
7. The distance detection device as described in claim 6, characterized in that, The first sensing unit includes a×a sensing elements arranged in an array, and the second sensing unit includes b×b sensing elements arranged in an array. The a×a sensing elements jointly output an electrical signal, and the b×b sensing elements jointly output an electrical signal, wherein b>a≥1.
8. An imaging system, characterized in that, It includes at least one image acquisition module and a distance detection device as described in any one of claims 1-7, wherein the distance detection device is used to adjust to a preset field of view to obtain distance information of the target object, and is used to cooperate with the image acquisition module to acquire images.
9. The imaging system as described in claim 8, characterized in that, The image acquisition module includes a first camera and a second camera. The first camera has a first zoom ratio, and the second camera has a second zoom ratio. The first zoom ratio is smaller than the second zoom ratio. The second transmitting unit is used to transmit light from the second field of view to the target object. The signal receiving module is used to control multiple second sensing units in the second receiving area to receive reflected light in order to cooperate with the first camera to capture images. The first reflecting unit is used to transmit light from the first field of view to the target object. The signal receiving module is used to control multiple first sensing units in the first receiving area to receive reflected light in order to cooperate with the second camera to capture images.
10. An electronic device, characterized in that, It includes a processor and an imaging system as described in claim 9, wherein the processor is electrically connected to the imaging system and forms an image of the target object based on a signal output by the imaging system.