TOF focusing apparatus, focusing method, and paragraphing device

By setting multiple projection modes in the TOF focusing device, the beam detection distance is dynamically adjusted according to the distance between the shooting device and the subject to be photographed, the problem of insufficient reflected light energy when detecting a long-distance object is solved, and the focus speed is improved. Reduces the risk of fever.

WO2024234279A1PCT designated stage expired Publication Date: 2024-11-21WUHAN HAOYIYUAN TECHNOLOGY CO LTD +1
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2023/094444
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-16
Publication Date
2024-11-21

AI Technical Summary

Technical Problem

When detecting long-distance objects, the reflected light energy is insufficient, resulting in short detection distance or severe heat generation of the emission unit. The existing solution requires two light sources to transmit alternately in time, resulting in slow focus speed.

Method used

It provides a TOF focusing device, including a transmitting unit and a receiving unit in a variety of projection modes. By selecting a suitable projection mode according to the distance between the shooting device and the subject to be photographed, a complete depth information is generated by just one beam acquisition. Increase focus speed.

Benefits of technology

By adaptively selecting the appropriate beam projection mode, the focus speed is improved without increasing heat generation, and the high power consumption and extended focus time caused by the alternating operation of multiple light sources is avoided.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2023094444_21112024_PF_FP_ABST
    Figure CN2023094444_21112024_PF_FP_ABST
Patent Text Reader

Abstract

Embodiments of the present description provide a TOF focusing apparatus, a focusing method, and a paragraphing device. A plurality of light beam projection modes can be set for the TOF focusing apparatus in advance, and detection distances of light beams projected by the TOF focusing apparatus in different projection modes are different. In the focusing process, a distance interval range where the distance between an object to be photographed and the photographing device is located can be pre-determined, a target projection mode suitable for a current photography scene is selected on the basis of the distance between said object and the photographing device, and a suitable light beam projection mode is selected adaptively according to the distance between said object and the photographing device, so that focusing can be completed by projecting the light beam only once (i.e., collecting a depth image frame) instead of projecting the light beam twice alternately in a time-sharing manner, thereby improving the focusing speed.
Need to check novelty before this filing date? Find Prior Art

Description

TOF focusing device, focusing method and shooting equipment Technical Field

[0001] This specification relates to the field of photography technology, and in particular to a TOF focusing device, focusing method, and shooting equipment. Background Art

[0002] TOF focusing is usually divided into single-point TOF focusing and multi-point TOF focusing. The single-point TOF focusing device can only emit one beam of light during the focusing process, which can easily cause misalignment of the object. During the focusing process, the multi-point TOF focusing device can emit a planar array light beam with a certain projection angle of view (FOV), which can solve the problem of misalignment. However, when the subject is far away from the TOF focusing device, the reflected light energy is insufficient, resulting in the inability to effectively trigger the receiving unit (for example, sensor) in the TOF focusing device, resulting in a short detection distance. If a longer detection distance is to be achieved, the light source emission power of the TOF sensor is relatively large, resulting in severe heating.

[0003] Currently, to address the above issues, two light sources can be set up in the TOF focusing device. One light source has a larger projection angle and a longer detection distance, while the other light source has a smaller projection angle and a longer detection distance. When focusing, the two light sources need to alternately project light beams in a time-sharing manner. That is, it is necessary to obtain complete and accurate depth information through statistical analysis of the two frames of TOF depth maps collected by the two light sources. This method takes a long time to determine the depth information, resulting in a slower focusing speed.

[0004] Summary of the Invention

[0005] Based on this, this specification provides a TOF focusing device, a focusing method and a shooting device.

[0006] According to a first aspect of an embodiment of this specification, a TOF focusing device is provided, comprising a transmitting unit, a receiving unit, and a control unit, wherein the transmitting unit has multiple projection modes, and the detection distance of the light beam projected by the transmitting unit in different projection modes is different;

[0007] The control unit is configured to determine a target projection mode from the multiple projection modes based on the distance between the camera and the subject during focusing of the camera, and notify the transmitting unit; wherein the detection distance corresponding to the target projection mode is positively correlated with the distance between the camera and the subject;

[0008] The transmitting unit is used to project a light beam according to the target projection mode;

[0009] The receiving unit is used to receive the return light after the light beam projected by the transmitting unit is reflected, and determine the depth information of the photographed object based on the return light, so as to focus the photographing device based on the depth information.

[0010] According to a second aspect of the embodiments of this specification, a shooting device is provided, which includes the TOF focusing device mentioned in the first aspect above.

[0011] According to a third aspect of an embodiment of this specification, a focusing method is provided, applicable to a TOF focusing device, wherein the TOF focusing device includes multiple projection modes, and the detection distance of the TOF focusing device is different in different projection modes. The method includes:

[0012] During focusing of the shooting device, determining a target projection mode from the plurality of projection modes based on the distance between the shooting device and the subject;

[0013] The TOF focusing device is controlled to project a light beam according to the target projection mode, and the depth information of the photographed object is determined based on the returned light of the light beam received by the TOF focusing device, so as to focus the shooting device based on the depth information.

[0014] According to a fourth aspect of the embodiments of this specification, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed, the method mentioned in the first aspect is implemented.

[0015] Applying the embodiment scheme of this specification, taking into account that during the focusing process, when the distance between the photographed object and the shooting device is different, the detection distance requirements for the light beam projected by the TOF focusing device are also different. Therefore, a variety of light beam projection modes can be set for the TOF focusing device in advance, and the detection distances of the light beams projected by the TOF focusing device under different projection modes are different. During the focusing process, the distance interval range of the distance between the photographed object and the shooting device can be pre-judged (for example, the distance interval range of the two can be automatically analyzed by a software algorithm), and the target projection mode suitable for the current shooting scene is selected based on the distance between the photographed object and the shooting device. For example, if the distance between the photographed object and the shooting device is far, a projection mode with a larger detection distance can be selected, otherwise, a mode with a smaller detection distance can be selected. By adaptively selecting a suitable light beam projection mode according to the distance range between the photographed object and the shooting device, only one light source needs to be emitted, and there is no need for two light sources to emit light alternately in time-sharing, that is, a complete and accurate depth information map is generated in one frame of TOF detection cycle time, and the focusing algorithm uses this depth information to control the lens to complete focusing, thereby improving the focusing speed.

[0016] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the specification and, together with the description, serve to explain the principles of the specification.

[0018] FIG1 is a schematic diagram of a TOF focusing principle according to an embodiment of this specification.

[0019] FIG2 is a schematic diagram of a multi-point TOF focusing principle according to an embodiment of this specification.

[0020] FIG3 is a schematic diagram of a multi-point TOF focusing device according to an embodiment of the present specification, which realizes focusing by alternately projecting two light beams in a time-sharing manner.

[0021] FIG4 is a schematic structural diagram of a TOF focusing device according to an embodiment of this specification.

[0022] FIG5 is a schematic diagram of an embodiment of the present disclosure showing how to change the projection viewing angle of a light source by changing the lens combination on the light path of the light source.

[0023] FIG6 is a flow chart of a focusing method according to an embodiment of this specification. DETAILED DESCRIPTION

[0024] Exemplary embodiments will be described in detail herein, with examples illustrated in the accompanying drawings. In the following description, when referring to the drawings, identical numerals in different figures represent identical or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all embodiments consistent with this specification. Rather, they are merely examples of apparatus and methods consistent with certain aspects of this specification, as detailed in the appended claims.

[0025] The terms used in this specification are for the purpose of describing specific embodiments only and are not intended to limit this specification. As used in this specification and the appended claims, the singular forms "a," "an," "the," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and / or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

[0026] It should be understood that although the terms first, second, third, etc. may be used in this specification to describe various information, such information should not be limited to these terms. These terms are merely used to distinguish information of the same type from one another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information without departing from the scope of this specification. Depending on the context, the term "if" as used herein may be interpreted as "when," "when," or "in response to determining."

[0027] Currently, commonly used focusing methods include phase detection, contrast detection, and Time of Flight (TOF). Compared to phase detection and contrast detection, TOF can achieve better focusing results even in scenes with low ambient light and low contrast. It also has a faster focusing speed, making it increasingly widely used in various focusing scenarios.

[0028] As shown in Figure 1, the principle of TOF focusing is to transmit a light beam toward the lens of the shooting device through the transmitting unit (for example, a laser transmitter) in the TOF focusing device. The light beam is reflected back by the object to be photographed and received by the receiving unit (for example, a TOF sensor) in the TOF focusing device. According to the time difference between the light beam emission timestamp T0 and the reception timestamp T and the speed of light V, the distance L between the object to be photographed and the shooting device can be calculated: L=V(T-T0) / 2. Then, based on this distance information and the lens object distance lookup table, the lens of the shooting device can be driven to the corresponding position to complete the focusing.

[0029] TOF focusing devices are generally divided into single-point TOF focusing devices and multi-point TOF focusing devices. In the single-point TOF focusing device, the emitting unit only projects one beam of light, i.e., a single-point light source, during the focusing process. This type of focusing device is prone to misalignment with the object and causes misfocusing.

[0030] During the focusing process of the multi-point TOF focusing device, the transmitting unit can project a planar array light beam with a certain projection angle of view (FOV), so that most objects within the shooting angle of view of the shooting device can be detected. As shown in Figure 2, the transmitting unit of the multi-point TOF focusing device can emit a planar array light beam with a certain FOV. After receiving the return light reflected by these planar array light beams from the external environment, the receiving unit can obtain a depth map (i.e., a point cloud map). Each pixel in the depth map contains depth information, indicating the distance between the point and the shooting device. Among them, each pixel in the depth map collected by the TOF focusing device corresponds to a pixel area in the image collected by the shooting device. For example, the pixel in the first row and first column of the depth map corresponds to a small pixel area in the upper left corner of the image. Therefore, the distance between the object in each pixel area in the image and the shooting device can be determined based on the depth map.

[0031] Multi-point TOF focusing can solve the problem of inaccurate single-point TOF focusing. However, when the transmitting unit of the TOF focusing device has a low transmission power, if the object is far away from the TOF focusing device, the reflected light energy is insufficient, resulting in an inability to effectively trigger the receiving unit, and the TOF sensor cannot detect distant objects. If the power of the transmitting unit is set to a high level in order to detect distant objects, it is easy to waste power and generate severe heat, which to a certain extent shortens the service life of the transmitting unit. It can be seen that multi-point TOF focusing has the problem of either short detection distance or excessive power.

[0032] In order to solve the above-mentioned problems of the multi-point TOF focusing device, one way is to set two groups of light sources in the emitting unit of the multi-point TOF focusing device. The power of the two groups of light sources can be the same or one large and one small (high power is responsible for long distance, low power is responsible for close distance), but the projection angles when projecting the light beam are different. The two groups of light sources can alternately emit light beams in time-sharing or be in the emitting state at the same time during the focusing process. For example, as shown in Figure 3, light source 1 can be set, and its FOV1 of the projected light beam is 60 degrees horizontally and 40 degrees vertically. Since the angle is relatively large, the light energy divergence is large, and the detection distance is within 3 meters. At the same time, light source 2 is set, and its FOV2 of the projected light beam is assumed to be 30 degrees horizontally and 10 degrees vertically. Since the horizontal and vertical angles are narrowed, the light energy is relatively concentrated than that of light source 1, so its detection distance will be farther than that of light source 1, and can be close to 10 meters. During the focusing process, light source 1 can be used to project a light beam first, and then the receiving unit receives the return light reflected by the external environment to obtain the depth information of the close-range object (i.e., depth map 1). Then, light source 2 can be used to project a light beam, and the receiving unit receives the return light reflected by the external environment to obtain the depth information of the distant object (i.e., depth map 2). The depth information measured twice can then be combined to obtain complete depth information (i.e., complete depth map 3) for focusing. If light source 1 and light source 2 work simultaneously, the TOF focusing device records the corresponding pulse cycle emission start time, and the distance detection can be completed by obtaining the corresponding reception time through algorithm comparison and filtering. In this way, the dual-field-of-view light source is combined with the detection of both long and short distances, so that the TOF focusing device can detect objects at both long and short distances.

[0033] Since the receiving unit of the TOF focusing device is similar to the CMOS sensor of a camera, it has a frame rate concept and needs to complete photon integration and sampling frame by frame. Assuming that light source 1 projects a light beam first, the receiving unit needs to complete the sampling and reception of the pulsed photons projected by light source 1 in one frame. At the beginning of the next frame, it is the turn of light source 2 to project a light beam, and the receiving unit needs to complete the sampling and reception of the pulsed photons projected by light source 2 in another frame. Therefore, it takes the acquisition time of two frames of depth images to complete the determination of the depth information of one focusing cycle. Since the frame rate of the receiving unit itself is limited, it takes a long time to complete the acquisition of one frame of depth image. If the two frames of depth images are combined to achieve a single focus, the overall focus time will be further extended and the focus speed will be reduced. Since focus speed is a prominent indicator during the shooting process, generally, the faster the better. The current focusing method sacrifices focus speed. In addition, the two light sources are in a state of alternating or simultaneous operation, which results in high average power consumption and severe heat generation, requiring the addition of a fan to assist in heat dissipation. Related issues need to be improved.

[0034] Based on this, an embodiment of the present application provides a multi-point TOF focusing solution, taking into account that during the focusing process, when the distance between the photographed object and the shooting device is different, the detection distance requirements for the light beam projected by the TOF focusing device are also different. Therefore, a variety of light beam projection modes can be set for the TOF focusing device in advance, and the detection distances of the light beams projected by the TOF focusing device are different under different projection modes. During the focusing process, the distance interval range of the distance between the photographed object and the shooting device can be pre-judged first, and the target projection mode suitable for the current shooting scene can be selected based on the distance between the photographed object and the shooting device. For example, if the distance between the photographed object and the shooting device is far, a projection mode with a larger detection distance can be selected, otherwise, a mode with a smaller detection distance can be selected. By adaptively selecting a suitable light beam projection mode according to the distance between the photographed object and the shooting device, focusing can be completed by projecting a light beam only once (i.e., capturing a frame of depth image), without the need to project two light beams alternately in time-sharing, thereby improving the focusing speed.

[0035] As shown in Figure 4, it is a schematic diagram of the TOF focusing device provided in an embodiment of the present application, and the TOF focusing device can be used to assist the shooting device in focusing. In some embodiments, the TOF focusing device and the shooting device can be two independent devices, and when in use, the two can be connected through a communication interface. For example, in some embodiments, the TOF focusing device may include a hardware interface, and the hardware interface may be an interface with data transmission, such as a USB interface, a Type-C interface, etc. The TOF focusing device can be connected to the shooting device through the hardware interface, and in some scenarios, the hardware interface may also have power supply capability. The TOF focusing device and the shooting device can realize the transmission of various types of information such as depth information and control commands through the hardware interface.

[0036] In some embodiments, the TOF focusing device can be integrated with the camera, that is, the TOF focusing device can be a functional module in the camera, directly integrated on the camera. The specific implementation method can be flexibly selected based on actual needs and is not limited by the embodiments of this application.

[0037] As shown in Figure 4 , the TOF focusing device 40 may include a transmitting unit 41, a receiving unit 42, and a control unit 43. The control unit 43 is communicatively connected to the transmitting unit 41 and the receiving unit 42, respectively. The transmitting unit 41 may be configured to transmit a planar array of light beams, such as laser pulses. The transmitting unit 41 may include one or more light sources, such as laser emitters.

[0038] In some embodiments, the light source in the emitting unit may be a vertical cavity surface emitting laser, and of course may be other types of light sources with similar functions, which is not limited in the embodiments of the present application.

[0039] The receiving unit 42 may be configured to receive the return light emitted by the transmitting unit and reflected back by the external environment. The receiving unit may be any sensor that can sense light signals and convert the sensed light signals into electrical signals.

[0040] The control unit 43 can be used to implement some control logic of the TOF focusing device and interact with the software system of the shooting device. The control unit 43 can be some microprocessors, such as MCU.

[0041] In order to meet the changing requirements for the detection distance of the TOF focusing device when the distance between the photographed object and the shooting device is different, a variety of different projection modes (such as projection mode 1 to projection mode n in Figure 4) can be pre-set for the transmitting unit 41. Under different projection modes, the detection distance of the light beam projected by the transmitting unit 41 is also different. Among them, the detection distance refers to the maximum distance between the object and the TOF focusing device that can be detected by the light beam projected by the transmitting unit 41. For example, when the distance between an object and the TOF focusing device exceeds 10 meters, the energy of the light beam projected by the transmitting unit 41 is already weak after reaching the object, and the return light reflected by the object cannot trigger the receiving unit, that is, the TOF focusing device cannot detect the object, which means that the detection distance of the light beam projected by the transmitting unit 41 is 10 meters, and it cannot be detected if it exceeds 10 meters.

[0042] After the user issues a focus instruction, the control unit 43 can determine the target projection mode from the multiple projection modes of the transmitting unit 41 based on the distance between the photographed object and the shooting device. For example, the control unit 43 can pre-judge the distance between the photographed object and the shooting device, determine which distance interval it is approximately in, and then select the projection mode that matches the distance interval as the target projection mode. The farther the distance between the photographed object and the shooting device, the longer the detection distance corresponding to the target projection mode is, thereby ensuring that the photographed object can be detected. After determining the target projection mode, the control unit 43 can notify the transmitting unit 41 so that the transmitting unit 41 can project the light beam according to the target projection mode. The receiving unit 43 can receive the return light reflected by the external environment from the light beam projected by the transmitting unit 41, and calculate the depth information based on the time difference between the time of receiving the return light and the time of projecting the light beam, so that the focus of the shooting device can be controlled based on the depth information.

[0043] Generally speaking, when the transmission power of the transmitting unit 41 is fixed, the larger the projection angle when projecting the light beam, the more dispersed the light beam energy, and the smaller the detection distance will be. Conversely, the larger the detection distance will be. Similarly, when the projection angle of the transmitting unit 41 is fixed, the greater the transmission power, that is, the greater the light beam energy, the greater the detection distance will be. Therefore, in some embodiments, the detection distance of the TOF focusing device can be changed by changing the projection angle and / or transmission power of the transmitting unit 41 to obtain detection distances under multiple projection modes.

[0044] In some scenarios, the projection angle of view of the emitting unit 41 in different projection modes may be different, but the transmission power may be the same. For example, assuming there are three projection modes, the transmission power of the emitting unit 41 in the three projection modes is the same, but the projection angle of view is different. The projection mode with a larger detection distance corresponds to a smaller projection angle of view. In some scenarios, the projection angle of the emitting unit in different projection modes may be the same, but the transmission power is inconsistent. For example, assuming there are three projection modes, the projection angle of view of the light beam projected by the emitting unit 41 in the three projection modes is the same, but the transmission power is different. The projection mode with a larger detection distance corresponds to a larger transmission power. In some scenarios, the projection angle and transmission power of the emitting unit in different projection modes may be inconsistent. For example, assuming there are three projection modes, the three projection modes may be a combination of different projection angles and different transmission powers, so that the detection distance corresponding to each projection mode is different. Of course, in actual use, it can be flexibly set based on the specific needs of the usage scenario.

[0045] In order to realize a variety of projection modes with different detection distances, in some embodiments, the transmitting unit 41 may include multiple first-type light sources, wherein the first-type light source refers to a light source with a fixed and non-adjustable projection angle. Each first-type light source can be used to realize a projection mode. For example, assuming that the transmitting unit has three projection modes, three light sources can be set, and each light source corresponds to a projection mode. The emission power of these three light sources can be the same, but the projection angles are different to achieve different detection distances. Or the projection angles of these three light sources are the same, but the emission power is different to achieve different detection distances. When the control unit 43 determines the target projection mode from a plurality of projection modes, it can notify the transmitting unit 41 to turn on the light source corresponding to the target projection mode so that the light beam is projected through the light source. For example, assuming there is projection mode 1 (detection distance 10m): light source A (projection viewing angle is 30° horizontally and 10° vertically); projection mode 2 (detection distance 5m): light source B (projection viewing angle is 40° horizontally and 30° vertically); projection mode 3 (detection distance 3m): light source C (projection viewing angle is 60° horizontally and 40° vertically). When the control unit 43 determines that the distance between the current photographed object and the shooting device is within 3m, that is, it determines that the currently required target projection mode is projection mode 3, it can notify the transmitting unit 41 to turn on light source C, and use light source C to project a light beam to obtain depth information.

[0046] Considering that if the emitting unit 41 has many projection modes, multiple light sources need to be provided to realize different projection modes, which will increase the cost to a certain extent. Therefore, in some embodiments, the emitting unit 41 may include at least one second type of light source, wherein the second type of light source refers to a light source whose projection viewing angle can be adjusted, so that a variety of projection modes can be realized by adjusting the projection viewing angle of the second type of light source. In this way, one light source can be used to realize multiple projection modes, which can reduce the number of light sources used in the emitting unit 41. For example, the emitting unit 41 only needs one light source to meet the needs of multiple projection modes.

[0047] For example, assuming that the emitting unit 41 includes only one light source D, the projection angle of the light source D can be adjusted. For example, it can be adjusted to the following three groups of projection angles: (1) horizontal 30°, vertical 10° (2) horizontal 40°, vertical 30° (3) horizontal 60°, vertical 40°. The three groups of projection angles can correspond to three projection modes, and the detection distances corresponding to the three projection modes are 10m, 5m, and 3m respectively.

[0048] Considering that the projection angle of a light beam can be changed by refraction of a lens, in some embodiments, as shown in FIG5 , in order to adjust the projection angle of a light source, one or more groups of lenses can be provided in the optical path of the light source, and the projection angle of the light source can be adjusted by adjusting the combination of these lenses. For example, when a combination of lens 1 and lens 2 is placed in the optical path of the light source, the projection angle of the light source is 30° horizontally and 30° vertically. When a combination of lens 1 and lens 3 is placed in the optical path of the light source, the projection angle of the light source is 60° horizontally and 30° vertically.

[0049] In some embodiments, the transmitting unit 41 may include multiple lens groups and a drive device, wherein the correspondence between different projection angles and lens combinations can be pre-set. When the control unit 43 determines a target projection mode from the multiple projection modes, it can notify the transmitting unit 41. The transmitting unit 41 can then determine the projection angle corresponding to the target projection mode and the lens combination corresponding to the projection angle. Then, based on the lens combination, the drive device is controlled to move one or more lens groups into the optical path of the light source.

[0050] In this way, the projection angle of the light source can be automatically adjusted. Compared with directly achieving different projection angles through multiple light sources with different projection angles, this method can save the number of light sources and also obtain more diverse projection angles.

[0051] Generally speaking, when using a camera to capture images, after the focal length of the camera lens is determined, in order to obtain a better composition ratio, the distance between the subject and the camera is often within a certain distance range. For example, taking the use of a zoom lens with a focal length of 24-70mm to shoot a person as an example, when the lens focal length is 24mm, in order to obtain a composition ratio that is more in line with the public's visual requirements (for example, the screen ratio is 30%), the distance between the person and the camera is usually within 3 meters. If it exceeds this distance, the proportion of the person is too small and does not meet the visual requirements. In other words, when using this focal length to shoot the subject, it is usually used within 3 meters, that is, the distance between the subject and the camera does not usually exceed 3 meters.

[0052] Based on the above principles, in some embodiments, when determining the distance between the subject and the photographing device, the focal length of the current photographing device lens can be used for determination. For example, assuming that the focal length of the lens is between 24-35mm, the subject is usually no more than 3 meters away from the photographing device to obtain a better composition ratio. When the focal length of the lens is between 35 and 55mm, the distance between the subject and the photographing device may need to be maintained at 3m-5m to obtain a better composition ratio, and so on. Therefore, the distance interval between the current subject and the photographing device can be inferred based on the current focal length of the lens, and then the target projection mode that matches the distance interval can be selected from the multiple projection modes of the transmitting unit 41. For example, assuming that the focal length of the current photographing device lens is between 24mm-35mm, under this focal length, the subject usually needs to be within 3m of the photographing device to obtain a suitable composition ratio. Therefore, a projection mode with a detection distance of 3m can be selected.

[0053] In some embodiments, in order to facilitate the determination of the target projection mode that matches the current scene being photographed, a mapping relationship between the focal length of the camera lens and the projection mode of the emitting unit 41 can be pre-established. For example, when the focal length is 24-35mm, it corresponds to projection mode 1, and the detection distance is 3m; when the focal length is 35-55mm, it corresponds to projection mode 2, and the detection distance is 5m; when the focal length is 55-70mm, it corresponds to projection mode 3, and the detection distance is 10m. Typically, when a user captures an image, they generally zoom first and then focus. After the user completes the zoom, the software system of the camera can automatically detect the focal length information of the current camera. The control unit 43 can obtain the focal length information from the software system of the camera, determine the target projection mode that matches the current focal length information based on the mapping relationship between the focal length information and the projection mode, and then control the emitting unit 41 to project the light beam according to the projection mode.

[0054] In some embodiments, it is taken into account that when the focal length of the lens of the shooting device changes, the shooting angle of the lens will also change accordingly. For example, as the focal length of the lens increases, its shooting angle of view will gradually become smaller. Generally speaking, the projection angle of view of the TOF focusing device will not exceed the shooting angle of view of the lens, otherwise the excess angle of view will have no practical significance, and the larger the projection angle of view, the greater the transmission power required by the transmitting unit 41 to achieve the same detection distance. Therefore, in some embodiments, when establishing a mapping relationship between focal length information and projection mode, the projection angle of view of the transmitting unit 41 when projecting a light beam in the projection mode corresponding to different focal lengths is also different, and the projection angle of view can be determined based on the shooting angle of the shooting device under the focal length.

[0055] In some embodiments, the ratio of the projection angle of view when the emitting unit 41 projects the light beam in the projection modes corresponding to different focal lengths to the shooting angle of view of the camera device at that focal length is a specified ratio. For example, in some embodiments, considering that the subject is usually located in the center of the frame, the edges of the frame are mostly areas of little concern to the user. Therefore, when measuring depth information, it is sufficient to cover only the majority of the center of the frame. Therefore, when setting the projection angle of view when the emitting unit 41 projects the light beam in the projection modes corresponding to different focal lengths, the projection angle of view can be 70% to 80% of the shooting angle of view of the camera lens at the current focal length.

[0056] For example, when the focal length of the shooting device is 24-35mm, its maximum horizontal shooting angle of view is 80°. Therefore, the horizontal projection angle of view of the emitting unit 41 when projecting a light beam in the projection mode corresponding to this focal length can be set to 64°; when the focal length of the shooting device is 35-55mm, its maximum horizontal shooting angle of view is 40°. Therefore, the horizontal projection angle of view of the emitting unit 41 when projecting a light beam in the projection mode corresponding to this focal length can be set to 32°; when the focal length of the shooting device is 55-70mm, its maximum horizontal shooting angle of view is 28°. Therefore, the horizontal projection angle of view of the emitting unit 41 when projecting a light beam in the projection mode corresponding to this focal length can be set to 22.4°. After determining the projection angle in each projection mode, the transmission power of the emitting unit 41 in each projection mode can be set based on the detection distance requirements in the mode, so that the detection distance can meet the requirements under different focal lengths.

[0057] In this way, the projection viewing angle of the transmitting unit 41 can adaptively change as the focal length information changes, thereby avoiding the problems of power waste and insufficient detection distance caused by the projection viewing angle being greater than the lens shooting viewing angle.

[0058] In some embodiments, when determining the distance between the subject and the camera, the subject's proportion within the frame of the image captured by the camera can also be considered. For example, at a fixed focal length, the larger the subject's proportion within the frame, the closer it is to the camera. Therefore, at a fixed focal length, the approximate distance between the subject and the camera can also be estimated based on the subject's proportion within the frame.

[0059] In addition, it is considered that the normal environment also includes a light beam with the same wavelength as the light beam emitted by the emitting unit 41. For example, the wavelength of the light beam emitted by the emitting unit 41 is usually 940nm, and there is also a 940nm light beam in sunlight. In this scenario, in order to avoid the light beam of the same wavelength in sunlight interfering with the detection results, it is generally necessary to increase the transmission power of the emitting unit 41 to distinguish it from the noise in the environment (i.e., the light beam of the same wavelength). Generally, the greater the noise intensity in the environment, the greater the transmission power required by the emitting unit 41 to distinguish it from the noise. At present, when increasing the transmission power of the emitting unit 41, a uniform amplitude is usually used to increase the transmission power, which often causes the emitting unit 41 to have a large power and severe heat generation.

[0060] Considering that the intensity of light noise in the environment varies with the intensity of sunlight, in order to reduce the interference of light noise and minimize the power of the transmitting unit 41 to reduce the degree of heat generation, in some embodiments, the transmission power of the transmitting unit 41 can be adaptively adjusted based on the light intensity in the current environment. For example, after determining the target projection mode, the control unit 43 can determine the current transmission power based on the light intensity in the current environment and notify the transmitting unit 41 to project the light beam according to the transmission power.

[0061] In some embodiments, when determining the illumination intensity of the current environment, it can be determined based on the brightness of the image captured by the camera. For example, generally, the stronger the sunlight, the brighter the captured image. Therefore, the current illumination intensity of the sunlight can be determined based on the image brightness. In some scenarios, a correspondence between the image brightness and the transmission power of the transmitting unit 41 can also be pre-established. During the focusing process, the brightness of the image captured by the camera can be first determined, and the transmission power of the transmitting unit 41 can be determined based on the brightness. Then, the transmitting unit 41 can be controlled to project a light beam according to the transmission power.

[0062] In some embodiments, the current light intensity can also be determined by the reception of the return light by the receiving unit 42 of the TOF focusing device. For example, the response threshold of the receiving unit 42 to the return light is typically determined based on the transmission power of the transmitting unit. The response threshold refers to the energy threshold of the light beam that triggers the receiving unit 42. That is, the light beam energy must exceed this threshold for the receiving unit 42 to sense it. Therefore, the greater the transmission power and the stronger the projected light beam energy, the greater the response threshold of the receiving unit 42. Assuming that the noise intensity in the current environment is high and exceeds the current response threshold of the receiving unit 42, the receiving unit 42 of the TOF focusing device can continue to receive light signals. In this case, it is necessary to increase the transmission power of the transmitting unit 41 and raise the response threshold of the receiving unit 42 to the light signal in order to distinguish the reflected return light from the noise. Therefore, when determining the transmission power of the transmitting unit 41, the transmission power can also be continuously adjusted based on the reception of the return light by the receiving unit 42 until an appropriate transmission power is determined.

[0063] In addition, the present disclosure also provides a photographing device including the TOF focusing device described in the above embodiments. The specific structure and focusing principle of the TOF focusing device can be found in the description of the above embodiments and will not be repeated here.

[0064] Furthermore, an embodiment of the present application also provides a focusing method applicable to a TOF focusing device, wherein the TOF focusing device includes multiple projection modes, and the detection distance of the TOF focusing device is different in different projection modes.

[0065] As shown in FIG6 , the method includes:

[0066] S602: During focusing of the shooting device, determining a target projection mode from the plurality of projection modes based on the distance between the shooting device and the object being shot;

[0067] S604: Control the TOF focusing device to project a light beam according to the target projection mode, and determine the depth information of the photographed object based on the returned light of the light beam received by the TOF focusing device, so as to focus the shooting device based on the depth information.

[0068] Among them, the focusing method can be executed by a functional module in the TOF focusing device, or the focusing method can also be executed by a functional module in the shooting device connected to the TOF focusing device, and the embodiments of the present application do not limit this.

[0069] In some embodiments, determining the target projection mode from the multiple projection modes based on the distance between the shooting device and the photographed object includes:

[0070] Determining the current focal length of the lens of the camera;

[0071] The target projection mode is determined based on the current focal length of the lens and a pre-stored correspondence between the focal length and the projection mode of the transmitting unit.

[0072] In some embodiments, the projection viewing angles of the TOF focusing device in the projection modes corresponding to different focal lengths are different, wherein the projection viewing angles in the projection modes corresponding to each focal length are determined based on the shooting viewing angles of the shooting device at each focal length.

[0073] In some embodiments, the projection viewing angle in the projection mode corresponding to each focal length is 70% to 80% of the shooting viewing angle of the shooting device at each focal length.

[0074] In some embodiments, the TOF focusing device includes a plurality of first-type light sources, each of the first-type light sources has a fixed projection viewing angle, and each first-type light source corresponds to a projection mode. Controlling the TOF focusing device to project a light beam according to the target projection mode includes:

[0075] The first type of light source corresponding to the target projection mode is turned on to project a light beam through the first type of light source.

[0076] In some embodiments, after determining the target projection mode from the plurality of projection modes, the method further includes:

[0077] The emission power of the TOF focusing device is determined based on the light intensity in the current environment, and the TOF focusing device is notified to project a light beam according to the emission power.

[0078] In some embodiments, the illumination intensity of the current environment is determined based on the brightness of the image captured by the camera; or

[0079] The light intensity of the current environment is determined based on the return light received by the TOF focusing device.

[0080] Among them, the specific implementation details of the above-mentioned focusing method can be referred to the description of each embodiment of the above-mentioned TOF focusing device, and will not be repeated here.

[0081] The various technical features in the above embodiments can be arbitrarily combined as long as there is no conflict or contradiction between the combinations of features. However, due to space limitations, they are not described one by one. Therefore, the arbitrary combination of the various technical features in the above embodiments also falls within the scope of disclosure of this specification.

[0082] Corresponding to the above-mentioned focusing method, an embodiment of the present application further provides a focusing device, which is applicable to a TOF focusing device. The TOF focusing device includes multiple projection modes. The detection distance of the TOF focusing device is different in different projection modes. The focusing device includes:

[0083] a projection mode determination module, configured to determine a target projection mode from the plurality of projection modes based on the distance between the shooting device and the object being shot during focusing of the shooting device;

[0084] A focusing module is used to control the TOF focusing device to project a light beam according to the target projection mode, and determine the depth information of the photographed object based on the returned light of the light beam received by the TOF focusing device, so as to focus the shooting device based on the depth information.

[0085] The specific implementation of focusing by the focusing device can refer to the description in the above method embodiment, which will not be repeated here.

[0086] Accordingly, an embodiment of this specification further provides a computer storage medium, wherein the storage medium stores a program, and when the program is executed by a processor, the method in any of the above embodiments is implemented.

[0087] The embodiments of this specification may take the form of a computer program product implemented on one or more storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing program code. Computer-usable storage media include permanent and non-permanent, removable and non-removable media, and information storage can be achieved by any method or technology. Information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include but are not limited to: phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission medium that can be used to store information that can be accessed by a computing device.

[0088] Since the apparatus embodiments generally correspond to the method embodiments, reference will be made to the description of the method embodiments for relevant details. The apparatus embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, i.e., they may be located in one location or distributed across multiple network elements. Some or all of the modules may be selected to achieve the objectives of the present embodiments as needed. Those skilled in the art will be able to understand and implement the present embodiments without inventive effort. Those skilled in the art will readily conceive of alternative implementations of the present embodiments after considering and practicing the description disclosed herein. The present embodiments are intended to cover any variations, uses, or adaptations of the present embodiments that adhere to the general principles of the present embodiments and include common knowledge or customary techniques in the art not disclosed in the present embodiments. The description and embodiments are to be considered merely as exemplary; the true scope and spirit of the present embodiments are indicated by the following claims.

[0089] It should be understood that the embodiments of the present invention are not limited to the precise structures described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the embodiments of the present invention is limited only by the appended claims.

[0090] The above description is only a preferred embodiment of the embodiments of this specification and is not intended to limit the embodiments of this specification. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the embodiments of this specification should be included in the scope of protection of the embodiments of this specification.

Claims

1. A TOF focusing device, characterized in that: The TOF focusing device includes a transmitting unit, a receiving unit and a control unit, wherein the transmitting unit includes multiple projection modes, and the detection distance of the light beam projected by the transmitting unit in different projection modes is different; The control unit is used to determine a target projection mode from the multiple projection modes based on the distance between the shooting device and the photographed object during the process of focusing the shooting device, and notify the transmitting unit; wherein the detection distance corresponding to the target projection mode is positively correlated with the distance between the shooting device and the photographed object; The transmitting unit is used to project a light beam according to the target projection mode; The receiving unit is used to receive the return light after the light beam projected by the transmitting unit is reflected, and determine the depth information of the photographed object based on the return light, so as to focus the photographing device based on the depth information.

2. The device according to claim 1, characterized in that The detection distance of the light beam projected by the emitting unit can be adjusted by changing the projection viewing angle and / or the emission power of the emitting unit.

3. The device according to claim 1 or 2, characterized in that: The emitting unit includes multiple first-type light sources, each of which has a fixed projection viewing angle, and each of which corresponds to a projection mode. The control unit is used to notify the emitting unit to turn on the first-type light source corresponding to the target projection mode after determining the target projection mode from the multiple projection modes, so as to project a light beam through the first-type light source.

4. The device according to claim 3, characterized in that The projection viewing angles of the first type of light sources corresponding to different projection modes are different.

5. The device according to claim 1, characterized in that The emitting unit includes at least one second type of light source, the projection viewing angle of the second type of light source is adjustable, and the multiple projection modes are achieved by adjusting the projection viewing angle of the at least one second type of light source.

6. The device according to claim 5, characterized in that The projection viewing angle of each second type of light source can be achieved by adjusting the lens combination on the light path of the second type of light source.

7. The device according to claim 6, characterized in that The emitting unit includes multiple groups of lenses and a driving device, and the driving device is used to determine the lens combination method corresponding to the current projection viewing angle of the second type of light source based on the correspondence between the preset projection viewing angle and the lens combination method, and drive one or more groups of lenses in the multiple groups of lenses to move to the optical path of the second type of light source based on the determined lens combination method.

8. The device according to claim 1, characterized in that The distance between the photographing device and the photographed object is determined based on the current focal length of the lens of the photographing device.

9. The device according to claim 8, characterized in that The focusing device pre-stores a correspondence between a focal length and a projection mode of the transmitting unit; the control unit is used to determine a target projection mode from the multiple projection modes based on the distance between the shooting device and the object being photographed, specifically for: Determining the current focal length of the lens of the photographing device; The target projection mode is determined based on the current focal length of the lens and the corresponding relationship.

10. The device according to claim 9, characterized in that The projection viewing angles of the emitting unit in the projection modes corresponding to different focal lengths are different, wherein the projection viewing angles of the emitting unit in the projection modes corresponding to each focal length are determined based on the shooting viewing angles of the shooting device at each focal length.

11. The device according to claim 9, characterized in that The ratio of the projection viewing angle of the emitting unit in the projection mode corresponding to each focal length to the shooting viewing angle of the shooting device in each focal length is a specified ratio.

12. The device according to claim 1, characterized in that The distance between the photographing device and the photographed object is determined based on the proportion of the photographed object in the image captured by the photographing device.

13. The device according to claim 1, characterized in that After determining the target projection mode from the multiple projection modes, the control unit is further used to determine the emission power of the emission unit based on the light intensity in the current environment, and notify the emission unit to project the light beam according to the emission power.

14. The device according to claim 13, characterized in that The light intensity of the current environment is determined based on the brightness of the image captured by the shooting device; or The light intensity of the current environment is determined based on the return light received by the receiving unit.

15. The device according to claim 1, characterized in that The light source in the emitting unit is a vertical cavity surface emitting laser.

16. The device according to claim 1, characterized in that The TOF focusing device comprises a hardware interface, and the TOF focusing device is connected to the shooting equipment via the hardware interface.

17. A photographing device, characterized in that: The shooting equipment includes the TOF focusing device as described in any one of claims 1-14.

18. A focusing method, characterized in that: Applicable to a TOF focusing device, the TOF focusing device includes multiple projection modes, and the detection distance of the TOF focusing device is different in different projection modes. The method includes: In the process of focusing the shooting device, based on the distance between the shooting device and the photographed object, determining a target projection mode from the multiple projection modes; The TOF focusing device is controlled to project a light beam according to the target projection mode, and the depth information of the photographed object is determined based on the returned light of the light beam received by the TOF focusing device, so as to focus the shooting device based on the depth information.

19. The method according to claim 18, characterized in that The determining of the target projection mode from the multiple projection modes based on the distance between the shooting device and the object being photographed includes: Determining the current focal length of the lens of the photographing device; The target projection mode is determined based on the current focal length of the lens and the pre-stored correspondence between the focal length and the projection mode of the TOF focusing device.

20. The method according to claim 19, characterized in that The projection viewing angles of the TOF focusing device when projecting a light beam in the projection modes corresponding to different focal lengths are different, wherein the projection viewing angles in the projection modes corresponding to each focal length are determined based on the shooting viewing angles of the shooting device at each focal length.

21. The method according to claim 20, characterized in that The projection viewing angle in the projection mode corresponding to each focal length is 70% to 80% of the shooting viewing angle of the shooting device at each focal length.

22. The method according to claim 18, characterized in that The TOF focusing device includes a plurality of first-type light sources, each of which has a fixed projection viewing angle, and each of which corresponds to a projection mode. The controlling the TOF focusing device to project a light beam according to the target projection mode includes: The first type of light source corresponding to the target projection mode is turned on to project a light beam through the first type of light source.

23. The method according to claim 18, characterized in that After determining the target projection mode from the plurality of projection modes, the method further includes: The emission power of the TOF focusing device is determined based on the light intensity in the current environment, and the TOF focusing device is notified to project a light beam according to the emission power.

24. The method according to claim 23, characterized in that The light intensity of the current environment is determined based on the brightness of the image captured by the shooting device; or The light intensity of the current environment is determined based on the return light received by the TOF focusing device.

25. A computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed, implements the method according to any one of claims 18 to 24.

Citation Information

Patent Citations

  • Adjustable depth measuring device and measuring method

    CN111025317A

  • Depth image collection method and device, mobile terminal and storage medium

    CN111815695A

  • TOF ranging device and its control method

    CN114938663A

  • Distance detection device and imaging apparatus

    EP3783386A2