Binocular depth camera control method and device, equipment and storage medium

Abstract

The invention provides a binocular depth camera control method, device and equipment and a storage medium, and relates to the technical field of camera shooting, and the method comprises the steps: obtaining a first shooting signal, and obtaining a first image based on the first shooting signal; acquiring image parameters of the first image; the image parameters comprise a first parameter and a second parameter; if the image parameter does not belong to the set range, acquiring a light supplementing parameter of the first light source and a light supplementing parameter of the second light source, generating a second shooting signal based on the light supplementing parameter of the first light source and the light supplementing parameter of the second light source, and acquiring a target depth image based on the second shooting signal; if the image parameter belongs to the set range, obtaining a target depth image based on the first shooting signal; according to the invention, various target images can be effectively acquired, and the defect that a binocular depth camera cannot acquire various depth images in the prior art is avoided.

Description

Technical Field

[0001] The present invention relates to the field of camera technology, and in particular to a binocular depth camera control method, device, equipment and storage medium. Background Art

[0002] Depth cameras can be divided into different types according to their principles, such as TOF (time of flight), binocular stereo vision, structured light, etc. Among them, binocular depth cameras are widely used due to their simple hardware and strong environmental adaptability, such as machine vision, autonomous driving, face recognition, etc.

[0003] The current disadvantages of binocular stereo camera systems are:

[0004] 1. Very sensitive to ambient light. Too bright or too dark an environment is not conducive to image matching, thus affecting the depth results;

[0005] 2. One binocular depth camera cannot meet the needs of different fill-light contents. Usually two binocular depth camera systems are required to achieve this, which will increase the equipment cost.

[0006] Therefore, it is urgent to provide a binocular depth camera control method that can meet various fill light requirements to achieve the acquisition of various depth images. Summary of the invention

[0007] In view of the deficiencies in the prior art, the present invention provides a binocular depth camera control method, device, equipment and storage medium to solve the technical problem that the binocular stereo camera in the prior art cannot meet various fill light requirements.

[0008] To achieve the above objectives, the present invention is implemented through the following technical solutions:

[0009] A first aspect of the present invention provides a binocular depth camera control method, the method comprising:

[0010] Acquire a first shooting signal, and acquire a first image based on the first shooting signal;

[0011] Acquire image parameters of the first image; the image parameters include a first parameter and a second parameter;

[0012] If the image parameters do not fall within the set range, obtaining fill light parameters of the first light source and fill light parameters of the second light source, generating a second shooting signal based on the fill light parameters of the first light source and the fill light parameters of the second light source, and obtaining a target depth image based on the second shooting signal;

[0013] The fill light parameters of the first light source are used to make the first parameter of the target depth image within a set range; the fill light parameters of the second light source are used to make the second parameter of the target depth image within a set range; the fill light parameters of the first light source include a first duration value and a first light intensity value, and the fill light parameters of the second light source include a second duration value and a second light intensity value;

[0014] If the image parameters are within the set range, a target depth image is acquired based on the first shooting signal.

[0015] Furthermore, the second shooting signal includes:

[0016] An image acquisition signal is used to acquire a target depth image;

[0017] A first light intensity signal, used to set the light intensity value of the first light source when it is lit to a first light intensity value;

[0018] A first duration signal, used to control the first light source to be lit and the lighting duration is a first duration value;

[0019] A second light intensity signal, used to set the light intensity value of the second light source when it is lit to a second light intensity value;

[0020] The second duration signal is used to control the second light source to be lit and the lighting duration is a second duration value.

[0021] Furthermore, the fill light parameters of the first light source are fill light parameters of non-visible light, and the fill light parameters of the second light source are fill light parameters of visible light.

[0022] Furthermore, the fill light parameters of the first light source are fill light parameters of a speckle projector, and the fill light parameters of the second light source are fill light parameters of infrared light.

[0023] A second aspect of the present invention further provides a binocular depth camera control device, the control system comprising:

[0024] A first acquisition module, used for acquiring a first shooting signal and acquiring a first image based on the first shooting signal;

[0025] A second acquisition module, used for acquiring image parameters of the first image; the image parameters include a first parameter and a second parameter;

[0026] A first judgment acquisition module is used to execute, if the image parameter does not belong to the set range, to obtain the fill light parameters of the first light source and the fill light parameters of the second light source, generate a second shooting signal based on the fill light parameters of the first light source and the fill light parameters of the second light source, and obtain a target depth image based on the second shooting signal;

[0027] The fill light parameters of the first light source are used to make the first parameter of the target depth image within a set range; the fill light parameters of the second light source are used to make the second parameter of the target depth image within a set range; the fill light parameters of the first light source include a first duration value and a first light intensity value, and the fill light parameters of the second light source include a second duration value and a second light intensity value;

[0028] The second judgment acquisition module is used to execute, if the image parameter belongs to the set range, to acquire the target depth image based on the first shooting signal.

[0029] Furthermore, the first judgment and acquisition module includes:

[0030] An image acquisition unit, used for acquiring a target depth image;

[0031] A first light intensity control unit, used to set the light intensity value of the first light source when it is lit to a first light intensity value;

[0032] A first duration control unit, used to control the first light source to be lit and the lighting duration is a first duration value;

[0033] A second light intensity control unit, used to set the light intensity value of the second light source when it is lit to a second light intensity value;

[0034] The second duration control unit is used to control the second light source to be lit and the lighting duration is a second duration value.

[0035] Furthermore, the fill light parameters of the first light source are fill light parameters of non-visible light, and the fill light parameters of the second light source are fill light parameters of visible light.

[0036] Furthermore, the fill light parameters of the first light source are fill light parameters of a speckle projector, and the fill light parameters of the second light source are fill light parameters of infrared light.

[0037] A third aspect of the present invention is an electronic device, comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus;

[0038] Memory, used to store computer programs;

[0039] The processor is used to implement the steps of any of the above control methods when executing the program stored in the memory.

[0040] According to a fourth aspect of the present invention, a computer-readable storage medium is provided, wherein a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the steps of any of the above-mentioned control methods are implemented.

[0041] The binocular depth camera control method, system, device and storage medium provided by the present invention have the following beneficial effects compared with the prior art:

[0042] A binocular depth camera control method provided by the present invention includes acquiring a first shooting signal, and acquiring a first image based on the first shooting signal; acquiring image parameters of the first image; if the image parameters do not fall within a set range, acquiring fill light parameters required for adjusting the image parameters to a light source within the set range, and generating a second shooting signal based on the fill light parameters; if the image parameters fall within the set range, using the first shooting signal as a second shooting signal; and then acquiring a target depth image based on the second shooting signal; wherein the image parameters include a first parameter and a second parameter, the first parameter can be adjusted by the first light source, and the second parameter can be adjusted by the second light source.

[0043] By effectively controlling the two light sources, the binocular depth camera can provide fill light as needed, avoiding the defects when there is no fill light (for example, when it is too dark or the content lacks texture);

[0044] With the control method provided above, the binocular depth camera can perform multiple mode selections, including the first light source alone for fill light, the second light source alone for fill light, the first and second light sources for fill light simultaneously, and the first and second light sources for no fill light, thereby achieving the acquisition of multiple target depth images;

[0045] This avoids the problem of increasing the image acquisition cost when using multiple binocular depth cameras to acquire depth images of multiple targets. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0047] Figure 1 A flowchart of a binocular depth camera control method provided in Example 1;

[0048] Figure 2 A schematic diagram of the connection relationship between the components of the binocular depth camera provided in Example 1;

[0049] Figure 3 This is a structural diagram of an electronic device provided in Example 3. DETAILED DESCRIPTION

[0050] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention are clearly and completely described. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0051] In order to solve the technical problem that the existing binocular depth camera cannot meet various fill light requirements, the main ideas of this application are:

[0052] A binocular depth camera control method is provided. The method can perform various forms of fill light according to fill light requirements, and obtain a target depth image under corresponding fill light forms.

[0053] Through the above scheme, a single binocular depth camera can effectively acquire multiple target depth images (corresponding images under different fill light forms), avoiding the disadvantage that multiple binocular depth cameras are required to acquire multiple depth images in the prior art; and improving the environmental adaptability of the binocular depth camera, so that it can acquire depth images in a variety of environments.

[0054] In order to better understand the technical solution of the present application, the technical solution of the present application will be introduced in detail below in combination with specific embodiments and drawings.

[0055] Example 1

[0056] Combined with Figure 1 , this embodiment provides a binocular depth camera control method, the method comprising:

[0057] A first shooting signal is acquired, and a first image is acquired based on the first shooting signal.

[0058] Image parameters of the first image are acquired; the image parameters include a first parameter and a second parameter.

[0059] If the image parameter does not fall within the set range, obtaining fill light parameters of the first light source and fill light parameters of the second light source, generating a second shooting signal based on the fill light parameters of the first light source and the fill light parameters of the second light source, and then obtaining a target depth image based on the second shooting signal;

[0060] The fill light parameters of the first light source are used to make the first parameter of the target depth image within a set range; the fill light parameters of the second light source are used to make the second parameter of the target depth image within a set range; the fill light parameters of the first light source include a first duration value and a first light intensity value, and the fill light parameters of the second light source include a second duration value and a second light intensity value;

[0061] If the image parameters are within the set range, a target depth image is acquired based on the first shooting signal.

[0062] A binocular depth camera control method provided in this embodiment can effectively perform shooting in various fill light forms, and can effectively avoid the disadvantages of existing binocular depth cameras that they have general environmental adaptability and cannot obtain various depth images.

[0063] In the above method, when the image parameters are all within the set range, it indicates that the binocular depth camera does not need to perform a fill light operation, and the target image can be directly acquired based on the first shooting signal.

[0064] When the first parameter is not within the set range and the second parameter is within the set range, it indicates that the first light source is required to perform fill light and the second light source does not need to perform fill light, then after obtaining the fill light parameter of the first light source and the fill light parameter corresponding to when the second light source is not lit, a second shooting signal is generated based on the obtained fill light parameter of the first light source and the fill light parameter of the second light source, and a target depth image is acquired based on the second shooting signal;

[0065] When the first parameter is within the set range and the second parameter is not within the set range, indicating that the second light source is needed for fill light and the first light source does not need to be fill light, then after obtaining the fill light parameters of the first light source (the fill light parameters of the first light source at this time correspond to the fill light parameters when the first light source is not lit) and the fill light parameters of the second light source, a second shooting signal is generated based on the fill light parameters of the first light source and the fill light parameters of the second light source, and based on the second shooting signal, the target image is acquired.

[0066] When both the first parameter and the second parameter are not within the set range, it indicates that both the first light source and the second light source are required to perform fill light. After obtaining the fill light parameters of the first light source and the fill light parameters of the second light source, a second shooting signal is generated, and based on the second shooting signal, a target depth image is obtained.

[0067] That is, the binocular depth camera control method provided by the present invention can realize four fill light modes, thereby effectively avoiding the aforementioned defects.

[0068] Combined with Figure 2 In the present embodiment, a binocular depth camera control method is provided, wherein the binocular depth camera comprises a control unit 5, a first camera 1, a second camera 2, a first light source 3, a second light source 4, a first driving module 6 and a second driving module 7;

[0069] refer to Figure 2 , the connection relationship between the above modules is:

[0070] The first camera 1 , the second camera 2 , the first driving module 6 and the second driving module 7 are respectively connected to the control unit 5 , the first camera 1 and the first light source 3 are respectively connected to the first driving module 6 , and the second camera 2 and the second light source 4 are respectively connected to the second driving module 7 .

[0071] The control method of the above binocular depth camera includes:

[0072] The control unit 5 obtains a first shooting signal and obtains a first image based on the first shooting signal; the process includes that after the control unit 5 obtains the first shooting signal (the first shooting signal comes from an external input (such as manual input) or is preset in the control unit 5), the first camera 1 and the second camera 2 are controlled to synchronously shoot a frame of image, the control unit 5 obtains the image synchronously shot by the first camera 1 and the second camera 2 (that is, the control unit 5 obtains two captured images), and selects one of the two captured images as the first image.

[0073] After obtaining the first image, the control unit 5 acquires the image parameters therein.

[0074] The image parameters include a first parameter and a second parameter; wherein the first parameter can be adjusted by the intensity and duration of the light emitted by the first light source 3 , and the second parameter can be adjusted by the intensity and duration of the light emitted by the second light source 4 .

[0075] After the control unit 5 obtains the image parameters, it determines whether the image parameters are within the set range, wherein:

[0076] Judgment result 1:

[0077] If the image parameters do not fall within the set range, the control unit 5 obtains the fill light parameters of the first light source 3 and the fill light parameters of the second light source 4 (the fill light parameters of the first light source 3 and the fill light parameters of the second light source 4 may come from external input or a correspondence table preset in the control unit 5; such as manually inputting or adjusting the specific values ​​of the specific fill light parameters, or the control unit 5 autonomously selects according to the correspondence between the image parameters and the fill light parameters preset therein); wherein, the fill light parameters of the first light source 3 are used to make the first parameters of the target depth image within the set range, and the fill light parameters of the second light source 4 are used to make the second parameters of the target depth image within the set range.

[0078] After acquiring the fill light parameters of the first light source 3 and the second light source 4 , the control unit 5 generates a second shooting signal based on the fill light parameters of the first light source 3 and the second light source 4 , and then acquires a target depth image based on the second shooting signal.

[0079] Among them, the fill light parameters of the first light source 3 include a first duration value and a first light intensity value, and the fill light parameters of the second light source 4 include a second duration value and a second light intensity value; that is, the first duration value and the second light intensity value constitute the fill light parameters of the first light source 3, which are used to make the first parameter of the target depth image within a set range, and the second duration value and the second light intensity value constitute the fill light parameters of the second light source 4, which are used to make the second parameter of the target depth image within a set range.

[0080] When the fill light parameters of the light source are not within the set range, there are the following situations:

[0081] Case 1: The first parameter is not within the set range and the second parameter is within the set range, the fill light parameters of the first light source 3 obtained by the control unit 5 include the first light intensity value and the first duration value (under the joint action of the two, the first light source 3 is illuminated as required), and the fill light parameters of the second light source 4 obtained include the second light intensity value and the second duration value (under the joint action of the two, the second light source 4 is not illuminated), and the fill light parameters of the first light source 3 are used to make the first parameter of the target depth image within the set range; that is, when the first camera 1 and the second camera 2 perform synchronous shooting later, the first light source 3 also works (the light intensity value when it is illuminated is the first light intensity value and the lighting duration is the first duration value), which is used for fill light, and the first parameter in the obtained target depth image belongs to the set range; wherein, because the second parameter is within the set range and the second light source 4 does not work later, when the external environment does not change, the second parameter in the obtained target depth image also belongs to the set range.

[0082] Case 2: The first parameter is within the set range and the second parameter is not within the set range, then the fill light parameters of the first light source 3 obtained by the control unit 5 include the first light intensity value and the first duration value (under the joint action of the two, the first light source 3 is not illuminated), and the fill light parameters of the second light source 4 obtained by the control unit 5 include the second light intensity value and the second duration value (under the joint action of the two, the second light source 4 is illuminated as required), and the fill light parameters of the second light source 4 are used to make the second parameter of the target depth image within the set range; that is, when the first camera 1 and the second camera 2 perform synchronous shooting later, the second light source 4 also works (the light intensity value when it is illuminated is the second light intensity value and the lighting duration is the second duration value), which is used for fill light, and the second parameter in the obtained target depth image belongs to the set range; wherein, because the first parameter is within the set range and the first light source 3 does not work later, when the external environment does not change, the first parameter in the obtained target depth image also belongs to the set range.

[0083] Case three: both the first parameter and the second parameter are not within the set range. The control unit 5 obtains the fill light parameters of the first light source 3 and the second light source 4 at the same time. The fill light parameters of the first light source 3 (including the first light intensity value and the first duration value, under the joint action of the two, the first light source 3 is illuminated as required) are used to make the first parameter of the target depth image within the set range, and the fill light parameters of the second light source 4 (including the second light intensity value and the second duration value, under the joint action of the two, the second light source 4 is illuminated as required) are used to make the second parameter of the target depth image within the set range; that is, when the first camera 1 and the second camera 2 are shooting synchronously in the later stage, the first light source 3 and the second light source 4 also work respectively and are used for fill light respectively. When the external environment does not change, the first parameter and the second parameter in the acquired target depth image are both within the set range.

[0084] In the above three situations, after the control unit 5 obtains the fill light parameters of the first light source 3 and the fill light parameters of the second light source 4, it generates a second shooting signal based on the fill light parameters of the first light source 3 and the fill light parameters of the second light source 4, and obtains the target depth image based on the second shooting signal.

[0085] The control unit 5 generates a second shooting signal based on the fill light parameters of the first light source 3 and the fill light parameters of the second light source 4, and the process of acquiring the target depth image based on the second shooting signal includes:

[0086] Situation 1:

[0087] The control unit 5 generates an image acquisition signal for controlling the first camera 1 and the second camera 2 to shoot synchronously and acquire a target depth image; the specific process includes: the control unit 5 sends the generated image acquisition signal to the first camera 1 and the second camera 2, controls the first camera 1 and the second camera 2 to shoot synchronously, and acquires the images taken by the two as the target depth image.

[0088] The control unit 5 generates a first light intensity signal corresponding to the first light intensity value, which is used to set the light intensity value when the first light source 3 is lit to the first light intensity value; the specific process includes the control unit 5 sending the first light intensity signal to the first driving module 6, and the first driving module 6 sets the light intensity value when the first light source 3 is lit to the first light intensity value after receiving the first light intensity signal.

[0089] The control unit 5 generates a first duration signal corresponding to the first duration value, which is used to control the first light source 3 to be lit and the lighting duration is the first duration value; the specific process includes the control unit 5 sending the first duration signal to the first camera 1, and after the first camera 1 receives the first duration signal, when it is triggered by the image acquisition signal to shoot and start exposure, the stroboscopic signal of the first camera 1 is synchronously sent out, and the stroboscopic signal of the first camera 1 controls the first light source 3 to be lit through the first driving module 6, and the duration of sending the stroboscopic signal of the first camera 1 is the same as the duration of the first light source 3 being lit and both are the first duration value; wherein the first duration value is less than the exposure duration of the first camera 1, so that the fill light process of the first light source 3 is in the exposure process of the first camera 1.

[0090] The control unit 5 generates a second light intensity signal corresponding to the second light intensity value, which is used to set the light intensity value when the second light source 4 is lit to the second light intensity value; the specific process includes: the control unit 5 sends the generated second light intensity signal to the second driving module 7, and the second driving module 7 does not set the light intensity value of the second light source 4 after receiving the first light intensity signal; and even if the second camera 2 sends a stroboscopic signal at a later time and triggers the second light source 4 through the second driving module, the second light source 4 cannot emit any content.

[0091] The control unit 5 generates a second duration signal corresponding to the second duration value, which is used to control the second light source 4 to be lit and the lighting duration is the second duration value; the specific process includes: the control unit 5 sends the second duration signal to the second camera 2, and after the second camera 2 receives the second duration signal, when it is triggered by the image acquisition signal to shoot and start exposure, the stroboscopic signal is not triggered.

[0092] Situation 2:

[0093] The control unit 5 generates an image acquisition signal for controlling the first camera 1 and the second camera 2 to shoot synchronously and acquire a target depth image; the specific process includes: the control unit 5 sends the generated image acquisition signal to the first camera 1 and the second camera 2, controls the first camera 1 and the second camera 2 to shoot synchronously, and acquires the images taken by the two as the target depth image.

[0094] The control unit 5 generates a first light intensity signal corresponding to the first light intensity value, which is used to set the light intensity value of the first light source 3 when it is lit to the first light intensity value; the specific process includes the control unit 5 sending the first light intensity signal to the first driving module 6, and the first driving module 6 does not set the light intensity value of the first light source 3 after receiving the first light intensity signal; and even if the first camera 1 sends a stroboscopic signal at a later time and triggers the first light source 3 through the first driving module 6, the first light source 3 cannot send out any content.

[0095] The control unit 5 generates a first duration signal corresponding to the first duration value, which is used to set the first light source 3 to be lit and the lighting duration is the first duration value; the specific process includes the control unit 5 sending the first duration signal to the first camera 1, and after the first camera 1 receives the first duration signal, when it is triggered by the image acquisition signal to shoot and start exposure, the stroboscopic signal is not triggered.

[0096] The control unit 5 generates a second light intensity signal corresponding to the second light intensity value, which is used to set the light intensity value when the second light source 4 is lit to the second light intensity value; the specific process includes: the control unit 5 sends the generated second light intensity signal to the second driving module 7, and the second driving module 7 sets the light intensity value when the second light source 4 is lit to the second light intensity value after receiving the second light intensity signal.

[0097] The control unit 5 generates a second duration signal corresponding to the second duration value, which is used to control the second light source 4 to be lit and the lighting duration is the second duration value; the specific process includes: the control unit 5 sends the second duration signal to the second camera 2, and after the second camera 2 receives the second duration signal, when it is triggered by the image signal to shoot and start exposure, the stroboscopic signal of the second camera 2 is synchronously triggered, and the stroboscopic signal of the second camera 2 controls the second light source 4 to be lit through the second driving module 7, and the duration of the stroboscopic signal of the second camera 2 is the same as the duration of the second light source 4 being lit and are both the second duration value; wherein the second duration value is less than the exposure duration of the second camera 2, so that the fill light process of the second light source 4 is in the exposure process of the second camera 2.

[0098] Situation 3:

[0099] The control unit 5 generates an image acquisition signal for controlling the first camera 1 and the second camera 2 to shoot synchronously and acquire a target depth image; the specific process includes: the control unit 5 sends the generated image acquisition signal to the first camera 1 and the second camera 2, controls the first camera 1 and the second camera 2 to shoot synchronously, and acquires the images taken by the two as the target depth image.

[0100] The control unit 5 generates a first light intensity signal corresponding to the first light intensity value, which is used to set the light intensity value when the first light source 3 is lit to the first light intensity value; the specific process includes the control unit 5 sending the first light intensity signal to the first driving module 6, and the first driving module 6 sets the light intensity value when the first light source 3 is lit to the first light intensity value after receiving the first light intensity signal.

[0101] The control unit 5 generates a first duration signal corresponding to the first duration value, which is used to control the first light source 3 to be lit and the lighting duration is the first duration value; the specific process includes the control unit 5 sending the first duration signal to the first camera 1, and after the first camera 1 receives the first duration signal, when it is triggered by the image acquisition signal to shoot and start exposure, the stroboscopic signal of the first camera 1 is synchronously sent out, and the stroboscopic signal of the first camera 1 controls the first light source 3 to be lit through the first driving module 6, and the duration of sending the stroboscopic signal of the first camera 1 is the same as the duration of the first light source 3 being lit and both are the first duration value; wherein the first duration value is less than the exposure duration of the first camera 1, so that the fill light process of the first light source 3 is in the exposure process of the first camera 1.

[0102] The control unit 5 generates a second light intensity signal corresponding to the second light intensity value, which is used to set the light intensity value when the second light source 4 is lit to the second light intensity value; the specific process includes: the control unit 5 sends the generated second light intensity signal to the second driving module 7, and the second driving module 7 sets the light intensity value when the second light source 4 is lit to the second light intensity value after receiving the second light intensity signal.

[0103] The control unit 5 generates a second duration signal corresponding to the second duration value, which is used to control the second light source 4 to be lit and the lighting duration is the second duration value; the specific process includes: the control unit 5 sends the second duration signal to the second camera 2, and after the second camera 2 receives the second duration signal, when it is triggered by the image signal to shoot and start exposure, the stroboscopic signal of the second camera 2 is synchronously triggered, and the stroboscopic signal of the second camera 2 controls the second light source 4 to be lit through the second driving module 7, and the duration of the stroboscopic signal of the second camera 2 is the same as the duration of the second light source 4 being lit and are both the second duration value; wherein the second duration value is less than the exposure duration of the second camera 2, so that the fill light process of the second light source 4 is in the exposure process of the second camera 2.

[0104] Judgment result 2:

[0105] If the image parameters are within the set range (that is, the first parameter is within the corresponding set range, and the second parameter is also within its corresponding set range), it means that no fill light operation is required, then:

[0106] The control unit 5 directly obtains the target depth image based on the first shooting signal; that is, the control unit 5 generates a first shooting signal and sends it to the first camera 1 and the second camera 2, controls the first camera 1 and the second camera 2 to shoot synchronously, and obtains the images taken by the two as the target depth image.

[0107] or

[0108] The control unit 5 performs the following operations:

[0109] The control unit 5 generates an image acquisition signal for controlling the first camera 1 and the second camera 2 to shoot synchronously and acquire a target depth image; the specific process includes: the control unit 5 sends the generated image acquisition signal to the first camera 1 and the second camera 2, controls the first camera 1 and the second camera 2 to shoot synchronously, and acquires the images taken by the two as the target depth image.

[0110] The control unit 5 generates a first light intensity signal corresponding to the first light intensity value, which is used to set the light intensity value of the first light source 3 when it is lit to the first light intensity value; the specific process includes the control unit 5 sending the first light intensity signal to the first driving module 6, and the first driving module 6 does not set the light intensity value of the first light source 3 after receiving the first light intensity signal; and even if the first camera 1 sends a stroboscopic signal at a later time and triggers the first light source 3 through the first driving module 6, the first light source 3 cannot send out any content.

[0111] The control unit 5 generates a first duration signal corresponding to the first duration value, which is used to set the first light source 3 to be lit and the lighting duration is the first duration value; the specific process includes the control unit 5 sending the first duration signal to the first camera 1, and after the first camera 1 receives the first duration signal, when it is triggered by the image acquisition signal to shoot and start exposure, the stroboscopic signal is not triggered.

[0112] The control unit 5 generates a second light intensity signal corresponding to the second light intensity value, which is used to set the light intensity value when the second light source 4 is lit to the second light intensity value; the specific process includes: the control unit 5 sends the generated second light intensity signal to the second driving module 7, and the second driving module 7 does not set the light intensity value of the second light source 4 after receiving the second light intensity signal, and even if the second camera 2 sends a strobe signal later and triggers the second light source 4 through the second driving module, the second light source 4 cannot send out any content.

[0113] The control unit 5 generates a second duration signal corresponding to the second duration value, which is used to control the second light source 4 to be lit and the lighting duration is the second duration value; the specific process includes: the control unit 5 sends the second duration signal to the second camera 2, and after the second camera 2 receives the second duration signal, when it is triggered by the image acquisition signal to shoot and start exposure, the stroboscopic signal is not triggered.

[0114] The first light intensity value and the first duration value are both fill light parameters corresponding to when the first light source 3 does not need fill light, and the second light intensity value and the second duration value are both fill light parameters corresponding to when the second light source 4 does not need fill light.

[0115] Through the above-mentioned setting and control method, it is possible to realize a single binocular depth camera to select multiple fill lights according to the set range obtained by the control unit 5 (input from the outside or stored in the control unit 5), thereby obtaining multiple target depth images, while improving the environmental adaptability of the binocular depth camera; avoiding the disadvantage that the existing binocular depth camera cannot obtain multiple target depth images.

[0116] In some embodiments, the fill light parameters of the first light source 3 are fill light parameters of non-visible light, and the fill light parameters of the second light source 4 are fill light parameters of visible light; that is, the first light source 3 is a visible light source, and the second light source 4 is a non-visible light source.

[0117] In some embodiments, the fill light parameters of the first light source 3 are fill light parameters of a speckle projector, and the fill light parameters of the second light source 4 are fill light parameters of infrared light; that is, the first light source 3 is a speckle projector, and the second light source 4 is an infrared LED lamp.

[0118] That is, the first light source 3 and the second light source 4 emit different contents, thereby meeting different fill light requirements.

[0119] Example 2

[0120] This embodiment provides a binocular depth camera control device, the control system comprising:

[0121] A first acquisition module, used for acquiring a first shooting signal and acquiring a first image based on the first shooting signal;

[0122] A second acquisition module, used to acquire image parameters of the first image; the image parameters include a first parameter and a second parameter;

[0123] A first judgment acquisition module is used to execute, if the image parameter does not belong to the set range, to obtain the fill light parameters of the first light source and the fill light parameters of the second light source, generate a second shooting signal based on the fill light parameters of the first light source and the fill light parameters of the second light source, and obtain a target depth image based on the second shooting signal;

[0124] The fill light parameters of the first light source are used to make the first parameter of the target depth image within a set range; the fill light parameters of the second light source are used to make the second parameter of the target depth image within a set range; the fill light parameters of the first light source include a first duration value and a first light intensity value, and the fill light parameters of the second light source include a second duration value and a second light intensity value;

[0125] The second judgment acquisition module is used to execute, if the image parameter belongs to the set range, to acquire the target depth image based on the first shooting signal.

[0126] Wherein, the first judgment acquisition module includes:

[0127] An image acquisition unit, used for acquiring a target depth image;

[0128] A first light intensity control unit, used to set the light intensity value of the first light source when it is lit to a first light intensity value;

[0129] A first duration control unit, used to control the first light source to be lit and the lighting duration is a first duration value;

[0130] A second light intensity control unit, used to set the light intensity value of the second light source when it is lit to a second light intensity value;

[0131] The second duration control unit is used to control the second light source to be lit and the lighting duration is a second duration value.

[0132] In some embodiments, the fill light parameters of the first light source are fill light parameters of non-visible light, and the fill light parameters of the second light source are fill light parameters of visible light.

[0133] In some embodiments, the fill light parameters of the first light source are fill light parameters of a speckle projector, and the fill light parameters of the second light source are fill light parameters of infrared light.

[0134] It can be understood that a binocular depth camera control device provided in an embodiment of the present invention corresponds to the above-mentioned binocular depth camera control method, and the explanations, examples, beneficial effects and other parts of the relevant contents can refer to the corresponding contents in the method for identifying the eye focus position, which will not be repeated here.

[0135] Example 3

[0136] refer to Figure 3 , this embodiment provides an electronic device, the electronic device includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus;

[0137] Memory, used to store computer programs;

[0138] The processor is used to implement the steps of the binocular depth camera control method mentioned in the claim when executing the program stored in the memory.

[0139] like Figure 3 As shown, it includes a processor 401, a communication interface 402, a memory 403 and a communication bus 404, wherein the processor 401, the communication interface 402, and the memory 403 communicate with each other through the communication bus 404.

[0140] Memory 403, used for storing computer programs;

[0141] The processor 401 is used to implement any of the above binocular depth camera control methods when executing the program stored in the memory 403.

[0142] The communication bus mentioned in the above electronic device can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The communication bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.

[0143] The communication interface is used for communication between the above electronic device and other devices.

[0144] The memory may include a random access memory (RAM) or a non-volatile memory (NVM), such as at least one disk memory. Optionally, the memory may also be at least one storage device located away from the aforementioned processor.

[0145] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

[0146] Example 4

[0147] This embodiment provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, the steps of the above-mentioned binocular depth camera control method are implemented.

[0148] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments may be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present invention are generated.

[0149] The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated therein. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)).

[0150] In summary, compared with the prior art, the binocular depth camera control method, device, equipment and storage medium provided by the present invention have the following beneficial effects:

[0151] After determining whether the image parameters are within the set range, the fill light parameters can be obtained according to the determination result. Different light sources can be effectively controlled according to the obtained fill light parameters to perform fill light separately, thereby realizing the free selection of multiple fill light modes and effectively obtaining the target depth image.

[0152] This avoids the defects of the prior art binocular depth camera, that is, the poor environmental adaptability and inability to obtain multiple depth images.

[0153] Improved the environmental adaptability of the binocular depth camera;

[0154] This avoids the problem of increasing the image acquisition cost when using multiple binocular depth cameras to acquire depth images of multiple targets.

[0155] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0156] The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A binocular depth camera control method, characterized in that: The method includes: Acquire a first shooting signal, and acquire a first image based on the first shooting signal; Acquire image parameters of the first image; the image parameters include a first parameter and a second parameter; If the image parameters do not fall within the set range, obtaining fill light parameters of the first light source and fill light parameters of the second light source, generating a second shooting signal based on the fill light parameters of the first light source and the fill light parameters of the second light source, and obtaining a target depth image based on the second shooting signal; The fill light parameters of the first light source are used to make the first parameter of the target depth image within a set range; the fill light parameters of the second light source are used to make the second parameter of the target depth image within a set range; the fill light parameters of the first light source include a first duration value and a first light intensity value, and the fill light parameters of the second light source include a second duration value and a second light intensity value; If the image parameters are within the set range, a target depth image is acquired based on the first shooting signal.

2. The control method according to claim 1, characterized in that: The second shooting signal includes: An image acquisition signal is used to acquire a target depth image; A first light intensity signal, used to set the light intensity value of the first light source when it is lit to a first light intensity value; A first duration signal, used to control the first light source to be lit and the lighting duration is a first duration value; A second light intensity signal, used to set the light intensity value of the second light source when it is lit to a second light intensity value; The second duration signal is used to control the second light source to be lit and the lighting duration is a second duration value.

3. The control method according to claim 1, characterized in that: The fill light parameters of the first light source are fill light parameters of non-visible light, and the fill light parameters of the second light source are fill light parameters of visible light.

4. The control method according to claim 1, characterized in that: The fill light parameters of the first light source are fill light parameters of a speckle projector, and the fill light parameters of the second light source are fill light parameters of infrared light.

5. A binocular depth camera control device, characterized in that: The control system comprises: A first acquisition module, used for acquiring a first shooting signal and acquiring a first image based on the first shooting signal; A second acquisition module, used to acquire image parameters of the first image; the image parameters include a first parameter and a second parameter; A first judgment acquisition module is used to execute, if the image parameter does not belong to the set range, to obtain the fill light parameters of the first light source and the fill light parameters of the second light source, generate a second shooting signal based on the fill light parameters of the first light source and the fill light parameters of the second light source, and obtain a target depth image based on the second shooting signal; The fill light parameters of the first light source are used to make the first parameter of the target depth image within a set range; the fill light parameters of the second light source are used to make the second parameter of the target depth image within a set range; the fill light parameters of the first light source include a first duration value and a first light intensity value, and the fill light parameters of the second light source include a second duration value and a second light intensity value; The second judgment acquisition module is used to execute, if the image parameter belongs to the set range, to acquire the target depth image based on the first shooting signal.

6. The control device according to claim 5, characterized in that: The first judgment and acquisition module includes: An image acquisition unit, used for acquiring a target depth image; A first light intensity control unit, used to set the light intensity value of the first light source when it is lit to a first light intensity value; A first duration control unit, used to control the first light source to be lit and the lighting duration is a first duration value; A second light intensity control unit, used to set the light intensity value of the second light source when it is turned on to a second light intensity value; The second duration control unit is used to control the second light source to be lit and the lighting duration is a second duration value.

7. The control device according to claim 5, characterized in that: The fill light parameters of the first light source are fill light parameters of non-visible light, and the fill light parameters of the second light source are fill light parameters of visible light.

8. The control device according to claim 5, characterized in that: The fill light parameters of the first light source are fill light parameters of a speckle projector, and the fill light parameters of the second light source are fill light parameters of infrared light.

9. An electronic device, characterized in that: It includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; Memory, used to store computer programs; A processor is used to implement the steps of the control method described in any one of claims 1 to 4 when executing a program stored in a memory.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the control method according to any one of claims 1 to 4 are implemented.

Images