A method, device, image acquisition device and medium for controlling the output of images by a camera

Abstract

The present application discloses a method, device, image acquisition device and medium for controlling camera image output, which relates to the technical field of image acquisition. It includes: obtaining the original images corresponding to the current environment collected by each camera; obtaining the brightness values of each original image; determining a target brightness value according to the brightness values of each original image; wherein, the target brightness value is one; determining an exposure combination according to the target brightness value; wherein the exposure combination at least includes the gain of the camera and the exposure time of the camera; controlling each camera to photograph the current environment according to the exposure combination. In this method, since the target brightness values of each camera are the same, the exposure combinations determined according to the target brightness values are also the same. Therefore, it is ensured that the image output brightness of each camera reaches consistency; at the same time, each camera adopts the same exposure combination, including the same exposure time, realizing the simultaneous image output of each camera, facilitating the user to restore the current environment according to the images at the same moment and with the same brightness, and improving the user experience.

Description

Technical Field

[0001] The present application relates to the technical field of image acquisition, and particularly to a method, a device, an image acquisition device and a medium for controlling image output of a camera. Background Art

[0002] With the popularization of virtual reality (VR) devices, people have more and more application scenarios for VR devices. Cameras (including a left-eye camera and a right-eye camera) are the eyes of VR devices and are responsible for image acquisition. After the two cameras acquire images, it is often necessary to restore the current environment according to the acquired images, such as using a 3D restoration algorithm to restore the current environment. However, in fact, in order to obtain a larger viewing angle, the binocular cameras often face different directions, and it is possible that the brightness of the images acquired by the two cameras is inconsistent, resulting in misjudgment when using the 3D restoration algorithm to restore the current scene, thus affecting the user experience.

[0003] Therefore, it can be seen that how to make the image output brightness of the two cameras of the VR device consistent is a technical problem that needs to be solved urgently by those skilled in the art. Summary of the Invention

[0004] The purpose of the present application is to provide a method, a device, an image acquisition device and a medium for controlling image output of a camera, which are used to realize the synchronization of the image output time and the consistency of the image output brightness of the cameras of the VR device.

[0005] To solve the above technical problems, the present application provides a method for controlling image output of a camera, which is applied to a device including at least two cameras, and includes:

[0006] Obtain the original images corresponding to the current environment acquired by each of the cameras;

[0007] Obtain the brightness values of the original images;

[0008] Determine a target brightness value according to the brightness values of the original images; wherein, there is one target brightness value;

[0009] Determine an exposure combination according to the target brightness value; wherein the exposure combination at least includes the gain of the camera and the exposure time of the camera;

[0010] Control each of the cameras to photograph the current environment according to the exposure combination.

[0011] Preferably, the obtaining the brightness values of the original images includes:

[0012] Divide the current original image into multiple regions;

[0013] Obtain the first average value of the RGB components of each of the regions;

[0014] Determine the brightness value corresponding to each of the regions according to the first average value;

[0015] Determine the brightness value of the current original image according to the brightness values corresponding to each of the regions.

[0016] Preferably, the determining the target brightness value according to the brightness values of the original images includes:

[0017] Obtain the size corresponding to each of the original images;

[0018] Determine whether the sizes corresponding to the original images are the same;

[0019] If so, obtain the second average value of the brightness values of the original images; use the second average value as the target brightness value;

[0020] If not, obtain the ratio value of the sizes corresponding to the original images; obtain the product of the brightness value of each original image and the corresponding ratio value as the updated brightness value of each original image; obtain the third average value of the updated brightness values of the original images; use the third average value as the target brightness value.

[0021] Preferably, the exposure combination includes the gain of the camera and the exposure time of the camera, and the determining the exposure combination according to the target brightness value includes:

[0022] When the gain of the camera is the current preset value, adjust the current exposure time of the camera in a first fixed step;

[0023] Obtain the current brightness value of the camera according to the current preset value and the current exposure time;

[0024] When the current brightness value of the camera is equal to the target brightness value, use the current preset value and the current exposure time as the exposure combination;

[0025] When the current brightness value of the camera is not equal to the target brightness value, return to the step of adjusting the current exposure time of the camera in a first fixed step when the gain of the camera is the current preset value.

[0026] Preferably, after adjusting the current exposure time of the camera in a first fixed step when the gain of the camera is the current preset value and before obtaining the current brightness value of the camera according to the current preset value and the current exposure time, the method further includes:

[0027] Determine whether the current exposure time is less than or equal to a first threshold;

[0028] If so, enter the step of obtaining the current brightness value of the camera according to the current preset value and the current exposure time;

[0029] If not, adjust the current preset value to a new preset value; obtain a new brightness value of the camera according to the new preset value and the first threshold;

[0030] When the new brightness value of the camera is equal to the target brightness value, use the new preset value and the first threshold as the exposure combination;

[0031] When the new brightness value of the camera is not equal to the target brightness value, return to the step of adjusting the current preset value to a new preset value.

[0032] Preferably, the obtaining of the original images corresponding to the current environment collected by each camera includes:

[0033] Obtain the original images corresponding to the current environment collected by each camera at the same moment.

[0034] Preferably, after controlling each camera to capture the current environment according to the exposure combination, the method further includes:

[0035] Record the actual time when each camera finishes capturing the image of the current environment;

[0036] When the actual time exceeds the second threshold, return to the step of obtaining the original images corresponding to the current environment collected by each camera.

[0037] To solve the above technical problems, the present application also provides a device for controlling camera image output, which is applied to a device including at least two cameras, and includes:

[0038] A first acquisition module, configured to acquire original images corresponding to the current environment collected by each camera;

[0039] A second acquisition module, configured to acquire the brightness values of the original images;

[0040] A first determination module, configured to determine a target brightness value according to the brightness values of the original images; wherein, there is one target brightness value;

[0041] A second determination module, configured to determine an exposure combination according to the target brightness value; wherein the exposure combination at least includes the gain of the camera and the exposure time of the camera;

[0042] A control module, configured to control each camera to capture the current environment according to the exposure combination.

[0043] To solve the above technical problems, the present application also provides an image acquisition device, including:

[0044] A memory for storing a computer program;

[0045] A processor for implementing the steps of the above method for controlling the camera to output images when executing the computer program.

[0046] To solve the above technical problems, the present application also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the above method for controlling the camera to output images are implemented.

[0047] A method for controlling the camera to output images provided by the present application is applied to a device including at least two cameras, and includes: obtaining original images corresponding to the current environment collected by each camera; obtaining the brightness values of each original image; determining a target brightness value according to the brightness values of each original image; wherein, the target brightness value is one; determining an exposure combination according to the target brightness value; wherein the exposure combination at least includes the gain of the camera and the exposure time of the camera; controlling each camera to photograph the current environment according to the exposure combination. In this method, the target brightness value is determined according to the brightness values of each original image, the exposure combination is determined according to the target brightness value, and then the image is photographed according to the exposure combination. Since the target brightness values of each camera are the same, the exposure combinations determined according to the target brightness value are also the same, so the output image brightness of each camera is ensured to be consistent; at the same time, each camera uses the same exposure combination, including the same exposure time, realizing that each camera outputs images simultaneously, which is convenient for users to restore the current environment according to the images at the same time and with the same brightness, improving the user experience.

[0048] In addition, the present application also provides a device for controlling the camera to output images, an image acquisition device, and a computer-readable storage medium, which have the same or corresponding technical features as the above-mentioned method for controlling the camera to output images, and the effects are the same. Description of the Drawings

[0049] To more clearly illustrate the embodiments of the present application, the following will briefly introduce the drawings required for use in the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained according to these drawings without creative efforts.

[0050] Figure 1 It is a flowchart of a method for controlling the camera to output images provided by an embodiment of the present application;

[0051] Figure 2 It is a flowchart of a method for obtaining the brightness value of each original image provided by an embodiment of the present application;

[0052] Figure 3 The structural diagram of the device for controlling the camera to output images provided by an embodiment of the present application;

[0053] Figure 4 The structural diagram of the image acquisition device provided by another embodiment of the present application;

[0054] Figure 5 The flowchart of a method for the binocular camera of a VR device to output images provided by an embodiment of the present application. Detailed implementation manners

[0055] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts belong to the protection scope of the present application.

[0056] The core of the present application is to provide a method, device, image acquisition device and medium for controlling the camera to output images, which are used to achieve the synchronization of the camera output time and the consistency of the output brightness of the VR device.

[0057] It should be noted that the method for controlling the camera to output images provided by the present application is applicable to the scenario of shooting images of the current environment through multiple cameras. In order to accurately restore the current environment based on the images captured by each camera, it is usually required that each camera outputs images under the conditions of time synchronization and consistent brightness. For example, in a VR device, there are a left-eye camera and a right-eye camera. The left-eye camera and the right-eye camera are equivalent to the eyes of the VR device and are responsible for image acquisition work. In practice, in order to obtain a larger viewing angle, the two cameras often face different directions, which may cause the brightness of the images captured by the two cameras to be inconsistent. Due to the inconsistent brightness of the two images, it is impossible to accurately extract the same feature points from the two images, which in turn causes misjudgment in the 3D restoration algorithm when collecting images, and thus it is impossible to accurately restore the current environment, affecting the user experience. Therefore, in the present application, the brightness information of the images captured by each camera is fused to obtain unified brightness information for each camera, which is converted into corresponding exposure combinations to control the synchronization of the camera output time and the consistency of the output brightness of each camera.

[0058] In order to enable those skilled in the art to better understand the solution of the present application, the present application will be further described in detail below in conjunction with the accompanying drawings and specific implementation manners. Figure 1 The flowchart of a method for controlling the camera to output images provided by an embodiment of the present application. This method is applied to a device including at least two cameras, such as Figure 1 As shown, the method includes:

[0059] S10: Obtain the original images corresponding to the current environment collected by each camera.

[0060] In implementation, in order to synchronize the image output time of each camera and make the output brightness consistent, it is necessary to fuse the brightness values of the original images collected by each camera to obtain a unified brightness value. When obtaining the brightness values of the original images collected by each camera, it is first necessary to obtain the original images collected by each camera. The original images here are to distinguish from the images taken after obtaining a unified exposure combination. Since it is necessary to restore the current environment based on the images collected by each camera, therefore, the original images corresponding to the current environment collected by each camera are obtained. In practice, the brightness in the environment at different times has a large difference on the captured images. Therefore, in order to accurately restore the current environment based on each original image, the preferred implementation is to select the original images corresponding to the current environment collected by each camera at the same time.

[0061] S11: Obtain the brightness values of each original image.

[0062] In step S10, the original images of the current environment collected by each camera are obtained, and then the brightness values of each original image are obtained. There is no limitation on the method of obtaining the brightness values of each original image. For example, the average value can be obtained after obtaining the brightness values of the pixel points in the image area, or the image color brightness can be calculated through Palette, etc.

[0063] S12: Determine the target brightness value according to the brightness values of each original image; wherein, there is one target brightness value.

[0064] After calculating the brightness values of each original image, the brightness value information of each original image can be further fused to obtain the unified brightness value information of each camera, that is, the target brightness value here. Since it is necessary to make the output brightness of each camera consistent, therefore, there is one target brightness value, that is, the brightness value when each camera outputs an image is this target brightness value.

[0065] S13: Determine the exposure combination according to the target brightness value; wherein the exposure combination includes at least the gain of the camera and the exposure time of the camera.

[0066] After obtaining the target brightness value, the corresponding exposure combination can be determined. The exposure combination includes the gain of the camera, the exposure time of the camera, and the aperture. In the embodiments of the present application, it is default that each camera uses the same aperture. Therefore, the final exposure combination includes the gain of the camera and the exposure time of the camera. When determining the exposure combination (the gain of the camera and the exposure time of the camera) according to the target brightness value, the camera gain and the exposure time of the camera can be adjusted according to a certain rule. For example, keep the camera gain unchanged, change the exposure time of the camera, calculate the corresponding brightness value and compare it with the target brightness value until the target brightness value is found and the adjustment stops. The exposure combination corresponding to the time when the target brightness value is obtained is the final exposure combination used to control each camera to shoot the current environment. According to formula (1), the exposure setting value (Exp_set) can be calculated:

[0067] Exp_set = the gain of the camera * the exposure time of the camera (1)

[0068] S14: Control each camera to shoot the current environment according to the exposure combination.

[0069] Upload the obtained exposure combination to the sensors of each camera, and then control each camera to shoot the current environment.

[0070] A method for controlling the image output of a camera provided in this embodiment is applied to a device including at least two cameras, and includes: obtaining the original images corresponding to the current environment collected by each camera; obtaining the brightness values of each original image; determining the target brightness value according to the brightness values of each original image; where the target brightness value is one; determining the exposure combination according to the target brightness value; where the exposure combination includes at least the gain of the camera and the exposure time of the camera; controlling each camera to shoot the current environment according to the exposure combination. In this method, the target brightness value is determined according to the brightness values of each original image, the exposure combination is determined according to the target brightness value, and then the image is shot according to the exposure combination. Since the target brightness values of each camera are the same, the exposure combinations determined according to the target brightness values are also the same. Therefore, it is ensured that the brightness of the images output by each camera is consistent; at the same time, each camera uses the same exposure combination, including the exposure time, so that each camera outputs images simultaneously, which is convenient for users to restore the current environment according to the images with the same time and the same brightness, improving the user experience.

[0071] In implementation, in order to obtain the brightness values of each original image more accurately, the preferred implementation is that obtaining the brightness values of each original image includes:

[0072] Dividing the current original image into multiple regions;

[0073] Obtaining the first average value of the RGB components of each region;

[0074] Determining the brightness value corresponding to each region according to the first average value;

[0075] Determine the brightness value of the current original image according to the brightness values corresponding to each region.

[0076] Here, an original image is taken as an example to illustrate the method for obtaining the brightness value of the original image. First, the original image is divided into multiple regions (sub-parts of the original image), and there is no limit on the size of the divided regions, which can be the same or different. For the convenience of quickly calculating the brightness value of the original image subsequently, it is selected to divide the original image into multiple regions of the same size. After dividing the original image into multiple regions, calculate the average value of the R, G, and B analysis quantities for each region respectively. According to formula (2), the average brightness value of each region can be calculated; after calculating the brightness values of all regions, the brightness value of the original image can be obtained based on the brightness values of all regions.

[0077] Y = 0.229R + 0.587G + 0.114B (2)

[0078] In formula (2), R represents the average value of the red analysis quantity in the original image; G represents the average value of the green analysis quantity in the original image; B represents the average value of the blue analysis quantity in the original image; Y represents the average brightness value of each region.

[0079] It should be noted that in the case where the entire original image is divided into multiple regions of various sizes, after calculating the brightness values of all regions, the average value of the brightness values of all regions can be obtained, and finally the average value is used as the brightness value of the original image; in the case where the entire original image is divided into multiple regions of unequal sizes, after calculating the brightness values of all regions, the brightness value of each region needs to be multiplied by the proportion of the corresponding region occupied as the brightness value of each region, and then the average value of the brightness values of all regions is obtained, and finally the average value is used as the brightness value of the original image.

[0080] Figure 2 It is a flowchart of a method for obtaining the brightness value of each original image provided by an embodiment of the present application. As Figure 2 shown, the method includes:

[0081] S15: Divide the original image into M * N regions;

[0082] S16: Calculate the average brightness value of each region;

[0083] S17: Calculate the average brightness value of all regions.

[0084] Among them, M represents the number of parts into which the original image is divided horizontally, and N represents the number of parts into which the original image is divided vertically. There is no limit on the specific values of M and N, which are determined according to the size of the original image in practice.

[0085] The method provided in this embodiment for obtaining the brightness values of the original images divides each original image into multiple regions, and obtains the brightness value of the entire original image based on the brightness values of the regions, making the obtained brightness value of the original image more accurate.

[0086] After obtaining the brightness values of the original images, determine the target brightness value according to the brightness values of the original images. In practice, to obtain a more accurate target brightness value, a preferred implementation is that determining the target brightness value according to the brightness values of the original images includes:

[0087] Obtain the sizes corresponding to the original images;

[0088] Determine whether the sizes corresponding to the original images are the same;

[0089] If so, obtain the second average value of the brightness values of the original images; use the second average value as the target brightness value;

[0090] If not, obtain the ratio value of the sizes corresponding to the original images; obtain the product of the brightness value of each original image and the corresponding ratio value as the updated brightness value of each original image; obtain the third average value of the updated brightness values of the original images; use the third average value as the target brightness value.

[0091] When the sizes corresponding to the original images are the same, the average value of the brightness values of all original images is the target brightness value; when the sizes corresponding to the original images are different, it is necessary to determine the target brightness value according to the sizes corresponding to the original images. The ratio value of the sizes corresponding to the original images is obtained by comparing the sizes of the original images. For example, in the binocular cameras of a VR device, the proportion of the first image captured by one camera is 0.3, and the proportion of the second image captured by the other camera is 0.7. Then, when calculating the target brightness value, it is necessary to multiply the brightness value of the first image by 0.3 to obtain the new brightness value of the first image, multiply the brightness value of the second image by 0.7 to obtain the new brightness value of the second image, and the final target brightness value is the average value of the new brightness value of the first image and the new brightness value of the second image.

[0092] The method provided in this embodiment for determining the target brightness value according to the brightness value of the original image takes into account the size of the original image, making the obtained target brightness value more accurate.

[0093] The above embodiment describes the method for obtaining the target brightness value. After obtaining the target brightness value, the exposure combination can be determined according to the target brightness value. In this embodiment, the aperture is default fixed, and only the exposure combination formed by the gain of the camera and the exposure time of the camera is considered. Specifically, determining the exposure combination according to the target brightness value includes:

[0094] When the gain of the camera is the current preset value, adjust the current exposure time of the camera in accordance with a first fixed step size;

[0095] Obtain the current brightness value of the camera according to the current preset value and the current exposure time;

[0096] When the current brightness value of the camera is equal to the target brightness value, use the current preset value and the current exposure time as the exposure combination;

[0097] When the current brightness value of the camera is not equal to the target brightness value, return to the step of adjusting the current exposure time of the camera in accordance with a first fixed step size when the gain of the camera is the current preset value.

[0098] The gain of the camera is the current preset value. By adjusting the exposure time of the camera to find the exposure combination corresponding to the target brightness value, that is, first fixing the gain of the camera and then adjusting the exposure time of the camera to find the exposure combination corresponding to the target brightness value. There are no restrictions on the current preset value and the first fixed step size, which are determined according to the actual situation. In this embodiment, the method adopted is to first fix the gain of the camera and then adjust the exposure time of the camera to find the exposure combination corresponding to the target brightness value. In practice, it is also possible to first fix the exposure time of the camera and then adjust the gain of the camera to find the exposure combination corresponding to the target brightness value.

[0099] It should be noted that in this embodiment, considering that the aperture in the exposure combination is fixed, the corresponding exposure combination (the gain of the camera and the exposure time of the camera) is obtained through the target brightness value. In practice, when the aperture in the exposure combination is not a fixed value, the method of obtaining the exposure combination (the gain of the camera, the exposure time of the camera, and the aperture) corresponding to the target brightness value is similar to the method of this embodiment, which will not be elaborated here.

[0100] The method for obtaining the exposure combination provided in this embodiment, compared with the method of randomly selecting the gain of the camera and the exposure time of the camera to determine the exposure combination corresponding to the target brightness value, fixes one variable and adjusts the other variable in this embodiment, and can quickly and regularly find the exposure combination corresponding to the target brightness value.

[0101] In the above embodiment, the exposure time of the camera is adjusted to find the exposure combination corresponding to the target brightness value. In practice, there is a certain threshold for the exposure time of the camera, that is, the exposure time cannot be increased after increasing to the threshold. If the exposure combination corresponding to the target brightness value is not found, the gain of the camera needs to be adjusted. Therefore, preferably, after adjusting the current exposure time of the camera in accordance with a first fixed step size when the gain of the camera is the current preset value and before obtaining the current brightness value of the camera according to the current preset value and the current exposure time, the method for controlling the camera to output images further includes:

[0102] Determine whether the current exposure time is less than or equal to a first threshold;

[0103] If yes, then enter the step of obtaining the current brightness value of the camera according to the current preset value and the current exposure time;

[0104] If not, adjusting the current preset value to a new preset value; obtaining a new brightness value of the camera according to the new preset value and the first threshold;

[0105] When the new brightness value of the camera is equal to the target brightness value, the new preset value and the first threshold are used as an exposure combination;

[0106] When the new brightness value of the camera is not equal to the target brightness value, the process returns to the step of adjusting the current preset value to a new preset value.

[0107] The first threshold is not limited and is determined according to actual conditions. In this embodiment, when the exposure time of the camera exceeds the first threshold and the target brightness value is not found, the target brightness value is found by adjusting the gain of the camera, so that the exposure combination corresponding to the target brightness value can be found.

[0108] In order to restore the current environment more accurately and quickly according to each original image, a preferred implementation is that obtaining the original image corresponding to the current environment captured by each camera includes:

[0109] Get the original image corresponding to the current environment captured by each camera at the same time.

[0110] In this embodiment, what is obtained is the original image corresponding to the current environment captured by each camera at the same time. Compared with the method of obtaining the original image corresponding to the current environment captured by each camera at different times, the method provided by this embodiment can eliminate the influence of the brightness difference in the environment at different times on the original image taken as much as possible, so that the current environment can be restored more accurately and quickly according to each original image.

[0111] After controlling each camera to take a picture of the current environment according to the exposure combination, in order to verify whether each camera outputs pictures synchronously, a preferred implementation is that after controlling each camera to take a picture of the current environment according to the exposure combination, the method of controlling the camera to output pictures further includes:

[0112] Record the actual moment when each camera completes capturing the image of the current environment;

[0113] When the actual time exceeds the second threshold, the process returns to the step of obtaining the original image corresponding to the current environment captured by each camera.

[0114] The second threshold is not limited and is determined according to the actual situation. When the actual time exceeds the second threshold, it indicates that the cameras do not output images synchronously. Therefore, it is necessary to return to the step of obtaining the original images corresponding to the current environment collected by each camera again to control the cameras to output images synchronously.

[0115] In this embodiment, the actual time when each camera finishes shooting the image of the current environment is recorded. By recording, the user can understand the image output situation of each camera; and when the actual time exceeds the second threshold, the cameras are controlled to output images synchronously again, so that the current environment can be restored more accurately.

[0116] In the above embodiment, the method for controlling the camera to output images is described in detail. The present application also provides embodiments of a device for controlling the camera to output images and an image acquisition device. It should be noted that the embodiments of the device part of the present application are described from two perspectives, one is from the perspective of functional modules, and the other is from the perspective of hardware.

[0117] Figure 3 The structural diagram of the device for controlling the camera to output images provided in an embodiment of the present application. This embodiment is based on the perspective of functional modules and includes:

[0118] A first acquisition module 10, configured to acquire the original images corresponding to the current environment collected by each camera;

[0119] A second acquisition module 11, configured to acquire the brightness values of the original images;

[0120] A first determination module 12, configured to determine a target brightness value according to the brightness values of the original images; wherein, there is one target brightness value;

[0121] A second determination module 13, configured to determine an exposure combination according to the target brightness value; wherein the exposure combination includes at least the gain of the camera and the exposure time of the camera;

[0122] A control module 14, configured to control each camera to shoot the current environment according to the exposure combination.

[0123] Since the embodiments of the device part correspond to the embodiments of the method part, please refer to the description of the embodiments of the method part for the embodiments of the device part, and details are not described here for the time being.

[0124] The device for controlling the camera to output images provided in this embodiment obtains the original images corresponding to the current environment collected by each camera through the first acquisition module; obtains the brightness values of each original image through the second acquisition module; determines the target brightness value according to the brightness values of each original image through the first determination module; where the target brightness value is one; determines the exposure combination according to the target brightness value through the second determination module; where the exposure combination includes at least the gain of the camera and the exposure time of the camera; controls each camera to photograph the current environment according to the exposure combination through the control module. In this device, the target brightness value is determined according to the brightness values of each original image, the exposure combination is determined according to the target brightness value, and then images are photographed according to the exposure combination. Since the target brightness values of each camera are the same, the exposure combinations determined according to the target brightness value are also the same, so it is ensured that the output image brightness of each camera is consistent; at the same time, each camera uses the same exposure combination, including the exposure time, to realize that each camera outputs images simultaneously, which is convenient for users to restore the current environment according to the images at the same time and with the same brightness, improving the user experience.

[0125] Figure 4 It is a structural diagram of an image acquisition device provided in another embodiment of this application. From a hardware perspective, as Figure 4 shown, the image acquisition device includes:

[0126] A memory 20 for storing computer programs;

[0127] A processor 21 for implementing the steps of the method for controlling the camera to output images as mentioned in the above embodiment when executing the computer program.

[0128] The image acquisition device provided in this embodiment may include, but is not limited to, a smart phone, a tablet computer, a laptop computer, or a desktop computer, etc.

[0129] Among them, the processor 21 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 21 may be implemented in at least one hardware form of a digital signal processor (DSP), a field-programmable gate array (FPGA), or a programmable logic array (PLA). The processor 21 may also include a main processor and a coprocessor. The main processor is a processor used to process data in the wake state, also known as the central processing unit (CPU); the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, the processor 21 may be integrated with a graphics processing unit (GPU), and the GPU is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 21 may further include an artificial intelligence (AI) processor, and the AI processor is used to process computational operations related to machine learning.

[0130] The memory 20 may include one or more computer-readable storage media, and the computer-readable storage media may be non-transitory. The memory 20 may further include high-speed random access memory and non-volatile memory, such as one or more disk storage devices and flash storage devices. In this embodiment, the memory 20 is at least used to store the following computer program 201. After the computer program is loaded and executed by the processor 21, it can implement the relevant steps of the method for controlling the camera to output images disclosed in any of the foregoing embodiments. In addition, the resources stored in the memory 20 may further include an operating system 202 and data 203, etc., and the storage method may be temporary storage or permanent storage. Among them, the operating system 202 may include Windows, Unix, Linux, etc. The data 203 may include, but is not limited to, the data involved in the method for controlling the camera to output images mentioned above.

[0131] In some embodiments, the image acquisition device may further include a display screen 22, an input / output interface 23, a communication interface 24, a power supply 25, and a communication bus 26.

[0132] Those skilled in the art can understand that Figure 4 the structure shown in

[0133] The image acquisition device provided by the embodiments of the present application includes a memory and a processor. When the processor executes the program stored in the memory, the following method can be implemented: the method for controlling the camera to output images, with the same effect as above.

[0134] Finally, the present application also provides an embodiment corresponding to a computer-readable storage medium. A computer program is stored on the computer-readable storage medium, and when the computer program is executed by the processor, the steps recorded in the above method embodiments are implemented.

[0135] It can be understood that if the method in the above embodiments is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or all or part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and executes all or part of the steps of the methods described in the various embodiments of the present application. And the aforementioned storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical discs that can store program codes.

[0136] The computer-readable storage medium provided by the present application includes the method for controlling the camera to output images mentioned above, with the same effect as above.

[0137] To enable those skilled in the art to better understand the technical solution of the present application, the following is combined with the attached Figure 5 For a further detailed description of the above-mentioned present application, Figure 5 It is a flowchart of a method for a binocular camera to output images of a VR device provided by an embodiment of the present application. As Figure 5 shown, the method includes:

[0138] S18: Obtain the image corresponding to the current environment collected by the binocular camera;

[0139] S19: Obtain the average brightness value corresponding to each image;

[0140] S20: Determine the final brightness value of the binocular camera;

[0141] S21: Determine the exposure combination to be issued according to the final brightness value;

[0142] S22: Control the binocular camera to capture the current environment according to the exposure combination.

[0143] The method for the binocular camera of the VR device provided in this embodiment can achieve the brightness synchronization and time synchronization of each frame of the binocular camera; time synchronization helps to achieve the good implementation of the background 3D algorithm sampling and modeling, and ensures the accuracy of the algorithm as much as possible; brightness synchronization helps to save the algorithm computing power during scene restoration, and reduces the misjudgment of sampling points during the sampling process, improving the user experience.

[0144] The above has introduced in detail a method, device, image acquisition device and medium for controlling camera imaging provided by the present application. Each embodiment in the specification is described in a progressive manner. The key point of each embodiment is the difference from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method part. It should be noted that for those of ordinary skill in the art in this technical field, without departing from the principle of the present application, several improvements and modifications can be made to the present application, and these improvements and modifications also fall within the protection scope of the claims of the present application.

[0145] It should also be noted that in this specification, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not expressly listed, or also includes elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "including a..." does not exclude the existence of another identical element in the process, method, article or device including the said element.

Claims

1. A method for controlling the image output of a camera, characterized in that, Applied to a device including at least two cameras, comprising: Obtain the original images corresponding to the current environment collected by each of the cameras; Obtain the brightness values of each of the original images; Determine a target brightness value according to the brightness values of each of the original images; wherein, there is one target brightness value; Determine an exposure combination according to the target brightness value; wherein the exposure combination at least includes the gain of the camera and the exposure time of the camera; each of the cameras adopts the same exposure combination; Control each of the cameras to photograph the current environment according to the same exposure combination, so that the user can restore the current environment according to the images with the same moment and the same brightness; specifically, upload the obtained exposure combination to the sensors of each camera, and then control each camera to photograph the current environment; The determining the target brightness value according to the brightness values of each of the original images includes: Obtain the sizes corresponding to each of the original images; Judge whether the sizes corresponding to each of the original images are the same; If so, obtain the second average value of the brightness values of the original images; use the second average value as the target brightness value; If not, obtain the proportional value of the sizes corresponding to the original images; obtain the product of the brightness value of each of the original images and the corresponding proportional value as the latest brightness value of each of the original images; obtain the third average value of the latest brightness values of the original images; use the third average value as the target brightness value.

2. The method for controlling the camera to output images according to claim 1, wherein The obtaining the brightness values of each of the original images includes: Divide the current original image into multiple regions; Obtain the first average value of the RGB components of each of the regions; Determine the brightness value corresponding to each of the regions according to the first average value; Determine the brightness value of the current original image according to the brightness values corresponding to each of the regions.

3. The method for controlling the camera to output images according to claim 1, wherein, The exposure combination includes the gain of the camera and the exposure time of the camera, and the determining the exposure combination according to the target brightness value includes: When the gain of the camera is the current preset value, adjust the current exposure time of the camera according to the first fixed step; Obtain the current brightness value of the camera according to the current preset value and the current exposure time; When the current brightness value of the camera is equal to the target brightness value, use the current preset value and the current exposure time as the exposure combination; When the current brightness value of the camera is not equal to the target brightness value, return to the step of adjusting the current exposure time of the camera according to the first fixed step when the gain of the camera is the current preset value.

4. The method for controlling the camera to output images according to claim 3, wherein After adjusting the current exposure time of the camera according to the first fixed step when the gain of the camera is the current preset value, and before obtaining the current brightness value of the camera according to the current preset value and the current exposure time, the method further includes: Judge whether the current exposure time is less than or equal to the first threshold; If so, enter the step of obtaining the current brightness value of the camera according to the current preset value and the current exposure time; If not, adjust the current preset value to a new preset value; obtain the new brightness value of the camera according to the new preset value and the first threshold; When the new brightness value of the camera is equal to the target brightness value, use the new preset value and the first threshold as the exposure combination; When the new brightness value of the camera is not equal to the target brightness value, return to the step of adjusting the current preset value to a new preset value.

5. The method for controlling the camera to output images according to claim 4, wherein The obtaining the original images corresponding to the current environment collected by each camera includes: Obtain the original images corresponding to the current environment collected by each camera at the same moment.

6. The method for controlling the camera to output images according to claim 5, wherein After controlling each camera to shoot the current environment according to the same exposure combination, the method further includes: Record the actual time when each camera finishes shooting the image of the current environment; When the actual time exceeds the second threshold, return to the step of obtaining the original images corresponding to the current environment collected by each camera.

7. A device for controlling the image output of a camera, characterized in that, Applied to a device including at least two cameras, it includes: A first acquisition module, configured to acquire the original images corresponding to the current environment collected by each camera; A second acquisition module, configured to acquire the brightness values of the original images; A first determination module, configured to determine a target brightness value according to the brightness values of the original images; wherein, there is one target brightness value; A second determination module, configured to determine an exposure combination according to the target brightness value; wherein the exposure combination at least includes the gain of the camera and the exposure time of the camera; each camera uses the same exposure combination; A control module, configured to control each camera to shoot the current environment according to the same exposure combination, so that the user can restore the current environment according to the images with the same moment and the same brightness; specifically, upload the obtained exposure combination to the sensors of each camera, and then control each camera to shoot the current environment; The first determination module is specifically configured to: Obtain the sizes corresponding to the original images; Judge whether the sizes corresponding to the original images are the same; If so, obtain the second average value of the brightness values of the original images; use the second average value as the target brightness value; If not, obtain the proportional value of the sizes corresponding to the original images; obtain the product of the brightness value of each original image and the corresponding proportional value as the latest brightness value of each original image; obtain the third average value of the latest brightness values of the original images; use the third average value as the target brightness value.

8. An image acquisition device, characterized in that, It includes: A memory, configured to store a computer program; A processor, configured to implement the steps of the method for controlling the camera to output images according to any one of claims 1 to 6 when executing the computer program.

9. A computer-readable storage medium, characterized in that, A computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method for controlling the camera to output images according to any one of claims 1 to 6 are implemented.

Images