A shooting control method, device, electronic device and storage medium

Abstract

The present application discloses a shooting control method, apparatus, electronic device and storage medium. The method includes: obtaining an environmental brightness parameter of a shooting scene; determining a target shooting mode according to the environmental brightness parameter; wherein the target shooting mode includes at least one of the following: whether to call an automatic exposure module, the number of exposure times of an image sensor, and whether to call an artificial intelligence module for image processing; and switching the shooting mode to the target shooting mode. In this way, different shooting scenes are characterized by environmental brightness parameters, and whether to call an automatic exposure module, the number of exposure times of an image sensor, and whether to call an artificial intelligence module for image processing are determined according to the environmental brightness parameters. A matching shooting mode is configured for different shooting scenes, which can improve the switching speed of the shooting device during the scene switching process, make the image display effect smoother, and prevent the occurrence of picture jumping phenomena.

Description

Technical Field

[0001] This application relates to image processing technology, and in particular to a shooting control method, device, electronic device and storage medium. Background Art

[0002] During the process of taking pictures / recording using a shooting device, due to the uncertainty of the usage scenario, a single shooting / recording strategy cannot meet the frequently changing usage scenarios. Therefore, a method of configuring shooting parameters or image processing parameters for different usage scenarios is introduced, which is called scene switching.

[0003] For the following scenario: when the user holds the shooting device to record video during the day and suddenly enters an unlit indoor area (low light) from the outdoor (high light / high brightness), the current common strategy is to use the AE algorithm to increase the exposure time of the image sensor to control the brightness of the picture, so that the picture brightness remains in a relatively stable and ideal state, thereby obtaining an ideal image quality.

[0004] However, the convergence of the AE algorithm takes time (generally at least 4 to 5 frames), and it also takes N + 1 frames for the new configuration of the image sensor to take effect. That is to say, a complete and successful scene switching requires at least 5 to 6 frames, and it may take longer in some complex scenarios. Once encountering a scenario with frequent and drastic changes, it will result in poor image quality of the output and unsatisfactory display effect. Summary of the Invention

[0005] Embodiments of this application are expected to provide a shooting control method, device, electronic device and storage medium.

[0006] The technical solution of this application is implemented as follows:

[0007] In a first aspect, a shooting control method is provided, including:

[0008] Obtaining environmental brightness parameters of a shooting scene;

[0009] Determining a target shooting mode according to the environmental brightness parameters; wherein, the target shooting mode includes at least one of the following: whether to call an automatic exposure module, the number of exposure times of the image sensor, and whether to call an artificial intelligence module for image processing;

[0010] Switching the shooting mode to the target shooting mode.

[0011] In a second aspect, a shooting control device is provided, including:

[0012] An obtaining unit, configured to obtain environmental brightness parameters of a shooting scene;

[0013] A determination unit, configured to determine a target shooting mode according to the environmental brightness parameter; wherein, the target shooting mode includes at least one of the following: whether to call an automatic exposure module, the number of exposure times of an image sensor, and whether to call an artificial intelligence module for image processing;

[0014] A control unit, configured to switch the shooting mode to the target shooting mode.

[0015] In a third aspect, an electronic device is provided, including: a processor and a memory configured to store a computer program that can run on the processor,

[0016] wherein, when the processor is configured to run the computer program, it executes the steps of the foregoing method.

[0017] In a fourth aspect, a computer-readable storage medium is provided, on which a computer program is stored, wherein when the computer program is executed by a processor, it implements the steps of the foregoing method.

[0018] In an embodiment of the present application, a shooting control method, apparatus, electronic device and storage medium are provided. The method includes: obtaining an environmental brightness parameter of a shooting scene; determining a target shooting mode according to the environmental brightness parameter; wherein, the target shooting mode includes at least one of the following: whether to call an automatic exposure module, the number of exposure times of an image sensor, and whether to call an artificial intelligence module for image processing; switching the shooting mode to the target shooting mode. In this way, different shooting scenes are characterized by environmental brightness parameters, and whether to call an automatic exposure module, the number of exposure times of an image sensor, and whether to call an artificial intelligence module for image processing are determined according to the environmental brightness parameters. A matching shooting mode is configured for different shooting scenes, which can improve the switching speed during scene switching, make the image display effect smoother, and there will be no phenomenon of picture jump.

[0019] Further, a user adjustment channel can also be configured, and the user can adjust the corresponding shooting mode in some shooting scenes according to their own needs, so that the image quality of the shooting matches the user's needs and further improves the image quality. Description of the Drawings

[0020] Figure 1 It is the first flow diagram of the shooting control method in an embodiment of the present application;

[0021] Figure 2 It is the second flow diagram of the shooting control method in an embodiment of the present application;

[0022] Figure 3 It is the schematic diagram of shooting scene change in an embodiment of the present application;

[0023] Figure 4It is the third process schematic diagram of the shooting control method in the embodiment of the present application;

[0024] Figure 5 It is the schematic illustration of the display interface in the embodiment of the present application Figure 1 ;

[0025] Figure 6 It is the schematic illustration of the display interface in the embodiment of the present application Figure 2 ;

[0026] Figure 7 It is the schematic diagram of the composition structure of the shooting control device in the embodiment of the present application;

[0027] Figure 8 It is the schematic diagram of the composition structure of the electronic device in the embodiment of the present application. Specific embodiments

[0028] In order to understand the features and technical content of the embodiments of the present application in more detail, the implementation of the embodiments of the present application will be described in detail below with reference to the accompanying drawings. The attached drawings are for reference and illustration only and are not used to limit the embodiments of the present application.

[0029] Figure 1 It is the first process schematic diagram of the shooting control method in the embodiment of the present application. As Figure 1 shown, the method may specifically include:

[0030] Step 101: Obtain the environmental brightness parameter of the shooting scene;

[0031] Here, the environmental brightness parameter is a parameter used to characterize the brightness and darkness of the shooting environment. Exemplarily, the environmental brightness parameter may be the illuminance output by an environmental brightness sensor, with the unit of lux (Lux).

[0032] Step 102: Determine the target shooting mode according to the environmental brightness parameter; wherein, the target shooting mode includes at least one of the following: whether to call the automatic exposure module, the number of exposure times of the image sensor, and whether to call the artificial intelligence module for image processing;

[0033] By using the environmental brightness parameter to characterize different shooting scenes and determining whether to call the automatic exposure module, the number of exposure times of the image sensor, and whether to call the artificial intelligence module for image processing according to the environmental brightness parameter, and configuring a matching shooting mode for different shooting scenes, the switching speed can be improved during the scene switching process, making the image display effect smoother and without the phenomenon of screen jump.

[0034] Exemplarily, in some embodiments, determining the target shooting mode according to the environmental brightness parameter includes: determining the target environmental brightness level of the shooting scene according to the environmental brightness parameter; and determining the target shooting mode corresponding to the target environmental brightness level according to the preset correspondence between the environmental brightness level and the shooting mode. In practical applications, the environmental brightness of the shooting scene can be divided into different brightness levels to distinguish different shooting scenes, and matching shooting modes can be formulated for different brightness levels.

[0035] Exemplarily, the environmental brightness level can be roughly divided into the following intervals: [>300Lux], [300Lux - 200Lux], [200Lux - 100Lux], [100Lux - 50Lux], [50Lux - 10Lux], [10Lux - 5Lux], [<5Lux]. The environmental brightness level is determined according to the interval where the environmental brightness parameter is located.

[0036] Different shooting modes are pre-configured for each brightness level. Through this detailed brightness level division, the processing of each brightness level can achieve the optimal effect to balance the switching speed, image quality, and power consumption.

[0037] The target shooting mode includes at least one of the following: whether to call the automatic exposure module, the number of exposure times of the image sensor, and whether to call the artificial intelligence module for image processing;

[0038] Among them, the Automatic Exposure (AE) module is used to adjust the exposure time of the image sensor. By reducing (increasing) the exposure time, the brightness of the picture is controlled so that the picture brightness remains in a relatively stable and ideal state, thereby obtaining ideal image quality.

[0039] When the number of exposure times of the image sensor is 1, one frame of exposure image is collected for the shooting scene. When the number of exposure times of the image sensor is greater than 1, the multi-frame technology is required to "quasi-simultaneously" output multiple frames of images with different exposure times, that is, the Digital Overlap (DOL) exposure technology, and then image fusion is performed to obtain a High Dynamic Range (HDR) image. One method of HDR technology is to perform long exposure, medium exposure, and short exposure on the same shooting scene respectively, collect three frames of exposure images, and then fuse these three frames of images to finally obtain one frame of HDR image. HDR technology can also perform fusion on 2 frames of exposure images obtained by exposing the same shooting scene 2 times, or perform fusion on 2 frames of exposure images obtained by exposing 4 times. In the embodiments of the present application, the number of exposure times is flexibly selected according to the environmental brightness level of the shooting scene.

[0040] Exemplarily, in some embodiments, the first environmental brightness level corresponds to the first number of exposure times, and the second environmental brightness level corresponds to the second number of exposure times; wherein, the first environmental brightness level is higher than the second environmental brightness level, and the first number of exposure times is less than or equal to the second number of exposure times;

[0041] It can be understood that when only considering the influence of the environmental brightness level on the number of exposure times, the lower the environmental brightness level, the more the number of exposure times, and the higher the environmental brightness level, the fewer the number of exposure times. The higher the environmental brightness level indicates that the shooting scene is brighter, and the lower the environmental brightness level indicates that the shooting scene is darker. In a brighter shooting scene, it is necessary to reduce the exposure time and select fewer exposure times to ensure the image quality. In a darker shooting scene, it is necessary to increase the exposure time and select more exposure times to ensure the image quality. The rule is: exposure level

[0042] The third environmental brightness level corresponds to not invoking the artificial intelligence module for image processing, and the fourth environmental brightness level corresponds to invoking the artificial intelligence module for image processing; wherein, the third environmental brightness level is higher than the fourth environmental brightness level.

[0043] It can be understood that when only considering the influence of the environmental brightness level on whether to invoke the artificial intelligence module, the lower the environmental brightness level, the more it is necessary to invoke the artificial intelligence module to improve the image quality.

[0044] Exemplarily, in some embodiments, the artificial intelligence module includes a first neural network model and a second neural network model; the artificial intelligence module performs optimization processing on the images captured under a preset fifth environmental brightness level based on the first neural network model; the artificial intelligence module performs optimization processing on the images captured under a preset sixth environmental brightness level based on the second neural network model; wherein, the fifth environmental brightness level and the sixth environmental brightness level are different environmental brightness levels in the fourth environmental brightness level.

[0045] It can be understood that the artificial intelligence module (Artificial Intelligence, AI) performs image processing based on the neural network model to improve the image quality. When the light conditions of the shooting scene are poor, in order to ensure the image quality, it is possible to select to invoke the AI module to improve the image quality. Further, different neural network models can also be trained for different brightness levels. The lower the environmental brightness level indicates that the shooting scene is darker, the worse the image quality collected by the image sensor, and the higher the requirement for the neural network model, and vice versa. By setting different neural network models, a balance can be achieved between image quality and power consumption.

[0046] Further, the method further includes: obtaining a training sample image under a fifth environmental brightness level; training a neural network model with the training sample image under the fifth environmental brightness level to obtain a first neural network model; obtaining a training sample image under a sixth environmental brightness level; training a neural network model with the training sample image under the sixth environmental brightness level to obtain a second neural network model.

[0047] Exemplarily, in some embodiments, when considering the influence of the environmental brightness level on the number of exposure times and whether to call the artificial intelligence module at the same time, if the artificial intelligence module is not called, the rule that the lower the environmental brightness level, the more exposure times, and the higher the environmental brightness level, the fewer exposure times is also followed. If the artificial intelligence module is called, the number of exposure times can be reduced first, and then the rule that the lower the environmental brightness level, the more exposure times, and the higher the environmental brightness level, the fewer exposure times is followed.

[0048] Exemplarily, the environmental brightness level can be roughly divided into the following intervals: [>300Lux], [300Lux - 200Lux], [200Lux - 100Lux], [100Lux - 50Lux], [50Lux - 10Lux], [10Lux - 5Lux], [<5Lux]. The corresponding relationship between the environmental brightness level and the shooting mode is as follows:

[0049] a) Above 300Lux: Do not call the AI module, the sensor uses 1DOL, and only call the AE module to perform scene switching.

[0050] b) 300Lux - 200Lux: Do not call the AI module, perform DOL switching, switch 1DOL to 2DOL and cooperate with the AE module to perform scene switching. In this scenario, the sensor uses 2DOL and cooperates with the AE module to perform scene switching. Compared with the sensor using 1DOL and cooperating with the AE module to perform scene switching, the convergence time of the AE algorithm is shorter and the scene switching speed is faster.

[0051] c) 200Lux - 100Lux: Do not call the AI module, perform DOL switching, switch from 2DOL to 3DOL, and cooperate with the AE module to perform scene switching. In this scenario, the sensor uses 3DOL and cooperates with the AE module to perform scene switching. Compared with the sensor using 2DOL and cooperating with the AE module to perform scene switching, the convergence time of the AE algorithm is shorter and the scene switching speed is faster. Among them, [>300Lux], [300Lux - 200Lux] and [200Lux - 100Lux] can be understood as the third environmental brightness level without calling the AI module. At these three environmental brightness levels, as the environmental brightness level decreases, the number of selected exposure times increases.

[0052] d) 100 Lux to 50 Lux: Below this brightness environment, the ambient light is already relatively low. Simply configuring the sensor cannot complete the switching within a short time. Therefore, in this scenario, the AI module enables the Super Night (SN) model (a neural network model specifically trained for low-light scenarios) for image processing. Using 1DOL and cooperating with the call of the AE module can quickly complete seamless switching. Using the AE module only changes the image brightness and cannot improve the detailed image quality. In the embodiments of the present application, the AE module is combined with the AI module and DOL switching, which can improve the switching speed and effectively improve the image quality.

[0053] e) 50 Lux to 10 Lux: Enable the SN model, switch the sensor to 2DOL, and cooperate with the call of the AE module to complete the scene switching.

[0054] f) 10 Lux to 5 Lux: Enable the SN model, switch the sensor to 3DOL, and call the AE module to complete the scene switching. Among them, the SN model can be understood as the first neural network model. The fifth ambient brightness level includes three ambient brightness levels: [100 Lux to 50 Lux], [50 Lux to 10 Lux], and [10 Lux to 5 Lux].

[0055] g) Below 5 Lux: In this scenario, the ambient light is so weak that most switching strategies cannot be completed quickly. Therefore, in this scenario, the AI module enables the Ultra dark (UD) model (a neural network model specifically trained for this ultra-dark scenario), switches the sensor to 2DOL, and cooperates with the call of the AE module. Combining these three strategies can complete the scene switching within a short time. Among them, the UD model can be the second neural network model. The sixth ambient brightness level includes: below 5 Lux.

[0056] Exemplarily, in some embodiments, when the ambient brightness level changes, according to the correspondence between the preset ambient brightness level and the shooting mode, the target shooting mode corresponding to the target ambient brightness level is determined.

[0057] Step 104: Switch the shooting mode to the target shooting mode.

[0058] Exemplarily, the operation process of the target shooting mode includes: calling the Automatic Exposure (AE) module to determine the exposure time of the image sensor; controlling the image sensor to collect at least one frame of shooting image based on the exposure time and the number of exposures; calling the Image Signal Processor (ISP) to perform image processing on the at least one frame of shooting image;

[0059] When the target shooting mode includes calling an artificial intelligence module for image processing, the switching the shooting mode to the target shooting mode further includes: calling the artificial intelligence module to perform image processing on the output image of the image signal processing module.

[0060] Exemplarily, the process of calling the AE module to determine the exposure time of the image sensor is as follows:

[0061] 1. The ISP calculates the brightness statistical value of each frame of image;

[0062] 2. Call the AE module to calculate a possible exposure time based on the brightness statistical value and configure it to the sensor;

[0063] 3. The sensor will apply the exposure time calculated in the previous step when collecting the next frame of image;

[0064] 4. Repeat the above steps 1, 2, and 3 until the AE algorithm converges to obtain a stable exposure time, and the sensor uses this exposure time to collect images in the current shooting scene.

[0065] It should be noted that when the shooting scene changes, that is, when the ambient brightness level changes, the scene switching is performed to call the AE module to repeat the above steps 1, 2, 3, and 4 to obtain the exposure time in the new shooting scene.

[0066] Exemplarily, the controlling the image sensor to collect at least one frame of shooting image based on the exposure time and the number of exposures includes: when the number of exposures is one, controlling the image sensor to perform one exposure to collect one frame of image according to the exposure time; when the number of exposures is at least two, obtaining the exposure times corresponding to at least two exposures according to the exposure time; controlling the image sensor to perform at least two exposures to collect at least two frames of images according to the at least two exposure times.

[0067] Exemplarily, when the number of exposures is at least two, call the ISP to fuse at least two frames of shooting images to obtain an HDR image.

[0068] It should be noted that when the current shooting mode is different from the target shooting mode, the current shooting mode is switched to the target shooting mode. Exemplarily, when the user holds the mobile phone to take pictures and enters a shooting scene with an ambient light intensity ranging from 300 Lux to 200 Lux from a shooting scene with an ambient light intensity above 300 Lux, the shooting mode is switched from 1DOL and the AE module is called to 2DOL and the AE module is called.

[0069] With the above technical solution, the ambient light intensity of the shooting scene is divided into different light intensity levels to distinguish different shooting scenes, and a matching shooting mode is formulated for different levels. Compared with only using the AE algorithm for scene switching, the embodiment of the present application coordinates the selection of the number of exposures and the AI module, and can improve the switching speed and ensure the image quality during the scene switching process.

[0070] In order to better illustrate the purpose of the present application, based on the above embodiments of the present application, further examples are given, such as Figure 2 As shown, the method specifically includes:

[0071] Step 201: Obtain a first ambient light intensity parameter collected by a first light sensor and a second ambient light intensity parameter collected by a second light sensor; wherein, the first light sensor and the second light sensor have opposite position orientations;

[0072] Here, an electronic device (such as a mobile phone, a tablet computer, a smart watch, etc.) includes a front camera device and a rear camera device. The first light sensor is on the same side as the front camera device, and the light sensor serving as the front camera is used to implement the shooting of the front camera. The second light sensor is on the same side as the rear camera device, and the light sensor serving as the rear camera is used to implement the shooting of the rear camera. In practical applications, the camera device can be a front camera device or a rear camera device.

[0073] Figure 3 For the schematic diagram of the shooting scene change in the embodiment of the present application, as Figure 3 As shown, when the user holds the electronic device and uses the rear camera device to take pictures, generally, the rear camera device faces the shooting object, the front camera device faces the user, and there are differences in the ambient light intensity parameters collected by the front and rear light sensors.

[0074] Step 202: Calculate the difference between the first ambient light intensity parameter and the second ambient light intensity parameter;

[0075] The difference ΔL between the first ambient light intensity parameter and the second ambient light intensity parameter is ΔL = L1 - L2. In practical applications, ΔL can be an unsigned absolute value or a signed value.

[0076] Such as Figure 3As shown, when the difference ΔL is the unsigned absolute value, the user holds the electronic device and enters from a bright scene into a dark scene. As ΔL decreases from large to small and approaches 0, the user holds the electronic device and enters from a bright scene into a dark scene. As ΔL decreases from large to small and approaches 0.

[0077] When the difference ΔL is a signed value, the user holds the electronic device and enters from a bright scene into a dark scene. As ΔL decreases from large to small and approaches 0, the user holds the electronic device and enters from a bright scene into a dark scene. As ΔL increases from small to large and approaches 0.

[0078] Step 203: When the difference is greater than the first threshold and the difference is continuously decreasing, switch the shooting mode to a preset first shooting mode;

[0079] Exemplarily, the first shooting mode includes calling the automatic exposure module, the number of exposure times of the image sensor is 2 times, and the artificial intelligence module is not called for image processing.

[0080] It can be understood that switching to the first shooting mode can be understood as an early switching operation. When the shooting scene changes violently, but the shooting mode does not meet the switching conditions, the shooting mode can be switched to the first shooting mode first. When the shooting scene is stable, the target environmental brightness level is determined according to the environmental brightness parameters, and then the shooting mode is switched from the first shooting mode to the target shooting mode, so that the image display effect is more fluent and there will be no picture jump.

[0081] The first shooting mode can also be understood as an intermediate shooting mode between the current shooting mode and the target shooting mode. If the brightness difference obtained by the front and rear light brightness sensors is large and the brightness difference is continuously decreasing (including from bright to dark and from dark to bright), it indicates that the current scene may be a violently changing scene. Using the front and rear brightness sensors to collect environmental brightness parameters can detect scenes with violent changes. For such scenes, the shooting mode is first switched to the first shooting mode and then to the target shooting mode, which solves the problem of the image brightness mutation and the unsmooth display effect when directly switching to the target shooting mode.

[0082] Step 204: When the difference is less than the second threshold, determine the target environmental brightness level according to the first environmental brightness parameter and / or the second environmental brightness parameter;

[0083] Wherein, the first threshold is greater than the second threshold. In practical applications, the first threshold is much greater than the second threshold. The first threshold is used to judge whether the shooting scene changes violently, and the second threshold is used to judge whether the shooting scene tends to be stable. When the difference is less than the second threshold, it indicates that the shooting scene tends to be stable, and the target environmental brightness level of the shooting scene can be determined, and then switched to the target shooting mode matching the shooting scene.

[0084] Exemplarily, the first threshold is 300 Lux, 500 Lux, 700 Lux, etc., and the second threshold is 50 Lux, 30 Lux, etc.

[0085] Exemplarily, in some embodiments, when the front camera device is started for shooting, the target ambient brightness level is determined according to the first ambient brightness parameter; when the rear camera device is started for shooting, the target ambient brightness level is determined according to the second ambient brightness parameter; the average value of the first ambient brightness parameter and the second ambient brightness parameter is calculated, and the target ambient brightness level is determined according to the average value; or, the weighted value of the first ambient brightness parameter and the second ambient brightness parameter is calculated, and the target ambient brightness level is determined according to the weighted value.

[0086] Step 205: Determine the target shooting mode corresponding to the target ambient brightness level according to the correspondence between the preset ambient brightness level and the shooting mode;

[0087] Wherein, the shooting mode includes: calling the automatic exposure module, the number of exposure times of the image sensor, and whether to call the artificial intelligence module for image processing;

[0088] Step 206: Switch the shooting mode to the target shooting mode.

[0089] To better illustrate the purpose of the present application, on the basis of the above embodiments of the present application, further examples are given, such as Figure 4 As shown, the method specifically includes:

[0090] Step 401: Determine the target ambient brightness level of the shooting scene according to the ambient brightness parameter of the shooting scene;

[0091] Step 402: Determine the target shooting mode corresponding to the target ambient brightness level according to the correspondence between the preset ambient brightness level and the shooting mode;

[0092] Wherein, the target shooting mode includes at least one of the following: whether to call the automatic exposure module, the number of exposure times of the image sensor, and whether to call the artificial intelligence module for image processing.

[0093] Step 403: Switch the shooting mode to the target shooting mode, and control the display device to display the first image generated in the target shooting mode;

[0094] Step 404: Control the display device to display the second image generated in the second shooting mode;

[0095] The target shooting mode is a shooting mode matched according to the environmental brightness level of the shooting scene. The second shooting mode can be understood as a shooting mode different from the target shooting mode. In the display interface, in addition to displaying the first image generated in the target shooting mode, the second image generated in other shooting modes can also be displayed. The user can modify the shooting mode corresponding to the brightness level according to their own preferences, allowing the user to also participate in the process of scene switching, so that the image effect in the current shooting scene matches the user's needs.

[0096] In practical applications, the display interface can display the image generated in one shooting mode or the images generated in multiple shooting modes.

[0097] Exemplarily, in some embodiments, controlling the display device to display the second image generated in the second shooting mode includes: controlling the display device to display an adjustment icon for adjusting the shooting mode; when obtaining the adjustment operation of the user for the adjustment icon, obtaining the second shooting mode, and controlling the display device to display the second image generated in the second shooting mode.

[0098] That is to say, in order to facilitate the adjustment of the shooting mode, different shooting modes can be displayed graphically. The user switches the shooting mode by operating the adjustment icon, so as to select the desired shooting mode.

[0099] Figure 5 Schematic diagram of the display interface in the embodiments of the present application Figure 1 , such as Figure 5 shown, a slider is displayed on the display interface of the display device. The user switches the shooting mode by dragging the slider, and the corresponding image in the shooting mode will be synchronously displayed on the display interface. The user selects whether to modify the shooting mode corresponding to the current level according to the image display effect.

[0100] Multiple images corresponding to different shooting modes can be simultaneously displayed on the display interface for display effect comparison to help the user select the desired shooting mode from them. Figure 6 Schematic diagram of the display interface in the embodiments of the present application Figure 2 , such as Figure 6 shown, the images generated in 6 shooting modes at the same moment in the current shooting scene are displayed on the display interface of the display device.

[0101] Step 405: When obtaining the confirmation operation of the user for the second shooting mode, use the second shooting mode as the shooting mode corresponding to the target environmental brightness level in the corresponding relationship.

[0102] It should be noted that the user's adjustment of the shooting mode is not limited to the process of taking pictures or videos. When the user adjusts photos or videos through the album, the operation of the user's adjustment of the shooting mode can be recorded and saved in the same way. In subsequent photo-taking and video-recording, the previous user selections can be referenced to customize the shooting mode for the user.

[0103] The shooting control method provided in the embodiments of the present application is applied to an electronic device with a shooting function. The electronic device may include, for example, a mobile phone, a tablet computer, a laptop computer, a handheld computer, a personal digital assistant (Personal Digital Assistant, PDA), a portable media player (Portable Media Player, PMP), a wearable device, a camera, etc.

[0104] In summary, the shooting control method provided in the embodiments of the present application has the following advantages:

[0105] 1. Short switching time. The DOL switching is combined with the call of the AE module, which can accelerate the scene switching speed.

[0106] 2. Higher image quality. Using the AE algorithm only changes the image brightness and cannot improve the image quality of details. Combining the AE module with the AI module and DOL switching can improve the switching speed and effectively improve the image quality. At the same time, a UI interface that can be selected by the user is added to make the image more in line with the user's preferences.

[0107] 3. Optimized power consumption. The traditional single strategy has excessive power consumption in some scenarios. The embodiments of the present application select different shooting modes for different brightness levels, giving full play to the functions of each shooting mode to balance the switching speed, image quality, and power consumption.

[0108] 4. Smoother scene transition. By dividing the scene switching into different brightness levels, and the shooting modes used between each brightness level have very small differences. Compared with the scheme of switching between shooting modes with large differences, the embodiments of the present application achieve seamless switching through multiple levels, making the entire scene switching process smoother.

[0109] To implement the method of the embodiments of the present application, based on the same inventive concept, the embodiments of the present application also provide a shooting control device, as Figure 7 shown. The shooting control device 70 includes:

[0110] An acquisition unit 701, configured to acquire the environmental brightness parameter of the shooting scene;

[0111] A determination unit 702, configured to determine a target shooting mode according to the environmental brightness parameter; wherein, the target shooting mode includes at least one of the following: whether to call an automatic exposure module, the number of exposure times of an image sensor, and whether to call an artificial intelligence module for image processing;

[0112] A control unit 703, configured to switch the shooting mode to the target shooting mode.

[0113] In some embodiments, the determination unit 702 is configured to determine a target environmental brightness level of the shooting scene according to the environmental brightness parameter; and determine a target shooting mode corresponding to the target environmental brightness level according to a corresponding relationship between a preset environmental brightness level and a shooting mode.

[0114] In some embodiments, a first environmental brightness level corresponds to a first number of exposure times, and a second environmental brightness level corresponds to a second number of exposure times; wherein, the first environmental brightness level is higher than the second environmental brightness level, and the first number of exposure times is less than or equal to the second number of exposure times;

[0115] A third environmental brightness level corresponds to not calling the artificial intelligence module for image processing, and a fourth environmental brightness level corresponds to calling the artificial intelligence module for image processing; wherein, the third environmental brightness level is higher than the fourth environmental brightness level.

[0116] In some embodiments, the artificial intelligence module includes a first neural network model and a second neural network model;

[0117] The artificial intelligence module performs optimization processing on an image captured under a preset fifth environmental brightness level based on the first neural network model;

[0118] The artificial intelligence module performs optimization processing on an image captured under a preset sixth environmental brightness level based on the second neural network model;

[0119] Wherein, the fifth environmental brightness level and the sixth environmental brightness level are different environmental brightness levels in the fourth environmental brightness level.

[0120] In some embodiments, an acquisition unit 701 is configured to acquire a first environmental brightness parameter collected by a first brightness sensor and a second environmental brightness parameter collected by a second brightness sensor; wherein, the first brightness sensor and the second brightness sensor have opposite position orientations;

[0121] The determination unit 702 is configured to, when a difference between the first environmental brightness parameter and the second environmental brightness parameter is greater than a first threshold and the difference is continuously decreasing, trigger the control unit 703 to switch the shooting mode to a preset first shooting mode;

[0122] A determination unit 702, configured to determine the target ambient brightness level according to the first ambient brightness parameter and / or the second ambient brightness parameter when the difference between the first ambient brightness parameter and the second ambient brightness parameter is less than a second threshold, where the first threshold is greater than the second threshold.

[0123] In some embodiments, the first shooting mode includes invoking an automatic exposure module, the number of exposure times of the image sensor is 2 times, and the artificial intelligence module is not invoked for image processing.

[0124] In some embodiments, a control unit 703 is further configured to control a display device to display a first image generated in the target shooting mode; control the display device to display a second image generated in a second shooting mode; and when obtaining a confirmation operation of the user for the second shooting mode, use the second shooting mode as the shooting mode corresponding to the target ambient brightness level in the corresponding relationship.

[0125] In some embodiments, a control unit 703 is configured to control the display device to display an adjustment icon for adjusting the shooting mode; when obtaining an adjustment operation of the user for the adjustment icon, obtain the second shooting mode, and control the display device to display a second image generated in the second shooting mode.

[0126] Based on the hardware implementation of each unit in the foregoing shooting control device, an embodiment of the present application further provides an electronic device, as Figure 8 shown, the electronic device 80 includes: a processor 801 and a memory 802 configured to store a computer program that can run on the processor;

[0127] Wherein, when the processor 801 is configured to run the computer program, it executes the method steps in the foregoing embodiments.

[0128] Of course, in practical applications, as Figure 8 shown, each component in the electronic device is coupled together through a bus system 803. It can be understood that the bus system 803 is used to realize the connection and communication between these components. In addition to including a data bus, the bus system 803 further includes a power bus, a control bus, and a status signal bus. However, for the sake of clear illustration, various buses are labeled as the bus system 803 in the figure.

[0129] In practical applications, the above-mentioned processor may be at least one of an application-specific integrated circuit (ASIC), a digital signal processing device (DSPD), a programmable logic device (PLD), a field-programmable gate array (FPGA), a controller, a microcontroller, and a microprocessor. It can be understood that for different devices, the electronic devices for implementing the functions of the above-mentioned processor may also be others, and the embodiments of the present application do not make specific limitations.

[0130] The above-mentioned memory may be a volatile memory, such as a random-access memory (RAM); or a non-volatile memory, such as a read-only memory (ROM), a flash memory, a hard disk drive (HDD), or a solid-state drive (SSD); or a combination of the above types of memories, and provides instructions and data to the processor.

[0131] In practical applications, the above-mentioned device may be an electronic device or a chip applied to an electronic device. In the present application, the device can implement the functions of multiple units through software, hardware, or a combination of software and hardware, so that the device can execute the shooting control method provided in any of the above embodiments. And the technical effects of the technical solutions of the device can refer to the technical effects of the corresponding technical solutions in the shooting control method, and the present application will not elaborate on this one by one.

[0132] In an exemplary embodiment, the embodiments of the present application also provide a computer-readable storage medium, such as a memory including a computer program, and the computer program can be executed by a processor of an electronic device to complete the steps of the foregoing method.

[0133] The embodiments of the present application also provide a computer program product, including computer program instructions.

[0134] Optionally, the computer program product can be applied to the electronic device in the embodiments of the present application, and the computer program instructions cause the computer to execute the corresponding processes implemented by the electronic device in the various methods of the embodiments of the present application. For the sake of brevity, it will not be elaborated here.

[0135] The embodiments of the present application also provide a computer program.

[0136] Optionally, the computer program can be applied to the electronic device in the embodiments of the present application. When the computer program runs on a computer, it causes the computer to execute the corresponding processes implemented by the electronic device in the various methods of the embodiments of the present application. For the sake of brevity, it will not be elaborated here.

[0137] It should be understood that in the embodiments of the present application, regarding data such as user information, when the embodiments of the present application are applied to specific products or technologies, user permission or consent needs to be obtained, and the collection, use, and processing of relevant data need to comply with the relevant laws, regulations, and standards of relevant countries and regions.

[0138] It should be understood that the terms used in the present application are only for the purpose of describing specific embodiments and are not intended to limit the present application. The singular forms of "a", "the", and "said" used in the present application and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more of the associated listed items. The expressions "has", "may have", "includes", "contains", or "may include" and "may contain" used in the present application can be used to indicate the existence of corresponding features (such as elements such as numerical values, functions, operations, or components), but do not exclude the existence of additional features.

[0139] It should be understood that although the terms first, second, third, etc. may be used in the present application to describe various information, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other and do not have to be used to describe a specific order or sequence. For example, without departing from the scope of the present invention, the first information can also be called the second information, and similarly, the second information can also be called the first information.

[0140] Among the technical solutions described in the embodiments of the present application, they can be arbitrarily combined without conflict.

[0141] In the several embodiments provided by the present application, it should be understood that the disclosed methods, devices, and equipment can be implemented in other ways. The embodiments described above are only illustrative. For example, the division of units is only a logical function division, and there can be other division methods in actual implementation. For example, multiple units or components can be combined, or can be integrated into another system, or some features can be ignored, or not executed. In addition, the coupling, direct coupling, or communication connection between the various components shown or discussed with each other can be through some interfaces, and the indirect coupling or communication connection of devices or units can be electrical, mechanical, or other forms.

[0142] The units described above as separate components may or may not be physically separated. The components shown as units may or may not be physical units, that is, they may be located in one place or distributed over multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0143] In addition, each functional unit in the embodiments of the present application may be fully integrated in a processing unit, or each unit may be separately regarded as a unit, or two or more units may be integrated in one unit. The above-mentioned integrated units may be implemented in the form of hardware, or in the form of a combination of hardware and software functional units.

[0144] As mentioned above, the above are only specific embodiments of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art within the technical scope disclosed in the present application can easily think of changes or substitutions, which should all be covered by the protection scope of the present application.

Claims

1. A shooting control method, characterized in that, the method includes: Obtaining the environmental brightness parameter of the shooting scene; Determining the target shooting mode according to the environmental brightness parameter; wherein, the target shooting mode includes at least one of the following: calling the automatic exposure module, the number of exposure times of the image sensor, and whether to call the artificial intelligence module for image processing; Switching the shooting mode to the target shooting mode; Among them, the determining the target shooting mode according to the environmental brightness parameter includes: Determining the target environmental brightness level of the shooting scene according to the environmental brightness parameter; Determining the target shooting mode corresponding to the target environmental brightness level according to the corresponding relationship between the preset environmental brightness level and the shooting mode; The first environmental brightness level corresponds to the first exposure number, and the second environmental brightness level corresponds to the second exposure number; wherein, the first environmental brightness level is higher than the second environmental brightness level, and the first exposure number is less than or equal to the second exposure number; The third environmental brightness level corresponds to not calling the artificial intelligence module for image processing, and the fourth environmental brightness level corresponds to calling the artificial intelligence module for image processing; wherein, the third environmental brightness level is higher than the fourth environmental brightness level; when the third environmental brightness level includes multiple environmental brightness levels, the lower the environmental brightness level in the third environmental brightness level, the more exposure times are selected, and when the fourth environmental brightness level includes multiple environmental brightness levels, the lower the environmental brightness level in the fourth environmental brightness level, the more exposure times are selected; Under similar environmental brightness levels, the exposure number corresponding to calling the artificial intelligence module is less than the exposure number corresponding to not calling the artificial intelligence module.

2. The method according to claim 1, characterized in that, the artificial intelligence module includes a first neural network model and a second neural network model; The artificial intelligence module optimizes the image captured under the preset fifth environmental brightness level based on the first neural network model; The artificial intelligence module optimizes the image captured under the preset sixth environmental brightness level based on the second neural network model; Among them, the fifth environmental brightness level and the sixth environmental brightness level are different environmental brightness levels in the fourth environmental brightness level.

3. The method according to claim 1, characterized in that, the obtaining the environmental brightness parameter of the shooting scene includes: Obtaining the first environmental brightness parameter collected by the first brightness sensor and the second environmental brightness parameter collected by the second brightness sensor; wherein, the positions and orientations of the first brightness sensor and the second brightness sensor are opposite; The determining the target shooting mode according to the environmental brightness parameter further includes: When the difference between the first environmental brightness parameter and the second environmental brightness parameter is greater than the first threshold and the difference is continuously decreasing, switching the shooting mode to the preset first shooting mode; When the difference between the first environmental brightness parameter and the second environmental brightness parameter is less than the second threshold, determine the target environmental brightness level according to the first environmental brightness parameter and / or the second environmental brightness parameter; wherein, the first threshold is greater than the second threshold.

4. The method according to claim 3, wherein, the first shooting mode includes: calling the automatic exposure module, the number of exposure times of the image sensor is 2 times, and not calling the artificial intelligence module for image processing.

5. The method according to claim 1, wherein, the method further includes: controlling a display device to display a first image generated in the target shooting mode; controlling the display device to display a second image generated in a second shooting mode; when obtaining a confirmation operation of the user for the second shooting mode, taking the second shooting mode as the shooting mode corresponding to the target environmental brightness level in the corresponding relationship.

6. The method according to claim 5, wherein, the controlling the display device to display the second image generated in the second shooting mode includes: controlling the display device to display an adjustment icon for adjusting the shooting mode; when obtaining an adjustment operation of the user for the adjustment icon, obtaining the second shooting mode and controlling the display device to display the second image generated in the second shooting mode.

7. A shooting control device, wherein, the device includes: an obtaining unit, configured to obtain an environmental brightness parameter of a shooting scene; a determining unit, configured to determine a target shooting mode according to the environmental brightness parameter; wherein, the target shooting mode includes at least one of the following: calling an automatic exposure module, the number of exposure times of an image sensor, and whether to call an artificial intelligence module for image processing; a control unit, configured to switch the shooting mode to the target shooting mode; wherein, the determining unit is specifically configured to determine the target environmental brightness level of the shooting scene according to the environmental brightness parameter; and determine the target shooting mode corresponding to the target environmental brightness level according to a corresponding relationship between a preset environmental brightness level and a shooting mode; the first environmental brightness level corresponds to a first exposure number, and the second environmental brightness level corresponds to a second exposure number; wherein, the first environmental brightness level is higher than the second environmental brightness level, and the first exposure number is less than or equal to the second exposure number; the third environmental brightness level corresponds to not calling the artificial intelligence module for image processing, and the fourth environmental brightness level corresponds to calling the artificial intelligence module for image processing; wherein, the third environmental brightness level is higher than the fourth environmental brightness level; when the third environmental brightness level includes multiple environmental brightness levels, the lower the environmental brightness level in the third environmental brightness level, the more exposure times are selected, and when the fourth environmental brightness level includes multiple environmental brightness levels, the lower the environmental brightness level in the fourth environmental brightness level, the more exposure times are selected; in similar environmental brightness levels, the exposure number corresponding to calling the artificial intelligence module is less than the exposure number corresponding to not calling the artificial intelligence module.

8. An electronic device, characterized in that, the electronic device includes: a processor and a memory configured to store a computer program that can run on the processor, wherein, when the processor is configured to run the computer program, it executes the steps of the method according to any one of claims 1 to 6.

9. A computer-readable storage medium, on which a computer program is stored, characterized in that, when the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 6.

Images