Shooting control method and device

Abstract

The invention discloses a shooting control method and device. Belongs to the technical field of communication. The method comprises the following steps: in a video shooting process, acquiring depth information of a shooting scene and motion characteristics of a motion object in a shooting picture; determining a frame rate of video shooting based on the depth information and the motion features; determining a first light parameter based on the frame rate, the ambient light parameter and the distance from the target shooting object to the electronic equipment; and shooting based on the first light parameter.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of communication technologies, and particularly to a shooting control method and apparatus thereof. Background Art

[0002] With the continuous improvement of the hardware performance of terminal devices, more and more users are accustomed to shooting videos through the camera function provided by the terminal devices. Before shooting a video, it is usually necessary to perform shooting settings automatically or manually to adapt to the current shooting scene.

[0003] In the prior art, fixed shooting settings are usually adopted during video shooting, that is, the shooting settings cannot be dynamically adjusted according to the real-time environment during video shooting. In a dynamically changing shooting scene, problems such as blurring or insufficient exposure are likely to occur, resulting in poor video shooting quality. Summary of the Invention

[0004] The purpose of the embodiments of the present application is to provide a shooting control method and apparatus thereof, which can dynamically adjust shooting parameters according to the environment during video shooting and improve the imaging quality of video shooting.

[0005] In a first aspect, the embodiments of the present application provide a shooting control method, which is executed by an electronic device. The method includes: during video shooting, obtaining depth information of the shooting scene and motion characteristics of a moving object in the shooting frame; determining the frame rate of video shooting based on the depth information and the motion characteristics; determining a first lighting parameter based on the frame rate, ambient light parameters, and the distance from the target shooting object to the electronic device; and performing shooting based on the first lighting parameter.

[0006] In a second aspect, the embodiments of the present application provide a shooting control apparatus. The apparatus includes: an obtaining unit, configured to obtain depth information of the shooting scene and motion characteristics of a moving object in the shooting frame during video shooting; a first determining unit, configured to determine the frame rate of video shooting based on the depth information and the motion characteristics; a second determining unit, configured to determine a first lighting parameter based on the frame rate, ambient light parameters, and the distance from the target shooting object to the electronic device; and a shooting unit, configured to perform shooting based on the first lighting parameter.

[0007] In a third aspect, the embodiments of the present application provide an electronic device. The electronic device includes a processor and a memory. The memory stores a program or instruction that can run on the processor. When the program or instruction is executed by the processor, the steps of the method described in the first aspect are implemented.

[0008] Fourthly, an embodiment of the present application provides a readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the method described in the first aspect above are implemented.

[0009] Fifthly, an embodiment of the present application provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor, and the processor is configured to run a program or an instruction to implement the method described in the first aspect.

[0010] Sixthly, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.

[0011] In the embodiment of the present application, during video shooting, depth information of the shooting scene and motion characteristics of a moving object in the shooting picture are first obtained, and then the frame rate of video shooting is determined based on the depth information and the motion characteristics. After that, based on the frame rate, ambient light parameters, and the distance from the target shooting object to the electronic device, a first lighting parameter is determined, and thus shooting is performed based on the first lighting parameter. On the one hand, since the depth information and the motion characteristics can comprehensively reflect the characteristics of the current shooting scene, setting the frame rate based on this can perform intelligent and dynamic frame rate control according to the environment and the objects in the picture during video shooting, ensuring that the best picture quality can be obtained in real time in a dynamically changing shooting scene. On the other hand, since the determination process of the first lighting parameter comprehensively considers the frame rate, ambient light parameters, and the distance from the target shooting object to the electronic device, intelligent and dynamic fill light control can be performed according to the environment and the position of the target shooting object during video shooting, ensuring that the best picture quality can be obtained in real time in a dynamically changing shooting scene. Therefore, the shooting parameters can be dynamically adjusted according to the environment during video shooting, improving the imaging quality of video shooting. Description of the Drawings

[0012] Figure 1 is one of the flowcharts of the shooting control method provided by the embodiment of the present application;

[0013] Figure 2 is the second flowchart of the shooting control method provided by the embodiment of the present application;

[0014] Figure 3 is the structural schematic diagram of the shooting control device provided by the embodiment of the present application;

[0015] Figure 4 is the structural schematic diagram of the electronic device provided by the embodiment of the present application;

[0016] Figure 5 is the hardware structural schematic diagram of the electronic device suitable for implementing the embodiment of the present application. Specific implementation manners

[0017] The technical solutions in the embodiments of the present application will be clearly described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art belong to the scope of protection of the present application.

[0018] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, rather than to describe a specific order or sequence. It should be understood that such terms can be interchanged under appropriate circumstances so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are usually of the same type, and the number of objects is not limited. For example, the first object can be one or multiple. In addition, "and / or" in the specification and claims means at least one of the connected objects, and the character " / " generally indicates an "or" relationship between the associated objects before and after.

[0019] The shooting control method and device provided in the embodiments of the present application will be described in detail below with reference to the accompanying drawings, through specific embodiments and their application scenarios.

[0020] Please refer to Figure 1 , which shows one of the flowcharts of the shooting control method provided in the embodiments of the present application. The shooting control method provided in the embodiments of the present application can be applied to an electronic device. In practice, the above-mentioned electronic device can be various electronic devices with a shooting function, such as a smart phone, a tablet computer, a laptop computer, a wearable device, etc.

[0021] The flow of the shooting control method provided in the embodiments of the present application includes the following steps:

[0022] Step 101, during video shooting, obtain the depth information of the shooting scene and the motion characteristics of the moving objects in the shooting picture.

[0023] In this embodiment, depth information can be used to describe the distance of an object in the picture from the electronic device. The depth information can be obtained through a binocular vision sensor array. The binocular vision sensor array is a sensor that simulates the principle of human binocular vision. It captures images simultaneously through two groups of cameras and calculates the parallax to obtain depth information. Specifically, the binocular vision sensor array can be first used to capture the images of the shooting scene in real time. The left and right cameras work synchronously to obtain two parallax images. Then, through the binocular parallax algorithm, the corresponding pixel points of the two images are matched, and the parallax value of each pixel point is calculated, thereby generating a depth information map. The depth information map is stored in the form of a grayscale image, and the grayscale value is inversely proportional to the distance of the object from the electronic device. The information in the depth information map is the depth information.

[0024] In this embodiment, motion features can be used to describe the motion direction and speed of a moving object between consecutive video frames. The moving object is an object in a moving state, that is, a non-stationary object. The motion features can be calculated by the optical flow method. The optical flow method is a computer vision technology used to analyze the motion of pixel points in a continuous image sequence to determine the motion direction and speed of an object. Specifically, the optical flow field of pixel points between the current video frame and the previous video frame can be first calculated to obtain the motion direction and speed of each pixel point, that is, the displacement vector. Then, the optical flow field is analyzed to extract the contour and motion parameters of the moving object.

[0025] Exemplarily, assume that during a football game, the electronic device is aimed at the football field for shooting. The images of the players and the football on the field can be captured through the binocular vision sensor array, and the depth information map can be obtained through parallax calculation to distinguish the players in the foreground and the stands in the background. At the same time, the motion vectors of the players and the football are calculated by the optical flow method to obtain their motion directions and speeds. By integrating the depth information and motion features, the positions, depths, motion states, etc. of various objects on the field can be described in detail, providing a data basis for subsequent frame rate determination.

[0026] Through the depth information, the distribution of objects in space and their distances from the electronic device can be determined; through the motion features, the motion trend and speed of objects can be determined. By obtaining the depth information and motion features, the current shooting scene can be accurately described, laying a data foundation for intelligent adjustment of shooting parameters.

[0027] Optionally, based on the binocular disparity algorithm, a motion compensation mechanism can be combined to obtain the depth information of the captured scene. Specifically, a double-buffer architecture can be adopted to optimize the data processing flow. The front buffer performs the original disparity calculation based on the binocular disparity algorithm and uses a matching algorithm based on SAD (Sum of Absolute Differences) to obtain a preliminary depth map. The back buffer corrects the data by combining the attitude data of the IMU (Inertial Measurement Unit) sensor and compensates for the jitter effect of the device through a Kalman filter model. By introducing the motion compensation mechanism and the double-buffer processing architecture, and combining the IMU sensor to eliminate the jitter effect of the device, the stability of binocular disparity calculation is improved.

[0028] Furthermore, for fast-moving objects, since the traditional binocular matching method may have depth jumps at the object edges, resulting in discontinuous disparity values, in the area where the gradient change exceeds 15% of the pixels, a ToF (Time of Flight) sensor can be used for auxiliary ranging to control the measurement error within ±3%, thereby improving the accuracy of depth estimation.

[0029] Optionally, an improved Farneback dense optical flow algorithm can be used to calculate the motion features, and a motion vector field can be constructed in the HSV (Hue, Saturation, Value) color space. First, the local image gradient is calculated through the second-order Gaussian partial derivative, and a motion vector estimation matrix is constructed based on the local pattern of the feature points. Then, the range from 0.5 to 5 meters can be used as the effective detection range. The area corresponding to the depth level from 0.5 to 1.5 meters is used as the near-view area, the area corresponding to the depth level from 1.5 to 3 meters is used as the mid-view area, and the area corresponding to the depth level from 3 to 5 meters is used as the far-view area. For the near-view area, in order to improve the recognition accuracy of high-speed moving objects, a detection grid of 8×8 pixels can be used, and an average filtering window of 0.1 second can be set to reduce instantaneous noise interference. For the far-view area, a detection grid of 16×16 pixels can be adopted, and a filtering window of 0.3 second can be set to reduce the misjudgment rate of the motion of distant objects. Based on the optical flow calculation results, a motion speed classification standard can be established, and the speed range is divided into a static range [0, 0.2) m / s, a low-speed range [0.2, 1) m / s, a medium-speed range [1, 2) m / s, and a high-speed range [2, +∞) m / s. The improved Farneback dense optical flow algorithm combines the HSV color space to optimize the motion vector calculation, enabling adaptive tracking strategies for moving objects at different distances and improving the ability to extract depth information in dynamic scenes.

[0030] Optionally, in order to improve the dynamic adaptability of depth measurement, a trajectory prediction method can be used to correct the parallax measurement value of a moving object. Set a time window τ. At time t, the depth value D of the target t is updated from the depth value D at the previous moment t-1 and the current motion speed V t as shown in Formula 1 below:

[0031]

[0032] where V(t′) represents the motion speed at time t′. This formula ensures that when the inter-frame time is short, the depth value can change smoothly with the motion trend, reducing the jitter phenomenon caused by parallax errors. For an object with a large instantaneous acceleration, by setting a speed change rate threshold dV / dt > 5m / s 2 , the value range of τ is dynamically adjusted to ensure the real-time nature of the correction calculation.

[0033] By correcting the parallax measurement value of the moving object, stable depth measurement data can be obtained under different motion states and depth levels, providing high-precision three-dimensional feature matrix support for subsequent dynamic frame rate decisions.

[0034] Step 102: Determine the frame rate of video shooting based on depth information and motion characteristics.

[0035] In this embodiment, the frame rate refers to the number of frames captured per second in video shooting, with the unit of fps. A higher frame rate can provide a smoother picture, but it will increase the data volume and processing burden.

[0036] In this embodiment, based on depth information and motion characteristics, multiple methods can be used to determine the frame rate of video shooting. For example, depth information and displacement vectors can be fused to construct a matrix, which can be used as the scene characteristics of the shooting scene. A frame rate prediction model can be pre-constructed based on artificial intelligence algorithms, and the scene characteristics can be input into the frame rate prediction model to obtain the frame rate of video shooting, and then the shooting settings can be updated based on this frame rate. Another example is that the frame rate of video shooting can also be calculated according to a pre-set frame rate calculation rule. No specific limitation is made here.

[0037] Exemplarily, when shooting a dance performance, when the dancer approaches the electronic device and moves quickly, it can be detected that there are high-speed moving objects in the close-up area, and the frame rate can be set to 120fps to ensure that the dancer's movements are clearly captured. When the dancer moves away from the electronic device, enters the long-shot area and the movement slows down, the frame rate can be reduced to 30fps to save computing and storage space and reduce the device power consumption.

[0038] It should be noted that during the shooting process, after determining the frame rate of video shooting, if the current frame rate is different from the determined frame rate, the frame rate of video shooting can be immediately set to the determined frame rate, so as to obtain the best picture quality in scenarios where the shooting environment or the shooting object changes dynamically.

[0039] Since the depth information and motion features can comprehensively reflect the characteristics of the current shooting scene, such as the depth and motion state of each object in the shooting picture, etc., setting the frame rate based on the depth information and motion features can achieve fine control of the shooting process. Increasing the frame rate in scenarios with high-speed moving objects can effectively reduce motion blur and improve the clarity and smoothness of the picture; reducing the frame rate in static scenarios or scenarios with low-speed moving objects can save computing resources and storage space, and reduce the power consumption of the device. This adaptive frame rate adjustment strategy ensures that the best picture quality can be obtained in scenarios where the shooting environment or the shooting object changes dynamically.

[0040] In some optional implementation manners, the frame rate of video shooting can be determined according to the following steps:

[0041] Step S21, based on the depth information and motion features, determine the area where the moving object is located in the shooting picture, the speed and acceleration of the moving object.

[0042] Specifically, the moving object in the shooting picture can be first identified based on the motion features. Then, according to the depth information of the moving object, the area where it is located can be determined. After that, through the displacement vector in the motion features, the speed and acceleration of the moving object can be calculated. Among them, according to the distance from the electronic device, the shooting range can be divided into a close-up area, a mid-shot area, and a long-shot area. The area where the moving object is located can refer to the close-up area, the mid-shot area, or the long-shot area. The speed of the moving object is the distance that the moving object moves within a unit time, reflecting the speed of the moving object. The acceleration of the moving object is the change rate of the moving object within a unit time, reflecting the speed change of the moving object.

[0043] It should be noted that the shooting picture may include one or more moving objects. When there are multiple moving objects in the shooting picture, the area, speed, and acceleration where each moving object is located can be determined respectively.

[0044] Through the depth information and motion features, the area, speed, and acceleration where the moving object is located can be accurately determined, providing a basis for subsequent dynamic adjustment of the frame rate. Since objects with different areas, speeds, and accelerations have different requirements for the frame rate, by precisely analyzing the area, speed, and acceleration where the moving object is located, intelligent adjustment of the frame rate can be achieved, ensuring the best shooting effect in different shooting scenarios.

[0045] Step S22: Determine the frame rate of video shooting based on the region, speed, and acceleration.

[0046] Here, there are various ways to determine the frame rate of video shooting based on the region, speed, and acceleration. For example, a frame rate prediction model can be pre-constructed based on an artificial intelligence algorithm. The region, speed, and acceleration can be input into this frame rate prediction model to obtain the frame rate of video shooting, and then the shooting settings can be updated based on this frame rate. Another example is that the frame rate of video shooting can be calculated according to a pre-set frame rate calculation rule. There is no specific limitation here. Another example is that the priority situation can be pre-set, and the frame rate calculation rule in the priority situation and the frame rate calculation rule in other situations except the priority situation can be determined. Whether the priority situation is satisfied can be determined based on the region, speed, and acceleration, and then the corresponding frame rate calculation rule can be adopted.

[0047] Optionally, in the case where there is a moving object with a speed greater than the first speed threshold and an acceleration less than the acceleration threshold in the close-up region, the frame rate of video shooting can be set to the first frame rate. This situation can be regarded as a priority situation. Among them, the first speed threshold can be used to determine whether the moving object is in a high-speed motion state. For example, it can be set to 2m / s. The first frame rate can correspond to the high frame rate mode, usually 120fps or above, and is used to capture clear pictures of high-speed moving objects. Exemplarily, during a dance performance, if it is detected that the dancer is in the close-up region and the speed is 3m / s, the frame rate can be set to 120fps to clearly capture the dancer's movements. In the close-up region, high-speed moving objects require a higher frame rate to capture their details and movements. By setting the first frame rate, motion blur can be effectively reduced, the clarity and smoothness of the picture can be improved, and every action detail of the close-up moving object can be clearly captured.

[0048] Optionally, in the case where there is a moving object only in the far-view region and the speed of the moving object is less than the second speed threshold, the frame rate of video shooting can be set to the second frame rate. This situation can be regarded as a priority situation. Among them, the second speed threshold can be used to determine whether the moving object is in a low-speed motion state. The second speed threshold is less than the first speed threshold. For example, it can be set to 0.2m / s. The second frame rate is less than the first frame rate. The second frame rate can be the reference frame rate, for example, 30fps. Exemplarily, during a dance performance, when the dancer moves to the far-view region and the speed drops to 0.1m / s, the frame rate can be set to 30fps. In the far-view region, low-speed moving objects do not require a high frame rate to capture their details and movements. By setting the second frame rate, computing resources and storage space can be effectively saved, while ensuring the smoothness and clarity of the picture, and meeting the shooting needs of users in different scenarios.

[0049] Optionally, in other cases, that is, in cases other than the above two priority cases, the frame rate of video shooting can be determined based on the speed and acceleration of the moving object. Specifically, it can be divided into the following two cases:

[0050] Case 1: If the acceleration is less than or equal to the acceleration threshold, the frame rate can be determined according to the speed of the moving object, that is, the frame rate is determined according to the actual speed of the moving object. Among them, the acceleration threshold can be set as needed, and its value is not limited here. Specifically, it is divided into the following cases:

[0051] When the speed is less than the third speed threshold, the frame rate of video shooting can be set to the third frame rate. For example, the third speed threshold is 1m / s and the third frame rate is 30fps. That is, if the speed is less than 1m / s, the frame rate can be set to 30fps.

[0052] When the speed is greater than or equal to the third speed threshold and less than or equal to the fourth speed threshold, the frame rate of video shooting can be determined based on the speed. For example, the third speed threshold is 1m / s and the fourth speed threshold is 2m / s. If the speed is greater than or equal to 1m / s and less than or equal to 2m / s, let the speed be denoted as v and the frame rate be denoted as F. The frame rate setting can refer to the following formula 2:

[0053]

[0054] When the speed is greater than the fourth speed threshold and less than or equal to the fifth speed threshold, the frame rate of video shooting can be set to the fourth frame rate. For example, the fourth speed threshold is 2m / s, the fifth speed threshold is 3m / s, and the fourth frame rate is 90fps. That is, if the speed is greater than or equal to 2m / s and less than or equal to 3m / s, the frame rate can be set to 90fps.

[0055] When the speed is greater than the fifth speed threshold, the frame rate of video shooting can be set to the fifth frame rate. For example, the fifth speed threshold is 3m / s and the fifth frame rate is 120fps. That is, if the speed is greater than or equal to 3m / s, the frame rate can be set to 120fps.

[0056] It should be noted that the first frame rate can be the same as the fifth frame rate. For example, both are 120fps. The second frame rate can be the same as the third frame rate. For example, both are 30fps. The first speed threshold can be the same as the fourth speed threshold. For example, both are 2m / s.

[0057] Case 2: If the acceleration is greater than the acceleration threshold, the speed of the moving object after the target duration can be predicted based on the speed of the moving object, i.e., the actual speed, to obtain the predicted speed, and then the frame rate can be determined according to the predicted speed. The target duration can be set as needed, and its value is not limited here. For example, the target duration can be set to 0.05 s. Specifically, the acceleration can be denoted as a, the target duration as Δt, and based on the actual speed v, the calculation of the predicted speed v' can refer to the following formula (3):

[0058] v' = v + a×Δt (3)

[0059] When processing a moving object with a large acceleration, by predicting the future speed and position of the moving object and adjusting the frame rate in advance, the smear in the picture in case of sudden movement can be reduced, and the response speed of frame rate adjustment can be improved.

[0060] By dynamically adjusting the frame rate, the shooting requirements in different motion states can be flexibly met. In the case of changes in the speed and acceleration of the object, a suitable frame rate can be found through linear interpolation or prediction algorithms, which not only ensures the smoothness and clarity of the picture but also reasonably utilizes computing resources and storage space.

[0061] Optionally, in the slow-motion mode, i.e., when the frame rate is greater than 60 fps, multi-frame synthesis processing can be performed to reduce the sampling pressure on the sensor. Specifically, the optical flow algorithm can be used to calculate the pixel displacement between adjacent frames to generate interpolation frames; then the interpolation frames and the actually captured frames are synthesized. For example, they are synthesized according to the ratio of the actually captured frames to the interpolation frames of 3:1. Thereby, the smoothness of the picture can be improved, and at the same time, the storage and encoding overhead in the high frame rate mode can be reduced.

[0062] Optionally, to optimize the video coding efficiency, a dynamic bit rate allocation mechanism can be set to adjust the bit rate allocation weight of the area corresponding to the moving object according to the motion intensity of the moving object. For the area corresponding to the moving object with high motion intensity, an additional 30% of the coding bit rate can be allocated to reduce motion blur and ensure detail clarity; for the static background area, the bit rate allocation can be appropriately reduced to improve the overall compression efficiency, enabling the system to optimize the storage resources and bandwidth usage while ensuring the visual quality.

[0063] Step 103: Determine the first lighting parameter based on the frame rate, ambient light parameter, and the distance from the target shooting object to the electronic device.

[0064] In this embodiment, the ambient light parameter can be used to reflect the lighting conditions of the shooting scene. The ambient light parameter can include but is not limited to at least one of the following: ambient illuminance value, ambient color temperature value. The first lighting parameter is used to control the attributes of the fill light to optimize the shooting picture. The first lighting parameter can include but is not limited to at least one of the following: light color temperature value, stroboscopic frequency, and brightness value.

[0065] In this embodiment, based on the frame rate, the ambient light parameters, and the distance from the target shooting object to the electronic device, various methods can be used to determine the first lighting parameter. For example, a first lighting parameter prediction model can be pre-constructed based on an artificial intelligence algorithm. The frame rate, the ambient light parameters, and the distance from the target shooting object to the electronic device can be input into the first lighting parameter prediction model to obtain the first lighting parameter output by the first lighting parameter prediction model. For another example, the first lighting parameter can also be calculated according to a pre-set first lighting parameter calculation rule. No specific limitation is made here.

[0066] Exemplarily, when shooting an indoor concert in a low-light environment, the ambient illuminance value is low and the color temperature is warm. The appropriate first lighting parameter can be calculated according to the current frame rate of 60fps, the distance of 2 meters from the target shooting object to the electronic device, and the ambient light parameters. For example, it includes a light color temperature value of 3000K, a stroboscopic frequency of 180Hz, and a brightness value of 800 lumens. This can ensure that under low-light conditions, the fill light provides appropriate illumination, making the picture brightness uniform and the color reproduction natural.

[0067] In some optional implementation manners, the ambient light parameters include the ambient illuminance value and the ambient color temperature value. The ambient color temperature value is the color temperature value of the ambient light, which is a parameter reflecting the light color of the shooting scene, with the unit of Kelvin (K), and can be collected by the ambient light sensor array. The ambient illuminance value is the illuminance value of the ambient light, which is a parameter reflecting the light intensity of the shooting scene, with the unit of lux (lx), and can be collected by the ambient light sensor array.

[0068] The first lighting parameter includes the light color temperature value, the light stroboscopic frequency, and the light brightness value. The light color temperature value is the color temperature setting value of the fill light, which is a parameter reflecting the light color of the fill light and can affect the color reproduction of the picture. The light stroboscopic frequency is the flashing frequency of the fill light, with the unit of Hertz (Hz), and needs to match the frame rate to avoid optical jitter. The light brightness value is the brightness setting value of the fill light, with the unit of lumen (lm), and can affect the brightness of the picture. The fill light can include but is not limited to a diffused light.

[0069] On this basis, the first lighting parameter can be determined through the following steps:

[0070] Step S31, determine the light color temperature value based on the ambient color temperature value and the color temperature threshold.

[0071] The color temperature threshold can be used to judge the high or low of the ambient color temperature, so as to determine the appropriate light source color temperature. The color temperature adjustment can adopt an environment adaptation algorithm to ensure that the video color matches the ambient light. When the ambient color temperature value C e is lower than 4000K, the light color temperature value C s can be set to C s = C e+500. When C e ≥4000K, C can be maintained s = C e .

[0072] By matching the color temperature of the light with the ambient color temperature, the color of the picture can be made more natural, avoiding the problem of color cast in the picture caused by the color temperature difference, and improving the visual comfort and color restoration degree of the picture.

[0073] Step S32: Determine the light strobing frequency based on the frame rate.

[0074] The strobing frequency can be dynamically adjusted according to the frame rate to ensure that the light source strobing matches the video sampling rate and reduce the optical jitter in the high frame rate mode. When the frame rate F = 30fps, the strobing frequency can be set to 120Hz; when F = 60fps, the strobing frequency can be set to 240Hz; when F = 120fps, the high frequency mode can be started and the strobing frequency can be set to 480Hz.

[0075] By matching the light strobing frequency with the frame rate, the optical jitter and stripe flicker phenomena can be effectively avoided, ensuring the lighting uniformity of high-speed moving objects, and thus ensuring the stability and clarity of the picture. Especially in the high frame rate shooting mode, the picture quality can be improved.

[0076] Step S33: Determine the light brightness value based on the frame rate, ambient illuminance value, distance from the target shooting object to the electronic device, and brightness threshold.

[0077] The brightness threshold can be used to judge whether the ambient illuminance is sufficient, so as to determine the appropriate light brightness value. The brightness compensation can adopt an attenuation model based on the depth of the target shooting object. According to the characteristic that the light intensity is inversely proportional to the square of the distance, the calculation of the brightness L can be carried out according to the following formula four:

[0078]

[0079] Where α is the material reflection coefficient, d is the depth of the target shooting object, F is the current frame rate, and E is the difference between the ambient illuminance value and the ideal illuminance value required for the electronic device to shoot. When the calculated L exceeds the human eye safety threshold of 10000 lumens, the hierarchical limiting strategy can be started. First, reduce the color temperature by 500K to reduce the visual stimulation of the high-brightness area; if it still exceeds the limit, the brightness is decreased by 10% at the same time, and the ISO (International Standards Organization, sensitivity) gain is appropriately increased, with a maximum of no more than ISO6400, to ensure the picture exposure balance in the low brightness compensation scenario. This strategy can maintain the brightness stability under extreme illuminance conditions, prevent the picture from overexposing or the lighting from being uneven, and at the same time take into account the optical consistency in the high frame rate mode.

[0080] By comprehensively considering factors such as environmental illuminance, the distance from the target object to be photographed to the electronic device, and the frame rate, the required light brightness can be accurately calculated, ensuring that the picture has appropriate brightness under different lighting conditions, avoiding overexposure or underexposure, and thus improving the shooting quality.

[0081] By determining the first light parameter by comprehensively considering various factors, precise fill light for the photographed picture can be achieved. Adjusting the light color temperature can make the picture color transition naturally with the ambient light, improving visual comfort; matching the stroboscopic frequency with the frame rate can avoid optical jitter and stripe flickering phenomena, ensuring the stability of the picture; precisely controlling the brightness can ensure that the picture has appropriate brightness under different lighting conditions, avoiding overexposure or underexposure, and thus improving the shooting quality.

[0082] Step 104, perform shooting based on the first light parameter.

[0083] In this embodiment, based on the first light parameter, subsequent video frames can be shot. When shooting subsequent video frames, the light module can be filled with light based on the first light parameter. Among them, the light module is a module composed of one or more light sources. Fill light means using a light source to supplement the illumination of the shooting scene to improve the brightness and quality of the picture.

[0084] In practice, a corresponding control signal can be generated based on the first light parameter. The control signal is sent to the light module to drive each light source in the light module to adjust its attributes, such as brightness, color temperature, and stroboscopic frequency. After the light module responds to the control signal in real time, fill light for the shooting scene can be achieved.

[0085] Optionally, the light module may include a main light, a contour light, and an ambient light. The main light is the main light source in the light module, responsible for providing central illumination, its brightness is adjustable, and its beam angle is adjustable. For example, it can be continuously adjustable between 20° and 100°. The contour light is an auxiliary light source in the light module, which can be used to highlight the contour of an object, and its beam angle is adjustable. For example, it can be continuously adjustable between 5° and 30°, used to enhance the illumination details of the object edge. The ambient light is the ambient light source in the light module, which can adopt a 120° wide-angle design to evenly illuminate the background and enhance the layering of the picture.

[0086] On this basis, in the high frame rate mode, for example, when the frame rate is greater than or equal to 120fps, the light brightness value determined in step S33 can be allocated according to the brightness ratio of the main light to the contour light of 3:1 to strengthen the illumination level of the moving subject; in the normal frame rate mode, for example, when the frame rate is equal to 30fps, the brightness ratio of the main light to the contour light is adjusted to 2:1 to adapt to a more natural light transition. When the moving direction changes, the contour light can complete the direction adjustment within 100ms so that it always remains consistent with the target moving direction, improving the illumination quality of the edge contour.

[0087] Exemplarily, when shooting an outdoor sports event, the main light can be controlled to provide high-brightness central illumination according to the current first lighting parameters, the contour light can highlight the contours of the athletes, and the ambient light can evenly illuminate the background. By precisely adjusting the attributes of each group of light sources, it is ensured that the picture always remains clear, bright and has accurate color reproduction under fast movement and complex lighting conditions.

[0088] By adjusting the brightness ratio of the main light and the contour light according to the frame rate, it is possible to ensure that under different frame rate modes, the lighting effect of the picture not only highlights the main body but also takes into account the background, enhancing the layering, three-dimensional sense and lighting balance of the picture. In the high frame rate mode, a higher brightness ratio of the main light and the contour light helps to clearly capture the details and contours of fast-moving objects.

[0089] Optionally, the PID (Proportional Integral Derivative) control algorithm can be used to achieve precise dynamic adjustment of the brightness, and the control target is that the brightness L(t) approaches the set value L s . Its control formula can be seen in Formula Five below:

[0090]

[0091] where e(t) = L s - L(t) is the brightness error, K p is the proportionality coefficient, K i is the integral coefficient, K d is the differential coefficient. The system sets the integral time constant T i = 0.5s and the differential time constant T d = 0.1s to optimize the brightness adjustment rate, avoid visual discomfort caused by sudden brightness changes, and at the same time reduce sensor exposure fluctuations.

[0092] Using the PID control algorithm to precisely adjust the brightness, the integral time constant can be set to 0.5s and the differential time constant can be set to 0.1s to ensure smooth lighting changes.

[0093] Optionally, through stroboscopic phase calibration, it is ensured that the light source pulse signal precisely matches the exposure timing of the CMOS (Complementary Metal Oxide Semiconductor) sensor, and the deviation between the rising edge of the light pulse and the sensor exposure signal is less than 0.1ms. The synchronous phase adjustment model is used to determine the phase compensation amount, as shown in Formula Six below:

[0094]

[0095] where Δφ is the required phase compensation amount, F is the current frame rate, and θ s is the light source trigger phase, and θ c is the CMOS exposure trigger phase. Through this compensation strategy, the deviation between the rising edge of the optical pulse and the exposure timing of the CMOS sensor can be controlled within 0.1 ms, improving the light synchronization accuracy, reducing stroboscopic or uneven brightness caused by the misalignment of the light source and exposure, and enhancing the smoothness and clarity of the image.

[0096] Optionally, a bidirectional communication link can be established between the video processing module and the lighting control module to ensure the timing consistency of frame rate switching and the adjustment of the first lighting parameters through a timestamp synchronization mechanism. At the same time, a status feedback loop at the 10-ms level can be set. When the detected parameters lag behind the video frame changes, a dynamic compensation algorithm is started to insert transitional frames and adjust the PWM (Pulse Width Modulation) duty cycle.

[0097] The core of the bidirectional communication link lies in a high-precision synchronization mechanism, data integrity guarantee, and exception recovery strategy to ensure stable and real-time information interaction between the video processing module and the lighting control module. The synchronization protocol frame structure consists of a timestamp, a frame rate code, and a set of the first lighting parameters. Among them, the 32-bit timestamp uses millisecond-level precision to ensure time synchronization between lighting control and image processing; the 16-bit frame rate code is used to dynamically adjust the video capture rate to be consistent with the step frame rate; the 24-bit set of the first lighting parameters covers the brightness distribution, color temperature setting, and beam angle of the main light, contour light, and ambient light to ensure the immediacy of the lighting control strategy. By constructing a dedicated synchronization protocol frame with a 32-bit timestamp, a 16-bit frame rate code, and a 24-bit set of the first lighting parameters, precise time alignment can be achieved.

[0098] Optionally, to ensure data integrity and reliability, a multiple verification mechanism can be established, including but not limited to CRC (Cyclic Redundancy Check), threshold comparison verification, and historical trend verification. The CRC verification uses a 16-bit redundancy code, and the calculation method is as follows in Formula 7:

[0099] C(x) = M(x)·x r mod G(x) (7)

[0100] where C(x) is the verification frame to be sent, M(x) is the original data, and x rRepresents a left shift operation, and G(x) is the generating polynomial. This verification method can effectively detect data corruption during transmission. The threshold comparison verification sets a safe range for the first set of lighting parameters. For example, the brightness does not exceed 1200 lumens, the color temperature is not lower than 2500K and not higher than 6500K, to avoid abnormal instructions from affecting the system stability. The historical trend verification calculates the change rate based on a sliding window. If the first lighting parameter mutates beyond the set threshold within a short period (such as a brightness change of more than 20%), the data packet is rejected and a retransmission is requested.

[0101] Optionally, if the verification fails three times in a row, it can automatically switch to a frame rate of 30fps, a color temperature of 5500K, and a brightness of 800 lumens to automatically fallback to the safe mode to ensure minimum availability.

[0102] The method provided by the above embodiments of the present application, during video shooting, first obtains the depth information of the shooting scene and the motion characteristics of the moving objects in the shooting frame, then determines the frame rate of the video shooting based on the depth information and the motion characteristics, and then determines the first lighting parameter based on the frame rate, the ambient light parameter, and the distance from the target shooting object to the electronic device, so as to perform shooting based on the first lighting parameter. On the one hand, since the depth information and the motion characteristics can comprehensively reflect the characteristics of the current shooting scene, setting the frame rate based on this can perform intelligent and dynamic frame rate control according to the environment and the objects in the frame during video shooting, ensuring that the best picture quality can be obtained in real time in a dynamically changing shooting scene. On the other hand, since the determination process of the first lighting parameter comprehensively considers the frame rate, the ambient light parameter, and the distance from the target shooting object to the electronic device, intelligent and dynamic fill light control can be performed according to the environment and the position of the target shooting object during video shooting, ensuring that the best picture quality can be obtained in real time in a dynamically changing shooting scene. Thus, the shooting parameters can be dynamically adjusted according to the environment during video shooting, improving the imaging quality of video shooting.

[0103] In addition, the shooting control method provided by the embodiments of the present application can take into account both static and dynamic scenes, can save computing resources in low-motion scenes, and can provide high frame rate and high-precision imaging quality in high-speed motion scenes, and is particularly suitable for application scenarios with high requirements for picture smoothness and lighting consistency such as real-time interaction, high-speed tracking, and augmented reality (AR).

[0104] Please refer to Figure 2 , which shows the second flowchart of the shooting control method provided by the embodiments of the present application. The process of this shooting control method includes the following steps:

[0105] Step 201, during video shooting, obtain the depth information of the shooting scene and the motion characteristics of the moving objects in the shooting frame.

[0106] Step 202: Determine the frame rate of video shooting based on depth information and motion features.

[0107] Step 203: Determine the first lighting parameter based on the frame rate, ambient light parameter, and the distance from the target shooting object to the electronic device.

[0108] Steps 201 to 203 can refer to Figure 1 Steps 101 to 103 in the corresponding embodiment, which will not be elaborated here.

[0109] Step 204: In the case where the generation delay of the first lighting parameter exceeds the duration threshold, based on the optical flow method, predict the motion trajectory of the target shooting object in the previous frame to generate at least one prediction frame.

[0110] In this embodiment, the duration threshold can be set as needed. For example, it can be set to 5 ms. The number of prediction frames can be set as needed. For example, it can be set to 1 to 3. The generation delay of the first lighting parameter exceeding the duration threshold means that the first lighting parameter lags. Generally, the first lighting parameter lag is more likely to occur in high-dynamic or high-load scenarios, specifically including but not limited to high frame rate switching scenarios, complex motion scenarios, and scenarios with too high system load, etc.

[0111] Exemplarily, when the frame rate suddenly changes from 30 fps to 120 fps, the first lighting parameter needs to be adjusted quickly, but there is a delay in hardware response. At this time, it may cause the generation of the first lighting parameter to lag; the motion trajectory of the target shooting object suddenly changes, such as rapid acceleration, resulting in the depth information and motion vector being updated later than the video frame, which may cause the generation of the first lighting parameter to lag; during multitasking, the sensor data processing or control instruction transmission is delayed, resulting in the generation of the first lighting parameter to lag.

[0112] In practice, the motion vector of the target shooting object in the previous frame can be calculated first using the optical flow method. Then, based on the motion vector, predict the position and motion trend of the target shooting object in the next few frames. After that, generate at least one prediction frame, and the number of prediction frames can be dynamically adjusted according to the motion speed and acceleration. By generating prediction frames, the motion trend and position of the target shooting object can be estimated in advance, providing a basis for the adjustment of the first lighting parameter, reducing the stuttering and ghosting phenomena in the picture, and improving the user experience.

[0113] Step 205: For each of the at least one prediction frame, determine the third lighting parameter corresponding to the prediction frame based on the first lighting parameter and the current second lighting parameter, and control the lighting module to fill light for the prediction frame based on the third lighting parameter.

[0114] In this embodiment, for each of at least one predicted frame, the third lighting parameter corresponding to the predicted frame can be determined based on the first lighting parameter and the current second lighting parameter according to an exponential decay function, so as to avoid the sudden change of brightness and color temperature from affecting the visual experience. The exponential decay function is shown in Formula 8 below:

[0115] P(t) = P0 + (P t - P0)·(1 - e -λt ) (8)

[0116] where P(t) is the third lighting parameter of the predicted frame at time t; P0 is the second lighting parameter, that is, the current value; P t is the first lighting parameter, that is, the target value; λ is the set transition rate, which is used to control the smoothness of the light change.

[0117] By predicting the lighting parameters of each predicted frame, the lighting module can be pre-adjusted before actual shooting to ensure that the best lighting effect can be obtained for each frame, and the smoothness and stability of the picture are improved.

[0118] Step 206, perform shooting based on the first lighting parameter.

[0119] For the description of Step 206, reference can be made to Figure 1 Step 104 in the corresponding embodiment, which will not be elaborated here.

[0120] By predicting the motion trajectory of the target shooting object, generating predicted frames, and filling light for these predicted frames according to the current value and the target value of the lamp tube parameters. This prediction and pre-adjustment mechanism can effectively reduce the stuttering and ghosting phenomena in the picture and improve the smoothness and stability of the captured picture.

[0121] It should be noted that for the shooting control method provided in the embodiments of the present application, the execution subject can be a shooting control device. In the embodiments of the present application, taking the shooting control device executing the shooting control method as an example, the shooting control device provided in the embodiments of the present application is described.

[0122] As Figure 3 shown, the shooting control device 300 in this embodiment includes: an acquisition unit 301, configured to acquire the depth information of the shooting scene and the motion characteristics of the moving object in the captured picture during video shooting; a first determination unit 302, configured to determine the frame rate of video shooting based on the depth information and the motion characteristics; a second determination unit 303, configured to determine the first lighting parameter based on the frame rate, the ambient light parameter, and the distance from the target shooting object to the electronic device; and a shooting unit, configured to perform shooting based on the first lighting parameter.

[0123] In some alternative implementation manners of this embodiment, the first determination unit 302 is further configured to: determine the region where the moving object is located, the speed and acceleration of the moving object in the captured image based on the depth information and the motion feature; when there is a moving object with a speed greater than the first speed threshold in the close-up region, set the frame rate of video shooting to the first frame rate; when there is only a moving object in the far-view region and the speed of the moving object is less than the second speed threshold, set the frame rate of video shooting to the second frame rate, where the second speed threshold is less than the first speed threshold, and the second frame rate is less than the first frame rate; in other cases, determine the frame rate of video shooting based on the speed and acceleration of the moving object. Through the depth information and the motion feature, the region, speed and acceleration where the moving object is located can be accurately determined. Since objects with different regions, speeds and accelerations have different requirements for the frame rate, by precisely analyzing the region, speed and acceleration where the moving object is located, intelligent adjustment of the frame rate can be achieved, ensuring the best shooting effect in different shooting scenarios.

[0124] In some alternative implementation manners of this embodiment, the first determination unit 302 is further configured to: when the acceleration of the moving object is less than or equal to the acceleration threshold, determine the frame rate of video shooting based on the speed of the moving object; when the acceleration of the moving object is greater than the acceleration threshold, predict the speed of the moving object after the target duration based on the speed of the moving object to obtain the predicted speed, and determine the frame rate of video shooting based on the predicted speed. By dynamically adjusting the frame rate, the shooting requirements in different motion states can be flexibly met. When the speed and acceleration of the object change, a suitable frame rate can be found through linear interpolation or prediction algorithms, ensuring both the smoothness and clarity of the image and reasonably utilizing computing resources and storage space.

[0125] In some alternative implementation manners of this embodiment, the ambient light parameter includes the ambient illuminance value and the ambient color temperature value; the first light parameter includes the light color temperature value, the light stroboscopic frequency and the light brightness value; the determination unit 303 is further configured to: determine the light color temperature value based on the ambient color temperature value and the color temperature threshold; determine the light stroboscopic frequency based on the frame rate; determine the light brightness value based on the frame rate, the ambient illuminance value, the distance from the target shooting object to the electronic device, and the brightness threshold. By comprehensively considering factors such as ambient illuminance, the distance from the target shooting object to the electronic device, and the frame rate, the required light brightness can be accurately calculated, ensuring that the image has an appropriate brightness under different lighting conditions, avoiding overexposure or underexposure, and thus improving the shooting quality.

[0126] In some alternative implementation manners of this embodiment, the device further includes a second control unit, configured to: when the generation delay of the first lighting parameter exceeds a duration threshold, predict the motion trajectory of the target shooting object in the previous frame based on the optical flow method to generate at least one predicted frame; for each of the at least one predicted frame, determine a third lighting parameter corresponding to the predicted frame based on the first lighting parameter and the current second lighting parameter, and control the lighting module to perform fill light on the predicted frame based on the third lighting parameter. By predicting the motion trajectory of the target shooting object, generating predicted frames, and performing fill light on these predicted frames according to the current value and target value of the lamp tube parameter. This prediction and pre-adjustment mechanism can effectively reduce the stuttering and ghosting phenomena in the picture and improve the smoothness and stability of the captured picture.

[0127] The device provided in the above embodiment of this application first obtains the depth information of the shooting scene and the motion characteristics of the moving objects in the captured picture during video shooting, then determines the frame rate of video shooting based on the depth information and motion characteristics, and then determines the first lighting parameter based on the frame rate, ambient light parameter, and the distance from the target shooting object to the electronic device, so as to perform shooting based on the first lighting parameter. On the one hand, since the depth information and motion characteristics can comprehensively reflect the characteristics of the current shooting scene, setting the frame rate based on this can perform intelligent and dynamic frame rate control according to the environment and objects in the picture during video shooting, ensuring the best picture quality can be obtained in real time in a dynamically changing shooting scene. On the other hand, since the determination process of the first lighting parameter comprehensively considers the frame rate, ambient light parameter, and the distance from the target shooting object to the electronic device, intelligent and dynamic fill light control can be performed according to the environment and the position of the target shooting object during video shooting, ensuring the best picture quality can be obtained in real time in a dynamically changing shooting scene. Thus, the shooting parameters can be dynamically adjusted according to the environment during video shooting, improving the imaging quality of video shooting.

[0128] The shooting control device in the embodiments of the present application may be an electronic device or a component in an electronic device, such as an integrated circuit or a chip. The electronic device may be a terminal or other devices other than terminals. Exemplarily, the electronic device may be a mobile phone, a tablet computer, a laptop computer, a handheld computer, a vehicle-mounted electronic device, a Mobile Internet Device (MID), an Augmented Reality (AR) / Virtual Reality (VR) device, a robot, a wearable device, an Ultra-Mobile Personal Computer (UMPC), a netbook, or a Personal Digital Assistant (PDA), etc. It may also be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine, or a self-service machine, etc. The embodiments of the present application do not make specific limitations.

[0129] The shooting control device in the embodiments of the present application may be a device with an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems. The embodiments of the present application do not make specific limitations.

[0130] The shooting control device provided by the embodiments of the present application can implement Figure 1 each process implemented by the method embodiments. To avoid repetition, it will not be elaborated here.

[0131] Optionally, as Figure 4 shown, the embodiments of the present application further provide an electronic device 400, including a processor 401 and a memory 402. A program or instruction that can run on the processor 401 is stored on the memory 402. When the program or instruction is executed by the processor 401, it implements each step of the above shooting control method embodiment and can achieve the same technical effect. To avoid repetition, it will not be elaborated here.

[0132] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.

[0133] Figure 5 It is a schematic diagram of the hardware structure of an electronic device for implementing the embodiments of the present application.

[0134] The electronic device 500 includes, but is not limited to, components such as a radio frequency unit 501, a network module 502, an audio output unit 503, an input unit 504, a sensor 505, a display unit 506, a user input unit 507, an interface unit 508, a memory 509, and a processor 510.

[0135] Those skilled in the art can understand that the electronic device 500 may further include a power source (such as a battery) for supplying power to each component. The power source can be logically connected to the processor 510 through a power management system, so as to implement functions such as management of charging, discharging, and power consumption management through the power management system. Figure 5 The structure of the electronic device shown does not limit the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0136] Among them, the processor 510 is used to obtain the depth information of the shooting scene and the motion characteristics of the moving objects in the shooting picture during video shooting; based on the depth information and the motion characteristics, determine the frame rate of video shooting; based on the frame rate, ambient light parameters, and the distance from the target shooting object to the electronic device, determine the first lighting parameter; and perform shooting based on the first lighting parameter.

[0137] Since the depth information and motion characteristics can comprehensively reflect the characteristics of the current shooting scene, setting the frame rate based on this can perform intelligent and dynamic frame rate control according to the environment and objects in the picture during video shooting, ensuring that the best picture quality can be obtained in real time in a dynamically changing shooting scene. Since the determination process of the first lighting parameter comprehensively considers the frame rate, ambient light parameters, and the distance from the target shooting object to the electronic device, intelligent and dynamic fill light control can be performed according to the environment and the position of the target shooting object during video shooting, ensuring that the best picture quality can be obtained in real time in a dynamically changing shooting scene. Thus, the shooting parameters can be dynamically adjusted according to the environment during video shooting, improving the imaging quality of video shooting.

[0138] In some alternative implementation manners of this embodiment, the processor 510 is further configured to determine the region where the moving object is located, the speed and acceleration of the moving object in the captured picture based on the depth information and the motion features; when there is a moving object with a speed greater than the first speed threshold in the near-view region, set the frame rate of video shooting to the first frame rate; when there is only a moving object in the far-view region and the speed of the moving object is less than the second speed threshold, set the frame rate of video shooting to the second frame rate, where the second speed threshold is less than the first speed threshold, and the second frame rate is less than the first frame rate; in other cases, determine the frame rate of video shooting based on the speed and acceleration of the moving object. Through the depth information and the motion features, the region, speed and acceleration where the moving object is located can be accurately determined. Since objects with different regions, speeds and accelerations have different requirements for the frame rate, by precisely analyzing the region, speed and acceleration where the moving object is located, intelligent adjustment of the frame rate can be achieved, ensuring the best shooting effect in different shooting scenarios.

[0139] In some alternative implementation manners of this embodiment, the processor 510 is further configured to, when the acceleration of the moving object is less than or equal to the acceleration threshold, determine the frame rate of video shooting based on the speed of the moving object; when the acceleration of the moving object is greater than the acceleration threshold, predict the speed of the moving object after the target duration based on the speed of the moving object to obtain the predicted speed, and determine the frame rate of video shooting based on the predicted speed. By dynamically adjusting the frame rate, the shooting requirements in different motion states can be flexibly met. When the speed and acceleration of the object change, a suitable frame rate can be found through linear interpolation or prediction algorithms, ensuring both the smoothness and clarity of the picture and reasonably utilizing computing resources and storage space.

[0140] In some alternative implementation manners of this embodiment, the ambient light parameters include the ambient illuminance value and the ambient color temperature value; the first light parameters include the light color temperature value, the light stroboscopic frequency and the light brightness value; the processor 510 is further configured to determine the light color temperature value based on the ambient color temperature value and the color temperature threshold; determine the light stroboscopic frequency based on the frame rate; determine the light brightness value based on the frame rate, the ambient illuminance value, the distance from the target shooting object to the electronic device, and the brightness threshold. By comprehensively considering factors such as the ambient illuminance, the distance from the target shooting object to the electronic device, and the frame rate, the required light brightness can be accurately calculated, ensuring that the picture has appropriate brightness under different lighting conditions, avoiding overexposure or underexposure, and thus improving the shooting quality.

[0141] In some alternative implementation manners of this embodiment, the processor 510 is further configured to, when the generation delay of the first lighting parameter exceeds the duration threshold, predict the motion trajectory of the target shooting object in the previous frame based on the optical flow method, and generate at least one predicted frame; for each predicted frame in the at least one predicted frame, determine the third lighting parameter corresponding to the predicted frame based on the first lighting parameter and the current second lighting parameter, and control the lighting module to perform fill light on the predicted frame based on the third lighting parameter. By predicting the motion trajectory of the target shooting object, generating predicted frames, and performing fill light on these predicted frames according to the current value and target value of the lamp tube parameter. This prediction and pre-adjustment mechanism can effectively reduce the stuttering and ghosting phenomena of the picture, and improve the smoothness and stability of the captured picture.

[0142] It should be understood that in the embodiments of the present application, the input unit 504 may include a graphics processing unit (GPU) 5041 and a microphone 5042. The graphics processing unit 5041 processes the image data of static pictures or videos obtained by an image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 506 may include a display panel 5061, and the display panel 5061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 507 includes at least one of a touch panel 5071 and other input devices 5072. The touch panel 5071 is also called a touch screen. The touch panel 5071 may include two parts, a touch detection device and a touch controller. The other input devices 5072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be elaborated here.

[0143] The memory 509 can be used to store software programs and various data. The memory 509 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data. Among them, the first storage area can store an operating system, application programs or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 509 can include a volatile memory or a non-volatile memory, or the memory 509 can include both a volatile memory and a non-volatile memory. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDR SDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synch link dynamic random access memory (SLDRAM), and a direct rambus random access memory (DRRAM). The memory 509 in the embodiments of the present application includes but is not limited to these and any other suitable types of memories.

[0144] The processor 510 may include one or more processing units; optionally, the processor 510 integrates an application processor and a modem processor. Among them, the application processor mainly processes operations related to the operating system, user interface, and application programs, etc., and the modem processor mainly processes wireless communication signals, such as a baseband processor. It can be understood that the above modem processor may not be integrated into the processor 510 either.

[0145] The embodiments of the present application also provide a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, it implements each process of the above-mentioned embodiment of the shooting control method and can achieve the same technical effect. To avoid repetition, it will not be elaborated here.

[0146] Among them, the processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media such as computer read-only memory ROM, random access memory RAM, magnetic disks, or optical discs.

[0147] Another embodiment of the present application provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is configured to run programs or instructions to implement each process of the above embodiment of the shooting control method and can achieve the same technical effects. To avoid repetition, it will not be elaborated here.

[0148] It should be understood that the chip mentioned in the embodiments of the present application may also be referred to as a system-on-chip, system chip, chip system, or system-on-chip.

[0149] The embodiments of the present application provide a computer program product. The program product is stored in a storage medium and is executed by at least one processor to implement each process of the above embodiment of the shooting control method and can achieve the same technical effects. To avoid repetition, it will not be elaborated here.

[0150] It should be noted that in this article, the terms "include", "comprise" or any other variant thereof are intended to cover non-exclusive inclusion, such that a process, method, article or device including a series of elements not only includes those elements but also includes other elements not expressly listed, or further includes elements inherent to such process, method, article or device. Without further limitation, an element defined by the phrase "including one..." does not exclude the presence of additional identical elements in the process, method, article or device including that element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in a reverse order according to the functions involved. For example, the described methods may be performed in an order different from that described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0151] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-described embodiment methods can be implemented by means of software plus a necessary general hardware platform. Of course, they can also be implemented by hardware, but in many cases, the former is a better implementation. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. The computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions for causing a terminal (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in various embodiments of the present application.

[0152] The embodiments of the present application have been described above in conjunction with the accompanying drawings. However, the present application is not limited to the above specific embodiments. The above specific embodiments are merely illustrative and not restrictive. Under the inspiration of the present application, those of ordinary skill in the art can also make many forms without departing from the purpose of the present application and the scope protected by the claims, and all of them belong to the protection scope of the present application.

Claims

1. A shooting control method, characterized in that: Executed by an electronic device, the method includes: During video shooting, depth information of the shooting scene and motion characteristics of the moving objects in the shooting picture are obtained; Determining a frame rate of video capture based on the depth information and the motion characteristics; Determine a first lighting parameter based on the frame rate, the ambient light parameter, and the distance from the target photographed object to the electronic device; Shooting is performed based on the first lighting parameters.

2. The method according to claim 1, characterized in that The determining the frame rate of the video shooting based on the depth information and the motion feature includes: Based on the depth information and the motion characteristics, determining the area where the moving object in the captured picture is located, and the speed and acceleration of the moving object; When there is a moving object with a speed greater than a first speed threshold in the near-view area, setting the frame rate of the video shooting to the first frame rate; When there is a moving object only in the distant view area and the speed of the moving object is less than a second speed threshold, setting the frame rate of the video shooting to a second frame rate, the second speed threshold is less than the first speed threshold, and the second frame rate is less than the first frame rate; In other cases, the frame rate of the video capture is determined based on the speed and acceleration of the moving object.

3. The method according to claim 2, characterized in that The step of determining the frame rate of video capture based on the speed and acceleration of the moving object includes: When the acceleration of the moving object is less than or equal to the acceleration threshold, determining a frame rate of video shooting based on the speed of the moving object; When the acceleration of the moving object is greater than the acceleration threshold, the speed of the moving object after a target duration is predicted based on the speed of the moving object to obtain a predicted speed, and a frame rate of video shooting is determined based on the predicted speed.

4. The method according to claim 1, characterized in that: The ambient light parameters include an ambient illumination value and an ambient color temperature value; the first light parameters include a light color temperature value, a light strobe frequency, and a light brightness value; and determining the first light parameters based on the frame rate, the ambient light parameters, and the distance from the target photographed object to the electronic device includes: Determining the light color temperature value based on the ambient color temperature value and the color temperature threshold; Based on the frame rate, determining the light strobe frequency; The light brightness value is determined based on the frame rate, the ambient illumination value, the distance from the target photographed object to the electronic device, and a brightness threshold.

5. The method according to claim 1, characterized in that: Before photographing based on the first lighting parameter, the method further includes: When the delay in generating the first lighting parameter exceeds a time threshold, predicting the motion trajectory of the target object in the previous frame based on an optical flow method to generate at least one predicted frame; For each predicted frame in the at least one predicted frame, a third lighting parameter corresponding to the predicted frame is determined based on the first lighting parameter and the current second lighting parameter, and the lighting module is controlled to perform fill lighting on the predicted frame based on the third lighting parameter.

6. A shooting control device, characterized in that: The device comprises: An acquisition unit, used to acquire depth information of a shooting scene and motion characteristics of a moving object in a shooting picture during video shooting; A first determining unit, configured to determine a frame rate of video shooting based on the depth information and the motion feature; A second determining unit, configured to determine a first lighting parameter based on the frame rate, the ambient light parameter, and the distance between the target photographed object and the electronic device; A shooting unit is used for shooting based on the first lighting parameters.

7. The device according to claim 6, characterized in that The first determining unit is further configured to: Based on the depth information and the motion characteristics, determining the area where the moving object in the captured image is located, and the speed and acceleration of the moving object; When there is a moving object with a speed greater than a first speed threshold in the near-view area, setting the frame rate of the video shooting to the first frame rate; When there is a moving object only in the distant view area and the speed of the moving object is less than a second speed threshold, setting the frame rate of the video shooting to a second frame rate, the second speed threshold is less than the first speed threshold, and the second frame rate is less than the first frame rate; In other cases, the frame rate of the video capture is determined based on the speed and acceleration of the moving object.

8. The device according to claim 7, characterized in that The first determining unit is further configured to: When the acceleration of the moving object is less than or equal to the acceleration threshold, determining a frame rate of video shooting based on the speed of the moving object; When the acceleration of the moving object is greater than the acceleration threshold, the speed of the moving object after a target duration is predicted based on the speed of the moving object to obtain a predicted speed, and a frame rate of video shooting is determined based on the predicted speed.

9. The device according to claim 6, characterized in that The ambient light parameters include an ambient illumination value and an ambient color temperature value; the first lighting parameters include a light color temperature value, a light strobe frequency, and a light brightness value; the second determining unit is further used to: Determining the light color temperature value based on the ambient color temperature value and the color temperature threshold; Based on the frame rate, determining the light strobe frequency; The light brightness value is determined based on the frame rate, the ambient illumination value, the distance from the target photographed object to the electronic device, and a brightness threshold.

10. The device according to claim 6, characterized in that The device also includes a prediction unit, configured to: When the delay in generating the first lighting parameter exceeds a time threshold, predicting the motion trajectory of the target object in the previous frame based on an optical flow method to generate at least one predicted frame; For each predicted frame in the at least one predicted frame, a third lighting parameter corresponding to the predicted frame is determined based on the first lighting parameter and the current second lighting parameter, and the lighting module is controlled to perform fill lighting on the predicted frame based on the third lighting parameter.

Images