Focusing frame rate control method and device

Abstract

The embodiment of the invention discloses a focus tracking frame rate control method and device, and the method comprises the steps: displaying a first user interface which comprises a shooting preview region and a plurality of shooting controls, and the shooting preview region is used for displaying an image collected by a camera; receiving a first operation, wherein the first operation is an operation for a target shooting control in the plurality of shooting controls; in response to the first operation, starting a target shooting mode, and displaying a target preview image in a shooting preview area; determining image parameters of the target preview image, and determining a target shooting scene based on the image parameters; and adjusting the distance measurement frame rate of a distance measurement sensor based on a target shooting mode and the target shooting scene. According to the embodiment of the invention, the ranging frame rate can be flexibly adjusted based on different shooting modes and shooting scenes, and the energy consumption is reduced on the premise of ensuring the shooting performance.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a method and device for frame rate control of focus tracking. Background Art

[0002] With the improvement of computing power and hardware capabilities, electronic devices support more and more diverse shooting scene requirements.

[0003] In current photography technology, the photography effect is usually adjusted by adjusting the automatic exposure module. However, the automatic exposure module needs to maintain a high frame rate of the ranging sensor in various scenes, which results in relatively high power consumption. Therefore, a frame rate control solution for focus tracking is needed, which can flexibly adjust the ranging frame rate based on different shooting modes and shooting scenes, and reduce energy consumption while ensuring shooting performance. Summary of the invention

[0004] The technical problem to be solved by the embodiments of the present application is to provide a method and device for frame rate control of focus tracking, which can flexibly adjust the ranging frame rate based on different shooting modes and shooting scenes, thereby reducing energy consumption while ensuring shooting performance.

[0005] In a first aspect, an embodiment of the present application provides a method for detecting the quality of an electrocardiogram signal, which may include: being applied to an electronic device, the electronic device including a camera module, the camera module including a camera and a ranging sensor; displaying a first user interface, the first user interface including a shooting preview area and multiple shooting controls, the shooting preview area being used to display an image captured by the camera; receiving a first operation, the first operation being an operation on a target shooting control among the multiple shooting controls; in response to the first operation, starting a target shooting mode, and displaying a target preview image in the shooting preview area; determining image parameters of the target preview image, and determining a target shooting scene based on the image parameters; and adjusting the ranging frame rate of the ranging sensor based on the target shooting mode and the target shooting scene.

[0006] In the existing laser-assisted focusing technology, there are usually two limitations: one is that the resolution of the laser is relatively low, and the other is that the frame rate of the laser ranging is fixed, usually 15 frames; the focusing technology based on this fixed frame rate can only achieve a simple opening or closing of the tracking focus, which limits the application effect of the tracking focus function in taking pictures. The embodiment of the present application provides a laser-assisted focusing solution with higher resolution and frame rate, which can more effectively track and focus on moving objects; however, in actual use scenarios, continuous high frame rate ranging may lead to a significant increase in energy consumption, which is particularly obvious for long-term or continuous use, and in non-critical scenarios, high frame rate ranging may not be necessary, and the improvement brought by maintaining a high frame rate for ranging is limited, but it leads to unnecessary consumption of system resources and excessive load on equipment. In response to this technical problem, the embodiment of the present application can flexibly adjust the ranging frame rate based on different shooting modes and shooting scenes to reduce energy consumption while ensuring shooting performance. Specifically, in the embodiment of the present application, the user can select a target shooting mode (such as auto focus automatic AF-A single shooting mode, auto focus full-time AF-F single shooting mode, all-object tracking continuous shooting mode, etc.) by clicking the shooting control in the shooting preview area, and determine the target shooting scene based on the image parameters in the preview image obtained by the camera (such as ambient brightness, streak effect detection results, and the distance of the shooting object), such as long-distance scene, non-long-distance scene-preview = 30 frames (FramesPer Second, one or more of the following scenarios: a non-telephoto-debanding preview 24 / 25fps scene, a non-telephoto-low-light preview <30fps scene, etc. Furthermore, in different shooting modes, for different shooting scenes, the ranging frame rate adjustment scheme of the ranging sensor may be different. Based on the differences in shooting modes and shooting environments, the ranging frame rate of the ranging sensor is dynamically adjusted. For example, the distance change of the object can be quickly and accurately tracked by increasing the ranging frame rate of the ranging sensor, and the focal length can be adjusted more quickly, especially when shooting moving objects, which helps to reduce motion blur and keep the image clear; or, by reducing the ranging frame rate, resource waste in non-essential scenarios is reduced (for example, in shooting in a low-light environment, the benefits of increasing the ranging frame rate are lower due to the longer exposure time). In summary, in the embodiments of the present application, after the user selects the target shooting mode, the current shooting scene can be determined based on the parameters in the preview image, and the ranging frame rate of the ranging sensor can be dynamically adjusted based on different shooting modes and different shooting scenes. The frame rate can be increased in scenes and modes that require quick response and precise focus, and the frame rate can be reduced when the focus requirement is low and the benefit of increasing the ranging frame rate of the ranging sensor is low, thereby improving the focusing effect and effectively controlling resource consumption.

[0007] In a possible implementation, the determining of the image parameters of the target preview image includes: determining the distance of the photographed object in the target preview image by the ranging sensor; and determining the stripe effect detection result and the RGB frame rate in the target preview image by the camera. In an embodiment of the present application, the image parameters of the target preview image can be based on the precise distance of the photographed object measured by the ranging sensor (for example, a matrix laser TOF sensor), and the stripe effect detection result and the RGB frame rate in the target preview image determined by the camera (for example, an automatic exposure module therein). Subsequently, based on the parameters in the preview image, the system can better identify the current shooting environment, and adjust the ranging frame rate of the ranging sensor based on the corresponding shooting mode, so as to provide users with a better shooting experience.

[0008] In a possible implementation, determining the target shooting scene based on the image parameters includes: if the distance to the shooting object is greater than a first preset distance, determining that the target shooting scene is a first scene; or, if the distance to the shooting object is less than the first preset distance and the RGB frame rate of the target preview image is a first frame rate, determining that the target shooting scene is a second scene, wherein the first frame rate is a default frame rate of the RGB frame rate in the target preview image; or, if the distance to the shooting object is less than the first preset distance and the RGB frame rate of the target preview image is a second frame rate or a third frame rate, determining that the target shooting scene is a third scene, wherein both the second frame rate and the third frame rate are less than the first frame rate, and the second frame rate or the third frame rate is a frame rate adjusted after performing streak effect detection; or, if the distance to the shooting object is less than the first preset distance and the RGB frame rate of the target preview image is a fourth frame rate, determining that the target shooting scene is a fourth scene, wherein the fourth frame rate is less than the first frame rate.

[0009] In an embodiment of the present application, the current shooting scene can be determined based on different image parameters in the preview image; specifically, the shooting scene can be based on the distance of the shooting object detected by a ranging sensor (such as a matrix laser TOF sensor) and the RGB frame rate of the preview image to distinguish different shooting scenes, wherein the distance of the shooting object will directly affect the composition and focus of the shooting, and the ambient brightness can be detected based on the RGB frame rate of the preview image, which affects the exposure level of the shooting, and the streak effect will directly affect the visual effect in the shooting. Furthermore, based on different shooting scenes, the requirements for ranging frame rate may also be different. For example, in long-distance shooting scenes, when the shooting object is beyond the laser shooting range, the laser ranging can be turned off to reduce unnecessary resource consumption; or, in medium and short distance non-low-light scenes, it may be necessary to increase the ranging frame rate of the ranging sensor to ensure more accurate focus; or, in scenes such as debanding, because the preview frame rate is set in the banding scene to eliminate or reduce the debanding effect, the ranging frame rate can be adjusted to synchronize with the RGB frame rate of the preview image to achieve better focus and obtain more accurate distance information when focusing; or, in low-light scenes, because the exposure time is long, many other problems may occur, such as motion focus blur, etc., and the effect of focusing is limited at this time, so the exposure time can be lengthened by reducing the ranging frame rate. In the embodiment of the present application, different scenes can be distinguished based on image parameters (such as the distance of the shooting object, the RGB frame rate of the preview image, the stripe effect detection result, etc.), and the camera system can make corresponding adjustments for different scenes to obtain better image quality. In summary, in the embodiments of the present application, accurate scene recognition (for example, determining the current shooting scene) can be performed based on different parameters in the preview image, so that the ranging frame rate of the ranging sensor can be adjusted for different shooting modes and different shooting scenes in the subsequent process, so as to improve the flexibility and image quality of the shooting device and reduce resource consumption.

[0010] In a possible implementation, the method further includes: if the distance of the photographed object is less than the first preset distance, and the stripe effect detection result is yes, then the size of the RGB frame rate in the target preview image is adjusted to the second frame rate or the third frame rate. In the embodiment of the present application, when it is detected that the shooting distance is close and the stripe effect occurs, the stripe effect that may occur during shooting can be reduced or eliminated by adjusting the RGB frame rate in the preview image. Specifically, in the automatic exposure mode, the camera will adjust the exposure setting according to the current ambient light. For example, when the RGB frame rate of the preview image of the camera is 30FPS, if the light changes continuously, the exposure setting of the camera will also be adjusted frequently, which may cause uneven brightness of the picture, thereby generating a stripe effect. In the embodiment of the present application, after the automatic exposure module in the camera detects the existence of the stripe effect, it can reduce the frequency mismatch problem between the camera and the ambient light source by adjusting the RGB frame rate in the preview image. This mechanism of automatically adjusting the frame rate provides a flexible way to optimize the image display in photography, especially when the ambient light conditions change or the shooting distance changes, it can automatically adapt and adjust to ensure image quality.

[0011] In a possible implementation, the types of the target shooting modes include a first mode, a second mode, and a third mode, wherein the first mode includes performing a single shot with continuous focus on the shooting object based on the target preview image, the second mode includes performing a single shot with single focus or a single shot with continuous focus on the shooting object based on the target preview image, and the third mode includes performing continuous focus continuous shooting on the shooting object based on the target preview image. Three different target shooting modes are provided in the embodiment of the present application, namely the first mode, the second mode, and the third mode, and the user can select a suitable mode based on different application scenarios to obtain a better shooting experience. Specifically, the first mode (e.g., the autofocus full-time AF-F mode) allows the user to take a single shot while continuously focusing on the subject, which is suitable for dynamically changing shooting scenes, ensuring clear shooting effects even in complex or unstable environments; the second mode (e.g., the autofocus automatic AF-A mode) can automatically switch the focus mode according to the movement of the subject and environmental changes, and can quickly and accurately lock the focus on both static and moving objects; the continuous focus continuous shooting function of the third mode (e.g., the all-things focus continuous shooting mode in the autofocus full-time AF-F mode) is more suitable for capturing continuous actions or dynamic scenes, such as sports events or natural animal activities, ensuring that every frame can be clearly recorded. In summary, the combination of the three shooting modes in the embodiments of the present application, and the subsequent dynamic adjustment of the ranging frame rate of the ranging sensor based on different shooting scenes in different modes, can greatly improve the flexibility and adaptability of shooting and meet the needs of different shooting scenes.

[0012] In a possible implementation, if the target shooting mode is the first mode; adjusting the ranging frame rate of the ranging sensor based on the target shooting mode and the target shooting scene includes: if the target shooting scene is the first scene and the length of the distance to the shooting object is greater than the second preset distance or the data acquired by the ranging sensor is invalid, adjusting the ranging frame rate of the ranging sensor to the first frame rate synchronized with the RGB frame rate frame, wherein the second preset distance is greater than the first preset distance; or, if the target shooting scene is the first scene and the distance to the shooting object is greater than the first preset distance and less than the second preset distance, adjusting the ranging frame rate of the ranging sensor to a fifth frame rate synchronized with the RGB frame rate frame, wherein , the fifth frame rate is greater than the first frame rate; or, if the target shooting scene is the second scene, the ranging frame rate of the ranging sensor is adjusted to the fifth frame rate synchronized with the RGB frame rate, or the sixth frame rate, wherein the sixth frame rate is greater than the first frame rate; or, if the target shooting scene is the third scene, the ranging frame rate of the ranging sensor is adjusted to the seventh frame rate synchronized with the RGB frame rate or the eighth frame rate synchronized with the RGB frame rate, or the sixth frame rate, wherein both the seventh frame rate and the eighth frame rate are greater than the first frame rate; or, if the target shooting scene is the fourth scene, the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate, wherein the ninth frame rate is less than the first frame rate.

[0013] In an embodiment of the present application, the frame rate of the ranging sensor can be dynamically adjusted for different shooting scenes that appear in the first mode (for example, the autofocus full-time AF-F single-shot mode), which significantly improves the camera's adaptability and focusing efficiency for different shooting scenes. Specifically, this dynamic adjustment mechanism allows the camera to automatically adjust the operating frequency of the ranging sensor according to the movement speed of the subject and the complexity of the scene. Specifically, when shooting a long-distance object, for the first scene, when the distance of the subject is greater than the second preset distance (for example, the subject is at a long distance outside the effective shooting distance of the ranging sensor) or the ranging data is invalid due to other factors (for example, the distance is too far or the ranging sensor fails), the frame rate of the ranging sensor can be adjusted to the first frame rate (for example, a moderate 30FPS). The ranging sensor may cause data invalidation due to the long distance or other reasons, but the z-direction movement (that is, the subject moves in the vertical direction) will soon become a close distance, so the ranging frame rate of the ranging sensor. It cannot be too low to ensure the focusing performance in the current scene; or, when the distance of the photographed object in the first scene is greater than the first preset distance (for example, 3 meters) and less than the second preset distance (for example, 4 meters), the ranging frame rate of the ranging sensor can be increased to a fifth frame rate synchronized with the RGB frame rate in the image preview interface (for example, 60FPS synchronization, which can be the maximum frame rate of the ranging sensor and is not specifically limited in the embodiments of the present application), so that the ranging sensor can update the distance information more frequently, thereby providing a faster and more accurate focusing effect when photographing distant objects. In addition, the synchronization of the RGB frame rate and the ranging The frame rate can ensure that the exposure level of the image remains constant when performing distance measurement, thereby reducing image quality problems caused by inconsistent exposure; alternatively, when the target shooting scene is the second scene, the ranging frame rate of the ranging sensor can be increased. This is because in close-range shooting, the relative position between the object and the sensor may change rapidly. Increasing the ranging frame rate can capture these changes more quickly, thereby providing more accurate and timely distance information; alternatively, when the target shooting scene is the third scene, the ranging frame rate of the ranging sensor can be adjusted to a frame rate that is synchronized with the RGB frame rate frame in the target preview image. Integer multiple, because the preview frame rate is set in the third scene to eliminate or reduce the stripe effect, the ranging frame rate can be adjusted to be synchronized with the RGB frame rate of the preview image, so as to achieve better focusing and use more accurate distance information when focusing; or, when the target shooting scene is the fourth scene, the ranging frame rate of the ranging sensor can be adjusted to the ninth frame rate (for example, 15FPS is not synchronized). Since the fourth scene is a low-light scene, the exposure time needs to be extended, and the number of frames is relatively chaotic, the benefit of increasing the ranging frame rate is low, so in the fourth scene, choose to reduce the frame rate to reduce unnecessary resource consumption.In summary, in the embodiments of the present application, for the four different scenarios in the first mode, the ranging frame rate is increased for necessary scenarios where increasing the ranging frame rate can bring more benefits, and the ranging frame rate is reduced for non-essential scenarios with lower benefits. This flexible frame rate adjustment not only improves the focus accuracy and response speed, but also optimizes energy efficiency to adapt to various different shooting needs.

[0014] In a possible implementation, if the target shooting mode is the second mode; adjusting the ranging frame rate of the ranging sensor based on the target shooting mode and the target shooting scene includes: if the target shooting scene is the first scene, adjusting the ranging frame rate of the ranging sensor to a ninth frame rate synchronized with the RGB frame rate, wherein the ninth frame rate is less than the first frame rate; or, if the target shooting scene is the second scene, adjusting the ranging frame rate of the ranging sensor to the ninth frame rate synchronized with the RGB frame rate; or, if the target shooting scene is the third scene, adjusting the ranging frame rate of the ranging sensor to the ninth frame rate; or, if the target shooting scene is the fourth scene, adjusting the ranging frame rate of the ranging sensor to the ninth frame rate.

[0015] In an embodiment of the present application, the frame rate of the ranging sensor can be dynamically adjusted for different shooting scenes that appear in the second mode (for example, autofocus automatic AF-A mode). The second mode is usually used for shooting low-dynamic scenes or static objects. The response speed or accuracy of the focus system may be high enough. Increasing the frame rate of the ranging sensor cannot significantly improve the focusing performance. Therefore, in an embodiment of the present application, the frame rate of the ranging sensor in each scene can be maintained at 15FPS, which is no worse than the previous generation. Specifically, when shooting a distant object, for the first scene, the frame rate of the ranging sensor can be adjusted to a ninth frame rate (for example, 15 FPS) that is frame-synchronized with the RGB frame rate in the target preview image; or, when the target shooting scene is the second scene, the ranging frame rate of the ranging sensor can be adjusted to a ninth frame rate (for example, 15 FPS) that is frame-synchronized with the RGB frame rate in the target preview image; or, when the target shooting scene is the third scene, the ranging frame rate of the ranging sensor can be adjusted to the ninth frame rate (for example, 15 FPS is not synchronized); or, when the target shooting scene is the fourth scene, the ranging frame rate of the ranging sensor can be adjusted to the ninth frame rate (for example, 15 FPS is not synchronized); further, although lowering the ranging frame rate can reduce the delay time caused by focusing, for actions with faster movement speeds such as frisbees and basketballs, the action may end before the frame rate is raised, so a frame rate that is too low than 15 frames, such as 1 frame or 5 frames, is not desirable. In summary, in the embodiments of the present application, for the four different scenarios in the first mode, the ranging frame rate is reduced to reduce the consumption of system resources when the benefit of increasing the ranging frame rate is low, and the ranging frame rate is maintained at not less than the frame rate of the previous generation to ensure the most basic focusing performance, thereby reducing the ranging frame rate of non-essential scenarios and reducing the waste of system resources.

[0016] In a possible implementation, if the target shooting mode is the third mode; adjusting the ranging frame rate of the ranging sensor based on the target shooting mode and the target shooting scene includes: if the target shooting scene is the first scene, adjusting the ranging frame rate of the ranging sensor to a fifth frame rate synchronized with the RGB frame rate, wherein the fifth frame rate is less than the first frame rate; or, if the target shooting scene is the second scene, adjusting the ranging frame rate of the ranging sensor to the fifth frame rate synchronized with the RGB frame rate; or, if the target shooting scene is the third scene, adjusting the ranging frame rate of the ranging sensor to a seventh frame rate synchronized with the RGB frame rate or an eighth frame rate synchronized with the RGB frame rate, wherein both the seventh frame rate and the eighth frame rate are greater than the first frame rate; or, if the target shooting scene is the fourth scene, adjusting the ranging frame rate of the ranging sensor to a ninth frame rate, wherein the ninth frame rate is less than the first frame rate.

[0017] In the embodiment of the present application, the frame rate of the ranging sensor can be dynamically adjusted for different shooting scenes in the third mode (e.g., the all-focus continuous shooting mode in the autofocus full-time AF-F mode), and the third mode can be applicable to dynamic and complex shooting environments. Specifically, the third mode can continuously track multiple targets including fast-moving and static objects, ensuring that each frame can be accurately focused during the continuous shooting process, and is suitable for shooting scenes where the moving speed of objects is fast and unpredictable, such as sports events, wildlife photography, and fast dynamics. Further, when the target shooting scene is the first scene, the ranging frame rate of the ranging sensor can be increased to a fifth frame rate synchronized with the RGB frame rate in the image preview interface (for example, 60FPS synchronization, the frame rate can be the maximum frame rate of the ranging sensor, and is not specifically limited in the embodiments of the present application), so that the ranging sensor can update the distance information more frequently, thereby providing a faster and more accurate focusing effect when shooting distant objects; or, when the target shooting scene is the second scene, since the relative position between the object and the sensor may change rapidly in close-range shooting, the ranging frame rate of the ranging sensor can be increased (for example, the ranging frame rate of the ranging sensor is adjusted to the fifth frame rate synchronized with the RGB frame rate in the target preview image), so as to achieve a better tracking focus effect; or, when the target shooting scene is the third scene, the ranging frame rate of the ranging sensor can be adjusted to the fifth frame rate synchronized with the RGB frame rate in the target preview image. The RGB frame rate in the preview image is an integer multiple of the frame rate of the frame synchronization (for example, the ranging frame rate of the ranging sensor is adjusted to the seventh frame rate of the frame synchronization with the RGB frame rate in the target preview image or the eighth frame rate of the frame synchronization). Because the stripe effect is eliminated or reduced by setting the preview frame rate in the third scene, the ranging frame rate can be adjusted to be synchronized with the RGB frame rate of the preview image to perform better focusing and use more accurate distance information when focusing; or, when the target shooting scene is the fourth scene, the ranging frame rate of the ranging sensor can be adjusted to the ninth frame rate (for example, 15FPS is not synchronized). Since the fourth scene is a low-light scene, the exposure time needs to be extended, and the number of frames is relatively chaotic, the benefit of increasing the ranging frame rate is low, so the ranging frame rate is fixed at a lower value (for example, 15FPS is not synchronized), and the frame rate is lowered in the fourth scene to reduce unnecessary resource consumption. In summary, in the embodiments of the present application, for the four different scenes in the third mode, the ranging frame rate is increased for necessary scenes where increasing the ranging frame rate can bring more benefits, and the ranging frame rate is reduced for non-essential scenes with lower benefits. This flexible frame rate adjustment not only improves the focusing accuracy and response speed, but also optimizes energy efficiency to adapt to various shooting needs. In addition, the Everything Focus Continuous Shooting mode significantly reduces the blur and reshoots caused by inaccurate focusing by optimizing the focusing system, thereby improving shooting efficiency. In this mode, the camera can adapt to scene changes more quickly and adjust the focus point in time to ensure clear images under changing shooting conditions.

[0018] In a possible implementation, in response to the first operation, starting the target shooting mode and displaying the target preview image in the shooting preview area include: if the target shooting mode is switched from the first mode or the third mode to the second mode, adjusting the ranging frame rate of the ranging sensor to a fifth frame rate, the fifth frame rate being greater than the first frame rate; or, if the target shooting mode is switched from the second mode to the first mode or the third mode, adjusting the ranging frame rate of the ranging sensor to a ninth frame rate, the ninth frame rate being less than the first frame rate. In the embodiment of the present application, by presetting a ranging sensor frame rate that is more in line with the mode application scenario for different focus modes, the system waiting time for loading can be reduced. Specifically, assuming that the first mode and the third mode are both AF-F (auto focus full-time) modes, and assuming that the second mode is AF-A (auto focus single-shot) mode, when the AF-A (auto focus single-shot) mode is switched to the AF-F (auto focus full-time) mode, the ranging frame rate of a preset ranging sensor (e.g., a matrix laser TOF sensor) can be set to a fifth frame rate (e.g., 60FPS), so that the camera can quickly adapt to dynamic scenes, especially when capturing moving objects, to ensure a continuous and stable focusing effect; when the target shooting mode is switched from the AF-F mode to the AF-A mode, the TOF frame rate can be preset to a ninth frame rate (e.g., 15FPS). Since the AF-A mode is generally suitable for static or little-changing shooting environments, a lower frame rate setting is beneficial to reducing energy consumption and extending the service life of the device, while maintaining high-quality images without frequent focus adjustments. In summary, by setting an adaptive default ranging frame rate for different shooting modes, the camera can avoid the delay caused by determining the preview image parameters. This strategy of automatically adjusting the frame rate provides users with greater flexibility and control in different shooting environments, optimizing the shooting effect and user experience.

[0019] In a second aspect, an embodiment of the present application provides a device for frame rate control of focus tracking, the device comprising a camera module, the camera module comprising a camera and a ranging sensor; and may include:

[0020] A display unit, configured to display a first user interface, wherein the first user interface includes a shooting preview area and a plurality of shooting controls, wherein the shooting preview area is configured to display an image captured by the camera;

[0021] A receiving unit, configured to receive a first operation, where the first operation is an operation on a target shooting control among the multiple shooting controls;

[0022] a shooting mode unit, responsive to the first operation, starting a target shooting mode and displaying a target preview image in the shooting preview area;

[0023] A shooting scene unit, used to determine image parameters of the target preview image, and determine a target shooting scene based on the image parameters;

[0024] The frame rate adjustment unit adjusts the ranging frame rate of the ranging sensor based on the target shooting mode and the target shooting scene.

[0025] In the prior art, the focus tracking effect of taking photos is usually adjusted by adjusting the automatic exposure module. However, in actual usage scenarios, continuous high frame rate ranging may lead to a significant increase in energy consumption, which is particularly obvious for long-term or continuous use. In non-critical scenarios, high frame rate ranging may not be necessary, and the improvement brought by maintaining a high frame rate is limited, which leads to unnecessary consumption of system resources and excessive load on the equipment. In response to this technical problem, in the embodiment of the present application, the ranging frame rate of the ranging sensor can be adjusted based on the shooting mode selected by the user and the shooting scene confirmed in the preview image of the user interface. While giving priority to ensuring the focus tracking effect of the necessary scenes, the frame rate of non-essential scenes can be reduced to reduce energy consumption in non-critical scenes. Specifically, in an embodiment of the present application, a user can select a target shooting mode (such as an autofocus automatic mode, an autofocus full-time mode, a focus tracking mode, etc.) by clicking a shooting control in a shooting preview area, and determine a target shooting scene based on image parameters in a preview image acquired by a camera (such as ambient brightness, stripe effect detection results, and the distance of a shooting object), such as a long-distance scene, a non-long-distance-preview = 30 frames (Frames Per Second, FPS) scene, a non-long-distance-debanding preview 24 / 25fps scene, and a non-long-distance-low-brightness preview <30fps scene. One or more of the above scenes. Furthermore, in different shooting modes and for different shooting scenes, the ranging frame rate adjustment scheme of the ranging sensor may be different, and the ranging frame rate of the ranging sensor is dynamically adjusted based on the shooting mode and the shooting environment. In summary, in the embodiments of the present application, after the user selects the target shooting mode, the current shooting scene can be determined based on the parameters in the preview image, and the ranging frame rate of the ranging sensor can be dynamically adjusted based on different shooting modes and different shooting scenes. The frame rate can be increased in scenes and modes that require quick response and precise focus, and the frame rate can be reduced when the focus requirement is low and the benefit of increasing the ranging frame rate of the ranging sensor is low, thereby improving the focusing effect and effectively controlling resource consumption.

[0026] In a possible implementation, the shooting scene unit is used to:

[0027] Determine the distance of the photographed object in the target preview image by using the ranging sensor;

[0028] The camera determines the stripe effect detection result and the RGB frame rate in the target preview image.

[0029] In a possible implementation, the shooting scene unit is specifically used to:

[0030] If the distance to the photographed object is greater than a first preset distance, then determining that the target photographing scene is a first scene; or,

[0031] If the distance of the photographed object is less than the first preset distance, and the RGB frame rate of the target preview image is the first frame rate, then the target photographing scene is determined to be the second scene, wherein the first frame rate is the default frame rate of the RGB frame rate in the target preview image; or,

[0032] If the distance of the photographed object is less than the first preset distance, and the RGB frame rate of the target preview image is the second frame rate or the third frame rate, then the target photographing scene is determined to be the third scene, wherein the second frame rate and the third frame rate are both less than the first frame rate, and the second frame rate or the third frame rate is the frame rate adjusted after performing streak effect detection; or,

[0033] If the distance of the photographed object is less than the first preset distance and the RGB frame rate of the target preview image is a fourth frame rate, it is determined that the target photographing scene is a fourth scene, wherein the fourth frame rate is less than the first frame rate.

[0034] In a possible implementation manner, the device further includes:

[0035] The preview frame rate adjustment unit adjusts the RGB frame rate in the target preview image to the second frame rate or the third frame rate if the distance of the photographed object is less than the first preset distance and the stripe effect detection result is that the stripe effect exists.

[0036] In a possible implementation, the target shooting mode includes a first mode, a second mode and a third mode, wherein the first mode includes performing a continuous focus single shot on the shooting object based on the target preview image, the second mode includes performing a single focus single shot or a continuous focus single shot on the shooting object based on the target preview image, and the third mode includes performing continuous focus continuous shooting on the shooting object based on the target preview image.

[0037] In a possible implementation, if the target shooting mode is the first mode;

[0038] The frame rate adjustment unit is specifically used for:

[0039] If the target shooting scene is the first scene, and the distance to the shooting object is greater than a second preset distance or the data acquired by the ranging sensor is invalid, the ranging frame rate of the ranging sensor is adjusted to the first frame rate synchronized with the RGB frame rate, wherein the second preset distance is greater than the first preset distance; or

[0040] If the target shooting scene is the first scene, and the distance of the shooting object is greater than the first preset distance and less than the second preset distance, the ranging frame rate of the ranging sensor is adjusted to a fifth frame rate synchronized with the RGB frame rate, wherein the fifth frame rate is greater than the first frame rate; or

[0041] If the target shooting scene is the second scene, the ranging frame rate of the ranging sensor is adjusted to the fifth frame rate or the sixth frame rate synchronized with the RGB frame rate, wherein the sixth frame rate is greater than the first frame rate; or

[0042] If the target shooting scene is the third scene, the ranging frame rate of the ranging sensor is adjusted to a seventh frame rate synchronized with the RGB frame rate or an eighth frame rate synchronized with the RGB frame rate, or the sixth frame rate, wherein the seventh frame rate and the eighth frame rate are both greater than the first frame rate; or

[0043] If the target shooting scene is the fourth scene, the ranging frame rate of the ranging sensor is adjusted to a ninth frame rate, wherein the ninth frame rate is smaller than the first frame rate.

[0044] In a possible implementation, if the target shooting mode is the second mode;

[0045] The frame rate adjustment unit is specifically used for:

[0046] If the target shooting scene is the first scene, adjusting the ranging frame rate of the ranging sensor to a ninth frame rate synchronized with the RGB frame rate, wherein the ninth frame rate is smaller than the first frame rate; or

[0047] If the target shooting scene is the second scene, adjusting the ranging frame rate of the ranging sensor to the ninth frame rate that is synchronized with the RGB frame rate; or,

[0048] If the target shooting scene is the third scene, adjusting the ranging frame rate of the ranging sensor to the ninth frame rate; or,

[0049] If the target shooting scene is the fourth scene, the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate.

[0050] In a possible implementation, if the target shooting mode is the third mode;

[0051] The frame rate adjustment unit is specifically used for:

[0052] If the target shooting scene is the first scene, adjusting the ranging frame rate of the ranging sensor to a fifth frame rate that is synchronized with the RGB frame rate, wherein the fifth frame rate is less than the first frame rate; or

[0053] If the target shooting scene is the second scene, adjusting the ranging frame rate of the ranging sensor to the fifth frame rate that is synchronized with the RGB frame rate; or,

[0054] If the target shooting scene is the third scene, the ranging frame rate of the ranging sensor is adjusted to a seventh frame rate synchronized with the RGB frame rate or an eighth frame rate synchronized with the RGB frame rate, wherein the seventh frame rate and the eighth frame rate are both greater than the first frame rate; or

[0055] If the target shooting scene is the fourth scene, the ranging frame rate of the ranging sensor is adjusted to a ninth frame rate, wherein the ninth frame rate is smaller than the first frame rate.

[0056] In a possible implementation, the shooting mode unit is specifically configured to:

[0057] If the target shooting mode is switched from the first mode or the third mode to the second mode, the ranging frame rate of the ranging sensor is adjusted to a fifth frame rate, the fifth frame rate being greater than the first frame rate; or

[0058] If the target shooting mode is switched from the second mode to the first mode or the third mode, the ranging frame rate of the ranging sensor is adjusted to a ninth frame rate, which is smaller than the first frame rate.

[0059] In a third aspect, an embodiment of the present application provides a computer storage medium for storing computer software instructions used in a device for controlling the frame rate of focus tracking provided in the second aspect, which includes a program designed for executing the above aspect.

[0060] In a fourth aspect, an embodiment of the present application provides a computer program, which includes instructions. When the computer program is executed by a computer, the computer can execute the process executed in the device for controlling the frame rate of focus tracking in the second aspect above. BRIEF DESCRIPTION OF THE DRAWINGS

[0061] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the background technology, the drawings required for use in the embodiments of the present application or the background technology will be described below.

[0062] Figure 1A It is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application.

[0063] Figure 1B It is a schematic diagram of the hardware structure of another electronic device provided in an embodiment of the present application.

[0064] Figure 1C It is a schematic diagram of the software structure of the electronic device provided in the embodiment of the present application.

[0065] Figure 2A It is a schematic diagram of a frame rate control module for focus tracking provided in an embodiment of the present application.

[0066] Figure 2B This is a schematic diagram of another frame rate control module for focus tracking provided in an embodiment of the present application.

[0067] Figure 2C This is a schematic diagram of a frame rate control module for focus tracking provided in an embodiment of the present application.

[0068] Figure 3A It is a flow chart of frame rate control for focus tracking provided in an embodiment of the present application.

[0069] Figure 3B It is a schematic diagram of a user interface provided in an embodiment of the present application.

[0070] Figure 3C This is another user interface schematic diagram provided in an embodiment of the present application.

[0071] Figure 3D This is another user interface schematic diagram provided in an embodiment of the present application.

[0072] Figure 3E This is an example diagram of a scenario provided in an embodiment of the present application.

[0073] Figure 3F It is a timing diagram provided in an embodiment of the present application.

[0074] Figure 4 A schematic diagram of a scene strategy in a shooting mode provided in an embodiment of the present application.

[0075] Figure 5A A schematic diagram of a scene of a first mode provided in an embodiment of the present application.

[0076] Figure 5B A schematic diagram of a scene of a first mode provided in an embodiment of the present application.

[0077] Figure 6 A schematic diagram of a scenario of a second mode provided in an embodiment of the present application.

[0078] Fig. 7A A schematic diagram of opening a third mode provided in an embodiment of the present application.

[0079] Figure 7B A schematic diagram of a long-distance scene in a third mode provided in an embodiment of the present application.

[0080] Figure 7C A schematic diagram of a close-range scene of a third mode provided in an embodiment of the present application.

[0081] Fig.7D A schematic diagram of a scene of a stripe effect provided in an embodiment of the present application.

[0082] Fig. 7E A schematic diagram of a low-light scene in a third mode provided in an embodiment of the present application.

[0083] Figure 7F This is a schematic diagram of a long-distance continuous shooting scene in a third mode provided in an embodiment of the present application. DETAILED DESCRIPTION

[0084] The embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

[0085] The terms "first", "second", "third" and "fourth" etc. in the specification and claims of the present application and the drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices.

[0086] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0087] The terms "component", "module", "system", etc. used in this specification are used to represent computer-related entities, hardware, firmware, a combination of hardware and software, software, or software in execution. For example, a component can be, but is not limited to, a process running on a processor, a processor, an object, an executable file, an execution thread, a program and / or a computer. By way of illustration, both applications running on a computing device and a computing device can be components. One or more components may reside in a process and / or an execution thread, and a component may be located on a computer and / or distributed between two or more computers. In addition, these components may be executed from various computer-readable media having various data structures stored thereon. For example, a component may communicate through a local and / or remote process according to a signal having one or more data packets (e.g., data from two components interacting with another component between a local system, a distributed system and / or a network, such as the Internet interacting with other systems through signals).

[0088] First, some terms in this application are explained to facilitate understanding by those skilled in the art.

[0089] (1) Subject Tracking is a photography technique used to continuously track the focus of a specific subject (such as a person, animal, or vehicle). This technique ensures that the subject remains clear while moving, which is important in fast-moving environments such as sports photography, wildlife photography, and news photography. Furthermore, modern cameras use image recognition and tracking algorithms to achieve this function, which can effectively lock and track the target subject under complex backgrounds or lighting conditions.

[0090] (2) Motion Tracking is a photography technique that focuses on the precise tracking of moving objects. This technique is suitable for capturing fast-moving objects, such as athletes, flying birds, or fast-moving vehicles. Its purpose is to create a dynamic blurred background by adjusting the shutter speed and focus while maintaining the clarity of the moving subject, thereby emphasizing the sense of speed and smoothness of movement. Motion Tracking is more important in sports events, natural wildlife photography, and high-speed action scene photography. Modern cameras and video equipment use complex algorithms and sensor technologies to achieve rapid response and continuous tracking of moving objects.

[0091] (3) Autofocus (AF) is a photographic technology that enables the camera and lens system to automatically adjust the focus point and ensure a clear image. The AF system uses a variety of sensors, algorithms, and mechanical components to detect and adjust the focus. It is more important for fast-moving scenes, low-light environments, or shooting situations that require high professional skills. There are two main types of autofocus technology: phase detection AF (fast, suitable for tracking dynamic objects) and contrast detection AF (highly accurate, but relatively slow). With technological advances, modern cameras usually combine the advantages of these two systems to provide more flexible and efficient autofocus solutions.

[0092] (4) Auto Exposure (AE), a photography technique that allows the camera to automatically adjust exposure parameters such as aperture size, shutter speed and ISO value (sensitivity) to ensure that the image has appropriate brightness and contrast; this technology is more important under variable lighting conditions, especially in fast shooting environments, so that photographers do not need to manually adjust all exposure settings, so that they can focus more on composition and creative expression. The AE system in modern cameras usually includes multiple modes, such as evaluative metering, center-weighted metering and spot metering, to adapt to different shooting scenes and subject requirements.

[0093] (5) Preview Frame Rate: refers to the frame rate of the camera when previewing the image before taking a photo or recording a video. Frame rate, that is, the number of image frames transmitted per second, is an important indicator for measuring video smoothness. In photography or videography, the preview frame rate directly affects whether the scene in progress can be accurately captured and evaluated.

[0094] (6) TOF (Time of Flight): A measurement technology used to determine the distance between an object and a sensing device. It works by sending a light signal (usually a laser) to the target object and measuring the time it takes for the light signal to travel back and forth. In photography and videography, TOF sensors are often used for depth perception, helping to improve autofocus speed and accuracy, especially in low-light environments. In addition, TOF technology is also used in fields such as augmented reality (AR) and virtual reality (VR), as well as certain types of 3D modeling and facial recognition technology.

[0095] (7) RGB (Red, Green, Blue): RGB refers to red, green, and blue, which are used as the basic colors for creating color images on electronic displays. In digital imaging, the RGB model is widely used in the display and sensing systems of various devices, including televisions, computer screens, cameras, and scanners. The RGB model is based on the human eye's sensitivity to red, green, and blue light, and a wide range of colors can be produced by combining these three colors at different intensities. In photography, the camera's sensor usually uses RGB filters to capture color images.

[0096] (8) Banding refers to a visual artifact that occurs in digital images, where there is a noticeable separation or "banding" between colors or gray levels that should transition smoothly. This effect is usually more noticeable in shadow or gradient areas of an image, especially when the image contains large areas of the same hue.

[0097] (9) Frame rate (FPS) is a definition in the field of graphics, which refers to the number of frames transmitted per second. In layman's terms, it refers to the number of frames in an animation or video. FPS measures the amount of information used to save and display dynamic video. The more frames per second, the smoother the displayed motion will be. Generally, the minimum to avoid jerky motion is 30. Some computer video formats can only provide 15 frames per second.

[0098] To facilitate understanding of the embodiments of the present application, an exemplary electronic device provided in the embodiments of the present application is first introduced below.

[0099] See also Figure 1A , Figure 1A 1 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. The electronic device 100 is a smart terminal device and can be of various types. The embodiment of the present application does not limit its specific type. For example, the terminal device can be a mobile phone, and can also include a tablet computer, a desktop computer, a desktop computer with a touch-sensitive surface or a touch panel, a laptop computer (laptop), a handheld computer, a notebook computer, a smart screen, a wearable device (such as a smart watch, a smart bracelet, etc.), an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, etc. Figure 1A As shown, the electronic device 100 may include a rear camera 011 and a sensor 012, and the sensor 012 may be a distance measurement sensor implemented by a variety of distance measurement methods such as time of flight distance measurement (Time of Flight, TOF), structured light distance measurement, binocular distance measurement, laser distance measurement, etc. Assuming that the current distance measurement method is direct time of flight distance measurement (Direct Time of Flight, DTOF) in matrix laser TOF distance measurement, the sensor 012 may be configured with a transmitter 012A and a receiver 012B, and the specific working process is: the transmitter emits a light pulse to the object, and the object can reflect the light beam, and the sensor at the receiving end can receive the reflected light pulse. The time interval between the reflected light pulse and the emitted light pulse can be obtained by measurement, and the time interval is the flight time of light. Based on the flight time of light and the speed of light, the object distance can be obtained.

[0100] Matrix laser TOF ranging can also be an indirect time of flight ranging device (Indirect Time of Flight, ITOF). The ITOF ranging device is also equipped with a transmitter and a receiver. Unlike the DTOF device, the light pulses emitted by the ITOF device are modulated by a sine wave, and are optical signals with regular changes in light and dark intensity. After these light pulses are irradiated on the surface of the object, they will be reflected back as is and captured by the ITOF receiving end. Since the emitted light pulses and reflected light pulses of the ITOF device show regular changes, by comparing the signal difference between the emitted light pulses and the reflected light pulses, the flight time in between can be indirectly calculated, and then the object distance can be obtained.

[0101] It should be noted that in addition to being used in autofocus scenarios, TOF devices can also be used in scenarios such as face recognition and gesture recognition, which will not be elaborated here.

[0102] With the continuous development of terminal technology, the functions that can be realized by the camera modules of electronic devices are gradually enriched. For example, the camera module can realize automatic focus, optical image stabilization, and long-distance clear imaging. In order to realize the above functions, electronic devices are generally equipped with multiple camera modules.

[0103] Exemplarily, the camera module may be a module for realizing an autofocus function, which may specifically include a lens assembly, an image sensor, and an image signal processor. Some camera modules are also equipped with a distance measurement module, etc. Among them, the lens assembly is used to receive light signals from the outside world and focus them on the image sensor. The distance measurement module can emit light pulses to the outside world, and can receive reflected pulses of light pulses, and then can obtain the distance between the object and the distance measurement module based on the flight time of light. The camera module can then adjust the distance between the lens assembly and the image sensor based on the distance to achieve clear imaging.

[0104] It can be seen that the camera module has a certain light transmission range, and the light signal enters or exits the camera module within the light transmission range. Since both the lens assembly and the distance measurement module need to transmit light, the light transmission range of the camera module is generally large. However, an excessively large light transmission range will increase the difficulty of the layout of the camera module, not only occupying too much layout space, but also affecting the aesthetics of the electronic device.

[0105] See also Figure 1B , Figure 1B This is a schematic diagram of the hardware structure of another electronic device provided in an embodiment of the present application. Figure 1B The components of the electronic device 100 are described in detail:

[0106] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a ranging sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0107] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0108] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0109] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0110] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0111] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0112] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0113] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100. While the charging management module 140 is charging the battery 142, it may also power the electronic device through the power management module 141.

[0114] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0115] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0116] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0117] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0118] The modem processor may include a modulator and a demodulator. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and may be arranged in the same device as the mobile communication module 150 or other functional modules.

[0119] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0120] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0121] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0122] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0123] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0124] The ISP (image signal processor) works in conjunction with the camera 193 to process the data captured by the camera. During the photo shooting process, when the shutter is opened, light is transmitted to the image sensor through the lens, and the automatic exposure module adjusts the exposure parameters to capture the best light. The image sensor, such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor, converts the light signal into an electrical signal. Subsequently, these electrical signals are transmitted to the ISP for processing and converted into digital image signals, which are optimized by the ISP algorithm, such as noise reduction, brightness adjustment, and color optimization, and then output to the DSP (digital signal processor) for further processing. The DSP converts the digital image signal into a standard RGB, YUV, etc. format image signal. In some embodiments, the electronic device 100 may include one or more (N, N is a positive integer greater than 1) such cameras 193, each of which integrates an ISP and an AE module to provide high-quality image capture and processing capabilities. In the embodiment of the present application, the ISP (image signal processor) works in conjunction with the camera 193 to obtain the RGB frame rate of the preview image, and detect the ambient brightness and exposure settings based on the RGB frame rate.

[0125] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0126] Video codecs are used to compress or decompress digital videos. The electronic device 100 may support one or more video codecs. Thus, the electronic device 100 may play or record videos in a variety of coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0127] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0128] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0129] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0130] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0131] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

[0132] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or listen to a hands-free call through the speaker 170A.

[0133] The receiver 170B, also called a "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or voice message, the voice can be received by placing the receiver 170B close to the human ear.

[0134] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to microphone 170C to input the sound signal into microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the sound source, realize directional recording function, etc.

[0135] The earphone interface 170D is used to connect a wired earphone and can be a USB interface 130 or a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association (CTIA) standard interface.

[0136] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the touch operation intensity according to the pressure sensor 180A. The electronic device 100 can also calculate the touch position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.

[0137] The gyro sensor 180B may be used to determine the motion posture of the electronic device 100 .

[0138] The air pressure sensor 180C is used to measure air pressure.

[0139] The magnetic sensor 180D includes a Hall sensor.

[0140] The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in all directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and is applied to applications such as horizontal and vertical screen switching and pedometers.

[0141] The distance sensor 180F is usually used to measure the distance between an object and a device, and can provide accurate distance data. The distance sensor 180F can be a matrix laser time of flight (TOF) sensor, which uses laser pulses to measure the time it takes for light waves to travel back and forth between the sensor and the object, thereby accurately calculating the distance. The matrix laser TOF sensor can not only measure the distance of a single point, but also capture the depth information of the entire scene through a matrix arrangement, providing data for three-dimensional imaging and advanced scene analysis. These sensors are important in a variety of applications, such as in autofocus camera systems, gesture recognition, augmented reality, and obstacle detection. Its precise distance measurement capability enables electronic devices to better understand and interact with the environment in which they are located. In an embodiment of the present application, the distance sensor 180F is used to determine the distance of the object in the preview image. In addition, the decision module in the camera can adjust the distance measurement frame rate of the distance sensor 180F based on the change of the shooting mode and the shooting scene. Optionally, the distance sensor 180F can also work in conjunction with the motor 191 to achieve the function of measuring the distance between the object and the device.

[0142] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector such as a photodiode.

[0143] The ambient light sensor 180L is used to sense the brightness of the light in the surrounding environment and works closely with the AE module to optimize the shooting experience. When the user is ready to take a photo, the ambient light sensor first measures the light intensity of the current scene, and this information is then passed to the automatic exposure module. In an embodiment of the present application, the automatic exposure module can adjust the camera settings, such as aperture size, exposure time, and ISO sensitivity, through the data obtained by the ambient light sensor 180L to ensure the quality of the preview image when shooting. In particular, in terms of processing RGB frame rates, the input of the ambient light sensor directly affects the color balance and brightness level of the image. This dynamic adjustment ensures that under different lighting conditions, whether in strong light or dim light environments, users can obtain preview images with vivid colors and moderate brightness. Therefore, the ambient light sensor 180L not only simply senses the brightness of light, but also provides the AE module with necessary information throughout the image capture process to achieve the best image capture effect.

[0144] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.

[0145] The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy.

[0146] The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.

[0147] The bone conduction sensor 180M can obtain a vibration signal. In some embodiments, the bone conduction sensor 180M can obtain a vibration signal of a vibrating bone block of the vocal part of the human body. The bone conduction sensor 180M can also contact the human pulse to receive a blood pressure beat signal. In some embodiments, the bone conduction sensor 180M can also be set in an earphone and combined into a bone conduction earphone. The audio module 170 can parse out a voice signal based on the vibration signal of the vibrating bone block of the vocal part obtained by the bone conduction sensor 180M to realize a voice function. The application processor can parse the heart rate information based on the blood pressure beat signal obtained by the bone conduction sensor 180M to realize a heart rate detection function.

[0148] The key 190 includes a power key, a volume key, etc. The key 190 may be a mechanical key or a touch key. The electronic device 100 may receive key input and generate key signal input related to user settings and function control of the electronic device 100.

[0149] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0150] Indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, messages, missed calls, notifications, etc.

[0151] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to and separated from the electronic device 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0152] The software system of the electronic device 100 may adopt a layered architecture. Figure 1C It is a schematic diagram of the software structure of the electronic device provided in the embodiment of the present application.

[0153] The layered architecture divides the system into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the system is divided into five layers, from top to bottom: application layer, application framework layer, hardware abstraction layer, driver layer, and hardware layer.

[0154] The application layer may include a series of application packages. In the embodiment of the present application, the application package may include a camera, a gallery, etc.

[0155] The application framework layer provides an application programming interface (API) and a programming framework for the application of the application layer. The application framework layer includes some predefined functions. In an embodiment of the present application, the application framework layer may include a camera access interface, wherein the camera access interface may include camera management and camera devices. The camera access interface is used to provide an application programming interface and a programming framework for camera applications.

[0156] The hardware abstraction layer is an interface layer between the application framework layer and the driver layer, and provides a virtual hardware platform for the operating system. In the embodiment of the present application, the hardware abstraction layer may include a camera hardware abstraction layer and a camera algorithm library.

[0157] The camera hardware abstraction layer may provide virtual hardware for camera device 1, camera device 2 or more camera devices. The camera algorithm library may include operating codes and data for implementing the shooting method provided in the embodiment of the present application.

[0158] The driver layer is a layer between hardware and software. The driver layer includes drivers for various hardware. The driver layer may include camera device drivers, digital signal processor drivers, and image processor drivers.

[0159] The camera hardware layer may include sensors, image signal processors, digital signal processors, and image processors. Sensors may include sensor 1, sensor 2, TOF, and multispectral sensors. The hardware layer is also connected to the driver layer, which includes camera device drivers, digital signal processor drivers, and image processor drivers. These drivers are responsible for converting high-level commands from the operating system or application into instructions that the camera hardware can understand and execute.

[0160] The camera device driver is used to drive the image sensor of the camera to collect images and drive the image signal processor to pre-process the images. The digital signal processor driver is used to drive the digital signal processor to process images. The image processor driver is used to drive the graphics processor to process images.

[0161] In combination with the above software structure, the following exemplarily illustrates the software and hardware workflow of the embodiment of the present application when taking photos by using the electronic device 100.

[0162] In response to the user's operation of opening the camera application, such as clicking the camera application icon, the camera application calls the camera access interface of the application framework layer to start the camera application, and then sends an instruction to start the camera by calling the camera device (camera device and / or other camera devices) in the camera hardware abstraction layer. The camera hardware abstraction layer sends the instruction to the camera device driver of the kernel layer. The camera device driver can start the image sensor of the corresponding camera and collect the image light signal through the image sensor. A camera device in the camera hardware abstraction layer corresponds to an image sensor in the hardware layer.

[0163] Then, the camera's image sensor can transmit the collected image light signal to the image signal processor for preprocessing to obtain an image electrical signal (that is, the original image, such as a RAW image), and transmit the above original image to the camera hardware abstraction layer through the camera device driver.

[0164] The camera hardware abstraction layer can send the original image to the camera algorithm library. The camera algorithm library stores the program code for implementing the method for tracking the dynamic frame rate of the laser focus provided in the embodiment of the present application. Based on the digital signal processor and the image processor, the camera algorithm library executes the above code, so that the electronic device 100 can execute some or all steps of the method for tracking the dynamic frame rate of the laser focus provided in the embodiment of the present application.

[0165] The camera algorithm library can send the processed image (such as RGB image) to the camera hardware abstraction layer. Then, the camera hardware abstraction layer can send it for display. At the same time, the camera algorithm library can also perform various image processing tasks, such as noise reduction, color correction, contrast adjustment, etc., to improve image quality or perform specific computer vision tasks.

[0166] Optionally, the above-mentioned original image or the image processed by the camera algorithm library can be stored in a specific storage unit through the interface provided by the camera hardware abstraction layer. Furthermore, in response to the user's operation of opening the gallery application, such as clicking the gallery application icon and then clicking to view the image, the gallery application calls the corresponding interface to access the image data in the storage unit, and then calls the image decoding library to decode the stored image data into an image that can be displayed on the display screen, so as to be displayed in the application.

[0167] Understandably, Figure 1A-Figure 1C The system architecture in the embodiment is only one or more exemplary implementations in the embodiments of the present application. The structure in the embodiments of the present application includes but is not limited to the above system architecture.

[0168] Based on the above three system architectures, the present application embodiment provides a functional module applied in the above system architectures, see Figure 2A-2C , Figure 2A is a schematic diagram of a frame rate control module for focus tracking provided in an embodiment of the present application, such as Figure 2A As shown, the decision module may be in the AF module 1001; Figure 2B is a schematic diagram of another frame rate control module for focus tracking provided in an embodiment of the present application, such as Figure 2B As shown, the decision module may be in the AE module 1002; Figure 2C is a schematic diagram of a frame rate control module for focus tracking provided in an embodiment of the present application, such as Figure 2C As shown, the decision module can be an independent module connected to the AF module 1001 and the AE module 1002. Figure 2A The embodiment shown specifically describes the AF module 1001 and the AE module 1002 in the frame rate control module of the focus tracking.

[0169] AF module 1001: AF module 1001 integrates autofocus function and decision logic function, and optimizes focus performance based on information obtained by AE module 1002. AF module 1001 can detect distance and depth information in the scene based on sensors (such as one or more ranging sensors such as laser ranging sensors, phase detection sensors, contrast detection sensors, matrix laser TOF sensors, etc.), and AF module 1001 can also receive banding effect flags and RGB frame rate data obtained in AE module 1002, and based on this information, determine whether the current shooting environment is affected by banded light caused by fluorescent lighting, for example, and determine the smoothness of real-time preview or image capture. AF module 1001 can adjust different frame rate strategies based on different detected environments to prioritize the focus tracking effect and reduce the frame rate in non-essential scenes. For example, after detecting whether there is a banding phenomenon, the AF module 1001 can eliminate or reduce possible light flicker by adjusting the RGB frame rate in the preview image frame to ensure that the image quality is not affected; at the same time, the ranging frame rate information of the ranging sensor is used to determine the ranging speed per second in focusing, which is particularly critical for capturing dynamic scenes. If the RGB frame rate in the preview image is high, it means that the scene changes dynamically quickly, and the AF module 1001 will increase the ranging frame rate to keep up with the scene changes; if the RGB frame rate is low, it may mean that the scene is relatively static, and the AF module can reduce the ranging frame rate to improve efficiency. In addition, the AF module 1001 also determines whether autofocus and auto exposure need to be synchronized to maintain image consistency and quality.

[0170] AE module 1002: The AE module 1002 is responsible for measuring the light intensity of the scene and automatically adjusting the camera settings to ensure that the photo has proper exposure. In the embodiment of the present application, the AE module 1002 can obtain the bandingFlag and RGB frame rate from the preview image to the AF module 1001 as a decision condition to adjust different frame rate strategies. The AE module 1002 can also automatically adjust the camera's exposure settings, including aperture, shutter speed, and ISO value, to achieve optimal image brightness; the AE module 1002 can not only adjust the exposure parameters according to the scene brightness, but also monitor possible banding light effects, namely banding phenomena, and feedback this situation to the AF module 1001 through the banding Flag. In addition, the AE module continuously monitors and provides RGB frame rate data during real-time preview or video recording to ensure that the exposure settings can adapt to rapidly changing scenes and light conditions. The output of the AE module 1002 ensures that high-quality images can be obtained under various lighting conditions for the focus decision of the AF module 1001.

[0171] based on Figure 1A-Figure 1C The system architecture provided, and Figure 2AThe provided focus tracking frame rate control module, combined with the focus tracking frame rate control method provided in the embodiment of the present application, specifically analyzes and solves the technical problems raised in the present application.

[0172] See also Figure 3A , Figure 3A is a flow chart of a frame rate control of focus tracking provided by an embodiment of the present application. The method can be applied to the above Figure 1A-Figure 1C In the system architecture described in Figure 1A-Figure 1C The terminal device 100 in the embodiment can be used to support and execute Figure 3A The method flow shown in FIG. 1 includes steps S300 to S304. The method may include the following steps S300 to S304.

[0173] Step S300: displaying a first user interface.

[0174] Specifically, a first user interface is displayed, wherein the first user interface includes a shooting preview area and a plurality of shooting controls, wherein the shooting preview area is used to display the image captured by the camera. Figure 3B , Figure 3B is a schematic diagram of a user interface provided in an embodiment of the present application, Figure 3B The left side includes two people in motion. Figure 3B The right side includes a terminal device 200, and the terminal device 200 includes an image preview interface. The image preview interface displays the image captured by the camera in real time (i.e., the two people dancing on the left). The terminal device 200 may also include multiple shooting controls. You can view the taken pictures by clicking on the historical picture 401, take a single shot by clicking the shutter 402, and perform continuous shooting by pressing and holding the shutter 402. You can also click on the camera conversion 403 to switch between the front / rear camera, and click on the photo mode 404 to switch the photo mode.

[0175] Step S301: receiving a first operation.

[0176] Specifically, a first operation is received, where the first operation is an operation on a target shooting control among the multiple shooting controls. When the user performs an operation on one of the multiple optional shooting controls (for example, by touching the screen or using the camera conversion 403 to switch the front / rear camera button to select a specific camera perspective), the system will receive this operation. For example, see Figure 3C , Figure 3C is another user interface diagram provided in the embodiment of the present application. At this time, the user enters Figure 3C In the photo taking interface, the target shooting control may be AF-F mode 405 or AF-A mode 406, and the first operation may be that the user clicks on AF-F mode 405 or AF-A mode 406 to switch the shooting mode.

[0177] Step S302: In response to the first operation, start the target shooting mode.

[0178] Specifically, in response to the first operation, the target shooting mode is started, and the target preview image is displayed in the shooting preview area; the user can select the target shooting mode (such as auto focus AF-A single shooting mode, auto focus full time AF-F single shooting mode, all objects tracking continuous shooting mode, etc.) by clicking the shooting control in the shooting preview area, and the camera system immediately responds and enters a specific shooting state. For example, see Figure 3C , Figure 3C 406. The target shooting control may be one or more of AF-F mode 405 and AF-A mode 406. The first operation may be that the user can slide out AF-F mode 405 or AF-A mode 406 by pulling down the status bar, and then select the corresponding shooting mode by clicking AF-F mode 405 and AF-A mode 406 in the upper frame. At this time, the shooting preview area (for example, the display screen of the camera or the interface of the mobile phone application) will display the target preview image, allowing the user to see the scene captured by the current lens; for example, in wildlife photography, when the photographer selects the target shooting mode, the system will immediately display the captured animal image on the display screen, and update it in real time so that the photographer can make timely adjustments to the shooting angle and composition.

[0179] In one possible implementation, the types of target shooting modes include a first mode, a second mode, and a third mode, wherein the first mode includes performing a single shot with continuous focus on the shooting object based on the target preview image, the second mode includes performing a single shot with a single focus or a single shot with continuous focus on the shooting object based on the target preview image, and the third mode includes performing continuous focus on the shooting object based on the target preview image. Specifically, three different target shooting modes are provided in an embodiment of the present application, namely a first mode, a second mode, and a third mode, and users can select a suitable mode based on different application scenarios to obtain a better shooting experience. For example, see Figure 3D , Figure 3D406 and AF-A mode 406. The first operation may be that after the user clicks the first mode (e.g., AF-F mode 405), the user continuously focuses on the photographed object and takes a single shot by clicking the shutter 402 (i.e., the target photographing control). The first mode is suitable for dynamically changing photographing scenes to ensure that a clear photographing effect can be obtained even in a complex or unstable environment. In the second mode (e.g., AF-A mode 406), the system can adjust the focus according to the movement of the photographed object. The focus mode is automatically switched according to movement and environmental changes. At this time, the first operation can be that the user takes a single shot by clicking the shutter 402 (i.e., the target shooting control) to quickly and accurately lock the focus. In the second mode, the system can quickly and accurately lock the focus regardless of whether the object is still or moving; the continuous focus continuous shooting function of the third mode (e.g., the all-things tracking mode 404A) is more suitable for capturing continuous action or dynamic scenes. At this time, in the shooting of dynamic scenes such as sports events or natural animal activities, the first operation can be that the user presses the shutter 402 (i.e., the target shooting control) and does not release it for continuous shooting to ensure that each frame can be clearly recorded.

[0180] In a possible implementation, if the target shooting mode is switched from the first mode or the third mode to the second mode, the ranging frame rate of the ranging sensor is adjusted to a fifth frame rate, which is greater than the first frame rate; or, if the target shooting mode is switched from the second mode to the first mode or the third mode, the ranging frame rate of the ranging sensor is adjusted to a ninth frame rate, which is less than the first frame rate. Specifically, in the embodiment of the present application, by presetting a ranging sensor frame rate that is more in line with the mode application scenario for different focus modes, the system's waiting time for loading can be reduced. Specifically, assuming that the first mode and the third mode are both AF-F (auto focus full-time) modes, and assuming that the second mode is AF-A (auto focus single-shot) mode, when the AF-A (auto focus single-shot) mode is switched to the AF-F (auto focus full-time) mode, the ranging frame rate of a preset ranging sensor (e.g., a matrix laser TOF sensor) can be set to a fifth frame rate (e.g., 60FPS), so that the camera can quickly adapt to dynamic scenes, especially when capturing moving objects, to ensure a continuous and stable focusing effect; when the target shooting mode is switched from the AF-F mode to the AF-A mode, the TOF frame rate can be preset to a ninth frame rate (e.g., 15FPS). Since the AF-A mode is generally suitable for static or little-changing shooting environments, a lower frame rate setting is beneficial to reducing energy consumption and extending the service life of the device, while maintaining high-quality images without frequent focus adjustments. In summary, by setting an adaptive default ranging frame rate for different shooting modes, the camera can avoid the delay caused by determining the preview image parameters. This strategy of automatically adjusting the frame rate provides users with greater flexibility and control in different shooting environments, optimizing the shooting effect and user experience.

[0181] Step S303: determining image parameters of the target preview image, and determining the target shooting scene based on the image parameters.

[0182] Specifically, the system analyzes the target preview image and determines various key image parameters, such as lighting conditions, color balance, contrast, streak effects, etc. Based on these parameters, the system further determines the appropriate shooting scene. For example, if the captured preview image shows dim light, the system may determine that it is indoors or in a low-light environment, so it will adjust the corresponding scene settings to optimize the shooting effect, such as increasing the ISO value, reducing the aperture, etc., to ensure a clear image.

[0183] In a possible implementation, determining the image parameters of the target preview image includes: determining the distance of the photographed object in the target preview image by the ranging sensor; and determining the stripe effect detection result and the RGB frame rate in the target preview image by the camera. In an embodiment of the present application, the image parameters of the target preview image can be based on the precise distance of the photographed object measured by the ranging sensor (for example, a matrix laser TOF sensor), and the stripe effect detection result and the RGB frame rate in the target preview image determined by the camera (for example, an automatic exposure module therein). Subsequently, based on the parameters in the preview image, the system can better identify the current shooting environment, and adjust the ranging frame rate of the ranging sensor based on the corresponding shooting mode, so as to provide users with a better shooting experience.

[0184] In a possible implementation, if the distance to the photographed object is greater than a first preset distance, the target photographing scene is determined to be a first scene; or, if the distance to the photographed object is less than the first preset distance and the RGB frame rate of the target preview image is a first frame rate, the target photographing scene is determined to be a second scene, wherein the first frame rate is a default frame rate of the RGB frame rate in the target preview image; or, if the distance to the photographed object is less than the first preset distance and the RGB frame rate of the target preview image is a second frame rate or a third frame rate, the target photographing scene is determined to be a third scene, wherein both the second frame rate and the third frame rate are less than the first frame rate, and the second frame rate or the third frame rate is a frame rate adjusted after performing streak effect detection; or, if the distance to the photographed object is less than the first preset distance and the RGB frame rate of the target preview image is a fourth frame rate, the target photographing scene is determined to be a fourth scene, wherein the fourth frame rate is less than the first frame rate.

[0185] In the embodiment of the present application, the current shooting scene can be determined based on different image parameters in the preview image; the shooting scene can be based on the distance of the shooting object detected by the ranging sensor (such as a matrix laser TOF sensor), the RGB frame rate of the preview image, and whether the stripe effect appears to distinguish different shooting scenes, wherein the distance of the shooting object will directly affect the composition and focus of the shooting, the ambient brightness can be detected based on the RGB frame rate of the preview image, and the ambient brightness affects the exposure level of the shooting, and the stripe effect will directly affect the visual effect in the shooting. For example, see Figure 3E , Figure 3E This is a scene example diagram provided in an embodiment of the present application. Figure 3EThe first scene 201-A, the second scene 201-B, the stripe effect scene 201-C and the fourth scene 201-D may be included; further, as shown in the first scene 201-A, if it is detected that the distance of the photographed object is an effective long distance exceeding the first preset distance (for example, it exceeds 3 meters of the first preset distance, but does not exceed the farthest ranging range of 4 meters of the ranging sensor), then the current shooting mode is judged to be the first scene. In the first scene, when the photographed object is beyond the laser shooting range, the laser ranging can be turned off to reduce unnecessary resource consumption; the judgment of the shooting scene can also be combined with the stripe effect in the preview image. The detection result and RGB frame rate should be determined. As shown in the second scene 201-B, when it is detected that the distance of the photographed object is a short distance less than the first preset distance, if the RGB frame rate in the current preview image is the first frame rate (the first frame rate can be the default RGB frame rate in the preview image with a frame rate greater than the preset low-brightness RGB frame rate, such as 30FPS), the current scene is determined to be the second scene (e.g., non-long-distance-preview=30FPS scene). In the second scene, the ranging frame rate of the ranging sensor can be increased to ensure more accurate focus. As shown in the streak effect scene 201-C, when the distance of the photographed object is above When the distance is short, if the RGB frame rate in the current preview image is the second frame rate or the third frame rate (the second frame rate or the third frame rate may be the default RGB frame rate in the preview image after eliminating the stripe effect, such as 24 / 25FPS), the current scene is determined to be the third scene (such as a non-long-distance-debanding preview 24 / 25fps scene). Because the stripe effect is eliminated or reduced by setting the preview frame rate in the third scene, the ranging frame rate may be adjusted to be synchronized with the RGB frame rate of the preview image, so as to achieve better focusing and use more accurate distance information when focusing. For example, in the fourth scene 201 -D, when the distance of the photographed object is the above-mentioned close distance, if the RGB frame rate in the current preview image is the fourth frame rate (the fourth frame rate may be the default RGB frame rate in the preview image that is less than the preset low-brightness RGB frame rate, and the fourth frame rate does not include a fixed value, such as any frame rate <30FPS), and the current scene is judged to be the fourth scene (for example, a non-long-distance-low-brightness preview <30fps scene), in the fourth scene, because the exposure time is long, many other problems may occur, such as motion focus blur, etc. At this time, the effect of focusing is limited, so the exposure time can be lengthened by reducing the ranging frame rate. In summary, in the embodiments of the present application, accurate scene recognition (for example, judging the current shooting scene) can be performed based on different image parameters in the preview image, so that the ranging frame rate of the ranging sensor can be adjusted for different shooting modes and different shooting scenes in the subsequent process, so as to improve the flexibility and image quality of the shooting device and reduce resource consumption.

[0186] In a possible implementation, the method further includes: if the distance of the photographed object is less than the first preset distance, and the stripe effect detection result is yes, then the size of the RGB frame rate in the target preview image is adjusted to the second frame rate or the third frame rate. In the embodiment of the present application, when it is detected that the shooting distance is close and the stripe effect occurs, the stripe effect that may occur during shooting can be reduced or eliminated by adjusting the RGB frame rate in the preview image. Specifically, in the automatic exposure mode, the camera will adjust the exposure setting according to the current ambient light. For example, when the RGB frame rate of the preview image of the camera is 30FPS, if the light changes continuously, the exposure setting of the camera will also be adjusted frequently, which may cause uneven brightness of the picture, thereby generating a stripe effect. In the embodiment of the present application, after the automatic exposure module in the camera detects the existence of the stripe effect, it can reduce the frequency mismatch problem between the camera and the ambient light source by adjusting the RGB frame rate in the preview image. This mechanism of automatically adjusting the frame rate provides a flexible way to optimize the image display in photography, especially when the ambient light conditions change or the shooting distance changes, it can automatically adapt and adjust to ensure image quality.

[0187] Step S304: adjusting the ranging frame rate of the ranging sensor based on the target shooting mode and the target shooting scene.

[0188] Specifically, finally, the system adjusts the frame rate of the ranging sensor according to the determined shooting mode and scene. The ranging sensor is used to measure the distance between the camera and the subject to help autofocus. Under different shooting conditions, the frame rate of the sensor needs to be adjusted differently to achieve the best results. For example, in fast-moving shooting scenes, such as sports events, the system will increase the frame rate of the ranging sensor to ensure fast and accurate focus on moving targets. On the contrary, in static or slow-moving scenes, such as landscape photography, the system may reduce the frame rate to save power and improve processing efficiency.

[0189] In a possible implementation, if the target shooting mode is the first mode; adjusting the ranging frame rate of the ranging sensor based on the target shooting mode and the target shooting scene includes: if the target shooting scene is the first scene and the length of the distance to the shooting object is greater than the second preset distance or the data acquired by the ranging sensor is invalid, adjusting the ranging frame rate of the ranging sensor to the first frame rate synchronized with the RGB frame rate frame, wherein the second preset distance is greater than the first preset distance; or, if the target shooting scene is the first scene and the distance to the shooting object is greater than the first preset distance and less than the second preset distance, adjusting the ranging frame rate of the ranging sensor to a fifth frame rate synchronized with the RGB frame rate frame, wherein , the fifth frame rate is greater than the first frame rate; or, if the target shooting scene is the second scene, the ranging frame rate of the ranging sensor is adjusted to the fifth frame rate synchronized with the RGB frame rate, or the sixth frame rate, wherein the sixth frame rate is greater than the first frame rate; or, if the target shooting scene is the third scene, the ranging frame rate of the ranging sensor is adjusted to the seventh frame rate synchronized with the RGB frame rate or the eighth frame rate synchronized with the RGB frame rate, or the sixth frame rate, wherein both the seventh frame rate and the eighth frame rate are greater than the first frame rate; or, if the target shooting scene is the fourth scene, the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate, wherein the ninth frame rate is less than the first frame rate.

[0190] Specifically, in the embodiment of the present application, the frame rate of the ranging sensor can be dynamically adjusted for different shooting scenes in the first mode (e.g., auto focus full-time AF-F single-shot mode), significantly improving the adaptability and focusing efficiency of the camera for different shooting scenes. Specifically, this dynamic adjustment mechanism allows the camera to automatically adjust the operating frequency of the ranging sensor according to the motion speed of the subject and the complexity of the scene.For example, when photographing a distant object, for the first scene, when the distance of the photographed object is greater than the second preset distance (for example, the photographed object is at a long distance outside the effective shooting distance of the ranging sensor) or the ranging data is invalid due to other factors (for example, the distance is too far or the ranging sensor fails, etc.), the frame rate of the ranging sensor can be adjusted to the first frame rate (for example, a moderate 30FPS). The ranging sensor may cause data invalidation due to the long distance or other reasons, but the z-direction movement will soon become a short distance, so the ranging frame rate of the ranging sensor cannot be too low to ensure the focusing performance in the current scene; or, when photographing the object in the first scene, When the distance to the object is greater than the first preset distance (for example, 3 meters) and less than the second preset distance (for example, 4 meters), the ranging frame rate of the ranging sensor can be increased to a fifth frame rate (for example, 60FPS synchronization) synchronized with the RGB frame rate in the image preview interface, and the frame rate can be the maximum frame rate of the ranging sensor, which is not specifically limited in the embodiments of the present application, so that the ranging sensor can update the distance information more frequently, thereby providing a faster and more accurate focusing effect when shooting distant objects. In addition, synchronizing the RGB frame rate with the ranging frame rate can ensure that the exposure level of the image remains constant when performing distance measurement, thereby reducing image quality problems caused by inconsistent exposure. ; Alternatively, when the target shooting scene is the second scene, the ranging frame rate of the ranging sensor may be increased. This is because in close-range shooting, the relative position between the object and the sensor may change rapidly. Increasing the ranging frame rate may capture these changes more quickly, thereby providing more accurate and timely distance information; Alternatively, when the target shooting scene is the third scene, the ranging frame rate of the ranging sensor may be adjusted to an integer multiple of the frame rate that is frame-synchronized with the RGB frame rate in the target preview image, that is, the ranging frame rate of the ranging sensor is adjusted to the seventh frame rate that is frame-synchronized with the RGB frame rate in the target preview image or the eighth frame rate that is frame-synchronized (for example, 48 / 50 FPS is synchronized with the RGB frame rate in the target preview image). Step), because the preview frame rate is set in the third scene to eliminate or reduce the stripe effect, the ranging frame rate can be adjusted to be synchronized with the RGB frame rate of the preview image to achieve better focusing and use more accurate distance information when focusing; or, when the target shooting scene is the fourth scene, the ranging frame rate of the ranging sensor can be adjusted to the ninth frame rate (for example, 15FPS is not synchronized). Since the fourth scene is a low-light scene, it is necessary to extend the exposure time, and the number of frames is relatively chaotic, the benefit of increasing the ranging frame rate is low, so the ranging frame rate is fixed at 15FPS is not synchronized, and the frame rate is lowered in the fourth scene to reduce unnecessary resource consumption.

[0191] In a possible implementation, if the target shooting mode is the second mode; adjusting the ranging frame rate of the ranging sensor based on the target shooting mode and the target shooting scene includes:

[0192] If the target shooting scene is the first scene, the ranging frame rate of the ranging sensor is adjusted to a ninth frame rate that is frame-synchronized with the RGB frame rate, wherein the ninth frame rate is less than the first frame rate; or, if the target shooting scene is the second scene, the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate that is frame-synchronized with the RGB frame rate; or, if the target shooting scene is the third scene, the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate; or, if the target shooting scene is the fourth scene, the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate.

[0193] In an embodiment of the present application, the frame rate of the ranging sensor can be dynamically adjusted for different shooting scenes that appear in the second mode (for example, autofocus automatic AF-A mode). The second mode is usually used for shooting low-dynamic scenes or static objects. The response speed or accuracy of the focus system may be high enough. Increasing the frame rate of the ranging sensor cannot significantly improve the focusing performance. Therefore, in an embodiment of the present application, the frame rate of the ranging sensor in each scene can be maintained at 15FPS, which is no worse than the previous generation. Specifically, when shooting a distant object, for the first scene, the frame rate of the ranging sensor can be adjusted to a ninth frame rate (for example, 15 FPS synchronization) that is synchronized with the RGB frame rate frame in the target preview image; or, when the target shooting scene is the second scene, the ranging frame rate of the ranging sensor can be adjusted to a ninth frame rate (for example, 15 FPS synchronization) that is synchronized with the RGB frame rate frame in the target preview image; or, when the target shooting scene is the third scene, the ranging frame rate of the ranging sensor can be adjusted to the ninth frame rate (for example, 15 FPS is not synchronized); or, when the target shooting scene is the fourth scene, the ranging frame rate of the ranging sensor can be adjusted to the ninth frame rate (for example, 15 FPS is not synchronized); further, see Figure 3F , Figure 3F is a timing diagram provided in an embodiment of the present application, such as Figure 3F As shown in the figure, switching from 15FPS to 60FPS has a latency of about 340ms. If the synchronization time can be reduced to 1 frame, the latency can be reduced to 257ms. Although lowering the ranging frame rate can reduce the latency caused by focusing, for fast-moving actions such as frisbee and basketball, the action to be filmed may end before the frame rate is increased, affecting the shooting experience. Therefore, a frame rate lower than 15 frames, such as 1 frame or 5 frames, is not advisable.

[0194] In a possible implementation, if the target shooting mode is the third mode; adjusting the ranging frame rate of the ranging sensor based on the target shooting mode and the target shooting scene includes: if the target shooting scene is the first scene, adjusting the ranging frame rate of the ranging sensor to a fifth frame rate synchronized with the RGB frame rate, wherein the fifth frame rate is less than the first frame rate; or, if the target shooting scene is the second scene, adjusting the ranging frame rate of the ranging sensor to the fifth frame rate synchronized with the RGB frame rate; or, if the target shooting scene is the third scene, adjusting the ranging frame rate of the ranging sensor to a seventh frame rate synchronized with the RGB frame rate or an eighth frame rate synchronized with the RGB frame rate, wherein both the seventh frame rate and the eighth frame rate are greater than the first frame rate; or, if the target shooting scene is the fourth scene, adjusting the ranging frame rate of the ranging sensor to a ninth frame rate, wherein the ninth frame rate is less than the first frame rate.

[0195] In the embodiment of the present application, the frame rate of the ranging sensor can be dynamically adjusted for different shooting scenes in the third mode (e.g., the all-focus continuous shooting mode in the autofocus full-time AF-F mode), and the third mode can be applicable to dynamic and complex shooting environments. Specifically, the third mode can continuously track multiple targets including fast-moving and static objects, ensuring that each frame can be accurately focused during the continuous shooting process, and is suitable for shooting scenes where the moving speed of objects is fast and unpredictable, such as sports events, wildlife photography, and fast dynamics. Further, when the target shooting scene is the first scene, the ranging frame rate of the ranging sensor can be increased to a fifth frame rate synchronized with the RGB frame rate in the image preview interface (for example, 60FPS synchronization, which can be the maximum frame rate of the ranging sensor and is not specifically limited in the embodiments of the present application), so that the ranging sensor can update the distance information more frequently, thereby providing a faster and more accurate focusing effect when shooting distant objects; or, when the target shooting scene is the second scene, the ranging frame rate of the ranging sensor can be adjusted to a fifth frame rate synchronized with the RGB frame rate in the target preview image (for example, 60FPS synchronization); or, when the target shooting scene is the third scene, the ranging frame rate of the ranging sensor can be adjusted to a fifth frame rate synchronized with the RGB frame rate in the target preview image. The B frame rate is the seventh frame rate of frame synchronization or the eighth frame rate of frame synchronization (for example, 48 / 50FPS synchronization). The seventh frame rate and the eighth frame rate can be an integer multiple of the second frame rate or the third frame rate (for example, 24 / 25FPS synchronization) in the RGB frame rate of the third scene image preview interface. It is not specifically limited in the embodiments of the present application and is used to synchronize with the RGB frame rate; or, when the target shooting scene is the fourth scene, the ranging frame rate of the ranging sensor can be adjusted to the ninth frame rate (for example, 15FPS is not synchronized). Since the fourth scene is a low-light scene, the exposure time needs to be extended, and the number of frames is relatively chaotic, the benefit of increasing the ranging frame rate is low, so the ranging frame rate is fixed at 15FPS is not synchronized, and the frame rate is lowered in the fourth scene to reduce unnecessary resource consumption. In summary, in the embodiments of the present application, for the four different scenes in the third mode, the ranging frame rate is increased for necessary scenes where increasing the ranging frame rate can bring more benefits, and the ranging frame rate is reduced for non-essential scenes with lower benefits. This flexible frame rate adjustment not only improves the focusing accuracy and response speed, but also optimizes energy efficiency to adapt to various shooting needs. In addition, the Everything Focus Continuous Shooting mode significantly reduces the blur and reshoots caused by inaccurate focusing by optimizing the focusing system, thereby improving shooting efficiency. In this mode, the camera can adapt to scene changes more quickly and adjust the focus point in time to ensure clear images under changing shooting conditions.

[0196] Optionally, in the above method steps S300 to S304, the detailed frame rate strategies for different scenes in different shooting modes in step S304 can be found in Figure 4, Figure 4 Schematic diagram of a scene strategy in a shooting mode provided in an embodiment of the present application; Figure 4 As shown:

[0197] (1) The target shooting mode is the first mode.

[0198] For example, please refer to Table 1, which is an example table of a first mode frame rate strategy provided in an embodiment of the present application. As shown in Table 1, the first mode may be an AF-F (non-continuous shooting) mode, and the strategy in the phase detection (PD) may be a follow autofocus (Follow Autofocus Strategy, Follow AF) strategy, and matrix laser TOF is used as the ranging method. Among them, the AF-F (non-continuous shooting) mode is generally used for static or slow-moving shooting scenes (such as static landscape photography, portrait photography or other slower activities). In AF-F mode, the camera will focus on a specific point or object at the beginning of shooting. If the subject moves within a certain range, the camera will try to adjust the focus to keep the image clear; the above-mentioned Follow AF strategy can be applied to continuous tracking focus, as well as capturing dynamic and unpredictable scenes, to ensure that a clear focus is maintained even when the object moves quickly. Further, please refer to Figure 5A , Figure 5A This is a schematic diagram of a first mode scenario provided in an embodiment of the present application. Figure 5A It may include a long-distance scene interface 10-A and an ultra-long-distance scene interface 10-B; as shown in the long-distance scene interface 10-A, in the embodiment of the present application, the target shooting control may be an AF-F mode 405, and the first operation may be that the user can slide out the AF-F mode 405 or the AF-A mode 406 by pulling down the status bar, and then click on the AF-F mode 405 in the upper frame as the target shooting mode. At this time, the shooting preview area in the system (for example, the camera display or the interface through the mobile phone application) will display the target preview image and quickly and accurately focus on the shooting object (i.e., the person with his back to the preview image). In addition, the above-mentioned distance measurement method may also include other distance measurement methods such as binocular distance measurement and structured light distance measurement, which are not specifically limited in the embodiment of the present application.

[0199] Table 1

[0200]

[0201]

[0202] In a possible implementation, assuming that the first scene 4001 is a long-distance 4m scene, as shown in Table 1, when the system detects that the focused object or person is at a relatively long distance within the ranging range (for example, a distance of 4m), the frame rate of the matrix laser TOF can be set to the default 60FPS synchronization, and when the data of the matrix laser TOF is invalid or infinite, the frame rate can be set to 30FPS. For example, see Figure 5A , Figure 5A This is a schematic diagram of a first mode scenario provided in an embodiment of the present application. Figure 5AThe system may include a long-distance scene interface 10-A and an ultra-long-distance scene interface 10-B; as shown in the long-distance scene interface 10-A, assuming that the target shooting mode has been selected as the AF-F (non-continuous shooting) mode, the target shooting control may be a shutter 402, at which time the shooting preview area in the system (for example, the display screen of the camera or the interface through the mobile phone application) will display the target preview image and quickly and accurately focus on the shooting object (i.e., the person with his back to the camera in the preview image), and the first operation may be that the user takes a single shot by clicking the shutter 402; further, based on the image parameters of the preview image, the system may detect the distance of the focused target through the sensor, and when the system detects that the target is within the focus range ... that the target is within the focus When the system detects that the walking person in the currently focused scene is at an effective long distance (i.e. within the ranging range), it means that there may be significant depth changes in the shooting scene. In order to effectively capture these distant objects and maintain clear focus, the system needs to adjust the focus and process the image more quickly. The frame rate can be increased to help the system capture dynamically changing scenes more smoothly, and the clarity of distant objects in the shooting can be maintained by synchronizing the focus system (AF) and frame rate. The system can detect the distance of the focused target through the sensor. When the system detects that the walking person in the currently focused scene is at an effective long distance (i.e. within the ranging range), it means that there may be significant depth changes in the shooting scene. In order to effectively capture these distant objects and maintain clear focus, the system needs to adjust the focus and process the image more quickly. The frame rate can be increased to help the system capture dynamically changing scenes more smoothly, and the clarity of distant objects in the shooting can be maintained by synchronizing the focus system (AF) and frame rate. In the case of significant depth changes, in order to effectively capture these distant objects and maintain clear focus, the system needs to adjust the focus and process the image more quickly. The frame rate can be increased to help the system capture dynamically changing scenes more smoothly, and the clarity of distant objects in the shooting can be maintained by synchronizing the focus system (AF) and the frame rate; as shown in the ultra-long-distance scene interface 10-B, assuming that the target shooting mode has been selected as AF-F (non-continuous shooting) mode, the target shooting control can be the shutter 402. At this time, the shooting preview area in the system (for example, the camera's display screen or through the interface of the mobile phone application) will display the target preview image and quickly and accurately focus on the shooting object (i.e., a person walking at a long distance in the preview image), the first operation is for the user to take a single shot by clicking the shutter 402; when the system detects that the person walking in the currently focused scene is at an invalid long distance (i.e., the focused data is invalid or infinite), it can save system resources by reducing part of the frame rate, but the frame rate cannot be reduced too low. Although the current long-distance matrix laser TOF is invalid, the person in the ultra-long-distance scene interface 10-B may move in the z direction, causing the focused target to become a close distance. In order to ensure performance during shooting, the system sets the ranging frame rate of the matrix laser TOF sensor not to be too low (for example, the frame rate can be set to 30FPS).

[0203] In a possible implementation, assuming that the second scene 4002 is a non-telephoto-preview=30FPS scene, as shown in Table 1, when the system detects that the focused object or person is within the range of the non-telephoto-preview=30fps scene, the matrix laser TOF can set the frame rate to the default 60FPS synchronization or 60FPS non-synchronization; wherein the non-telephoto-preview=30fps scene is a camera setting designed for daily use and a variety of common photography scenes. For example, see Figure 5B , Figure 5B This is a schematic diagram of a first mode scenario provided in an embodiment of the present application. Figure 5B The interface 10-C may include a non-telephoto-preview = 30FPS scene interface 10-C, a banding scene interface 10-D, and a non-telephoto-low-brightness (preview < 30FPS scene) interface 10-E; as shown in the non-telephoto-preview = 30FPS scene interface 10-C, in the embodiment of the present application, assuming that the target shooting mode has been selected as the AF-F (non-continuous shooting) mode, the target shooting control may be a shutter 402, at which time the shooting preview area in the system (for example, the camera display or the interface through the mobile phone application) will display the target preview image and quickly and accurately focus on the shooting object (i.e., the person sitting at a close distance reading a book in the preview image), and the first operation may be for the user to take a single shot by clicking the shutter 402; further, the camera preview function of the system displays a person sitting at a close distance reading a book, and the system may obtain the banding Flag and RGB frame rate from the AE module through the AF module as judgment conditions, and if the banding is not detected Flag, and the current RGB frame rate conditions are met, the system may determine that the current environment is suitable for setting to "non-telephoto-preview = 30fps scenario". In this scenario, the system can set the camera preview frame rate to 30 frames per second and set the ranging frame rate of the matrix laser TOF sensor to the default 60FPS synchronous or 60FPS asynchronous, ensuring the focus performance in close-range shooting, and improving image quality and user shooting experience.

[0204] In a possible implementation, assuming that the third scene 4003 is a non-long-distance-debanding (preview 24 / 25FPS scene), as shown in Table 1, when the system detects that the focused object or person is within the non-long-distance-debanding (preview 24 / 25FPS scene) scene within the ranging range, the matrix laser TOF can set the frame rate to the default 48 / 50FPS synchronization or 60FPS non-synchronization. For example, see Figure 5B , Figure 5B This is a schematic diagram of a first mode scenario provided in an embodiment of the present application. Figure 5BIt may include a non-telephoto-preview = 30FPS scene interface 10-C, a banding scene interface 10-D, and a non-telephoto-low-brightness (preview <30FPS scene) interface 10-E; as shown in the banding scene interface 10-D, in the embodiment of the present application, assuming that the target shooting mode has been selected as the AF-F (non-continuous shooting) mode, the target shooting control may be a shutter 402. At this time, the shooting preview area in the system (for example, the camera display or the interface through the mobile phone application) will display the target preview image and quickly and accurately focus on the shooting object (that is, the person sitting at a close distance reading a book in the preview image). The first operation may be that the user takes a single shot by clicking the shutter 402; further, the system may obtain the banding Flag and RGB frame rate from the AE module through the AF module as the judgment condition. If the banding is detected, Flag, that is, there is a stripe effect. The stripe effect may be due to the fact that the camera preview frame rate works at 30 frames, and the ranging frame rate does not match the RGB frame rate frequency, so some black shadows appear in the preview screen (i.e. banding). For the banding situation, the system may set the current environment to "non-long-range-debanding (preview 24 / 25fps scene)"; in this scenario, in order to reduce or eliminate the stripe effect, the camera's preview frame rate will be adjusted to 24 or 25 frames per second; further, the system can also set the ranging frame rate of the matrix laser TOF sensor to the default 48 / 50FPS synchronization or 60FPS non-synchronization, align the laser exposure time and the image exposure time, and perform better focusing, as well as use more accurate distance information when focusing. In addition, the default synchronization frame rate can be any integer multiple of the 24 / 25FPS frame rate during preview, not limited to 48 / 50FPS, but also an integer multiple of 24 / 25FPS within the maximum frame rate range in the ranging mode, which is not specifically limited in the embodiments of the present application.

[0205] In a possible implementation, assuming that the fourth scene 4004 is a non-long-distance-low-light (preview <30FPS scene), as shown in Table 1, when the system detects that the focused object or person is within the non-long-distance-low-light (preview <30FPS scene) scene within the ranging range, the matrix laser TOF can set the frame rate to the default 15FPS asynchronous. For example, see Figure 5B , Figure 5B This is a schematic diagram of a first mode scenario provided in an embodiment of the present application. Figure 5BIt may include a non-telephoto-preview = 30FPS scene interface 10-C, a banding scene interface 10-D, and a non-telephoto-low-light (preview < 30FPS scene) interface 10-E; as shown in the non-telephoto-low-light (preview < 30FPS scene) interface 10-E, in the embodiment of the present application, assuming that the target shooting mode has been selected as the AF-F (non-continuous shooting) mode, the target shooting control may be a shutter 402, at which time the shooting preview area in the system (for example, the camera display or the interface through the mobile phone application) will display the target preview image and quickly and accurately focus on the shooting object (i.e., the person sitting at a close distance reading a book in the preview image), and the first operation may be that the user takes a single shot by clicking the shutter 402; further, the figure shows a person sitting at a close distance reading a book in a dark environment, and the system may obtain the banding Flag and RGB frame rate from the AE module through the AF module as judgment conditions. If the banding is not detected Flag, and the current RGB frame rate meets the ambient brightness conditions, the system may determine that the current environment is suitable for setting to a "non-long-range-low-light preview <30FPS scenario". In this scenario, the system can increase the light capture of each frame by reducing the preview frame rate (that is, the preview frame rate is <30FPS), thereby improving image quality in difficult shooting environments; further, since the frame rate during ranging may be unstable at this moment and varies within 15FPS, the focusing performance caused by the low frame rate is no longer a bottleneck, and the captured picture may be blurry, so in the embodiment of the present application, you can choose to give up increasing the focusing frame rate, and set the ranging frame rate of the matrix laser TOF sensor to the default 15FPS out of sync, so that the ranging frame rate of the matrix laser TOF sensor no longer changes, and reduce the frame rate in non-essential scenarios to save system resources.

[0206] (2) The target shooting mode is the second mode.

[0207] For example, see Table 2, which is an example table of a second mode frame rate strategy provided in an embodiment of the present application. As shown in Table 2, the second mode can be an AF-A non-continuous shooting mode, which is suitable for scenes where objects do not move frequently or users do not need to continuously track specific objects. The strategy in phase detection (PD) can be a follow autofocus (Follow Autofocus Strategy, Follow AF) strategy, and matrix laser TOF is used as a ranging method. Further, see Figure 6 , Figure 6 Schematic diagram of a second mode scenario provided in an embodiment of the present application. Figure 6It may include a long-distance scene interface 20-A, a non-long-distance-preview=30FPS scene interface 20-B, a banding scene interface 20-C, and a non-long-distance-low-light (preview <30FPS scene) interface 20-D; as shown in the long-distance scene interface 20-A, in the embodiment of the present application, the target shooting control may be an AF-F mode 405, and the first operation may be that the user can slide out the AF-F mode 405 or the AF-A mode 406 by pulling down the status bar, and then click on the AF-F mode 405 in the upper frame as the target shooting mode. At this time, the shooting preview area in the system (for example, the camera display or through the interface of the mobile phone application) will display the target preview image and quickly and accurately focus on the shooting object (i.e., the person with his back to the preview image). Among them, the AF-A mode, i.e., the Autofocus-Automatic mode, usually automatically switches between single autofocus (AF-S) and continuous autofocus (AF-C), and the system will automatically switch the focus mode according to whether the subject is moving. If the subject is stationary, you can refer to the AF-S mode to lock the focus; if the subject is moving, you can refer to the AF-C mode to continuously track the focus; the above Follow AF strategy can be applied to continuous tracking focus, as well as capturing dynamic and unpredictable scenes, to ensure that a clear focus is maintained even when the object moves quickly. In addition, in the "Everything Tracking Off" mode, the system will not automatically track the target, and the ranging frame rate can be zero; and the above ranging methods can also include other ranging methods such as binocular ranging and structured light ranging, which are not specifically limited in the embodiments of this application.

[0208] Table 2

[0209]

[0210] In a possible implementation, for example, see Figure 6 , Figure 6 Schematic diagram of a second mode scenario provided in an embodiment of the present application. Figure 6 It may include a long-distance scene interface 20-A, a non-long-distance-preview = 30FPS scene interface 20-B, a banding scene interface 20-C, a non-long-distance-low-brightness (preview <30FPS scene) interface 20-D, and combined with Table 2.

[0211] Specifically, it is assumed that the first scene 4001 is a long-distance 4m scene, such as Figure 6As shown in the medium and long distance scene interface 20-A, in the embodiment of the present application, assuming that the target shooting mode has been selected as AF-A (non-continuous shooting) mode, the target shooting control can be a shutter 402. At this time, the shooting preview area in the system (for example, the camera display screen or the interface through the mobile phone application) will display the target preview image and quickly and accurately focus on the shooting object (that is, the person playing golf in the preview image). The first operation can be that the user takes a single shot by clicking the shutter 402; further, the system can detect the distance of the focused target through the sensor. When the system detects that the person playing golf in the currently focused scene is at an effective long distance (that is, within the ranging range), the frame rate of the matrix laser TOF can be set to 15FPS for synchronization.

[0212] Assume that the second scene 4002 is a non-remote-preview=30FPS scene, such as Figure 6 As shown in the non-telephoto-preview=30FPS scene interface 20-B, in the embodiment of the present application, assuming that the target shooting mode has been selected as the AF-A (non-continuous shooting) mode, the target shooting control can be the shutter 402, and the shooting preview area in the system (for example, the display screen of the camera or the interface through the mobile phone application) will display the target preview image and quickly and accurately focus on the shooting object (that is, the person lying on the bed and watching the mobile phone in the preview image), and the first operation can be that the user takes a single shot by clicking the shutter 402; further, the camera preview function of the system displays a person lying on the bed and watching the mobile phone at a close distance, and the system can obtain the banding Flag and RGB frame rate from the AE module through the AF module as the judgment condition. If the banding Flag is not detected and the current RGB frame rate condition meets the requirements, the system may determine that the current environment is suitable for setting as the "non-telephoto-preview=30fps scene". In this scenario, the system can set the camera preview frame rate to 30 frames per second and set the ranging frame rate of the matrix laser TOF sensor to 15FPS synchronization;

[0213] Assume that the third scene 4003 is non-long-distance-debanding (preview 24 / 25FPS scene), such as Figure 6As shown in the banding scene interface 20-C, in the embodiment of the present application, assuming that the target shooting mode has been selected as the AF-A (non-continuous shooting) mode, the target shooting control can be the shutter 402. At this time, the shooting preview area in the system (for example, the display screen of the camera or the interface through the mobile phone application) will display the target preview image and quickly and accurately focus on the shooting object (that is, the person lying on the bed and watching the mobile phone in the preview image). The first operation can be that the user takes a single shot by clicking the shutter 402; further, the camera preview function of the system displays a person lying on the bed and watching the mobile phone at a close distance. The system can obtain the banding Flag and RGB frame rate from the AE module through the AF module as the judgment condition. If the banding is detected Flag, that is, there is a stripe effect. This stripe effect may be caused by the camera preview frame rate working at 30 frames, and the ranging frame rate does not match the RGB frame rate frequency, so some black shadows (i.e. banding) appear in the preview image. For the banding situation, the system may set the current environment to "non-long-range-debanding (preview 24 / 25fps scene)"; in this scenario, in order to reduce or eliminate the stripe effect, the camera preview frame rate will be adjusted to 24 or 25 frames per second, and the ranging frame rate of the matrix laser TOF sensor will be set to 15FPS out of sync;

[0214] Assume that the fourth scene 4004 is non-long-distance-low-brightness (preview <30FPS scene), such as Figure 6As shown in the non-long-range-low-light (preview <30FPS scene) interface 20-D, in the embodiment of the present application, assuming that the target shooting mode has been selected as AF-A (non-continuous shooting) mode, the target shooting control can be a shutter 402. At this time, the shooting preview area in the system (for example, the camera display screen or the interface through the mobile phone application) will display the target preview image and quickly and accurately focus on the shooting object (that is, the person lying on the bed and watching the mobile phone in the preview image). The first operation can be that the user takes a single shot by clicking the shutter 402; further, the figure shows a person sitting in a dark environment and reading a book at a close distance. The system can obtain the banding Flag and RGB frame rate from the AE module through the AF module as the judgment condition. If the banding is not detected, the system can obtain the banding flag and RGB frame rate from the AE module through the AF module. Flag, and the current RGB frame rate meets the ambient brightness conditions, the system may determine that the current environment is suitable for setting to "non-long-range-low-light (preview <30FPS scenario)". In this scenario, the system can increase the light capture of each frame by reducing the preview frame rate (that is, the preview frame rate is <30FPS), thereby improving image quality in difficult shooting environments; further, since the frame rate during ranging may be unstable at this moment and varies within 15FPS, the focusing performance caused by the low frame rate is no longer a bottleneck, and the captured picture may be blurry, so in the embodiment of the present application, you can choose to give up increasing the focusing frame rate, and set the ranging frame rate of the matrix laser TOF sensor to the default 15FPS out of sync, so that the ranging frame rate of the matrix laser TOF sensor no longer changes, and reduce the frame rate in non-essential scenarios to save system resources.

[0215] In the embodiment of the present application, the system can be set to AF-A (non-continuous shooting) mode. Since in AF-A mode, there is no need to continuously and quickly track and adjust the focus, the camera usually automatically selects the focus point in a single shot or occasional scene change, and since AF-A is a non-continuous shooting mode, there is no need to frequently update the focus point. Therefore, the improvement of the overall performance of taking pictures by increasing the frame rate to the fast focus response brought by the AF-A (non-continuous shooting) mode is relatively limited; and when the all-things tracking function is turned off, the camera will not continue to track dynamic objects, and the camera's focus system is more used for static or slow-moving objects. The improvement of the ranging frame rate may not significantly improve the performance or image quality when taking pictures. In summary, in the embodiment of the present application, when the benefits of increasing the ranging frame rate are low, the frame rate can be reduced to save resources, and since the performance should not be lower than the performance standard of the previous generation of ranging frame rate of 15FPS, the ranging frame rate of the matrix laser TOF sensor is set to 15FPS synchronous or 15FPS asynchronous.

[0216] (3) Assume that the target photographing mode 400 is the third mode.

[0217] Exemplarily, please refer to Table 3, which is an example table of the third mode frame rate strategy provided in the embodiment of the present application. As shown in Table 2, the third mode can be the AF-F continuous shooting (focus tracking for everything is on) mode, which can include subject focus priority and motion focus priority, and is suitable for scenes where the shooting target moves frequently. The strategy in the phase detection (PD) can be the Follow Autofocus Strategy (Follow AF) strategy, and the matrix laser TOF is used as the ranging method. Among them, in the focus tracking for everything mode, various objects in the shooting scene can be automatically identified and tracked, such as people, animals, vehicles, etc. Once specific objects are identified, the focus tracking for everything system can track the movement of these objects in real time to ensure that they are always in focus. In some cases, the focus tracking for everything can simultaneously track multiple objects in the scene and focus on them according to the user's settings or the priority of the scene. Exemplarily, please refer to Fig. 7A , Fig. 7A This is a schematic diagram of opening a third mode provided in an embodiment of the present application. The target shooting controls may include a shutter 402, a photo 404, and a focus tracking 404A. At this time, the first operation may be for the user to display an extended function task bar by clicking or swiping up to take a photo 404, and click the focus tracking 404A in the extended function task bar to turn on the focus tracking mode. The above-mentioned Follow AF strategy can be applied to continuous tracking focus, as well as to capture dynamic and unpredictable scenes, to ensure that a clear focus is maintained even when the object moves quickly. In addition, the above-mentioned ranging method may also include other ranging methods such as binocular ranging and structured light ranging, which are not specifically limited in the embodiments of the present application.

[0218] Table 3

[0219]

[0220] In a possible implementation, assuming that the first scene 4001 is a long-distance 4m scene, as shown in Table 3, when the system detects that the focused object or person is at a relatively long distance within the ranging range (for example, a distance of 4m), the matrix laser TOF can set the frame rate to the default 60FPS synchronization. Figure 7B , Figure 7B This is a schematic diagram of a long-distance scene in the third mode provided in an embodiment of the present application. Figure 7BThe system may include a subject focus priority interface 30-B and a motion focus priority interface 30-C; in the embodiment of the present application, assuming that the target shooting mode has been selected as the AF-F (focus-following continuous shooting) mode, the target shooting controls may include a shutter 402, a subject focus priority 404A1, and a motion focus priority 404A2. At this time, the shooting preview area in the system (for example, the display screen of the camera or the interface through the mobile phone application) will display the target preview image and quickly and accurately focus on the shooting object (that is, the dancing person and dog in the preview image). The first operation is that the user clicks on the subject focus priority 404A1 or the motion focus priority 404A2, and then holds down the shutter 402 for continuous shooting; further, as shown in the subject focus priority interface 30-B, when the user clicks on the subject focus priority 404A1, the system Through its sensor, objects in the shooting scene can be detected, such as a person swinging a golf club on the left and a person walking on the right, and their distance from the camera. When the two people in the scene are detected to be at a long distance within the ranging range of the matrix laser TOF (for example, 4m), in order to ensure that the subject is captured continuously and clearly during rapid continuous shooting, the system can increase the ranging frame rate of the matrix laser TOF sensor (for example, setting the frame rate to 60FPS synchronization). The frame rate can be the maximum frame rate of any ranging method, which is not specifically limited in the embodiments of the present application. It is used to speed up the focusing speed and maintain stable tracking focus on distant subjects, ensuring that the dynamic changes of the subject can be accurately captured and focused in each continuous shooting frame, ensuring that even distant moving subjects can be accurately captured and kept in focus during high-speed continuous shooting. As shown in the motion focus priority interface 30-C, assuming that the person on the left side of the camera preview interface is moving (i.e., swinging a club) and the person on the right side is still, when the user clicks on the motion focus priority 404A2, the camera focuses on the person on the left side of the camera preview interface who is swinging a club, mainly capturing rapidly changing targets, requiring the camera to adapt and respond quickly. In order to effectively capture such motion elements in the continuous shooting mode, the system will optimize its focus speed and increase the ranging frame rate of the matrix laser TOF sensor (for example, setting the frame rate to 60FPS synchronization). The frame rate can be the maximum frame rate of any ranging method and is not specifically limited in the embodiments of the present application. It is used to speed up the focus speed and maintain stable tracking focus on distant moving targets. In this way, the camera ensures that it can accurately focus on moving objects in each frame of the continuous shooting to ensure image clarity and continuity.

[0221] In a possible implementation, assuming that the second scene 4002 is a non-telephoto-preview=30FPS scene, as shown in Table 3, when the system detects that the focused object or person is within the range of the non-telephoto-preview=30fps scene, the matrix laser TOF can set the frame rate to the default 60FPS synchronization; wherein the non-telephoto-preview=30fps scene is a camera setting designed for daily use and a variety of common photography scenes. For example, see Figure 7C , Figure 7C Schematic diagram of a close-range scene in a third mode provided in an embodiment of the present application. Figure 7C The system may include a subject focus priority interface 30-D and a motion focus priority interface 30-E; in the embodiment of the present application, assuming that the target shooting mode has been selected as the AF-F (focus-following continuous shooting) mode, the target shooting controls may include a shutter 402, a subject focus priority 404A1, and a motion focus priority 404A2. At this time, the shooting preview area in the system (for example, the camera display or the interface through the mobile phone application) will display the target preview image and quickly and accurately focus on the shooting object (that is, the dancing person and dog in the preview image). The first operation may be that the user clicks on the subject focus priority 404A1 or the motion focus priority 404A2, and then holds down the shutter 402 for continuous shooting; further, as shown in the subject focus priority interface 30-D , the camera preview function of the system displays a dancing person and a dog. When the user clicks on the subject focus priority 404A1, the camera will focus on the two subjects; as shown in the motion focus priority interface 30-E, assuming that the dancing person on the left moves and turns his body, when the user clicks on the motion focus priority 404A2, the camera focuses on the moving person on the left; in order to obtain a smooth and responsive preview experience in the non-telephoto-preview=30fps scene, and to make the preview screen consistent with the performance during actual shooting, the system can increase the ranging frame rate of the matrix laser TOF sensor (for example, set the frame rate to 60FPS synchronization), which can be the maximum frame rate of any ranging method, and is not specifically limited in the embodiments of the present application. In summary, in the non-telephoto-preview=30fps scene, the frame rate of the ranging method is increased to provide faster and more accurate focusing performance, especially in the case of needing to track variable and dynamic objects, to ensure that each frame in continuous shooting can achieve the best focusing effect.

[0222] In a possible implementation, assuming that the third scene 4003 is a non-long-distance-debanding (preview 24 / 25FPS scene), as shown in Table 3, when the system detects that the focused object or person is within the range of the non-long-distance-debanding (preview 24 / 25FPS scene) scene, the matrix laser TOF can set the frame rate to the default 48 / 50FPS synchronization. For example, see Fig.7D , Fig.7D This is a schematic diagram of a scene of a stripe effect provided in an embodiment of the present application. Fig.7D The first stripe effect interface 30-F and the second stripe effect interface 30-G may be included; as shown in the first stripe effect interface 30-F and the second stripe effect interface 30-G, in the embodiment of the present application, assuming that the target shooting mode has been selected as the AF-F (focus-tracking continuous shooting) mode, the target shooting control may include a shutter 402, a subject focus priority 404A1 and a motion focus priority 404A2. At this time, the shooting preview area in the system (for example, the camera display or the interface through the mobile phone application) will display the target preview image and quickly and accurately focus on the shooting object (that is, the dancing person and dog in the preview image). The first operation may be that the user clicks on the subject focus priority 404A1 or the motion focus priority 404A2, and then continuously shoots by pressing the shutter 402; further, the system may obtain the banding Flag and RGB frame rate from the AE module through the AF module as the judgment condition. If the banding is detected, Flag, that is, there is a stripe effect, which may be due to the fact that the camera preview frame rate works at 30 frames, and the ranging frame rate does not match the RGB frame rate frequency, so some black shadows (i.e. banding) appear in the preview screen. For the banding situation, the system can set the current environment to "non-long-range-debanding (preview 24 / 25fps scene)"; in this scenario, in order to reduce or eliminate the stripe effect, the camera's preview frame rate will be adjusted to 24 or 25 frames per second; further, the system can also set the ranging frame rate of the corresponding matrix laser TOF sensor to the default 48 / 50FPS synchronization, align the laser exposure time and the image exposure time, for better focusing, and use more accurate distance information when focusing. In addition, the default synchronization frame rate can be any integer multiple of the 24 / 25FPS frame rate during preview, not limited to 48 / 50FPS, but can also be an integer multiple of 24 / 25FPS within the maximum frame rate range in the ranging mode, which is not specifically limited in the embodiments of the present application.

[0223] In a possible implementation, assuming that the fourth scene 4004 is a non-long-distance-low-light (preview <30FPS scene), as shown in Table 3, when the system detects that the focused object or person is within the non-long-distance-low-light (preview <30FPS scene) scene within the ranging range, the matrix laser TOF can set the frame rate to the default 15FPS asynchronous. For example, see Fig. 7E , Fig. 7E Schematic diagram of a low-light scene in a third mode provided in an embodiment of the present application. Fig. 7EThe system may include a subject focus priority interface 30-H and a motion focus priority interface 30-I; in the embodiment of the present application, assuming that the target shooting mode has been selected as the AF-F (focus-following continuous shooting) mode, the target shooting controls may include a shutter 402, a subject focus priority 404A1 and a motion focus priority 404A2. At this time, the shooting preview area in the system (for example, the display screen of the camera or the interface through the mobile phone application) will display the target preview image and quickly and accurately focus on the shooting object (that is, the dancing person and dog in the preview image). The first operation can be that the user clicks the subject focus priority 404A1 or After the motion focus priority 404A2, continuous shooting is performed by pressing the shutter button 402; further, as shown in the subject focus priority interface 30-H, the system's camera preview function displays a dancing person and a dog, and when the user clicks the subject focus priority 404A1, the camera will focus on these two subjects; and as shown in the motion focus priority interface 30-I, assuming that the dancing person on the left moves and turns his body, when the user clicks the motion focus priority 404A2, the camera focuses on the moving person on the left; the system can obtain the banding from the AE module through the AF module Flag and RGB frame rate are used as judgment conditions. If the banding Flag is not detected and the current RGB frame rate meets the ambient brightness conditions, the system may determine that the current environment is suitable for setting as a "non-long-range-low-light preview <30FPS scenario". In this scenario, the system can increase the light capture of each frame by reducing the preview frame rate (that is, the preview frame rate is <30FPS), thereby improving image quality in difficult shooting environments; further, since the frame rate during ranging may be unstable at this moment and varies within 15FPS, the focusing performance caused by the frame rate being too low is no longer a bottleneck, and the captured picture may be blurry. Therefore, in the embodiment of the present application, you can choose to give up increasing the focusing frame rate and set the ranging frame rate of the matrix laser TOF sensor to the default 15FPS without synchronization, so that the ranging frame rate of the matrix laser TOF sensor no longer changes, and reduce the frame rate in non-essential scenarios to save system resources.

[0224] In one possible implementation, as shown in Table 3, assuming that the current system detects that the focused object or person is at a relatively long distance within the ranging range (e.g., the first scene 4001), and the user selects the motion focus priority mode in the all-object tracking mode, in this mode, the user can achieve continuous shooting by long pressing the shooting key to capture dynamic scenes, such as high-speed sports activities. The system can track fast-moving targets faster and more accurately by increasing the frame rate of the ranging method (e.g., setting the frame rate of the matrix laser TOF to the default 60FPS synchronization). For example, see Figure 7F , Figure 7F Schematic diagram of a long-distance continuous shooting scene in a third mode provided in an embodiment of the present application. Figure 7FThe system may include a first continuous shooting interface 30-J, a second continuous shooting interface 30-K, a third continuous shooting interface 30-L and a fourth continuous shooting interface 30-M; in the embodiment of the present application, assuming that the target shooting mode has been selected as the motion focus priority 404A2 in the AF-F (focus-tracking continuous shooting) mode, the target shooting control may include a shutter 402. At this time, the shooting preview area in the system (for example, the display screen of the camera or the interface through the mobile phone application) will display the target preview image and quickly and accurately focus on the shooting object (that is, the person and cat playing golf in the preview image). The first operation can be that the user presses and holds the shutter 402 without further, as shown in the first continuous shooting interface 30-J, the picture includes a person moving at a long distance and a motionless cat. Taking the motion focus priority 404A2 in the all-things tracking mode as an example, the camera's preview screen will focus on the moving person, and the user can achieve continuous shooting by long pressing the shooting key 402. In the embodiment of the present application, capturing three pictures is taken as an example (the number of pictures captured by the continuous shooting can also be hundreds or thousands, which is not specifically limited in the embodiment of the present application), and the focus in the pictures captured by the continuous shooting is concentrated on high-speed moving targets, such as precise focus on people playing golf. At the same time, in this mode, the camera intelligently distinguishes between moving and stationary objects, such as a stationary cat next to you. In this case, the stationary cat will not be tracked in focus, thereby ensuring that the camera's focus resources are concentrated on the main moving target; as shown in the second continuous shooting interface 30-K, the third continuous shooting interface 30-L and the fourth continuous shooting interface 30-M, in the motion focus priority mode, after the camera takes the previous picture 401, it still tracks the high-speed moving object (i.e., the person swinging the golf club) while ignoring the surrounding stationary objects (i.e., the stationary cat). Therefore, in a series of pictures captured in the Everything Pursuit mode, the athlete is always the center of focus, and the surrounding static objects do not distract the camera's attention. In an embodiment of the present application, for the scene recognized by the AE module, a corresponding frame rate scheme is adopted in the ranging mode, while giving priority to ensuring the tracking effect, and reducing the frame rate in non-essential scenes, through Figures 5A-7F The frame rate control scheme of focus tracking in the embodiment described in the specification greatly improves the efficiency and accuracy of capturing dynamic scenes.

[0225] It should be understood that each step in the above method embodiment can be completed by an integrated logic circuit of hardware in a processor or by instructions in the form of software. The method steps disclosed in the embodiments of the present application can be directly embodied as being executed by a hardware processor, or by a combination of hardware and software modules in a processor.

[0226] The present application also provides a terminal device, which may include: a memory and a processor. The memory may be used to store a computer program; the processor may be used to call the computer program in the memory, so that the terminal device executes the method executed by the terminal device side in any of the above embodiments.

[0227] The present application also provides a terminal device, which may include: a memory and a processor. The memory may be used to store a computer program; the processor may be used to call the computer program in the memory, so that the terminal device executes the method executed by the terminal device side in any of the above embodiments.

[0228] The present application also provides a chip system, which includes at least one processor for implementing the functions involved in the terminal device side in any of the above embodiments.

[0229] In one possible design, the chip system also includes a memory, which is used to store program instructions and data, and the memory is located inside or outside the processor.

[0230] The chip system may be composed of the chip, or may include the chip and other discrete devices.

[0231] Optionally, the processor in the chip system may be one or more. The processor may be implemented by hardware or by software. When implemented by hardware, the processor may be a logic circuit, an integrated circuit, etc. When implemented by software, the processor may be a general-purpose processor implemented by reading software code stored in a memory.

[0232] Optionally, the memory in the chip system may also be one or more. The memory may be integrated with the processor or may be separately arranged with the processor, which is not limited in the embodiments of the present application. Exemplarily, the memory may be a non-transient processor, such as a read-only memory ROM, which may be integrated with the processor on the same chip or may be arranged on different chips respectively. The embodiments of the present application do not specifically limit the type of memory and the arrangement of the memory and the processor.

[0233] Exemplarily, the chip system can be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a microcontroller unit (MCU), a programmable logic device (PLD) or other integrated chips.

[0234] The present application also provides a computer program product, which includes: a computer program (also referred to as code, or instruction), which, when executed, enables a computer to execute the method executed by the terminal device side in any of the above embodiments.

[0235] The present application also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program (also referred to as code or instruction). When the computer program is executed, the computer executes the method executed by the terminal device side in any of the above embodiments.

[0236] The various implementation modes of the present application can be combined arbitrarily to achieve different technical effects.

[0237] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state disk (SSD)), etc.

[0238] Those skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by computer programs to instruct related hardware, and the programs can be stored in computer-readable storage media. When the programs are executed, they can include the processes of the above-mentioned method embodiments. The aforementioned storage media include: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.

[0239] In short, the above is only an embodiment of the technical solution of this application, and is not intended to limit the protection scope of this application. Any modification, equivalent replacement, improvement, etc. made according to the disclosure of this application shall be included in the protection scope of this application.

Claims

1. A method for controlling a focus tracking frame rate, characterized in that: Applied to electronic equipment, the electronic equipment includes a camera module, the camera module includes a camera and a distance sensor; the method includes: Displaying a first user interface, wherein the first user interface includes a shooting preview area and a plurality of shooting controls, wherein the shooting preview area is used to display an image captured by the camera; receiving a first operation, where the first operation is an operation on a target shooting control among the multiple shooting controls; In response to the first operation, starting a target shooting mode and displaying a target preview image in the shooting preview area; Determining image parameters of the target preview image, and determining a target shooting scene based on the image parameters; Based on the target shooting mode and the target shooting scene, the ranging frame rate of the ranging sensor is adjusted.

2. The method according to claim 1, characterized in that The step of determining the image parameters of the target preview image includes: Determine the distance of the photographed object in the target preview image by using the ranging sensor; The camera determines the stripe effect detection result and the RGB frame rate in the target preview image.

3. The method according to claim 2, characterized in that The determining the target shooting scene based on the image parameters comprises: If the distance to the photographed object is greater than a first preset distance, then determining that the target photographing scene is a first scene; or, If the distance of the photographed object is less than the first preset distance, and the RGB frame rate of the target preview image is the first frame rate, then the target photographing scene is determined to be the second scene, wherein the first frame rate is the default frame rate of the RGB frame rate in the target preview image; or, If the distance of the photographed object is less than the first preset distance, and the RGB frame rate of the target preview image is the second frame rate or the third frame rate, then the target photographing scene is determined to be the third scene, wherein the second frame rate and the third frame rate are both less than the first frame rate, and the second frame rate or the third frame rate is the frame rate adjusted after performing streak effect detection; or, If the distance of the photographed object is less than the first preset distance and the RGB frame rate of the target preview image is a fourth frame rate, the target photographing scene is determined to be a fourth scene, wherein the fourth frame rate is less than the first frame rate.

4. The method according to claim 3, characterized in that The method further comprises: If the distance of the photographed object is less than the first preset distance, and the stripe effect detection result is that the stripe effect exists, the size of the RGB frame rate in the target preview image is adjusted to the second frame rate or the third frame rate.

5. The method according to claim 3 or 4, characterized in that: The types of the target shooting mode include a first mode, a second mode and a third mode, wherein the first mode includes performing a single shot with continuous focus on the shooting object based on the target preview image, the second mode includes performing a single shot with single focus or a single shot with continuous focus on the shooting object based on the target preview image, and the third mode includes performing continuous focus continuous shooting on the shooting object based on the target preview image.

6. The method according to claim 5, characterized in that If the target shooting mode is the first mode; adjusting the ranging frame rate of the ranging sensor based on the target shooting mode and the target shooting scene includes: If the target shooting scene is the first scene, and the distance to the shooting object is greater than a second preset distance or the data acquired by the ranging sensor is invalid, the ranging frame rate of the ranging sensor is adjusted to the first frame rate synchronized with the RGB frame rate, wherein the second preset distance is greater than the first preset distance; or If the target shooting scene is the first scene, and the distance of the shooting object is greater than the first preset distance and less than the second preset distance, the ranging frame rate of the ranging sensor is adjusted to a fifth frame rate synchronized with the RGB frame rate, wherein the fifth frame rate is greater than the first frame rate; or If the target shooting scene is the second scene, the ranging frame rate of the ranging sensor is adjusted to the fifth frame rate or the sixth frame rate synchronized with the RGB frame rate, wherein the sixth frame rate is greater than the first frame rate; or If the target shooting scene is the third scene, the ranging frame rate of the ranging sensor is adjusted to a seventh frame rate synchronized with the RGB frame rate or an eighth frame rate synchronized with the RGB frame rate, or the sixth frame rate, wherein the seventh frame rate and the eighth frame rate are both greater than the first frame rate; or If the target shooting scene is the fourth scene, the ranging frame rate of the ranging sensor is adjusted to a ninth frame rate, wherein the ninth frame rate is smaller than the first frame rate.

7. The method according to claim 5 or 6, characterized in that: If the target shooting mode is the second mode; adjusting the ranging frame rate of the ranging sensor based on the target shooting mode and the target shooting scene includes: If the target shooting scene is the first scene, adjusting the ranging frame rate of the ranging sensor to a ninth frame rate synchronized with the RGB frame rate, wherein the ninth frame rate is smaller than the first frame rate; or If the target shooting scene is the second scene, adjusting the ranging frame rate of the ranging sensor to the ninth frame rate that is synchronized with the RGB frame rate; or, If the target shooting scene is the third scene, adjusting the ranging frame rate of the ranging sensor to the ninth frame rate; or, If the target shooting scene is the fourth scene, the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate.

8. The method according to any one of claims 5 to 7, characterized in that: If the target shooting mode is the third mode; adjusting the ranging frame rate of the ranging sensor based on the target shooting mode and the target shooting scene includes: If the target shooting scene is the first scene, adjusting the ranging frame rate of the ranging sensor to a fifth frame rate that is synchronized with the RGB frame rate, wherein the fifth frame rate is less than the first frame rate; or If the target shooting scene is the second scene, adjusting the ranging frame rate of the ranging sensor to the fifth frame rate that is synchronized with the RGB frame rate; or, If the target shooting scene is the third scene, the ranging frame rate of the ranging sensor is adjusted to a seventh frame rate synchronized with the RGB frame rate or an eighth frame rate synchronized with the RGB frame rate, wherein the seventh frame rate and the eighth frame rate are both greater than the first frame rate; or If the target shooting scene is the fourth scene, the ranging frame rate of the ranging sensor is adjusted to a ninth frame rate, wherein the ninth frame rate is smaller than the first frame rate.

9. The method according to any one of claims 5 to 8, characterized in that: In response to the first operation, starting a target shooting mode and displaying a target preview image in the shooting preview area includes: If the target shooting mode is switched from the first mode or the third mode to the second mode, the ranging frame rate of the ranging sensor is adjusted to a fifth frame rate, the fifth frame rate being greater than the first frame rate; or If the target shooting mode is switched from the second mode to the first mode or the third mode, the ranging frame rate of the ranging sensor is adjusted to a ninth frame rate, which is smaller than the first frame rate.

10. A device for controlling focus frame rate, characterized in that: The device comprises a camera module, wherein the camera module comprises a camera and a distance measuring sensor; and the method comprises: A display unit, configured to display a first user interface, wherein the first user interface includes a shooting preview area and a plurality of shooting controls, wherein the shooting preview area is configured to display an image captured by the camera; A receiving unit, configured to receive a first operation, where the first operation is an operation on a target shooting control among the multiple shooting controls; a shooting mode unit, responsive to the first operation, starting a target shooting mode and displaying a target preview image in the shooting preview area; A shooting scene unit, used to determine image parameters of the target preview image, and determine a target shooting scene based on the image parameters; The frame rate adjustment unit adjusts the ranging frame rate of the ranging sensor based on the target shooting mode and the target shooting scene.

11. The device according to claim 10, characterized in that The shooting scene unit is used for: Determine the distance of the photographed object in the target preview image by using the ranging sensor; The camera determines the stripe effect detection result and the RGB frame rate in the target preview image.

12. The device according to claim 11, characterized in that The shooting scene unit is specifically used for: If the distance to the photographed object is greater than a first preset distance, then determining that the target photographing scene is a first scene; or, If the distance of the photographed object is less than the first preset distance, and the RGB frame rate of the target preview image is the first frame rate, then the target photographing scene is determined to be the second scene, wherein the first frame rate is the default frame rate of the RGB frame rate in the target preview image; or, If the distance of the photographed object is less than the first preset distance, and the RGB frame rate of the target preview image is the second frame rate or the third frame rate, then the target photographing scene is determined to be the third scene, wherein the second frame rate and the third frame rate are both less than the first frame rate, and the second frame rate or the third frame rate is the frame rate adjusted after performing streak effect detection; or, If the distance of the photographed object is less than the first preset distance and the RGB frame rate of the target preview image is a fourth frame rate, it is determined that the target photographing scene is a fourth scene, wherein the fourth frame rate is less than the first frame rate.

13. The device according to claim 12, characterized in that The device also includes: The preview frame rate adjustment unit adjusts the RGB frame rate in the target preview image to the second frame rate or the third frame rate if the distance of the photographed object is less than the first preset distance and the stripe effect detection result is that the stripe effect exists.

14. The device according to claim 12 or 13, characterized in that The types of the target shooting mode include a first mode, a second mode and a third mode, wherein the first mode includes performing a single shot with continuous focus on the shooting object based on the target preview image, the second mode includes performing a single shot with single focus or a single shot with continuous focus on the shooting object based on the target preview image, and the third mode includes performing continuous focus continuous shooting on the shooting object based on the target preview image.

15. The device according to claim 14, characterized in that If the target shooting mode is the first mode, the frame rate adjustment unit is specifically used to: If the target shooting scene is the first scene, and the distance to the shooting object is greater than a second preset distance or the data acquired by the ranging sensor is invalid, the ranging frame rate of the ranging sensor is adjusted to the first frame rate synchronized with the RGB frame rate, wherein the second preset distance is greater than the first preset distance; or If the target shooting scene is the first scene, and the distance of the shooting object is greater than the first preset distance and less than the second preset distance, the ranging frame rate of the ranging sensor is adjusted to a fifth frame rate synchronized with the RGB frame rate, wherein the fifth frame rate is greater than the first frame rate; or If the target shooting scene is the second scene, the ranging frame rate of the ranging sensor is adjusted to the fifth frame rate or the sixth frame rate synchronized with the RGB frame rate, wherein the sixth frame rate is greater than the first frame rate; or If the target shooting scene is the third scene, the ranging frame rate of the ranging sensor is adjusted to a seventh frame rate synchronized with the RGB frame rate or an eighth frame rate synchronized with the RGB frame rate, or the sixth frame rate, wherein the seventh frame rate and the eighth frame rate are both greater than the first frame rate; or If the target shooting scene is the fourth scene, the ranging frame rate of the ranging sensor is adjusted to a ninth frame rate, wherein the ninth frame rate is smaller than the first frame rate.

16. The device according to claim 14 or 15, characterized in that If the target shooting mode is the second mode, the frame rate adjustment unit is specifically used to: If the target shooting scene is the first scene, adjusting the ranging frame rate of the ranging sensor to a ninth frame rate synchronized with the RGB frame rate, wherein the ninth frame rate is smaller than the first frame rate; or If the target shooting scene is the second scene, adjusting the ranging frame rate of the ranging sensor to the ninth frame rate that is synchronized with the RGB frame rate; or, If the target shooting scene is the third scene, adjusting the ranging frame rate of the ranging sensor to the ninth frame rate; or, If the target shooting scene is the fourth scene, the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate.

17. The device according to any one of claims 14 to 16, characterized in that If the target shooting mode is the third mode; the frame rate adjustment unit is specifically used to: If the target shooting scene is the first scene, adjusting the ranging frame rate of the ranging sensor to a fifth frame rate that is synchronized with the RGB frame rate, wherein the fifth frame rate is less than the first frame rate; or If the target shooting scene is the second scene, adjusting the ranging frame rate of the ranging sensor to the fifth frame rate that is synchronized with the RGB frame rate; or, If the target shooting scene is the third scene, the ranging frame rate of the ranging sensor is adjusted to a seventh frame rate synchronized with the RGB frame rate or an eighth frame rate synchronized with the RGB frame rate, wherein the seventh frame rate and the eighth frame rate are both greater than the first frame rate; or If the target shooting scene is the fourth scene, the ranging frame rate of the ranging sensor is adjusted to a ninth frame rate, wherein the ninth frame rate is smaller than the first frame rate.

18. The device according to any one of claims 14 to 17, characterized in that The shooting mode unit is specifically used for: If the target shooting mode is switched from the first mode or the third mode to the second mode, adjusting the ranging frame rate of the ranging sensor to a fifth frame rate, wherein the fifth frame rate is greater than the first frame rate; or, If the target shooting mode is switched from the second mode to the first mode or the third mode, the ranging frame rate of the ranging sensor is adjusted to a ninth frame rate, which is smaller than the first frame rate.

19. A computer storage medium, characterized in that: The computer storage medium stores a computer program, which implements the method according to any one of claims 1 to 9 when executed by a processor.

20. A computer program, characterized in that The computer program comprises instructions, and when the computer program is executed by a computer, the computer is caused to perform the method according to any one of claims 1 to 9.

Images