A method and apparatus for frame rate control in autofocus tracking

Abstract

This application discloses a method and apparatus for controlling the frame rate of autofocus tracking. The method may include: displaying a first user interface, the first user interface including a shooting preview area and multiple shooting controls, the shooting preview area being used to display images captured by a camera; receiving a first operation, the first operation being an operation on a target shooting control among the multiple shooting controls; responding to the first operation, activating a target shooting mode and displaying a target preview image in the shooting preview area; determining image parameters of the target preview image and determining a target shooting scene based on the image parameters; and adjusting the ranging frame rate of a ranging sensor based on the target shooting mode and the target shooting scene. This application embodiment can flexibly adjust the ranging frame rate based on different shooting modes and shooting scenes, reducing energy consumption while ensuring shooting performance.

Description

Technical Field

[0001] This application relates to the field of terminal technology, and in particular to a method and apparatus for frame rate control of autofocus. Background Technology

[0002] With the improvement of computing power and hardware capabilities, electronic devices can support increasingly diverse shooting scenarios.

[0003] Current photography technologies typically adjust image quality by modifying the automatic exposure module. However, this module needs to maintain a high frame rate for the ranging sensor across various shooting scenarios, resulting in relatively high power consumption. Therefore, a focus-tracking frame rate control scheme is needed that can flexibly adjust the ranging frame rate based on different shooting modes and scenarios, reducing power consumption while ensuring shooting performance. Summary of the Invention

[0004] The technical problem to be solved by the embodiments of this application is to provide a method and apparatus for controlling the frame rate of autofocus, which can flexibly adjust the ranging frame rate based on different shooting modes and shooting scenarios, thereby reducing energy consumption while ensuring shooting performance.

[0005] In a first aspect, embodiments of this application provide a method for detecting electrocardiogram (ECG) signal quality, which may include: applying to an electronic device, the electronic device including a camera module, the camera module including a camera and a ranging sensor; displaying a first user interface, the first user interface including a shooting preview area and a plurality of shooting controls, the shooting preview area being used to display images captured by the camera; receiving a first operation, the first operation being an operation on a target shooting control among the plurality of shooting controls; responding to the first operation, activating a target shooting mode, and displaying a target preview image in the shooting preview area; determining image parameters of the target preview image, and determining a target shooting scene based on the image parameters; and adjusting the ranging frame rate of the ranging sensor based on the target shooting mode and the target shooting scene.

[0006] Existing laser-assisted autofocus technologies typically suffer from two limitations: relatively low laser resolution and a fixed frame rate, usually 15 frames per second (fps). This fixed frame rate approach only allows for simple on / off focus tracking, limiting its effectiveness in photography. This application provides a laser-assisted autofocus solution with higher resolution and frame rate, enabling more effective tracking and focusing on moving objects. However, in real-world scenarios, sustained high frame rate ranging can significantly increase energy consumption, especially during prolonged or continuous use. Furthermore, in non-critical scenarios, high frame rate ranging may not be necessary, offering limited performance gains and instead leading to unnecessary system resource consumption and excessive device load. To address this issue, this application allows for flexible adjustment of the ranging frame rate based on different shooting modes and scenarios, reducing energy consumption while maintaining shooting performance. Specifically, in this embodiment, the user can select a target shooting mode (e.g., autofocus AF-A single-shot mode, autofocus full-time AF-F single-shot mode, object tracking continuous shooting mode, etc.) by clicking the shooting control in the shooting preview area, and determine the target shooting scene based on image parameters in the preview image acquired by the camera (e.g., ambient brightness, stripe effect detection results, and distance to the subject), such as a distant scene, a non-distant scene, or a non-distant scene. - Preview = 30 frames (FramesPer) In addition to one or more scenarios such as Second (FPS) scene, non-far-range - debanding preview 24 / 25fps scene, and non-far-range - low-brightness preview <30fps scene, further, in different shooting modes and for different shooting scenarios, the ranging frame rate adjustment scheme of the ranging sensor may be different. Based on the different shooting modes and shooting environments, the ranging frame rate of the ranging sensor is dynamically adjusted. For example, by increasing the ranging frame rate of the ranging sensor, the distance change of the object can be tracked quickly and accurately, and the focus can be adjusted more quickly, especially when shooting moving objects, which helps to reduce motion blur and keep the image clear; or, by reducing the ranging frame rate, the waste of resources in unnecessary scenes can be reduced (for example, in shooting in low-brightness environments, the benefits of increasing the ranging frame rate are lower due to the longer exposure time). In summary, in this embodiment, after the user selects the target shooting mode, the current shooting scene can be determined based on the parameters in the preview image. The ranging frame rate of the ranging sensor can be dynamically adjusted based on different shooting modes and shooting scenes. The frame rate is increased in scenes and modes that require fast response and accurate focusing, while the frame rate is reduced when the focusing requirement is low and the benefit of increasing the ranging frame rate of the ranging sensor is low. This improves the focusing effect and effectively controls the consumption of resources.

[0007] In one possible implementation, determining the image parameters of the target preview image includes: determining the distance of the object in the target preview image using the ranging sensor; and determining the stripe effect detection result and RGB frame rate in the target preview image using the camera. In this embodiment, the image parameters of the target preview image can be based on the precise distance of the object measured by the ranging sensor (e.g., a matrix laser TOF sensor), and the stripe effect detection result and RGB frame rate in the target preview image determined by the camera (e.g., its automatic exposure module). Subsequently, based on the parameters in the preview image, the system can better identify the current shooting environment and adjust the ranging frame rate of the ranging sensor according to the corresponding shooting mode, providing the user with a better shooting experience.

[0008] In one possible implementation, determining the target shooting scene based on the image parameters includes: if the distance to the object being photographed is greater than a first preset distance, then determining the target shooting scene as a first scene; or, if the distance to the object being photographed is less than the first preset distance, and the RGB frame rate of the target preview image is a first frame rate, then determining the target shooting scene as a second scene, wherein the first frame rate is the default frame rate of the RGB frame rate in the target preview image; or, if the distance to the object being photographed is less than the first preset distance, and the RGB frame rate of the target preview image is a second frame rate or a third frame rate, then determining the target shooting scene as a third scene, wherein both the second frame rate and the third frame rate are less than the first frame rate, and the second frame rate or the third frame rate is the frame rate adjusted after stripe effect detection; or, if the distance to the object being photographed is less than the first preset distance, and the RGB frame rate of the target preview image is a fourth frame rate, then determining the target shooting scene as a fourth scene, wherein the fourth frame rate is less than the first frame rate.

[0009] In this embodiment, the current shooting scene can be determined based on different image parameters in the preview image. Specifically, the shooting scene can be distinguished based on the distance of the shooting object detected by the ranging sensor (e.g., matrix laser TOF sensor) and the RGB frame rate of the preview image. The distance of the shooting object will directly affect the composition and focus of the shot. The ambient brightness can be detected based on the RGB frame rate of the preview image. The ambient brightness affects the exposure level of the shot, and the stripe effect will directly affect the visual effect in the shot. Furthermore, the required range-measuring frame rate may vary depending on the shooting scenario. For example, in long-distance shooting scenarios, when the subject is outside the laser's shooting range, laser rangefinding can be turned off to reduce unnecessary resource consumption. Alternatively, in medium-to-close distance non-low-light scenarios, it may be necessary to increase the range-measuring frame rate of the range sensor to ensure more accurate focusing. Or, in scenarios with debanding effects, since the preview frame rate is set to eliminate or reduce the debanding effect in debanding scenarios, the range-measuring frame rate can be adjusted to synchronize with the RGB frame rate of the preview image for better focusing and to obtain more accurate distance information during focusing. Or, in low-light scenarios, because the exposure time is long, it may cause many other problems, such as motion blur, etc. In this case, the focusing effect is limited, so the exposure time can be lengthened by reducing the range-measuring frame rate. In the embodiments of this application, different scenarios can be distinguished based on image parameters (such as the distance of the subject, the RGB frame rate of the preview image, the debanding effect detection result, etc.), and the camera system can make corresponding adjustments for different scenarios to obtain better image quality. In summary, the embodiments of this application can perform accurate scene recognition (e.g., determine the current shooting scene) based on different parameters in the preview image, thereby adjusting the ranging frame rate of the ranging sensor for different shooting modes and shooting scenes in the future, so as to improve the flexibility of the shooting device and the image quality, and reduce the consumption of resources.

[0010] In one possible implementation, the method further includes: if the distance to the object being photographed is less than the first preset distance, and the stripe effect detection result is yes, then adjusting the RGB frame rate in the target preview image to the second frame rate or the third frame rate. In this embodiment, when a close-range shooting distance is detected and a stripe effect occurs, the stripe effect that may occur during shooting can be reduced or eliminated by adjusting the RGB frame rate in the preview image. Specifically, in automatic exposure mode, the camera adjusts the exposure settings according to the current ambient light. For example, when the RGB frame rate of the camera's preview image is 30 FPS, if the light keeps changing, the camera's exposure settings will also be frequently adjusted, which may lead to uneven brightness in the image, thus producing a stripe effect. In this embodiment, after detecting the existence of a stripe effect, the automatic exposure module in the camera can reduce the frequency mismatch between the camera and the ambient light source by adjusting the RGB frame rate in the preview image. This automatic frame rate adjustment mechanism provides a flexible way to optimize image display in photography, especially when ambient light conditions or shooting distances change, it can automatically adapt and adjust to ensure image quality.

[0011] In one possible implementation, the target shooting mode includes a first mode, a second mode, and a third mode. The first mode includes continuous autofocus and single-shot shooting of the subject based on the target preview image. The second mode includes single-shot or continuous autofocus and single-shot shooting of the subject based on the target preview image. The third mode includes continuous autofocus and burst shooting of the subject based on the target preview image. This application provides three different target shooting modes, namely the first mode, the second mode, and the third mode, allowing users to select the appropriate mode based on different application scenarios for a better shooting experience. Specifically, the first mode (e.g., full-time AF-F mode) allows users to continuously focus on the subject while taking a single shot, suitable for dynamically changing shooting scenes, ensuring clear shooting results even in complex or unstable environments. The second mode (e.g., automatic AF-A mode) can automatically switch focus modes according to the movement of the subject and changes in the environment, quickly and accurately locking focus on both stationary and moving objects. The third mode (e.g., continuous shooting mode within full-time AF-F mode) is more suitable for capturing continuous actions or dynamic scenes, such as sports events or natural animal activities, ensuring that every frame is clearly recorded. In summary, by combining the three shooting modes in this embodiment, and subsequently dynamically adjusting the ranging sensor's frame rate based on different shooting scenes in different modes, the flexibility and adaptability of shooting can be greatly improved, meeting the needs of different shooting scenarios.

[0012] In one possible implementation, if the target shooting mode is a first mode; adjusting the ranging frame rate of the ranging sensor based on the target shooting mode and the target shooting scene includes: if the target shooting scene is the first scene, and the distance to the object being photographed is greater than a second preset distance or the data acquired by the ranging sensor is invalid, then adjusting the ranging frame rate of the ranging sensor to the first frame rate synchronized with the RGB frame rate, wherein the second preset distance is greater than the first preset distance; or, if the target shooting scene is the first scene, and the distance to the object being photographed is greater than the first preset distance and less than the second preset distance, then adjusting the ranging frame rate of the ranging sensor to a fifth frame rate synchronized with the RGB frame rate, wherein... In the above scenarios, the fifth frame rate is greater than the first frame rate; or, if the target shooting scene is the second scene, the ranging frame rate of the ranging sensor is adjusted to the fifth frame rate or the sixth frame rate synchronized with the RGB frame rate, wherein the sixth frame rate is greater than the first frame rate; or, if the target shooting scene is the third scene, the ranging frame rate of the ranging sensor is adjusted to the seventh frame rate or the eighth frame rate synchronized with the RGB frame rate, or the sixth frame rate, wherein both the seventh and eighth frame rates are greater than the first frame rate; or, if the target shooting scene is the fourth scene, the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate, wherein the ninth frame rate is less than the first frame rate.

[0013] In this embodiment, the frame rate of the rangefinder sensor can be dynamically adjusted for different shooting scenarios in the first mode (e.g., full-time AF-F single-shot mode), significantly improving the camera's adaptability and focusing efficiency for different shooting scenarios. Specifically, this dynamic adjustment mechanism allows the camera to automatically adjust the operating frequency of the rangefinder sensor based on the movement speed of the subject and the complexity of the scene. Specifically, when shooting distant objects, for the first scenario, if the distance of the subject is greater than a second preset distance (e.g., the subject is at a distance beyond the effective shooting distance of the rangefinder sensor) or if the ranging data is invalid due to other factors (e.g., excessive distance or rangefinder sensor malfunction), the frame rate of the rangefinder sensor can be adjusted to the first frame rate (e.g., a moderate 30 FPS). The rangefinder sensor may experience data failure due to distance or other reasons, but the z-axis movement (i.e., the subject moving along a vertical direction) will quickly become close, thus the ranging frame rate of the rangefinder sensor will be adjusted accordingly. The distance should not be too low to ensure focusing performance in the current scene; or, when the distance to the subject in the first scene is greater than a first preset distance (e.g., 3 meters) and less than a second preset distance (e.g., 4 meters), the ranging frame rate of the ranging sensor can be increased to the fifth frame rate (e.g., 60 FPS synchronization, which can be the maximum frame rate of the ranging sensor, not specifically limited in this embodiment) that is synchronized with the RGB frame rate in the image preview interface. This allows the ranging sensor to update distance information more frequently, thereby providing a faster and more accurate focusing effect when shooting distant objects. In addition, synchronizing the RGB frame rate and the ranging... Frame rate ensures that the image exposure level remains constant during distance measurement, thus reducing image quality issues caused by inconsistent exposure. Alternatively, when the target shooting scene is a secondary scene, the ranging sensor's frame rate can be increased. This is because the relative position between the object and the sensor may change rapidly in close-range shooting; increasing the ranging frame rate allows for faster capture of these changes, providing more accurate and timely distance information. Or, when the target shooting scene is a tertiary scene, the ranging sensor's frame rate can be adjusted to be synchronized with the RGB frame rate in the target preview image. The frame rate can be set to an integer multiple because the preview frame rate is set in the third scene to eliminate or reduce the stripe effect. Therefore, the ranging frame rate can be adjusted to be synchronized with the RGB frame rate of the preview image for better focusing and more accurate distance information when focusing. Alternatively, when the target shooting scene is the fourth scene, the ranging sensor's frame rate can be adjusted to the ninth frame rate (e.g., 15 FPS out of sync). Since the fourth scene is a low-light scene, the exposure time needs to be lengthened and the frame rate is more chaotic, so the benefit of increasing the ranging frame rate is low. Therefore, the frame rate is reduced in the fourth scene to reduce unnecessary resource consumption.In summary, in this embodiment of the application, for the four different scenarios in the first mode, the ranging frame rate is increased for necessary scenarios where increasing the ranging frame rate can bring more benefits, and the ranging frame rate is decreased for unnecessary scenarios where the benefits are low. This flexible frame rate adjustment not only improves the accuracy and response speed of focusing, but also optimizes energy efficiency and adapts to various shooting needs.

[0014] In one possible implementation, if the target shooting mode is the second mode; adjusting the ranging frame rate of the ranging sensor based on the target shooting mode and the target shooting scene includes: if the target shooting scene is the first scene, adjusting the ranging frame rate of the ranging sensor to a ninth frame rate synchronized with the RGB frame rate, wherein the ninth frame rate is less than the first frame rate; or, if the target shooting scene is the second scene, adjusting the ranging frame rate of the ranging sensor to the ninth frame rate synchronized with the RGB frame rate; or, if the target shooting scene is the third scene, adjusting the ranging frame rate of the ranging sensor to the ninth frame rate; or, if the target shooting scene is the fourth scene, adjusting the ranging frame rate of the ranging sensor to the ninth frame rate.

[0015] In this embodiment, the frame rate of the rangefinder sensor can be dynamically adjusted for different shooting scenarios in the second mode (e.g., autofocus auto AF-A mode). The second mode is usually for shooting low dynamic scenes or static objects. The response speed or accuracy of the focusing system may already be high enough. Increasing the frame rate of the rangefinder sensor will not significantly improve the focusing performance. Therefore, in this embodiment, the frame rate of the rangefinder sensor in each scenario can be maintained at 15 FPS, which is no worse than the previous generation. Specifically, when shooting distant objects, for the first scene, the frame rate of the ranging sensor can be adjusted to the ninth frame rate (e.g., 15 FPS synchronization) synchronized with the RGB frame rate in the target preview image; or, when the target shooting scene is the second scene, the ranging frame rate of the ranging sensor can be adjusted to the ninth frame rate (e.g., 15 FPS synchronization) synchronized with the RGB frame rate in the target preview image; or, when the target shooting scene is the third scene, the ranging frame rate of the ranging sensor can be adjusted to the ninth frame rate (e.g., 15 FPS desynchronized); or, when the target shooting scene is the fourth scene, the ranging frame rate of the ranging sensor can be adjusted to the ninth frame rate (e.g., 15 FPS desynchronized). Furthermore, although reducing the ranging frame rate can reduce the delay time caused by focusing, for fast-moving actions such as frisbees and basketballs, it may cause the action to end before the frame rate is raised. Therefore, excessively low frame rates, such as 1 or 5 frames, lower than 15 frames, are not advisable. In summary, in the embodiments of this application, for the four different scenarios in the first mode, the ranging frame rate is reduced to reduce the consumption of system resources when the benefit of increasing the ranging frame rate is low, and the ranging frame rate is maintained at a frame rate no lower than that of the previous generation to ensure the most basic focusing performance. The ranging frame rate in unnecessary scenarios is reduced, thereby reducing the waste of system resources.

[0016] In one possible implementation, if the target shooting mode is the third mode, adjusting the ranging frame rate of the ranging sensor based on the target shooting mode and the target shooting scene includes: if the target shooting scene is the first scene, adjusting the ranging frame rate of the ranging sensor to a fifth frame rate synchronized with the RGB frame rate, wherein the fifth frame rate is less than the first frame rate; or, if the target shooting scene is the second scene, adjusting the ranging frame rate of the ranging sensor to the fifth frame rate synchronized with the RGB frame rate; or, if the target shooting scene is the third scene, adjusting the ranging frame rate of the ranging sensor to a seventh frame rate synchronized with the RGB frame rate or an eighth frame rate synchronized with the RGB frame rate, wherein both the seventh and eighth frame rates are greater than the first frame rate; or, if the target shooting scene is the fourth scene, adjusting the ranging frame rate of the ranging sensor to a ninth frame rate, wherein the ninth frame rate is less than the first frame rate.

[0017] In this embodiment, the frame rate of the rangefinder sensor can be dynamically adjusted for different shooting scenarios in the third mode (e.g., the continuous shooting mode with autofocus on all objects in full-time AF-F mode). The third mode is suitable for dynamic and complex shooting environments. Specifically, the third mode can continuously track multiple targets, including fast-moving and static objects, ensuring accurate focus in every frame during continuous shooting. It is suitable for shooting scenes with fast and unpredictable movement of objects, such as sports events, wildlife photography, and fast-moving subjects. Furthermore, when the target shooting scene is the first scene, the ranging frame rate of the ranging sensor can be increased to the fifth frame rate synchronized with the RGB frame rate in the image preview interface (e.g., synchronized at 60 FPS; this frame rate can be the maximum frame rate of the ranging sensor, which is not specifically limited in this embodiment), so that the ranging sensor can update distance information more frequently, thereby providing a faster and more accurate focusing effect when shooting distant objects; or, when the target shooting scene is the second scene, since the relative position between the object and the sensor may change rapidly in close-up shooting, the ranging frame rate of the ranging sensor can be increased (e.g., adjusted to the fifth frame rate synchronized with the RGB frame rate in the target preview image), thereby achieving a better tracking focus effect; or, when the target shooting scene is the third scene, the ranging frame rate of the ranging sensor can be adjusted to the fifth frame rate synchronized with the target... The RGB frame rate in the preview image is set to an integer multiple of the frame rate for frame synchronization (e.g., adjusting the ranging sensor's frame rate to the seventh or eighth frame rate synchronized with the RGB frame rate in the target preview image). This is because the preview frame rate is set to eliminate or reduce stripe effects in this third scene, so the ranging frame rate can be adjusted to synchronize with the RGB frame rate of the preview image for better focusing and more accurate distance information during focusing. Alternatively, when the target shooting scene is the fourth scene, the ranging sensor's frame rate can be adjusted to the ninth frame rate (e.g., 15 FPS out of sync). Since the fourth scene is a low-light scene, requiring a longer exposure time and with a more chaotic frame rate, increasing the ranging frame rate has less benefit. Therefore, the ranging frame rate is fixed at a lower value (e.g., 15 FPS out of sync), and the frame rate is reduced in the fourth scene to reduce unnecessary resource consumption. In summary, in this embodiment, for the four different scenarios in the third mode, the ranging frame rate is increased for necessary scenarios where increasing the ranging frame rate brings significant benefits, and decreased for unnecessary scenarios where the benefits are low. This flexible frame rate adjustment not only improves focusing accuracy and response speed but also optimizes energy efficiency, adapting to various shooting needs. Furthermore, the multi-object focusing continuous shooting mode significantly reduces blur and reshoots caused by inaccurate focusing by optimizing the focusing system, thus improving shooting efficiency. In this mode, the camera can adapt to scene changes more quickly and adjust the focus point in a timely manner, ensuring clear images even under varying shooting conditions.

[0018] In one possible implementation, responding to the first operation by activating the target shooting mode and displaying a target preview image in the shooting preview area includes: if the target shooting mode switches from the first mode or the third mode to the second mode, adjusting the ranging frame rate of the ranging sensor to a fifth frame rate, wherein the fifth frame rate is greater than the first frame rate; or, if the target shooting mode switches from the second mode to the first mode or the third mode, adjusting the ranging frame rate of the ranging sensor to a ninth frame rate, wherein the ninth frame rate is less than the first frame rate. In this embodiment, by presetting a ranging sensor frame rate that better suits the application scenario of different focusing modes, the system's waiting loading time can be reduced. Specifically, assuming both the first and third modes are AF-F (full-time autofocus) mode, and the second mode is AF-A (single autofocus) mode, when switching from AF-A (single autofocus) mode to AF-F (full-time autofocus) mode, the preset rangefinder frame rate (e.g., matrix laser TOF sensor) can be set to the fifth frame rate (e.g., 60 FPS). This allows the camera to quickly adapt to dynamic scenes, especially when capturing moving objects, ensuring continuous and stable focusing. When switching the target shooting mode from AF-F mode to AF-A mode, the TOF frame rate can be preset to the ninth frame rate (e.g., 15 FPS). Since AF-A mode is usually suitable for static or relatively stable shooting environments, a lower frame rate setting helps reduce power consumption, extend the lifespan of the device, and maintain high-quality images without frequent focus adjustments. In summary, by setting appropriate default ranging frame rates for different shooting modes, the camera can avoid delays caused by determining preview image parameters. Furthermore, this automatic frame rate adjustment strategy provides users with greater flexibility and control in different shooting environments, optimizing shooting results and user experience.

[0019] Secondly, embodiments of this application provide a frame rate control device for autofocus tracking, the device comprising a camera module, the camera module comprising a camera and a ranging sensor; and may include:

[0020] A display unit is used to display a first user interface, the first user interface including a shooting preview area and multiple shooting controls, the shooting preview area being used to display the image captured by the camera;

[0021] A receiving unit is configured to receive a first operation, wherein the first operation is an operation on a target shooting control among the plurality of shooting controls;

[0022] The shooting mode unit, in response to the first operation, activates the target shooting mode and displays the target preview image in the shooting preview area;

[0023] A scene capture unit is used to determine the image parameters of the target preview image and determine the target shooting scene based on the image parameters;

[0024] The frame rate adjustment unit adjusts the ranging frame rate of the ranging sensor based on the target shooting mode and the target shooting scene.

[0025] In existing technologies, autofocus tracking is typically adjusted by modifying the automatic exposure module. However, in real-world applications, consistently high frame rate ranging can significantly increase power consumption, especially during prolonged or continuous use. Furthermore, in non-critical scenarios, high frame rate ranging may not be necessary, and the performance improvement from maintaining a high frame rate is limited, leading to unnecessary consumption of system resources and excessive device load. To address this issue, this application's embodiment adjusts the ranging sensor's frame rate based on the user-selected shooting mode and the shooting scene confirmed in the preview image from the user interface. This prioritizes maintaining autofocus tracking in essential scenes while reducing the frame rate in non-essential scenes, thereby minimizing power consumption in non-critical environments. Specifically, in this embodiment, the user can select a target shooting mode (e.g., autofocus automatic mode, autofocus all-time mode, object tracking mode, etc.) by clicking the shooting control in the shooting preview area, and determine the target shooting scene based on the image parameters in the preview image acquired by the camera (e.g., ambient brightness, stripe effect detection result, and distance to the shooting object). For example, one or more of the following scenes: long distance scene, non-long distance - preview = 30 frames per second (FPS) scene, non-long distance - debanding preview 24 / 25fps scene, and non-long distance - low brightness preview < 30fps scene. Furthermore, in different shooting modes, the ranging frame rate adjustment scheme of the ranging sensor may be different for different shooting scenes. The ranging frame rate of the ranging sensor is dynamically adjusted based on the different shooting modes and shooting environments. In summary, in this embodiment, after the user selects the target shooting mode, the current shooting scene can be determined based on the parameters in the preview image. The ranging frame rate of the ranging sensor can be dynamically adjusted based on different shooting modes and shooting scenes. The frame rate is increased in scenes and modes that require fast response and accurate focusing, while the frame rate is reduced when the focusing requirement is low and the benefit of increasing the ranging frame rate of the ranging sensor is low. This improves the focusing effect and effectively controls the consumption of resources.

[0026] In one possible implementation, the shooting scene unit is used for:

[0027] The distance to the object being photographed in the target preview image is determined by the ranging sensor.

[0028] The camera is used to determine the stripe effect detection result and RGB frame rate in the target preview image.

[0029] In one possible implementation, the shooting scene unit is specifically used for:

[0030] If the distance to the object being photographed is greater than a first preset distance, then the target shooting scene is determined to be the first scene; or,

[0031] If the distance to the object being photographed is less than the first preset distance, and the RGB frame rate of the target preview image is the first frame rate, then the target shooting scene is determined to be the second scene, wherein the first frame rate is the default frame rate of the RGB frame rate in the target preview image; or,

[0032] If the distance to the object being photographed is less than the first preset distance, and the RGB frame rate of the target preview image is either the second frame rate or the third frame rate, then the target shooting scene is determined to be a third scene, wherein both the second frame rate and the third frame rate are less than the first frame rate, and the second frame rate or the third frame rate is the frame rate adjusted after stripe effect detection; or...

[0033] If the distance to the object being photographed is less than the first preset distance, and the RGB frame rate of the target preview image is the fourth frame rate, then the target shooting scene is determined to be the fourth scene, wherein the fourth frame rate is less than the first frame rate.

[0034] In one possible implementation, the device further includes:

[0035] If the distance to the object being photographed is less than the first preset distance, and the stripe effect detection result indicates the presence of a stripe effect, the preview frame rate adjustment unit adjusts the RGB frame rate in the target preview image to the second frame rate or the third frame rate.

[0036] In one possible implementation, the target shooting mode may include a first mode, a second mode, and a third mode, wherein the first mode includes continuous focusing and single shooting of the subject based on the target preview image, the second mode includes single focusing and single shooting or continuous focusing and single shooting of the subject based on the target preview image, and the third mode includes continuous focusing and continuous shooting of the subject based on the target preview image.

[0037] In one possible implementation, the target shooting mode is the first mode;

[0038] The frame rate adjustment unit is specifically used for:

[0039] If the target shooting scene is the first scene, and the distance to the shooting object is greater than the second preset distance or the data acquired by the ranging sensor is invalid, then the ranging frame rate of the ranging sensor is adjusted to the first frame rate synchronized with the RGB frame rate, wherein the second preset distance is greater than the first preset distance; or,

[0040] If the target shooting scene is the first scene, and the distance to the shooting object is greater than the first preset distance and less than the second preset distance, then the ranging frame rate of the ranging sensor is adjusted to a fifth frame rate synchronized with the RGB frame rate, wherein the fifth frame rate is greater than the first frame rate; or,

[0041] If the target shooting scene is the second scene, then the ranging frame rate of the ranging sensor is adjusted to the fifth frame rate or the sixth frame rate synchronized with the RGB frame rate, wherein the sixth frame rate is greater than the first frame rate; or...

[0042] If the target shooting scene is the third scene, then the ranging frame rate of the ranging sensor is adjusted to a seventh frame rate synchronized with the RGB frame rate, or an eighth frame rate synchronized with the RGB frame rate, or the sixth frame rate, wherein both the seventh and eighth frame rates are greater than the first frame rate; or,

[0043] If the target shooting scene is the fourth scene, then the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate, wherein the ninth frame rate is less than the first frame rate.

[0044] In one possible implementation, if the target shooting mode is the second mode;

[0045] The frame rate adjustment unit is specifically used for:

[0046] If the target shooting scene is the first scene, then the ranging frame rate of the ranging sensor is adjusted to a ninth frame rate synchronized with the RGB frame rate, wherein the ninth frame rate is less than the first frame rate; or...

[0047] If the target shooting scene is the second scene, then the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate, which is synchronized with the RGB frame rate; or,

[0048] If the target shooting scene is the third scene, then the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate; or,

[0049] If the target shooting scene is the fourth scene, then the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate.

[0050] In one possible implementation, the target shooting mode is the third mode;

[0051] The frame rate adjustment unit is specifically used for:

[0052] If the target shooting scene is the first scene, then the ranging frame rate of the ranging sensor is adjusted to a fifth frame rate synchronized with the RGB frame rate, wherein the fifth frame rate is less than the first frame rate; or,

[0053] If the target shooting scene is the second scene, then the ranging frame rate of the ranging sensor is adjusted to the fifth frame rate, which is synchronized with the RGB frame rate; or,

[0054] If the target shooting scene is the third scene, then the ranging frame rate of the ranging sensor is adjusted to a seventh frame rate synchronized with the RGB frame rate or an eighth frame rate synchronized with the RGB frame rate, wherein both the seventh frame rate and the eighth frame rate are greater than the first frame rate; or,

[0055] If the target shooting scene is the fourth scene, then the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate, wherein the ninth frame rate is less than the first frame rate.

[0056] In one possible implementation, the shooting mode unit is specifically used for:

[0057] If the target shooting mode is switched from the first mode or the third mode to the second mode, then the ranging frame rate of the ranging sensor is adjusted to the fifth frame rate, which is greater than the first frame rate; or,

[0058] If the target shooting mode is switched from the second mode to the first mode or the third mode, the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate, which is less than the first frame rate.

[0059] Thirdly, embodiments of this application provide a computer storage medium for storing computer software instructions used in a focus tracking frame rate control apparatus provided for the second aspect above, which includes a program designed to execute the aspects described above.

[0060] Fourthly, embodiments of this application provide a computer program including instructions that, when executed by a computer, enable the computer to perform the processes executed in the focus-tracking frame rate control device described in the second aspect. Attached Figure Description

[0061] To more clearly illustrate the technical solutions in the embodiments of this application or the background art, the accompanying drawings used in the embodiments of this application or the background art will be described below.

[0062] Figure 1A This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application.

[0063] Figure 1B This is a schematic diagram of the hardware structure of another electronic device provided in an embodiment of this application.

[0064] Figure 1C This is a schematic diagram of the software structure of the electronic device provided in the embodiments of this application.

[0065] Figure 2A This is a schematic diagram of a focus tracking frame rate control module provided in an embodiment of this application.

[0066] Figure 2B This is a schematic diagram of another frame rate control module for autofocus provided in an embodiment of this application.

[0067] Figure 2C This is a schematic diagram of another frame rate control module for autofocus provided in an embodiment of this application.

[0068] Figure 3A This is a schematic diagram of a frame rate control process for autofocus provided in an embodiment of this application.

[0069] Figure 3B This is a schematic diagram of a user interface provided in an embodiment of this application.

[0070] Figure 3C This is another user interface diagram provided in the embodiments of this application.

[0071] Figure 3D This is another user interface diagram provided in the embodiments of this application.

[0072] Figure 3E This is a scenario example diagram provided in the embodiments of this application.

[0073] Figure 3F This is a timing diagram provided in the embodiments of this application.

[0074] Figure 4 This is a schematic diagram of a scene strategy under a shooting mode provided in an embodiment of this application.

[0075] Figure 5A This is a schematic diagram of a first mode provided in the embodiments of this application.

[0076] Figure 5B This is a schematic diagram of a first mode provided in the embodiments of this application.

[0077] Figure 6 This is a schematic diagram of a second mode provided in the embodiments of this application.

[0078] Figure 7A This is a schematic diagram of a third mode opening provided in the embodiments of this application.

[0079] Figure 7B This is a schematic diagram of a long-distance scene in a third mode provided in the embodiments of this application.

[0080] Figure 7C This is a schematic diagram of a close-range scene in a third mode provided in the embodiments of this application.

[0081] Figure 7D This is a schematic diagram of a stripe effect scenario provided in an embodiment of this application.

[0082] Figure 7E This is a schematic diagram of a low-brightness scene in a third mode provided in the embodiments of this application.

[0083] Figure 7F This is a schematic diagram of a long-distance continuous shooting scene in a third mode provided in the embodiments of this application. Detailed Implementation

[0084] The embodiments of this application will now be described with reference to the accompanying drawings.

[0085] The terms "first," "second," "third," and "fourth," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or apparatuses.

[0086] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0087] As used in this specification, the terms "component," "module," "system," etc., are used to refer to computer-related entities, hardware, firmware, combinations of hardware and software, software, or software in execution. For example, a component can be, but is not limited to, a process running on a processor, a processor, an object, an executable file, an execution thread, a program, and / or a computer. As illustrated, applications running on computing devices and computing devices can both be components. One or more components may reside in a process and / or an execution thread, and components may be located on a single computer and / or distributed among two or more computers. Furthermore, these components can be executed from various computer-readable media on which various data structures are stored. For example, a component may communicate via local and / or remote processes based on signals having one or more data packets (e.g., data from two components interacting with another component between a local system, a distributed system, and / or a network, such as the Internet interacting with other systems via signals).

[0088] First, some of the terms used in this application will be explained to facilitate understanding by those skilled in the art.

[0089] (1) Subject Tracking is a photographic technique used to continuously track a specific subject (such as a person, animal, or vehicle). This technique ensures that the subject remains sharp even when it is moving, which is important for fast-moving environments such as sports photography, wildlife photography, and news photography. Furthermore, modern cameras utilize image recognition and tracking algorithms to achieve this function, enabling them to effectively lock onto and track the target subject in complex backgrounds or lighting conditions.

[0090] (2) Motion Tracking: A photographic technique focused on precisely tracking moving objects. This technique is suitable for capturing fast-moving objects, such as athletes, birds, or fast-moving vehicles; its purpose is to create a dynamically blurred background by adjusting shutter speed and focus while maintaining the sharpness of the moving subject, thereby emphasizing the sense of speed and fluidity of motion. Motion tracking is particularly important in sports events, wildlife photography, and high-speed action scene photography. Modern cameras and video equipment use complex algorithms and sensing technologies to achieve rapid response and continuous tracking of moving objects.

[0091] (3) Autofocus (AF) is a photographic technique that enables the camera and lens system to automatically adjust the focus point and ensure image sharpness. AF systems utilize various sensors, algorithms, and mechanical components to detect and adjust the focus, and are crucial for fast-moving scenes, low-light environments, or shooting situations requiring high technical skill. Autofocus technology includes two main types: phase-detection AF (fast, suitable for tracking moving objects) and contrast-detection AF (high accuracy, but relatively slower). With technological advancements, modern cameras typically combine the advantages of both systems to provide more flexible and efficient autofocus solutions.

[0092] (4) Auto Exposure (AE) is a photographic technique that allows the camera to automatically adjust exposure parameters, such as aperture, shutter speed, and ISO (sensitivity), to ensure that the image has appropriate brightness and contrast. This technique is particularly important in varying lighting conditions, especially in fast-paced shooting environments, allowing photographers to focus more on composition and creative expression without having to manually adjust all exposure settings. Modern cameras typically include multiple AE systems, such as evaluative metering, center-weighted metering, and spot metering, to adapt to different shooting scenarios and subject requirements.

[0093] (5) Preview Frame Rate refers to the frame rate at which the camera previews the scene before taking a picture or recording a video. Frame rate, which is the number of image frames transmitted per second, is an important indicator for measuring the smoothness of video; in photography or videography, the preview frame rate directly affects whether the scene in progress can be accurately captured and evaluated.

[0094] (6) TOF (Time of Flight): A measurement technique used to determine the distance between an object and a sensing device. It works by sending a light signal (usually a laser) to the target object and measuring the round-trip time of the light signal. In photography and videography, TOF sensors are commonly used for depth sensing, helping to improve the speed and accuracy of autofocus, especially in low-light environments. In addition, TOF technology is also applied in fields such as augmented reality (AR) and virtual reality (VR), as well as certain types of 3D modeling and facial recognition technologies.

[0095] (7) RGB (Red, Green, Blue): RGB refers to red, green, and blue, these three colors are used as the basic colors for creating color images on electronic displays. In digital imaging, the RGB model is widely used in display and sensing systems of various devices, including televisions, computer screens, cameras, and scanners. The RGB model is based on the human eye's sensitivity to red, green, and blue light, and a wide range of colors can be produced by combining these three colors with different intensities. In photography, camera sensors typically use RGB color filters to capture color images.

[0096] (8) Banding is a visual artifact that appears in digital images, where there is a noticeable separation or "banding" between colors or gray levels that should transition smoothly. This effect is usually more noticeable in the shadow or gradient areas of an image, especially when the image contains large areas of the same tone.

[0097] (9) Frame rate (Frames Per Second, FPS) is a definition in the field of graphics, referring to the number of frames transmitted per second. In simpler terms, it refers to the number of frames in an animation or video. FPS measures the amount of information used to store and display dynamic video. The more frames per second, the smoother the displayed motion. Generally, a minimum of 30 frames per second is needed to avoid choppy motion. Some computer video formats can only provide 15 frames per second.

[0098] To facilitate understanding of the embodiments of this application, the exemplary electronic devices provided in the embodiments of this application will be described below.

[0099] Please see Figure 1A , Figure 1A This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application. The electronic device 100 is a smart terminal device and can be of various types; this embodiment does not limit its specific type. For example, the terminal device can be a mobile phone, and may also include tablet computers, desktop computers, desktop computers with touch-sensitive surfaces or touch panels, laptop computers, handheld computers, smart screens, wearable devices (such as smartwatches, smart bracelets, etc.), augmented reality (AR) devices, virtual reality (VR) devices, artificial intelligence (AI) devices, etc. Figure 1A As shown, the electronic device 100 may include a rear-facing camera 011 and a sensor 012. The sensor 012 can be a ranging sensor that implements various ranging methods such as Time of Flight (TOF), structured light ranging, binocular ranging, and laser ranging. Assuming that the current ranging method is Direct Time of Flight (DTOF) in matrix laser TOF ranging, the sensor 012 may be configured with a transmitter 012A and a receiver 012B. The specific working process is as follows: the transmitter emits a light pulse towards the object being photographed. The object can reflect the light beam, and the sensor at the receiver end can receive the reflected light pulse. By measuring, the time interval between the reflected light pulse and the emitted light pulse can be obtained, which is the time of flight of light. Based on the time of flight of light and the speed of light, the object distance can be calculated.

[0100] Matrix laser Time-of-Flight (TOF) ranging can also be called Indirect Time-of-Flight (ITOF) ranging. ITOF ranging devices, like DTOF devices, have transmitters and receivers. Unlike DTOF devices, ITOF devices emit light pulses that are sinusoidally modulated, resulting in light signals with regularly varying brightness. These light pulses, after striking an object's surface, are reflected back and captured by the ITOF receiver. Because the emitted and reflected light pulses of an ITOF device exhibit regularly varying signals, the time of flight can be indirectly calculated by comparing the signal differences between the emitted and reflected pulses, thus determining the object distance.

[0101] It should be added that, in addition to its application in autofocus, TOF devices can also be used in face recognition, gesture recognition, and other applications, which will not be elaborated here.

[0102] With the continuous development of terminal technology, the functions that camera modules in electronic devices can achieve are becoming increasingly diverse. For example, camera modules can achieve autofocus, optical image stabilization, and clear imaging at long distances. To achieve these functions, electronic devices are generally equipped with multiple camera modules.

[0103] For example, a camera module can be a module for implementing autofocus, specifically including a lens assembly, an image sensor, and an image signal processor. Some camera modules also include a distance measurement module. The lens assembly receives light signals from the outside world and focuses them onto the image sensor. The distance measurement module can emit light pulses and receive reflected light pulses, thus determining the distance between the object and the distance measurement module based on the time-of-flight of light. The camera module can then adjust the distance between the lens assembly and the image sensor based on this distance to achieve clear imaging.

[0104] As can be seen, a camera module has a certain light-transmitting range, within which light signals enter or exit. Since both the lens assembly and the distance measurement module require light transmission, the light-transmitting range of a camera module is generally large. However, an excessively large light-transmitting range increases the difficulty of camera module layout, not only occupying too much layout space but also affecting the aesthetics of the electronic device.

[0105] Please see Figure 1B , Figure 1B This is a schematic diagram of the hardware structure of another electronic device provided in an embodiment of this application. The following is in conjunction with... Figure 1B A detailed description of each component of the electronic device 100 is provided below:

[0106] Electronic device 100 may include processor 110, external memory interface 120, internal memory 121, universal serial bus (USB) interface 130, charging management module 140, power management module 141, battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0107] It is understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0108] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0109] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of fetching and executing instructions.

[0110] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0111] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0112] It is understood that the interface connection relationships between the modules illustrated in the embodiments of the present invention are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0113] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141.

[0114] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 121, external memory, display screen 194, camera 193, and wireless communication module 160, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be located in the same device.

[0115] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0116] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.

[0117] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.

[0118] The modem processor may include a modulator and a demodulator. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.

[0119] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0120] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).

[0121] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0122] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or N displays 194, where N is a positive integer greater than 1.

[0123] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0124] The ISP (Image Signal Processor) works in conjunction with the camera 193 to process the data captured by the camera. During the shooting process, when the shutter opens, light passes through the lens to the image sensor, and the automatic exposure module adjusts the exposure parameters to capture the optimal light. The image sensor, such as a charge-coupled device (CCD) or complementary metal-oxide-semiconductor (CMOS) phototransistor, converts the light signal into an electrical signal. These electrical signals are then passed to the ISP for processing, converting them into digital image signals. After optimization by the ISP's algorithms, such as noise reduction, brightness adjustment, and color optimization, the signals are output to the DSP (Digital Signal Processor) for further processing. The DSP converts the digital image signal into standard RGB, YUV, and other format image signals. In some embodiments, the electronic device 100 may include one or more (N, where N is a positive integer greater than 1) cameras 193, each integrating an ISP and an AE module to provide high-quality image capture and processing capabilities. In this embodiment, the ISP (Image Signal Processor) works in conjunction with the camera 193 to acquire the RGB frame rate of the preview image and detect ambient brightness and exposure settings based on the RGB frame rate.

[0125] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when electronic device 100 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.

[0126] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. Thus, electronic device 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0127] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.

[0128] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.

[0129] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of electronic device 100 (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0130] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0131] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.

[0132] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or make hands-free calls through the speaker 170A.

[0133] The receiver 170B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a telephone call or voice message, the receiver 170B can be brought close to the ear to listen to the voice.

[0134] Microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 170C, inputting the sound signal into microphone 170C. Electronic device 100 may have at least one microphone 170C. In some embodiments, electronic device 100 may have two microphones 170C, which, in addition to collecting sound signals, can also perform noise reduction. In other embodiments, electronic device 100 may also have three, four, or more microphones 170C, which can collect sound signals, reduce noise, identify the sound source, and perform directional recording, etc.

[0135] The 170D headphone jack is used to connect wired headphones. The 170D headphone jack can be a USB 130 interface or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface, or a CTIA standard interface.

[0136] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be disposed on display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. Electronic device 100 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 194, electronic device 100 detects the intensity of the touch operation based on pressure sensor 180A. Electronic device 100 can also calculate the touch position based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands. For example: when a touch operation with an intensity less than a first pressure threshold is applied to the SMS application icon, a command to view an SMS is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to the SMS application icon, a command to create a new SMS is executed.

[0137] The gyroscope sensor 180B can be used to determine the motion attitude of the electronic device 100.

[0138] The 180C barometric pressure sensor is used to measure barometric pressure.

[0139] The magnetic sensor 180D includes a Hall sensor.

[0140] The 180E accelerometer can detect the magnitude of acceleration of electronic device 100 in various directions (typically three axes). When electronic device 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of electronic devices and applied to applications such as screen orientation switching and pedometers.

[0141] The ranging sensor 180F is typically used to measure the distance between an object and a device, providing accurate distance data. The ranging sensor 180F can be a matrix laser time-of-flight (TOF) sensor, which uses laser pulses to measure the time it takes for a light wave to travel between the sensor and the object, thereby accurately calculating the distance. Matrix laser TOF sensors can not only measure the distance to a single point, but also capture depth information of the entire scene through matrix arrangement, providing data for 3D imaging and advanced scene analysis. These sensors are important in various applications, such as autofocus camera systems, gesture recognition, augmented reality, and obstacle detection. Their accurate ranging capabilities enable electronic devices to better understand and interact with their environment. In this embodiment, the ranging sensor 180F is used to determine the distance to the object being photographed in the preview image. Furthermore, the decision module in the camera can adjust the ranging frame rate of the ranging sensor 180F based on changes in the shooting mode and shooting scene. Optionally, the ranging sensor 180F can also work in conjunction with the motor 191 to achieve the function of measuring the distance between the object and the device.

[0142] The proximity light sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode.

[0143] An ambient light sensor 180L is used to sense the brightness of the surrounding environment and works closely with the AE module to optimize the shooting experience. When the user is ready to take a picture, the ambient light sensor first measures the light intensity of the current scene, and this information is then passed to the automatic exposure module. In this embodiment, the automatic exposure module can adjust camera settings, such as aperture size, exposure time, and ISO sensitivity, based on the data acquired by the ambient light sensor 180L, to ensure the quality of the preview image during shooting. Especially in handling RGB frame rates, the input from the ambient light sensor directly affects the color balance and brightness level of the image. This dynamic adjustment ensures that under different lighting conditions, whether in strong light or low light environments, the user can obtain a preview image with vivid colors and moderate brightness. Therefore, the ambient light sensor 180L not only simply senses the brightness but also provides the AE module with the necessary information throughout the image capture process to achieve the best image capture effect.

[0144] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can utilize the characteristics of the collected fingerprints to achieve fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering calls with fingerprints, etc.

[0145] Temperature sensor 180J is used to detect temperature. In some embodiments, electronic device 100 uses the temperature detected by temperature sensor 180J to execute a temperature processing strategy.

[0146] Touch sensor 180K, also known as a "touch panel," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touch screen." Touch sensor 180K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K may also be located on the surface of electronic device 100, in a different position than display screen 194.

[0147] The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire vibration signals from the vibrating bone segments of the human vocal cords. The bone conduction sensor 180M can also contact the human pulse to receive blood pressure signals. In some embodiments, the bone conduction sensor 180M can also be incorporated into headphones to form bone conduction headphones. The audio module 170 can parse the voice signals from the vibrating bone segments of the vocal cords acquired by the bone conduction sensor 180M to realize voice functionality. The application processor can parse heart rate information from the blood pressure signals acquired by the bone conduction sensor 180M to realize heart rate detection functionality.

[0148] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch-sensitive buttons. Electronic device 100 can receive button input and generate key signal inputs related to user settings and function control of electronic device 100.

[0149] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. For example, different vibration feedback effects can correspond to different touch operations applied to different applications (such as taking photos, playing audio, etc.). Motor 191 can also correspond to different vibration feedback effects for touch operations applied to different areas of the display screen 194. Different application scenarios (such as time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also be customized.

[0150] Indicator 192 can be an indicator light, used to indicate charging status, power changes, or to indicate messages, missed calls, notifications, etc.

[0151] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to make contact with and separate from the electronic device 100. The electronic device 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 simultaneously. The multiple cards can be of the same or different types. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to realize functions such as calls and data communication. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0152] The software system of electronic device 100 can adopt a layered architecture. Figure 1C This is a schematic diagram of the software structure of the electronic device provided in the embodiments of this application.

[0153] A layered architecture divides the system into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the system is divided into five layers, from top to bottom: application layer, application framework layer, hardware abstraction layer, driver layer, and hardware layer.

[0154] The application layer may include a series of application packages. In this embodiment, the application package may include a camera, a gallery, etc.

[0155] The application framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The application framework layer includes some predefined functions. In this embodiment, the application framework layer may include a camera access interface, which may include camera management and camera devices. The camera access interface is used to provide application programming interfaces and programming frameworks for camera applications.

[0156] The hardware abstraction layer is an interface layer located between the application framework layer and the driver layer, providing a virtual hardware platform for the operating system. In this embodiment, the hardware abstraction layer may include a camera hardware abstraction layer and a camera algorithm library.

[0157] The camera hardware abstraction layer can provide virtual hardware for camera device 1, camera device 2, or more camera devices. The camera algorithm library may include runtime code and data that implement the shooting methods provided in the embodiments of this application.

[0158] The driver layer is the layer between hardware and software. It includes drivers for various hardware components, such as camera drivers, digital signal processor drivers, and image processor drivers.

[0159] The camera hardware layer may include sensors, image signal processors, digital signal processors, and image processors. The sensors may include sensor 1, sensor 2, TOF, and multispectral sensors. The hardware layer is also connected to the driver layer, which includes camera device drivers, digital signal processor drivers, and image processor drivers. These drivers are responsible for translating high-level commands from the operating system or applications into instructions that the camera hardware can understand and execute.

[0160] The camera device driver is used to drive the image sensor of the camera to acquire images and to drive the image signal processor to preprocess the images. The digital signal processor driver is used to drive the digital signal processor to process images. The image processor driver is used to drive the graphics processor to process images.

[0161] The following describes, in conjunction with the above software structure, the software and hardware workflows of the embodiments of this application when taking pictures using the electronic device 100.

[0162] In response to a user's action of opening the camera application, such as clicking the camera application icon, the camera application calls the camera access interface in the application framework layer to launch the camera application. This then sends a command to the camera device (camera device and / or other camera devices) in the camera hardware abstraction layer to start the camera. The camera hardware abstraction layer forwards this command to the camera device driver in the kernel layer. The camera device driver can then activate the corresponding camera's image sensor and acquire image light signals through the image sensor. One camera device in the camera hardware abstraction layer corresponds to one image sensor in the hardware layer.

[0163] Then, the camera's image sensor can transmit the acquired image light signal to the image signal processor for preprocessing to obtain the image electrical signal (that is, the original image, such as a RAW image), and transmit the original image to the camera hardware abstraction layer through the camera device driver.

[0164] The camera hardware abstraction layer can send raw images to a camera algorithm library. The camera algorithm library stores program code that implements the laser-tracking dynamic frame rate method provided in this application embodiment. Based on a digital signal processor and an image processor, the camera algorithm library executes the above code, enabling the electronic device 100 to perform some or all of the steps of the laser-tracking dynamic frame rate method provided in this application embodiment.

[0165] The camera algorithm library can send processed images (such as RGB images) to the camera hardware abstraction layer. The camera hardware abstraction layer can then display the images. Simultaneously, the camera algorithm library can perform various image processing tasks, such as noise reduction, color correction, and contrast adjustment, to improve image quality or perform specific computer vision tasks.

[0166] Optionally, through the interface provided by the camera hardware abstraction layer, the original image or the image processed by the camera algorithm library can be stored in a specific storage unit. Furthermore, in response to the user's operation of opening the gallery application, such as clicking the gallery application icon and then clicking to view the image, the gallery application calls the corresponding interface to access the image data in the storage unit, and then calls the image decoding library to decode the stored image data into an image that can be displayed on the screen for display in the application.

[0167] Understandable Figures 1A-1C The system architecture described above is only one or more exemplary implementations in the embodiments of this application, and the structures in the embodiments of this application include, but are not limited to, the above system architecture.

[0168] Based on the three system architectures described above, this application provides a functional module applied to the aforementioned system architectures. Please refer to [link to relevant documentation]. Figures 2A-2C , Figure 2A This is a schematic diagram of a focus tracking frame rate control module provided in an embodiment of this application, as shown below. Figure 2A As shown, the decision-making module can be located in AF module 1001; Figure 2B This is a schematic diagram of another focus tracking frame rate control module provided in an embodiment of this application, as shown below. Figure 2B As shown, the decision-making module can be located in AE module 1002; Figure 2C This is a schematic diagram of another frame rate control module for autofocus provided in an embodiment of this application, as shown below. Figure 2C As shown, the decision module can be a standalone module, connected to the AF module 1001 and the AE module 1002. The following will use... Figure 2A The illustrated embodiment specifically describes the AF module 1001 and AE module 1002 in the frame rate control module for autofocus tracking. Wherein:

[0169] AF Module 1001: AF Module 1001 integrates autofocus and decision logic functions, optimizing focus performance based on information acquired from AE Module 1002. AF Module 1001 can detect distance and depth information in the scene using sensors (such as one or more rangefinders, including laser rangefinders, phase detection sensors, contrast detection sensors, and matrix laser TOF sensors). AF Module 1001 can also receive banding flags and RGB frame rate data acquired from AE Module 1002, and use this information to determine whether the current shooting environment is affected by banded lighting, such as fluorescent lighting, and to determine the smoothness of real-time preview or image capture. AF Module 1001 can adjust different frame rate strategies based on different detected environments, prioritizing focus tracking and reducing the frame rate in unnecessary scenarios. For example, after detecting banding, the AF module 1001 can eliminate or reduce potential light flicker by adjusting the RGB frame rate in the preview image frame, ensuring that image quality is not affected. Simultaneously, the ranging frame rate information from the ranging sensor determines the ranging speed per second during focusing, which is particularly crucial for capturing dynamic scenes. If the RGB frame rate in the preview image is high, it indicates rapid scene changes, and the AF module 1001 will increase the ranging frame rate to keep up with these changes; conversely, if the RGB frame rate is low, it may mean a relatively static scene, and the AF module can reduce the ranging frame rate to improve efficiency. Furthermore, the AF module 1001 also determines whether autofocus and auto exposure need to be synchronized to maintain image consistency and quality.

[0170] AE Module 1002: The AE module 1002 is responsible for measuring the light intensity of the scene and automatically adjusting the camera settings to ensure proper exposure of the photos. In this embodiment, the AE module 1002 can obtain the banding flag and RGB frame rate from the preview image and provide them to the AF module 1001 as decision conditions to adjust different frame rate strategies. The AE module 1002 can also automatically adjust the camera's exposure settings, including aperture, shutter speed, and ISO value, to achieve optimal image brightness. The AE module 1002 not only adjusts exposure parameters according to scene brightness but also monitors possible banding effects and feeds this information back to the AF module 1001 via the banding flag. Furthermore, the AE module continuously monitors and provides RGB frame rate data during real-time preview or video recording to ensure that the exposure settings can adapt to rapidly changing scene and lighting conditions. The output of the AE module 1002 ensures high-quality images are obtained under various lighting conditions for the AF module 1001's focus decision.

[0171] based on Figures 1A-1C The provided system architecture, and Figure 2AThe provided focus tracking frame rate control module, combined with the focus tracking frame rate control method provided in the embodiments of this application, specifically analyzes and solves the technical problems raised in this application.

[0172] See Figure 3A , Figure 3A This is a flowchart illustrating a focus tracking frame rate control method provided in an embodiment of this application. This method can be applied to the above-mentioned... Figures 1A-1C In the system architecture described above, the one in which Figures 1A-1C Terminal device 100 can be used to support and execute Figure 3A The method flow shown consists of steps S300-S304. This method may include the following steps S300-S304.

[0173] Step S300: Display the first user interface.

[0174] Specifically, a first user interface is displayed, which includes a shooting preview area and multiple shooting controls. The shooting preview area is used to display images captured by the camera. For example, see [link to example]. Figure 3B , Figure 3B This is a schematic diagram of a user interface provided in an embodiment of this application. Figure 3B The left side includes two people in motion. Figure 3B The right side includes a terminal device 200, which includes an image preview interface. The image preview interface displays the image captured in real time by the camera (i.e., the two people dancing on the left). The terminal device 200 may also include multiple shooting controls. You can view the captured images by clicking on the history image 401, take a single shot by clicking on the shutter 402, take a continuous shot by pressing and holding the shutter 402, switch between the front and rear cameras by clicking on the camera switch 403, and switch the shooting mode by clicking on the shooting mode 404.

[0175] Step S301: Receive the first operation.

[0176] Specifically, the system receives a first operation, which is an operation on a target shooting control among the plurality of shooting controls. This operation is received when a user performs an operation on one of the plurality of selectable shooting controls (e.g., by touching the screen or using the camera switch 403 to switch between front and rear cameras, selecting a specific camera angle). For example, see [link to relevant documentation]. Figure 3C , Figure 3C This is another user interface diagram provided in the embodiments of this application. In this case, the user enters... Figure 3C In the camera interface, the target shooting control can be either AF-F mode 405 or AF-A mode 406. The first operation can be that the user clicks on AF-F mode 405 or AF-A mode 406 to switch shooting modes.

[0177] Step S302: In response to the first operation, start the target shooting mode.

[0178] Specifically, in response to the first operation, the target shooting mode is activated, and a target preview image is displayed in the shooting preview area. The user can select the target shooting mode (e.g., autofocus AF-A single-shot mode, autofocus full-time AF-F single-shot mode, continuous shooting mode with object tracking, etc.) by clicking the shooting controls in the shooting preview area. The camera system responds immediately and enters the specific shooting state. For example, see [link to example]. Figure 3C , Figure 3C This is another user interface diagram provided in the embodiments of this application. The target shooting control can be one or more of AF-F mode 405 and AF-A mode 406. The first operation can be that the user can slide out AF-F mode 405 or AF-A mode 406 by pulling down the status bar, and then select the corresponding shooting mode by clicking AF-F mode 405 and AF-A mode 406 in the upper frame. At this time, the shooting preview area (e.g., the camera's display screen or through the interface of a mobile application) will display the target preview image, allowing the user to see the scene captured by the current lens. For example, in wildlife photography, when the photographer selects the target shooting mode, the system will immediately display the captured animal image on the display screen and update it in real time so that the photographer can make timely adjustments to the shooting angle and composition.

[0179] In one possible implementation, the target shooting mode includes a first mode, a second mode, and a third mode. The first mode includes continuous autofocus and single-shot shooting of the subject based on the target preview image; the second mode includes single-shot or continuous autofocus and single-shot shooting of the subject based on the target preview image; and the third mode includes continuous autofocus and burst shooting of the subject based on the target preview image. Specifically, this application provides three different target shooting modes, namely the first mode, the second mode, and the third mode. Users can select the appropriate mode based on different application scenarios to obtain a better shooting experience. For example, see [link to relevant documentation]. Figure 3D , Figure 3DThis application provides another user interface diagram, including AF-F mode 405, AF-A mode 406, and object tracking mode 404A (i.e., AF-F continuous shooting mode); further, the first operation can be that after the user clicks the first mode (e.g., AF-F mode 405), while continuously focusing on the subject, a single shot is taken by clicking the shutter 402 (i.e., the target shooting control). This first mode is suitable for dynamically changing shooting scenes, ensuring clear shooting results even in complex or unstable environments; in the second mode (e.g., AF-A mode 406), the system can adjust the focus according to the movement of the subject. The system automatically switches focus modes based on movement and environmental changes. In this mode, the first operation is for the user to take a single shot by clicking the shutter button 402 (i.e., the target shooting control) to quickly and accurately lock the focus. In this second mode, the system can quickly and accurately lock the focus on both stationary and moving objects. The third mode (e.g., the object tracking mode 404A) with continuous focus shooting is more suitable for capturing continuous actions or dynamic scenes. In this case, in shooting dynamic scenes such as sports events or natural animal activities, the first operation is for the user to press and hold the shutter button 402 (i.e., the target shooting control) to take continuous shots, ensuring that every frame is recorded clearly.

[0180] In one possible implementation, if the target shooting mode switches from the first mode or the third mode to the second mode, the ranging frame rate of the ranging sensor is adjusted to a fifth frame rate, which is greater than the first frame rate; or, if the target shooting mode switches from the second mode to the first mode or the third mode, the ranging frame rate of the ranging sensor is adjusted to a ninth frame rate, which is less than the first frame rate. Specifically, in this embodiment, by presetting a ranging sensor frame rate that better suits the application scenario of different focusing modes, the system's waiting loading time can be reduced. Specifically, assuming both the first and third modes are AF-F (full-time autofocus) mode, and the second mode is AF-A (single autofocus) mode, when switching from AF-A (single autofocus) mode to AF-F (full-time autofocus) mode, the preset rangefinder frame rate (e.g., matrix laser TOF sensor) can be set to the fifth frame rate (e.g., 60 FPS). This allows the camera to quickly adapt to dynamic scenes, especially when capturing moving objects, ensuring continuous and stable focusing. When switching the target shooting mode from AF-F mode to AF-A mode, the TOF frame rate can be preset to the ninth frame rate (e.g., 15 FPS). Since AF-A mode is usually suitable for static or relatively stable shooting environments, a lower frame rate setting helps reduce power consumption, extend the lifespan of the device, and maintain high-quality images without frequent focus adjustments. In summary, by setting appropriate default ranging frame rates for different shooting modes, the camera can avoid delays caused by determining preview image parameters. Furthermore, this automatic frame rate adjustment strategy provides users with greater flexibility and control in different shooting environments, optimizing shooting results and user experience.

[0181] Step S303: Determine the image parameters of the target preview image, and determine the target shooting scene based on the image parameters.

[0182] Specifically, the system analyzes the target preview image to determine various key image parameters, such as lighting conditions, color balance, contrast, and stripe effects. Based on these parameters, the system further determines a suitable shooting scene. For example, if the captured preview image shows dim lighting, the system may determine that the scene is indoors or in a low-light environment, and therefore adjust the corresponding scene settings to optimize the shooting effect, such as increasing the ISO value or decreasing the aperture, to ensure a clear image.

[0183] In one possible implementation, determining the image parameters of the target preview image includes: determining the distance of the object being photographed in the target preview image using the ranging sensor; and determining the stripe effect detection result and RGB frame rate in the target preview image using the camera. In this embodiment, the image parameters of the target preview image can be based on the precise distance of the object being photographed determined by the ranging sensor (e.g., a matrix laser TOF sensor), and the stripe effect detection result and RGB frame rate in the target preview image determined by the camera (e.g., its automatic exposure module). Subsequently, based on the parameters in the preview image, the system can better identify the current shooting environment and adjust the ranging frame rate of the ranging sensor according to the corresponding shooting mode, providing the user with a better shooting experience.

[0184] In one possible implementation, if the distance to the object being photographed is greater than a first preset distance, the target shooting scene is determined to be a first scene; or, if the distance to the object being photographed is less than the first preset distance, and the RGB frame rate of the target preview image is a first frame rate, the target shooting scene is determined to be a second scene, wherein the first frame rate is the default frame rate of the RGB frame rate in the target preview image; or, if the distance to the object being photographed is less than the first preset distance, and the RGB frame rate of the target preview image is a second or third frame rate, the target shooting scene is determined to be a third scene, wherein both the second and third frame rates are less than the first frame rate, and the second or third frame rate is the frame rate adjusted after stripe effect detection; or, if the distance to the object being photographed is less than the first preset distance, and the RGB frame rate of the target preview image is a fourth frame rate, the target shooting scene is determined to be a fourth scene, wherein the fourth frame rate is less than the first frame rate.

[0185] In this embodiment, the current shooting scene can be determined based on different image parameters in the preview image. The shooting scene can be distinguished based on the distance of the subject detected by a ranging sensor (e.g., a matrix laser TOF sensor), the RGB frame rate of the preview image, and the presence of a stripe effect. The distance of the subject directly affects the composition and focus of the shot; the RGB frame rate of the preview image can detect the ambient brightness, which affects the exposure level; and the stripe effect directly affects the visual effect during shooting. For example, see [link to relevant documentation]. Figure 3E , Figure 3E This is a scenario example diagram provided in the embodiments of this application. Figure 3EThe shooting mode can include a first scene 201-A, a second scene 201-B, a stripe effect scene 201-C, and a fourth scene 201-D. Further, as shown in the first scene 201-A, if the detected distance to the subject exceeds a first preset distance (e.g., exceeding 3 meters of the first preset distance but not exceeding the maximum ranging range of the ranging sensor, which is 4 meters), then the current shooting mode is determined to be the first scene. In the first scene, when the subject exceeds the laser shooting range, laser ranging can be turned off to reduce unnecessary resource consumption. The determination of the shooting scene can also be combined with the stripe effect in the preview image. Based on the detection results and RGB frame rate, as shown in the second scene 201-B, when the distance of the detected subject is less than the first preset distance, if the RGB frame rate in the current preview image is the first frame rate (this first frame rate can be the default RGB frame rate in a preview image with a frame rate larger than the preset low-brightness RGB frame rate, such as 30FPS), then the current scene is determined to be the second scene (e.g., a non-far distance - preview = 30FPS scene). In this second scene, more accurate focusing can be ensured by increasing the ranging frame rate of the ranging sensor; as shown in the stripe effect scene 201-C, when the distance of the detected subject is greater than the first preset distance, the current scene is determined to be the second scene (e.g., a non-far distance - preview = 30FPS scene). In this second scene, more accurate focusing can be ensured by increasing the ranging frame rate of the ranging sensor; When discussing close-up shots, if the RGB frame rate in the current preview image is the second or third frame rate (this second or third frame rate can be the default RGB frame rate in the preview image after stripe effects are eliminated, such as 24 / 25 FPS), then the current scene is determined to be the third scene (e.g., a non-far-distance debanding preview 24 / 25 fps scene). Because the stripe effect is eliminated or reduced by setting the preview frame rate in this third scene, the ranging frame rate can be adjusted to synchronize with the RGB frame rate of the preview image for better focusing and more accurate distance information during focusing; such as the fourth scene 201... As shown in -D, when the distance to the subject is close as described above, if the RGB frame rate in the current preview image is the fourth frame rate (this fourth frame rate can be the default RGB frame rate in the preview image that is lower than the preset low-brightness RGB frame rate, and this fourth frame rate does not include fixed values, such as any frame rate <30FPS), and the current scene is determined to be the fourth scene (e.g., a non-far-distance - low-brightness preview <30fps scene), in this fourth scene, because the exposure time is long, many other problems may occur, such as motion blur. At this time, the effect brought by focusing is limited, so the exposure time can be lengthened by reducing the ranging frame rate. In summary, in the embodiments of this application, accurate scene recognition (e.g., determining the current shooting scene) can be performed based on different image parameters in the preview image, thereby adjusting the ranging frame rate of the ranging sensor for different shooting modes and different shooting scenes in the future, so as to improve the flexibility and image quality of the shooting device and reduce resource consumption.

[0186] In one possible implementation, the method further includes: if the distance to the object being photographed is less than the first preset distance, and the stripe effect detection result is yes, then adjusting the RGB frame rate in the target preview image to the second frame rate or the third frame rate. In this embodiment, when a close-range shooting distance is detected and a stripe effect occurs, the stripe effect that may occur during shooting can be reduced or eliminated by adjusting the RGB frame rate in the preview image. Specifically, in automatic exposure mode, the camera adjusts the exposure settings according to the current ambient light. For example, when the RGB frame rate of the camera's preview image is 30 FPS, if the light keeps changing, the camera's exposure settings will also be frequently adjusted, which may lead to uneven brightness in the image, thus producing a stripe effect. In this embodiment, after detecting the existence of a stripe effect, the automatic exposure module in the camera can reduce the frequency mismatch between the camera and the ambient light source by adjusting the RGB frame rate in the preview image. This automatic frame rate adjustment mechanism provides a flexible way to optimize image display in photography, especially when ambient light conditions or shooting distances change, it can automatically adapt and adjust to ensure image quality.

[0187] Step S304: Adjust the ranging frame rate of the ranging sensor based on the target shooting mode and the target shooting scene.

[0188] Specifically, the system finally adjusts the frame rate of the rangefinder sensor based on the determined shooting mode and scene. The rangefinder sensor measures the distance between the camera and the subject, thus aiding in autofocus. Under different shooting conditions, the sensor's frame rate requires different adjustments to achieve optimal results. For example, in fast-moving scenes, such as sports events, the system increases the rangefinder sensor's frame rate to ensure fast and accurate focusing on moving targets. Conversely, in static or slow-moving scenes, such as landscape photography, the system may reduce the frame rate to conserve power and improve processing efficiency.

[0189] In one possible implementation, if the target shooting mode is a first mode; adjusting the ranging frame rate of the ranging sensor based on the target shooting mode and the target shooting scene includes: if the target shooting scene is the first scene, and the distance to the object being photographed is greater than a second preset distance or the data acquired by the ranging sensor is invalid, then adjusting the ranging frame rate of the ranging sensor to the first frame rate synchronized with the RGB frame rate, wherein the second preset distance is greater than the first preset distance; or, if the target shooting scene is the first scene, and the distance to the object being photographed is greater than the first preset distance and less than the second preset distance, then adjusting the ranging frame rate of the ranging sensor to a fifth frame rate synchronized with the RGB frame rate, wherein... In the above scenarios, the fifth frame rate is greater than the first frame rate; or, if the target shooting scene is the second scene, the ranging frame rate of the ranging sensor is adjusted to the fifth frame rate or the sixth frame rate synchronized with the RGB frame rate, wherein the sixth frame rate is greater than the first frame rate; or, if the target shooting scene is the third scene, the ranging frame rate of the ranging sensor is adjusted to the seventh frame rate or the eighth frame rate synchronized with the RGB frame rate, or the sixth frame rate, wherein both the seventh and eighth frame rates are greater than the first frame rate; or, if the target shooting scene is the fourth scene, the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate, wherein the ninth frame rate is less than the first frame rate.

[0190] Specifically, in this embodiment, the frame rate of the rangefinder sensor can be dynamically adjusted for different shooting scenarios in the first mode (e.g., full-time AF-F single-shot mode), significantly improving the camera's adaptability and focusing efficiency for different shooting scenarios. Specifically, this dynamic adjustment mechanism allows the camera to automatically adjust the operating frequency of the rangefinder sensor based on the speed of the moving object and the complexity of the scene.For example, when shooting distant objects, in the first scenario, if the distance to the object is greater than a second preset distance (e.g., the object is at a distance beyond the effective shooting distance of the rangefinder sensor) or if the ranging data is invalid due to other factors (e.g., excessive distance or rangefinder sensor malfunction), the frame rate of the rangefinder sensor can be adjusted to the first frame rate (e.g., a moderate 30 FPS). The rangefinder sensor may experience data failure due to distance or other reasons, but z-axis movement will quickly become closer; therefore, the rangefinder sensor's frame rate cannot be too low to ensure focusing performance in the current scene. Alternatively, when shooting distant objects in the first scenario... When the distance to the object is greater than a first preset distance (e.g., 3 meters) and less than a second preset distance (e.g., 4 meters), the ranging frame rate of the ranging sensor can be increased to a fifth frame rate synchronized with the RGB frame rate in the image preview interface (e.g., 60 FPS synchronization; this frame rate can be the maximum frame rate of the ranging sensor, which is not specifically limited in this embodiment). This allows the ranging sensor to update distance information more frequently, thereby providing a faster and more accurate focusing effect when shooting distant objects. In addition, synchronizing the RGB frame rate and the ranging frame rate can ensure that the exposure level of the image remains constant during distance measurement, thereby reducing image quality problems caused by inconsistent exposure. Alternatively, when the target shooting scene is the second scene, the ranging frame rate of the ranging sensor can be increased. This is because in close-range shooting, the relative position between the object and the sensor may change rapidly, and increasing the ranging frame rate can capture these changes faster, thus providing more accurate and timely distance information. Alternatively, when the target shooting scene is the third scene, the ranging frame rate of the ranging sensor can be adjusted to an integer multiple of the frame rate synchronized with the RGB frame rate in the target preview image. That is, the ranging frame rate of the ranging sensor can be adjusted to the seventh frame rate or the eighth frame rate synchronized with the RGB frame rate in the target preview image (e.g., 48 / 50 FPS). (Step 1) Because the preview frame rate is set in the third scene to eliminate or reduce the stripe effect, the ranging frame rate can be adjusted to be synchronized with the RGB frame rate of the preview image for better focusing and more accurate distance information when focusing; or, when the target shooting scene is the fourth scene, the ranging frame rate of the ranging sensor can be adjusted to the ninth frame rate (e.g., 15 FPS asynchronous). Since the fourth scene is a low-brightness scene, the exposure time needs to be lengthened and the frame rate is more chaotic, so the benefit of increasing the ranging frame rate is low. Therefore, the ranging frame rate is fixed at 15 FPS asynchronous, and the frame rate is reduced in the fourth scene to reduce unnecessary resource consumption.

[0191] In one possible implementation, if the target shooting mode is the second mode; adjusting the ranging frame rate of the ranging sensor based on the target shooting mode and the target shooting scene includes:

[0192] If the target shooting scene is the first scene, then the ranging frame rate of the ranging sensor is adjusted to a ninth frame rate synchronized with the RGB frame rate, wherein the ninth frame rate is less than the first frame rate; or, if the target shooting scene is the second scene, then the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate synchronized with the RGB frame rate; or, if the target shooting scene is the third scene, then the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate; or, if the target shooting scene is the fourth scene, then the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate.

[0193] In this embodiment, the frame rate of the rangefinder sensor can be dynamically adjusted for different shooting scenarios in the second mode (e.g., autofocus auto AF-A mode). The second mode is usually for shooting low dynamic scenes or static objects. The response speed or accuracy of the focusing system may already be high enough. Increasing the frame rate of the rangefinder sensor will not significantly improve the focusing performance. Therefore, in this embodiment, the frame rate of the rangefinder sensor in each scenario can be maintained at 15 FPS, which is no worse than the previous generation. Specifically, when shooting distant objects, for the first scene, the frame rate of the ranging sensor can be adjusted to the ninth frame rate (e.g., 15 FPS synchronization) synchronized with the RGB frame rate in the target preview image; or, when the target shooting scene is the second scene, the ranging frame rate of the ranging sensor can be adjusted to the ninth frame rate (e.g., 15 FPS synchronization) synchronized with the RGB frame rate in the target preview image; or, when the target shooting scene is the third scene, the ranging frame rate of the ranging sensor can be adjusted to be out of sync with the ninth frame rate (e.g., 15 FPS desynchronized); or, when the target shooting scene is the fourth scene, the ranging frame rate of the ranging sensor can be adjusted to the ninth frame rate (e.g., 15 FPS desynchronized); further, see... Figure 3F , Figure 3F This is a timing diagram provided in an embodiment of this application, such as... Figure 3F As shown, switching from 15FPS to 60FPS results in a latency of approximately 340ms. If the synchronization time can be reduced to 1 frame, the latency can be reduced to 257ms. Although reducing the ranging frame rate can reduce the latency caused by focusing, for fast-moving actions such as frisbees and basketballs, the action to be captured may have ended before the frame rate is increased, affecting the shooting experience. Therefore, excessively low frame rates, such as 1 or 5 frames, are not advisable.

[0194] In one possible implementation, if the target shooting mode is the third mode, adjusting the ranging frame rate of the ranging sensor based on the target shooting mode and the target shooting scene includes: if the target shooting scene is the first scene, adjusting the ranging frame rate of the ranging sensor to a fifth frame rate synchronized with the RGB frame rate, wherein the fifth frame rate is less than the first frame rate; or, if the target shooting scene is the second scene, adjusting the ranging frame rate of the ranging sensor to the fifth frame rate synchronized with the RGB frame rate; or, if the target shooting scene is the third scene, adjusting the ranging frame rate of the ranging sensor to a seventh frame rate synchronized with the RGB frame rate or an eighth frame rate synchronized with the RGB frame rate, wherein both the seventh and eighth frame rates are greater than the first frame rate; or, if the target shooting scene is the fourth scene, adjusting the ranging frame rate of the ranging sensor to a ninth frame rate, wherein the ninth frame rate is less than the first frame rate.

[0195] In this embodiment, the frame rate of the rangefinder sensor can be dynamically adjusted for different shooting scenarios in the third mode (e.g., the continuous shooting mode with autofocus on all objects in full-time AF-F mode). The third mode is suitable for dynamic and complex shooting environments. Specifically, the third mode can continuously track multiple targets, including fast-moving and static objects, ensuring accurate focus in every frame during continuous shooting. It is suitable for shooting scenes with fast and unpredictable movement of objects, such as sports events, wildlife photography, and fast-moving subjects. Furthermore, when the target shooting scene is the first scene, the ranging frame rate of the ranging sensor can be increased to the fifth frame rate synchronized with the RGB frame rate in the image preview interface (e.g., 60 FPS synchronization; this frame rate can be the maximum frame rate of the ranging sensor, which is not specifically limited in this embodiment), so that the ranging sensor can update distance information more frequently, thereby providing a faster and more accurate focusing effect when shooting distant objects; or, when the target shooting scene is the second scene, the ranging frame rate of the ranging sensor can be adjusted to the fifth frame rate synchronized with the RGB frame rate in the target preview image (e.g., 60 FPS synchronization); or, when the target shooting scene is the third scene, the ranging frame rate of the ranging sensor can be adjusted to the fifth frame rate synchronized with the RGB frame rate in the target preview image. The seventh or eighth frame rate of frame synchronization (e.g., 48 / 50 FPS synchronization) can be an integer multiple of the second or third frame rate (e.g., 24 / 25 FPS synchronization) in the RGB frame rate of the third scene image preview interface. This application embodiment does not impose specific limitations and is used to synchronize with the RGB frame rate. Alternatively, when the target shooting scene is the fourth scene, the ranging frame rate of the ranging sensor can be adjusted to the ninth frame rate (e.g., 15 FPS asynchronous). Since the fourth scene is a low-brightness scene, the exposure time needs to be extended, and the frame rate is relatively chaotic, so the benefit of increasing the ranging frame rate is low. Therefore, the ranging frame rate is fixed at 15 FPS asynchronous. In the fourth scene, the frame rate is reduced to reduce unnecessary resource consumption. In summary, in this embodiment, for the four different scenarios in the third mode, the ranging frame rate is increased for necessary scenarios where increasing the ranging frame rate brings significant benefits, and decreased for unnecessary scenarios where the benefits are low. This flexible frame rate adjustment not only improves focusing accuracy and response speed but also optimizes energy efficiency, adapting to various shooting needs. Furthermore, the multi-object focusing continuous shooting mode significantly reduces blur and reshoots caused by inaccurate focusing by optimizing the focusing system, thus improving shooting efficiency. In this mode, the camera can adapt to scene changes more quickly and adjust the focus point in a timely manner, ensuring clear images even under varying shooting conditions.

[0196] Optionally, in the above method steps S300-S304, the detailed frame rate strategy for different scenes under different shooting modes in step S304 can be found in [reference needed]. Figure 4, Figure 4 This is a schematic diagram of a scene strategy under a shooting mode provided in an embodiment of this application; as shown below. Figure 4 As shown:

[0197] (1) The target shooting mode is the first mode.

[0198] For example, see Table 1, which is an example table of a first mode frame rate strategy provided in the embodiments of this application. As shown in Table 1, the first mode can be AF-F (non-continuous shooting) mode, and the strategy in phase detection (PD) can be a follow autofocus strategy (Follow AF) strategy, as well as using matrix laser TOF as the ranging method. The AF-F (non-continuous shooting) mode is typically used for static or slowly moving shooting scenarios (such as static landscape photography, portrait photography, or other relatively slow activities). In AF-F mode, the camera focuses on a specific point or object at the start of shooting. If the subject moves within a certain range, the camera will attempt to adjust the focus to maintain image sharpness. The aforementioned Follow AF strategy can be applied to continuous focus tracking and capturing dynamic and unpredictable scenes, ensuring sharp focus even when objects are moving quickly. Further, see... Figure 5A , Figure 5A This is a schematic diagram of a first mode scenario provided in an embodiment of this application. Figure 5A The system may include a long-distance scene interface 10-A and an ultra-long-distance scene interface 10-B. As shown in the long-distance scene interface 10-A, in this embodiment, the target shooting control can be AF-F mode 405. The first operation can be that the user can slide out AF-F mode 405 or AF-A mode 406 by pulling down the status bar, and then click on AF-F mode 405 in the upper frame as the target shooting mode. At this time, the shooting preview area in the system (e.g., the camera's display screen or through the interface of a mobile application) will display the target preview image and quickly and accurately focus on the shooting object (i.e., the person with their back to the camera in the preview image). In addition, the above-mentioned ranging method may also include other ranging methods such as binocular ranging and structured light ranging, which are not specifically limited in this embodiment.

[0199] Table 1

[0200]

[0201]

[0202] In one possible implementation, assuming the first scene 4001 is a distant scene at 4m, as shown in Table 1, when the system detects that the object or person in focus is at a relatively far distance within the ranging range (e.g., 4m), the matrix laser TOF can be synchronized with a frame rate set to the default 60FPS. When the matrix laser TOF data is invalid or at infinity, the frame rate can be set to 30FPS. For example, see [link to relevant documentation]. Figure 5A , Figure 5A This is a schematic diagram of a first mode scenario provided in an embodiment of this application. Figure 5AThe system can include a long-distance scene interface 10-A and a super-long-distance scene interface 10-B. As shown in the long-distance scene interface 10-A, assuming the target shooting mode has been selected as AF-F (non-continuous shooting) mode, the target shooting control can be the shutter 402. At this time, the shooting preview area in the system (e.g., the camera's display screen or through a mobile application interface) will display the target preview image and quickly and accurately focus on the subject (i.e., the person with their back to you in the preview image). The first operation can be a single shot taken by the user by clicking the shutter 402. Furthermore, based on the image parameters of the preview image, the system can detect the distance to the focused target through a sensor. When the system detects… When a person walking in the currently focused scene is within the effective distance (i.e., within the ranging range), it means there may be significant depth changes in the scene. To effectively capture these distant objects and maintain sharp focus, the system needs to adjust focus and process the image more quickly. This can be achieved by increasing the frame rate to help the system capture dynamically changing scenes more smoothly, and by synchronizing the autofocus system (AF) and frame rate to maintain the sharpness of distant objects in the shot. The system can detect the distance of the target being focused on using a sensor. When the system detects that a person walking in the currently focused scene is within the effective distance (i.e., within the ranging range), it means there may be significant depth changes in the scene. In situations with significant depth changes, to effectively capture distant objects and maintain sharp focus, the system needs to adjust focus and process images more quickly. This can be achieved by increasing the frame rate to help the system capture dynamically changing scenes more smoothly, and by synchronizing the autofocus system (AF) and frame rate to maintain the sharpness of distant objects during shooting. As shown in the super telephoto scene interface 10-B, assuming the target shooting mode has been selected as AF-F (non-continuous shooting) mode, and the target shooting control can be shutter 402, the shooting preview area in the system (e.g., the camera's display screen or through a mobile application interface) will display the target preview image and quickly and accurately focus on the subject. (i.e., a person walking at a distance in the preview image). The first operation can be for the user to take a single shot by clicking shutter 402. When the system detects that the person walking in the currently focused scene is at an invalid distance (i.e., the focus data is invalid or at infinity), the system can save system resources by reducing the frame rate. However, the frame rate cannot be reduced too low. Although the current long-distance matrix laser TOF is invalid, the person in the ultra-long-distance scene interface 10-B may move in the z-direction, causing the focus target to become close. In order to ensure the performance during shooting, the system sets the ranging frame rate of the matrix laser TOF sensor to not be too low (for example, the frame rate can be set to 30 FPS).

[0203] In one possible implementation, assuming the second scene 4002 is a non-far-preview = 30fps scene, as shown in Table 1, when the system detects that the focused object or person is within the ranging range of a non-far-preview = 30fps scene, the matrix laser TOF can be set to a default 60fps synchronous or 60fps asynchronous frame rate. Here, the non-far-preview = 30fps scene is a camera setting designed for everyday use and various common photographic scenarios. For example, see [link to relevant documentation]. Figure 5B , Figure 5B This is a schematic diagram of a first mode scenario provided in an embodiment of this application. Figure 5B The system may include a non-long-distance preview = 30FPS scene interface 10-C, a banding scene interface 10-D, and a non-long-distance low-brightness (preview < 30FPS scene) interface 10-E. As shown in the non-long-distance preview = 30FPS scene interface 10-C, in this embodiment, assuming the target shooting mode has been selected as AF-F (non-continuous shooting) mode, the target shooting control can be the shutter 402. At this time, the shooting preview area in the system (e.g., the camera's display screen or through the interface of a mobile application) will display the target preview image and quickly and accurately focus on the shooting object (i.e., the person sitting at close range reading a book in the preview image). The first operation can be a single shot taken by the user clicking the shutter 402. Further, the system's camera preview function displays a person sitting at close range reading a book. The system can obtain the banding flag and RGB frame rate from the AE module through the AF module as judgment conditions. If no banding is detected... If the flag is displayed and the current RGB frame rate condition is met, the system may determine that the current environment is suitable for setting to "non-far-preview = 30fps scene". In this scene, the system can set the camera preview frame rate to 30 frames per second and set the ranging frame rate of the matrix laser TOF sensor to the default 60FPS synchronous or 60FPS asynchronous, to ensure focusing performance in close-range shooting, as well as improve image quality and user shooting experience.

[0204] In one possible implementation, assuming the third scene 4003 is a non-far-debanding (preview 24 / 25FPS scene), as shown in Table 1, when the system detects that the focused object or person is within the ranging range of a non-far-debanding (preview 24 / 25FPS scene) scene, the matrix laser TOF can be set to a default 48 / 50FPS synchronous or 60FPS asynchronous frame rate. For example, see [link to relevant documentation]. Figure 5B , Figure 5B This is a schematic diagram of a first mode scenario provided in an embodiment of this application. Figure 5BThe system may include a non-long-distance - preview = 30FPS scene interface 10-C, a banding scene interface 10-D, and a non-long-distance - low brightness (preview < 30FPS scene) interface 10-E. As shown in the banding scene interface 10-D, in this embodiment, assuming the target shooting mode has been selected as AF-F (non-continuous shooting) mode, the target shooting control can be the shutter 402. At this time, the shooting preview area in the system (e.g., the camera's display screen or through a mobile application interface) will display the target preview image and quickly and accurately focus on the shooting object (i.e., the person sitting at close range reading a book in the preview image). The first operation can be a single shot taken by the user clicking the shutter 402. Further, the system can obtain the banding flag and RGB frame rate from the AE module through the AF module as decision conditions. If banding is detected... The presence of a banding effect, or stripe effect, may be due to a mismatch between the camera's preview frame rate (operating at 30 frames per second) and the ranging frame rate (24 / 25fps) frequency. This results in some black shadows (banding) in the preview image. To address banding, the system may set the current environment to "non-far-range - debanding (24 / 25fps preview scene)." In this scenario, to reduce or eliminate the banding effect, the camera's preview frame rate is adjusted to 24 or 25 frames per second. Furthermore, the system can also set the ranging frame rate of the matrix laser TOF sensor to a default 48 / 50fps synchronous or 60fps asynchronous, aligning the laser's exposure time with the image's exposure time for better focusing and more accurate distance information during focusing. Additionally, the default synchronous frame rate can be any integer multiple of the 24 / 25fps preview frame rate, not limited to 48 / 50fps, and can also be an integer multiple of 24 / 25fps within the maximum frame rate range of the ranging method. This embodiment does not impose specific limitations.

[0205] In one possible implementation, assuming the fourth scene 4004 is a non-far-range, low-brightness scene (preview < 30 FPS scene), as shown in Table 1, when the system detects that the focused object or person is within the ranging range of a non-far-range, low-brightness scene (preview < 30 FPS scene), the matrix laser TOF can be desynchronized to the default 15 FPS. For example, see... Figure 5B , Figure 5B This is a schematic diagram of a first mode scenario provided in an embodiment of this application. Figure 5BThe system may include a non-long-distance - preview = 30FPS scene interface 10-C, a banding scene interface 10-D, and a non-long-distance - low brightness (preview < 30FPS scene) interface 10-E. As shown in the non-long-distance - low brightness (preview < 30FPS scene) interface 10-E, in this embodiment, assuming the target shooting mode has been selected as AF-F (non-continuous shooting) mode, the target shooting control can be the shutter 402. At this time, the shooting preview area in the system (e.g., the camera's display screen or through the interface of a mobile application) will display the target preview image and quickly and accurately focus on the shooting object (i.e., the person sitting at close range reading a book in the preview image). The first operation can be a single shot taken by the user clicking the shutter 402. Further, in the figure, a person is sitting at close range reading a book in a dark environment. The system can obtain the banding flag and RGB frame rate from the AE module through the AF module as judgment conditions. If no banding is detected... If the current RGB frame rate matches the ambient brightness, the system may determine that the current environment is suitable for setting it to "non-far-distance - low-brightness preview <30FPS scene". In this scene, the system can increase the light capture per frame by reducing the preview frame rate (i.e., the preview frame rate is <30FPS), thereby improving image quality in difficult shooting environments. Furthermore, since the frame rate during ranging may be unstable at this moment, varying within 15FPS, the low frame rate means that focusing performance is no longer a bottleneck, and the captured image may be blurry. Therefore, in this embodiment, it is possible to choose not to increase the focusing frame rate and set the ranging frame rate of the matrix laser TOF sensor to the default 15FPS asynchronous, so that the ranging frame rate of the matrix laser TOF sensor no longer changes, reducing the frame rate in unnecessary scenes and saving system resources.

[0206] (2) The target shooting mode is the second mode.

[0207] For example, see Table 2, which is an example table of a second-mode frame rate strategy provided in the embodiments of this application. As shown in Table 2, the second mode can be an AF-A non-continuous shooting mode, suitable for situations where objects in the scene do not move frequently, or where the user does not need to continuously track a specific object. The strategy in phase detection (PD) can be a follow autofocus strategy (Follow AF) strategy, and a matrix laser TOF as the ranging method. Further, see... Figure 6 , Figure 6 This is a schematic diagram of a second mode scenario provided in an embodiment of this application. Figure 6The system may include a long-distance scene interface 20-A, a non-long-distance preview = 30FPS scene interface 20-B, a banding scene interface 20-C, and a non-long-distance low-brightness (preview < 30FPS scene) interface 20-D. As shown in the long-distance scene interface 20-A, in this embodiment, the target shooting control can be AF-F mode 405. The first operation can be that the user can slide out AF-F mode 405 or AF-A mode 406 by pulling down the status bar, and then click on AF-F mode 405 in the upper frame as the target shooting mode. At this time, the shooting preview area in the system (e.g., the camera's display screen or through the interface of a mobile application) will display the target preview image and quickly and accurately focus on the shooting object (i.e., the person with their back to the camera in the preview image). Among them, AF-A mode, namely Autofocus-Automatic mode, usually automatically switches between single autofocus (AF-S) and continuous autofocus (AF-C). The system will automatically switch the focus mode according to whether the subject is moving. If the subject is stationary, AF-S mode can be used to lock focus; if the subject is moving, AF-C mode can be used to continuously track focus. This Follow AF strategy can be applied to continuous focus tracking and capturing dynamic and unpredictable scenes, ensuring sharp focus even when the object is moving rapidly. Furthermore, in "Everything Tracking Off" mode, the system will not automatically track the target, and the ranging frame rate can be zero. The ranging methods mentioned above can also include binocular ranging, structured light ranging, and other ranging methods, which are not specifically limited in this embodiment.

[0208] Table 2

[0209]

[0210] In one possible implementation, exemplarily, see [reference needed]. Figure 6 , Figure 6 This is a schematic diagram of a second mode scenario provided in an embodiment of this application. Figure 6 It can include a long-distance scene interface 20-A, a non-long-distance scene interface with a preview of 30 FPS 20-B, a banding scene interface 20-C, and a non-long-distance low-brightness (preview < 30 FPS scene) interface 20-D, and is combined with Table 2.

[0211] Specifically, assuming the first scene 4001 is a distant scene at a distance of 4m, such as Figure 6As shown in the mid-to-long distance scene interface 20-A, in this embodiment of the application, assuming that the target shooting mode has been selected as AF-A (non-continuous shooting) mode, the target shooting control can be the shutter 402. At this time, the shooting preview area in the system (e.g., the camera's display screen or through the interface of a mobile application) will display the target preview image and quickly and accurately focus on the shooting object (i.e., the person playing golf in the preview image). The first operation can be a single shot taken by the user by clicking the shutter 402. Furthermore, the system can detect the distance of the focused target through the sensor. When the system detects that the person playing golf in the currently focused scene is at an effective long distance (i.e., within the ranging range), the matrix laser TOF can be synchronized with a frame rate of 15 FPS.

[0212] Assuming the second scene 4002 is a non-far-view preview scene with a frame rate of 30 FPS, such as Figure 6 As shown in the interface 20-B of the non-long-distance preview = 30FPS scene, in this embodiment of the application, assuming that the target shooting mode has been selected as AF-A (non-continuous shooting) mode, the target shooting control can be shutter 402. At this time, the shooting preview area in the system (e.g., the camera's display screen or through the interface of a mobile application) will display the target preview image and quickly and accurately focus on the shooting object (i.e., the person lying in bed looking at a mobile phone in the preview image). The first operation can be that the user takes a single shot by clicking shutter 402. Further, the camera preview function of the system displays a person lying in bed looking at a mobile phone at close range. The system can obtain the banding flag and RGB frame rate from the AE module through the AF module as a judgment condition. If the banding flag is not detected and the current RGB frame rate condition is met, the system may determine that the current environment is suitable for setting to "non-long-distance preview = 30fps scene". In this scene, the system can set the camera preview frame rate to 30 frames per second and set the ranging frame rate of the matrix laser TOF sensor to 15FPS for synchronization.

[0213] Assuming the third scene 4003 is a non-long-range debanding scene (preview of a 24 / 25FPS scene), such as Figure 6As shown in the banding scene interface 20-C, in this embodiment, assuming the target shooting mode has been selected as AF-A (non-continuous shooting) mode, the target shooting control can be shutter 402. At this time, the shooting preview area in the system (e.g., the camera's display screen or through the interface of a mobile application) will display the target preview image and quickly and accurately focus on the shooting object (i.e., the person lying in bed looking at their phone in the preview image). The first operation can be a single shot taken by the user by clicking shutter 402. Further, the camera preview function of the system displays a person lying in bed looking at their phone at close range. The system can obtain the banding flag and RGB frame rate from the AE module through the AF module as a judgment condition. If banding is detected... The "flag" indicates the presence of a stripe effect. This stripe effect may be due to a mismatch between the camera's preview frame rate (30fps) and the ranging frame rate (24 / 25fps) frequency. As a result, some black shadows (banding) appear in the preview image. To address the banding issue, the system may set the current environment to "non-long-range - debanding (24 / 25fps preview scene)". In this scenario, to reduce or eliminate the stripe effect, the camera's preview frame rate will be adjusted to 24 or 25fps, and the ranging frame rate of the matrix laser TOF sensor will be set to 15fps for desynchronization.

[0214] Assuming the fourth scene 4004 is a non-far-range, low-brightness scene (preview < 30 FPS scene), such as Figure 6As shown in the interface 20-D for medium-distance, low-light (preview <30FPS scene) scenarios, in this embodiment, assuming the target shooting mode has been selected as AF-A (non-continuous shooting) mode, the target shooting control can be shutter 402. At this time, the shooting preview area in the system (e.g., the camera's display screen or through the interface of a mobile application) will display the target preview image and quickly and accurately focus on the shooting object (i.e., the person lying in bed looking at a mobile phone in the preview image). The first operation can be a single shot taken by the user by clicking shutter 402. Further, in the figure, a person is sitting at close range reading a book in a dark environment. The system can obtain the banding flag and RGB frame rate from the AE module through the AF module as a decision condition. If no banding is detected... If the current RGB frame rate matches the ambient brightness, the system may determine that the current environment is suitable for setting it to "non-far-distance - low brightness (preview <30FPS scene)". In this scene, the system can increase the light capture per frame by reducing the preview frame rate (i.e., the preview frame rate is <30FPS), thereby improving image quality in difficult shooting environments. Furthermore, since the frame rate during ranging may be unstable at this moment, varying within 15FPS, a frame rate that is too low means that focusing performance is no longer a bottleneck, and the resulting image may be blurry. Therefore, in this embodiment, it is possible to choose not to increase the focusing frame rate and set the ranging frame rate of the matrix laser TOF sensor to the default 15FPS asynchronous setting, so that the ranging frame rate of the matrix laser TOF sensor no longer changes, reducing the frame rate in unnecessary scenes and saving system resources.

[0215] In this embodiment, the system can be set to AF-A (non-continuous shooting) mode. Since AF-A mode does not require continuous and rapid tracking and focusing, the camera typically selects the focus point automatically in a single shot or occasional scene changes. Furthermore, because AF-A is a non-continuous shooting mode, frequent focus point updates are unnecessary. Therefore, increasing the frame rate in AF-A (non-continuous shooting) mode has a limited impact on the overall performance improvement of photography. Additionally, when the object tracking function is disabled, the camera does not continuously track moving objects; the camera's focusing system is used more for static or slowly moving objects. In this case, increasing the ranging frame rate may not significantly improve performance or image quality during photography. In summary, given the limited benefits of increasing the ranging frame rate, this embodiment can save resources by reducing the frame rate. Since performance should not be lower than the previous generation's ranging frame rate of 15 FPS, the ranging frame rate of the matrix laser TOF sensor is set to either 15 FPS synchronously or 15 FPS asynchronously.

[0216] (3) Assume that the target shooting mode 400 is the third mode.

[0217] For example, see Table 3, which is an example table of a third-mode frame rate strategy provided in the embodiments of this application. As shown in Table 2, the third mode can be an AF-F continuous shooting (everything tracking focus on) mode, which can include subject focus priority and motion focus priority, suitable for scenes where the shooting target moves frequently. The strategy in phase detection (PD) can be a follow autofocus strategy (Follow AF) strategy, and a matrix laser TOF as the ranging method. In the everything tracking focus mode, it can automatically identify and track various objects in the shooting scene, such as people, animals, vehicles, etc. Once a specific object is identified, the everything tracking focus system can track the movement of these objects in real time to ensure that they are always in focus. In some cases, everything tracking focus can track multiple objects in the scene at the same time and focus on them according to the user's settings or the scene priority. For example, see Table 3. Figure 7A , Figure 7A This is a schematic diagram illustrating a third mode activation provided in this application embodiment. The target shooting control may include shutter 402, photo capture 404, and object tracking focus 404A. The first operation can be for the user to click or swipe up on photo capture 404 to display the extended function taskbar, and then click on object tracking focus 404A in the extended function taskbar to activate the object tracking focus mode. The aforementioned Follow AF strategy can be applied to continuous tracking focus and capturing dynamic and unpredictable scenes, ensuring clear focus even when objects are moving rapidly. Furthermore, the aforementioned ranging method may also include other ranging methods such as binocular ranging and structured light ranging, which are not specifically limited in this application embodiment.

[0218] Table 3

[0219]

[0220] In one possible implementation, assuming the first scene 4001 is a distant scene at 4m, as shown in Table 3, when the system detects that the object or person being focused on is at a relatively far distance within the ranging range (e.g., 4m), the matrix laser TOF can be synchronized with a frame rate set to the default 60FPS. For example, see [link to relevant documentation]. Figure 7B , Figure 7B This is a schematic diagram of a long-distance scene in a third mode provided in the embodiments of this application. Figure 7BThe system may include a subject-focus-priority interface 30-B and a motion-focus-priority interface 30-C. In this embodiment, assuming the target shooting mode has been selected as AF-F (All-Object Continuous Shooting) mode, the target shooting controls may include shutter 402, subject-focus-priority 404A1, and motion-focus-priority 404A2. At this time, the shooting preview area in the system (e.g., the camera's display screen or through the interface of a mobile application) will display the target preview image and quickly and accurately focus on the shooting object (i.e., the dancing person and dog in the preview image). The first operation can be that the user clicks on subject-focus-priority 404A1 or motion-focus-priority 404A2 and then holds down shutter 402 to start continuous shooting. Further, as shown in subject-focus-priority interface 30-B, when the user clicks on subject-focus-priority 404A1, the system... Its sensors can detect objects in the shooting scene, such as a person swinging a golf club on the left and a person walking on the right, and their distance from the camera. When two people in the scene are detected at a distance (e.g., 4m) within the range of the matrix laser TOF, in order to ensure that the subject is continuously and clearly captured during rapid continuous shooting, the system can increase the ranging frame rate of the matrix laser TOF sensor (e.g., set the frame rate to 60FPS synchronously). This frame rate can be the maximum frame rate of any ranging method, and is not specifically limited in this embodiment. It is used to speed up the focusing speed and maintain stable tracking focus on distant subjects, ensuring that the dynamic changes of the subject can be accurately captured and focused on in each continuous shooting frame, and ensuring that even distant moving subjects can be accurately captured and kept in sharp focus during high-speed continuous shooting. As shown in the motion focus priority interface 30-C, assuming the person on the left side of the camera preview interface is moving (i.e., swinging a golf club), while the person on the right side is stationary, when the user clicks motion focus priority 404A2, the camera focuses on the person swinging a golf club on the left side of the camera preview interface. This mainly captures rapidly changing targets, requiring the camera to adapt and respond quickly. In order to effectively capture such moving elements in continuous shooting mode, the system optimizes its focusing speed and increases the ranging frame rate of the matrix laser TOF sensor (e.g., setting the frame rate to 60 FPS synchronously). This frame rate can be the maximum frame rate of any ranging method, and is not specifically limited in this embodiment. It is used to speed up the focusing speed and maintain stable tracking of distant moving targets. In this way, the camera ensures that it can accurately focus on the moving object in each frame of continuous shooting to ensure the clarity and continuity of the image.

[0221] In one possible implementation, assuming the second scene 4002 is a non-far-preview = 30fps scene, as shown in Table 3, when the system detects that the focused object or person is within the ranging range of a non-far-preview = 30fps scene, the matrix laser TOF can be synchronized with a frame rate set to the default 60fps. Here, the non-far-preview = 30fps scene is a camera setting designed for everyday use and various common photographic scenarios. For example, see [link to example]. Figure 7C , Figure 7C This is a schematic diagram of a close-range scene in a third mode provided in this application embodiment. Figure 7C The system may include a subject-focus-priority interface 30-D and a motion-focus-priority interface 30-E. In this embodiment, assuming the target shooting mode has been selected as AF-F (All-Object Continuous Shooting) mode, the target shooting controls may include shutter 402, subject-focus-priority 404A1, and motion-focus-priority 404A2. At this time, the shooting preview area in the system (e.g., the camera's display screen or through the interface of a mobile application) will display the target preview image and quickly and accurately focus on the shooting object (i.e., the dancing person and dog in the preview image). The first operation can be that the user clicks on subject-focus-priority 404A1 or motion-focus-priority 404A2 and then holds down shutter 402 to perform continuous shooting. Further, as shown in subject-focus-priority interface 30-D... The system's camera preview function displays a dancing person and a dog. When the user clicks "Subject Focus Priority 404A1," the camera will focus on these two subjects. As shown in the "Motion Focus Priority" interface 30-E, assuming the dancing person on the left moves and rotates their body, when the user clicks "Motion Focus Priority 404A2," the camera will focus on the moving person on the left. To obtain a smooth and responsive preview experience in non-far-range preview = 30fps scenes and to ensure that the preview image matches the performance during actual shooting, the system can increase the ranging frame rate of the matrix laser TOF sensor (e.g., setting the frame rate to 60FPS synchronously). This frame rate can be the maximum frame rate of any ranging method, and is not specifically limited in this embodiment. In summary, by increasing the frame rate of the ranging method in non-far-range preview = 30fps scenes, faster and more accurate focusing performance is provided, especially when tracking changing and dynamic objects, ensuring optimal focusing effect in each frame during continuous shooting.

[0222] In one possible implementation, assuming the third scene 4003 is a non-far-debanding (preview 24 / 25FPS scene), as shown in Table 3, when the system detects that the focused object or person is within the ranging range of a non-far-debanding (preview 24 / 25FPS scene) scene, the matrix laser TOF can be synchronized with a frame rate of the default 48 / 50FPS. For example, see [link to relevant documentation]. Figure 7D , Figure 7D This is a schematic diagram illustrating a stripe effect scenario provided in an embodiment of this application. Figure 7D The system may include a first stripe effect interface 30-F and a second stripe effect interface 30-G. As shown in the first stripe effect interface 30-F and the second stripe effect interface 30-G, in this embodiment, assuming the target shooting mode has been selected as AF-F (all-object tracking continuous shooting) mode, the target shooting control may include shutter 402, subject focus priority 404A1, and motion focus priority 404A2. At this time, the shooting preview area in the system (e.g., the camera's display screen or through the interface of a mobile application) will display the target preview image and quickly and accurately focus on the shooting object (i.e., the dancing person and dog in the preview image). The first operation can be that the user clicks on the subject focus priority 404A1 or the motion focus priority 404A2 and then holds down the shutter 402 to perform continuous shooting. Further, the system can obtain the banding flag and RGB frame rate from the AE module through the AF module as a decision condition. If banding is detected... The presence of banding, or stripe effect, may be due to a mismatch between the camera's preview frame rate (operating at 30 frames per second) and the ranging frame rate (which is incompatible with the RGB frame rate). This results in some black shadows (banding) appearing in the preview image. To address banding, the system can set the current environment to "non-far-distance - debanding (preview 24 / 25fps scene)". In this scenario, to reduce or eliminate the banding effect, the camera's preview frame rate is adjusted to 24 or 25 frames per second. Furthermore, the system can also set the ranging frame rate of the corresponding matrix laser TOF sensor to the default 48 / 50 FPS for synchronization, aligning the laser's exposure time with the image's exposure time for better focusing and using more accurate distance information during focusing. In addition, the default synchronization frame rate can be any integer multiple of the 24 / 25 FPS frame rate during preview, not limited to 48 / 50 FPS, and can also be an integer multiple of 24 / 25 FPS within the maximum frame rate range of the ranging method. This application embodiment does not impose specific limitations.

[0223] In one possible implementation, assuming the fourth scene 4004 is a non-far-range, low-brightness scene (preview < 30 FPS scene), as shown in Table 3, when the system detects that the focused object or person is within the ranging range of a non-far-range, low-brightness scene (preview < 30 FPS scene), the matrix laser TOF can be desynchronized to the default 15 FPS. For example, see... Figure 7E , Figure 7E This is a schematic diagram of a low-brightness scene in a third mode provided in the embodiments of this application. Figure 7EThe system may include a subject-focus-priority interface 30-H and a motion-focus-priority interface 30-I. In this embodiment, assuming the target shooting mode has been selected as AF-F (All-Object Continuous Shooting) mode, the target shooting controls may include a shutter 402, a subject-focus-priority interface 404A1, and a motion-focus-priority interface 404A2. At this time, the shooting preview area in the system (e.g., the camera's display screen or through a mobile application interface) will display the target preview image and quickly and accurately focus on the shooting object (i.e., the dancing person and dog in the preview image). The first operation can be the user clicking the subject-focus-priority interface 404A1 or... After using motion-priority focus 404A2, continuous shooting is initiated by holding down shutter button 402. Further, as shown in subject-priority focus interface 30-H, the system's camera preview displays a dancing person and a dog. When the user clicks subject-priority focus 404A1, the camera will focus on these two subjects. And as shown in motion-priority focus interface 30-I, assuming the dancing person on the left moves and rotates their body, when the user clicks motion-priority focus 404A2, the camera focuses on the moving person on the left. The system can obtain banding data from the AE module via the AF module. Using the flag and RGB frame rate as decision criteria, if no banding flag is detected and the current RGB frame rate matches the ambient brightness conditions, the system may determine that the current environment is suitable for setting it to "non-far-distance - low-brightness preview <30FPS scene". In this scene, the system can increase the light capture per frame by reducing the preview frame rate (i.e., the preview frame rate is <30FPS), thereby improving image quality in difficult shooting environments. Furthermore, since the frame rate during ranging may be unstable at this time, varying within 15FPS, a frame rate that is too low means that focusing performance is no longer a bottleneck, and the captured image may be blurry. Therefore, in this embodiment, it is possible to choose not to increase the focusing frame rate and set the ranging frame rate of the matrix laser TOF sensor to the default 15FPS asynchronous, so that the ranging frame rate of the matrix laser TOF sensor no longer changes, reducing the frame rate in unnecessary scenes and saving system resources.

[0224] In one possible implementation, as shown in Table 3, assuming the system detects the object or person in focus at a relatively far distance within the ranging range (e.g., scene 4001 in the first scene), the user selects the motion focus priority mode under the all-object tracking focus mode. In this mode, the user can continuously shoot by long-pressing the shutter button to capture dynamic scenes, such as fast-moving sports activities. The system can increase the frame rate of the ranging method (e.g., setting the frame rate of the matrix laser TOF to the default 60FPS for synchronization) to track fast-moving targets faster and more accurately. For example, see [link to relevant documentation]. Figure 7F , Figure 7F This is a schematic diagram of a long-distance continuous shooting scene in a third mode provided in the embodiments of this application. Figure 7FThe system may include a first continuous shooting interface 30-J, a second continuous shooting interface 30-K, a third continuous shooting interface 30-L, and a fourth continuous shooting interface 30-M. In this embodiment, assuming the target shooting mode has been selected as AF-F (All-Object Continuous Shooting) mode with motion focus priority 404A2, the target shooting control may include a shutter 402. At this time, the shooting preview area in the system (e.g., the camera's display screen or through the interface of a mobile application) will display the target preview image and quickly and accurately focus on the shooting object (i.e., the person playing golf and the cat in the preview image). The first operation can be that the user presses and holds the shutter 402 without... The camera performs continuous shooting; further, as shown in the first continuous shooting interface 30-J, the image includes a person moving at a distance and a stationary cat. Taking the motion focus priority 404A2 in the all-object tracking focus mode as an example, the camera's preview screen will focus on the moving person. The user can achieve continuous shooting by long-pressing the shooting button 402. In this embodiment, three images are captured as an example (the number of images captured in this continuous shooting can also be hundreds or thousands, which is not specifically limited in this embodiment). The focus in the images captured in the continuous shooting is focused on the high-speed moving target, such as the precise focus on a person playing golf. Simultaneously, in this mode, the camera intelligently distinguishes between moving and stationary objects. For example, a stationary cat will not be tracked in this case, ensuring that the camera's focus resources are concentrated on the main moving target. As shown in the second continuous shooting interface 30-K, the third continuous shooting interface 30-L, and the fourth continuous shooting interface 30-M, in the motion focus priority mode, after capturing the previous image 401, the camera continues to track the fast-moving object (i.e., the person swinging a golf club) while ignoring surrounding stationary objects (i.e., the stationary cat). Therefore, in a series of images captured in the motion focus priority mode, the athlete remains the center of focus, while surrounding static objects do not distract the camera. In this embodiment, for the scene identified by the AE module, a corresponding frame rate scheme is adopted in the ranging method. While prioritizing the tracking effect, the frame rate is reduced in unnecessary scenes. Figures 5A-7F The frame rate control scheme for focus tracking in the embodiments described herein greatly improves the efficiency and accuracy of capturing dynamic scenes.

[0225] It should be understood that each step in the above method embodiments can be completed by integrated logic circuits in the processor hardware or by instructions in software form. The method steps disclosed in the embodiments of this application can be directly manifested as being executed by a hardware processor, or being executed by a combination of hardware and software modules in the processor.

[0226] This application also provides a terminal device, which may include a memory and a processor. The memory may be used to store computer programs; the processor may be used to invoke the computer programs in the memory, so that the terminal device executes the methods executed on the terminal device side in any of the above embodiments.

[0227] This application also provides a terminal device, which may include a memory and a processor. The memory may be used to store computer programs; the processor may be used to invoke the computer programs in the memory, so that the terminal device executes the methods executed on the terminal device side in any of the above embodiments.

[0228] This application also provides a chip system, which includes at least one processor for implementing the functions involved on the terminal device side in any of the above embodiments.

[0229] In one possible design, the chip system also includes a memory for storing program instructions and data, which may be located within or outside the processor.

[0230] The chip system can consist of chips or include chips and other discrete components.

[0231] Optionally, the chip system may contain one or more processors. These processors can be implemented in hardware or software. When implemented in hardware, the processor can be a logic circuit, an integrated circuit, etc. When implemented in software, the processor can be a general-purpose processor, implemented by reading software code stored in memory.

[0232] Optionally, the chip system may contain one or more memories. The memory may be integrated with the processor or disposed separately from it; this application embodiment does not limit this. For example, the memory may be a non-transient processor, such as a read-only memory (ROM), which may be integrated with the processor on the same chip or disposed separately on different chips. This application embodiment does not specifically limit the type of memory or the arrangement of the memory and processor.

[0233] For example, the chip system may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a micro controller unit (MCU), a programmable logic device (PLD), or other integrated chips.

[0234] This application also provides a computer program product, which includes a computer program (also referred to as code or instructions) that, when run, causes a computer to perform the method executed on the terminal device side in any of the above embodiments.

[0235] This application also provides a computer-readable storage medium storing a computer program (also referred to as code or instructions). When the computer program is run, it causes the computer to perform the method executed on the terminal device side in any of the above embodiments.

[0236] The various embodiments of this application can be combined arbitrarily to achieve different technical effects.

[0237] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium accessible to a computer or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state disk (SSD)).

[0238] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.

[0239] In summary, the above description is merely an embodiment of the technical solution of this application and is not intended to limit the scope of protection of this application. Any modifications, equivalent substitutions, improvements, etc., made based on the disclosure of this application should be included within the scope of protection of this application.

Claims

1. A method for controlling the frame rate of autofocus tracking, characterized in that, Applied to an electronic device, the electronic device including a camera module, the camera module including a camera and a ranging sensor; the method includes: A first user interface is displayed, which includes a shooting preview area and multiple shooting controls. The shooting preview area is used to display the image captured by the camera. Receive a first operation, wherein the first operation is an operation on a target shooting control among the plurality of shooting controls; In response to the first operation, the target shooting mode is activated, and a target preview image is displayed in the shooting preview area; Determine the image parameters of the target preview image; the determination of the image parameters of the target preview image includes: determining the distance of the object being photographed in the target preview image using the ranging sensor; and determining the stripe effect detection result and RGB frame rate in the target preview image using the camera; If the distance to the object being photographed is less than a first preset distance, and the stripe effect detection result indicates the presence of a stripe effect, then the RGB frame rate in the target preview image is adjusted to a second frame rate or a third frame rate; wherein, both the second frame rate and the third frame rate are less than the first frame rate, and the second frame rate or the third frame rate is the frame rate adjusted after stripe effect detection; the first frame rate is the default frame rate of the RGB frame rate in the target preview image; The target shooting scene is determined based on the image parameters; wherein, if the distance of the shooting object is less than the first preset distance, and the RGB frame rate of the target preview image is the second frame rate or the third frame rate, then the target shooting scene is determined to be the third scene; Based on the target shooting mode and the target shooting scene, the ranging frame rate of the ranging sensor is adjusted, where the ranging frame rate is the number of frames per second that the ranging sensor completes the ranging operation.

2. The method according to claim 1, characterized in that, Determining the target shooting scene based on the image parameters includes: If the distance to the object being photographed is greater than a first preset distance, then the target shooting scene is determined to be the first scene; or, If the distance to the object being photographed is less than the first preset distance, and the RGB frame rate of the target preview image is the first frame rate, then the target shooting scene is determined to be the second scene; or, If the distance to the object being photographed is less than the first preset distance, and the RGB frame rate of the target preview image is the second frame rate or the third frame rate, then the target shooting scene is determined to be the third scene; or, If the distance to the object being photographed is less than the first preset distance, and the RGB frame rate of the target preview image is the fourth frame rate, then the target shooting scene is determined to be the fourth scene, wherein the fourth frame rate is less than the first frame rate.

3. The method according to claim 2, characterized in that, The target shooting mode includes a first mode, a second mode, and a third mode. The first mode includes continuous focusing and single shooting of the subject based on the target preview image. The second mode includes single focusing and single shooting or continuous focusing and single shooting of the subject based on the target preview image. The third mode includes continuous focusing and continuous shooting of the subject based on the target preview image.

4. The method according to claim 3, characterized in that, If the target shooting mode is the first mode; adjusting the ranging frame rate of the ranging sensor based on the target shooting mode and the target shooting scene includes: If the target shooting scene is the first scene, and the distance to the shooting object is greater than the second preset distance or the data acquired by the ranging sensor is invalid, then the ranging frame rate of the ranging sensor is adjusted to the first frame rate synchronized with the RGB frame rate, wherein the second preset distance is greater than the first preset distance; or, If the target shooting scene is the first scene, and the distance to the shooting object is greater than the first preset distance and less than the second preset distance, then the ranging frame rate of the ranging sensor is adjusted to a fifth frame rate synchronized with the RGB frame rate, wherein the fifth frame rate is greater than the first frame rate; or, If the target shooting scene is the second scene, then the ranging frame rate of the ranging sensor is adjusted to the fifth frame rate or the sixth frame rate synchronized with the RGB frame rate, wherein the sixth frame rate is greater than the first frame rate; or... If the target shooting scene is the third scene, then the ranging frame rate of the ranging sensor is adjusted to a seventh frame rate synchronized with the RGB frame rate, or an eighth frame rate synchronized with the RGB frame rate, or the sixth frame rate, wherein both the seventh and eighth frame rates are greater than the first frame rate; or, If the target shooting scene is the fourth scene, then the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate, wherein the ninth frame rate is less than the first frame rate.

5. The method according to claim 3 or 4, characterized in that, If the target shooting mode is the second mode; adjusting the ranging frame rate of the ranging sensor based on the target shooting mode and the target shooting scene includes: If the target shooting scene is the first scene, then the ranging frame rate of the ranging sensor is adjusted to a ninth frame rate synchronized with the RGB frame rate, wherein the ninth frame rate is less than the first frame rate; or... If the target shooting scene is the second scene, then the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate, which is synchronized with the RGB frame rate; or, If the target shooting scene is the third scene, then the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate; or, If the target shooting scene is the fourth scene, then the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate.

6. The method according to any one of claims 3-4, characterized in that, If the target shooting mode is the third mode; adjusting the ranging frame rate of the ranging sensor based on the target shooting mode and the target shooting scene includes: If the target shooting scene is the first scene, then the ranging frame rate of the ranging sensor is adjusted to a fifth frame rate synchronized with the RGB frame rate, wherein the fifth frame rate is less than the first frame rate; or, If the target shooting scene is the second scene, then the ranging frame rate of the ranging sensor is adjusted to the fifth frame rate, which is synchronized with the RGB frame rate; or, If the target shooting scene is the third scene, then the ranging frame rate of the ranging sensor is adjusted to a seventh frame rate synchronized with the RGB frame rate or an eighth frame rate synchronized with the RGB frame rate, wherein both the seventh frame rate and the eighth frame rate are greater than the first frame rate; or, If the target shooting scene is the fourth scene, then the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate, wherein the ninth frame rate is less than the first frame rate.

7. The method according to any one of claims 3-4, characterized in that, The step of activating the target shooting mode in response to the first operation and displaying the target preview image in the shooting preview area includes: If the target shooting mode is switched from the first mode or the third mode to the second mode, then the ranging frame rate of the ranging sensor is adjusted to the fifth frame rate, which is greater than the first frame rate; or, If the target shooting mode is switched from the second mode to the first mode or the third mode, the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate, which is less than the first frame rate.

8. A device for controlling the frame rate of focus tracking, characterized in that, The device includes a camera module, which includes a camera and a ranging sensor; the device includes: A display unit is used to display a first user interface, the first user interface including a shooting preview area and multiple shooting controls, the shooting preview area being used to display the image captured by the camera; A receiving unit is configured to receive a first operation, wherein the first operation is an operation on a target shooting control among the plurality of shooting controls; A shooting mode unit is configured to, in response to the first operation, activate a target shooting mode and display a target preview image in the shooting preview area; A scene capture unit is used to determine the image parameters of the target preview image. The determination of the image parameters of the target preview image includes: determining the distance of the object being captured in the target preview image through the ranging sensor; and determining the stripe effect detection result and RGB frame rate in the target preview image through the camera. The preview frame rate adjustment unit is configured to adjust the RGB frame rate in the target preview image to a second frame rate or a third frame rate if the distance to the object being photographed is less than a first preset distance and the stripe effect detection result indicates the presence of a stripe effect; wherein the second frame rate and the third frame rate are both less than the first frame rate, and the second frame rate or the third frame rate is the frame rate adjusted after stripe effect detection; the first frame rate is the default frame rate of the RGB frame rate in the target preview image; The shooting scene unit is further configured to determine a target shooting scene based on the image parameters; wherein, if the distance of the shooting object is less than the first preset distance, and the RGB frame rate of the target preview image is the second frame rate or the third frame rate, then the target shooting scene is determined to be a third scene; The frame rate adjustment unit is used to adjust the ranging frame rate of the ranging sensor based on the target shooting mode and the target shooting scene. The ranging frame rate is the number of frames per second that the ranging sensor completes the ranging operation.

9. The apparatus according to claim 8, characterized in that, The shooting scene unit is specifically used for: If the distance to the object being photographed is greater than a first preset distance, then the target shooting scene is determined to be the first scene; or, If the distance to the object being photographed is less than the first preset distance, and the RGB frame rate of the target preview image is the first frame rate, then the target shooting scene is determined to be the second scene; or, If the distance to the object being photographed is less than the first preset distance, and the RGB frame rate of the target preview image is the second frame rate or the third frame rate, then the target shooting scene is determined to be the third scene; or, If the distance to the object being photographed is less than the first preset distance, and the RGB frame rate of the target preview image is the fourth frame rate, then the target shooting scene is determined to be the fourth scene, wherein the fourth frame rate is less than the first frame rate.

10. The apparatus according to claim 9, characterized in that, The target shooting mode includes a first mode, a second mode, and a third mode. The first mode includes continuous focusing and single shooting of the subject based on the target preview image. The second mode includes single focusing and single shooting or continuous focusing and single shooting of the subject based on the target preview image. The third mode includes continuous focusing and continuous shooting of the subject based on the target preview image.

11. The apparatus according to claim 10, characterized in that, If the target shooting mode is the first mode; the frame rate adjustment unit is specifically used for: If the target shooting scene is the first scene, and the distance to the shooting object is greater than the second preset distance or the data acquired by the ranging sensor is invalid, then the ranging frame rate of the ranging sensor is adjusted to the first frame rate synchronized with the RGB frame rate, wherein the second preset distance is greater than the first preset distance; or, If the target shooting scene is the first scene, and the distance to the shooting object is greater than the first preset distance and less than the second preset distance, then the ranging frame rate of the ranging sensor is adjusted to a fifth frame rate synchronized with the RGB frame rate, wherein the fifth frame rate is greater than the first frame rate; or, If the target shooting scene is the second scene, then the ranging frame rate of the ranging sensor is adjusted to the fifth frame rate or the sixth frame rate synchronized with the RGB frame rate, wherein the sixth frame rate is greater than the first frame rate; or... If the target shooting scene is the third scene, then the ranging frame rate of the ranging sensor is adjusted to a seventh frame rate synchronized with the RGB frame rate, or an eighth frame rate synchronized with the RGB frame rate, or the sixth frame rate, wherein both the seventh and eighth frame rates are greater than the first frame rate; or, If the target shooting scene is the fourth scene, then the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate, wherein the ninth frame rate is less than the first frame rate.

12. The apparatus according to claim 10 or 11, characterized in that, If the target shooting mode is the second mode; the frame rate adjustment unit is specifically used for: If the target shooting scene is the first scene, then the ranging frame rate of the ranging sensor is adjusted to a ninth frame rate synchronized with the RGB frame rate, wherein the ninth frame rate is less than the first frame rate; or... If the target shooting scene is the second scene, then the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate, which is synchronized with the RGB frame rate; or, If the target shooting scene is the third scene, then the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate; or, If the target shooting scene is the fourth scene, then the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate.

13. The apparatus according to any one of claims 10-11, characterized in that, If the target shooting mode is the third mode; the frame rate adjustment unit is specifically used for: If the target shooting scene is the first scene, then the ranging frame rate of the ranging sensor is adjusted to a fifth frame rate synchronized with the RGB frame rate, wherein the fifth frame rate is less than the first frame rate; or, If the target shooting scene is the second scene, then the ranging frame rate of the ranging sensor is adjusted to the fifth frame rate, which is synchronized with the RGB frame rate; or, If the target shooting scene is the third scene, then the ranging frame rate of the ranging sensor is adjusted to a seventh frame rate synchronized with the RGB frame rate or an eighth frame rate synchronized with the RGB frame rate, wherein both the seventh frame rate and the eighth frame rate are greater than the first frame rate; or, If the target shooting scene is the fourth scene, then the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate, wherein the ninth frame rate is less than the first frame rate.

14. The apparatus according to any one of claims 10-11, characterized in that, The shooting mode unit is specifically used for: If the target shooting mode is switched from the first mode or the third mode to the second mode, the ranging frame rate of the ranging sensor is adjusted to the fifth frame rate, which is greater than the first frame rate. or, If the target shooting mode is switched from the second mode to the first mode or the third mode, the ranging frame rate of the ranging sensor is adjusted to the ninth frame rate, which is less than the first frame rate.

15. A computer storage medium, characterized in that, The computer storage medium stores a computer program that, when executed by a processor, implements the method described in any one of claims 1-7.

16. A computer program product, characterized in that, The computer program product includes instructions that, when executed by a computer, cause the computer to perform the method as described in any one of claims 1-7.

Images