Frame Rate Adjustment Method, Device, Electronic Device and Storage Medium

Abstract

Embodiments of the present application disclose a frame rate adjustment method, apparatus, electronic device, and storage medium. The method includes the following steps: obtaining fixation point information of the display screen being gazed at through an eye tracking module; determining a fixation area on the display screen according to the fixation point information; analyzing the change trend of the regional image information of the fixation area to obtain a fixation area change trend. Specifically, it can be analyzed whether the change of the regional image information of the fixation area is stable. Furthermore, according to the fixation area change trend, the image frame rate is adjusted. In this way, the change trend of the user's fixation area on the fixation area can be determined through eye tracking technology, and the image data processing pressure can be dynamically adjusted by adjusting the frame rate, reducing the occupation of system resources, and achieving the purpose of reducing system power consumption on the basis of meeting the image processing effect.

Description

Technical Field

[0001] This application relates to the field of display technologies, and particularly to a frame rate adjustment method, apparatus, electronic device, and storage medium. Background Art

[0002] In current camera applications, the frame rate of the camera can be set. Since the frame rate at which the camera operates is constant until the next setting, for an Image Signal Processor (ISP) or other underlying processing modules, the number of frames to be processed per unit time is also fixed. For example, if the frame rate is set to 60 frames per second, the image processing algorithm needs to process image data at a rate of 60 frames per second. Thus, the processing speed and power consumption of the ISP and related processing modules will be at a relatively high level. Therefore, the problem of how to more flexibly adjust the frame rate to reduce the power consumption of image data processing needs to be solved. Summary of the Invention

[0003] Embodiments of this application provide a frame rate adjustment method, apparatus, electronic device, and storage medium, which can dynamically adjust the image data processing pressure by adjusting the frame rate, reduce the occupation of system resources, and achieve the purpose of reducing system power consumption on the basis of meeting the image processing effect.

[0004] In a first aspect, embodiments of this application provide a frame rate adjustment method applied to an electronic device, where the electronic device includes an eye tracking module and a display screen, and the method includes:

[0005] Obtaining gaze point information of the display screen being gazed at through the eye tracking module;

[0006] Determining a gaze area on the display screen according to the gaze point information;

[0007] Analyzing a change trend of the regional image information of the gaze area to obtain a gaze area change trend;

[0008] Adjusting the image frame rate according to the gaze area change trend.

[0009] In a second aspect, embodiments of this application provide a frame rate adjustment apparatus applied to an electronic device, where the electronic device includes an eye tracking module and a display screen, and the apparatus includes:

[0010] An obtaining unit, configured to obtain gaze point information of the display screen being gazed at through the eye tracking module;

[0011] A determining unit, configured to determine a gaze area on the display screen according to the gaze point information;

[0012] An analysis unit for analyzing the change trend of the regional image information of the fixation area to obtain the fixation area change trend;

[0013] An adjustment unit for adjusting the image frame rate according to the fixation area change trend.

[0014] In a third aspect, an embodiment of the present application provides an electronic device, including a first camera, a second camera, a processor, a memory, a communication interface, and one or more programs. Among them, the above one or more programs are stored in the above memory and are configured to be executed by the above processor. The above programs include instructions for executing the steps in the first aspect of the embodiment of the present application.

[0015] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium. Among them, the above computer-readable storage medium stores a computer program for electronic data exchange. Among them, the above computer program enables a computer to execute some or all of the steps described in the first aspect of the embodiment of the present application.

[0016] In a fifth aspect, an embodiment of the present application provides a computer program product. Among them, the above computer program product includes a non-transitory computer-readable storage medium storing a computer program. The above computer program is operable to enable a computer to execute some or all of the steps described in the first aspect of the embodiment of the present application. This computer program product can be a software installation package.

[0017] Implementing the embodiments of the present application has the following beneficial effects:

[0018] It can be seen that in the frame rate adjustment method, device, electronic device, and storage medium provided in the embodiments of the present application, the fixation point information of the display screen being fixated is obtained through the eye tracking module; the fixation area on the display screen is determined according to the fixation point information; the change trend of the regional image information of the fixation area is analyzed to obtain the fixation area change trend. Specifically, it can be analyzed whether the change of the regional image information of the fixation area is stable. Furthermore, the image frame rate is adjusted according to the fixation area change trend. In this way, the change trend of the user's fixation area on the fixation area can be determined through the eye tracking technology, and the image data processing pressure can be dynamically adjusted by adjusting the frame rate, reducing the occupation of system resources, and achieving the purpose of reducing system power consumption on the basis of meeting the image processing effect. Description of the Drawings

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the following drawings are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0020] Figure 1A It is a schematic structural diagram of an electronic device provided by an embodiment of the present application;

[0021] Figure 1B It is a schematic flowchart of a frame rate adjustment method provided by an embodiment of the present application;

[0022] Figure 1C It is a demonstration schematic diagram of analyzing the change trend of the fixation area provided by an embodiment of the present application;

[0023] Figure 1D It is a demonstration schematic diagram of reconfiguring the image acquisition frame rate of an image sensor provided by an embodiment of the present application;

[0024] Figure 1E It is a demonstration schematic diagram of bypassing and outputting a part of the image collected by the image sensor to the back-end image processing module provided by an embodiment of the present application;

[0025] Figure 1F It is a demonstration schematic diagram of bypassing and discarding part of the image provided by an embodiment of the present application;

[0026] Figure 2A It is a schematic flowchart of another frame rate adjustment method provided by an embodiment of the present application;

[0027] Figure 2B It is a demonstration schematic diagram of interpolating frames for an image data stream provided by an embodiment of the present application;

[0028] Figure 3 It is a schematic structural diagram of an electronic device provided by an embodiment of the present application;

[0029] Figure 4 It is a schematic structural diagram of a frame rate adjustment device provided by an embodiment of the present application. Detailed implementation manners

[0030] In order to enable those skilled in the art to better understand the solutions of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

[0031] In the description and claims of this application and the above-mentioned drawings, terms such as "first" and "second" are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally further includes steps or units not listed, or optionally further includes other steps or units inherent to these processes, methods, products or devices.

[0032] Reference to "embodiment" herein means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of this application. The phrase appears in various places in the specification and does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art will explicitly and implicitly understand that the embodiments described herein can be combined with other embodiments.

[0033] The electronic devices involved in the embodiments of this application may include various handheld devices, vehicle-mounted devices, wearable devices (smart watches, smart bracelets, wireless earphones, augmented reality / virtual reality devices, smart glasses), computing devices or other processing devices connected to a wireless modem, as well as various forms of user equipment (UE), mobile station (MS), terminal device, etc. For ease of description, the above-mentioned devices are collectively referred to as electronic devices.

[0034] The embodiments of this application will be described in detail below.

[0035] Please refer to Figure 1A , Figure 1A which is a schematic structural diagram of an electronic device disclosed in the embodiments of this application. The electronic device 100 includes a storage and processing circuit 110, and a sensor 170 connected to the storage and processing circuit 110, wherein:

[0036] The electronic device 100 may include a control circuit, and the control circuit may include a storage and processing circuit 110. The storage and processing circuit 110 may include a memory, such as a hard disk drive memory, a non-volatile memory (such as a flash memory or other electronically programmable read-only memory for forming a solid state drive, etc.), a volatile memory (such as a static or dynamic random access memory, etc.), etc., which are not limited in the embodiments of the present application. The processing circuit in the storage and processing circuit 110 may be used to control the operation of the electronic device 100. The processing circuit may be implemented based on one or more microprocessors, microcontrollers, digital signal processors, baseband processors, power management units, audio codec chips, application specific integrated circuits, display driver integrated circuits, etc.

[0037] The storage and processing circuit 110 may be used to run software in the electronic device 100, such as an Internet browsing application, a Voice over Internet Protocol (VOIP) phone call application, an email application, a media playback application, an operating system function, etc. These software may be used to perform some control operations. For example, image acquisition based on a camera, ambient light measurement based on an ambient light sensor, proximity sensor measurement based on a proximity sensor, information display function implemented based on a status indicator such as an LED, touch event detection based on a touch sensor, functions associated with displaying information on multiple (such as hierarchical) display screens, operations associated with performing wireless communication functions, operations associated with collecting and generating audio signals, control operations associated with collecting and processing button press event data, and other functions in the electronic device 100, which are not limited in the embodiments of the present application.

[0038] The electronic device 100 may include an input-output circuit 150. The input-output circuit 150 may be used to enable the electronic device 100 to implement data input and output, that is, to allow the electronic device 100 to receive data from an external device and also to allow the electronic device 100 to output data from the electronic device 100 to an external device. The input-output circuit 150 may further include a sensor 170. The sensor 170 may include a fingerprint recognition module, and may further include an ambient light sensor, a proximity sensor based on light and capacitance, a touch sensor (for example, based on a light touch sensor and / or a capacitive touch sensor, where the touch sensor may be a part of a touch display screen or may be used independently as a touch sensor structure), an acceleration sensor, and other sensors, etc. The ultrasonic fingerprint recognition module may be integrated under the screen, or the fingerprint recognition module may be disposed on the side or back of the electronic device, which is not limited herein, and the fingerprint recognition module may be used to collect fingerprint images.

[0039] The sensor 170 may further include an infrared (IR) camera and a visible light camera. The IR camera and the visible light camera may form an eye tracking module for performing eye tracking. When the IR camera takes a picture, the pupil reflects infrared light, so the IR camera is more accurate in taking a pupil image than an RGB camera. The visible light camera needs to perform more subsequent pupil detections, with higher calculation accuracy and accuracy than the IR camera and better versatility than the IR camera, but with a large amount of calculation.

[0040] The input-output circuit 150 may further include one or more display screens, such as the display screen 130. The display screen 130 may include a liquid crystal display screen, an organic light emitting diode display screen, an electronic ink display screen, a plasma display screen, or a combination of one or more of other display technology-based display screens. The display screen 130 may include a touch sensor array (i.e., the display screen 130 may be a touch display screen). The touch sensor may be a capacitive touch sensor formed by an array of transparent touch sensor electrodes (such as indium tin oxide (ITO) electrodes), or may be a touch sensor formed using other touch technologies, such as acoustic touch, pressure-sensitive touch, resistive touch, optical touch, etc., which are not limited in the embodiments of the present application.

[0041] The electronic device 100 may further include an audio component 140. The audio component 140 may be used to provide audio input and output functions for the electronic device 100. The audio component 140 in the electronic device 100 may include a speaker, a microphone, a buzzer, a tone generator, and other components for generating and detecting sounds.

[0042] The communication circuit 120 may be used to provide the electronic device 100 with the ability to communicate with external devices. The communication circuit 120 may include analog and digital input-output interface circuits, and wireless communication circuits based on radio frequency signals and / or optical signals. The wireless communication circuit in the communication circuit 120 may include a radio frequency transceiver circuit, a power amplifier circuit, a low noise amplifier, a switch, a filter, and an antenna. For example, the wireless communication circuit in the communication circuit 120 may include a circuit for supporting near field communication (NFC) by transmitting and receiving near field coupled electromagnetic signals. For example, the communication circuit 120 may include a near field communication antenna and a near field communication transceiver. The communication circuit 120 may further include a cellular phone transceiver and an antenna, a wireless local area network transceiver circuit and an antenna, etc.

[0043] The electronic device 100 may further include a battery, a power management circuit, and other input-output units 160. The input-output units 160 may include buttons, joysticks, click wheels, scroll wheels, touch pads, keypads, keyboards, cameras, light-emitting diodes, and other status indicators, etc.

[0044] The user may input commands through the input-output circuit 150 to control the operation of the electronic device 100, and may use the output data of the input-output circuit 150 to receive status information and other outputs from the electronic device 100.

[0045] Please refer to Figure 1B , Figure 1B which is a schematic flowchart of a frame rate adjustment method provided by an embodiment of the present application, and is applied to an electronic device as shown in Figure 1A The electronic device includes an eye tracking module and a display screen. As shown in Figure 1B , the frame rate adjustment method provided by the present application includes:

[0046] 101. Obtain the fixation point information of the display screen being gazed at through the eye tracking module.

[0047] Among them, the eye tracking module may include a camera, and the user's eyes are tracked through the camera. The camera for eye tracking may be an infrared camera or a visible light camera, etc., and there is no limitation here.

[0048] Among them, the fixation point information may include information such as the fixation point position and the fixation duration.

[0049] In specific implementation, as the user's line of sight moves on the display screen, the eye tracking module may detect the fixation point information of the user's eyes gazing at the display screen. For example, the eye tracking module may detect the first fixation point position on the display screen where the user's eyes gaze, and the first duration of gazing at the first fixation point position. When the user's line of sight moves, the eye tracking module may detect the second fixation point position on the display screen where the user's eyes gaze, and the second duration of gazing at the second fixation point position. Thus, the eye tracking module may detect different fixation point positions on the display screen where the user gazes at different times and the fixation duration corresponding to the fixation point positions.

[0050] 102. Determine the fixation area on the display screen according to the fixation point information.

[0051] Among them, the fixation area is the area where the user's fixation point is located. As the user's fixation point moves, the fixation area will also change. If the user's fixation point does not move, the fixation area is relatively fixed.

[0052] Optionally, in the above step 102, the fixation point information includes at least one fixation point position and at least one fixation duration corresponding to the at least one fixation point position. Determining the fixation area on the display screen according to the fixation point information may include the following steps:

[0053] 21. Determine the fixation point positions with a fixation duration greater than a preset duration;

[0054] 22. Determine the area within a preset range around the fixation point position as the fixation area; or determine the contour enclosing area of the fixation object corresponding to the fixation point position as the fixation area.

[0055] In a specific implementation, a preset duration can be set in advance. When it is determined that the fixation duration of a user's fixation on a fixation point position is greater than the preset duration, the area within a first range around the fixation point position can be determined as the fixation area. Specifically, the first range area can be a preset fixation frame or a preset fixation circle. The shape and size of the first range area are fixed. The size of the preset fixation frame or preset fixation circle can be set by the system default or by the user himself / herself, and there is no restriction here. For example, when the image content in the display screen shows a sky, the area within the preset fixation frame or preset fixation circle around the fixation point position can be determined as the fixation area.

[0056] Or, when it is determined that the fixation duration of a user's fixation on a fixation point position is greater than the preset duration, the contour enclosing area of the fixation object corresponding to the fixation point position can be determined as the fixation area. Specifically, if the image content corresponding to the fixation point position is a specific fixation object, the shape and size of the fixation area change with the shape and size of the fixation object, such as a human face, a portrait, or an object such as a tree, a mountain, an animal, or a chat interface box, an application icon, etc. The above-mentioned fixation objects have their own specific contours. Therefore, the contour enclosing area of the fixation object can be determined as the fixation area.

[0057] 103. Analyze the change trend of the regional image information of the fixation area to obtain the fixation area change trend.

[0058] Among them, the fixation area change trend may specifically include the position change trend and the content change trend of the regional image information. The position change trend refers to whether the position of the regional image information that the user is concerned about changes over time; the content change trend refers to whether the content of the regional image information that the user is concerned about changes over time.

[0059] In a specific implementation, the image information of the fixation area can be extracted to obtain the regional image information, and then the change trend of the regional image information of the fixation area can be analyzed to obtain the fixation area change trend. For example, the regional image information of the fixation area is relatively stable, changes smoothly, or changes rapidly, etc., and there is no restriction here.

[0060] Optionally, in step 103 above, analyzing the change trend of the regional image information of the gaze area to obtain the gaze area change trend may include the following steps:

[0061] 31. Extract features from the regional image information to obtain regional image features;

[0062] 32. Input the regional image features into a feature training model for training to obtain the feature information of the gaze area;

[0063] 33. Analyze the change trend of the regional image information in the gaze area over time according to the feature information of the gaze area to obtain the gaze area change trend.

[0064] Among them, the feature extraction algorithms for extracting image features from the regional image information may include at least one of the following: Histogram of Oriented Gradients (HOG) algorithm, Hough transform method, Haar feature cascade classifier algorithm, etc., which are not limited here.

[0065] Among them, the feature information of the gaze area may include the position feature information of the gaze area and the feature information of the image content included in the gaze area. The feature information of the gaze area is used to characterize the image content of the gaze area. The image content of the gaze area can be regarded as the user's gaze object. For example, the feature information of the gaze area can be the feature information of a face, the feature information of a portrait, the feature information of a mountain, the feature information of a tree, etc., which are not limited here. The gaze object of the gaze area can be determined through the feature information of the gaze area.

[0066] In specific implementation, among the multiple gaze areas corresponding to different multiple gaze points detected at different times, different regional image information may be included. The regional image information corresponding to each gaze point can be subjected to feature extraction to obtain regional image features, and the regional image features corresponding to different gaze areas can be obtained. The regional image features are sequentially input into an image feature training model, and the input regional image features are trained by the image feature training model to obtain the feature information of the gaze areas where different gaze points are located. Optionally, if the gaze point information detected by the eye tracking module includes m gaze points, where m is a positive integer, regional image features can be extracted from the regional image information of the m gaze areas corresponding to the m gaze points. The regional image features corresponding to the m gaze points are sequentially input into the image feature training model, and m gaze area feature information of the m gaze areas can be obtained. For example, the face feature information of the gaze area or the feature information of an object in the gaze area can be obtained.

[0067] Among them, the change trend of the fixation area specifically refers to the trend of whether the position and content of the image information in the area concerned by the user change over time. Specifically, it is possible to analyze whether the content of the user's fixation image changes according to the m pieces of fixation area feature information of the m fixation areas. If among the area image information of the m fixation areas, there are x times when the image content is the same, where x is a positive integer less than or equal to m, the occurrence probability of this image content can be calculated. If this occurrence probability is greater than the preset probability threshold, it can be determined that this image content is the target image content that the user focuses on, indicating that the image content of the fixation area is concentrated on the target object. Regardless of whether the position of the fixation point changes, the image content of the fixation area where the fixation point is located is the target image content. Thus, the change information of the fixation area can characterize that the fixation points are concentrated on the target image content, and then the target image content can be used as the target object concerned by the user on the display screen.

[0068] Optionally, the feature information of the fixation area includes m pieces of feature information corresponding to m fixation points, where m is an integer greater than 1. In step 33 above, the step of analyzing the change trend of the area image information in the fixation area over time according to the feature information of the fixation area to obtain the change trend of the fixation area may include the following steps:

[0069] 3301. If among the m pieces of feature information, there are n pieces of feature information that include the first object of interest and the second object of interest, and there are k pieces of feature information that include the first object of interest, where both n and k are positive integers less than m, and the sum of n and k is less than or equal to m;

[0070] 3302. Determine the first object of interest as the target object, and determine that the change information of the fixation area characterizes that the image content of the fixation area is concentrated on the target object.

[0071] In the embodiment of the present application, the change trend of the area image information in the fixation area may be as follows: The area image information in the fixation area includes the object concerned by the user. At some moments, the fixation area also includes other objects adjacent to and related to the object concerned by the user. In this case, it will be analyzed that the user also focuses on the second object of interest in addition to the first object of interest at some moments. For example, please refer to Figure 1C as shown in Figure 1C which is a demonstration schematic diagram for analyzing the change trend of the fixation area provided by the embodiment of the present application. Among them, the screen of the display screen shows a football game scene where a player kicks the ball. Among the 8 pieces of feature information, the 3 pieces of feature information corresponding to the first 3 frames of the picture include the player and the football concerned by the user, and the 5 pieces of feature information of the last 5 frames of the picture include the player concerned by the user. In this way, it can be analyzed and determined according to the 8 pieces of feature information that the target object concerned by the user is the player, rather than the player and the football, so as to more accurately analyze the target object concerned by the user.

[0072] Optionally, the feature information of the fixation area includes the feature information corresponding to multiple fixation points. In step 33 above, the step of analyzing the change trend of the regional image information in the fixation area over time according to the feature information of the fixation area to obtain the fixation area change trend may include the following steps:

[0073] 3303. Determine the fixation change index parameter according to the feature information of the fixation area. The fixation change index parameter includes at least one of the following: the position movement rate, movement frequency, and feature change frequency of the feature information;

[0074] 3304. Determine the content change degree value of the fixation area according to the fixation change index parameter. The fixation change index parameter is used to characterize the change trend of the fixation area.

[0075] Among them, the position movement rate of the feature information can be determined according to the fixation point positions and fixation times corresponding to multiple fixation points. Specifically, the movement rate of the fixation points can be determined according to the fixation point positions and fixation times of every two adjacent fixation points, obtaining multiple movement rates, and then determining the rate average value of the multiple movement rates, and taking this rate average value as the position movement rate of the feature information.

[0076] Among them, the movement frequency within the total fixation duration corresponding to multiple fixation points can be determined according to the number of multiple fixation points.

[0077] Among them, to determine the feature change frequency, specifically, the number of feature changes can be analyzed according to the feature information of the fixation area, and then the feature change frequency can be determined according to the number of feature changes and the total fixation duration corresponding to multiple fixation points. For example, within the total fixation duration corresponding to 15 fixation points, according to the regional image information of 15 frames, among the 15 feature information corresponding to 15 fixation points, the feature information of the first 5 frames does not change, the feature information of the 6th frame changes, the feature information of the 6th - 10th frames does not change, the feature information of the 11th frame changes, and the feature information of the 11th - 15th frames does not change. In this way, the number of feature changes can be counted as 3 times, and then the feature change frequency can be determined according to the number of feature changes and the total fixation duration.

[0078] Among them, to determine the content change degree value of the fixation area according to the fixation change index parameter, a mapping relationship between the fixation change index parameter and the change degree value can be preset, and the corresponding content change degree value can be determined according to the preset mapping relationship between the fixation change index parameter and the change degree value. Optionally, if the fixation change index parameter includes two or three of the position movement rate, movement frequency, and feature change frequency, the reference change degree value corresponding to the fixation change index parameter can be determined according to the mapping relationship between each fixation change index parameter and the change degree value, and the weight value corresponding to each fixation change index parameter can be obtained. Then, a weighted calculation is performed according to the reference change degree values and weight values corresponding to the two or three fixation change index parameters to obtain the content change degree value of the fixation area. For example, the first reference change degree value corresponding to the position movement rate can be determined according to the mapping relationship between the position movement rate and the change degree value, the second reference change degree value corresponding to the movement frequency can be determined according to the mapping relationship between the movement frequency and the change degree value, and the third reference change degree value corresponding to the feature change frequency can be determined according to the mapping relationship between the feature change frequency and the change degree value. In addition, the first weight value, second weight value, and third weight value corresponding to the position movement rate, movement frequency, and feature change frequency are obtained respectively. Then, a weighted calculation is performed according to the first reference change degree value, second reference change degree value, third reference change degree value, first weight value, second weight value, and third weight value to obtain the content change degree value of the fixation area. The calculation formula is as follows: Content change degree value = First reference change degree value * First weight value + Second reference change degree value * Second weight value + Third reference change degree value * Third weight value.

[0079] Optionally, in step 3303 above, the determining the feature change frequency according to the feature information of the fixation area may include the following steps:

[0080] 3331. Match the two feature information corresponding to every two adjacent time points among the multiple fixation points in chronological order to obtain multiple matching values;

[0081] 3332. If there are consecutive multiple target matching values greater than the preset matching threshold among the multiple matching values, determine the feature change frequency according to the first number of the consecutive multiple target matching values and the total fixation duration corresponding to the multiple fixation points.

[0082] In the embodiments of the present application, it is possible to determine whether the feature information has changed by matching the feature information. If the matching value is greater than the matching threshold, it indicates that the feature information has not changed. Among them, the larger the first number, the more stable the feature is, or the smoother the feature change is. The smaller the first number, the faster the feature changes. Furthermore, the feature change frequency can be determined according to the first number of consecutive multiple target matching values and the total fixation duration corresponding to multiple fixation points. Specifically, the second number can be determined according to the first number and the total number of multiple fixation points, and then the feature change frequency can be determined according to the second number and the total fixation duration. Thus, the feature change frequency of the changing feature information can be analyzed through the unchanged feature information.

[0083] 104. Adjust the image frame rate according to the change trend of the fixation area.

[0084] Among them, in the embodiments of the present application, determining whether to adjust the image frame rate mainly depends on the change trend of the fixation area. Specifically, if the regional image information of the fixation area is more stable or changes smoothly, the image frame rate can be reduced. If the regional image information of the fixation area changes relatively fast, the current frame rate can be maintained. In this way, when the regional image information is relatively stable or changes smoothly, the image data processing pressure can be dynamically adjusted by reducing the image frame rate, and the occupation of system resources can be reduced, so as to achieve the purpose of reducing system power consumption on the basis of meeting the image processing effect.

[0085] Optionally, in the embodiments of the present application, for the image data after reducing the image frame rate, during the subsequent image data processing, since the regional image information is relatively stable or changes smoothly within a unit time, more image details can be compensated through frame interpolation processing, so as to meet the requirement of smoothness.

[0086] Optionally, in step 104 above, the adjusting the image frame rate according to the change trend of the fixation area may include the following steps:

[0087] 41. If the change information of the fixation area indicates that the image content of the fixation area focuses on the target object, reduce the image frame rate; or,

[0088] 42. If the content change degree value of the regional image information of the fixation area is less than or equal to the preset degree threshold, reduce the image frame rate.

[0089] In the embodiments of the present application, if the gaze area change information indicates that the image content of the gaze area focuses on the target object, the content that the user is concerned about is relatively stable. If the content change degree value of the gaze area image information is less than or equal to the preset degree threshold, it indicates that the content that the user is concerned about changes smoothly. In this way, the image frame rate can be reduced, the image data processing pressure can be reduced, and the occupation of system resources can be reduced, so as to achieve the purpose of reducing system power consumption on the basis of meeting the image processing effect.

[0090] Optionally, the electronic device further includes an image sensor and an image buffer. The image buffer is used to store the images collected by the image sensor. In step 41 or step 42 above, reducing the image frame rate may include the following steps:

[0091] 43. Reconfigure the image acquisition frame rate of the image sensor to reduce the image frame rate; or,

[0092] 44. Output part of the images collected by the image sensor to the backend image processing module for processing through the bypass of the image sensor to reduce the image frame rate; or,

[0093] 45. Discard part of the images collected by the image sensor in the image buffer through the bypass of the image sensor to reduce the image frame rate.

[0094] In the embodiments of the present application, the ways to achieve reducing the image frame rate may include: reconfiguring the image acquisition frame rate of the image sensor so that the image acquirer acquires image data at a reduced image acquisition frame rate. For example, please refer to Figure 1D , Figure 1D which is a demonstration schematic diagram for reconfiguring the image acquisition frame rate of the image sensor provided by the embodiments of the present application. Originally, the image sensor acquires images at a frame rate of 60fps. The image acquisition frame rate can be reconfigured to 30fps so that the image sensor acquires images at an image acquisition frame rate of 30fps to reduce the image frame rate.

[0095] Or, it is also possible not to change the configuration of the image sensor, but to use the bypass of the image sensor. Specifically, part of the images collected by the image sensor can be output to the backend image processing module for processing through the bypass of the image sensor. Among them, the backend image processing module may include at least one of the following: image data processor ISP, image processing algorithm, and image application program. The embodiments of the present application do not make restrictions. The image application program refers to an application program that processes or applies the images collected by the image sensor. Please refer to Figure 1E , Figure 1EThis is a demonstration schematic diagram of a bypass that outputs a part of the image collected by an image sensor to a backend image processing module. Among them, if the image acquisition frame rate of the image sensor is 60fps, the bypass can transmit to the backend image processing module at a rate of 30 frames per unit time, enabling the backend image processing module to only process part of the images. For example, when the image sensor acquires images at an image acquisition frame rate of 60fps and outputs images at a frame rate of 60fps, when transmitting images to the ISP, only even-frame images can be output, and odd-frame images are not transmitted. Optionally, the part of the images not transmitted by the above bypass can be stored in the image buffer and called by the image application program. In this way, the IPS and image processing algorithms only process part of the images and do not need to process the part of the images not transmitted by the bypass. In this way, the time and power consumption of image data processing at the hardware level (such as the ISP) and the software level (such as the image processing algorithm) can be reduced, achieving the effect of reducing the frame rate.

[0096] Alternatively, without changing the configuration of the image sensor, part of the images output by the image sensor can be discarded through the bypass of the image sensor. In a specific implementation, the image buffer stores the images collected by the image sensor, and the bypass can discard part of the images in the image buffer. Please refer to Figure 1F , Figure 1F This is a demonstration schematic diagram of a bypass that discards part of the images provided by an embodiment of this application. If the image acquisition frame rate of the image sensor is 60fps and the images are output to the image buffer at a frame rate of 60fps, the bypass can discard part of the images in the image buffer. Alternatively, when the bypass transmits the images collected by the image sensor to the backend image processing module for image data processing, it can process every other frame, and the unprocessed image data frames are directly discarded and not transmitted to the backend image processing module for processing. For example, when the image sensor acquires images at an image acquisition frame rate of 60fps and outputs images at a frame rate of 60fps, when transmitting images to the ISP, only even-frame images can be transmitted to the backend image processing module for processing, and odd-frame images are not transmitted or processed. In this way, the time and power consumption of image data processing at the hardware level (such as the ISP) and the software level (such as the image processing algorithm) can be reduced, and the technical effect of reducing the image frame rate can be achieved through the bypass of the image sensor.

[0097] It can be seen that in the embodiments of the present application, the gaze point information of the display screen being gazed at is obtained through the eye tracking module; the gaze area on the display screen is determined according to the gaze point information; the change trend of the area image information of the gaze area is analyzed to obtain the gaze area change trend. Specifically, it can be analyzed whether the change of the area image information of the gaze area is stable. Furthermore, the image frame rate is adjusted according to the gaze area change trend. In this way, the gaze area change trend of the user's gaze area on the gaze area can be determined through the eye tracking technology, and the image data processing pressure can be dynamically adjusted by adjusting the frame rate, reducing the occupation of system resources, and achieving the purpose of reducing system power consumption on the basis of meeting the image processing effect.

[0098] Please refer to Figure 2A , Figure 2A which is a schematic flowchart of a frame rate adjustment method provided by an embodiment of the present application, applied to an electronic device. The electronic device includes an eye tracking module and a display screen. The method includes:

[0099] 201. Obtain the gaze point information of the display screen being gazed at through the eye tracking module.

[0100] 202. Determine the gaze area on the display screen according to the gaze point information.

[0101] 203. Extract features from the area image information to obtain area image features.

[0102] 204. Input the area image features into a feature training model for training to obtain the feature information of the gaze area. The feature information of the gaze area includes the feature information corresponding to multiple gaze points.

[0103] 205. Determine the gaze change index parameter according to the feature information of the gaze area. The gaze change index parameter includes at least one of the following: the position movement rate, movement frequency, and feature change frequency of the feature information.

[0104] 206. Determine the content change degree value of the gaze area according to the gaze change index parameter. The gaze change index parameter is used to characterize the gaze area change trend of the area image information in the gaze area over time.

[0105] 207. If the gaze area change information characterizes that the image content of the gaze area is concentrated on the target object, or if the content change degree value of the gaze area image information is less than or equal to a preset degree threshold, then reduce the image frame rate.

[0106] Among them, the specific implementation processes of the above steps 201-207 can refer to the corresponding descriptions in steps 101-step 104, and will not be elaborated here.

[0107] 208. Obtain the image data stream after reducing the frame rate.

[0108] 209. Perform frame interpolation on the image data stream to obtain the image data stream after frame interpolation.

[0109] Among them, by performing frame interpolation on the image data stream, more image data can be included in the image data stream collected after reducing the frame rate, improving the smoothness of the picture.

[0110] For example, as Figure 2B shown, it is a demonstration schematic diagram of performing frame interpolation on an image data stream provided by an embodiment of the present application. Among them, the fixation point information is obtained through an eye tracking module. The fixation point information may include multiple different fixation points detected at multiple moments. The fixation point information is trained through a fixation point movement trend model in the model training module. The position movement rate, movement frequency, and feature change frequency of the fixation area can be analyzed to obtain the change trend of the fixation area. Furthermore, according to the change trend of the fixation area, the image frame rate is adjusted. If the image frame rate is reduced from 60 fps to 30 fps, then during the subsequent image data processing, frame interpolation can be performed on 30 frames of images, inserting 10 frames of images, and finally obtaining an image data stream of 40 frames of images. In this way, compared with the case of not reducing the frame rate and obtaining an image data stream of 60 frames of images, the embodiment of the present application can reduce the pressure of image data processing, reduce the occupation of system resources, and achieve the purpose of reducing system power consumption on the basis of meeting the image processing effect.

[0111] It can be seen that in the embodiment of the present application, by determining the fixation change index parameters including the position movement rate, movement frequency, and feature change frequency of the feature information according to the feature information of the fixation area, and determining the content change degree value of the fixation area according to the fixation change index parameters, the fixation change index parameters are used to characterize the fixation area change trend of the regional image information in the fixation area over time. If the fixation area change information characterizes that the image content of the fixation area is concentrated on the target object, or if the content change degree value of the fixation area image information is less than or equal to the preset degree threshold, then the image frame rate is reduced, the image data stream after reducing the frame rate is obtained, and frame interpolation is performed on the image data stream to obtain the image data stream after frame interpolation. In this way, the pressure of image data processing can be adjusted, the occupation of system resources can be reduced, and the purpose of reducing system power consumption can be achieved on the basis of meeting the image processing effect.

[0112] The following is a device for implementing the above frame rate adjustment method, specifically as follows:

[0113] Consistent with the above, please refer to Figure 3 , Figure 3It is a schematic structural diagram of an electronic device provided by an embodiment of the present application. The electronic device includes: a processor 310, a communication interface 330, and a memory 320; it further includes an eye tracking module 340, a display screen 350, and one or more programs 321. The one or more programs 321 are stored in the memory 320 and are configured to be executed by the processor. The program 321 includes instructions for performing the following steps:

[0114] Obtain the fixation point information of the display screen being gazed at through the eye tracking module;

[0115] Determine the fixation area on the display screen according to the fixation point information;

[0116] Analyze the change trend of the regional image information of the fixation area to obtain the fixation area change trend;

[0117] Adjust the image frame rate according to the fixation area change trend.

[0118] In a possible example, the fixation point information includes at least one fixation point position and at least one fixation duration corresponding to the at least one fixation point position. In terms of determining the fixation area on the display screen according to the fixation point information, the program 321 includes instructions for performing the following steps:

[0119] Determine the fixation point positions with a fixation duration greater than a preset duration;

[0120] Determine the area within a preset range around the fixation point position as the fixation area; or; determine the contour enclosing area of the fixation object corresponding to the fixation point position as the fixation area.

[0121] In a possible example, in terms of adjusting the image frame rate according to the fixation area change trend, the program 321 includes instructions for performing the following steps:

[0122] If the fixation area change information indicates that the image content of the fixation area is concentrated on the target object, or if the content change degree value of the fixation area image information is less than or equal to a preset degree threshold, then reduce the image frame rate.

[0123] In a possible example, in terms of analyzing the change trend of the regional image information of the fixation area to obtain the fixation area change trend, the program 321 includes instructions for performing the following steps:

[0124] Extract features from the regional image information to obtain regional image features;

[0125] Input the regional image features into a feature training model for training to obtain the feature information of the fixation area;

[0126] Analyze the changing trend of the regional image information in the fixation area over time according to the characteristic information of the fixation area, and obtain the changing trend of the fixation area.

[0127] In a possible example, the characteristic information of the fixation area includes m pieces of characteristic information corresponding to m fixation points, where m is an integer greater than 1. In the aspect of analyzing the changing trend of the regional image information in the fixation area over time according to the characteristic information of the fixation area and obtaining the changing trend of the fixation area, the program 321 includes instructions for performing the following steps:

[0128] If among the m pieces of characteristic information, n pieces of characteristic information include a first focus object and a second focus object, and k pieces of characteristic information include the first focus object, where both n and k are positive integers less than m, and the sum of n and k is less than or equal to m;

[0129] Determine the first focus object as the target object, and determine that the fixation area change information indicates that the image content of the fixation area focuses on the target object.

[0130] In a possible example, the characteristic information of the fixation area includes multiple pieces of characteristic information corresponding to multiple fixation points. In the aspect of analyzing the changing trend of the regional image information in the fixation area over time according to the characteristic information of the fixation area and obtaining the changing trend of the fixation area, the program 321 includes instructions for performing the following steps:

[0131] Determine a fixation change index parameter according to the characteristic information of the fixation area, where the fixation change index parameter includes at least one of the following: the position movement rate, movement frequency, and characteristic change frequency of the characteristic information;

[0132] Determine the content change degree value of the fixation area according to the fixation change index parameter, where the fixation change index parameter is used to characterize the changing trend of the fixation area.

[0133] In a possible example, in the aspect of determining the characteristic change frequency according to the characteristic information of the fixation area, the program 321 includes instructions for performing the following steps:

[0134] Match the two pieces of characteristic information corresponding to two adjacent fixation points among the multiple fixation points in chronological order to obtain multiple matching values;

[0135] If there are consecutive multiple target matching values greater than a preset matching threshold among the multiple matching values, determine the characteristic change frequency according to the first number of the consecutive multiple target matching values and the total fixation duration corresponding to the multiple fixation points.

[0136] In a possible example, the electronic device further includes an image sensor and an image buffer. The image buffer is used to store the images collected by the image sensor. In terms of reducing the image frame rate, the program 321 includes instructions for performing the following steps:

[0137] Reconfigure the image acquisition frame rate of the image sensor to reduce the image frame rate; or,

[0138] Output part of the images collected by the image sensor to the back-end image processing module through the bypass of the image sensor for processing to reduce the image frame rate; or,

[0139] Discard part of the images collected by the image sensor in the image buffer through the bypass of the image sensor to reduce the image frame rate.

[0140] Please refer to Figure 4 , Figure 4 FIG. is a schematic structural diagram of a frame rate adjustment device provided in this embodiment. The frame rate adjustment device 400 is applied to an electronic device. The electronic device includes an eye tracking module and a display screen. The device 400 includes an acquisition unit 401, a determination unit 402, an analysis unit 403, and an adjustment unit 404. Among them,

[0141] The acquisition unit 401 is configured to obtain the fixation point information of the display screen being fixated through the eye tracking module;

[0142] The determination unit 402 is configured to determine the fixation area on the display screen according to the fixation point information;

[0143] The analysis unit 403 is configured to analyze the change trend of the regional image information of the fixation area to obtain the fixation area change trend;

[0144] The adjustment unit 404 is configured to adjust the image frame rate according to the fixation area change trend.

[0145] Optionally, the fixation point information includes at least one fixation point position and at least one fixation duration corresponding to the at least one fixation point position. In terms of determining the fixation area on the display screen according to the fixation point information, the determination unit 402 is specifically configured to:

[0146] Determine the fixation point positions with a fixation duration greater than a preset duration;

[0147] Determine the area within a preset range around the fixation point position as the fixation area; or determine the contour enclosing area of the fixation object corresponding to the fixation point position as the fixation area.

[0148] Optionally, in terms of adjusting the image frame rate according to the change trend of the fixation area, the adjustment unit 404 is specifically configured to:

[0149] If the fixation area change information indicates that the image content of the fixation area is concentrated on the target object, or if the content change degree value of the fixation area image information is less than or equal to a preset degree threshold, the image frame rate is reduced.

[0150] Optionally, in terms of analyzing the change trend of the regional image information of the fixation area to obtain the fixation area change trend, the analysis unit 403 is specifically configured to:

[0151] Extract features from the regional image information to obtain regional image features;

[0152] Input the regional image features into a feature training model for training to obtain the feature information of the fixation area;

[0153] Analyze the change trend of the regional image information in the fixation area over time according to the feature information of the fixation area to obtain the fixation area change trend.

[0154] Optionally, the feature information of the fixation area includes m pieces of feature information corresponding to m fixation points, where m is an integer greater than 1. In terms of analyzing the change trend of the regional image information in the fixation area over time according to the feature information of the fixation area to obtain the fixation area change trend, the analysis unit 403 is specifically configured to:

[0155] If among the m pieces of feature information, n pieces of feature information include a first attention object and a second attention object, and k pieces of feature information include the first attention object, where n and k are both positive integers less than m, and the sum of n and k is less than or equal to m;

[0156] Determine the first attention object as the target object, and determine that the fixation area change information indicates that the image content of the fixation area is concentrated on the target object.

[0157] Optionally, the feature information of the fixation area includes multiple pieces of feature information corresponding to multiple fixation points. In terms of analyzing the change trend of the regional image information in the fixation area over time according to the feature information of the fixation area to obtain the fixation area change trend, the analysis unit 403 is specifically configured to:

[0158] Determine a fixation change index parameter according to the feature information of the fixation area, where the fixation change index parameter includes at least one of the following: the position movement rate, movement frequency, and feature change frequency of the feature information;

[0159] Determine the content change degree value of the fixation area according to the fixation change index parameter, where the fixation change index parameter is used to characterize the change trend of the fixation area.

[0160] Optionally, in terms of determining the feature change frequency according to the feature information of the fixation area, the analysis unit 403 is specifically configured to:

[0161] Match the two feature information corresponding to every two adjacent fixation points among the multiple fixation points in chronological order to obtain multiple matching values;

[0162] If there are continuously multiple target matching values greater than a preset matching threshold among the multiple matching values, determine the feature change frequency according to the first number of the continuously multiple target matching values and the total fixation duration corresponding to the multiple fixation points.

[0163] Optionally, the electronic device further includes an image sensor and an image buffer. The image buffer is used to store the images collected by the image sensor. In terms of reducing the image frame rate, the adjustment unit 404 is specifically configured to:

[0164] Reconfigure the image acquisition frame rate of the image sensor to reduce the image frame rate; or,

[0165] Output part of the images collected by the image sensor to the back-end image processing module for processing through the bypass of the image sensor to reduce the image frame rate; or,

[0166] Discard part of the images collected by the image sensor in the image buffer through the bypass of the image sensor to reduce the image frame rate.

[0167] It can be seen that the frame rate adjustment device described in the embodiments of the present application obtains the fixation point information of the display screen being fixated through the eye tracking module; determines the fixation area on the display screen according to the fixation point information; analyzes the change trend of the regional image information of the fixation area to obtain the change trend of the fixation area. Specifically, it can analyze whether the change of the regional image information of the fixation area is stable. Furthermore, according to the change trend of the fixation area, the image frame rate is adjusted. In this way, the change trend of the user's fixation area on the fixation area can be determined through the eye tracking technology, and the image data processing pressure can be dynamically adjusted by adjusting the frame rate, reducing the occupation of system resources, and achieving the purpose of reducing system power consumption on the basis of meeting the image processing effect.

[0168] It can be understood that the functions of the respective program modules of the frame rate adjustment device in this embodiment can be specifically implemented according to the methods in the above method embodiments, and the specific implementation process can refer to the relevant descriptions of the above method embodiments, which will not be elaborated here.

[0169] The embodiments of the present application further provide a computer storage medium. The computer storage medium stores a computer program for electronic data exchange, and the computer program enables a computer to execute some or all of the steps of any of the methods described in the foregoing method embodiments. The computer includes an electronic device.

[0170] The embodiments of the present application further provide a computer program product. The computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to enable a computer to execute some or all of the steps of any of the methods described in the foregoing method embodiments. The computer program product may be a software installation package, and the computer includes an electronic device.

[0171] It should be noted that, for the foregoing method embodiments, for simplicity of description, they are all expressed as a series of action combinations. However, those skilled in the art should know that the present application is not limited by the described action sequence, because according to the present application, some steps may be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily essential to the present application.

[0172] In the above embodiments, the descriptions of the respective embodiments have their own emphases. For the parts not detailed in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.

[0173] In several embodiments provided by the present application, it should be understood that the disclosed device can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the above-mentioned unit division is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed mutual coupling or direct coupling or communication connection may be through some interfaces. The indirect coupling or communication connection of the device or unit may be in an electrical or other form.

[0174] The units described as separate components may or may not be physically separated. The components displayed as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0175] In addition, in each embodiment of the present application, each functional unit can be integrated into a processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

[0176] If the above integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable memory. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the above methods in each embodiment of the present application. The aforementioned memory includes: USB flash drives, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), mobile hard disks, magnetic disks, or optical discs, etc., which can store program codes.

[0177] Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing relevant hardware through a program. This program can be stored in a computer-readable memory. The memory can include: flash drives, read-only memories (abbreviation: ROM), random access memories (abbreviation: RAM), magnetic disks, or optical discs, etc.

[0178] The above has introduced the embodiments of the present application in detail. Specific examples are used in this article to elaborate on the principle and implementation manner of the present application. The description of the above embodiments is only used to help understand the method and its core idea of the present application; at the same time, for those of ordinary skill in the art, according to the idea of the present application, there will be changes in the specific implementation manner and application scope. In summary, the content of this specification should not be construed as a limitation to the present application.

Claims

1. A frame rate adjustment method, characterized in that, Applied to an electronic device, the electronic device including an eye tracking module and a display screen, the method comprising: Obtaining, by the eye tracking module, fixation point information of the display screen being gazed at; Determining a fixation area on the display screen according to the fixation point information; Analyzing a change trend of the area image information of the fixation area, extracting features from the area image information, and obtaining area image features; Inputting the area image features into a feature training model for training to obtain feature information of the fixation area, the feature information of the fixation area including multiple pieces of feature information corresponding to multiple fixation points; Determining a fixation change index parameter according to the feature information of the fixation area, the fixation change index parameter including at least one of the following: a position movement rate, a movement frequency, and a feature change frequency of the feature information; including: sequentially matching two pieces of feature information corresponding to two adjacent fixation points among the multiple fixation points in chronological order to obtain multiple matching values; if there are multiple consecutive target matching values greater than a preset matching threshold among the multiple matching values, determining the feature change frequency according to a first number of the multiple consecutive target matching values and a total fixation duration corresponding to the multiple fixation points; Determining a content change degree value of the fixation area according to the fixation change index parameter, the fixation change index parameter being used to characterize a change trend of the area image information in the fixation area over time; including: determining a reference change degree value corresponding to the fixation change index parameter according to a mapping relationship between each fixation change index parameter and the change degree value, obtaining a weight value corresponding to each fixation change index parameter, and performing weighted calculation according to the reference change degree values and weight values corresponding to two or three fixation change index parameters to obtain the content change degree value of the fixation area; If the fixation area change information indicates that the image content of the fixation area is concentrated on a target object, or if the content change degree value of the fixation area image information is less than or equal to a preset degree threshold, reducing the image frame rate.

2. The method according to claim 1, wherein The fixation point information includes at least one fixation point position and at least one fixation duration corresponding to the at least one fixation point position, and determining the fixation area on the display screen according to the fixation point information includes: Determining fixation point positions with a fixation duration greater than a preset duration; Determining a preset range area around the fixation point position as the fixation area; or; determining a contour enclosing area of a fixation object corresponding to the fixation point position as the fixation area.

3. The method according to claim 1, wherein The feature information of the fixation area includes m pieces of feature information corresponding to m fixation points, m being an integer greater than 1, and analyzing a change trend of the area image information in the fixation area over time according to the feature information of the fixation area to obtain a fixation area change trend, including: If n pieces of the m pieces of feature information include a first focus object and a second focus object, and k pieces of the feature information include the first focus object, both n and k being positive integers less than m, and the sum of n and k being less than or equal to m; Determine that the first object of interest is the target object, and determine that the gaze area change information indicates that the image content of the gaze area focuses on the target object.

4. The method according to any one of claims 1 to 3, characterized in that, The electronic device further includes an image sensor and an image buffer. The image buffer is used to store the images collected by the image sensor. The reducing the image frame rate includes: Reconfiguring the image acquisition frame rate of the image sensor to reduce the image frame rate; or, Outputting part of the images collected by the image sensor to the back-end image processing module for processing through the bypass of the image sensor to reduce the image frame rate; or, Discarding part of the images collected by the image sensor in the image buffer through the bypass of the image sensor to reduce the image frame rate.

5. A frame rate adjustment device, characterized in that, Applied to an electronic device, the electronic device includes an eye tracking module and a display screen. The device includes: An acquisition unit, configured to acquire gaze point information of the display screen being gazed at through the eye tracking module; A determination unit, configured to determine a gaze area on the display screen according to the gaze point information; An analysis unit, configured to analyze a change trend of the area image information of the gaze area to obtain a gaze area change trend; An adjustment unit, configured to adjust the image frame rate according to the gaze area change trend; The analysis unit is specifically configured to extract features from the area image information to obtain area image features; input the area image features into a feature training model for training to obtain feature information of the gaze area. The feature information of the gaze area includes multiple pieces of feature information corresponding to multiple gaze points; determine a gaze change index parameter according to the feature information of the gaze area. The gaze change index parameter includes at least one of the following: the position movement rate, movement frequency, and feature change frequency of the feature information; including: sequentially matching two pieces of feature information corresponding to two adjacent gazed points among the multiple gazed points in chronological order to obtain multiple matching values; if there are multiple consecutive target matching values greater than a preset matching threshold among the multiple matching values, determine the feature change frequency according to the first number of the multiple consecutive target matching values and the total gaze duration corresponding to the multiple gazed points; Determine a content change degree value of the gaze area according to the gaze change index parameter. The gaze change index parameter is used to characterize the gaze area change trend of the area image information in the gaze area over time; including: determining a reference change degree value corresponding to the gaze change index parameter according to the mapping relationship between each gaze change index parameter and the change degree value, obtaining a weight corresponding to each gaze change index parameter, and performing weighted calculation according to the reference change degree values and weights corresponding to two or three gaze change index parameters to obtain the content change degree value of the gaze area; The adjustment unit is specifically configured to reduce the image frame rate if the gaze area change information indicates that the image content of the gaze area focuses on the target object, or if the content change degree value of the gaze area image information is less than or equal to a preset degree threshold.

6. An electronic device, characterized in that, It includes an eye tracking module, a display screen, a processor, a memory, a communication interface, and one or more programs. The memory is used to store one or more programs and is configured to be executed by the processor. The programs include instructions for performing the steps in the method according to any one of claims 1-4.

7. A computer-readable storage medium, characterized in that, Store a computer program for electronic data interchange, wherein the computer program causes a computer to execute the method according to any one of claims 1-4.

Images