Shooting anti-shake method, device, electronic equipment and storage medium

Abstract

The embodiments of the present application disclose a shooting anti-shake method, device, electronic device and storage medium, the method comprising the following steps: obtaining gaze point information of a display screen being gazed at through an eye tracking module; obtaining regional image information of a gaze area where the gaze point is located according to the gaze point information; analyzing a target object of interest in the display screen according to the gaze point information and the regional image information; dividing a display area of ​​the display screen into at least two partitions according to the target object; performing differentiated anti-shake processing on each of the at least two partitions to obtain at least two partitions after processing, wherein each of the at least two partitions corresponds to different anti-shake processing parameters, so that differentiated anti-shake processing can be performed in the display area of ​​the display screen based on the eye tracking technology, and on the premise of ensuring the image quality of the target object, the anti-shake processing efficiency is improved, and low-power consumption and high-quality anti-shake shooting is achieved.

Description

Technical Field

[0001] The present application relates to the field of display technology, and in particular to a shooting anti-shake method, device, electronic device and storage medium. Background Art

[0002] With the widespread popularization of electronic devices (such as mobile phones, tablet computers, etc.), electronic devices can support more and more applications and have more and more powerful functions. Electronic devices are developing in a diversified and personalized direction and have become an indispensable electronic product in users' lives.

[0003] There are two main types of camera stabilization at present, optical image stabilization (OIS) and electronic image stabilization (EIS). These two video stabilization technologies perform stabilization processing based on the entire image when shooting images. It is difficult to obtain a better stabilization effect while ensuring low power consumption. At the same time, due to the limitations of the stabilization processing technology, the image quality will also be lost to a certain extent, thus reducing the user experience. Summary of the invention

[0004] The embodiments of the present application provide a shooting anti-shake method, device, electronic device and storage medium, which can implement anti-shake processing during shooting based on eye tracking technology, achieve low-power and high-quality anti-shake shooting, and improve user experience.

[0005] In a first aspect, an embodiment of the present application provides a shooting anti-shake method, which is applied to an electronic device, wherein the electronic device includes an eye tracking module and a display screen, and the method includes:

[0006] Acquiring gaze point information of the display screen through the eye tracking module;

[0007] Acquire regional image information of a gaze area where the gaze point is located according to the gaze point information;

[0008] Analyzing a target object of interest in the display screen according to the gaze point information and the regional image information; dividing a display area of ​​the display screen into at least two partitions according to the target object;

[0009] Differentiated anti-shake processing is performed on each of the at least two partitions to obtain at least two processed partitions, wherein each of the at least two partitions corresponds to a different anti-shake processing parameter.

[0010] In a second aspect, an embodiment of the present application provides a shooting anti-shake device, which is applied to an electronic device, wherein the electronic device includes an eye tracking module and a display screen, and the device includes:

[0011] An acquisition unit, configured to acquire gaze point information of the display screen through the eye tracking module;

[0012] The acquisition unit is further used to acquire regional image information of a gaze area where the gaze point is located according to the gaze point information;

[0013] An analyzing unit, configured to analyze a target object of interest in the display screen according to the gaze point information and the regional image information;

[0014] A partitioning unit, configured to divide a display area of ​​the display screen into at least two partitions according to the target object;

[0015] The processing unit is used to perform differentiated anti-shake processing on each of the at least two partitions to obtain at least two partitions after processing, wherein each of the at least two partitions corresponds to a different anti-shake processing parameter.

[0016] In a third aspect, an embodiment of the present application provides an electronic device, comprising a first camera, a second camera, a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the program includes instructions for executing the steps in the first aspect of the embodiment of the present application.

[0017] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program for electronic data exchange, wherein the computer program enables a computer to execute part or all of the steps described in the first aspect of the embodiment of the present application.

[0018] In a fifth aspect, an embodiment of the present application provides a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute some or all of the steps described in the first aspect of the embodiment of the present application. The computer program product may be a software installation package.

[0019] The implementation of the embodiments of the present application has the following beneficial effects:

[0020] It can be seen that the shooting anti-shake method, device, electronic device and storage medium provided in the embodiments of the present application obtain the gaze point information of the display screen being gazed at through the eye tracking module; obtain the regional image information of the gaze area where the gaze point is located according to the gaze point information; analyze the target object of interest in the display screen according to the gaze point information and the regional image information; divide the display area of ​​the display screen into at least two partitions according to the target object; perform differentiated anti-shake processing on each of the at least two partitions to obtain at least two partitions after processing, wherein each of the at least two partitions corresponds to different anti-shake processing parameters, so that the display area of ​​the display screen can be differentiated anti-shake processed based on the eye tracking technology, while ensuring the image quality of the target object, improving the anti-shake processing efficiency, and realizing low-power consumption and high-quality anti-shake shooting. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0022] Figure 1A is a structural schematic diagram of an electronic device provided in an embodiment of the present application;

[0023] Figure 1B It is a flowchart of a shooting anti-shake method provided by an embodiment of the present application;

[0024] Figure 1C This is a demonstration schematic diagram of dividing a display area of ​​an electronic device into at least two partitions provided by an embodiment of the present application;

[0025] Figure 1D is a schematic diagram showing a gaze point movement provided by an embodiment of the present application;

[0026] Figure 1E is a demonstration schematic diagram of determining a focal plane provided in an embodiment of the present application;

[0027] Figure 1F It is a schematic diagram of a depth of field principle provided by an embodiment of the present application;

[0028] Figure 1G This is a schematic diagram showing a method of performing differentiated anti-shake processing on a shooting area of ​​a display screen provided by an embodiment of the present application;

[0029] Figure 2 It is a flowchart of another shooting anti-shake method provided by an embodiment of the present application;

[0030] Figure 3 is a structural schematic diagram of an electronic device provided in an embodiment of the present application;

[0031] Figure 4 It is a structural schematic diagram of a shooting anti-shake device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0032] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0033] The terms "first", "second", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices.

[0034] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0035] The electronic devices involved in the embodiments of the present application may include various handheld devices with wireless communication functions, vehicle-mounted devices, wearable devices (smart watches, smart bracelets, wireless headphones, augmented reality / virtual reality devices, smart glasses), computing devices or other processing devices connected to wireless modems, and various forms of user equipment (UE), mobile stations (MS), terminal devices, etc. For the convenience of description, the above-mentioned devices are collectively referred to as electronic devices.

[0036] The following is a detailed description of the embodiments of the present application.

[0037] See also Figure 1A , Figure 1A1 is a schematic diagram of the structure of an electronic device disclosed in an embodiment of the present application. The electronic device 100 includes a storage and processing circuit 110 and a sensor 170 connected to the storage and processing circuit 110, wherein:

[0038] The electronic device 100 may include a control circuit, which may include a storage and processing circuit 110. The storage and processing circuit 110 may include a memory, such as a hard disk drive memory, a non-volatile memory (such as a flash memory or other electronic programmable read-only memory for forming a solid-state drive, etc.), a volatile memory (such as a static or dynamic random access memory, etc.), etc., which is not limited by the embodiments of the present application. The processing circuit in the storage and processing circuit 110 can be used to control the operation of the electronic device 100. The processing circuit can be implemented based on one or more microprocessors, microcontrollers, digital signal processors, baseband processors, power management units, audio codec chips, application-specific integrated circuits, display driver integrated circuits, etc.

[0039] The storage and processing circuit 110 may be used to run software in the electronic device 100, such as an Internet browsing application, a Voice over Internet Protocol (VOIP) phone call application, an email application, a media playback application, an operating system function, etc. These software may be used to perform some control operations, such as image acquisition based on a camera, ambient light measurement based on an ambient light sensor, proximity sensor measurement based on a proximity sensor, information display functions implemented based on status indicators such as status indicators of light-emitting diodes, touch event detection based on a touch sensor, functions associated with displaying information on multiple (e.g., layered) display screens, operations associated with performing wireless communication functions, operations associated with collecting and generating audio signals, control operations associated with collecting and processing button press event data, and other functions in the electronic device 100, etc., which are not limited by the embodiments of the present application.

[0040] The electronic device 100 may include an input-output circuit 150. The input-output circuit 150 may be used to enable the electronic device 100 to input and output data, that is, to allow the electronic device 100 to receive data from an external device and also to allow the electronic device 100 to output data from the electronic device 100 to an external device. The input-output circuit 150 may further include a sensor 170. The sensor 170 may include a fingerprint recognition module, and may also include an ambient light sensor, a proximity sensor based on light and capacitance, a touch sensor (for example, based on a light touch sensor and / or a capacitive touch sensor, wherein the touch sensor may be part of a touch display screen, or may be used independently as a touch sensor structure), an acceleration sensor, and other sensors, etc. The ultrasonic fingerprint recognition module may be integrated under the screen, or the fingerprint recognition module may be disposed on the side or back of the electronic device, which is not limited here, and the fingerprint recognition module may be used to collect fingerprint images.

[0041] The sensor 170 may also include an infrared (IR) camera and a visible light camera. The IR camera and the visible light camera may constitute an eye tracking module, which is used to perform eye tracking. When the IR camera is shooting, the pupil reflects infrared light, so the IR camera is more accurate than the RGB camera in capturing pupil images. The visible light camera requires more subsequent pupil detection, and has higher calculation precision and accuracy than the IR camera, and better versatility than the IR camera, but has a large amount of calculation.

[0042] The input-output circuit 150 may also include one or more display screens, such as the display screen 130. The display screen 130 may include a liquid crystal display screen, an organic light-emitting diode display screen, an electronic ink display screen, a plasma display screen, a display screen using other display technologies, or a combination of several of them. The display screen 130 may include a touch sensor array (i.e., the display screen 130 may be a touch-controlled display screen). The touch sensor may be a capacitive touch sensor formed by an array of transparent touch sensor electrodes (e.g., indium tin oxide (ITO) electrodes), or may be a touch sensor formed using other touch technologies, such as sonic touch, pressure-sensitive touch, resistive touch, optical touch, etc., which is not limited in the embodiments of the present application.

[0043] The electronic device 100 may further include an audio component 140. The audio component 140 may be used to provide audio input and output functions for the electronic device 100. The audio component 140 in the electronic device 100 may include a speaker, a microphone, a buzzer, a tone generator, and other components for generating and detecting sound.

[0044] The communication circuit 120 can be used to provide the electronic device 100 with the ability to communicate with external devices. The communication circuit 120 may include analog and digital input-output interface circuits, and wireless communication circuits based on radio frequency signals and / or optical signals. The wireless communication circuit in the communication circuit 120 may include a radio frequency transceiver circuit, a power amplifier circuit, a low noise amplifier, a switch, a filter, and an antenna. For example, the wireless communication circuit in the communication circuit 120 may include a circuit for supporting near field communication (NFC) by transmitting and receiving near field coupled electromagnetic signals. For example, the communication circuit 120 may include a near field communication antenna and a near field communication transceiver. The communication circuit 120 may also include a cellular phone transceiver and antenna, a wireless local area network transceiver circuit and antenna, etc.

[0045] The electronic device 100 may further include a battery, power management circuits and other input-output units 160. The input-output units 160 may include buttons, joysticks, click wheels, scroll wheels, touch pads, keypads, keyboards, cameras, light emitting diodes and other status indicators, etc.

[0046] A user may input commands through input-output circuitry 150 to control the operation of electronic device 100 , and may use output data of input-output circuitry 150 to enable receiving status information and other outputs from electronic device 100 .

[0047] See also Figure 1B , Figure 1B is a flow chart of a shooting anti-shake method provided by an embodiment of the present application, which is applied to Figure 1A The electronic device shown in the figure comprises an eye tracking module and a display screen. Figure 1B As shown, the shooting anti-shake method provided by this application includes:

[0048] 101. Obtain gaze point information of the display screen through the eye tracking module.

[0049] Among them, the eye tracking module may include a camera, through which the user's eyes are tracked. The camera for eye tracking may be an infrared camera or a visible light camera, etc., which is not limited here.

[0050] The gaze point information may include gaze point location, gaze duration and other information.

[0051] In a specific implementation, as the user's gaze moves on the display screen, the eye tracking module can detect the gaze point information of the user's eyes on the display screen. For example, the eye tracking module can detect the first gaze point position of the user's eyes on the display screen, and a first gaze duration of the first gaze point position. When the user's gaze moves, the eye tracking module can detect the second gaze point position of the user's eyes on the display screen, and a second gaze duration of the second gaze point position. Thus, the eye tracking module can detect different gaze point positions of the user on the display screen at different times and the gaze durations corresponding to the gaze point positions.

[0052] 102. Acquire regional image information of a gaze area where the gaze point is located according to the gaze point information.

[0053] Among them, regional image information of the gaze area where the gaze point is located is obtained according to the gaze point information, and the regional image information may include image information of people, objects, etc. For example, if the user is gazing at a person, regional image information related to the person included in the gaze area where the gaze point is located in the display screen can be determined according to the gaze point information; if the user is gazing at objects such as mountains and trees, regional image information related to the object included in the gaze area where the gaze point is located in the display screen can be determined according to the gaze point information.

[0054] Optionally, in the above step 102, the gaze point information includes at least one gaze point position and at least one gaze duration corresponding to the at least one gaze point position, and acquiring the regional image information of the gaze area where the gaze point is located according to the gaze point information may include the following steps:

[0055] 21. Determine the position of the gaze point whose gaze duration is greater than the preset duration;

[0056] 22. Determine a first range area around the gaze point position as the gaze area; or; determine an area surrounded by a contour of a gaze object corresponding to the gaze point position as the gaze area;

[0057] 23. Extract image information of the gaze area to obtain the area image information.

[0058] In a specific implementation, a preset time length can be set in advance. When it is determined that the user's gaze time at a gaze point position is greater than the preset time length, the first range area around the gaze point position can be determined as the gaze area. Specifically, the first range area can be a preset gaze frame or a preset gaze circle. The size of the preset gaze frame or the preset gaze circle can be set by the system by default or by the user. There is no limitation here. For example, when the image content in the display screen is a sky, the first range area around the gaze point position within the preset gaze frame or the preset gaze circle can be determined as the gaze area.

[0059] Alternatively, when it is determined that the user's gaze duration at a gaze point position is greater than a preset duration, the contour enclosed area of ​​the gaze object corresponding to the gaze point position can be determined as the gaze area. Specifically, if the image content corresponding to the gaze point position is a specific gaze object, such as a face, a portrait, or objects such as trees, mountains, animals, or a chat interface box, application icon, etc., the above-mentioned gaze object has its own specific contour, and therefore, the contour enclosed area of ​​the gaze object can be determined as the gaze area.

[0060] 103. Analyze a target object of interest in the display screen according to the gaze point information and the regional image information; and divide a display area of ​​the display screen into at least two partitions according to the target object.

[0061] The gaze point information and the regional image information can reflect the content of interest that the user is gazing at on the display screen. Therefore, the target object of interest to the user can be analyzed based on the gaze point information and the regional image information.

[0062] The at least two partitions may include the area where the target object is located, and the electronic device may divide the area where the target object is located into a key area and divide other areas into non-key areas. Optionally, the electronic device may further divide the non-key area into a secondary key area and a background area according to the image content information of the area where the target position is located.

[0063] In specific implementation, Figure 1C As shown, a demonstration schematic diagram of dividing the display area of ​​an electronic device into at least two partitions provided in an embodiment of the present application, the electronic device can set the area where the target object is located as a key area. If it is detected that the display area of ​​the electronic device includes three target objects, three key areas can be set. Furthermore, the area around each key area can be set as a secondary key area, and the area outside the key area and the secondary key area can be divided into a background area.

[0064] Optionally, in the above step 103, analyzing the target object of interest in the display screen according to the gaze point information and the regional image information may include the following steps:

[0065] 31. Analyze the information of the movement of the gaze point over time according to the gaze point information to obtain the gaze point movement trend information;

[0066] 32. Analyze the gaze area change information of the gaze area according to the regional image information;

[0067] 33. If the gaze point movement trend information represents that the gaze point is concentrated in a first position area, the first position area is used as the target object of attention in the display screen; or, if the gaze area change information represents that the gaze point is concentrated in a target image content, the target image content is used as the target object of attention in the display screen.

[0068] The gaze point movement trend information specifically includes information on whether and how the gaze point changes over time. The gaze point may move within the first position area over time, and the movement range is relatively concentrated. For example, Figure 1D As shown, Figure 1D A demonstration diagram of gaze point movement is provided for an embodiment of the present application. Assuming that the user's gaze point changes over time within a first position area of ​​a display screen and does not exceed the range of the first position area, it can be determined that the gaze point movement trend information represents that the gaze point is concentrated in the first position area.

[0069] The gaze area change information of the gaze area is analyzed according to the regional image information. Specifically, when the gaze point moves to different positions, whether the image content of the gaze area changes and how it changes can be analyzed. For example, during the movement of the gaze point, if the image content of the gaze area where the user's gaze point is located is concentrated in the face area, it indicates that the image content of the gaze area is relatively fixed; if the image content of the gaze area where the user's gaze point is located includes trees, mountains and water, it indicates that the image content of the gaze area has changed.

[0070] In a specific implementation, based on the gaze point movement trend information and the gaze area change information, if the gaze point movement trend information indicates that the gaze point is concentrated in a first position area, that is, concentrated in a fixed position area, indicating that the user's gaze point position on the display screen is relatively concentrated, then the first position area can be used as the target object of interest in the display screen, the position information of the first position area is determined, and the first position information is subjected to focused anti-shake processing. If the gaze area change information indicates that the gaze point is concentrated on the target image content, that is, the content that the user is concerned about is relatively fixed, regardless of whether the gaze point position changes, the image content of the gaze area where the gaze point is located is relatively concentrated, the target image content can be used as the target object of interest in the display screen, the characteristic information of the target image content is determined, and the target image content is subjected to focused anti-shake processing based on the characteristic information.

[0071] Optionally, in the above step 32, analyzing the gaze area change information of the gaze area according to the regional image information includes:

[0072] 3201. Extract features from the regional image information to obtain regional image features;

[0073] 3202. Input the regional image features into a feature training model for training to obtain feature information of the gaze region;

[0074] 3203. Analyze information about changes in image content in the gaze area with the gaze point according to feature information of the gaze area to obtain gaze area change information.

[0075] Among them, the feature extraction algorithm for extracting image features from the regional image information may include at least one of the following: Histogram of Oriented Gradients (HOG) algorithm, Hough transform method or Haar feature cascade classifier algorithm, etc., which are not limited here.

[0076] Among them, the characteristic information of the gaze area may include position characteristic information of the gaze area and characteristic information of the image content contained in the gaze area. The characteristic information of the gaze area is used to characterize the image content of the gaze area. For example, the characteristic information of the gaze area may be characteristic information of a face, characteristic information of a portrait, characteristic information of a mountain, characteristic information of a tree, etc., which is not limited here. The image content of the gaze area can be determined through the characteristic information of the gaze area.

[0077] In a specific implementation, different regional image information may be included in the multiple gaze areas corresponding to different multiple gaze points detected at different times, and feature extraction may be performed on the regional image information corresponding to each gaze point to obtain regional image features, and regional image features corresponding to different gaze areas are obtained. The regional image features are sequentially input into the image feature training model, and the input regional image features are trained through the image feature training model to obtain feature information of the gaze areas where the different gaze points are located. Optionally, if the gaze point information detected by the eye tracking module includes M gaze points, M is a positive integer, regional image features may be extracted from the regional image information of the M gaze areas corresponding to the M gaze points, and the regional image features corresponding to the M gaze points are sequentially input into the image feature training model, and M gaze area feature information of the M gaze areas may be obtained. For example, facial feature information of the gaze area may be obtained, which may specifically include feature information of various parts of the face (nose, eyes, chin, forehead, etc.).

[0078] Among them, the image content change information refers to whether the user's gaze image content changes and how it changes. Specifically, whether the user's gaze image content changes can be analyzed based on the M gaze area feature information of the M gaze areas. If there are N times of the same image content in the regional image information of the M gaze areas, N is a positive integer less than or equal to M, the occurrence probability of the image content can be calculated. If the occurrence probability is greater than a preset probability threshold, it can be determined that the image content is the target image content that the user focuses on, indicating that the image content of the gaze area is concentrated on the target object. Regardless of whether the gaze point position changes, the image content of the gaze area where the gaze point is located is the target image content. Therefore, the gaze area change information can represent that the gaze point is concentrated on the target image content, and then the target image content can be used as the target object that is focused on in the display screen.

[0079] Optionally, in the above step 103, dividing the display area of ​​the display screen into at least two partitions according to the target object includes:

[0080] 34. Determine the focal plane of the target object;

[0081] 35. Determine relative depth information between the focal plane and other photographed objects in the display area;

[0082] 36. Divide a display area of ​​the display screen into at least two partitions according to the relative depth information.

[0083] See also Figure 1E , Figure 1E A demonstration schematic diagram for determining a focal plane is provided for an embodiment of the present application, wherein the distance between a target object and a camera of an electronic device in a shooting direction can be determined, and then, a plane parallel to the imaging plane of the camera and passing through the target object is determined as the focal plane.

[0084] Furthermore, the relative depth information between the focal plane and other photographic objects in the display area can be determined. Specifically, the first depth of field corresponding to the focal plane where the target object is located can be determined, and then the second depth of field of other photographic objects in the display area can be determined, and then the relative depth of field information of the target object relative to the other photographic objects can be determined based on the first depth of field and the second depth of field. In this way, if there are multiple photographic objects with different depths of field in the shooting picture, the relative depth of field information of the target object relative to different photographic objects can be determined.

[0085] See also Figure 1F , Figure 1F A schematic diagram of the depth of field principle provided in an embodiment of the present application, wherein the foreground depth of field and the background depth of field corresponding to the focal plane can be determined according to the aperture value, object distance, mass circle diameter and focal length of the shooting lens, and the specific formula is as follows:

[0086]

[0087]

[0088] Among them, △L1 is the foreground depth of field, △L2 is the back depth of field, F is the aperture value, L is the object distance, δ is the diameter of the mass circle and f is the focal length of the first camera.

[0089] Then the first depth of field corresponding to the focal plane can be calculated according to the foreground depth of field and the back depth of field. The specific formula is as follows:

[0090]

[0091] Finally, based on the relative depth of field information of the target object relative to different photographed objects in the captured image, the display area of ​​the display screen may be divided into at least two partitions to distinguish the target object from the corresponding areas of other photographed objects in the display area.

[0092] 104. Perform differentiated anti-shake processing on each of the at least two partitions to obtain at least two processed partitions, wherein each of the at least two partitions corresponds to a different anti-shake processing parameter.

[0093] Among them, the anti-shake processing parameters refer to the jitter compensation parameters calculated based on the jitter offset of the target object. The anti-shake processing parameters may include, for example, anti-shake frequency, anti-shake amplitude, anti-shake direction, etc., which are not limited here.

[0094] In a specific implementation, differential anti-shake processing is performed on each of at least two partitions, and corresponding anti-shake processing parameters can be determined according to the regional image information of each partition, and a higher-effect anti-shake processing is performed on the partition where the target object is located, and a lower-effect anti-shake processing or no anti-shake processing is performed on other shooting contents other than the target object. Specifically, in order to improve the anti-shake processing effect of the target object, the anti-shake processing parameters of the area where the target object is located can be adjusted to improve the anti-shake processing effect of the target object; or, the anti-shake processing parameters of non-key areas other than the target object can be adjusted to reduce the anti-shake processing effect of non-key areas, so as to reduce the time consumed by the anti-shake processing and improve the anti-shake processing efficiency. Therefore, different anti-shake processing parameters can be used to perform differential anti-shake processing on each partition, and the anti-shake processing efficiency can be improved while ensuring the anti-shake processing effect of the target object.

[0095] For an example, see Figure 1G , Figure 1GA demonstration schematic diagram of differentiated anti-shake processing for the shooting area of ​​a display screen is provided in an embodiment of the present application, wherein the display area of ​​the display screen can be divided into a key area, a sub-key area and a background area according to a target object, and for the divided key area, sub-key area and background area, different anti-shake processing parameters can be used to achieve a high anti-shake processing effect for the key area, a second-highest anti-shake processing effect for the sub-key area, and a low anti-shake processing effect for the background area, thereby ensuring the image quality of the key area and improving the image processing rate of the background area, thereby improving the smoothness of the picture while ensuring the image quality of the key area.

[0096] In the embodiment of the present application, the at least two partitions include the first partition where the target object is located. After the above step 104, the method further includes:

[0097] A1. Acquire at least one historical cache area image;

[0098] A2. Synthesize the first partition with the at least one historical cache area image to obtain a synthesized first partition;

[0099] A3. Displaying the synthesized first partition and other partitions of the at least two partitions on the display screen.

[0100] The historical cached area image refers to an area image obtained by pre-extracting the image content of the target object in the historical frame and then caching it.

[0101] In an embodiment of the present application, by synthesizing the first partition with at least one historical cache area image to obtain a synthesized first partition, the image of the first partition where the target object is located can be enhanced to improve the picture quality of the first partition.

[0102] Optionally, in the above step 103, after analyzing the target object of interest in the display screen according to the gaze point information and the regional image information, the method further includes:

[0103] B1. Segmenting the image region where the target object is located in at least one historical frame to obtain at least one historical cache region image;

[0104] B2. Store the at least one historical cache area image in a cache area in a memory.

[0105] In an embodiment of the present application, after determining the target object that the user is paying attention to, the image area corresponding to the target object in at least one historical frame before the current screen can be segmented to obtain at least one historical cache area image, and each of the at least one historical cache area image includes image content corresponding to the target object. In a specific implementation, if the target object is the first position area that the user is looking at, the image of at least one historical frame can be segmented according to the position information of the first position area to obtain at least one historical cache area image. For example, assuming that the first position area is a circular area with a radius of 2 cm in the lower right corner of the display screen, the circular area at the position in at least one historical frame can be segmented according to the position information of the circular area to obtain at least one historical cache area image; if the target object is the target image content that the user is looking at, the image of at least one historical frame can be segmented according to the target image content to obtain at least one historical cache area image. For example, if the target object is a first face, the first face in at least one historical frame can be segmented to obtain at least one historical cache area image.

[0106] Furthermore, at least one historical cache area image may be cached for subsequent image synthesis with the first partition where the target object is located.

[0107] Optionally, in the above step A3, performing image synthesis on the first partition and the at least one historical cache area image to obtain the synthesized first partition includes:

[0108] A31, dividing the first partition and the at least one historical cache area image into two or more sub-unit areas according to the image features of the first partition;

[0109] A32. Synthesize the sub-unit area image corresponding to each of the two or more sub-unit areas in the first partition and at least one sub-unit area image corresponding to the at least one historical cache area image to obtain a synthesized first partition.

[0110] Among them, the above-mentioned two or more sub-unit areas are constituent elements of the image content of the first partition. For example, when the target object in the first partition is a human face, the first partition can be divided into two or more sub-unit areas such as nose, left eye, right eye, nose, chin, forehead, left ear, and right ear. Then, the image content of the first partition and the sub-unit area image corresponding to each sub-unit area in at least one historical cache area image can be synthesized. For example, the left eye area of ​​the image content of the first partition and the left eye area in at least one historical cache area image are synthesized, the right eye area of ​​the image content of the first partition and the right eye area in at least one historical cache area image are synthesized, the nose area of ​​the image content of the first partition and the nose area in at least one historical cache area image are synthesized, and so on. Each constituent element in the first partition can be synthesized separately to improve the processing effect of the image details in the target object.

[0111] It can be seen that in the embodiment of the present application, the gaze point information of the display screen is obtained through the eye tracking module; the regional image information of the gaze area where the gaze point is located is obtained according to the gaze point information; the target object of focus in the display screen is analyzed according to the gaze point information and the regional image information; the display area of ​​the display screen is divided into at least two partitions according to the target object; each of the at least two partitions is subjected to differentiated anti-shake processing to obtain at least two partitions after processing, wherein each of the at least two partitions corresponds to different anti-shake processing parameters, so that the display area of ​​the display screen can be subjected to differentiated anti-shake processing based on the eye tracking technology to achieve low-power consumption and high-quality anti-shake shooting.

[0112] See also Figure 2 , Figure 2 A flowchart of a method for anti-shake shooting provided in an embodiment of the present application is applied to an electronic device, wherein the electronic device includes an eye tracking module and a display screen, and the method includes:

[0113] 201. Obtain gaze point information of the display screen through the eye tracking module.

[0114] 202. Obtain regional image information of a gaze area where the gaze point is located according to the gaze point information.

[0115] 203. Analyze the information of the movement of the gaze point over time according to the gaze point information to obtain the gaze point movement trend information.

[0116] 204. Analyze gaze area change information of the gaze area according to the area image information.

[0117] 205. If the gaze point movement trend information represents that the gaze point is concentrated in a first position area, the first position area is used as the target object of attention in the display screen; or, if the gaze area change information represents that the gaze point is concentrated in a target image content, the target image content is used as the target object of attention in the display screen.

[0118] 206. Determine a focal plane where the target object is located.

[0119] 207. Determine relative depth information between the focal plane and other photographed objects in the display area.

[0120] 208. Divide a display area of ​​the display screen into at least two partitions according to the relative depth information.

[0121] 209. Perform differentiated anti-shake processing on each of the at least two partitions to obtain at least two processed partitions, wherein each of the at least two partitions corresponds to a different anti-shake processing parameter.

[0122] The specific implementation process of the above steps 201-209 can refer to the corresponding description in steps 101-104, which will not be repeated here.

[0123] It can be seen that in the embodiment of the present application, the gaze point information of the display screen is obtained through the eye tracking module; the regional image information of the gaze area where the gaze point is located is obtained according to the gaze point information; the information on the movement of the gaze point over time is analyzed according to the gaze point information to obtain the gaze point movement trend information; the gaze area change information of the gaze area is analyzed according to the regional image information; if the gaze point movement trend information represents that the gaze point is concentrated in the first position area, the first position area is used as the target object of interest in the display screen; or, if the gaze area change information represents that the gaze point is concentrated on the target image content, the target image content is used as the target object of interest in the display screen, and the focal plane where the target object is located is determined; the relative depth information between the focal plane and other photographed objects in the display area is determined; the display area of ​​the display screen is divided into at least two partitions according to the relative depth information, and each of the at least two partitions is subjected to differentiated anti-shake processing. In this way, different anti-shake processing parameters can be used to perform differentiated anti-shake processing on each partition, thereby improving the anti-shake processing efficiency while ensuring the anti-shake processing effect in key areas.

[0124] The following is a device for implementing the above-mentioned shooting anti-shake method, specifically as follows:

[0125] Consistent with the above, see Figure 3 , Figure 33 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application, the electronic device includes: a processor 310, a communication interface 330 and a memory 320; and also includes an eye tracking module 340, a display screen 350, and one or more programs 321, the one or more programs 321 are stored in the memory 320 and are configured to be executed by the processor, and the program 321 includes instructions for executing the following steps:

[0126] Acquiring gaze point information of the display screen through the eye tracking module;

[0127] Acquire regional image information of a gaze area where the gaze point is located according to the gaze point information;

[0128] Analyzing a target object of interest in the display screen according to the gaze point information and the regional image information; dividing a display area of ​​the display screen into at least two partitions according to the target object;

[0129] Differentiated anti-shake processing is performed on each of the at least two partitions to obtain at least two processed partitions, wherein each of the at least two partitions corresponds to a different anti-shake processing parameter.

[0130] In a possible example, the gaze point information includes at least one gaze point position and at least one gaze duration corresponding to the at least one gaze point position. In acquiring regional image information of a gaze area where a gaze point is located according to the gaze point information, the program 321 includes instructions for performing the following steps:

[0131] Determine the position of the target gaze point whose gaze duration is longer than the preset duration;

[0132] Determine a first range area around the target gaze point position as the gaze area; or; determine a contour enclosed area of ​​the gaze object corresponding to the target gaze point position as the gaze area;

[0133] The image information of the gaze area is extracted to obtain the area image information.

[0134] In a possible example, in analyzing the target object of interest in the display screen according to the gaze point information and the regional image information, the program 321 includes instructions for performing the following steps:

[0135] Analyze the information of the movement of the gaze point over time according to the gaze point information to obtain the gaze point movement trend information;

[0136] analyzing the gaze area change information of the gaze area according to the area image information;

[0137] If the gaze point movement trend information represents that the gaze point is concentrated in a first position area, the first position area is used as the target object of attention in the display screen; or, if the gaze area change information represents that the gaze point is concentrated in a target image content, the target image content is used as the target object of attention in the display screen.

[0138] In a possible example, in analyzing the gaze area change information of the gaze area according to the regional image information, the program 321 further includes instructions for performing the following steps:

[0139] Extracting features from the regional image information to obtain regional image features;

[0140] Inputting the regional image features into a feature training model for training to obtain feature information of the gaze area;

[0141] Information about changes of image content in the gaze area with the gaze point is analyzed according to the feature information of the gaze area to obtain gaze area change information.

[0142] In a possible example, in the aspect of dividing the display area of ​​the display screen into at least two partitions according to the target object, the program 321 includes instructions for executing the following steps:

[0143] Determining a focal plane of the target object;

[0144] Determining relative depth information between the focal plane and other photographed objects in the display area;

[0145] The display area of ​​the display screen is divided into at least two partitions according to the relative depth information.

[0146] In a possible example, the at least two partitions include a first partition where the target object is located, and after performing differential anti-shake processing on each of the at least two partitions to obtain at least two processed partitions, the program 321 further includes instructions for performing the following steps:

[0147] Acquire the at least one historical cache area image;

[0148] Performing image synthesis on the first partition and the at least one historical cache area image to obtain a synthesized first partition;

[0149] The synthesized first partition and other partitions of the at least two partitions are displayed on the display screen.

[0150] In a possible example, after analyzing the target object of interest in the display screen according to the gaze point information and the regional image information, the program 321 further includes instructions for executing the following steps:

[0151] Segmenting an image region where the target object is located in at least one historical frame to obtain at least one historical cache region image;

[0152] The at least one historical cache area image is stored in a cache area in a memory.

[0153] In a possible example, in the aspect of synthesizing the first partition with the at least one historical cache area image to obtain the synthesized first partition, the program 321 includes instructions for performing the following steps:

[0154] Dividing the first partition and the at least one historical cache area image into two or more sub-unit areas according to image features of the first partition;

[0155] The sub-unit region image corresponding to each of the two or more sub-unit regions in the first partition and at least one sub-unit region image corresponding to the at least one historical cache region image are synthesized to obtain a synthesized first partition.

[0156] See also Figure 4 , Figure 4 4 is a schematic diagram of the structure of a shooting anti-shake device provided in this embodiment. The shooting anti-shake device 400 is applied to an electronic device, and the electronic device includes an eye tracking module and a display screen. The device 400 includes an acquisition unit 401, an analysis unit 402, a division unit 403 and a processing unit 404, wherein:

[0157] The acquisition unit 401 is used to acquire the gaze point information of the display screen through the eye tracking module;

[0158] The acquisition unit 401 is further configured to acquire regional image information of a gaze area where a gaze point is located according to the gaze point information;

[0159] An analyzing unit 402, configured to analyze a target object of interest in the display screen according to the gaze point information and the regional image information;

[0160] A division unit 403, configured to divide the display area of ​​the display screen into at least two partitions according to the target object;

[0161] The processing unit 404 is configured to perform differentiated anti-shake processing on each of the at least two partitions to obtain at least two partitions after processing, wherein each of the at least two partitions corresponds to a different anti-shake processing parameter.

[0162] Optionally, the gaze point information includes at least one gaze point position and at least one gaze duration corresponding to the at least one gaze point position. In acquiring regional image information of a gaze area where the gaze point is located according to the gaze point information, the acquiring unit 401 is specifically configured to:

[0163] Determine the position of the target gaze point whose gaze duration is longer than the preset duration;

[0164] Determine a first range area around the target gaze point position as the gaze area; or; determine a contour enclosed area of ​​the gaze object corresponding to the target gaze point position as the gaze area;

[0165] The image information of the gaze area is extracted to obtain the area image information.

[0166] Optionally, in the aspect of analyzing the focused target object in the display screen according to the gaze point information and the regional image information, the analyzing unit 402 is specifically configured to:

[0167] Analyze the information of the movement of the gaze point over time according to the gaze point information to obtain the gaze point movement trend information;

[0168] analyzing the gaze area change information of the gaze area according to the area image information;

[0169] If the gaze point movement trend information represents that the gaze point is concentrated in a first position area, the first position area is used as the target object of attention in the display screen; or, if the gaze area change information represents that the gaze point is concentrated in a target image content, the target image content is used as the target object of attention in the display screen.

[0170] Optionally, in analyzing the gaze area change information of the gaze area according to the regional image information, the analyzing unit 402 is specifically configured to:

[0171] Extracting features from the regional image information to obtain regional image features;

[0172] Inputting the regional image features into a feature training model for training to obtain feature information of the gaze area;

[0173] Information about changes of image content in the gaze area with the gaze point is analyzed according to the feature information of the gaze area to obtain gaze area change information.

[0174] Optionally, in the aspect of dividing the display area of ​​the display screen into at least two partitions according to the target object, the dividing unit 403 is specifically configured to:

[0175] Determining a focal plane of the target object;

[0176] Determining relative depth information between the focal plane and other photographed objects in the display area;

[0177] The display area of ​​the display screen is divided into at least two partitions according to the relative depth information.

[0178] Optionally, the at least two partitions include a first partition where the target object is located, and after performing differential anti-shake processing on each of the at least two partitions to obtain at least two processed partitions, the processing unit 404 is further configured to:

[0179] Acquire the at least one historical cache area image;

[0180] Performing image synthesis on the first partition and the at least one historical cache area image to obtain a synthesized first partition;

[0181] The synthesized first partition and other partitions of the at least two partitions are displayed on the display screen.

[0182] Optionally, after analyzing the focused target object in the display screen according to the gaze point information and the regional image information, the processing unit 404 is further configured to:

[0183] Segmenting an image region where the target object is located in at least one historical frame to obtain at least one historical cache region image;

[0184] The at least one historical cache area image is stored in a cache area in a memory.

[0185] Optionally, in the aspect of synthesizing the first partition with the at least one historical cache area image to obtain the synthesized first partition, the processing unit 404 is specifically configured to:

[0186] Dividing the first partition and the at least one historical cache area image into two or more sub-unit areas according to image features of the first partition;

[0187] The sub-unit region image corresponding to each of the two or more sub-unit regions in the first partition and at least one sub-unit region image corresponding to the at least one historical cache region image are synthesized to obtain a synthesized first partition.

[0188] It can be seen that the shooting anti-shake device described in the embodiment of the present application obtains the gaze point information of the display screen through the eye tracking module; obtains the regional image information of the gaze area where the gaze point is located according to the gaze point information; analyzes the target object of focus in the display screen according to the gaze point information and the regional image information; divides the display area of ​​the display screen into at least two partitions according to the target object; performs differentiated anti-shake processing on each of the at least two partitions to obtain at least two partitions after processing, wherein each of the at least two partitions corresponds to different anti-shake processing parameters. In this way, the display area of ​​the display screen can be differentially anti-shake processed based on the eye tracking technology, and the anti-shake processing efficiency is improved while ensuring the image quality of the target object, thereby achieving low-power consumption and high-quality anti-shake shooting.

[0189] It can be understood that the functions of each program module of the shooting anti-shake device of this embodiment can be specifically implemented according to the method in the above method embodiment. The specific implementation process can refer to the relevant description of the above method embodiment, which will not be repeated here.

[0190] An embodiment of the present application also provides a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, wherein the computer program enables a computer to execute part or all of the steps of any method described in the above method embodiments, and the above computer includes an electronic device.

[0191] The embodiment of the present application also provides a computer program product, the computer program product includes a non-transitory computer-readable storage medium storing a computer program, the computer program is operable to cause a computer to execute some or all of the steps of any method described in the method embodiment. The computer program product may be a software installation package, and the computer includes an electronic device.

[0192] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0193] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0194] In the several embodiments provided in the present application, it should be understood that the disclosed device can be implemented in other ways. For example, the device embodiments described above are only schematic, such as the division of the above-mentioned units, which is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, and the indirect coupling or communication connection of devices or units can be electrical or other forms.

[0195] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0196] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0197] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a memory, including a number of instructions to enable a computer device (which can be a personal computer, server or network device, etc.) to perform all or part of the steps of the above-mentioned methods of each embodiment of the present application. The aforementioned memory includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, disk or CD-ROM and other media that can store program codes.

[0198] A person skilled in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable memory, and the memory can include: a flash drive, a read-only memory (English: Read-Only Memory, abbreviated as: ROM), a random access memory (English: Random Access Memory, abbreviated as: RAM), a magnetic disk or an optical disk, etc.

[0199] The embodiments of the present application are introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method and core idea of ​​the present application. At the same time, for general technical personnel in this field, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A shooting anti-shake method, characterized in that: Applied to an electronic device, the electronic device includes an eye tracking module and a display screen, and the method includes: The eye tracking module obtains the gaze point information on which the display screen is being watched; The area image information of the gaze area where the gaze point is located is obtained based on the gaze point information; Analyze the target object to be concerned in the display screen based on the gaze point information and the area image information, including: Based on the gaze point information, the information on the movement of the gaze point over time is analyzed to obtain the gaze point motion trend information; Analyze the gaze area change information of the gaze area based on the area image information; If the gaze point movement trend information indicates that the gaze point is concentrated in a first position area, the first position area is used as the target object of interest in the display screen; or, if the gaze area change information indicates that the gaze point is concentrated in a target image content, the target image content is used as the target object of interest in the display screen; According to the target object, the display area of ​​the display screen is divided into at least two partitions, including: Determine the distance between the target object and the camera of the electronic device in the shooting direction; Determine that the imaging plane parallel to the camera and passing through the target object is the focal plane; Determine the first depth of field corresponding to the focal plane where the target object is located; Determine the second depth of field of other subjects in the display area; Determine the relative depth information of the target object relative to the other photographed subject based on the first depth of field and the second depth of field; According to the relative depth information, the display area of ​​the display screen is divided into at least two partitions; Performing differentiated anti-shake processing on each of the at least two partitions to obtain at least two processed partitions, wherein each of the at least two partitions corresponds to a different anti-shake processing parameter, and the at least two partitions include a first partition where the target object is located; Obtain the at least one historical cache area image; The first partition and the at least one historical cache area image are synthesized to obtain the synthesized first partition; The synthesized first partition and other partitions of the at least two partitions are displayed on the display screen, wherein the historical cached area image refers to an area image obtained by pre-extracting the image content of the target object in the historical frame and caching it.

2. The method according to claim 1, characterized in that: The gaze point information includes at least one gaze point position and at least one gaze duration corresponding to the at least one gaze point position, and acquiring regional image information of a gaze area where the gaze point is located according to the gaze point information includes: Determine the position of the target gaze point whose gaze time is greater than the preset time; It is determined that the first range area around the target gaze position is a gaze area; or it is determined that the contour surrounding area of ​​the gaze object corresponding to the target gaze position is a gaze area; Image information of the gaze area is extracted to obtain the area image information.

3. The method according to claim 1 or 2, characterized in that: The gaze area change information of the gaze area according to the area image information, including: Feature extraction is performed on the area image information to obtain area image features; The area image feature input feature training model is trained to obtain feature information of the gaze area; According to the characteristic information of the gaze area, the information on the image content in the gaze area changes with the gaze point is analyzed, and the gaze area change information is obtained.

4. The method according to claim 3, characterized in that After analyzing the target object to be concerned in the display screen based on the gaze point information and the area image information, the method further comprises: The image area where the target object is located in at least one history frame is segmented to obtain at least one history cache area image; The at least one historical cache area image is stored in a cache area in memory.

5. The method according to claim 3, characterized in that: The first partition and the at least one historical cache area image are synthesized to obtain the synthesized first partition, including: According to the image characteristics of the first partition, the first partition and the at least one historical cache area image are divided into two or more sub-unit areas; The sub-unit region image corresponding to each of the two or more sub-unit regions in the first partition and at least one sub-unit region image corresponding to the at least one historical cache region image are synthesized to obtain a synthesized first partition.

6. A shooting anti-shake device, characterized in that: Applied to an electronic device, the electronic device includes an eye tracking module and a display screen, and the device includes: A acquisition unit is used to obtain the gaze point information on which the display screen is being watched through the eye tracking module; The acquisition unit is also configured to acquire area image information of the gaze area where the gaze point is located based on the gaze point information; An analysis unit is used to analyze a target object to be concerned in the display screen based on the gaze point information and the area image information; the analysis unit is specifically used for: Based on the gaze point information, the information on the movement of the gaze point over time is analyzed to obtain the gaze point motion trend information; Analyze the gaze area change information of the gaze area based on the area image information; If the gaze point movement trend information indicates that the gaze point is concentrated in a first position area, the first position area is used as the target object of interest in the display screen; or, if the gaze area change information indicates that the gaze point is concentrated in a target image content, the target image content is used as the target object of interest in the display screen; The partitioning unit is used to divide the display area of ​​the display screen into at least two partitions according to the target object; the partitioning unit is specifically used for: Determine the distance between the target object and the camera of the electronic device in the shooting direction; Determine that the imaging plane parallel to the camera and passing through the target object is the focal plane; Determine the first depth of field corresponding to the focal plane where the target object is located; Determine the second depth of field of other subjects in the display area; Determine the relative depth information of the target object relative to the other photographed subject based on the first depth of field and the second depth of field; According to the relative depth information, the display area of ​​the display screen is divided into at least two partitions; a processing unit, configured to perform differentiated anti-shake processing on each of the at least two partitions to obtain at least two partitions after processing, wherein each of the at least two partitions corresponds to a different anti-shake processing parameter, and the at least two partitions include a first partition where the target object is located; The processing unit is also used for: Obtain the at least one historical cache area image; The first partition and the at least one historical cache area image are synthesized to obtain the synthesized first partition; The synthesized first partition and other partitions of the at least two partitions are displayed on the display screen, wherein the historical cached area image refers to an area image obtained by pre-extracting the image content of the target object in the historical frame and caching it.

7. An electronic device, characterized in that: The invention comprises an eye tracking module, a display screen, a processor, a memory, a communication interface, and one or more programs, wherein the memory is used to store one or more programs and is configured to be executed by the processor, wherein the program comprises instructions for executing the steps in the method according to any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that: The computer readable storage medium is used to store a computer program, wherein the computer program causes the computer to perform the method of any of claims 1-5.

Images