Picture frame insertion method and device, electronic equipment, storage medium and program product

Abstract

The invention discloses a picture frame insertion method and device, electronic equipment, a storage medium and a program product, and belongs to the technical field of electronics. The method comprises the steps that under the condition that a first picture is displayed, first track information is obtained, and the first track information represents a motion track of an object in the first picture; and determining whether to perform frame insertion operation after the first picture based on the track information.

Description

Technical Field

[0001] The present application belongs to the field of electronic technology, and specifically relates to a frame insertion method, device, electronic equipment, storage medium and program product. Background Art

[0002] With the development of technology, users have higher and higher requirements for the smoothness of game screens. When the game is running, the frame rate of the game (that is, the number of images displayed sequentially per second) directly affects the smoothness of the game screen. Electronic devices can use interpolation technology to increase the frame rate of the game to improve the smoothness of the game screen.

[0003] The currently commonly used interpolation technology is interpolation frame, that is, after rendering two consecutive frames of images, the two consecutive frames of images are cached, and an image processing algorithm is used to calculate the motion vector of the object between the two frames of images, and the image between the two frames of images is predicted and generated as an interpolation frame to fill the gap between the two frames of images and achieve an increase in frame rate.

[0004] However, the interpolated frame is generated by predicting two frames of images, and it takes extra time for the electronic device to predict, generate and display the newly generated frame, resulting in a delay in the picture display, that is, the time it takes for the picture to respond to user input becomes longer, resulting in a poor picture display effect. Summary of the invention

[0005] The purpose of the embodiments of the present application is to provide a method, device, electronic device, storage medium and program product for interpolating a picture, which can avoid the picture delay problem caused by interpolation and improve the display effect of the picture.

[0006] In a first aspect, an embodiment of the present application provides a method for interpolating a picture, the method comprising: when displaying a first picture, obtaining first trajectory information, the first trajectory information representing a motion trajectory of an object in the first picture; based on the trajectory information, determining whether to perform an interpolation operation after the first picture.

[0007] In a second aspect, an embodiment of the present application provides a frame insertion device, which includes: an acquisition module and a determination module. The acquisition module is used to acquire first trajectory information when displaying a first picture, and the first trajectory information represents the motion trajectory of an object in the first picture. The determination module is used to determine whether to perform a frame insertion operation after the first picture based on the first trajectory information acquired by the acquisition module.

[0008] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0009] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0010] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0011] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.

[0012] In an embodiment of the present application, when displaying the first picture, first trajectory information representing the motion trajectory of the object in the first picture can be obtained, and then based on the first trajectory information, it can be determined whether to perform an interpolation operation after the first picture. In this solution, the first trajectory information can be analyzed to identify the characteristics of the motion trajectory of the object in the picture, so as to determine whether an interpolation operation is required, that is, the degree of influence of the delay on the picture display effect can be known through the motion trajectory of the object in the picture, and then the decision whether to perform an interpolation operation is made based on this degree of influence, rather than directly performing an interpolation operation, so as to avoid the picture delay caused by directly performing an interpolation operation on the picture, thereby improving the picture display effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 This is one of the flow charts of the picture frame insertion method provided in the embodiment of the present application;

[0014] Figure 2 This is the second flowchart of the frame insertion method provided in the embodiment of the present application;

[0015] Figure 3 This is the third flowchart of the frame insertion method provided in the embodiment of the present application;

[0016] Figure 4 This is the fourth flowchart of the frame insertion method provided in the embodiment of the present application;

[0017] Figure 5 This is the fifth flowchart of the picture frame insertion method provided in the embodiment of the present application;

[0018] Figure 6 This is the sixth flowchart of the picture frame insertion method provided in the embodiment of the present application;

[0019] Figure 7 It is one of the schematic diagrams of the picture frame insertion device provided in the embodiment of the present application;

[0020] Figure 8 This is the second schematic diagram of the frame insertion device provided in the embodiment of the present application;

[0021] Fig. 9 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0022] Fig.10 It is a schematic diagram of the hardware structure of the electronic device provided in the embodiment of the present application. DETAILED DESCRIPTION

[0023] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0024] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0025] The terms "at least one (item)", "at least one of" and the like in this application refer to any one, any two or a combination of more than two of the objects included therein. For example, at least one (item) of a, b, and c can be represented by: "a", "b", "c", "a and b", "a and c", "b and c" and "a, b and c", where a, b, and c can be single or multiple. Similarly, "at least two (items)" refers to two or more, and its meaning is similar to that of "at least one (item)".

[0026] The following, in conjunction with the accompanying drawings, describes in detail the frame insertion method, device, electronic device, storage medium and program product provided in the embodiments of the present application through specific embodiments and their application scenarios.

[0027] The embodiments of the present application can be applied to a scenario where a user performs touch input on a screen displayed by an electronic device when the electronic device uses an interpolation function to increase the frame rate of the displayed screen. Specifically, when the electronic device displays any interactive screen, and the interactive screen uses an interpolation function to increase the frame rate, the user performs touch input on the interactive screen to change the interactive screen displayed by the electronic device. For example, the interactive screen may include, but is not limited to: a game screen, a desktop screen, a video screen, a virtual reality (VR) or augmented reality (AR) screen, etc.

[0028] For example, taking the game screen as an example, the electronic device displays the game screen of a racing game, and the racing game uses the interpolation function to improve the frame rate of the game. The display content in the screen includes the player's vehicle, road scenery, instrument panel, operation controls, etc. The user can touch the operation controls to change the display content of the player's vehicle, road scenery, instrument panel, etc.

[0029] The currently commonly used interpolation technology is interpolation frame, that is, based on two consecutive frames of rendered images, the image between the two frames is predicted and generated as an interpolation frame, and the interpolation frame is displayed between the two frames to achieve an increase in frame rate.

[0030] However, the interpolated frame is generated by predicting two frames of images, and it takes extra time for the electronic device to generate and display the interpolated frame, resulting in a delay in the picture display, that is, the time it takes for the picture to respond to user input becomes longer, so that the picture display effect is poor.

[0031] The embodiments of the present application provide a picture interpolation method, device, electronic device, storage medium and program product. The electronic device can analyze the first trajectory information to identify the characteristics of the motion trajectory of the object in the picture, so as to determine whether an interpolation operation is needed. That is, the electronic device can know the degree of influence of the delay on the picture display effect through the motion trajectory of the object in the picture, and thus decide whether to perform an interpolation operation based on the degree of influence, instead of directly performing an interpolation operation, so as to avoid picture delay caused by directly performing an interpolation operation on the picture, thereby improving the display effect of the picture.

[0032] The execution subject of the frame interpolation method provided in the embodiment of the present application may be a frame interpolation device, which may be an electronic device, or a functional module or functional entity in an electronic device. The technical solution provided in the embodiment of the present application is described below using an electronic device as an example.

[0033] Figure 1 A flowchart of a method for interpolating frames provided in an embodiment of the present application is shown. Figure 1As shown, the frame insertion method provided in the embodiment of the present application may include the following steps 201 to 202.

[0034] Step 201: When displaying a first picture, the electronic device obtains first trajectory information.

[0035] In the embodiment of the present application, the first trajectory information represents the motion trajectory of the object in the first picture.

[0036] Optionally, in an embodiment of the present application, the above-mentioned first screen may include but is not limited to any of the following: a game screen, a desktop screen, a video screen, a virtual reality (VR) or augmented reality (AR) screen, etc.

[0037] Optionally, in an embodiment of the present application, the first trajectory information can be obtained through a touch trajectory of a touch event generated by a first input of the user to the first screen, that is, the electronic device can analyze the user's touch trajectory to determine the first trajectory information based on the touch information of the touch trajectory.

[0038] Optionally, in the embodiment of the present application, the user's first input may be a touch input such as a click input, a long press input, a sliding input, etc. on the first screen.

[0039] For example, taking the game screen as an example, the electronic device displays the game screen of a racing game. The displayed content in the screen includes the player's vehicle, road scenery, instrument panel, operation controls, etc. The user can slide the operation control to the left to make the player's vehicle drive to the left, and the displayed content such as the road scenery and instrument panel will change.

[0040] It can be understood that the above touch information represents the touch trajectory of the first input performed by the user on the first screen, such as short press, long press, slide to the left, slide to the right, slide up, slide down, etc.

[0041] It should be noted that the touch screen of the electronic device adopts a high-frequency detection mechanism to continuously monitor the contact state of the screen surface. The detection frequency of the touch screen, that is, the sampling period of the touch screen, refers to the number of times (for example, 100 times) that the touch screen hardware performs touch detection on the screen within a unit time (usually 1s). The high-frequency detection ensures the instant and continuous capture of the touch action. In the embodiment of the present application, when the user performs the first input on the first screen, the first input is not completed instantaneously, but consists of a series of continuous and directional touch actions. The high-frequency sampling characteristics of the touch screen enable the electronic device to capture every slight change of the first input, and record the coordinate information of each touch point in the touch track at each detection, including the starting touch point, multiple points in the middle of the process, and the end touch point. The touch track in the embodiment of the present application is actually connected by these continuously detected touch points, wherein each detected touch point represents a point on the touch track in the form of coordinates, which together constitute the complete path of the user's operation.

[0042] For example, taking the detection frequency of the touch screen of the electronic device as 100 Hz (ie, 100 times per second), when the duration of the first input is 2 seconds, the touch screen can detect 200 touch points and record the coordinate information of each touch point.

[0043] Optionally, in the embodiment of the present application, combined with Figure 1 ,like Figure 2 As shown, the "obtaining first trajectory information" in the above step 201 can be implemented through the following steps 201a and 201b.

[0044] Step 201a: When a first picture is displayed and a touch event on the first picture is detected, the electronic device obtains second track information.

[0045] In the embodiment of the present application, the second trajectory information represents the touch trajectory corresponding to the touch event in the first picture.

[0046] Optionally, in the embodiment of the present application, the electronic device may determine the second trajectory information by acquiring the starting point coordinate information and the ending point coordinate information corresponding to the touch event.

[0047] Optionally, in an embodiment of the present application, the starting point coordinate information and the ending point coordinate information corresponding to the above touch event may be coordinate information of two adjacent touch points continuously detected by the electronic device when the user performs the first input.

[0048] For example, the touch screen detects 200 touch points of the first input, where the starting point coordinate information can be the coordinate information of the first touch point, and the end point coordinate information can be the coordinate information of the second touch point, or the starting point coordinate information can be the coordinate information of the second touch point, and the end point coordinate information can be the coordinate information of the third touch point. And so on, until the starting point coordinate information is the coordinate information of the 199th touch point, and the end point coordinate information is the coordinate information of the 200th touch point, for a total of 199 cases.

[0049] Step 201b: The electronic device determines first track information based on the starting point coordinate information and the ending point coordinate information of the touch track.

[0050] In the embodiment of the present application, the first trajectory information includes a movement direction.

[0051] Optionally, in the embodiment of the present application, the above-mentioned trajectory information includes the direction of movement. Figure 1 ,like Figure 3 As shown, the above step 201b can be implemented through the following step 201b1 or step 201b2.

[0052] Step 201b1: The electronic device determines the direction of movement based on the difference between the starting point coordinate information and the end point coordinate information.

[0053] Optionally, in the embodiment of the present application, the above-mentioned difference includes at least one of the following: a difference between the horizontal coordinate information of the starting point and the horizontal coordinate information of the end point, and a difference between the vertical coordinate information of the starting point and the vertical coordinate information of the end point.

[0054] Optionally, in an embodiment of the present application, the electronic device can determine the sliding direction of the touch event by comparing the difference between the horizontal coordinate information of the starting point and the horizontal coordinate information of the end point, and the difference between the vertical coordinate information of the starting point and the vertical coordinate information of the end point with a threshold value N, and use the direction as the movement direction of the first trajectory information. Among them, N is used to distinguish between small touch sliding and clear direction sliding, and can be adjusted according to the sensitivity of the specific application and device. This method combines the judgment of horizontal movement, vertical movement and oblique movement, and can be applied to game engines or other applications that require precise touch direction. Specifically:

[0055] (1) When the difference between the horizontal coordinates of the touch end point coordinates and the touch start point coordinates is less than a negative number of N, and the absolute value of the difference between the vertical coordinates of the touch end point coordinates and the touch start point coordinates is less than or equal to N, the sliding direction is determined to be leftward;

[0056] (2) when the difference between the horizontal coordinates of the touch end point coordinates and the touch start point coordinates is greater than N, and the absolute value of the difference between the vertical coordinates of the touch end point coordinates and the touch start point coordinates is less than or equal to N, the sliding direction is determined to be rightward;

[0057] (3) when the absolute value of the difference between the horizontal coordinates of the touch end point coordinates and the touch start point coordinates is less than or equal to N, and the difference between the vertical coordinates of the touch end point coordinates and the touch start point coordinates is less than the negative of N, the sliding direction is determined to be upward;

[0058] (4) when the absolute value of the difference between the horizontal coordinates of the touch end point coordinates and the touch start point coordinates is less than or equal to the negative number of N, and the difference between the vertical coordinates of the touch end point coordinates and the touch start point coordinates is greater than N, the sliding direction is determined to be downward;

[0059] (5) When the difference between the horizontal coordinates of the touch end point coordinates and the touch start point coordinates is less than a negative number of N, and the difference between the vertical coordinates of the touch end point coordinates and the touch start point coordinates is less than a negative number of N, the sliding direction is determined to be the upper left;

[0060] (6) When the difference between the horizontal coordinates of the touch end point coordinates and the touch start point coordinates is less than the negative number of N, and the absolute value of the difference between the vertical coordinates of the touch end point coordinates and the touch start point coordinates is greater than N, the sliding direction is determined to be the lower left;

[0061] (7) When the difference between the horizontal coordinates of the touch end point coordinates and the touch start point coordinates is greater than N, and the absolute value of the difference between the vertical coordinates of the touch end point coordinates and the touch start point coordinates is less than the negative of N, the sliding direction is determined to be the upper right;

[0062] (8) When the difference between the horizontal coordinates of the touch end point coordinates and the touch start point coordinates is greater than N, and the absolute value of the difference between the vertical coordinates of the touch end point coordinates and the touch start point coordinates is greater than N, the sliding direction is determined to be lower right.

[0063] For example, taking N as 30, when the starting point coordinate information is (100, 150) and the end point coordinate information is (60, 150), the difference between the horizontal coordinates of the end point coordinate information and the starting point coordinate information is 60-100=-40, which is less than the negative number of N, that is, -30, and the difference between the vertical coordinates of the end point coordinate information and the starting point coordinate information is 150-150=0, and the absolute value of the difference is 0, which is less than N, then the electronic device can determine that the sliding direction is to the left;

[0064] When the starting point coordinate information is (100, 150) and the end point coordinate information is (140, 150), the difference between the horizontal coordinates of the end point coordinate information and the starting point coordinate information is 140-100=40, which is greater than N, that is, 30; the difference between the vertical coordinates of the end point coordinate information and the starting point coordinate information is 150-150=0, and the absolute value of the difference is 0, which is less than N, so the electronic device can determine that the sliding direction is rightward;

[0065] When the starting point coordinate information is (150, 150) and the end point coordinate information is (150, 90), the difference between the horizontal coordinates of the end point coordinate information and the starting point coordinate information is 150-150=0, and the absolute value of the difference is 0, which is less than N; the difference between the vertical coordinates of the end point coordinate information and the starting point coordinate information is 90-150=-60, which is less than the negative number of N, that is, -30, and the electronic device can determine that the sliding direction is upward;

[0066] When the starting point coordinate information is (150, 150) and the end point coordinate information is (150, 190), the difference between the horizontal coordinates of the end point coordinate information and the starting point coordinate information is 150-150=0, and the absolute value of the difference is 0, which is less than N; the difference between the vertical coordinates of the end point coordinate information and the starting point coordinate information is 190-150=40, which is greater than N, that is, 30, and the electronic device can determine that the sliding direction is downward;

[0067] When the starting point coordinate information is (200, 200) and the end point coordinate information is (150, 150), the difference between the horizontal coordinates of the end point coordinate information and the starting point coordinate information is 150-200=-50, which is less than the negative number of N, that is, -30; the difference between the vertical coordinates of the end point coordinate information and the starting point coordinate information is 150-200=-50, which is less than the negative number of N, that is, -30, then the electronic device can determine that the sliding direction is the upper left;

[0068] When the starting point coordinate information is (200, 200) and the end point coordinate information is (150, 250), the difference between the horizontal coordinates of the end point coordinate information and the starting point coordinate information is 150-200=-50, which is less than the negative number of N, that is, -30; the difference between the vertical coordinates of the end point coordinate information and the starting point coordinate information is 250-200=50, which is greater than N, that is, 30, and the electronic device can determine that the sliding direction is the lower left;

[0069] When the starting point coordinate information is (200, 200) and the end point coordinate information is (250, 150), the difference between the horizontal coordinates of the end point coordinate information and the starting point coordinate information is 250-200=50, which is greater than N, that is, 30; the difference between the vertical coordinates of the end point coordinate information and the starting point coordinate information is 150-200=-50, which is less than the negative number of N, that is, -30, then the electronic device can determine that the sliding direction is the upper right;

[0070] When the starting point coordinate information is (200, 200) and the end point coordinate information is (250, 250), the difference between the horizontal coordinates of the end point coordinate information and the starting point coordinate information is 250-200=50, which is greater than N, that is, 30; the difference between the vertical coordinates of the end point coordinate information and the starting point coordinate information is 250-200=50, which is greater than N, that is, 30, then the electronic device can determine that the sliding direction is the lower right. In this way, the electronic device can accurately determine the sliding direction through the starting point coordinate information and the end point coordinate information corresponding to the touch event, and use it as the movement direction of the first trajectory information.

[0071] Step 201b2: The electronic device determines a first angle value based on the starting point coordinate information and the end point coordinate information, and determines a moving direction based on the first angle value.

[0072] In the embodiment of the present application, the first angle value is the angle value between the first vector and the first direction, and the first direction is the horizontal axis direction corresponding to the starting point coordinate information or the end point coordinate information.

[0073] In the embodiment of the present application, the electronic device may obtain the starting point coordinate information and the ending point coordinate information corresponding to the touch event, and then the electronic device may determine the first vector based on the starting point coordinate information and the ending point coordinate information.

[0074] Optionally, in the embodiment of the present application, the electronic device can determine the first vector by the difference between the abscissa information of the end point and the abscissa information of the start point, and the difference between the ordinate information of the end point and the ordinate information of the start point. The first vector is represented by ΔP, and its mathematical expression is as follows:

[0075] ΔP=(x 2 -x 1 ,y 2 -y 1 ) Formula (1)

[0076] Among them, x 2 Indicates the end point horizontal coordinate information, x 1 , represents the horizontal coordinate information of the starting point, y 2 Indicates the vertical coordinate information of the end point, y 1 Indicates the vertical coordinate information of the starting point.

[0077] For example, taking the starting point coordinate information as (100, 150) and the end point coordinate information as (120, 160), the first vector is: ΔP=(120-100, 160-150)=(20, 10).

[0078] It should be noted that the above vector is used to represent a direction, that is, the sliding direction of the touch event, and the value in the vector represents the movement distance of the touch event. For example, when ΔP is (20,10), the actual meaning of ΔP is that the touch position of the user on the touch screen moves 20 units (such as pixels) in the positive direction of the horizontal axis and 10 units in the positive direction of the vertical axis in the coordinate axis corresponding to the starting point coordinate information or the end point coordinate information.

[0079] In the embodiment of the present application, the electronic device can use the angle (i.e., the first angle value) between the vector and the positive direction of the horizontal axis in the coordinate axis corresponding to the starting point coordinate information or the end point coordinate information to represent the user's sliding direction and use it as the movement direction of the first trajectory information. The first angle value is represented by θ, which can be calculated by the angle between the first vector and the unit vector i=(1,0) in the positive direction of the horizontal axis. The mathematical expression of the vector angle formula is as follows:

[0080] θ=atan2(ΔP y -ΔP x ) Formula (2)

[0081] Where ΔP y Represents the ordinate information of the first vector, ΔP x Indicates the horizontal coordinate information of the first vector. atan2 is a special inverse tangent function that can calculate the angle between the ray from the origin (0,0) to the point (x,y) and the positive direction of the horizontal axis. The calculation result range is (-π,π]. When the result is a positive value, it is expressed as a clockwise direction, and when the result is a positive value, it is expressed as a counterclockwise direction.

[0082] Exemplarily, taking the first vector as (20, 10) as an example, the electronic device can substitute the ordinate information 10 and the abscissa information 20 of the first vector into the vector angle formula to calculate that the first angle value is approximately 26.57°, that is, approximately 0.147π.

[0083] In this way, the electronic device can accurately determine the angle between the sliding direction and the horizontal axis direction corresponding to the starting point coordinate information or the ending point coordinate information according to the starting point coordinate information and the ending point coordinate information corresponding to the touch event as the movement direction.

[0084] Step 202: The electronic device determines whether to perform a frame insertion operation after the first frame based on the first trajectory information.

[0085] In the embodiment of the present application, the electronic device can first determine the change of the screen during the touch input process based on the trajectory information, so as to determine whether to perform the interpolation operation after the first screen according to the degree of influence of the delay on the screen display effect. Generally, the smaller the change in the motion angle or the motion speed of the first trajectory information, the simpler and easier to predict the motion trajectory of the content in the screen. In these cases, the interpolated frames generated can better match the actual motion trajectory, and the user sees a coherent and consistent motion trajectory in the screen, and it is difficult to detect the existence of a small delay. The greater the change in the motion angle or the motion speed of the first trajectory information, the more complex and difficult to predict the motion trajectory of the content in the screen. In these cases, the interpolated frames generated may deviate from the actual motion trajectory, and the user sees an incoherent and fragmented motion trajectory in the screen, making the small delay easy to be detected by the user. Therefore, in the embodiment of the present application, the electronic device may not perform the interpolation operation after the first screen to avoid the delay caused by interpolating the screen when the motion angle or the motion speed of the first trajectory information changes greatly, thereby improving the display effect of the screen.

[0086] Optionally, in the embodiment of the present application, combined with Figure 1 ,like Figure 4 As shown, the above step 202 can be implemented by the following step 202a or step 202b.

[0087] Step 202a: When the change in the motion trajectory satisfies the first condition, the electronic device does not perform a frame insertion operation after the first picture.

[0088] Optionally, in the embodiment of the present application, the first trajectory information includes at least one of the following: movement direction, movement speed. The first condition includes at least one of the following: the movement direction changes, and the change in movement speed is greater than or equal to a first threshold.

[0089] Optionally, in the embodiment of the present application, the first threshold may be a default value of the electronic device or a preset value by the user. For example, the first threshold may be 10 units per second. The specific value may be determined according to actual usage requirements and is not limited in the embodiment of the present application.

[0090] Optionally, in an embodiment of the present application, when the above-mentioned first trajectory information includes the direction of movement, the electronic device can determine the sliding direction based on the starting point coordinate information and the end point coordinate information corresponding to the touch event and use it as the direction of movement. The direction of movement can be a general direction, such as left, right, up, down, upper left, lower left, upper right, lower right, or a specific angle value between the first vector and the positive direction of the horizontal axis, such as 45°, 90°, π, etc.

[0091] Optionally, in an embodiment of the present application, the electronic device can calculate the movement direction between every two adjacent touch points, so that the electronic device can combine the last movement direction with the movement direction determined this time to determine whether the movement direction has changed.

[0092] Optionally, in an embodiment of the present application, when the above-mentioned movement direction is a rough direction, the electronic device can determine whether the previous movement direction is the same as the current movement direction, thereby determining that the movement direction has changed if the previous movement direction is different from the current movement direction.

[0093] For example, taking N as 30, assuming that the coordinate information of the first touch point is (100, 150), the coordinate information of the second touch point is (60, 150), and the coordinate information of the third touch point is (100, 150). The difference between the horizontal coordinates of the first touch point and the second touch point is 60-100=-40, which is less than the negative number of N, that is, less than -30. The difference between the vertical coordinates of the first touch point and the second touch point is 150-150=0. The absolute value of the difference is 0, which is less than N. Then the electronic device can determine that the first movement direction is to the left. The difference between the horizontal coordinates of the second touch point and the third touch point is 100-60=40, which is greater than N, that is, greater than 30. The difference between the vertical coordinates of the second touch point and the third touch point is 150-150=0. The absolute value of the difference is 0, which is less than N. The electronic device can determine that the second movement direction is to the right, which is different from the first movement direction to the left, so the electronic device can determine that the movement direction has changed.

[0094] Optionally, in an embodiment of the present application, when the above-mentioned movement direction is a specific angle value between the first vector and the positive direction of the horizontal axis, the electronic device can determine whether the difference between the previous angle value and the current angle value is greater than or equal to M (for example, 45° or 0.25π), thereby determining that the movement direction has changed when the previous movement is different from the current movement direction.

[0095] For example, taking M as 45°, assuming that the coordinate information of the first touch point is (100, 150), the coordinate information of the second touch point is (120, 160), and the coordinate information of the third touch point is (100, 150). The electronic device can calculate the first vector as ΔP = (120-100, 160-150) = (20, 10) based on the coordinate information of the first touch point and the coordinate information of the second touch point, and then the electronic device can substitute the ordinate information 10 and the abscissa information 20 of the first vector into the vector angle formula, and calculate that the first angle value is approximately 26.57°, that is, approximately 0.147π. Then, the electronic device can calculate the first vector as ΔP=(100-120, 150-160)=(-20, -10) based on the coordinate information of the second touch point and the coordinate information of the third touch point. Then, the electronic device can substitute the ordinate information -10 and the abscissa information -20 of the second vector into the vector angle formula to calculate the first angle value to be approximately 203.43°, which is approximately 1.1π. However, considering the angle conversion to ensure that the angle range is between -π and π, the actual first angle value is approximately (203.43°-360°)=-156.57°, which is approximately -0.87π. According to the above two calculation results, the difference between the two sliding vector angles is 26.57°-(-156.57°)=176.86°. Because 176.86° is much greater than 45°, the electronic device determines that the direction of movement has changed.

[0096] Optionally, the electronic device may represent the sliding speed between two adjacent touch points with S and the sliding time between two adjacent touch points with T according to the difference between the abscissa information of the end point and the abscissa information of the start point, and the difference between the ordinate information of the end point and the ordinate information of the start point, and the mathematical expression thereof is the following formula (3):

[0097]

[0098] Among them, x 2 Indicates the end point horizontal coordinate information, x 1 , represents the horizontal coordinate information of the starting point, y 2 Indicates the vertical coordinate information of the end point, y 1 Indicates the vertical coordinate information of the starting point.

[0099] Optionally, in an embodiment of the present application, the electronic device can calculate the sliding speed between every two adjacent touch points and use it as the movement speed, so that the electronic device can determine whether the change between the last movement speed and the movement speed determined this time is greater than or equal to a first threshold value, thereby determining that the movement speed has changed when the change between the last movement speed and the current movement speed is greater than the first threshold value.

[0100] Exemplarily, taking the sliding time of 0.01 seconds and the first threshold of 10 units per second as an example, assuming that the coordinate information of the first touch point is (100, 150), the coordinate information of the second touch point is (140, 150), and the coordinate information of the third touch point is (180, 170). The electronic device can calculate the movement speed between the first touch point and the second touch point as 4000 units per second based on the coordinate information of the first touch point and the coordinate information of the second touch point. Then the electronic device can calculate the movement speed between the second touch point and the third touch point as 4472 units per second based on the coordinate information of the second touch point and the coordinate information of the third touch point. According to the above two calculation results, the difference between the two sliding speeds is 4472-4000=472 units per second, which is much greater than 10 units per second, so the electronic device can determine that the movement speed has changed.

[0101] Step 202b: When the change of the motion trajectory does not satisfy the first condition, the electronic device performs a frame insertion operation after the first picture.

[0102] Optionally, in an embodiment of the present application, when the change in the motion trajectory represented by the first trajectory information does not satisfy the first condition, if the interpolation function of the game application is turned on, the electronic device can continue to perform the interpolation operation after the first screen, or, if the interpolation function of the game is turned off, the electronic device can turn on the interpolation function after the first screen.

[0103] In this way, the electronic device can determine whether an interpolation operation is needed based on the direction of movement or the speed of movement, so that no interpolation operation is performed when the direction of movement suddenly changes or the speed of movement suddenly accelerates. The electronic device can thus improve the response speed of the picture when the direction or speed changes suddenly, avoid unnatural acceleration or turning effects on the display of the game application, and thus improve the display effect of the display of the game application.

[0104] Optionally, in the embodiment of the present application, the electronic device can learn the user's operating habits and predict the motion trajectory by integrating a machine learning model to achieve more precise control. In addition, the frame insertion method provided in the embodiment of the present application is not limited to game images, but can also be applied to video playback, virtual reality (VR) and augmented reality (AR) that require high-quality and smooth experience, and has broad application prospects.

[0105] The embodiment of the present application provides a method for interpolating a picture. The electronic device can analyze the first trajectory information to identify the characteristics of the motion trajectory of the object in the picture, so as to determine whether an interpolation operation is needed. That is, the electronic device can know the degree of influence of the delay on the picture display effect through the motion trajectory of the object in the picture, and thus decide whether to perform an interpolation operation based on the degree of influence, instead of directly performing an interpolation operation, so as to avoid picture delay caused by directly performing an interpolation operation on the picture, thereby improving the display effect of the picture.

[0106] For example, assuming that the first screen is a game screen, for simple or slow touch input, the electronic device can determine that the scene in the game may be a stable motion trajectory, so it can perform interpolation to reduce the pressure of rendering the screen and save computing resources; for complex or fast touch input, the electronic device can determine that the scene in the game may be a sudden turning action or speed change, so it can avoid unnecessary interpolation, thereby improving the response speed of the screen, reducing operation delays, and improving display effects.

[0107] In the embodiment of the present application, avoiding unnecessary frame insertion can effectively reduce the delay problem caused by frame insertion, especially for game screens and other screen types that are extremely sensitive to delay, which can greatly improve the player's gaming experience. At the same time, since the frame insertion operation can be intelligently adjusted according to the actual situation, power consumption can be further optimized while ensuring the visual effect, thereby extending the use time of the mobile phone.

[0108] Optionally, in the embodiment of the present application, combined with Figure 4 ,like Figure 5 As shown, after the above step 202a, the picture interpolation method provided in the embodiment of the present application further includes the following step 301.

[0109] Step 301: After a first time period, if the duration of the change in the motion trajectory not satisfying the first condition is greater than or equal to a second threshold, the electronic device performs a frame insertion operation after the first picture.

[0110] Optionally, in the embodiment of the present application, the first duration may be a default duration of the electronic device or a preset duration of the user. For example, the first duration may be 3 seconds, 5 seconds, or 10 seconds, etc. The specific duration may be determined according to actual use requirements, and the embodiment of the present application does not limit this.

[0111] It should be noted that the duration during which the change in the motion trajectory does not satisfy the first condition can be understood as: within a period of time, the change in the motion trajectory has not satisfied the first condition, that is, within a period of time, the movement direction of the motion trajectory has not changed and the change in the movement speed has been less than the first threshold, and this period of time is the above-mentioned duration.

[0112] Optionally, in the embodiment of the present application, the above-mentioned duration can be a default of the electronic device, or a preset by the user. For example, the above-mentioned duration can be 2 seconds, 3 seconds or 5 seconds, etc. The specific duration can be determined according to actual use requirements, and the embodiment of the present application is not limited.

[0113] Optionally, in the embodiment of the present application, the second threshold value may be a default value of the electronic device or a preset value by the user. For example, the second threshold value may be 5 seconds. The specific value may be determined according to actual use requirements and is not limited in the embodiment of the present application.

[0114] For example, taking the first duration as 10 seconds and the second threshold as 2 seconds, within 10 seconds after the electronic device displays the first picture, if the change in the motion trajectory continues for 2 seconds without satisfying the first condition, that is, the duration is equal to the second threshold, the electronic device can perform an interpolation operation after the 2 seconds.

[0115] In this way, the electronic device can restart the interpolation operation when the motion trajectory changes stably, avoiding excessive impact on the interpolation operation when the motion trajectory changes drastically in a short period of time, and improving the flexibility of the interpolation operation.

[0116] Optionally, in the embodiment of the present application, combined with Figure 1 ,like Figure 6 As shown, before the above step 201, the picture interpolation method provided in the embodiment of the present application also includes the following steps 401 and 402.

[0117] Step 401: The electronic device detects a touch signal in a first picture through a touch screen hardware TP layer, and converts the touch signal into a touch event.

[0118] It should be noted that in the working principle of touch panel hardware (TP), the capture and conversion of touch events are the responsibility of the touch screen driver. When the user touches the touch screen, the touch screen sensor detects the touch position and generates a signal. This signal is usually analog and needs to be converted into a digital signal by the touch screen driver so that the operating system and application can recognize and process it. The TP driver reads the state of the touch screen and converts the original touch signal into a touch screen event.

[0119] Step 402: The electronic device transmits the touch event to the input management layer or the application framework layer, and the input management layer or the application framework layer is used to perform trajectory analysis on the touch event.

[0120] Optionally, in the embodiment of the present application, the electronic device may pass the touch events to the input handler. Then the electronic device may obtain these events through the TP driver layer code and perform trajectory analysis on the touch events.

[0121] Optionally, in an embodiment of the present application, the electronic device may pass the touch event to the application framework layer, intercept the touch event by rewriting the touch event processing function (such as the onTouchEvent method), and pass the event to the trajectory analysis module of the application framework layer to perform trajectory analysis on the touch event.

[0122] Each of the above-mentioned method embodiments, or various possible implementation methods in each method embodiment can be executed separately, or any two or more of them can be executed in combination with each other. The specific implementation method can be determined according to actual usage requirements, and the embodiments of the present application do not limit this.

[0123] The frame interpolation method provided in the embodiment of the present application may be executed by a frame interpolation device. In the embodiment of the present application, the frame interpolation device provided in the embodiment of the present application is described by taking the frame interpolation method executed by the frame interpolation device as an example.

[0124] Figure 7 FIG. 2 shows a possible structural diagram of a frame insertion device involved in some embodiments of the present application. Figure 7 As shown, the frame insertion device 70 may include: an acquisition module 71 and a determination module 72 .

[0125] The acquisition module 71 is used to acquire first track information when displaying a touch event of the first picture, and the first track information represents the motion track of the object in the first picture. The determination module 72 is used to determine whether to perform an interpolation operation after the first picture based on the first track information acquired by the acquisition module 71.

[0126] In a possible implementation, the determination module 72 is specifically configured to:

[0127] When the change of the motion trajectory satisfies the first condition, no frame insertion operation is performed after the first frame;

[0128] Alternatively, when the change of the motion trajectory does not satisfy the first condition, an interpolation operation is performed after the first frame;

[0129] The first trajectory information includes at least one of the following: a moving direction and a moving speed; the first condition includes at least one of the following: a moving direction changes and a change in the moving speed is greater than or equal to a first threshold.

[0130] In one possible implementation, combining Figure 7 ,like Figure 8 As shown, the frame interpolation device 70 provided in the embodiment of the present application further includes: a processing module 73. The processing module 73 is configured to, after the determination module 72 determines that the frame interpolation operation is not performed after the first frame, perform the frame interpolation operation after the first time period if the change of the touch track does not satisfy the first condition for a duration greater than or equal to the second threshold.

[0131] In a possible implementation, the acquisition module 71 is specifically used to: when the first screen is displayed and a touch event on the first screen is detected, acquire second track information, the second track information representing the starting point coordinate information and the end point coordinate information corresponding to the touch event in the first screen. The determination module is also used to determine the first track information based on the starting point coordinate information and the end point coordinate information of the touch track acquired by the acquisition module 71, the first track information including the movement direction.

[0132] In a possible implementation, the trajectory information includes a movement direction; the acquisition module 71 is specifically configured to:

[0133] Determine the direction of movement based on the difference between the starting point coordinate information and the end point coordinate information, where the difference includes at least one of the following: the difference between the starting point abscissa information and the end point abscissa information, and the difference between the starting point ordinate information and the end point ordinate information;

[0134] or,

[0135] Based on the starting point coordinate information and the end point coordinate information, a first angle value is determined, and based on the first angle value, a movement direction is determined, the first angle value is the angle value between the first vector and the first direction, the first vector is a vector formed by coordinate points corresponding to the starting point coordinate information and the end point coordinate information, and the first direction is the horizontal axis direction corresponding to the starting point coordinate information or the end point coordinate information.

[0136] In an embodiment of the present application, a frame insertion device is provided. The frame insertion device can analyze the first trajectory information to identify the characteristics of the motion trajectory of the object in the picture, so as to determine whether a frame insertion operation is needed. That is, the frame insertion device can learn the degree of influence of the delay on the picture display effect through the motion trajectory of the object in the picture, and then decide whether to perform the frame insertion operation based on the degree of influence, instead of directly performing the frame insertion operation, so as to avoid the picture delay caused by directly performing the frame insertion operation on the picture, thereby improving the picture display effect.

[0137] The frame insertion device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or it can be other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc. It can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., and the embodiment of the present application does not make specific limitations.

[0138] The frame insertion device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0139] The frame insertion device provided in the embodiment of the present application can implement each process implemented in the above method embodiment, and will not be described again here to avoid repetition.

[0140] Alternatively, if Fig. 9 As shown, an embodiment of the present application further provides an electronic device 1000, including a processor 1001 and a memory 1002, wherein the memory 1002 stores a program or instruction that can be executed on the processor 1001, and when the program or instruction is executed by the processor 1001, each step of the above-mentioned picture interpolation method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0141] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0142] Fig.10 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0143] The electronic device 100 includes but is not limited to components such as a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, and a processor 110.

[0144] Those skilled in the art will appreciate that the electronic device 100 may also include a power source (such as a battery) for supplying power to various components, and the power source may be logically connected to the processor 110 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.10 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0145] The processor 110 is used to obtain first trajectory information when displaying a touch event of a first picture, the first trajectory information representing a motion trajectory of an object in the first picture; and determine whether to perform an interpolation operation after the first picture based on the first trajectory information.

[0146] Optionally, the processor 110 is specifically configured to:

[0147] When the change of the motion trajectory satisfies the first condition, no frame insertion operation is performed after the first frame;

[0148] Alternatively, when the change of the motion trajectory does not satisfy the first condition, an interpolation operation is performed after the first frame;

[0149] The first trajectory information includes at least one of the following: a moving direction and a moving speed; the first condition includes at least one of the following: a moving direction changes and a change in the moving speed is greater than or equal to a first threshold.

[0150] Optionally, the processor 110 is further configured to, after not performing an interpolation operation after the first frame, perform an interpolation operation after the first frame if, after a first period of time, the change in the touch track does not satisfy a first condition and the duration of the change is greater than or equal to a second threshold.

[0151] Optionally, the processor 110 is specifically configured to: when the first screen is displayed and a touch event on the first screen is detected, obtain second trajectory information, the second trajectory information representing the starting point coordinate information and the ending point coordinate information corresponding to the touch event in the first screen. The processor 110 is also configured to determine the first trajectory information based on the starting point coordinate information and the ending point coordinate information of the touch trajectory, the first trajectory information including the movement direction.

[0152] Optionally, the trajectory information includes a movement direction; and the processor 110 is specifically configured to:

[0153] The direction of movement is determined based on the difference between the starting point coordinate information and the end point coordinate information, and the difference includes at least one of the following: the difference between the horizontal coordinate information of the starting point and the horizontal coordinate information of the end point, and the difference between the vertical coordinate information of the starting point and the vertical coordinate information of the end point; or, based on the starting point coordinate information and the end point coordinate information, a first angle value is determined, and based on the first angle value, the direction of movement is determined, the first angle value is the angle value between a first vector and a first direction, the first vector is a vector formed by coordinate points corresponding to the starting point coordinate information and the end point coordinate information, and the first direction is the horizontal axis direction corresponding to the starting point coordinate information or the end point coordinate information.

[0154] An embodiment of the present application provides an electronic device, which can analyze first trajectory information to identify the characteristics of the motion trajectory of an object in a picture, so as to determine whether an interpolation operation is needed, that is, the electronic device can know the degree of influence of delay on the picture display effect through the motion trajectory of the object in the picture, and thus decide whether to perform an interpolation operation based on the degree of influence, instead of directly performing an interpolation operation, so as to avoid picture delay caused by directly performing an interpolation operation on the picture, thereby improving the display effect of the picture.

[0155] The electronic device provided in the embodiment of the present application can implement each process implemented in the above method embodiment, and can achieve the same technical effect. To avoid repetition, it is not repeated here. The beneficial effects of various implementations in this embodiment can be specifically referred to the beneficial effects of the corresponding implementations in the above method embodiment. To avoid repetition, it is not repeated here.

[0156] It should be understood that in the embodiment of the present application, the input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 107 includes a touch panel 1071 and at least one of other input devices 1072. The touch panel 1071 is also called a touch screen. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0157] The memory 109 can be used to store software programs and various data. The memory 109 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 109 may include a volatile memory or a non-volatile memory, or the memory 109 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 109 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0158] The processor 110 may include one or more processing units; optionally, the processor 110 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 110.

[0159] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned picture interpolation method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0160] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0161] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned picture interpolation method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0162] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0163] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned picture interpolation method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0164] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0165] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0166] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A frame insertion method, characterized in that: include: In the case of displaying a first picture, obtaining first trajectory information, where the first trajectory information represents a motion trajectory of an object in the first picture; Based on the first trajectory information, it is determined whether to perform a frame insertion operation after the first picture.

2. The method according to claim 1, characterized in that The determining whether to perform a frame insertion operation after the first picture based on the first trajectory information includes: When the change of the motion trajectory satisfies the first condition, no frame insertion operation is performed after the first picture; Alternatively, when the change of the motion trajectory does not satisfy the first condition, performing a frame insertion operation after the first picture; The first trajectory information includes at least one of the following: a movement direction and a movement speed; the first condition includes at least one of the following: the movement direction changes, and the change in the movement speed is greater than or equal to a first threshold.

3. The method according to claim 2, characterized in that After not performing the frame insertion operation after the first picture, the method further includes: After the first duration, if the duration for which the change in the motion trajectory does not satisfy the first condition is greater than or equal to a second threshold, an interpolation operation is performed after the first picture.

4. The method according to claim 1 or 2, characterized in that: The obtaining of first track information while displaying the first picture includes: When the first screen is displayed and a touch event on the first screen is detected, obtaining second track information, where the second track information represents a touch track corresponding to the touch event in the first screen; The first track information is determined based on the starting point coordinate information and the ending point coordinate information of the touch track, where the first track information includes a movement direction.

5. The method according to claim 4, characterized in that The determining the first track information based on the starting point coordinate information and the ending point coordinate information of the touch track includes: Determine the movement direction based on the difference between the starting point coordinate information and the end point coordinate information, wherein the difference includes at least one of the following: the difference between the starting point abscissa information and the end point abscissa information, and the difference between the starting point ordinate information and the end point ordinate information; or, Based on the starting point coordinate information and the end point coordinate information, a first angle value is determined, and based on the first angle value, the movement direction is determined, the first angle value is the angle value between a first vector and a first direction, the first vector is a vector formed by coordinate points corresponding to the starting point coordinate information and the end point coordinate information, and the first direction is the horizontal axis direction corresponding to the starting point coordinate information or the end point coordinate information.

6. A frame insertion device, characterized in that: include: Get module and determine module; The acquisition module is used to acquire first trajectory information when displaying a first picture, where the first trajectory information represents a motion trajectory of an object in the first picture; The determining module is used to determine whether to perform a frame insertion operation after the first picture based on the first trajectory information acquired by the acquiring module.

7. The device according to claim 6, characterized in that The determination module is specifically used for: When the change of the motion trajectory satisfies the first condition, no frame insertion operation is performed after the first picture; Alternatively, when the change of the motion trajectory does not satisfy the first condition, performing a frame insertion operation after the first picture; The first trajectory information includes at least one of the following: a movement direction and a movement speed; the first condition includes at least one of the following: the movement direction changes, and the change in the movement speed is greater than or equal to a first threshold.

8. The device according to claim 7, characterized in that The device further comprises: a processing module; The processing module is used to perform a frame insertion operation after the first frame, after the determination module determines that the frame insertion operation is not performed after the first frame, and if the duration of the change in the motion trajectory not satisfying the first condition is greater than or equal to a second threshold after a first period of time.

9. The device according to claim 6 or 7, characterized in that The acquisition module is specifically used for: When the first screen is displayed and a touch event on the first screen is detected, second track information is acquired, where the second track information represents starting point coordinate information and end point coordinate information corresponding to the touch event in the first screen; The determining module is further configured to determine the first track information based on the starting point coordinate information and the ending point coordinate information of the touch track acquired by the acquiring module, wherein the first track information includes a movement direction.

10. The device according to claim 9, characterized in that The determination module is specifically used for: Determine the movement direction based on the difference between the starting point coordinate information and the end point coordinate information, wherein the difference includes at least one of the following: the difference between the starting point abscissa information and the end point abscissa information, and the difference between the starting point ordinate information and the end point ordinate information; or, Based on the starting point coordinate information and the end point coordinate information, a first angle value is determined, and based on the first angle value, the movement direction is determined, the first angle value is the angle value between the first vector and the first direction, the first vector is a vector formed by coordinate points corresponding to the starting point coordinate information and the end point coordinate information, and the first direction is the horizontal axis direction corresponding to the starting point coordinate information or the end point coordinate information.

11. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the picture interpolation method as described in any one of claims 1 to 6 are implemented.

Images