Frame insertion method, device and electronic equipment

Abstract

The present application discloses a frame insertion method, device and electronic device. The method comprises: obtaining the output frame rate, target frame rate and target category information of a target video, wherein the target frame rate is associated with the frame rate of the target video after frame insertion processing, and the target category information is used to indicate the frame insertion range of the target video; determining the target frame insertion mode according to the output frame rate and the target frame rate; and performing frame insertion processing on the target video according to the target category information and the target frame insertion mode.

Description

Technical Field

[0001] The present application belongs to the field of communication technology, and specifically relates to a frame insertion method, device and electronic equipment. Background Art

[0002] Typically, when an electronic device performs frame interpolation processing on an application, this method can be used to insert a frame at a fixed interval based on the frames output by the application, so as to improve the fluency of the electronic device performing frame interpolation processing on the application.

[0003] However, the above frame insertion strategy is relatively fixed, so the application scenario of the frame insertion strategy is relatively single, and the flexibility and efficiency of the frame insertion strategy are relatively poor. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide a frame insertion method, device and electronic device, which can improve the flexibility of the frame insertion strategy of the electronic device and improve the efficiency of the electronic device in processing frame insertion.

[0005] In a first aspect, an embodiment of the present application provides an interpolation method, which includes: obtaining a set frame rate, a target frame rate, and a target category information of a target video, wherein the target frame rate is associated with the frame rate of the target video after interpolation processing, and the target category information is used to indicate an interpolation range of the target video; determining a target interpolation mode according to the set frame rate and the target frame rate; and performing interpolation processing on the target video according to the target category information and the target interpolation mode.

[0006] In a second aspect, an embodiment of the present application provides an interpolation device, which includes: an acquisition module, a determination module, and a processing module. The acquisition module is used to acquire the set frame rate, target frame rate, and target category information of the target video, the target frame rate is associated with the frame rate of the target video after interpolation processing, and the target category information is used to indicate the interpolation range of the target video. The determination module is used to determine the target interpolation method based on the set frame rate and target frame rate acquired by the acquisition module. The processing module is used to perform interpolation processing on the target video based on the target category information and target interpolation method determined by the determination module.

[0007] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the method described in the first aspect.

[0008] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0009] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0010] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.

[0011] In an embodiment of the present application, the electronic device can obtain the set frame rate, target frame rate and target category information of the target video, the target frame rate is associated with the frame rate of the target video after interpolation processing, and the target category information is used to indicate the interpolation range of the target video; determine the target interpolation method according to the set frame rate and the target frame rate; and perform interpolation processing on the target video according to the target category information and the target interpolation method. Since the electronic device can determine the interpolation method according to the set frame rate, target frame rate and target category information of the target video, and use the interpolation method to perform interpolation processing on the target video, the electronic device can dynamically determine the implementation method of interpolation and the scope of interpolation, thereby improving the flexibility of the electronic device in determining the interpolation strategy, and while improving the smoothness of the electronic device displaying the target video, it also improves the effect of the electronic device performing interpolation processing on the target video. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 It is one of the schematic diagrams of a frame insertion method provided in an embodiment of the present application;

[0013] Figure 2 This is a schematic diagram of an example of a mobile phone interface provided in an embodiment of the present application;

[0014] Figure 3 is a structural schematic diagram of a frame insertion device provided in an embodiment of the present application;

[0015] Figure 4 This is one of the hardware structure diagrams of an electronic device provided in an embodiment of the present application;

[0016] Figure 5 This is the second schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0017] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0018] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0019] The following describes in detail the frame insertion method provided in the embodiment of the present application through specific embodiments and application scenarios in conjunction with the accompanying drawings.

[0020] In an embodiment of the present application, the electronic device can obtain the set frame rate and target category information of the target video, and determine the target frame rate of the target video based on the set frame rate and target category information, so that the electronic device can use the target frame rate to perform interpolation processing on the target video; compared with the traditional technology, which can only use a solution of inserting a frame at a fixed interval based on the frame output by the application to improve the smoothness of the electronic device when performing interpolation processing on the target video, the embodiment of the present application can determine the implementation method and scope of interpolation based on the set frame rate and target category information, and flexibly set the target frame rate of the target video, so that the electronic device can use the target frame rate to dynamically perform interpolation processing on the target video, thereby improving the smoothness of the electronic device displaying the target video and also improving the effect of the electronic device performing interpolation processing on the target video.

[0021] The present application embodiment provides a frame insertion method. Figure 1 FIG. 2 shows a flow chart of a frame insertion method provided by an embodiment of the present application. Figure 1 As shown, the interpolation method provided in the embodiment of the present application may include the following steps 201 to 203.

[0022] Step 201: The electronic device obtains a set frame rate, a target frame rate, and target category information of a target video.

[0023] In the embodiment of the present application, the target frame rate is associated with the frame rate of the target video after the interpolation process, and the target category information is used to indicate the interpolation range of the target video.

[0024] In an embodiment of the present application, a user can open any application (e.g., a game application) in an electronic device so that the electronic device can display a video of the application (e.g., a target video: a game screen in a game application, a video screen in a browser, etc.), and then the electronic device can detect whether the target video needs to be interpolated, and when it is detected that the target video needs to be interpolated, the electronic device can obtain the set frame rate, target frame rate, and target category information of the target video to determine the interpolation method of the target video based on the set frame rate and target category information of the target video.

[0025] Optionally, in an embodiment of the present application, the above-mentioned set frame rate can be a system default set frame rate parameter, a user-preset set frame rate parameter, a user-historically used set frame rate parameter, or a user-set frame rate parameter in real time. The specific frame rate can be determined based on actual use, and the present application embodiment does not impose any limitations.

[0026] It should be noted that the above-mentioned set frame rate refers to the set frame rate level information of the target video (for example, 30 frames, 60 frames or 90 frames, etc.).

[0027] Optionally, in an embodiment of the present application, the above-mentioned target category information can be system default category information, category information for pre-setting, category information used by the user in history, or category information selected by the user in real time. The specific information can be determined based on actual use, and the embodiment of the present application does not impose any limitations.

[0028] Optionally, in an embodiment of the present application, the above target category information may include a power saving category and an improvement effect category.

[0029] Optionally, before the above step 201, the interpolation method provided in the embodiment of the present application further includes the following step 301, and step 201 can be specifically implemented by the following steps 201a and 201b.

[0030] Step 301: The electronic device displays a frame insertion interaction interface.

[0031] In an embodiment of the present application, the interpolation interaction interface includes at least one category identifier and at least one frame rate identifier, each category identifier is used to indicate a type of category information of the interpolation, and each frame rate identifier is used to indicate a frame rate of the interpolation.

[0032] Optionally, in an embodiment of the present application, when a user opens a game application, the electronic device may display the interface of the game application and display an interpolation interaction interface in the interface of the game application.

[0033] Step 201a: The electronic device displays a frame insertion interaction interface, obtains a set frame rate of a target video, and receives a first input of a target category identifier in at least one category identifier and a target frame rate identifier in at least one frame rate identifier from a user.

[0034] Optionally, in an embodiment of the present application, when the electronic device displays the target video on the screen, the user can input the display interface of the target video to trigger the electronic device to display the interpolation interaction interface, and display at least one category identifier and at least one frame rate identifier on the setting interaction interface, each category identifier is used to indicate a category information of the interpolation, and each frame rate identifier is used to indicate a frame rate of the interpolation. Then, the user can make a first input on any category identifier (such as the target category identifier) ​​and any frame rate (such as the target frame rate) on the interaction interface (for example, select and input the target frame rate parameters displayed in the setting interaction interface or enter the target frame rate parameters in a preset area of ​​the interaction interface) to trigger the electronic device to process / update the setting frame rate parameters currently used by the target video to the frame rate parameters required by the user.

[0035] In an embodiment of the present application, before obtaining the set frame rate and target category information of the target video, the electronic device can display the target video on the screen of the electronic device and display an interpolation interaction interface on the display interface of the target video so that the user can input in the interpolation interaction interface.

[0036] In the embodiment of the present application, each of the above-mentioned category information indicates an interpolation frame range.

[0037] Optionally, in an embodiment of the present application, the electronic device may display an interpolation interaction interface in a floating manner on the display interface of the target video.

[0038] Optionally, in an embodiment of the present application, the electronic device may further divide the screen into two areas, so as to display a playback interface of the target video in the first area and to display an interpolation interaction interface in the second area.

[0039] Optionally, in an embodiment of the present application, the at least one frame insertion category identifier may include a power consumption optimization identifier and a frame rate improvement identifier.

[0040] Optionally, in an embodiment of the present application, the above-mentioned power consumption optimization identifier is used to indicate power consumption saving category information, and the above-mentioned frame rate improvement identifier is used to indicate improvement effect category information.

[0041] Optionally, in an embodiment of the present application, the above-mentioned power consumption optimization flag indicates a first interpolation effect, and the above-mentioned frame rate improvement flag indicates a second interpolation effect.

[0042] Optionally, in an embodiment of the present application, the first frame interpolation effect is that the power consumption of the electronic device displaying the target video is lower than the power consumption of the electronic device displaying the target video before the frame interpolation processing is performed, and the smoothness of the electronic device displaying the target video is equivalent to or better than the smoothness of the electronic device displaying the target video before the frame interpolation processing is performed; the second frame interpolation effect is that the power consumption of the electronic device displaying the target video is equivalent to or greater than the power consumption of the electronic device displaying the target video before the frame interpolation processing is performed, and the smoothness of the electronic device displaying the target video is better than the smoothness of the electronic device displaying the target video before the frame interpolation processing is performed.

[0043] It should be noted that, since the electronic device can save the consumption of the central processing unit (CPU) / graphics processing unit (GPU) when controlling the output frame rate of the target video, the power consumption of the electronic device is reduced after the frame interpolation processing; due to the consumption of the interpolation chip in the electronic device, the power consumption of the electronic device is increased after the frame interpolation processing; if the power consumption saved by controlling the frame rate is greater than the consumption of the interpolation chip, it is a power saving type, that is, the effect corresponding to the optimization power consumption identifier (the first interpolation effect); if the power consumption saved by controlling the frame rate is less than the consumption of the interpolation chip, it is an improvement effect type, that is, the effect corresponding to the improvement frame rate identifier (the second interpolation effect).

[0044] Optionally, in the embodiment of the present application, the first input may be a click input (e.g., a single click input, a double click input, or an input of a preset number of clicks), a long press input, or a sliding input, etc. The specific setting may be based on actual use requirements and is not limited in the embodiment of the present application.

[0045] For example, taking the electronic device as a mobile phone as an example, Figure 2 As shown, the mobile phone displays a display interface 10 of the target video, so that an interpolation interaction interface 11 can be displayed on the display interface 10, so that the mobile phone can display at least one category identifier (for example, an improvement frame rate identifier, an optimization power consumption identifier) ​​and at least one frame rate identifier (for example, 60 frames, 90 frames, 120 frames) on the interpolation interaction interface 11 and display a control at a position corresponding to each identifier, respectively. The user can input the control corresponding to the category identifier among the multiple identifiers to trigger the electronic device to determine the category information indicated by the target category identifier as the target category information, and trigger the electronic device to determine the frame rate information indicated by the target frame rate identifier as the target frame rate information.

[0046] Step 201b: In response to the first input, the electronic device determines the category information indicated by the target category identifier as the target category information, and determines the frame rate indicated by the target frame rate identifier as the target frame rate.

[0047] In an embodiment of the present application, after receiving the user's first input of the target insertion category identifier and the target frame rate identifier, the electronic device can determine the category information indicated by the target category identifier as the target category information, and determine the frame rate information indicated by the target frame rate identifier as the target frame rate information, so that the electronic device obtains the target category information and the target frame rate information and determines the target frame rate.

[0048] In an embodiment of the present application, when the electronic device can display an interpolation interaction interface, the user can make a first input of a target category identifier and a target frame rate identifier, which enriches the interpolation categories of the electronic device and also enables the electronic device to determine the category information of the target video according to the needs of the user, thereby improving the flexibility of the electronic device in determining the category information of the target video.

[0049] Step 202: The electronic device determines a target frame insertion mode according to a set frame rate and a target frame rate.

[0050] In an embodiment of the present application, after obtaining the target frame rate and the set frame rate, the electronic device determines the frame insertion method of the target video according to the set frame rate and the target frame rate.

[0051] Optionally, the target frame rate is greater than or equal to the set frame rate, and step 202 can be specifically implemented through the following steps 202a1 and 202a2, or through step 202b.

[0052] Step 202a1: When the set frame rate is greater than the first frame rate, the AP main control chip sets the output frame rate of the target video to the first frame rate.

[0053] The value of the first frame rate is half of the value of the target frame rate.

[0054] Optionally, in an embodiment of the present application, the AP main control chip in the electronic device can set the output frame rate of the target video to the first frame rate.

[0055] Optionally, in an embodiment of the present application, the electronic device may first apply for a buffer from a buffer queue of an image synthesis system, and then fill the display content of the target video into the buffer, so that the image synthesis system of the electronic device can synthesize the display content of the target video. The electronic device may then control the time interval for the application indicated by the target video to apply for the buffer to a time interval corresponding to half the target frame rate, so as to set the output frame rate of the target video to the first frame rate.

[0056] Step 202a2: The independent frame insertion chip performs frame insertion processing on the target video of the first frame rate to obtain the target video of the second frame rate, wherein the value of the second frame rate is twice the value of the first frame rate.

[0057] Optionally, in an embodiment of the present application, the electronic device may perform frame interpolation processing on a target video of a first frame rate through an independent frame interpolation chip to obtain a target video of a second frame rate, wherein the value of the second frame rate is twice the value of the first frame rate.

[0058] Step 202b1: When the frame rate is set to be less than or equal to the first frame rate, the independent frame insertion chip performs frame insertion processing on the target video to obtain a target video with a third frame rate.

[0059] In the embodiment of the present application, the value of the third frame rate is twice the value of the set frame rate;

[0060] The value of the first frame rate is half of the value of the target frame rate.

[0061] Optionally, in an embodiment of the present application, when the set frame rate is less than or equal to the first frame rate, the output frame rate of the target video output by the AP main control chip is the same as the set frame rate. After the independent interpolation chip receives the target video transmitted from the application processor AP main control chip, it performs interpolation processing on the target video to obtain a target video with a third frame rate.

[0062] Step 203: The electronic device performs frame insertion processing on the target video according to the target category information and the target frame insertion method.

[0063] In the embodiment of the present application, the electronic device can use the interpolation frame rate corresponding to the target frame rate and the interpolation effective range corresponding to the target category information to perform interpolation processing on the target video.

[0064] It should be noted that the frame insertion process refers to that the electronic device uses the target frame rate to perform frame insertion on the basis of the frames of the target video.

[0065] Optionally, in the embodiment of the present application, the above step 203 can be specifically implemented by the following step 203a.

[0066] Step 203a: The frame insertion chip uses a target frame insertion method to perform frame insertion processing on the video segment corresponding to the target category information in the target video.

[0067] Optionally, in an embodiment of the present application, after determining the interpolation range corresponding to the target category information, the electronic device may select video segments corresponding to the interpolation range from the target video according to the interpolation range, and perform interpolation processing on these video segments using the target frame rate.

[0068] In an embodiment of the present application, the electronic device can use a target frame rate to perform frame insertion processing on the video segment corresponding to the target category information in the target video according to the target category information selected by the user. Therefore, the electronic device can flexibly determine the interpolation effect, interpolation method and the scope of interpolation effect. In this way, the flexibility of the electronic device in determining the interpolation strategy is improved, and the effect of the electronic device performing interpolation processing on the target video is enriched.

[0069] Optionally, in the embodiment of the present application, the target video is a game video, and the above step 203a can be specifically implemented through the following steps 203a1 and 203a2, or steps 203a1 and 203a3.

[0070] Step 203a1: The electronic device detects the game state of the game video in real time.

[0071] Optionally, in an embodiment of the present application, the electronic device can detect the game state of the game video in real time through the detection module, and perform frame insertion processing on the game video corresponding to the game state according to different game states.

[0072] In the embodiment of the present application, the above-mentioned game state can be divided into a game state or a non-game state.

[0073] Step 203a2: When the target category information indicates the first interpolation range and the game state of the video clip in the game video is the target state, the independent interpolation chip uses the target interpolation method to perform interpolation processing on the video clip in the target state.

[0074] In the embodiment of the present application, the target state is a game state or a non-game state.

[0075] In an embodiment of the present application, if the target category information corresponding to the target category identifier selected by the user indicates a first interpolation frame range (i.e., saving power consumption), and the game state of the video clip in the game video is a game match state or a non-game match state, the electronic device can use the target frame rate corresponding to the first interpolation frame range to perform interpolation processing on the game match state video or the non-game match state video in the game video.

[0076] Step 203a3: When the target category information indicates the second interpolation range and the game state of the video clip in the game video is a game match state, the independent interpolation chip uses a target interpolation method to perform interpolation processing on the video clip in the game match state.

[0077] In an embodiment of the present application, if the target category information corresponding to the target category identifier selected by the user indicates a second interpolation range (i.e., increasing the frame rate), and the game state of the video clip in the game video is a game match state, the electronic device can use the target frame rate corresponding to the second interpolation range to perform interpolation processing on the video clip of the game match state in the game video.

[0078] It should be noted that when an electronic device displays a game video, usually, since users have higher requirements for the smoothness of the video of the game game status in the game video, and lower requirements for the smoothness of the video of the non-game game status, if the user selects the first interpolation range, the electronic device can use the target frame rate to interpolate the video of the game game status or the video of the non-game game status; if the user selects the second interpolation range, the user can use the target frame rate to interpolate the video of the game game status.

[0079] In an embodiment of the present application, the electronic device can dynamically determine the implementation method and scope of frame insertion in the game video according to the user's needs, so as to achieve the optimal effect of reducing power consumption and enhancing video smoothness in the game video. Therefore, while reducing the power consumption of the electronic device running game applications and displaying game videos, the smoothness of the game application displaying the game video can also be optimized. In this way, the effect of the electronic device displaying the game video is improved, the power consumption of the electronic device performing frame insertion processing on the game video is reduced, and the smoothness of the electronic device displaying the game video is improved.

[0080] An embodiment of the present application provides a frame insertion method. Since the electronic device can determine the frame insertion method according to the set frame rate, target frame rate and target category information of the target video, and adopt the frame insertion method to perform frame insertion processing on the target video, the electronic device can dynamically determine the implementation method of the frame insertion and the scope of the frame insertion. In this way, the flexibility of the electronic device in determining the frame insertion strategy is improved, and while improving the smoothness of the electronic device in displaying the target video, the power consumption of the electronic device in performing frame insertion processing on the target video is reduced, and the effect of the electronic device in performing frame insertion processing on the target video is also improved.

[0081] It should be noted that the frame insertion method provided in the embodiment of the present application can be executed by an electronic device, a frame insertion device, or a control module in the frame insertion device for executing the frame insertion method. In the embodiment of the present application, the frame insertion method provided in the embodiment of the present application is described by taking the execution of the frame insertion method by an electronic device as an example.

[0082] Figure 3 FIG. 2 shows a possible structural diagram of a frame insertion device involved in an embodiment of the present application. Figure 3As shown, the frame insertion device 70 may include: an acquisition module 71 , a determination module 72 and a processing module 73 .

[0083] The acquisition module 71 is used to acquire the set frame rate, target frame rate and target category information of the target video, the target frame rate is associated with the frame rate of the target video after the interpolation process, and the target category information is used to indicate the interpolation range of the target video. The determination module 72 is used to determine the target interpolation mode according to the set frame rate and target frame rate acquired by the acquisition module 71. The processing module 73 is used to perform interpolation processing on the target video according to the target category information and target interpolation mode determined by the determination module 72.

[0084] An embodiment of the present application provides a frame insertion device. Since the electronic device can determine the frame insertion method according to the set frame rate, target frame rate and target category information of the target video, and adopt the frame insertion method to perform frame insertion processing on the target video, the electronic device can dynamically determine the implementation method of the frame insertion and the scope of the frame insertion. In this way, the flexibility of the electronic device in determining the frame insertion strategy is improved, and while improving the smoothness of the electronic device in displaying the target video, the power consumption of the electronic device in performing frame insertion processing on the target video is reduced, and the effect of the electronic device in performing frame insertion processing on the target video is also improved.

[0085] In a possible implementation, the interpolation device 70 further includes a display module. The display module is used to display an interpolation interaction interface before the acquisition module 71 acquires the set frame rate, target frame rate, and target category information of the target video, wherein the interpolation interaction interface includes at least one category identifier and at least one frame rate identifier, each category identifier is used to indicate a category information of the interpolation, and each frame rate identifier is used to indicate a frame rate of the interpolation.

[0086] In one possible implementation, the acquisition module 71 is specifically used to display an interpolation interaction interface, obtain the set frame rate of the target video, and receive a first input from a user for a target category identifier in at least one category identifier and a target frame rate identifier in at least one frame rate identifier; and in response to the first input, determine the category information indicated by the target category identifier as the target category information, and determine the frame rate indicated by the target frame rate identifier as the target frame rate.

[0087] In one possible implementation, the target frame rate is greater than or equal to the set frame rate, and the determination module 72 is specifically used to, when the set frame rate is greater than the first frame rate, the AP main control chip sets the output frame rate of the target video to the first frame rate; the independent interpolation chip interpolates the target video of the first frame rate to obtain a target video of a second frame rate, and the value of the second frame rate is twice the value of the first frame rate; when the set frame rate is less than or equal to the first frame rate, the independent interpolation chip interpolates the target video to obtain a target video of a third frame rate, and the value of the third frame rate is twice the value of the set frame rate; wherein the value of the first frame rate is half of the value of the target frame rate.

[0088] In a possible implementation, the processing module 73 is specifically configured to enable the frame insertion chip to perform frame insertion processing on the video segment corresponding to the target category information in the target video by adopting a target frame insertion method.

[0089] In a possible implementation, the target video is a game video. The processing module 73 is specifically used to detect the game state of the game video in real time; when the target category information indicates a first interpolation range and the game state of the video clip in the game video is the target state, the independent interpolation chip adopts a target interpolation method to perform interpolation processing on the video clip in the target state, and the target state is a game match state or a non-game match state; when the target category information indicates a second interpolation range and the game state of the video clip in the game video is a game match state, the independent interpolation chip adopts a target interpolation method to perform interpolation processing on the video clip in the game match state.

[0090] The interpolation device in the embodiment of the present application can be a device, or a component, integrated circuit, or chip in a terminal. The device can be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc. The non-mobile electronic device can be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0091] The interpolation device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0092] The interpolation device provided in the embodiment of the present application can implement each process implemented in the above method embodiment and can achieve the same technical effect. To avoid repetition, it will not be described here.

[0093] Alternatively, if Figure 4 As shown, an embodiment of the present application also provides an electronic device 90, including a processor 91, a memory 92, and a program or instruction stored in the memory 92 and executable on the processor 91. When the program or instruction is executed by the processor 91, each process of the above-mentioned method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be described here.

[0094] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0095] Figure 5 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0096] The electronic device 100 includes but is not limited to components such as a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, and a processor 110.

[0097] Those skilled in the art will appreciate that the electronic device 100 may also include a power source (such as a battery) for supplying power to various components, and the power source may be logically connected to the processor 110 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Figure 5 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0098] The radio frequency unit 101 is used to obtain the set frame rate, target frame rate and target category information of the target video, the target frame rate is associated with the frame rate of the target video after the interpolation processing, and the target category information is used to indicate the interpolation range of the target video. The processor 110 is used to determine the target interpolation mode according to the set frame rate and the target frame rate. The processor 110 is used to perform interpolation processing on the target video according to the target category information and the target interpolation mode.

[0099] An embodiment of the present application provides an electronic device. Since the electronic device can determine the interpolation method according to the set frame rate, target frame rate and target category information of the target video, and adopt the interpolation method to perform interpolation processing on the target video, the electronic device can dynamically determine the implementation method of interpolation and the scope of interpolation. In this way, the flexibility of the electronic device in determining the interpolation strategy is improved, and while improving the smoothness of the electronic device in displaying the target video, the power consumption of the electronic device in performing interpolation processing on the target video is reduced, and the effect of the electronic device in performing interpolation processing on the target video is also improved.

[0100] Optionally, in an embodiment of the present application, the display unit 106 is used to display an interpolation interaction interface before obtaining the set frame rate, target frame rate and target category information of the target video, and the interpolation interaction interface includes at least one category identifier and at least one frame rate identifier, each category identifier is used to indicate a type of category information of the interpolation, and each frame rate identifier is used to indicate a frame rate of the interpolation.

[0101] Optionally, in an embodiment of the present application, the radio frequency unit 101 is specifically used to display an interpolation interaction interface, obtain a set frame rate of a target video, and receive a first input from a user for a target category identifier in at least one category identifier and a target frame rate identifier in at least one frame rate identifier; and in response to the first input, determine the category information indicated by the target category identifier as the target category information, and determine the frame rate indicated by the target frame rate identifier as the target frame rate.

[0102] Optionally, in an embodiment of the present application, the target frame rate is greater than or equal to the set frame rate, and the processor 110 is specifically used to, when the set frame rate is greater than the first frame rate, the AP main control chip sets the output frame rate of the target video to the first frame rate; the independent interpolation chip performs interpolation processing on the target video of the first frame rate to obtain a target video of a second frame rate, and the value of the second frame rate is twice the value of the first frame rate; when the set frame rate is less than or equal to the first frame rate, the independent interpolation chip performs interpolation processing on the target video to obtain a target video of a third frame rate, and the value of the third frame rate is twice the value of the set frame rate; wherein the value of the first frame rate is half of the value of the target frame rate.

[0103] Optionally, in an embodiment of the present application, the processor 110 is specifically configured to use a frame insertion chip to perform frame insertion processing on a video segment corresponding to target category information in a target video by adopting a target frame insertion method.

[0104] Optionally, in an embodiment of the present application, the target video is a game video. The processor 110 is specifically used to detect the game state of the game video in real time; when the target category information indicates a first interpolation range and the game state of the video clip in the game video is the target state, the independent interpolation chip adopts a target interpolation method to perform interpolation processing on the video clip in the target state, and the target state is a game match state or a non-game match state; when the target category information indicates a second interpolation range and the game state of the video clip in the game video is a game match state, the independent interpolation chip adopts a target interpolation method to perform interpolation processing on the video clip in the game match state.

[0105] The electronic device provided in the embodiment of the present application can implement each process implemented in the above method embodiment and can achieve the same technical effect. To avoid repetition, it will not be described here.

[0106] The beneficial effects of various implementations in this embodiment can be specifically referred to the beneficial effects of the corresponding implementations in the above method embodiment. To avoid repetition, they will not be described again here.

[0107] It should be understood that in the embodiment of the present application, the input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 107 includes a touch panel 1071 and other input devices 1072. The touch panel 1071 is also called a touch screen. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Other input devices 1072 may include but are not limited to a physical keyboard, a function key (such as a volume control button, a switch button, etc.), a trackball, a mouse, and a joystick, which will not be repeated here. The memory 109 can be used to store software programs and various data, including but not limited to applications and operating systems. The processor 110 can integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, the user interface, and the application program, etc., and the modem processor mainly processes wireless communication. It is understandable that the above-mentioned modem processor may not be integrated into the processor 110.

[0108] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0109] The processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0110] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0111] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0112] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned video generation method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0113] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0114] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0115] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A frame insertion method, It is characterized in that The method comprises: Acquire a set frame rate, a target frame rate, and target category information of a target video, wherein the target frame rate is associated with a frame rate of the target video after frame interpolation processing, and the target category information is used to indicate a frame interpolation range of the target video; Determining a target interpolation mode according to the set frame rate and the target frame rate; Performing frame interpolation processing on the target video according to the target category information and the target frame interpolation mode; The target frame rate is greater than or equal to the set frame rate, and determining the target interpolation mode according to the set frame rate and the target frame rate includes: When the set frame rate is greater than the first frame rate, the application processor AP main control chip sets the output frame rate of the target video to the first frame rate; the independent interpolation chip performs interpolation processing on the target video of the first frame rate to obtain a target video of a second frame rate, and the value of the second frame rate is twice the value of the first frame rate; When the set frame rate is less than or equal to the first frame rate, the independent frame insertion chip performs frame insertion processing on the target video to obtain a target video with a third frame rate, wherein the value of the third frame rate is twice the value of the set frame rate; The value of the first frame rate is half of the value of the target frame rate.

2. The method according to claim 1, It is characterized in that Before obtaining the set frame rate, target frame rate and target category information of the target video, the method further includes: Displaying a frame insertion interaction interface, wherein the frame insertion interaction interface includes at least one category identifier and at least one frame rate identifier, each category identifier is used to indicate a type of category information of the frame insertion, and each frame rate identifier is used to indicate a frame rate of the frame insertion; The step of obtaining the set frame rate, target frame rate, and target category information of the target video includes: Displaying a frame insertion interaction interface, obtaining a set frame rate of the target video, and receiving a first input of a target category identifier in the at least one category identifier and a target frame rate identifier in the at least one frame rate identifier by a user; In response to the first input, the category information indicated by the target category identifier is determined as the target category information, and the frame rate indicated by the target frame rate identifier is determined as the target frame rate.

3. The method according to claim 1, It is characterized in that The performing frame interpolation processing on the target video according to the target category information and the target frame interpolation mode includes: The frame insertion chip adopts the target frame insertion method to perform frame insertion processing on the video segment corresponding to the target category information in the target video.

4. The method according to claim 3, It is characterized in that The target video is a game video; The frame insertion chip adopts the target frame insertion mode to perform frame insertion processing on the video segment corresponding to the target category information in the target video, including: Detecting the game state of the game video in real time; When the target category information indicates a first interpolation frame range and the game state of the video clip in the game video is a target state, the independent interpolation frame chip adopts the target interpolation mode to perform interpolation processing on the video clip in the target state, and the target state is a game match state or a non-game match state; When the target category information indicates a second interpolation range and the game state of the video clip in the game video is a game match state, the independent interpolation chip uses the target interpolation method to perform interpolation processing on the video clip in the game match state.

5. A frame insertion device, It is characterized in that The frame insertion device comprises: an acquisition module, a determination module and a processing module; The acquisition module is used to acquire a set frame rate, a target frame rate and target category information of a target video, wherein the target frame rate is associated with a frame rate of the target video after the interpolation process, and the target category information is used to indicate an interpolation range of the target video; The determining module is used to determine a target interpolation mode according to the set frame rate and the target frame rate acquired by the acquiring module; The processing module is used to perform frame interpolation processing on the target video according to the target category information and the target frame interpolation mode determined by the determination module; The target frame rate is greater than or equal to the set frame rate, and the determination module is specifically used to, when the set frame rate is greater than the first frame rate, set the output frame rate of the target video to the first frame rate by the application processor AP main control chip; the independent interpolation chip performs interpolation processing on the target video with the first frame rate to obtain a target video with a second frame rate, and the value of the second frame rate is twice the value of the first frame rate; When the set frame rate is less than or equal to the first frame rate, the independent frame insertion chip performs frame insertion processing on the target video to obtain a target video with a third frame rate, wherein the value of the third frame rate is twice the value of the set frame rate; The value of the first frame rate is half of the value of the target frame rate.

6. The device according to claim 5, It is characterized in that The interpolation device further includes a display module; The display module is used to display a frame insertion interaction interface before the acquisition module acquires the set frame rate, target frame rate and target category information of the target video, wherein the frame insertion interaction interface includes at least one category identifier and at least one frame rate identifier, each category identifier is used to indicate a type of category information of the interpolated frame, and each frame rate identifier is used to indicate a type of frame rate of the interpolated frame; The acquisition module is specifically used to display a frame insertion interaction interface, acquire a set frame rate of the target video, and receive a first input of a target category identifier in the at least one category identifier and a target frame rate identifier in the at least one frame rate identifier by a user; And in response to the first input, the category information indicated by the target category identifier is determined as the target category information, and the frame rate indicated by the target frame rate identifier is determined as the target frame rate.

7. The device according to claim 5, It is characterized in that The processing module is specifically used for the frame insertion chip to adopt the target frame insertion method to perform frame insertion processing on the video segment corresponding to the target category information in the target video.

8. The device according to claim 7, It is characterized in that The target video is a game video; The processing module is specifically used to detect the game state of the game video in real time; when the target category information indicates a first interpolation range and the game state of the video clip in the game video is a target state, the independent interpolation chip adopts the target interpolation method to perform interpolation processing on the video clip in the target state, and the target state is a game match state or a non-game match state; when the target category information indicates a second interpolation range and the game state of the video clip in the game video is a game match state, the independent interpolation chip adopts the target interpolation method to perform interpolation processing on the video clip in the game match state.

9. An electronic device, It is characterized in that The method comprises a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the interpolation method as claimed in any one of claims 1 to 4.

10. A readable storage medium, It is characterized in that The readable storage medium stores a program or an instruction, and when the program or the instruction is executed by a processor, the steps of the interpolation method according to any one of claims 1 to 4 are implemented.

Images