Video playback method and apparatus, device, and storage medium

Abstract

The present application relates to the technical field of large-screen interaction, and discloses a video playback method and apparatus, a device, and a storage medium. The method comprises: a server device obtaining a network state of a network between the server device and a large screen in response to receiving a remote control playback instruction for a target video sent by a client device; on the basis of the network state and the resolution of the large screen, performing preprocessing including at least one of image frame blending and image frame compression on the image frames contained in the target video to obtain preprocessed video data corresponding to the target video; encoding the preprocessed video data to obtain encoded video data corresponding to the target video (S203); and sending the encoded video data to the large screen so as to play the target video on the large screen (S204). By performing preprocessing including at least one of image frame blending and image frame compression on the image frames contained in a target video, the transmission of the target video is optimized, reducing the probability of stuttering or crashing during playback of the target video on a remotely-controlled large screen.

Description

Video playback method, device, equipment and storage medium

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on February 8, 2024, with application number 202410177321.2 and application name “Video Playback Method, Device, Equipment and Storage Medium”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The embodiments of the present application relate to, but are not limited to, the field of large-screen interactive technology, and in particular to a video playback method, apparatus, device, and storage medium. Background Art

[0003] With the development of large-screen interaction, there is an increasing demand for remote control of large screens using terminal devices such as tablet computers (Portable Android devices, Pads for short).

[0004] Current video playback methods involve connecting a large screen to a personal computer (PC) and controlling it remotely via the PC. The PC consists of a host computer and a display screen. Specifically, when a user needs to play a video, they enter a play command for the target video on the screen. The PC responds to the command, plays the target video on the PC's display, and sends the video content to the large screen in real time for playback.

[0005] When playing videos in the above manner, the remote control may freeze. Summary of the Invention

[0006] The following is a summary of the subject matter described in detail herein. This summary is not intended to limit the scope of the claims.

[0007] The present application provides a video playback method, apparatus, device, and storage medium.

[0008] In the first aspect, an embodiment of the present application provides a video playback method, which is applied to a server device in a video playback system, and the video playback system also includes a client device and a large screen connected to the server device, and a user interacts with the client device to remotely control the large screen to play a target video; the video playback method includes: responding to a remote control playback instruction for a target video sent by the client device, obtaining the network status of the network between the server device and the large screen; preprocessing the image frames contained in the target video according to the network status and the resolution of the large screen to obtain preprocessed video data corresponding to the target video, and the preprocessing includes at least one of image frame mixing and image frame compression; encoding the preprocessed video data to obtain encoded video data corresponding to the target video; sending the encoded video data to the large screen to play the target video on the large screen.

[0009] In one possible implementation, different network states correspond to different preprocessing methods. The better the network state, the higher the image quality corresponding to the preprocessed video data; and / or, different large-screen resolutions correspond to different preprocessing methods. The higher the large-screen resolution, the higher the image quality corresponding to the preprocessed video data.

[0010] In one possible implementation, the image frames contained in the target video are preprocessed according to the network status and the large-screen resolution to obtain preprocessed video data corresponding to the target video, including: if the video content of the target video contains a 3D scene, the target video is played frame by frame, and the rendering image is sampled in real time during the playback process; the 3D image frames corresponding to the 3D scene are converted into 2D image frames; according to the network status and the large-screen resolution, the 2D image frames are preprocessed to obtain preprocessed video data corresponding to the target video.

[0011] In a possible implementation, the preprocessing includes image frame mixing, and further includes: for a target image frame to be mixed, storing the target image frame before the image frame mixing is performed.

[0012] In a possible implementation, encoding the preprocessed video data to obtain encoded video data corresponding to the target video includes: binary encoding the preprocessed video data to obtain encoded video data corresponding to the target video.

[0013] In a possible implementation, both the client device and the server device are mobile terminals.

[0014] In the second aspect, an embodiment of the present application provides a video playback method, which is applied to a large screen in a video playback system. The video playback system also includes a client device and a server device connected to the client device and the large screen respectively, and the user interacts with the client device to remotely control the large screen to play the target video; the video playback method includes: receiving encoded video data corresponding to the target video sent by the server device, and the encoded video data is obtained by preprocessing and encoding the target video by the server device, and the preprocessing includes at least one of image frame mixing and image frame compression; decoding the encoded video data to obtain decoded video data corresponding to the target video; performing at least one of image frame decompression and image frame disassembly on the decoded video data, and playing the processed image frame.

[0015] In one possible implementation, the decoded video data is subjected to at least one of image frame decompression and image frame disassembly, and the processed image frames are played, including: determining the preprocessing corresponding to the decoded video data, the preprocessing including at least one of image frame mixing and image frame compression; if the preprocessing corresponding to the decoded video data includes image frame compression, performing image frame decompression on the decoded video data to obtain decompressed video data of the image frames corresponding to the target video; if the preprocessing corresponding to the decoded video data includes image frame mixing, performing image frame disassembly on the decompressed video data to obtain processed image frames; and playing the processed image frames.

[0016] In a possible implementation, both the client device and the server device are mobile terminals.

[0017] In a third aspect, an embodiment of the present application provides a video playback system, comprising: a client device, a server device, and a large screen, wherein the server device is connected to the client device and the large screen respectively;

[0018] The client device is used to interact with the user to remotely control the large screen to play the target video;

[0019] A server device, configured to execute the video playback method provided in the first aspect;

[0020] The large screen is used to execute the video playback method provided in the second aspect.

[0021] In a possible implementation, both the client device and the server device are mobile terminals.

[0022] In a fourth aspect, an embodiment of the present application provides a video playback device, which is applied to a server device in a video playback system. The video playback system further includes a client device and a large screen connected to the server device. A user interacts with the client device to remotely control the large screen to play a target video. The video playback device includes:

[0023] An acquisition module, configured to acquire the network status of the network between the server device and the large screen in response to receiving a remote control playback instruction for a target video sent by the client device;

[0024] a preprocessing module, configured to preprocess the image frames included in the target video according to the network status and the large screen resolution to obtain preprocessed video data corresponding to the target video, wherein the preprocessing includes at least one of image frame mixing and image frame compression;

[0025] An encoding module, used to encode the preprocessed video data to obtain encoded video data corresponding to the target video;

[0026] The sending module is used to send the encoded video data to the large screen so that the target video can be played on the large screen.

[0027] In one possible implementation, different network states correspond to different preprocessing methods. The better the network state, the higher the image quality corresponding to the preprocessed video data; and / or, different large-screen resolutions correspond to different preprocessing methods. The higher the large-screen resolution, the higher the image quality corresponding to the preprocessed video data.

[0028] In one possible implementation, the preprocessing module is specifically used to: if the video content of the target video contains a 3D scene, play the target video frame by frame, and sample the rendering image in real time during the playback process; convert the 3D image frame corresponding to the 3D scene into a 2D image frame; and preprocess the 2D image frame according to the network status and large-screen resolution to obtain the preprocessed video data corresponding to the target video.

[0029] In a possible implementation, the preprocessing includes image frame mixing, and further includes: for a target image frame to be mixed, storing the target image frame before the image frame mixing is performed.

[0030] In a possible implementation, the encoding module is specifically configured to perform binary encoding on the preprocessed video data to obtain encoded video data corresponding to the target video.

[0031] In a possible implementation, both the client device and the server device are mobile terminals.

[0032] In a fifth aspect, an embodiment of the present application provides a video playback device for use on a large screen in a video playback system. The video playback system further includes a client device and a server device connected to the client device and the large screen, respectively. A user interacts with the client device to remotely control the large screen to play a target video. The video playback device includes:

[0033] a receiving module, configured to receive encoded video data corresponding to a target video sent by a server device, the encoded video data being obtained by the server device through preprocessing and encoding the target video, the preprocessing including at least one of image frame mixing and image frame compression;

[0034] A decoding module, used to decode the encoded video data to obtain decoded video data corresponding to the target video;

[0035] The playing module is used to perform at least one of decompressing and disassembling the decoded video data image frames and playing the processed image frames.

[0036] In one possible implementation, the playback module is specifically used to: determine the preprocessing corresponding to the decoded video data, which preprocessing includes at least one of image frame mixing and image frame compression; if the preprocessing corresponding to the decoded video data includes image frame compression, then perform image frame decompression on the decoded video data to obtain decompressed video data of the image frames corresponding to the target video; if the preprocessing corresponding to the decoded video data includes image frame mixing, then perform image frame decompression on the decompressed video data to obtain processed image frames; and play the processed image frames.

[0037] In a possible implementation, both the client device and the server device are mobile terminals.

[0038] In a sixth aspect, an embodiment of the present application provides an electronic device, including:

[0039] at least one processor;

[0040] and a memory communicatively coupled to the at least one processor;

[0041] The memory is used to store instructions executable by at least one processor, and the instructions are executed by at least one processor to enable the at least one processor to execute the video playback method provided by the first aspect and / or the second aspect.

[0042] In a seventh aspect, an embodiment of the present application provides a computer-readable storage medium, in which computer-executable instructions are stored. The computer-executable instructions are executed by a processor to implement the video playback method provided in the first aspect and / or the second aspect.

[0043] In an eighth aspect, an embodiment of the present application provides a program product, the program product comprising computer-executable instructions. When the computer-executable instructions are executed, the video playback method provided in the first aspect and / or the second aspect is implemented.

[0044] In a ninth aspect, an embodiment of the present application provides a computer program. When the computer program runs on a computer, the computer executes the video playback method provided in the first aspect and / or the second aspect.

[0045] The video playback method, apparatus, device, and storage medium provided in the embodiments of the present application are as follows: the server-side device obtains the network status of the network between the server-side device and the large screen in response to receiving a remote control playback instruction for a target video sent by a client device, and performs at least one of image frame mixing and image frame compression on the image frames contained in the target video according to the network status and the resolution of the large screen to obtain preprocessed video data corresponding to the target video, encodes the preprocessed video data to obtain encoded video data corresponding to the target video, and sends the encoded video data to the large screen to play the target video on the large screen. The present application reduces the amount of video data to be transmitted by performing at least one of image frame mixing and image frame compression on the image frames contained in the target video, thereby optimizing the transmission of the target video and reducing the probability of freezes or crashes when the target video is played on the remote control large screen.

[0046] Still other aspects will become apparent upon reading and understanding the accompanying drawings and detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0048] FIG1 is a schematic diagram of a video playback system provided in an embodiment of the present application;

[0049] FIG2 is a flow chart of a video playback method provided by an embodiment of the present application;

[0050] FIG3 is a flowchart of a video playback method provided by another embodiment of the present application;

[0051] FIG4 is a schematic diagram of encoding and decoding pull-down provided in an embodiment of the present application;

[0052] FIG5 is a schematic structural diagram of a video playback device provided in one embodiment of the present application;

[0053] FIG6 is a structural diagram of a video playback device provided in another embodiment of the present application;

[0054] FIG7 is a schematic structural diagram of an electronic device provided in one embodiment of the present application.

[0055] The above drawings illustrate specific embodiments of the present application, which will be described in more detail below. These drawings and the textual description are not intended to limit the scope of the present application in any way, but rather to illustrate the concepts of the present application to those skilled in the art by reference to specific embodiments. DETAILED DESCRIPTION

[0056] Exemplary embodiments will be described in detail herein, with examples illustrated in the accompanying drawings. In the following description, when referring to the drawings, identical numerals in different figures represent identical or similar elements, unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.

[0057] In one optional method, when using a terminal device to remotely control a large-screen program, if the large screen is used to run the program, all the computing power consumed is the computing power of the large-screen central processing unit (CPU). However, the CPU of the large screen is relatively backward, especially when running three-dimensional (3D) programs, the large screen will become hot and lag and crash.

[0058] Based on the above problems, the embodiment of the present application concentrates the computing power consumed by remote control of the large screen mainly on other ends outside the large screen, such as the remote control end, where the large screen is the remotely controlled end, and pre-processes the resources to be transmitted to the large screen to reduce the amount to be transmitted, so as to optimize the transmission and reduce the probability of the large screen being stuck or crashing.

[0059] FIG1 is a schematic diagram of a video playback system according to an embodiment of the present invention. As shown in FIG1 , a video playback system 10 includes a client device 11 , a server device 12 , and a large screen 13 .

[0060] Optionally, the server device 12 is connected to the client device 11 and the large screen 13 respectively.

[0061] For example, the server device 12 and the client device 11 may transmit remote control command data via the User Datagram Protocol (UDP), and the connection between the server device 12 and the large screen 13 may be a near field communication connection.

[0062] Specifically, the client device 11 is used to interact with the user to remotely control the large screen to play the target video; the server device 12 is used to obtain the network status of the network between the server device 12 and the large screen 13 in response to receiving the remote control playback instruction for the target video sent by the client device 11, and pre-process the image frames contained in the target video according to the network status and the resolution of the large screen, and encode the pre-processed video data corresponding to the target video, and further send the encoded video data to the large screen 13 to play the target video on the large screen 13; the large screen 13 is used to receive the encoded video data corresponding to the target video sent by the server device 12, and decode the encoded video data to obtain the decoded video data corresponding to the target video, further perform at least one of image frame decompression and image frame disassembly on the decoded video data, and play the processed image frames.

[0063] Furthermore, considering that when using a PC to remotely control a large screen, in chain stores or auto dealerships, each store may be equipped with one or two high-configuration PC hosts, which is costly and inconvenient. Therefore, optionally, both the client device 11 and the server device 12 are mobile terminals. Specifically, the client device 11 is loaded with a remote control application for interacting with the user to remotely control the large screen, and the server device 12 is loaded with a running program for playing the target video. For example, the running program can be a 3D program.

[0064] The video playback method provided in the embodiments of the present application is described in detail below with reference to specific embodiments.

[0065] FIG2 is a flow chart of a video playback method provided by an embodiment of the present application. It is applied to a server device in the above-mentioned video playback system. As shown in FIG2 , the video playback method specifically includes the following steps:

[0066] S201, in response to receiving a remote control playback instruction for a target video sent by a client device, obtaining a network status of a network between a server device and a large screen.

[0067] Optionally, both the server device and the client device are mobile terminals.

[0068] For example, the remote control playback instruction may be a finger sliding instruction or a color changing instruction.

[0069] Exemplarily, the data corresponding to the remote control playback instruction is transmitted based on the UDP protocol, wherein the instruction consists of a protocol number and content, and the first 8 bits of the instruction are the protocol number.

[0070] Optionally, the remote control playback instruction for the target video sent by the client device may be an encrypted binary instruction. Exemplarily, the instruction may be encrypted using MD5.

[0071] In one possible implementation, the user can perform obfuscation encryption based on the remote control playback instruction, then perform MD5 encryption, and then binary the MD5 encrypted result. The original instruction name is further bound to MD5 to facilitate version management, and the corresponding instruction set and MD5 json are generated to facilitate index search.

[0072] In one possible implementation, the server device decodes the remote play command before obtaining the network status. Specifically, the server device updates the JSON in real time, parses the binary, and obtains the remote play command after MD5. The server then searches the JSON for the corresponding remote play command. Once the remote play command is found, the first eight digits are the remote play command to be executed by the server device, and the remaining digits are any parameters.

[0073] Optionally, the network status of the network between the server device and the large screen is determined based on the real-time monitored network rate. Specifically, a network rate with a delay of less than 50MS (milliseconds) is determined to have a high-end network status, a network rate with a delay of less than 100MS (milliseconds) is determined to have a medium-end network status, and a network rate with a delay of more than 100MS (milliseconds) is determined to have a low-end network status.

[0074] S202 , preprocessing image frames included in the target video according to the network status and the large screen resolution to obtain preprocessed video data corresponding to the target video, wherein the preprocessing includes at least one of image frame mixing and image frame compression.

[0075] Optionally, different network states correspond to different preprocessing methods, and the better the network state, the higher the image quality corresponding to the preprocessed video data; and / or, different large-screen resolutions correspond to different preprocessing methods, and the higher the large-screen resolution, the higher the image quality corresponding to the preprocessed video data.

[0076] In one possible implementation, if the large-screen resolution is the first resolution, the image quality corresponding to the preprocessed video data is set to the first resolution, the second resolution, and the third resolution when the network status is high-end, mid-range, and low-end, respectively; if the large-screen resolution is the second resolution, the image quality corresponding to the preprocessed video data is set to the second resolution, the third resolution, and the fourth resolution when the network status is high-end, mid-range, and low-end, respectively.

[0077] For example, the first resolution may be 2k, the second resolution may be 1080P, the third resolution may be 720P, and the fourth resolution may be 480P.

[0078] Optionally, at least two frames are mixed during the image frame mixing process. For example, image frames A, B, and C are mixed to obtain image frame D. Correspondingly, before playing the target video on the large screen, image frame D is disassembled to obtain image frames A, B, and C.

[0079] Optionally, whether to perform frame blending on the image frames included in the target video is determined based on the network status. Specifically, when the network status is high, the image frames are not blended; when the network status is medium, two image frames are blended; when the network status is low, three image frames are blended.

[0080] Optionally, for a target image frame for image frame mixing, the target image frame is stored before the image frame mixing is performed.

[0081] Optionally, the image frames are compressed based on the network status. Specifically, when the network status is high, the image frames are compressed with a first preset value as the compression strength; when the network status is medium, the image frames are compressed with a second preset value as the compression strength; and when the network status is low, the image frames are compressed with a third preset value as the compression strength. For example, the first preset value may be 5, the second preset value may be 7, and the third preset value may be 9.

[0082] S203: Encode the preprocessed video data to obtain encoded video data corresponding to the target video.

[0083] The purpose of encoding is also to reduce the amount of data to be transmitted, and therefore, the embodiment of the present application does not limit the specific encoding method used for encoding. Optionally, the pre-processed video data is binary-encoded to obtain encoded video data corresponding to the target video.

[0084] S204: Send the encoded video data to the large screen to play the target video on the large screen.

[0085] In an embodiment of the present application, in response to receiving a remote control playback instruction for a target video sent by a client device, the network status of the network between the server device and the large screen is obtained, and according to the network status and the resolution of the large screen, at least one of image frame mixing and image frame compression is performed on the image frames contained in the target video to obtain preprocessed video data corresponding to the target video, the preprocessed video data is encoded to obtain encoded video data corresponding to the target video, and the encoded video data is sent to the large screen to play the target video on the large screen. By performing at least one of image frame mixing and image frame compression on the image frames contained in the target video, the transmission rate of the preprocessed video data corresponding to the target video is optimized, and low-stuttering playback of the target video on the large screen is achieved.

[0086] Based on the above embodiment, optionally, the image frames contained in the target video are preprocessed according to the network status and the large-screen resolution to obtain preprocessed video data corresponding to the target video, which specifically includes the following steps: if the video content of the target video contains a 3D scene, the target video is played frame by frame, and the rendering image is sampled in real time during the playback process; the 3D image frames corresponding to the 3D scene are converted into 2D image frames; according to the network status and the large-screen resolution, the 2D image frames are preprocessed to obtain preprocessed video data corresponding to the target video.

[0087] Exemplarily, the RenderTexture rendering image is sampled in real time during playback to convert the 3D scene into a 2D image.

[0088] The following describes the processing flow of the large screen after receiving the above-mentioned encoded video data with reference to FIG3 .

[0089] FIG3 is a flow chart of a video playback method provided by another embodiment of the present application. As shown in FIG3 , the video playback method specifically includes the following steps:

[0090] S301, receiving encoded video data corresponding to a target video sent by a server device, where the encoded video data is obtained by the server device through preprocessing and encoding the target video, where the preprocessing includes at least one of image frame mixing and image frame compression.

[0091] Specifically, the preprocessing and encoding methods are similar to those described above and will not be described in detail here.

[0092] S302: Decode the encoded video data to obtain decoded video data corresponding to the target video.

[0093] Optionally, if a correct compressed packet is obtained after decoding, the compressed packet is decompressed; if erroneous data is obtained, the compressed packet is discarded and the process continues to wait.

[0094] For example, if the encoding adopts binary encoding, the decoding adopts binary decoding accordingly.

[0095] It can be understood that the encoding and decoding methods of the video data corresponding to different playback platforms of the target video corresponding to the large screen can be the same encoding script and decoding script.

[0096] Exemplarily, the encoding and decoding methods of the video data may also be determined according to the playback platform of the target video corresponding to the large screen, and different platforms correspond to different encoding scripts and decoding scripts.

[0097] Figure 4 is a schematic diagram of the codec drop-down menu provided in an embodiment of the present application. As shown in Figure 4, by clicking the drop-down button 41 corresponding to the codec, the corresponding playback platform 42 is selected, and the encoding script and decoding script corresponding to the playback platform 42 are further determined based on the selected playback platform 42. Exemplary playback platforms can be Android playback platforms, Apple playback platforms, and television playback platforms (TV).

[0098] S303 , performing at least one of image frame decompression and image frame disassembly on the decoded video data, and playing the processed image frames.

[0099] Optionally, determine the preprocessing corresponding to the decoded video data, which preprocessing includes at least one of image frame mixing and image frame compression; if the preprocessing corresponding to the decoded video data includes image frame compression, perform image frame decompression on the decoded video data to obtain decompressed video data of the image frames corresponding to the target video; if the preprocessing corresponding to the decoded video data includes image frame mixing, perform image frame decompression on the decompressed video data to obtain processed image frames; and play the processed image frames.

[0100] Specifically, the first 8 bits of the binary are parsed to obtain whether the image frames are mixed. If three frames are mixed, the second and third frames are stored in the memory and the first frame is to be played; if two frames are mixed, the second frame is stored in the memory for playback.

[0101] The large screen loads the memory image frame in real time, stores it in the queue, and makes it into a stack and pop form. That is, the image frame is stored in the memory in real time in the previous step, and now the image frame is obtained from the memory in real time and stacked, and the image frame is popped out in real time for analysis and playback.

[0102] In an embodiment of the present application, encoded video data corresponding to a target video sent by a server device is received, the encoded video data is decoded to obtain decoded video data corresponding to the target video, the decoded video data is further subjected to at least one of image frame decompression processing and image frame disassembly processing, and the processed image frames are played, thereby reducing the computing power consumed when playing videos on a large screen and reducing the probability of the large screen being stuck or crashing.

[0103] To sum up, it can be understood that the video playback method provided in the embodiment of the present application, on the one hand, does not require an additional PC host, and can directly use existing mobile devices for graphics transmission, thereby achieving a low-cost effect. At the same time, using a mobile terminal instead of a PC host also improves convenience; on the other hand, without the need to provide a PC host, the computing power of the mobile device is utilized, and the computing power of the large screen is not consumed, thereby achieving a high-performance effect.

[0104] The following are device embodiments of the present application, which can be used to implement the method embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method embodiments of the present application.

[0105] Figure 5 is a schematic diagram of the structure of a video playback device provided in one embodiment of the present application. This device is used in a video playback system, where a server device is connected to the server device and a large screen. Users interact with the client device to remotely control the large screen to play a target video. As shown in Figure 5, the video playback device 50 includes an acquisition module 51, a preprocessing module 52, an encoding module 53, and a sending module 54.

[0106] The acquisition module 51 is used to obtain the network status of the network between the server device and the large screen in response to receiving the remote control playback instruction for the target video sent by the client device;

[0107] A preprocessing module 52 is configured to preprocess the image frames included in the target video according to the network status and the large screen resolution to obtain preprocessed video data corresponding to the target video, wherein the preprocessing includes at least one of image frame mixing and image frame compression;

[0108] The encoding module 53 is used to encode the pre-processed video data to obtain encoded video data corresponding to the target video;

[0109] The sending module 54 is used to send the encoded video data to the large screen so that the target video can be played on the large screen.

[0110] In one possible implementation, different network states correspond to different preprocessing methods. The better the network state, the higher the image quality corresponding to the preprocessed video data; and / or, different large-screen resolutions correspond to different preprocessing methods. The higher the large-screen resolution, the higher the image quality corresponding to the preprocessed video data.

[0111] In one possible implementation, the preprocessing module 52 is specifically used to: if the video content of the target video contains a 3D scene, play the target video frame by frame, and sample the rendering image in real time during the playback process; convert the 3D image frame corresponding to the 3D scene into a 2D image frame; preprocess the 2D image frame according to the network status and the large screen resolution to obtain the preprocessed video data corresponding to the target video.

[0112] In a possible implementation, the preprocessing includes image frame mixing and also includes a storage module (not shown) for storing the target image frame for image frame mixing before the image frame mixing is performed.

[0113] In a possible implementation, the encoding module 53 is specifically configured to perform binary encoding on the preprocessed video data to obtain encoded video data corresponding to the target video.

[0114] In a possible implementation, both the client device and the server device are mobile terminals.

[0115] The video playback device provided in this embodiment can be used to execute the method steps of the above method embodiment. The specific implementation method and technical effects are similar and will not be repeated here.

[0116] Figure 6 is a schematic diagram of the structure of a video playback device provided in another embodiment of the present application. Applied to a large screen within a video playback system, the video playback system further includes a client device and a server device connected to the client device and the large screen, respectively. A user interacts with the client device to remotely control the large screen to play a target video. As shown in Figure 6, the video playback device 60 includes a receiving module 61, a decoding module 62, and a playback module 63.

[0117] The receiving module 61 is configured to receive encoded video data corresponding to a target video sent by a server device, wherein the encoded video data is obtained by preprocessing and encoding the target video by the server device, wherein the preprocessing includes at least one of image frame mixing and image frame compression;

[0118] A decoding module 62 is used to decode the encoded video data to obtain decoded video data corresponding to the target video;

[0119] The playback module 63 is configured to perform at least one of image frame decompression and image frame disassembly on the decoded video data, and to play the processed image frames.

[0120] In one possible implementation, the playback module 63 is specifically used to: determine the preprocessing corresponding to the decoded video data, which preprocessing includes at least one of image frame mixing and image frame compression; if the preprocessing corresponding to the decoded video data includes image frame compression, then perform image frame decompression on the decoded video data to obtain decompressed video data of the image frames corresponding to the target video; if the preprocessing corresponding to the decoded video data includes image frame mixing, then perform image frame decompression on the decompressed video data to obtain processed image frames; and play the processed image frames.

[0121] In a possible implementation, both the client device and the server device are mobile terminals.

[0122] The video playback device provided in this embodiment can be used to execute the method steps of the above method embodiment. The specific implementation method and technical effects are similar and will not be repeated here.

[0123] It should be noted that it should be understood that the division of the various modules of the above device is merely a division of logical functions. In actual implementation, they can be fully or partially integrated into one physical entity, or they can be physically separated. Moreover, these modules can all be implemented in the form of software called by a processing element; or they can all be implemented in the form of hardware; or some modules can be implemented in the form of software called by a processing element, and some modules can be implemented in the form of hardware. For example, the processing module can be a separately established processing element, or it can be integrated into a chip of the above device. In addition, it can also be stored in the memory of the above device in the form of program code, and called by a processing element of the above device to perform the functions of the above processing module. The implementation of other modules is similar. In addition, these modules can all or partly be integrated together, or they can be implemented independently. The processing element here can be an integrated circuit with signal processing capabilities. In the implementation process, each step of the above method or each of the above modules can be completed by the hardware integrated logic circuit in the processor element or by instructions in the form of software.

[0124] For example, the above modules can be one or more integrated circuits configured to implement the above methods, such as one or more application-specific integrated circuits (ASICs), one or more microprocessors (DSPs), or one or more field programmable gate arrays (FPGAs). For another example, when a module is implemented by scheduling program code through a processing element, the processing element can be a general-purpose processor, such as a central processing unit (CPU) or other processor that can call program code. For another example, these modules can be integrated together and implemented in the form of a system-on-a-chip (SOC).

[0125] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When software is used for implementation, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website, computer, server or data center to another website, computer, server or data center by wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrations. Available media may be magnetic media (eg, floppy disks, hard disks, tapes), optical media (eg, Digital Video Discs (DVDs)), or semiconductor media (eg, solid state disks (SSDs)).

[0126] FIG7 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. As shown in FIG7 , the electronic device 70 may include one or more of the following components: a processing component 702 , a memory 704 , a power component 706 , a multimedia component 708 , an audio component 710 , an input / output (I / O) interface 712 , a sensor component 714 , and a communication component 716 .

[0127] The processing component 702 generally controls the overall operation of the electronic device 70, such as operations associated with display, phone calls, data communications, camera operation, and recording operations. The processing component 702 may include at least one processor 720 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 702 may include one or more modules to facilitate interaction between the processing component 702 and other components. For example, the processing component 702 may include a multimedia module to facilitate interaction between the multimedia component 708 and the processing component 702.

[0128] The memory 704 is configured to store various types of data to support operations on the electronic device 70. Examples of such data include instructions for any application or method operating on the electronic device 70, contact data, phone book data, messages, pictures, videos, etc. The memory 704 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.

[0129] The power component 706 provides power to the various components of the electronic device 70. The power component 706 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 70.

[0130] The multimedia component 708 includes a screen that provides an output interface between the electronic device 70 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor can not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 708 includes a front camera and / or a rear camera. When the electronic device 70 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have a focal length and optical zoom capability.

[0131] The audio component 710 is configured to output and / or input audio signals. For example, the audio component 710 includes a microphone (MIC), which is configured to receive external audio signals when the electronic device 70 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal can be further stored in the memory 704 or transmitted via the communication component 716. In some embodiments, the audio component 710 also includes a speaker for outputting audio signals.

[0132] I / O interface 712 provides an interface between processing component 702 and peripheral interface modules, such as a keyboard, click wheel, buttons, etc. These buttons may include but are not limited to: a home button, volume buttons, a start button, and a lock button.

[0133] The sensor assembly 714 includes one or more sensors for providing various aspects of status assessment for the electronic device 70. For example, the sensor assembly 714 can detect the open / closed state of the electronic device 70, the relative positioning of components, such as the display and keypad of the electronic device 70. The sensor assembly 714 can also detect changes in the position of the electronic device 70 or a component of the electronic device 70, the presence or absence of user contact with the electronic device 70, the orientation or acceleration / deceleration of the electronic device 70, and the temperature change of the electronic device 70. The sensor assembly 714 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 714 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 714 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0134] The communication component 716 is configured to facilitate wired or wireless communication between the electronic device 70 and other devices. The electronic device 70 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 716 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 716 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0135] In an exemplary embodiment, the electronic device 70 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above-described methods.

[0136] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 704 including instructions, and the instructions can be executed by the processor 720 of the electronic device 70 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0137] The electronic device of the embodiment of the present application can be used to execute the method steps in the above method embodiment. The specific implementation method and technical effects are similar and will not be repeated here.

[0138] An embodiment of the present application also provides a computer-readable storage medium, in which computer-executable instructions are stored. When the computer-executable instructions are executed by a processor, they are used to implement the method steps in the above-mentioned method embodiment. The specific implementation method and technical effect are similar and will not be repeated here.

[0139] The present application also provides a program product comprising computer-executable instructions. When the computer-executable instructions are executed, the method steps in the above method embodiment are implemented. The specific implementation methods and technical effects are similar and will not be described in detail here.

[0140] The embodiment of the present application also provides a computer program, which, when executed on a computer, enables the computer to execute the method steps in the above method embodiment. The specific implementation method and technical effect are similar and will not be repeated here.

[0141] Those skilled in the art will appreciate that all or part of the steps in the above method can be completed by instructing relevant hardware (such as a processor) through a program, and the program can be stored in a computer-readable storage medium, such as a read-only memory, a disk or an optical disk. Optionally, all or part of the steps in the above embodiment can also be implemented using one or more integrated circuits. Accordingly, each module / unit in the above embodiment can be implemented in the form of hardware, for example, by implementing its corresponding functions through an integrated circuit, or in the form of a software functional module, for example, by executing a program / instruction stored in a memory by a processor to implement its corresponding function. This application is not limited to any particular form of combination of hardware and software.

[0142] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present application that follow the general principles of the present application and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered as exemplary only, and the true scope and spirit of the present application are indicated by the following claims.

[0143] It should be understood that the present application is not limited to the exact structure described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

[0144] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

Claims

1. A video playback method, applied to a server device in a video playback system, wherein the video playback system further comprises a client device connected to the server device and a large screen, wherein a user interacts with the client device to remotely control the large screen to play a target video; The video playback method includes: In response to receiving a remote control playback instruction for the target video sent by the client device, obtaining a network status of a network between the server device and the large screen; Preprocessing the image frames included in the target video according to the network status and the large screen resolution to obtain preprocessed video data corresponding to the target video, wherein the preprocessing includes at least one of image frame mixing and image frame compression; Encoding the preprocessed video data to obtain encoded video data corresponding to the target video; The encoded video data is sent to the large screen so as to play the target video on the large screen.

2. The video playback method according to claim 1, wherein: Different network states correspond to different preprocessing methods. The better the network state, the higher the image quality corresponding to the preprocessed video data; and / or, different large-screen resolutions correspond to different preprocessing methods. The higher the large-screen resolution, the higher the image quality corresponding to the preprocessed video data.

3. The video playback method according to claim 1 or 2, wherein: Preprocessing the image frames included in the target video according to the network status and the large screen resolution to obtain preprocessed video data corresponding to the target video includes: If the target video contains a 3D scene, the target video is played frame by frame, and a rendering image is sampled in real time during the playback process; Converting the 3D image frame corresponding to the 3D scene into a 2D image frame; The 2D image frame is preprocessed according to the network status and the large screen resolution to obtain preprocessed video data corresponding to the target video.

4. The video playback method according to claim 1 or 2, wherein: The preprocessing includes image frame blending and further includes: For a target image frame for image frame mixing, the target image frame is stored before the image frame mixing is performed.

5. The video playback method according to claim 1 or 2, wherein: The encoding of the preprocessed video data to obtain encoded video data corresponding to the target video includes: The preprocessed video data is binary-encoded to obtain encoded video data corresponding to the target video.

6. A video playback method, applied to a large screen in a video playback system, wherein the video playback system further comprises a client device and a server device connected to the client device and the large screen, respectively, wherein a user interacts with the client device to remotely control the large screen to play a target video; The video playback method includes: Receiving encoded video data corresponding to the target video sent by the server device, where the encoded video data is obtained by the server device preprocessing and encoding the target video, where the preprocessing includes at least one of image frame mixing and image frame compression; Decoding the encoded video data to obtain decoded video data corresponding to the target video; The decoded video data is subjected to at least one of image frame decompression and image frame disassembly, and the processed image frames are played.

7. The video playback method according to claim 6, wherein: The performing at least one of image frame decompression and image frame disassembly on the decoded video data and playing the processed image frames includes: Determining preprocessing corresponding to the decoded video data, the preprocessing comprising at least one of image frame mixing and image frame compression; If the preprocessing corresponding to the decoded video data includes image frame compression, performing image frame decompression processing on the decoded video data to obtain video data after image frame decompression corresponding to the target video; If the pre-processing corresponding to the decoded video data includes image frame mixing, performing image frame decompression on the decompressed video data to obtain the processed image frames; Play the processed image frame.

8. A video playback system comprising: A client device, a server device and a large screen, wherein the server device is connected to the client device and the large screen respectively; The client device is used to interact with the user to remotely control the large screen to play the target video; The server device is configured to execute the video playback method according to any one of claims 1 to 5; The large screen is used to execute the video playback method according to any one of claims 6 or 7.

9. A video playback device, applied to a server device in a video playback system. The video playback system also includes a client device and a large screen connected to the server device. A user interacts with the client device to remotely control the large screen to play a target video. The video playback device comprises: an acquisition module, configured to acquire a network status of a network between the server device and the large screen in response to receiving a remote control playback instruction for the target video sent by the client device; a preprocessing module, configured to preprocess the image frames included in the target video according to the network status and the large screen resolution to obtain preprocessed video data corresponding to the target video, wherein the preprocessing includes at least one of image frame mixing and image frame compression; An encoding module, configured to encode the preprocessed video data to obtain encoded video data corresponding to the target video; The sending module is used to send the encoded video data to the large screen so as to play the target video on the large screen.

10. A video playback device, applied to a large screen in a video playback system, wherein the video playback system further comprises a client device and a server device connected to the client device and the large screen, respectively, wherein a user interacts with the client device to remotely control the large screen to play a target video; The video playback device comprises: a receiving module, configured to receive encoded video data corresponding to the target video sent by the server device, wherein the encoded video data is obtained by the server device preprocessing and encoding the target video, wherein the preprocessing includes at least one of image frame mixing and image frame compression; A decoding module, configured to decode the encoded video data to obtain decoded video data corresponding to the target video; The playing module is used to perform at least one of image frame decompression and image frame disassembly on the decoded video data, and play the processed image frames.

11. An electronic device comprising: at least one processor; and a memory communicatively coupled to the at least one processor; The memory is used to store instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the video playback method according to any one of claims 1 to 7.

12. A computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, wherein the computer-executable instructions, when executed by a processor, are used to implement the video playback method according to any one of claims 1 to 7.

13. A computer program product, comprising a computer program, wherein when the computer program is executed, the video playback method according to any one of claims 1 to 7 is implemented. 14 . A computer program, wherein when the computer program is run on a computer, the computer executes the video playing method according to claim 1 .

Images