Video processing method, device, equipment, readable storage medium and product

Abstract

The embodiment of the present application discloses a video processing method, device, equipment, readable storage medium and product, wherein the method includes: obtaining decoded data of a video, and data attribute information of the decoded data; the data attribute information is used to reflect the data storage form of the decoded data; encapsulating the data attribute information of the decoded data according to the target encapsulation format to obtain encapsulated data; sending the encapsulated data to a video receiving end, so that the video receiving end decapsulates the encapsulated data according to the target encapsulation format to obtain the data attribute information, and reads the decoded data based on the data attribute information, and performs screen processing on the decoded data. The embodiment of the present application can improve the efficiency of video processing.

Description

Technical Field

[0001] The present application relates to the field of video processing technology, and in particular to a video processing method, device, equipment, readable storage medium and product. Background Art

[0002] With the development of mobile Internet, video playback has become one of the important functions of terminal devices such as smart phones and tablets. In the process of video playback, it is generally necessary to decode the encoded data of the video to obtain the decoded data of the video, transfer the decoded data to the texture by data copying, perform video optimization processing on the decoded data on the texture, and then render and display the video data after video optimization processing.

[0003] Since this method needs to copy the decoded data before performing video optimization processing, this method will increase the video processing time and reduce the video processing efficiency. Summary of the invention

[0004] The embodiments of the present application provide a video processing method, apparatus, device, readable storage medium and product, which can improve video processing efficiency.

[0005] In a first aspect, the present application provides a video processing method, comprising:

[0006] Obtaining decoded data of a video and data attribute information of the decoded data; the data attribute information is used to reflect the data storage form of the decoded data;

[0007] Encapsulating the data attribute information of the decoded data according to the target encapsulation format to obtain encapsulated data;

[0008] The encapsulated data is sent to the video receiving end, so that the video receiving end decapsulates the encapsulated data according to the target encapsulation format, obtains the data attribute information, reads the decoded data based on the data attribute information, and processes the decoded data on the screen.

[0009] In a second aspect, the present application provides another video processing method, comprising:

[0010] receiving encapsulated data sent by a video transmitting end; the encapsulated data is obtained by encapsulating data attribute information according to a target encapsulation format, and the data attribute information is used to reflect the data storage format of the decoded data;

[0011] Decapsulating the encapsulated data according to the target encapsulation format to obtain the data attribute information, and reading the decoded data based on the data attribute information;

[0012] The decoded data is processed to be displayed on the screen.

[0013] In a third aspect, the present application provides a video processing device, including:

[0014] A data acquisition unit, used to acquire decoded data of a video and data attribute information of the decoded data; the data attribute information is used to reflect the data storage form of the decoded data;

[0015] A data encapsulation unit, used for encapsulating the data attribute information of the decoded data according to a target encapsulation format to obtain encapsulated data;

[0016] The data sending unit is used to send the encapsulated data to the video receiving end, so that the video receiving end decapsulates the encapsulated data according to the target encapsulation format, obtains the data attribute information, reads the decoded data based on the data attribute information, and performs screen processing on the decoded data.

[0017] In a fourth aspect, the present application provides a video processing device, including:

[0018] A data receiving unit is used to receive encapsulated data sent by a video transmitting end; the encapsulated data is obtained by encapsulating data attribute information according to a target encapsulation format, and the data attribute information is used to reflect the data storage form of the decoded data;

[0019] A data decapsulation unit, configured to decapsulate the encapsulated data according to the target encapsulation format, obtain the data attribute information, and read the decoded data based on the data attribute information;

[0020] The data display unit is used to process the decoded data on the screen.

[0021] In a fifth aspect, the present application provides a computer device, including: a processor, a memory, and a network interface;

[0022] The above-mentioned processor is connected to a memory and a network interface, wherein the network interface is used to provide a data communication function, the above-mentioned memory is used to store computer program code, and the above-mentioned processor is used to call the above-mentioned computer program code so that a computer device including the processor executes the video processing method of the first aspect, or executes the video processing method of the second aspect.

[0023] In a sixth aspect, the present application provides a computer-readable storage medium, which stores a computer program, and the computer program is suitable for being loaded and executed by a processor so that a computer device having the processor executes the video processing method of the first aspect above, or executes the video processing method of the second aspect above.

[0024] In the seventh aspect, the present application provides a computer program product or a computer program, which includes computer instructions. When the computer instructions are executed by a processor, they implement the video processing method of the first aspect mentioned above, or execute the video processing method of the second aspect mentioned above.

[0025] In an embodiment of the present application, the decoded data of the video and the data attribute information of the decoded data are obtained; the data attribute information is used to reflect the data storage form of the decoded data; the data attribute information of the decoded data is encapsulated and processed according to the target encapsulation format to obtain encapsulated data; the encapsulated data is sent to the video receiving end, so that the video receiving end decapsulates the encapsulated data according to the target encapsulation format to obtain the data attribute information, and the decoded data is read based on the data attribute information, and the decoded data is processed on the screen. Since this method only needs to transmit the data attribute information of the decoded data, the decoded data can be read based on the data attribute information, and there is no need to copy the decoded data itself, so the data processing efficiency can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0027] Figure 1 is a network architecture diagram of a video processing system provided in an embodiment of the present application;

[0028] Figure 2 It is a flowchart of a video processing method provided by an embodiment of the present application;

[0029] Figure 3 is a schematic diagram of a video playback scenario provided by an embodiment of the present application;

[0030] Figure 4 is a schematic diagram of another video playback scenario provided by an embodiment of the present application;

[0031] Figure 5 This is another schematic diagram of a video playback scenario provided by an embodiment of the present application;

[0032] Figure 6 It is a schematic diagram of the composition structure of a packaging format provided in an embodiment of the present application;

[0033] Figure 7 It is a schematic diagram of the composition structure of a video playback system provided in an embodiment of the present application;

[0034] Figure 8is a flowchart of another video processing method provided in an embodiment of the present application;

[0035] Fig. 9 It is a flowchart of another video processing method provided in an embodiment of the present application;

[0036] Fig.10 is a schematic diagram of the composition structure of a video processing device provided in an embodiment of the present application;

[0037] Fig.11 is a schematic diagram of the composition structure of another video processing device provided in an embodiment of the present application;

[0038] Fig.12 It is a schematic diagram of the composition structure of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0039] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0040] The technical solution of the present application can be applied to the scene of processing the decoded data of the video so as to play the decoded data of the video. For example, it can be applied to the video playback system, by encapsulating the decoded data of the video to obtain encapsulated data, and by transmitting the encapsulated data, the decoded data of the video can be processed based on the encapsulated data later, without the need for data copying, which can improve the video processing efficiency.

[0041] It should be noted that the collection, use and processing of relevant data involved in the embodiments of the present application, such as decoded data, data attribute information, target encapsulation format, etc., require the consent of the corresponding personal information subject and must comply with the provisions of relevant laws and regulations.

[0042] Please refer to Figure 1 , Figure 1 is a network architecture diagram of a video processing system provided in an embodiment of the present application, such as Figure 1 As shown, the computer device can exchange data with the terminal device, and the number of the terminal devices can be one or at least two. For example, when the number of the terminal devices is multiple, the terminal device may include Figure 1The terminal device 101a, the terminal device 101b and the terminal device 101c in the embodiment of the present invention are shown in FIG. 1. Taking the terminal device 101a as an example, the computer device 102 can obtain the decoded data of the video and the data attribute information of the decoded data. Further, the computer device 102 can encapsulate the data attribute information of the decoded data according to the target encapsulation format to obtain encapsulated data. Optionally, the computer device 102 can send the encapsulated data to the video receiving end. For example, the video receiving end can be installed in the terminal device 101a, and the decoded data can be displayed on the terminal device 101a.

[0043] The computer device mentioned in the embodiments of the present application may refer to a server or a terminal device, or may also be a system composed of a server and a terminal device, which is not limited in the embodiments of the present application. The terminal device may be an electronic device, including but not limited to a mobile phone, a tablet computer, a laptop computer, a vehicle-mounted device, etc. The server mentioned above may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, and big data and artificial intelligence platforms.

[0044] For further information, see Figure 2 , Figure 2 It is a flowchart of a video processing method provided by an embodiment of the present application; the execution subject of the video processing method may be a video sending end, which may refer to a video processing module or other modules that can implement video processing functions, and the video processing module may be a module deployed in a video player, or a module deployed on a terminal device that needs to play a video, or a platform or background server for implementing video processing functions, etc., and the embodiments of the present application do not limit this. Figure 2 As shown, the video processing method includes but is not limited to the following steps:

[0045] S101, obtaining decoded video data and data attribute information of the decoded data.

[0046] In one scenario, see Figure 3 , Figure 3 This is a schematic diagram of a video playback scenario provided by an embodiment of the present application. After obtaining the encoded data of the video, the encoded data of the video is decoded by the video decoding module to obtain decoded data. The decoded data can be displayed on the display screen of the terminal device by rendering the decoded data.

[0047] In this scenario, the terminal device may refer to a device with a video player installed. By installing the video player on the terminal device, video data can be played on the terminal device. Since this video playback method only displays the decoded data of the video and does not perform video post-processing, such as video optimization, on the decoded data of the video, the decoded data displayed by this video playback method may have poor video quality.

[0048] In another scenario, see Figure 4 , Figure 4 This is another scene diagram of video playback provided by an embodiment of the present application. After the encoded data of the video is obtained, the encoded data of the video is decoded by a video decoding module to obtain decoded data. The decoded data is generally decoded in the memory of the terminal device. Furthermore, the decoded data in the memory is transferred to the texture by means of data copying. When the decoded data needs to be post-processed later, the video post-processing can be performed in the texture. For example, video post-processing can refer to video optimization processing of the decoded data, thereby improving the video quality, and so on. Furthermore, by rendering and displaying the decoded data of the video post-processing, the optimized video data can be displayed on the display screen of the terminal device.

[0049] In this scenario, since this video playback method performs video post-processing on the decoded data, it can improve the video quality and the video playback experience. However, this video processing method requires copying the decoded data, so this video processing method will result in low video processing efficiency and low video playback efficiency.

[0050] In view of this, the embodiment of the present application provides a video processing method, which can realize video post-processing without copying the decoded data, thereby improving the video processing efficiency and further improving the video playback efficiency. Figure 5 , Figure 5 It is another scene diagram of video playback provided by an embodiment of the present application. After obtaining the encoded data of the video, the encoded data of the video is decoded by the video decoding module to obtain decoded data. Further, the data attribute information of the decoded data can be obtained, and the data attribute information of the decoded data is encapsulated to obtain encapsulated data. By transmitting the encapsulated data to a video receiving end such as a video post-processing module, the video post-processing module can unpack the encapsulated data to obtain the data attribute information, so that the decoded data can be read from the memory. Furthermore, the video post-processing module can also perform video post-processing on the decoded data. By rendering and displaying the decoded data of the video post-processing, the video data after video post-processing can be displayed on the display screen of the terminal device. Since the decoded data is subjected to video post-processing, the video quality can be improved and the video playback experience can be improved.

[0051] Among them, the video receiving end may refer to a video post-processing module, for example, and the video post-processing module may be a module, component or program code deployed in a video player, etc. The video receiving end may also refer to other modules for implementing the post-processing function of the decoded data, which is not limited in the embodiments of the present application. It can be understood that the video processing module is used to implement the transmission function of the decoded data, that is, to enable the video post-processing module to obtain the decoded data. The video post-processing module is used to implement video post-processing of the decoded data, and the two modules process the decoded data in different ways. Since this video processing method does not require data copying of the decoded data, this video processing method can improve the video processing efficiency, thereby improving the video playback efficiency.

[0052] In an embodiment of the present application, the video processing module can obtain the decoded data of the video and the data attribute information of the decoded data. For example, when the uploading device of the initial video data obtains the initial video data, in order to facilitate the transmission of the video data, the initial video data can be encoded and processed to obtain the encoded data of the video, thereby sending the encoded data of the video to the video processing module. Then the video processing module can obtain the encoded data of the video, and obtain the decoded data of the video by decoding the encoded data of the video. The encoding process is used to encode the initial video data into encoded data, and the decoding process is used to decode the encoded data into decoded data. The encoding process can be the inverse process of the decoding process, and the decoded data is the initial video data. By encoding the video file to obtain the encoded data, the size of the video file can be compressed, thereby improving the efficiency of video transmission. By decoding the encoded data, the encoded data can be restored to the initial video data, which is convenient for subsequent video playback.

[0053] Furthermore, the decoded data may be analyzed to obtain data attribute information of the decoded data. The data attribute information is used to reflect the data storage form of the decoded data. For example, the data attribute information may be used to indicate the storage location of the decoded data in the memory of the terminal device, the data storage method of the decoded data, and so on. By obtaining the data attribute information of the decoded data, the decoded data of the corresponding data storage method may be subsequently read from the corresponding storage location based on the data attribute information.

[0054] Optionally, the initial video data in the embodiment of the present application may include but is not limited to online streaming media files, local media files, real-time recorded video data, etc. In the embodiment of the present application, a video source input of a terminal device may be received, where the video source may refer to encoded data, and a video decoding module such as a video decoder on the terminal device is used to decode the encoded data to obtain decoded data, thereby obtaining decoded data of the video.

[0055] S102, encapsulating the data attribute information of the decoded data according to the target encapsulation format to obtain encapsulated data.

[0056] In the embodiment of the present application, the data attribute information of the decoded data is encapsulated according to the target encapsulation format to obtain the encapsulated data. After the encapsulated data is obtained, the encapsulated data can be unpacked according to the target encapsulation format to obtain the data attribute information, and then the decoded data can be read based on the data attribute information. By encapsulating the data attribute information of the decoded data according to the target encapsulation format, data transmission can be facilitated.

[0057] The target encapsulation format may refer to a data transmission protocol agreed upon by the video transmitter and the video receiver. By adopting the agreed data transmission protocol to encapsulate the data attribute information of the decoded data, encapsulated data that complies with the data transmission protocol may be obtained, so that data transmission may be performed. After receiving the encapsulated data, the video receiver may decapsulate the encapsulated data according to the data transmission protocol, restore the data attribute information, and then read the decoded data based on the data attribute information for subsequent processing. The encapsulated data may refer to the data attribute information after encapsulation according to the target encapsulation format.

[0058] In one embodiment, the target encapsulation format may include at least one of the image width of the video, the image height of the video, the pixel format of the video, the storage address of the video, and the video timestamp. Since the image width and image height of the video may indicate the video screen of the video, and the pixel format of the video may refer to the storage format of the video, the storage address of the video may be used to reflect the storage location of the video on the terminal device, for example, it may reflect the storage path of the video in the memory of the terminal device. The video timestamp may indicate the duration of the video displayed on the display screen, so by encapsulating at least one of these information in any video, the corresponding video data may be read based on these information later, so that the acquired video may be subsequently processed.

[0059] In one embodiment, since the target encapsulation format may include at least one of the image width of the video, the image height of the video, the pixel format of the video, the storage address of the video, and the video timestamp, the data attribute information of the decoded data may include at least one of the image width of the decoded data, the image height of the decoded data, the pixel format of the decoded data, the storage address of the decoded data, and the video timestamp of the decoded data. For example, if the target encapsulation format may include the storage address of the video, the data attribute information of the decoded data may include the storage address of the decoded data. For example, if the target encapsulation format may include the image width and, the image height of the video, and the storage address of the video, the data attribute information of the decoded data may include the image width of the decoded data, the image height of the decoded data, and the storage address of the decoded data.

[0060] Among them, the image width of the decoded data may refer to the width of the image screen displayed by the decoded data on the display screen, the image height of the decoded data may refer to the height of the image screen displayed by the decoded data on the display screen, and the pixel format of the decoded data may refer to the storage method of the video data in the memory. For example, the pixel format may include but is not limited to YUV (a color encoding method) and RGB (another color encoding method). The encoded data can be encoded and stored in the memory using a variety of different pixel formats, and the image restoration method corresponding to the data of each pixel format is different. Therefore, by encapsulating the pixel format of the decoded data, when the decoded data is read at the corresponding storage address in the memory later, it can be determined which pixel format of the decoded data is read. The storage address of the decoded data may refer to the specific storage location of the decoded data in the memory. The video timestamp of the decoded data can be used to reflect the duration of each frame of the video image in the decoded data displayed on the display screen.

[0061] In the embodiment of the present application, since the decoded data is generally composed of multiple video frames, when the data attribute information of the decoded data is encapsulated, the data attribute information of each video frame can be obtained separately for encapsulation processing to obtain the encapsulation data corresponding to each video frame, so as to use the encapsulation data corresponding to each video frame as the encapsulation data corresponding to the decoded data. For example, the encapsulation data corresponding to the decoded data may include at least one of the image width of each video frame in the decoded data, the image height of each video frame, the pixel format of each video frame, the storage address of each video frame, and the video timestamp of each video frame. The video timestamp of each video frame may refer to the duration of each video frame displayed on the display screen.

[0062] In the embodiment of the present application, the data attribute information of each frame of the video image in the encoded data is respectively encapsulated to obtain encapsulated data. During data transmission, the stability and integrity of the data transmission can be guaranteed, thereby improving the subsequent video playback experience.

[0063] In an optional implementation, the video transmitter and the video receiver can pre-agree on a target encapsulation format, and then when the video receiver receives the encapsulated data, it can decapsulate the encapsulated data based on the pre-agreement target encapsulation format to obtain data attribute information. Alternatively, when the encapsulated data is sent to the video receiver, the target encapsulation format can be sent to the video receiver, so that when the video receiver receives the encapsulated data, it can decapsulate the encapsulated data using the received target encapsulation format to obtain data attribute information. Optionally, the target encapsulation format can be changed at regular intervals, and after the target encapsulation format is changed, the changed target encapsulation format is sent to the video receiver to improve data transmission security, etc.

[0064] In a possible scenario, for example, the decoded data obtained is data sent by a target terminal device, and the data attribute information may include the image width (width) of the decoded data, the image height (height) of the decoded data, the pixel format (format) of the decoded data, the storage address (buffer) of the decoded data, and the video timestamp (timestamp) of the decoded data. The target terminal device may refer to a device equipped with a target video player, which is used to play the decoded data in the target pixel format.

[0065] Since the target terminal device is a device with a target video player installed, and the target video player is used to play decoded data in the target pixel format, it can be determined that the pixel format of the decoded data is the target pixel format. When the data attribute information of the decoded data is packaged, since the pixel format of the decoded data has been determined, the pixel format of the decoded data does not need to be packaged. This is equivalent to presetting the pixel format of the decoded data. Therefore, after the subsequent video receiving end receives the packaged data, it can obtain the decoded data of the set pixel format from the corresponding position according to the pre-set setting, thereby reducing the amount of data in the packaged data, reducing the size of the packaged data, and improving data transmission efficiency.

[0066] In an optional implementation scenario, it is also possible to determine which attribute information in the data attribute information of the decoded data is encapsulated in combination with the initial source of the initial video data to obtain the corresponding encapsulated data. The initial source of the initial video data can reflect the terminal device that collects the initial video data. If the pixel format supported by the terminal device that collects the initial video data is a fixed pixel format, the image width of the decoded data, the image height of the decoded data, the storage address of the decoded data, and the video timestamp of the decoded data in the data attribute information can be encapsulated to obtain encapsulated data. Alternatively, it is also possible to determine which attribute information in the data attribute information of the decoded data is encapsulated in combination with the identifier of the terminal device associated with the video receiving end or other factors to obtain the corresponding encapsulated data. The corresponding data attribute information is subsequently unpacked, and the decoded data is read from the memory based on the obtained attribute information, and then displayed on the display screen. Since one or more of the data attribute information of the decoded data can be selected for encapsulation to obtain encapsulated data, the flexibility of data encapsulation can be improved.

[0067] Optionally, see Figure 6 , Figure 6 It is a schematic diagram of the composition structure of a packaging format provided in an embodiment of the present application. For example, the target packaging format includes data attribute information that may include the image width of the decoded data, the image height of the decoded data, the pixel format of the decoded data, the storage address of the decoded data, and the video timestamp of the decoded data.

[0068] In one embodiment, the decoded data may refer to the data obtained by decoding the encoded data of the video using a hard decoding method. For example, the hard decoding method may refer to decoding the encoded data of the video using a hard decoder to obtain the decoded data of the video. By decoding the encoded data using a hard decoder, the hard decoder can convert the encoded data into decoded data that can be used for video post-processing. Compared with decoding the encoded data using a soft decoding method, the hard decoding method can improve decoding efficiency and reduce power consumption of terminal equipment.

[0069] In an embodiment of the present application, the video processing module encapsulates the data attribute information of the decoded data according to the target encapsulation format to obtain encapsulated data; the method of sending the encapsulated data to the video receiving end can be called data transparent transmission, that is, a transmission method in which the decoded data is not copied. The decoded data is transmitted to the video receiving end by data transparent transmission, and the video receiving end unpacks the encapsulated data to obtain the data attribute information, thereby reading the decoded data from the storage address of the decoded data based on the data attribute information for video post-processing. Since this method does not require data copying of the decoded data, a large amount of computing resources can be saved, and the impact of large-scale data copying on the performance and power consumption of the terminal device can be avoided. Since there is no need to process the decoded data, the decoded data is transmitted to the video receiving end for video post-processing, which can avoid repeated copying of the decoded data, thereby improving data processing efficiency.

[0070] S103, sending the encapsulated data to the video receiving end, so that the video receiving end decapsulates the encapsulated data according to the target encapsulation format, obtains data attribute information, reads decoded data based on the data attribute information, and processes the decoded data on the screen.

[0071] In the embodiment of the present application, since the video transmitting end sends the encapsulated data to the video receiving end, the video receiving end can unpack the encapsulated data according to the target encapsulation format, obtain data attribute information, and read the decoded data based on the data attribute information, and perform screen processing on the decoded data. For example, the video receiving end can read the decoded data that conforms to the data storage form of the decoded data based on the corresponding storage address in the memory of the terminal device, so that the decoded data can be processed on the screen. Among them, the display screen can refer to a display device used by the terminal device to display the video, such as a display screen. Performing screen processing on the decoded data can refer to rendering the decoded data, and sending the rendered decoded data to the display screen for display. Alternatively, performing screen processing on the decoded data can also refer to performing subsequent processing such as video post-processing on the decoded data, rendering the decoded data after the video post-processing, and sending the rendered decoded data to the display screen for display. That is, after receiving the decoded data, the video receiving end can further perform video post-processing on the decoded data, so that the image quality of the decoded data after the video post-processing is clearer, and the video playback effect is improved. The specific video post-processing method can refer to the description of step S203 below, and no further explanation is given here.

[0072] Optionally, see Figure 7 , Figure 7It is a schematic diagram of the composition structure of a video playback system provided by an embodiment of the present application. The video playback system can be installed on any terminal device with a video playback function. The video playback system may include a video player, a video processing module, and a video post-processing module. Among them, the video player may include a perception layer (such as a Java layer), a data transmission layer, i.e., a JNI layer (Java Native Interface, local service interface layer), and a kernel layer. The kernel layer may include a file storage module (Demuxer), a video decoder, and a rendering module. The video decoder may include a hard decoding module and a soft decoding module. The video processing module may refer to a module with a data transparent transmission function deployed on the terminal device. The perception layer may be used to perceive object behavior, and the data transmission layer may be used to transmit the storage location of the video data to be played. The kernel layer may be used to store decoded data, and the file storage module may store merged video data in multiple formats, i.e., the merged video data includes video data and audio data. The video decoder is used to perform decoding processing. For example, the hard decoding module may be used to decode the decoded data using a hard decoding method, and the soft decoding module may be used to decode the decoded data using a soft decoding method. The rendering module is used to render the video data to display the rendered video data on the display screen.

[0073] Specifically, after receiving the decoded data, the terminal device can perceive the object behavior through the perception layer, such as perceiving the click behavior of the user of the terminal device on the decoded data. The object may refer to the user of the terminal device or the computer device. The click behavior may include the click behavior on the local video data of the terminal device, or the click behavior on any video in the application running on the terminal device. The perception layer further transmits the click behavior to the data transmission layer, and the data transmission layer transmits the uniform resource locator (URL) storage location of the video data associated with the click behavior to the kernel layer. The file storage module in the kernel layer can download the video data from the URL storage location. At this time, the downloaded video data refers to the encoded data of the video, and the video decoder in the kernel layer can decode the encoded data to obtain the decoded data. For example, the video decoder can split the encoded data into an encoded video signal and an encoded audio signal, and use the hard decoding module in the video decoder to decode the encoded video signal in a hard decoding manner to obtain the decoded data. The decoded data is transmitted to the video post-processing module through the video processing module, and the decoded data is post-processed by the video post-processing module, and the decoded data after the video post-processing is transmitted to the rendering module. The decoded data after video post-processing is rendered by the rendering module, so that the post-processed video data is displayed on the display screen.

[0074] Optionally, the video processing module may refer to an AImageReader module, for example, and the target encapsulation format may refer to an AImage encapsulation format, for example. Figure 6 The video post-processing module may refer to the HI AI Foundation module.

[0075] In an optional implementation, data attribute information of the decoded data may be obtained and sent to a video receiving end, so that the video receiving end reads the decoded data based on the data attribute information and processes the decoded data on the screen.

[0076] In an embodiment of the present application, by directly sending the data attribute information of the unpacked data to the video receiving end, such as a video post-processing module, the video post-processing module can read the decoded data from the memory according to the data attribute information, so that the decoded data can be processed on the screen. Since the video post-processing module does not need to copy the data when post-processing the decoded data, the video processing efficiency can be improved.

[0077] In the embodiment of the present application, by using a hard decoder for video decoding, compared with soft decoding, hard decoding can improve the efficiency of video processing, reduce the power consumption of the device, and extend the battery life of the terminal device. Furthermore, by using data transparent transmission to transmit the decoded data to the video post-processing module for processing, the number of memory copies can be reduced, the data transmission efficiency can be improved, and the power consumption of the device can be reduced.

[0078] In an embodiment of the present application, the decoded data of the video and the data attribute information of the decoded data are obtained; the data attribute information is used to reflect the data storage form of the decoded data; the data attribute information of the decoded data is encapsulated and processed according to the target encapsulation format to obtain encapsulated data; the encapsulated data is sent to the video receiving end, so that the video receiving end decapsulates the encapsulated data according to the target encapsulation format to obtain the data attribute information, and the decoded data is read based on the data attribute information, and the decoded data is processed on the screen. Since this method only needs to transmit the data attribute information of the decoded data, the decoded data can be read based on the data attribute information, and there is no need to copy the decoded data itself, so the data processing efficiency can be improved.

[0079] For further information, see Figure 8 , Figure 8 is a flow chart of another video processing method provided in an embodiment of the present application; Figure 8As shown, the execution subject of the video processing method may be a video receiving end, which may refer to a video post-processing module or other modules that can implement video post-processing functions. The video post-processing module may be a module deployed in a video player, or a module deployed on a terminal device that needs to play a video, or a platform or background server that implements post-processing, etc. The embodiment of the present application does not limit this. The video processing method includes but is not limited to the following steps:

[0080] S201, receiving encapsulated data sent by a video sending end.

[0081] In an embodiment of the present application, a video receiving end may receive encapsulated data sent by a video transmitting end. Encapsulated data is obtained by encapsulating data attribute information according to a target encapsulation format, and the data attribute information is used to reflect the data storage form of decoded data. Decoded data may refer to data obtained by decoding encoded data of a video, and encoded data of a video may refer to data obtained by encoding a video file.

[0082] Among them, the video receiving end and the video sending end can be deployed in a video player, or can be deployed on a terminal device equipped with a video player, and the embodiment of the present application does not limit this. The video sending end can, for example, refer to a video processing module, which can be used to encapsulate the decoded data of the video to obtain encapsulated data, and send the encapsulated data to the video receiving end. The video receiving end can refer to a video post-processing module. By receiving the encapsulated data sent by the video processing module, the video post-processing module can perform corresponding processing on the encapsulated data, thereby reading the corresponding video data. The specific process of encapsulating the decoded data of the video can refer to the description in the above step S101, which will not be repeated here.

[0083] S202, decapsulating the encapsulated data according to the target encapsulation format to obtain data attribute information, and reading decoded data based on the data attribute information.

[0084] In an embodiment of the present application, the video processing module and the video post-processing module can agree on a target encapsulation format, so that when the encapsulated data is obtained, the video post-processing module can decapsulate the encapsulated data according to the target encapsulation format, obtain data attribute information, and read the decoded data based on the data attribute information.

[0085] In one embodiment, the data attribute information may include at least one of the image width of the decoded data, the image height of the decoded data, the pixel format of the decoded data, the storage address of the decoded data, and the video timestamp of the decoded data. For example, when the data attribute information includes the image width of the decoded data, the image height of the decoded data, the pixel format of the decoded data, the storage address of the decoded data, and the video timestamp of the decoded data, the decoded data may be read in the following manner:

[0086] The video data to be assembled having the same pixel format as the decoded data is read from the storage address of the decoded data; the video data to be assembled is assembled according to the image width of the decoded data, the image height of the decoded data and the video timestamp of the decoded data to obtain the decoded data.

[0087] Among them, when the encoded data is decoded to obtain decoded data, the decoded data can be stored in the memory of the terminal device, for example, it can be stored in the memory of the terminal device according to the set rules. At this time, the decoded data stored in the memory can be called video data to be assembled, and the video data to be assembled needs to be assembled to obtain encapsulated data. Therefore, when reading the decoded data, the video data to be assembled can be read from the memory of the terminal device according to the set rules, and the video data to be assembled is assembled to obtain decoded data. It can be understood that the video data to be assembled in the memory may include video data of multiple video widths and video heights and multiple video pixel formats, and the encapsulated data obtained by assembling according to different video widths and video heights and different pixel formats is different.

[0088] In the embodiment of the present application, by agreeing on the target encapsulation format, after obtaining the encapsulated data, the target encapsulation format can be used to perform decapsulation processing to obtain data attribute information, and then the encapsulated data can be read based on the data attribute information. Since there is no need to repeatedly copy the decoded data, the video processing efficiency can be improved.

[0089] S203, processing the decoded data to be displayed on the screen.

[0090] In the embodiment of the present application, since the encapsulated data is read, it is equivalent to restoring the decoded data to obtain the initial video data. Therefore, the decoded data can be processed on the screen, for example, the initial video data is rendered and the rendered initial video data is sent to the display screen for display.

[0091] Optionally, the decoded data may be further subjected to video post-processing to improve the image quality in the decoded data, thereby improving the video playback experience. For example, the decoded data may be subjected to video post-processing to obtain video data to be displayed; the video post-processing may include at least one of noise reduction processing, sharpening processing, and color correction processing; the video data to be displayed may be rendered, and the rendered video data to be displayed may be sent to a display screen for display.

[0092] For example, the decoded data may be subjected to noise reduction processing, and the video data after the noise reduction processing may be determined as the video data to be displayed. Alternatively, the decoded data may be subjected to sharpening processing, and the video data after the sharpening processing may be determined as the video data to be displayed. Alternatively, the decoded data may be subjected to color correction processing, and the video data after the color correction processing may be determined as the video data to be displayed. Alternatively, the decoded data may be subjected to noise reduction processing, the video data after the noise reduction processing may be subjected to sharpening processing, and the video data after the sharpening processing may be subjected to color correction processing, and the video data after the color correction processing may be determined as the video data to be displayed, and so on.

[0093] In the embodiment of the present application, since the decoded data can be subjected to noise reduction processing, the signal-to-noise ratio of the image can be improved, the useful information in the image can be retained, and the noise can be reduced, thereby improving the video quality. By performing sharpening processing on the decoded data, the clarity of the image can be improved. By performing color correction processing on the decoded data, the color cast in the image can be corrected, thereby improving the video playback experience. Optionally, the dynamic range of the decoded data can also be adjusted to adjust the color cast, dim colors, etc. in the image. By performing video post-processing on the decoded data, the video quality of the decoded data can be optimized, so that the image quality in the decoded data is clearer, thereby improving the video quality.

[0094] Further optionally, since the essence of performing video post-processing on decoded data is to use a video post-processing method to adjust the video parameters in the decoded data, corresponding pixel points are displayed on the display screen based on the pixel values ​​corresponding to the video parameters, thereby playing the video data after video post-processing. The video parameters after video post-processing can also be further adjusted to improve the video playback experience.

[0095] For example, the video parameters of the decoded data can be adjusted to display the adjusted decoded data. Specifically, the video parameters and the video parameter adjustment model in the video data to be displayed can be obtained; the video parameter adjustment model is used to adjust the video parameters in the video data; the video parameter adjustment model is used to perform parameter adjustment processing on the video parameters in the video data to be displayed to obtain target video parameters; based on the target video parameters, the video data to be rendered is generated, the video data to be rendered is rendered, and the rendered video data to be rendered is sent to the display screen for display.

[0096] The video parameters may include at least one of video resolution, frame rate and color. The video parameters in the video data to be displayed may include at least one of resolution, frame rate and color of each video frame to be displayed. For example, a model may be pre-trained so that the trained video parameter adjustment model can have the ability to adjust video parameters. By using the trained video parameter adjustment model to adjust the video parameters in the video data to be displayed, the video resolution, frame rate and color may be adjusted, thereby improving the video playback experience.

[0097] Optionally, the video parameter adjustment model may include, for example, but is not limited to, a convolutional neural network model (CNN), a deep neural network model (DNN), a recurrent neural network model (RNN), a residual network model (ResNet), and the like.

[0098] In one embodiment, the video parameter adjustment model can be trained in the following manner: an initial video parameter adjustment model, sample video parameters and sample labels are obtained; the sample video parameters are obtained by performing video post-processing on sample decoded data; the sample video parameters are adjusted using the initial video parameter adjustment model to obtain sample adjusted video parameters; the video parameter adjustment model is trained based on the sample adjusted video parameters and sample labels to obtain the video parameter adjustment model.

[0099] Among them, training the video parameter adjustment model based on the sample-adjusted video parameters and the sample labels to obtain the video parameter adjustment model means: comparing the difference between the sample-adjusted video parameters and the sample labels, adjusting the video parameter adjustment model based on the difference, and obtaining the video parameter adjustment model. If the difference between the sample-adjusted video parameters and the sample labels is greater than the difference threshold, it means that the initial video parameter adjustment model still needs to be trained, and the model parameters in the initial video parameter adjustment model are adjusted to reduce the difference between the sample-adjusted video parameters and the sample labels. If the difference between the sample-adjusted video parameters and the sample labels is less than or equal to the difference threshold, the initial video parameter adjustment model at this time can be determined as the video parameter adjustment model.

[0100] It can be understood that the sample label can refer to the actual parameter value of the sample video parameter, that is, the sample real data, and the sample adjusted video parameter can refer to the model prediction data of the sample video parameter. The purpose of training the initial video parameter adjustment model is to make the sample real data and the model prediction data as consistent as possible. If the sample real data is inconsistent with the model prediction data, continue to adjust the model parameters in the initial video parameter adjustment model so that the sample real data is consistent with the model prediction data. If the sample real data is consistent with the model prediction data, the initial video parameter adjustment model at this time is saved as a video parameter adjustment model, so that the video parameters in the video data to be displayed are adjusted using the video parameter adjustment model to obtain the target video parameters. By training the initial video parameter adjustment model, the accuracy of the video parameters can be improved when the trained video parameter adjustment model is used to adjust the video parameters later.

[0101] In an optional implementation, the video type of the video data to be displayed and the object tag associated with the terminal device that needs to display the video data to be displayed can be further obtained, and the video parameters in the video data to be displayed can be adjusted based on the video type and object tag of the video data to be displayed using a video parameter adjustment model to obtain target video parameters.

[0102] Among them, the object tag can be used to reflect the object's preferences. For example, for the type of video data that the object likes, higher video parameters can be set when adjusting parameters to improve the video playback effect. For the type of video data that the object does not like, fixed video parameters or lower video parameters can be set to improve video processing efficiency.

[0103] For example, if the video type and the object label of the video data to be displayed match, the target video parameter is greater than the parameter threshold. If the video type and the object label of the video data to be displayed do not match, the target video parameter is less than or equal to the parameter threshold. If the target video parameter is greater than the parameter threshold, the corresponding video resolution is higher than the video resolution corresponding to the target video parameter being less than the parameter threshold, and the corresponding frame rate is higher than the frame rate corresponding to the target video parameter being less than the parameter threshold, and so on.

[0104] Optionally, the video parameters corresponding to the video type indicated by the object tag can be set respectively. When the video type of the video data to be displayed matches the object tag, the video parameters corresponding to the corresponding video type can be determined as the video parameters of the video data to be displayed. For example, for beauty video data, the video parameters can be set so that the color of the video data displayed on the display screen tends to the color of the video data itself. For food video data, the video parameters can be set so that the color of the video data displayed on the display screen is clearer, and so on.

[0105] In the embodiment of the present application, since the video post-processing method generally processes the video data based on the conventional post-processing method, for multiple terminal devices that need to play the video data, the video parameters of the video data obtained by the video post-processing are the same, and the video effect played on each terminal device is the same. Since the user of each terminal device has different preferences for the same video data, the video parameters are adjusted by combining the video type and object label of the video data, so that the adjusted video parameters are more in line with the preferences of the users of each terminal device, which can improve the video playback experience.

[0106] In an embodiment of the present application, through a machine learning algorithm such as a video parameter adjustment model, the video parameters in the decoded data after video post-processing can be intelligently adjusted to improve the video playback effect. Since the video parameters can be adjusted according to the personalized needs of the object, the video viewing experience can be improved for each object. Furthermore, by performing AI (Artificial Intelligence) post-processing on the decoded data through HI AI Foundation, the video playback quality can be improved, the video clarity can be improved, the video picture is more realistic and vivid, and the video viewing experience is improved. By using the AI ​​function provided by HI AI Foundation, the video parameters in the decoded data after video post-processing can be intelligently adjusted, and the best video playback effect can be provided according to personalized needs and the hardware performance of the device, which solves the problem that traditional AI models are difficult to deploy on the end side.

[0107] In an optional implementation, the video processing method in the embodiment of the present application can be executed by a terminal device equipped with a video processing module and a video post-processing module, and the final video data can be played by the terminal device equipped with the video processing module and the video post-processing module. It can also be executed by a terminal device equipped with a video processing module and a video post-processing module, and the final video data is transmitted to other terminal devices that are not equipped with a video processing module and a video post-processing module, and the terminal device that receives the final video data plays the video data.

[0108] In an embodiment of the present application, the decoded data of the video and the data attribute information of the decoded data are obtained; the data attribute information is used to reflect the data storage form of the decoded data; the data attribute information of the decoded data is encapsulated and processed according to the target encapsulation format to obtain encapsulated data; the encapsulated data is sent to the video receiving end, so that the video receiving end decapsulates the encapsulated data according to the target encapsulation format to obtain the data attribute information, and the decoded data is read based on the data attribute information, and the decoded data is processed on the screen. Since this method only needs to transmit the data attribute information of the decoded data, the decoded data can be read based on the data attribute information, and there is no need to copy the decoded data itself, so the data processing efficiency can be improved. Furthermore, since the decoded data is post-processed, the video quality can be improved, thereby improving the video playback effect. And by adjusting the video parameters after the video post-processing, the parameter adjustment can be realized according to the personalized needs, and different video parameters can be determined for each object, thereby improving the video viewing experience.

[0109] For further information, see Fig. 9 , Fig. 9 is a flowchart of another video processing method provided by an embodiment of the present application; Fig. 9 As shown, the video processing method can be applied to a video processing system, which may include a video transmitter and a video receiver, and the video transmitter and the video receiver jointly implement the video playback function. For example, the video transmitter may refer to a video processing module, and the video receiver may refer to a video post-processing module. The video processing method includes but is not limited to the following steps:

[0110] S301, the video processing module obtains decoded video data and data attribute information of the decoded data.

[0111] S302: The video processing module encapsulates the data attribute information of the decoded data according to the target encapsulation format to obtain encapsulated data.

[0112] S303, the video processing module sends the encapsulated data to the video post-processing module.

[0113] S304, the video post-processing module decapsulates the encapsulated data according to the target encapsulation format, obtains data attribute information, and reads decoded data based on the data attribute information.

[0114] S305, the video post-processing module performs video post-processing on the decoded data to obtain video data to be displayed.

[0115] S306, the video post-processing module renders the video data to be displayed, and sends the rendered video data to be displayed to the display screen for display.

[0116] In the embodiment of the present application, the specific implementation of steps S301 to S306 can refer to the implementation of the above-mentioned steps S101 to S103, and the implementation of steps S201 to S203, which will not be repeated here.

[0117] In an embodiment of the present application, the decoded data of the video and the data attribute information of the decoded data are obtained; the data attribute information is used to reflect the data storage form of the decoded data; the data attribute information of the decoded data is encapsulated and processed according to the target encapsulation format to obtain encapsulated data; the encapsulated data is sent to the video receiving end, so that the video receiving end decapsulates the encapsulated data according to the target encapsulation format to obtain the data attribute information, and the decoded data is read based on the data attribute information, and the decoded data is processed on the screen. Since this method only needs to transmit the data attribute information of the decoded data, the decoded data can be read based on the data attribute information, and there is no need to copy the decoded data itself, so the data processing efficiency can be improved. Furthermore, since the decoded data is post-processed, the video quality can be improved, thereby improving the video playback effect. And by adjusting the video parameters after the video post-processing, the parameter adjustment can be realized according to the personalized needs, and different video parameters can be determined for each object, thereby improving the video viewing experience.

[0118] The method of the embodiment of the present application is introduced above, and the device of the embodiment of the present application is introduced below.

[0119] See also Fig.10 , Fig.10 1 is a schematic diagram of the composition structure of a video processing device provided in an embodiment of the present application. The above-mentioned video processing device can be deployed on a video sending end; the video processing device can be used to execute the corresponding steps in the video processing method provided in an embodiment of the present application. The video processing device 100 includes:

[0120] The data acquisition unit 1001 is used to acquire the decoded data of the video and the data attribute information of the decoded data; the data attribute information is used to reflect the data storage form of the decoded data;

[0121] A data encapsulation unit 1002 is used to encapsulate the data attribute information of the decoded data according to a target encapsulation format to obtain encapsulated data;

[0122] The data sending unit 1003 is used to send the encapsulated data to the video receiving end, so that the video receiving end decapsulates the encapsulated data according to the target encapsulation format, obtains the data attribute information, reads the decoded data based on the data attribute information, and processes the decoded data on the screen.

[0123] Optionally, the data attribute information includes at least one of an image width of the decoded data, an image height of the decoded data, a pixel format of the decoded data, a storage address of the decoded data, and a video timestamp of the decoded data.

[0124] Optionally, the decoded data is obtained by decoding the encoded data of the video in a hard decoding manner.

[0125] It should be noted that Fig.10 For the contents not mentioned in the corresponding embodiments, please refer to the description of the method embodiments, which will not be repeated here.

[0126] In an embodiment of the present application, the decoded data of the video and the data attribute information of the decoded data are obtained; the data attribute information is used to reflect the data storage form of the decoded data; the data attribute information of the decoded data is encapsulated and processed according to the target encapsulation format to obtain encapsulated data; the encapsulated data is sent to the video receiving end, so that the video receiving end decapsulates the encapsulated data according to the target encapsulation format to obtain the data attribute information, and the decoded data is read based on the data attribute information, and the decoded data is processed on the screen. Since this method only needs to transmit the data attribute information of the decoded data, the decoded data can be read based on the data attribute information, and there is no need to copy the decoded data itself, so the data processing efficiency can be improved.

[0127] See also Fig.11 , Fig.11 1 is a schematic diagram of the composition structure of another video processing device provided in an embodiment of the present application. The above-mentioned video processing device can be deployed on a video receiving end; the video processing device can be used to execute the corresponding steps in the video processing method provided in an embodiment of the present application. The video processing device 110 includes:

[0128] The data receiving unit 1101 is used to receive the encapsulated data sent by the video transmitting end; the encapsulated data is obtained by encapsulating the data attribute information according to the target encapsulation format, and the data attribute information is used to reflect the data storage form of the decoded data;

[0129] The data decapsulation unit 1102 is used to decapsulate the encapsulated data according to the target encapsulation format, obtain the data attribute information, and read the decoded data based on the data attribute information;

[0130] The data display unit 1103 is used to display the decoded data on the screen.

[0131] Optionally, the data attribute information includes at least one of an image width of the decoded data, an image height of the decoded data, a pixel format of the decoded data, a storage address of the decoded data, and a video timestamp of the decoded data; the data decapsulation unit 1102 is specifically configured to:

[0132] Reading video data to be assembled having the same pixel format as the decoded data from the storage address of the decoded data;

[0133] The video data to be assembled is assembled according to the image width of the decoded data, the image height of the decoded data and the video timestamp of the decoded data to obtain the decoded data.

[0134] Optionally, the data display unit 1103 is specifically used to:

[0135] Performing video post-processing on the decoded data to obtain video data to be displayed; the video post-processing includes at least one of noise reduction processing, sharpening processing, and color correction processing;

[0136] The video data to be displayed is rendered, and the rendered video data to be displayed is sent to the display screen for display.

[0137] Optionally, the data display unit 1103 is specifically used to:

[0138] Acquire video parameters and a video parameter adjustment model in the video data to be displayed; the video parameter adjustment model is used to adjust the video parameters in the video data;

[0139] The video parameter adjustment model is used to perform parameter adjustment processing on the video parameters in the video data to be displayed to obtain target video parameters;

[0140] The video data to be rendered is generated based on the target video parameters, the video data to be rendered is rendered, and the rendered video data to be rendered is sent to the display screen for display.

[0141] Optionally, the video processing device 110 further includes a model training unit 1104, and the model training unit 1104 is used to:

[0142] Obtaining an initial video parameter adjustment model, sample video parameters and sample labels; the sample video parameters are obtained by performing video post-processing on sample decoded data;

[0143] The initial video parameter adjustment model is used to perform parameter adjustment processing on the sample video parameters to obtain sample adjusted video parameters;

[0144] The video parameter adjustment model is trained based on the sample adjustment video parameter and the sample label to obtain the video parameter adjustment model.

[0145] It should be noted that Fig.11 For the contents not mentioned in the corresponding embodiments, please refer to the description of the method embodiments, which will not be repeated here.

[0146] In an embodiment of the present application, the decoded data of the video and the data attribute information of the decoded data are obtained; the data attribute information is used to reflect the data storage form of the decoded data; the data attribute information of the decoded data is encapsulated and processed according to the target encapsulation format to obtain encapsulated data; the encapsulated data is sent to the video receiving end, so that the video receiving end decapsulates the encapsulated data according to the target encapsulation format to obtain the data attribute information, and the decoded data is read based on the data attribute information, and the decoded data is processed on the screen. Since this method only needs to transmit the data attribute information of the decoded data, the decoded data can be read based on the data attribute information, and there is no need to copy the decoded data itself, so the data processing efficiency can be improved. Furthermore, since the decoded data is post-processed, the video quality can be improved, thereby improving the video playback effect. And by adjusting the video parameters after the video post-processing, the parameter adjustment can be realized according to the personalized needs, and different video parameters can be determined for each object, thereby improving the video viewing experience.

[0147] See also Fig.12 , Fig.12 Schematic diagram of the structure of a computer device provided in an embodiment of the present application. Fig.12 As shown, the above-mentioned computer device 120 may include: a processor 1201, a network interface 1204 and a memory 1205. In addition, the above-mentioned computer device 120 may also include: a user interface 1203 and at least one communication bus 1202. Among them, the communication bus 1202 is used to realize the connection and communication between these components. Among them, the user interface 1203 may include a display screen (Display), a keyboard (Keyboard), and the optional user interface 1203 may also include a standard wired interface and a wireless interface. The network interface 1204 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1205 may be a high-speed RAM memory, or it may be a non-volatile memory (non-volatile memory), such as at least one disk storage. The memory 1205 may optionally also be at least one storage device located away from the aforementioned processor 1201. As Fig.12 As shown, the memory 1205 as a computer-readable storage medium may include an operating system, a network communication module, a user interface module, and a device control application.

[0148] exist Fig.12 In the computer device 120 shown, the network interface 1204 can provide a network communication function; the user interface 1203 is mainly used to provide an input interface for the user; and the processor 1201 can be used to call the device control application stored in the memory 1205 to achieve:

[0149] Obtaining decoded data of a video and data attribute information of the decoded data; the data attribute information is used to reflect the data storage form of the decoded data;

[0150] Encapsulating the data attribute information of the decoded data according to the target encapsulation format to obtain encapsulated data;

[0151] The encapsulated data is sent to the video receiving end, so that the video receiving end decapsulates the encapsulated data according to the target encapsulation format, obtains the data attribute information, reads the decoded data based on the data attribute information, and processes the decoded data on the screen.

[0152] Alternatively, the processor 1201 may be configured to call a device control application stored in the memory 1205 to implement:

[0153] receiving encapsulated data sent by a video transmitting end; the encapsulated data is obtained by encapsulating data attribute information according to a target encapsulation format, and the data attribute information is used to reflect the data storage format of the decoded data;

[0154] Decapsulating the encapsulated data according to the target encapsulation format to obtain the data attribute information, and reading the decoded data based on the data attribute information;

[0155] The decoded data is sent to the display screen for display.

[0156] It should be understood that the computer device 120 described in the embodiment of the present application can execute the above Figure 2 , Figure 8 and Fig. 9 The description of the above video processing method in the corresponding embodiment can also be performed as described above. Fig.10 and Fig.11 The description of the video processing device in the corresponding embodiment will not be repeated here. In addition, the description of the beneficial effects of the same method will not be repeated here either.

[0157] In an embodiment of the present application, the decoded data of the video and the data attribute information of the decoded data are obtained; the data attribute information is used to reflect the data storage form of the decoded data; the data attribute information of the decoded data is encapsulated and processed according to the target encapsulation format to obtain encapsulated data; the encapsulated data is sent to the video receiving end, so that the video receiving end decapsulates the encapsulated data according to the target encapsulation format to obtain the data attribute information, and the decoded data is read based on the data attribute information, and the decoded data is processed on the screen. Since this method only needs to transmit the data attribute information of the decoded data, the decoded data can be read based on the data attribute information, and there is no need to copy the decoded data itself, so the data processing efficiency can be improved. Furthermore, since the decoded data is post-processed, the video quality can be improved, thereby improving the video playback effect. And by adjusting the video parameters after the video post-processing, the parameter adjustment can be realized according to the personalized needs, and different video parameters can be determined for each object, thereby improving the video viewing experience.

[0158] The embodiment of the present application also provides a computer-readable storage medium, which stores a computer program, which includes program instructions, which, when executed by a computer, causes the computer to execute the method of the aforementioned embodiment, and the computer may be part of the computer device mentioned above. For example, it is the above-mentioned processor 1201. As an example, the program instructions may be deployed on a computer device for execution, or deployed on multiple computer devices located at one location for execution, or, executed on multiple computer devices distributed at multiple locations and interconnected by a communication network, and multiple computer devices distributed at multiple locations and interconnected by a communication network may constitute a blockchain network.

[0159] Those skilled in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above methods. Among them, the storage medium can be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc.

[0160] The above disclosure is only the preferred embodiment of the present application, which certainly cannot be used to limit the scope of rights of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope covered by the present application.

Claims

1. A video processing method, characterized in that: The method comprises: Obtaining decoded data of a video and data attribute information of the decoded data; the data attribute information is used to reflect the data storage form of the decoded data; Encapsulating the data attribute information of the decoded data according to the target encapsulation format to obtain encapsulated data; The encapsulated data is sent to a video receiving end, so that the video receiving end decapsulates the encapsulated data according to the target encapsulation format, obtains the data attribute information, reads the decoded data based on the data attribute information, and processes the decoded data on the screen.

2. The method according to claim 1, characterized in that: The data attribute information includes at least one of an image width of the decoded data, an image height of the decoded data, a pixel format of the decoded data, a storage address of the decoded data, and a video timestamp of the decoded data.

3. The method according to claim 1 or 2, characterized in that: The decoded data is obtained by decoding the encoded data of the video in a hard decoding manner.

4. A video processing method, characterized in that: The method comprises: Receive encapsulated data sent by the video transmitting end; the encapsulated data is obtained by encapsulating data attribute information according to the target encapsulation format, and the data attribute information is used to reflect the data storage form of the decoded data; Decapsulating the encapsulated data according to the target encapsulation format to obtain the data attribute information, and reading the decoded data based on the data attribute information; The decoded data is processed to be displayed on the screen.

5. The method according to claim 4, characterized in that The data attribute information includes at least one of an image width of the decoded data, an image height of the decoded data, a pixel format of the decoded data, a storage address of the decoded data, and a video timestamp of the decoded data; The reading the decoded data based on the data attribute information includes: Reading video data to be assembled having the same pixel format as the decoded data from the storage address of the decoded data; The video data to be assembled is assembled according to the image width of the decoded data, the image height of the decoded data and the video timestamp of the decoded data to obtain the decoded data.

6. The method according to claim 4 or 5, characterized in that: The processing of displaying the decoded data on the screen comprises: Performing video post-processing on the decoded data to obtain video data to be displayed; the video post-processing includes at least one of noise reduction processing, sharpening processing, and color correction processing; The video data to be displayed is rendered, and the rendered video data to be displayed is sent to a display screen for display.

7. The method according to claim 6, characterized in that The rendering process of the video data to be displayed and sending the rendered video data to be displayed to a display screen for display includes: Acquire video parameters and a video parameter adjustment model in the video data to be displayed; the video parameter adjustment model is used to adjust the video parameters in the video data; Using the video parameter adjustment model to perform parameter adjustment processing on the video parameters in the video data to be displayed to obtain target video parameters; The video data to be rendered is generated based on the target video parameters, the video data to be rendered is rendered, and the rendered video data to be rendered is sent to the display screen for display.

8. The method according to claim 7, characterized in that The method further comprises: Acquire an initial video parameter adjustment model, sample video parameters and sample labels; the sample video parameters are obtained by performing video post-processing on sample decoded data; Using the initial video parameter adjustment model to perform parameter adjustment processing on the sample video parameters to obtain sample adjusted video parameters; The video parameter adjustment model is trained based on the sample adjustment video parameters and the sample labels to obtain the video parameter adjustment model.

9. A video processing device, characterized in that: The device comprises: A data acquisition unit, used to acquire decoded data of a video and data attribute information of the decoded data; the data attribute information is used to reflect the data storage form of the decoded data; A data encapsulation unit, used for encapsulating the data attribute information of the decoded data according to a target encapsulation format to obtain encapsulated data; The data sending unit is used to send the encapsulated data to the video receiving end, so that the video receiving end decapsulates the encapsulated data according to the target encapsulation format, obtains the data attribute information, reads the decoded data based on the data attribute information, and processes the decoded data on the screen.

10. A video processing device, characterized in that: The device comprises: A data receiving unit, used for receiving encapsulated data sent by a video transmitting end; the encapsulated data is obtained by encapsulating data attribute information according to a target encapsulation format, and the data attribute information is used to reflect the data storage form of the decoded data; a data decapsulation unit, configured to decapsulate the encapsulated data according to the target encapsulation format, obtain the data attribute information, and read the decoded data based on the data attribute information; The data display unit is used to process the decoded data on the screen.

11. A computer device, characterized in that: include: Processor, memory, and network interface; The processor is connected to the memory and the network interface, wherein the network interface is used to provide a data communication function, the memory is used to store program code, and the processor is used to call the program code so that the computer device executes the method described in any one of claims 1 to 3, or executes the method described in any one of claims 4 to 8.

12. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, which is suitable for being loaded and executed by a processor, so that a computer device having the processor executes the method according to any one of claims 1 to 3, or executes the method according to any one of claims 4 to 8.

13. A computer program product, characterized in that The computer program product comprises computer instructions, and when the computer instructions are executed by a processor, the method according to any one of claims 1 to 3 is implemented, or the method according to any one of claims 4 to 8 is executed.

Images