Video information processing method, device, system, electronic device and storage medium
By converting and encoding video image frames, a fused image frame carrying transparent channel information is formed, which solves the problem of large transparent animation playback storage space and long decoding time, and improves the user experience.
Patent Information
- Application Number
- CN202010161205.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-03-10
- Publication Date
- 2025-08-22
- Estimated Expiration
- 2040-03-10
AI Technical Summary
In the prior art, the transparent effect animation playback method uses an animation resource package composed of multiple pictures, resulting in large storage space and long decoding time, which affects the user experience.
By acquiring the original image frame of the target video, performing a first conversion process to determine the common chromaticity value parameters of adjacent pixel points, forming a fused image frame carrying transparent channel information, and performing video encoding processing to form the video stream information to be stored.
Effectively reduce animation storage space, shorten decoding time, improve user fluency, and improve user experience.
Smart Images

Figure CN113450293B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to information processing technology, and in particular to a video information processing method, device, system, electronic device and storage medium. Background Art
[0002] In the related art, when playing animations, not only are the playback styles becoming increasingly rich, but the visual effects are also becoming increasingly rich. In particular, for software with social information interaction, if a transparent animation can be appropriately played during the communication between the two communicating parties, the user's visual experience can be greatly enhanced without affecting the communication between the two communicating parties in viewing the content of the communication in the chat box. Therefore, a transparent playback style is usually used to play animations. In order to achieve transparent animations, an image file storage format with transparency information (PNGPortable Network Graphic Format) is usually used to achieve this. Among them, a PNG sequence is essentially an animation resource package composed of multiple images, each of which has transparency information. By decoding and playing this animation resource package, a transparent animation is achieved. However, this method of using an animation resource package composed of multiple images is usually very large, so the decoding time will be very long, and it will occupy a large amount of memory, resulting in poor efficiency of this animation playback method, affecting the user's experience. Summary of the Invention
[0003] In view of this, embodiments of the present invention provide a video information processing method, apparatus, system, electronic device, and storage medium. The technical solutions of the embodiments of the present invention are implemented as follows:
[0004] An embodiment of the present invention provides a method for processing video information, the method comprising:
[0005] Obtain the original image frame of the target video and the corresponding original image frame sequence;
[0006] According to the original image frame sequence of the target video, a first conversion process is performed on the original image frame of the target video, and a common chromaticity value parameter of adjacent pixel points in a pixel array of a corresponding fused image frame is determined;
[0007] Based on the common chromaticity value parameters of the adjacent pixels, performing a second transformation process on the first transformation process result of the original image frame of the target video to form a fused image frame, wherein the fused image frame carries transparent channel information that matches the original image frame of the target video;
[0008] According to the original image frame sequence, video encoding processing is performed on the fused image frame to form corresponding video stream information to be stored.
[0009] An embodiment of the present invention further provides a method for processing video information, the method comprising:
[0010] When the playback process corresponding to the stored video stream information is triggered, the video stream information is obtained, and the video stream information is decoded to determine a corresponding fused image frame, wherein the fused image frame carries corresponding transparent channel information;
[0011] Performing a third transformation process on the fused image frame to determine a chromaticity value parameter of each pixel in the fused image frame;
[0012] performing a fourth transformation on the result of the third transformation of the fused image frame based on a chromaticity value parameter of each pixel in the fused image frame to form a corresponding original image frame;
[0013] Based on the transparent channel information, the transparency of the original image frame is adjusted, and the original image frame is subjected to video encoding processing to form a corresponding target video.
[0014] An embodiment of the present invention further provides a video information processing method, characterized in that the method includes:
[0015] Obtain the original image frame of the target video and the corresponding original image frame sequence;
[0016] According to the original image frame sequence of the target video, a first conversion process is performed on the original image frame of the target video, and a common chromaticity value parameter of adjacent pixel points in a pixel array of a corresponding fused image frame is determined;
[0017] Based on the common chromaticity value parameters of the adjacent pixels, performing a second transformation process on the first transformation process result of the original image frame of the target video to form a fused image frame, wherein the fused image frame carries transparent channel information that matches the original image frame of the target video;
[0018] According to the original image frame sequence, the fused image frame is subjected to video encoding processing to form corresponding video stream information to be stored;
[0019] When the playback process corresponding to the stored video stream information is triggered, the video stream information is obtained, and the video stream information is decoded to determine a corresponding fused image frame, wherein the fused image frame carries corresponding transparent channel information;
[0020] Performing a third transformation process on the fused image frame to determine a chromaticity value parameter of each pixel in the fused image frame;
[0021] performing a fourth transformation on the result of the third transformation of the fused image frame based on a chromaticity value parameter of each pixel in the fused image frame to form a corresponding original image frame;
[0022] Based on the transparent channel information, the transparency of the original image frame is adjusted, and the original image frame is subjected to video encoding processing to form video stream information of corresponding transparency.
[0023] An embodiment of the present invention further provides a video information processing device, the device comprising:
[0024] A first information transmission module is used to obtain the original image frame of the target video and the corresponding original image frame sequence;
[0025] a first information processing module, configured to perform a first conversion process on the original image frames of the target video according to the original image frame sequence of the target video, and determine a common chromaticity value parameter of adjacent pixel points in a pixel array of a corresponding fused image frame;
[0026] The first information processing module is configured to perform a second transformation on the first transformation result of the original image frame of the target video based on the common chromaticity value parameter of the adjacent pixels to form a fused image frame, wherein the fused image frame carries transparent channel information that matches the original image frame of the target video;
[0027] The first information processing module is configured to perform video encoding processing on the fused image frame according to the original image frame sequence to form corresponding video stream information to be stored.
[0028] In the above scheme,
[0029] The first information processing module is configured to determine a starting position and an ending position for slicing the target video according to initialization parameters of the target video;
[0030] The first information processing module is configured to slice the target video according to the starting position and the ending position to form slices of the target video;
[0031] The first information processing module is configured to determine the original image frames of the target video according to the slices of the target video, and determine a corresponding original image frame sequence according to parameter information of the original image frames of the target video.
[0032] In the above scheme,
[0033] The first information processing module is configured to convert the original image frames of the target video from a three-primary color encoding method to a grayscale value encoding method according to the original image frame sequence of the target video;
[0034] The first information processing module is used to determine the chromaticity value parameter of each pixel in the original image frame of the grayscale encoding method;
[0035] The first information processing module is used to determine adjacent pixel points in the pixel array of the original image frame based on the original image frame sequence of the target video, and determine the common chromaticity value parameters of adjacent pixel points in the pixel array of the corresponding fused image frame based on the chromaticity value parameters of each pixel point in the original image frame.
[0036] In the above scheme,
[0037] The first information processing module is configured to determine a common color parameter of adjacent pixels in a pixel array of a corresponding fused image frame based on a color parameter in a chromaticity value parameter of each pixel in the original image frame;
[0038] The first information processing module is used to determine a common saturation parameter of adjacent pixels in a pixel array of a corresponding fused image frame based on a saturation parameter in a chromaticity value parameter of each pixel in the original image frame.
[0039] In the above scheme,
[0040] The first information processing module is configured to replace the color parameters in the chromaticity value parameters of each pixel in the original image frame with the common color parameters of adjacent pixels in the pixel array of the fused image frame based on a mapping relationship matching the target video;
[0041] The first information processing module is configured to replace the saturation parameter in the chromaticity value parameter of each pixel in the original image frame with the common saturation parameter of adjacent pixels in the pixel array of the fused image frame based on a mapping relationship matching the target video;
[0042] The first information processing module is configured to fill the transparent channel information that matches the original image frame of the target video into the pixel array to form a fused image frame carrying the transparent channel information.
[0043] An embodiment of the present invention further provides a video information processing device, the device comprising:
[0044] a second information transmission module, configured to obtain the video stream information when the playback process corresponding to the stored video stream information is triggered, decode the video stream information, and determine a corresponding fused image frame, wherein the fused image frame carries corresponding transparent channel information;
[0045] a second information processing module, configured to perform a third transformation on the fused image frame to determine a chromaticity value parameter of each pixel in the fused image frame;
[0046] a second information processing module, configured to perform a fourth transformation on the third transformation result of the fused image frame based on the chromaticity value parameter of each pixel in the fused image frame to form a corresponding original image frame;
[0047] The second information processing module is configured to adjust the transparency of the original image frame based on the transparent channel information, and perform video encoding processing on the original image frame to form a corresponding target video.
[0048] In the above scheme,
[0049] The second information processing module is configured to determine, according to the sequence of the fused image frames and based on the common chromaticity value parameters of adjacent pixels in the fused image frames, a color parameter in the chromaticity value parameters of each pixel in the original image frame;
[0050] The second information processing module is used to determine the saturation parameter in the chromaticity value parameter of each pixel in the original image frame based on the sequence of the fused image frames and the common saturation parameter of adjacent pixels in the fused image frame.
[0051] In the above scheme,
[0052] The second information processing module is used to convert the third conversion processing result of the fused image frame from a grayscale value encoding method into a three-primary color encoding method based on the color parameters and saturation parameters in the chromaticity value parameters of each pixel point in the original image frame to form a corresponding original image frame.
[0053] In the above scheme,
[0054] The second information processing module is used to display a user interface, wherein the user interface includes a process display interface matching different application processes;
[0055] The second information processing module is configured to display the video stream information with corresponding transparency on the user interface when a playback process triggering operation for the stored video stream information is received.
[0056] An embodiment of the present invention further provides a video information processing system, the system comprising:
[0057] The third information transmission module is used to obtain the original image frame of the target video and the corresponding original image frame sequence;
[0058] a third information processing module, configured to perform a first conversion process on the original image frames of the target video according to the original image frame sequence of the target video, and determine a common chromaticity value parameter of adjacent pixel points in a pixel array of a corresponding fused image frame;
[0059] The third information processing module is configured to perform a second transformation on the first transformation result of the original image frame of the target video based on the common chromaticity value parameter of the adjacent pixels to form a fused image frame, wherein the fused image frame carries transparent channel information that matches the original image frame of the target video;
[0060] The third information processing module is configured to perform video encoding processing on the fused image frame according to the original image frame sequence to form corresponding video stream information to be stored;
[0061] The third information processing module is configured to obtain the video stream information when the playback process corresponding to the stored video stream information is triggered, decode the video stream information, and determine a corresponding fused image frame, wherein the fused image frame carries the corresponding transparent channel information;
[0062] Performing a third transformation process on the fused image frame to determine a chromaticity value parameter of each pixel in the fused image frame;
[0063] performing a fourth transformation on the result of the third transformation of the fused image frame based on a chromaticity value parameter of each pixel in the fused image frame to form a corresponding original image frame;
[0064] Based on the transparent channel information, the transparency of the original image frame is adjusted, and the original image frame is subjected to video encoding processing to form video stream information of corresponding transparency.
[0065] An embodiment of the present invention further provides an electronic device, comprising:
[0066] a memory for storing executable instructions;
[0067] The processor is used to implement the preceding video information processing method when running the executable instructions stored in the memory.
[0068] An embodiment of the present invention further provides a computer-readable storage medium storing executable instructions, wherein the executable instructions, when executed by a processor, implement the aforementioned video information processing method.
[0069] The embodiments of the present invention have the following beneficial effects:
[0070] The embodiment of the present invention obtains the original image frame of the target video and the corresponding original image frame sequence; performs a first conversion process on the original image frame of the target video according to the original image frame sequence of the target video, and determines the common chromaticity value parameters of adjacent pixels in the pixel array of the corresponding fused image frame; performs a second conversion process on the first conversion process result of the original image frame of the target video based on the common chromaticity value parameters of the adjacent pixels to form a fused image frame, wherein the fused image frame carries transparent channel information that matches the original image frame of the target video; performs video encoding process on the fused image frame according to the original image frame sequence to form corresponding video stream information to be stored. Therefore, since the video stream information to be stored is used as the carrier of the encoding result, compared with the method of using PNG sequence for transparent animation playback, it can not only effectively reduce the storage space required for the animation, but also shorten the decoding time, improve the fluency of user use, and thus effectively improve the user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0071] Figure 1 A schematic diagram of a usage scenario of the video information processing method provided by an embodiment of the present invention;
[0072] Figure 2 A schematic diagram of the structure of a video information processing device provided by an embodiment of the present invention;
[0073] Figure 3 An optional flowchart of a video information processing method provided by an embodiment of the present invention;
[0074] Figure 4 A schematic diagram of the structure of a video information processing device provided by an embodiment of the present invention;
[0075] Figure 5 An optional flowchart of a video information processing method provided by an embodiment of the present invention;
[0076] Figure 6 An optional flowchart of a video information processing method provided by an embodiment of the present invention;
[0077] Figure 7 An optional flowchart of a video information processing method provided by an embodiment of the present invention;
[0078] Figure 8 A schematic diagram of video encoding of original image frames by the video information processing method provided by an embodiment of the present invention;
[0079] Figure 9 A schematic diagram of the encoding effect of the video information processing method provided by an embodiment of the present invention;
[0080] Figure 10 A schematic diagram of the encoding effect of the video information processing method provided by an embodiment of the present invention;
[0081] Figure 11 A schematic diagram of video decoding of original image frames by the video information processing method provided by an embodiment of the present invention;
[0082] Figure 12 A schematic diagram of the decoding effect of the video information processing method provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0083] In order to make the objectives, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be regarded as limiting the present invention. All other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.
[0084] In the following description, reference is made to “some embodiments”, which describes a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.
[0085] Before further explaining the embodiments of the present invention in detail, the nouns and terms involved in the embodiments of the present invention are explained. The nouns and terms involved in the embodiments of the present invention are subject to the following interpretations.
[0086] 1) In response, it is used to indicate the conditions or states on which the executed operations depend. When the dependent conditions or states are met, one or more operations executed can be real-time or have a set delay. Unless otherwise specified, there is no restriction on the order in which the multiple operations executed are executed.
[0087] 2) Terminals, including but not limited to: ordinary terminals and dedicated terminals, wherein the ordinary terminals maintain a long connection and / or a short connection with the sending channel, and the dedicated terminals maintain a long connection with the sending channel.
[0088] 3) Client: The carrier that implements specific functions in the terminal. For example, the mobile client (APP) is the carrier of specific functions in the mobile terminal, such as executing payment consumption functions or purchasing financial products.
[0089] 4) YUV, grayscale encoding method, is a color encoding method, where "Y" represents brightness (Luminance or Luma), that is, the grayscale value, and "U" and "V" represent chrominance (Chrominance or Chroma). It is used to describe the color and saturation of the image and is used to specify the color of the pixel.
[0090] 5) RGB, the three-primary color encoding method, also known as the RGB color model, is a color standard in the industry. It obtains various colors by changing the three color channels of red (R), green (G), and blue (B) and superimposing them on each other. RGB represents the colors of the three channels of red, green, and blue. This standard covers almost all colors that can be perceived by human vision and is one of the most widely used color systems.
[0091] 6) Video: A broad definition is any video that uses frame-by-frame capture or rendering and continuous playback to create a moving image. Regardless of the subject, as long as the capture or rendering is frame-by-frame (forming distinct image frames) and the video is played continuously to create a moving image, it is considered a video. Examples include animated videos and portrait videos.
[0092] The following describes exemplary applications of the apparatus for implementing the embodiments of the present disclosure. The apparatus provided by the embodiments of the present disclosure can be implemented as various types of electronic devices with a graphics processing unit (GPU), such as a tablet computer, a laptop computer, and a central processing unit.
[0093] Figure 1 Schematic diagram of the use scenario of the video information processing method provided by the embodiment of the present invention, see Figure 1 The terminals (including terminal 10-1 and terminal 10-2) are provided with clients of software capable of displaying different animation information, such as clients or plug-ins for different short or long animations. Users can obtain the corresponding animation information and display it through the corresponding clients. The terminals are connected to server 200 via network 300. Network 300 can be a wide area network or a local area network, or a combination of the two, and a wireless link is used to achieve data transmission. In some embodiments of the present invention, taking an instant messaging client as an example, the chat interface of the instant messaging client does not block other objects in the user interface (e.g., chat content, text input box, etc.) when playing animation content (e.g., background animation or dynamic expressions). The user interface needs to present animation content with transparency channel information.
[0094] As an example, the server 200 is used to deploy the video information processing device to implement the video information processing method provided by the present invention, so as to obtain the original image frame of the target video and the corresponding original image frame sequence; according to the original image frame sequence of the target video, the original image frame of the target video is subjected to a first conversion processing, and the common chromaticity value parameters of adjacent pixels in the pixel array of the corresponding fused image frame are determined; based on the common chromaticity value parameters of the adjacent pixels, the first conversion processing result of the original image frame of the target video is subjected to a second conversion processing to form a fused image frame, wherein the fused image frame carries transparent channel information matching the original image frame of the target video; according to the original image frame sequence, the fused image frame is subjected to video encoding processing to form corresponding video stream information to be stored.
[0095] The structure of the video information processing device of the embodiment of the present invention is described in detail below. The video information processing device can be implemented in various forms, such as a dedicated terminal with the processing function of the video information processing device, or a server with the processing function of the video information processing device, such as the preceding Figure 1 Server 200 in. Figure 2 The schematic diagram of the structure of the video information processing device provided by the embodiment of the present invention can be understood as follows: Figure 2 Only an exemplary structure of the video information processing device is shown, not all structures, and can be implemented as needed. Figure 2 Partial or complete structure shown.
[0096] The video information processing device provided in the embodiment of the present invention includes: at least one processor 201, a memory 202, a user interface 203 and at least one network interface 204. The various components in the video information processing device are coupled together via a bus system 205. It can be understood that the bus system 205 is used to achieve connection and communication between these components. In addition to including a data bus, the bus system 205 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the bus system 205 is not described in detail. Figure 2 Various buses are labeled as bus system 205.
[0097] The user interface 203 may include a display, a keyboard, a mouse, a trackball, a click wheel, keys, buttons, a touch pad or a touch screen.
[0098] It is understood that the memory 202 can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. The memory 202 in the embodiment of the present invention can store data to support the operation of the terminal (such as 10-1). Examples of such data include: any computer program used to operate on the terminal (such as 10-1), such as an operating system and an application program. Among them, the operating system includes various system programs, such as a framework layer, a core library layer, a driver layer, etc., which are used to implement various basic services and process hardware-based tasks. The application program can include various application programs.
[0099] In some embodiments, the video information processing device provided by the embodiments of the present invention can be implemented in a combination of software and hardware. As an example, the video information processing device provided by the embodiments of the present invention can be a processor in the form of a hardware decoding processor, which is programmed to execute the video information processing method provided by the embodiments of the present invention. For example, the processor in the form of a hardware decoding processor can adopt one or more application-specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field-programmable gate arrays (FPGAs), or other electronic components.
[0100] As an example of a video information processing device provided by an embodiment of the present invention being implemented by a combination of software and hardware, the video information processing device provided by an embodiment of the present invention can be directly embodied as a combination of software modules executed by a processor 201. The software module can be located in a storage medium, and the storage medium is located in the memory 202. The processor 201 reads the executable instructions included in the software module in the memory 202, and combines with the necessary hardware (for example, including the processor 201 and other components connected to the bus 205) to complete the video information processing method provided by the embodiment of the present invention.
[0101] As an example, the processor 201 can be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc., where the general-purpose processor can be a microprocessor or any conventional processor, etc.
[0102] As an example of a hardware implementation of the video information processing device provided in an embodiment of the present invention, the device provided in an embodiment of the present invention can be directly executed by a processor 201 in the form of a hardware decoding processor, for example, one or more application-specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field-programmable gate arrays (FPGAs), or other electronic components to implement the video information processing method provided in an embodiment of the present invention.
[0103] The memory 202 in the embodiment of the present invention is used to store various types of data to support the operation of the video information processing device. Examples of such data include any executable instructions for operating on the video information processing device, such as executable instructions. The program implementing the video information processing method of the embodiment of the present invention may be included in the executable instructions.
[0104] In other embodiments, the video information processing device provided by the embodiment of the present invention can be implemented in software. Figure 2 The video information processing device stored in memory 202 is shown. This device may be software in the form of a program or plug-in, and may include a series of modules. An example of a program stored in memory 202 may include a video information processing device. The video information processing device includes the following software modules: a first information transmission module 2081 and a first information processing module 2082. When the software modules in the video information processing device are read into RAM and executed by processor 201, the video information processing method provided in an embodiment of the present invention is implemented. The functions of each software module in the video information processing device include:
[0105] The first information transmission module 2081 is used to obtain the original image frame of the target video and the corresponding original image frame sequence;
[0106] A first information processing module 2082 is configured to perform a first conversion process on the original image frames of the target video according to the original image frame sequence of the target video, and determine a common chromaticity value parameter of adjacent pixels in a pixel array of a corresponding fused image frame;
[0107] The first information processing module 2082 is configured to perform a second transformation on the first transformation result of the original image frame of the target video based on the common chromaticity value parameter of the adjacent pixels to form a fused image frame, wherein the fused image frame carries transparent channel information that matches the original image frame of the target video;
[0108] The first information processing module 2082 is configured to perform video encoding processing on the fused image frame according to the original image frame sequence to form corresponding video stream information to be stored.
[0109] Combine Figure 2 The server 20 shown illustrates the video information processing method provided by the embodiment of the present invention, see Figure 3 , Figure 3 This is an optional flow chart of the video information processing method provided by the embodiment of the present invention. It can be understood that: Figure 3 The steps shown can be performed by various servers running video information processing devices, such as dedicated terminals, servers, cloud servers or server clusters with video information processing functions. Figure 3 The steps shown are explained.
[0110] Step 301: The video information processing apparatus obtains original image frames of a target video and a corresponding original image frame sequence.
[0111] In some embodiments of the present invention, obtaining the original image frames of the target video and the corresponding original image frame sequence can be achieved by:
[0112] Based on the initialization parameters of the target video, the starting position and the ending position of the target video are determined; the target video is sliced according to the starting position and the ending position to form slices of the target video; the original image frames of the target video are determined according to the slices of the target video, and the corresponding original image frame sequence is determined according to the parameter information of the original image frames of the target video. Furthermore, according to different usage scenarios, the code stream of the target video signal and the code stream of the target video signal can be encapsulated into new multimedia information to form multimedia information to be on demand; or the formed multimedia information can be pushed to the terminal 10 through the network 40.
[0113] In some embodiments of the present invention, when processing the target video, the target video is first initialized, and two consecutive frames of images are extracted from the target video through the processing queue of the image processor GPU, namely the first frame image T-1 and the second frame image T. Since the noise of each frame image in the target video shot under dark light conditions usually satisfies the Gaussian distribution, when removing the noise of the image frame, the extracted first frame image T-1 and the second frame image T are first Gaussian blurred to improve the operating efficiency of the image processor GPU.
[0114] Step 302: The video information processing device performs a first conversion process on the original image frames of the target video according to the original image frame sequence of the target video, and determines the common chromaticity value parameters of adjacent pixel points in the pixel array of the corresponding fused image frame.
[0115] In some embodiments of the present invention, performing a first conversion process on the original image frames of the target video according to the original image frame sequence of the target video and determining the common chromaticity value parameters of adjacent pixels in the pixel array of the corresponding fused image frame can be achieved by:
[0116] According to the original image frame sequence of the target video, the original image frame of the target video is converted from a three-primary color encoding method to a grayscale value encoding method; the chromaticity value parameter of each pixel in the original image frame of the grayscale value encoding method is determined; based on the original image frame sequence of the target video, adjacent pixels in the pixel array of the original image frame are determined, and based on the chromaticity value parameter of each pixel in the original image frame, a common chromaticity value parameter of adjacent pixels in the pixel array of the corresponding fused image frame is determined. The video information processing method provided by the present invention can be applied to various scenarios, especially for use environments with social information interaction functions. During the communication process between the two communicating parties, playing the video at a suitable time can significantly improve the user experience. Video playback can be triggered by certain conditions. The triggering condition for video playback can be that the communication information sent by the two communicating parties during the communication includes a keyword that can trigger an animation effect; or the user activates a function in the software application that has an animation playback effect, such as when the gift sending function is activated, an animation effect about the gift giving process can be played. The embodiment of the present invention does not specifically limit the form of the above triggering condition. Furthermore, currently, in order to avoid affecting the communication between the two parties in viewing the content of the chat box, the animation videos played are usually transparent animation videos. In order to solve the problems of high memory consumption and poor playback performance when playing transparent animations, the embodiment of the present invention proposes a method of using a video file with a specific format as the carrier of the animation and playing the animation through a native player. The specific format can be the fourth version of the Moving Pictures Experts Group (MP4) or the streaming media format (FLV Flash Video), etc., which is not specifically limited in the embodiment of the present invention.
[0117] In some embodiments of the present invention, determining the common chromaticity value parameters of adjacent pixels in the pixel array of the corresponding fused image frame based on the chromaticity value parameters of each pixel in the original image frame can be achieved by:
[0118] Based on the color parameters in the chromaticity value parameters of each pixel point in the original image frame, the common color parameters of adjacent pixel points in the pixel array of the corresponding fused image frame are determined; based on the saturation parameters in the chromaticity value parameters of each pixel point in the original image frame, the common saturation parameters of adjacent pixel points in the pixel array of the corresponding fused image frame are determined.
[0119] In some embodiments of the present invention, performing a second transformation on the first transformation result of the original image frame of the target video based on the common chromaticity value parameter of the adjacent pixels to form a fused image frame can be achieved by:
[0120] Based on a mapping relationship matching the target video, the color parameters of the chromaticity value parameters of each pixel in the original image frame are replaced by the common color parameters of adjacent pixels in the pixel array of the fused image frame; based on a mapping relationship matching the target video, the saturation parameters of the chromaticity value parameters of each pixel in the original image frame are replaced by the common saturation parameters of adjacent pixels in the pixel array of the fused image frame; and transparent channel information matching the original image frame of the target video is filled into the pixel array to form a fused image frame carrying transparent channel information. Since the color parameters of the chromaticity value parameters of each pixel in the original image frame are replaced by the common color parameters of adjacent pixels in the pixel array of the fused image frame, the volume of the pixel array of the fused image frame is significantly smaller than that of the original image frame, thereby maximally filling the transparent channel information matching the original image frame of the target video into the pixel array to form the fused image frame carrying transparent channel information. Thus, by compressing the volume of the fused image frame, the volume of the target video can also be effectively compressed.
[0121] Step 303: The video information processing device performs a second conversion process on the first conversion process result of the original image frame of the target video based on the common chromaticity value parameters of the adjacent pixel points to form a fused image frame.
[0122] The fused image frame carries transparent channel information that matches the original image frame of the target video.
[0123] Step 304: The video information processing device performs video encoding processing on the fused image frame according to the original image frame sequence to form corresponding video stream information to be stored.
[0124] The structure of the video information processing device of the embodiment of the present invention is described in detail below. The video information processing device can be implemented in various forms, such as a dedicated terminal with the processing function of the video information processing device, or a server with the processing function of the video information processing device, such as the preceding Figure 1 Terminal 10-1 or 10-2 in. Figure 4 The schematic diagram of the structure of the video information processing device provided by the embodiment of the present invention can be understood as follows: Figure 4 Only an exemplary structure of the video information processing device is shown, not all structures, and can be implemented as needed. Figure 4 Partial or complete structure shown.
[0125] The video information processing device provided in the embodiment of the present invention includes: at least one processor 401, a memory 402, a user interface 403 and at least one network interface 404. The various components in the video information processing device are coupled together via a bus system 405. It can be understood that the bus system 405 is used to achieve connection and communication between these components. In addition to including a data bus, the bus system 405 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the bus system 405 is not described in detail. Figure 4 Various buses are labeled as bus system 405 .
[0126] The user interface 403 may include a display, a keyboard, a mouse, a trackball, a click wheel, keys, buttons, a touch pad or a touch screen.
[0127] It is understood that the memory 402 can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. The memory 402 in the embodiment of the present invention can store data to support the operation of the terminal (such as 10-1). Examples of such data include: any computer program for operating on the terminal (such as 10-1), such as an operating system and an application. Among them, the operating system includes various system programs, such as a framework layer, a core library layer, a driver layer, etc., which are used to implement various basic services and process hardware-based tasks. The application can include various applications.
[0128] In some embodiments, the video information processing device provided by the embodiments of the present invention can be implemented in a combination of software and hardware. As an example, the video information processing device provided by the embodiments of the present invention can be a processor in the form of a hardware decoding processor, which is programmed to execute the video information processing method provided by the embodiments of the present invention. For example, the processor in the form of a hardware decoding processor can adopt one or more application-specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field-programmable gate arrays (FPGAs), or other electronic components.
[0129] As an example of a video information processing device provided by an embodiment of the present invention being implemented by a combination of software and hardware, the video information processing device provided by an embodiment of the present invention can be directly embodied as a combination of software modules executed by a processor 401. The software module can be located in a storage medium, and the storage medium is located in the memory 402. The processor 401 reads the executable instructions included in the software module in the memory 402, and combines with the necessary hardware (for example, including the processor 401 and other components connected to the bus 405) to complete the video information processing method provided by the embodiment of the present invention.
[0130] As an example, the processor 401 can be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc., where the general-purpose processor can be a microprocessor or any conventional processor, etc.
[0131] As an example of a hardware implementation of the video information processing device provided in an embodiment of the present invention, the device provided in an embodiment of the present invention can be directly executed by a processor 401 in the form of a hardware decoding processor, for example, one or more application-specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field-programmable gate arrays (FPGAs), or other electronic components to implement the video information processing method provided in an embodiment of the present invention.
[0132] The memory 402 in the embodiment of the present invention is used to store various types of data to support the operation of the video information processing device. Examples of such data include any executable instructions for operating on the video information processing device, such as executable instructions. The program implementing the video information processing method of the embodiment of the present invention may be included in the executable instructions.
[0133] In other embodiments, the video information processing device provided by the embodiment of the present invention can be implemented in software. Figure 4The video information processing device stored in memory 402 is shown. This device may be software in the form of a program or plug-in, and may include a series of modules. An example of a program stored in memory 402 may include a video information processing device, which includes the following software modules: a second information transmission module 4081 and a second information processing module 4082. When the software modules in the video information processing device are read into RAM by processor 401 and executed, the video information processing method provided in an embodiment of the present invention is implemented. The functions of the various software modules in the video information processing device include:
[0134] The second information transmission module 4081 is configured to obtain the video stream information when the playback process corresponding to the stored video stream information is triggered, decode the video stream information, and determine the corresponding fused image frame, wherein the fused image frame carries the corresponding transparent channel information;
[0135] The second information processing module 4082 is configured to perform a third transformation on the fused image frame to determine a chromaticity value parameter of each pixel in the fused image frame;
[0136] A second information processing module 4082 is configured to perform a fourth transformation on the third transformation result of the fused image frame based on the chromaticity value parameter of each pixel in the fused image frame to form a corresponding original image frame;
[0137] The second information processing module 4082 is configured to adjust the transparency of the original image frame based on the transparent channel information, and perform video encoding processing on the original image frame to form a corresponding target video.
[0138] Combine Figure 2 The terminal 10-1 shown illustrates the video information processing method provided by the embodiment of the present invention, see Figure 5 , Figure 5 This is an optional flow chart of the video information processing method provided by the embodiment of the present invention. It can be understood that: Figure 5 The steps shown can be performed by various electronic devices running video information processing devices, such as dedicated terminals with video information processing functions, video players. Figure 5 The steps shown are explained.
[0139] Step 501: When the playback process corresponding to the stored video stream information is triggered, the video stream information is obtained, and the video stream information is decoded to determine the corresponding fused image frame.
[0140] The fused image frame carries corresponding transparent channel information.
[0141] Step 502: Perform a third transformation process on the fused image frame to determine the chromaticity value parameter of each pixel in the fused image frame.
[0142] In some embodiments of the present invention, performing the third conversion process on the fused image frame to determine the chromaticity value parameter of each pixel in the fused image frame can be achieved by:
[0143] According to the sequence of the fused image frames, based on the common chromaticity value parameters of adjacent pixels in the fused image frame, the color parameters in the chromaticity value parameters of each pixel in the original image frame are determined; according to the sequence of the fused image frames, based on the common saturation parameters of adjacent pixels in the fused image frame, the saturation parameters in the chromaticity value parameters of each pixel in the original image frame are determined.
[0144] Step 503: Based on the chromaticity value parameters of each pixel in the fused image frame, perform a fourth transformation on the result of the third transformation of the fused image frame to form a corresponding original image frame.
[0145] In some embodiments of the present invention, performing a fourth transformation on the result of the third transformation of the fused image frame based on the chromaticity value parameter of each pixel in the fused image frame to form a corresponding original image frame can be achieved by:
[0146] Based on the color parameters and saturation parameters in the chromaticity value parameters of each pixel point in the original image frame, the third conversion processing result of the fused image frame is converted from the grayscale value encoding method to the three primary color encoding method to form the corresponding original image frame.
[0147] Step 504: Based on the transparent channel information, the transparency of the original image frame is adjusted, and the original image frame is subjected to video encoding processing to form a corresponding target video.
[0148] Combine Figure 2 The terminal 10-1 and the server 200 are shown to illustrate the video information processing method provided by the embodiment of the present invention. Figure 6 , Figure 6 This is an optional flow chart of the video information processing method provided by the embodiment of the present invention. It can be understood that: Figure 6 The steps shown can be performed by various electronic devices running a video information processing system, such as a dedicated terminal with video information processing function, a video player (which can store the encoded target video and decode the video information). Figure 6 The steps shown are explained.
[0149] Step 601: Acquire original image frames of a target video and a corresponding original image frame sequence.
[0150] Step 602: performing a first conversion process on the original image frames of the target video according to the original image frame sequence of the target video, and determining common chromaticity value parameters of adjacent pixels in a pixel array of a corresponding fused image frame.
[0151] Among them, for each picture in the PNG sequence, it contains an Alpha channel, wherein the Alpha channel is a special layer for recording transparency information. For example, a picture stored using 16 bits may have 5 bits representing red (R), 5 bits representing green (G), 5 bits representing blue (B), and 1 bit representing transparency. In this case, the picture is either completely transparent or completely opaque. For a picture stored using 32 bits, red, green, blue and transparency can be represented every 8 bits. In this case, in addition to representing complete transparency and complete opacity, the Alpha channel can also represent 256 levels of translucency. The Alpha value ranges from 0 to 1. Among them, 1 represents complete opacity and 0 represents complete transparency. In an embodiment of the present invention, the transparency parameter refers to the above-mentioned Alpha value. Among them, in addition to RGB values, color parameter values can also be represented as YUV values.
[0152] Step 603: Based on the common chromaticity value parameters of the adjacent pixels, a second transformation is performed on the first transformation result of the original image frame of the target video to form a fused image frame, wherein the fused image frame carries transparent channel information that matches the original image frame of the target video.
[0153] Step 604: performing video encoding processing on the fused image frame according to the original image frame sequence to form corresponding video stream information to be stored.
[0154] Step 605: When the playback process corresponding to the stored video stream information is triggered, the video stream information is obtained, and the video stream information is decoded to determine a corresponding fused image frame, wherein the fused image frame carries corresponding transparent channel information.
[0155] Step 606: Perform a third transformation process on the fused image frame to determine the chromaticity value parameter of each pixel in the fused image frame.
[0156] Step 607: Based on the chromaticity value parameters of each pixel in the fused image frame, perform a fourth transformation on the result of the third transformation of the fused image frame to form a corresponding original image frame.
[0157] Step 608: Based on the transparent channel information, adjust the transparency of the original image frame, and perform video encoding processing on the original image frame to form video stream information of corresponding transparency.
[0158] The following uses the target video as an animation as an example to illustrate the video information processing method provided by this application. Figure 1 In the illustrated usage environment, transparent animations can be played using formats such as PNG sequences, APNG images, GIF images, and MP4. PNG sequences and APNG images are large in size, consume significant performance overhead when decoded into bitmaps, and consume significant memory during playback, making them unsuitable for high-resolution and long-duration animations. GIF animations, however, lack transparency information, as they contain only 0s and 1s, and their clarity and frame rate are low after compression, making them unsuitable for large animation playback. While transparent MP4 can support transparent animation playback, it requires expanding the width or height of the image to twice the original size, storing half the RGB information and the other half the transparency information, or expanding the width or height to 4 / 3 of the original size, with the remaining 1 / 3 used for the transparency information. This also requires a larger viewing area for the animation. This increases the size of the animation file, memory usage, and CPU usage during the decoding process on the phone. In scenarios where full-screen animation playback is required, excessive memory usage can impact other terminal processes.
[0159] refer to Figure 7 , Figure 7 An optional flow chart of a video information processing method provided in an embodiment of the present invention is provided. To solve the above-mentioned problem, an embodiment of the present invention provides a video information processing method, comprising the following steps:
[0160] Step 701: Acquire a sequence of image frames of a target video.
[0161] Traditional animation formats (such as MP4) don't support transparent display. The decoded image data only contains the RGB channel triplet. To support transparent playback, the alpha channel (αChannel or Alpha Channel) must be stored in each frame. In existing methods, each image in the data source (PNG sequence) includes an alpha channel, but this information is lost when the animation is synthesized.
[0162] Step 702: Process the image frame of the target video to form a pair of UV values shared by two adjacent pixels.
[0163] Among them, reference Figure 8 , Figure 8 A schematic diagram of video encoding of an original image frame using the video information processing method provided in an embodiment of the present invention. In the process of converting the RGB image frame to YUV, two adjacent pixels can share a pair of UV values, saving exactly 1 / 3 of the space for each pixel. The saved space can be used to store the alpha channel information corresponding to the pixel.
[0164] refer to Figure 9 and Figure 10 , Figure 9 A schematic diagram of the encoding effect of the video information processing method provided by an embodiment of the present invention is provided. Figure 10 A schematic diagram of the encoding effect of the video information processing method provided in an embodiment of the present invention, wherein, since the color parameters in the chromaticity value parameters of each pixel point in the original image frame are replaced by the common color parameters of adjacent pixels in the pixel array of the fused image frame, the volume of the pixel array of the fused image frame is significantly smaller than the volume of the original image frame, thereby achieving the maximum extent of filling transparent channel information matching the original image frame of the target animation into the pixel array, forming a fused image frame carrying transparent channel information. Therefore, by compressing the volume of the fused image frame, the volume of the target animation can also be effectively compressed.
[0165] Step 703: triggering the ffmpeg process to convert the processed image frame sequence into a corresponding mp4 format file.
[0166] Step 704: When the target video is in the playing state, the corresponding MP4 format file is converted to form a transparent animation.
[0167] Among them, reference Figure 11 and Figure 12 , Figure 11 A schematic diagram of video decoding of an original image frame by a video information processing method provided by an embodiment of the present invention is provided. Figure 12 A schematic diagram of the decoding effect of the video information processing method provided in an embodiment of the present invention, wherein, during the animation playback process, the animation file generated in the previous step can be played. Before playback, it is necessary to restore the image obtained from the animation and convert the image frame from YUV format to RGB format to form a transparent animation.
[0168] Furthermore, the preceding steps may be processed by the CPU or GPU of the terminal. In this process, GPU processing is preferably used to reduce the load on the terminal CPU.
[0169] Compared with the transparent video solution used in traditional technology, refer to Table 1,
[0170]
[0171] Table 1
[0172] The technical solution provided by this application can not only effectively reduce the storage space required for animation, but also shorten the decoding time, improve the fluency of user use, and thus effectively improve the user experience.
[0173] Beneficial technical effects:
[0174] The embodiment of the present invention obtains the original image frame of the target video and the corresponding original image frame sequence; performs a first conversion process on the original image frame of the target video according to the original image frame sequence of the target video, and determines the common chromaticity value parameters of adjacent pixels in the pixel array of the corresponding fused image frame; performs a second conversion process on the first conversion process result of the original image frame of the target video based on the common chromaticity value parameters of the adjacent pixels to form a fused image frame, wherein the fused image frame carries transparent channel information that matches the original image frame of the target video; performs video encoding process on the fused image frame according to the original image frame sequence to form corresponding video stream information to be stored. Therefore, since the video stream information to be stored is used as the carrier of the encoding result, compared with the method of using PNG sequence for transparent animation playback, it can not only effectively reduce the storage space required for the animation, but also shorten the decoding time, improve the fluency of user use, and thus effectively improve the user experience.
[0175] The above description is merely an embodiment of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.
Claims
1. A video information processing method, characterized in that: The method comprises: Acquire original image frames of a target video, perform Gaussian blur processing on any two adjacent image frames in the original image frames, and determine a corresponding original image frame sequence based on the original image frames subjected to the Gaussian blur processing; Determine the chromaticity value parameters of each pixel in the original image frame in the grayscale encoding mode; Determining adjacent pixel points in a pixel array of the original image frame; Determining common color parameters of adjacent pixels in a pixel array of a corresponding fused image frame based on color parameters in the chromaticity value parameters of each pixel in the original image frame; Determining a common saturation parameter of adjacent pixels in a pixel array of a corresponding fused image frame based on a saturation parameter in the chromaticity value parameter of each pixel in the original image frame; Based on a mapping relationship matching the target video, replacing the color parameters in the chromaticity value parameters of each pixel in the original image frame with the common color parameters of adjacent pixels in the pixel array of the fused image frame; Based on a mapping relationship matching the target video, replacing a saturation parameter in a chromaticity value parameter of each pixel in the original image frame with a common saturation parameter of adjacent pixels in a pixel array of the fused image frame; Filling the transparent channel information that matches the original image frame of the target video into the pixel array to form a fused image frame carrying the transparent channel information; According to the original image frame sequence, video encoding processing is performed on the fused image frame to form corresponding video stream information to be stored.
2. The method according to claim 1, characterized in that The determining a corresponding original image frame sequence based on the original image frame subjected to the Gaussian blur processing includes: Determining the starting position and the ending position of slicing the target video according to the initialization parameters of the target video; Slicing the target video according to the starting position and the ending position to form slices of the target video; The original image frames of the target video are determined according to the slices of the target video, and the corresponding original image frame sequence is determined according to the parameter information of the original image frames of the target video that have undergone the Gaussian blur processing.
3. The method according to claim 1, characterized in that The triggering conditions for the target video playback include: the communication information sent by the communicating parties during the communication includes keywords that trigger the animation effect; or, the function with the animation playback effect is enabled in the software application.
4. A video information processing method, characterized in that: The method comprises: When a playback process corresponding to the stored video stream information is triggered, the video stream information is obtained, and the video stream information is decoded to determine a corresponding fused image frame, wherein the fused image frame carries corresponding transparent channel information, and the video stream information is obtained by the video information processing method according to any one of claims 1 to 3; Performing a third transformation process on the fused image frame to determine a chromaticity value parameter of each pixel in the fused image frame; performing a fourth transformation on the third transformation result of the fused image frame based on a chromaticity value parameter of each pixel in the fused image frame to form a corresponding original image frame; Based on the transparent channel information, the transparency of the original image frame is adjusted, and the original image frame is subjected to video encoding processing to form a corresponding target video.
5. The method according to claim 4, characterized in that The performing the third conversion process on the fused image frame to determine the chromaticity value parameter of each pixel in the fused image frame includes: Determining, according to the sequence of the fused image frames, a color parameter in the chromaticity value parameters of each pixel in the original image frame based on common chromaticity value parameters of adjacent pixels in the fused image frame; According to the sequence of the fused image frames, the saturation parameter in the chromaticity value parameters of each pixel in the original image frame is determined based on the common saturation parameter of adjacent pixels in the fused image frame.
6. The method according to claim 5, characterized in that The step of performing a fourth transformation on the result of the third transformation of the fused image frame based on the chromaticity value parameter of each pixel in the fused image frame to form a corresponding original image frame includes: Based on the color parameters and saturation parameters in the chromaticity value parameters of each pixel point in the original image frame, the third conversion processing result of the fused image frame is converted from the grayscale value encoding method to the three primary color encoding method to form the corresponding original image frame.
7. The method according to claim 4, characterized in that The method further comprises: Display a user interface, wherein the user interface includes a process display interface matching different application processes; When a playback process triggering operation for the stored video stream information is received, the video stream information with corresponding transparency is displayed on the user interface.
8. A video information processing method, characterized in that: The method comprises: Acquire original image frames of a target video, perform Gaussian blur processing on any two adjacent image frames in the original image frames, and determine a corresponding original image frame sequence based on the original image frames subjected to the Gaussian blur processing; Determine the chromaticity value parameters of each pixel in the original image frame in the grayscale encoding mode; Determining adjacent pixel points in a pixel array of the original image frame; Determining common color parameters of adjacent pixels in a pixel array of a corresponding fused image frame based on color parameters in the chromaticity value parameters of each pixel in the original image frame; Determining a common saturation parameter of adjacent pixels in a pixel array of a corresponding fused image frame based on a saturation parameter in the chromaticity value parameter of each pixel in the original image frame; Based on a mapping relationship matching the target video, replacing the color parameters in the chromaticity value parameters of each pixel in the original image frame with the common color parameters of adjacent pixels in the pixel array of the fused image frame; Based on a mapping relationship matching the target video, replacing a saturation parameter in a chromaticity value parameter of each pixel in the original image frame with a common saturation parameter of adjacent pixels in a pixel array of the fused image frame; Filling the pixel array with transparent channel information that matches the original image frame of the target video to form a fused image frame carrying the transparent channel information; According to the original image frame sequence, the fused image frame is subjected to video encoding processing to form corresponding video stream information to be stored; When the playback process corresponding to the stored video stream information is triggered, the video stream information is acquired, and the video stream information is decoded to determine the corresponding fused image frame; Performing a third transformation process on the fused image frame to determine a chromaticity value parameter of each pixel in the fused image frame; performing a fourth transformation on the third transformation result of the fused image frame based on a chromaticity value parameter of each pixel in the fused image frame to form a corresponding original image frame; Based on the transparent channel information, the transparency of the original image frame is adjusted, and the original image frame is subjected to video encoding processing to form video stream information of corresponding transparency.
9. A video information processing device, characterized in that: The device comprises: a first information transmission module, configured to obtain original image frames of a target video, perform Gaussian blur processing on any two adjacent image frames in the original image frames, and determine a corresponding original image frame sequence based on the original image frames subjected to the Gaussian blur processing; The first information processing module is configured to determine a chromaticity value parameter for each pixel in an original image frame encoded in a grayscale value manner; determine adjacent pixels in a pixel array of the original image frame; determine a common color parameter for adjacent pixels in a pixel array of a corresponding fused image frame based on a color parameter in the chromaticity value parameter for each pixel in the original image frame; and determine a common saturation parameter for adjacent pixels in a pixel array of a corresponding fused image frame based on a saturation parameter in the chromaticity value parameter for each pixel in the original image frame. The first information processing module is further configured to replace, based on a mapping relationship matching the target video, a color parameter in the chromaticity value parameter of each pixel in the original image frame with a common color parameter of adjacent pixels in the pixel array of the fused image frame; replace, based on a mapping relationship matching the target video, a saturation parameter in the chromaticity value parameter of each pixel in the original image frame with a common saturation parameter of adjacent pixels in the pixel array of the fused image frame; and fill the pixel array with transparent channel information matching the original image frame of the target video to form a fused image frame carrying the transparent channel information; The first information processing module is further configured to perform video encoding processing on the fused image frame according to the original image frame sequence to form corresponding video stream information to be stored.
10. A video information processing device, characterized in that: The device comprises: a second information transmission module, configured to obtain the video stream information when a playback process corresponding to the stored video stream information is triggered, and decode the video stream information to determine a corresponding fused image frame, wherein the fused image frame carries corresponding transparent channel information, and the video stream information is obtained by the video information processing method according to any one of claims 1 to 3; a second information processing module, configured to perform a third transformation on the fused image frame to determine a chromaticity value parameter of each pixel in the fused image frame; a second information processing module, configured to perform a fourth transformation on the third transformation result of the fused image frame based on the chromaticity value parameter of each pixel in the fused image frame to form a corresponding original image frame; The second information processing module is configured to adjust the transparency of the original image frame based on the transparent channel information, and perform video encoding processing on the original image frame to form a corresponding target video.
11. A video information processing system, characterized in that: The system comprises: a third information transmission module, configured to obtain original image frames of a target video, perform Gaussian blur processing on any two adjacent image frames in the original image frames, and determine a corresponding original image frame sequence based on the original image frames subjected to the Gaussian blur processing; a third information processing module configured to determine a chromaticity parameter of each pixel in an original image frame encoded in a grayscale value manner; determine adjacent pixels in a pixel array of the original image frame; determine a common color parameter of adjacent pixels in a pixel array of a corresponding fused image frame based on a color parameter in the chromaticity parameter of each pixel in the original image frame; and determine a common saturation parameter of adjacent pixels in a pixel array of a corresponding fused image frame based on a saturation parameter in the chromaticity parameter of each pixel in the original image frame; The third information processing module is configured to replace the color parameters of the chromaticity value parameters of each pixel in the original image frame with the common color parameters of adjacent pixels in the pixel array of the fused image frame based on a mapping relationship matching the target video; replace the saturation parameters of the chromaticity value parameters of each pixel in the original image frame with the common saturation parameters of adjacent pixels in the pixel array of the fused image frame based on a mapping relationship matching the target video; and fill the transparent channel information matching the original image frame of the target video into the pixel array to form a fused image frame carrying the transparent channel information; The third information processing module is configured to perform video encoding processing on the fused image frame according to the original image frame sequence to form corresponding video stream information to be stored; The third information processing module is configured to obtain the video stream information and decode the video stream information to determine the corresponding fused image frame when the playback process corresponding to the stored video stream information is triggered; Performing a third transformation process on the fused image frame to determine a chromaticity value parameter of each pixel in the fused image frame; performing a fourth transformation on the third transformation result of the fused image frame based on a chromaticity value parameter of each pixel in the fused image frame to form a corresponding original image frame; Based on the transparent channel information, the transparency of the original image frame is adjusted, and the original image frame is subjected to video encoding processing to form video stream information of corresponding transparency.
12. An electronic device, characterized in that: The electronic device comprises: a memory for storing executable instructions; The processor is configured to implement the video information processing method described in any one of claims 1 to 3, or the video information processing method described in any one of claims 4 to 7, or the video information processing method described in claim 8 when running the executable instructions stored in the memory.
13. A computer-readable storage medium storing executable instructions, characterized in that: When the executable instructions are executed by the processor, the video information processing method according to any one of claims 1 to 3 is implemented, or the video information processing method according to any one of claims 4 to 7, or the video information processing method according to claim 8 is implemented.
14. A method for processing a code stream, characterized in that: The code stream is generated according to the video information processing method according to any one of claims 1 to 3, or is decoded based on the video information processing method according to any one of claims 4 to 7, or is encoded and decoded based on the video information processing method according to claim 8.
Citation Information
Patent Citations
Animation playing method, device, storage medium and terminal
CN109272565A