Video processing method, device and system

Abstract

The embodiments of the present disclosure provide a video processing method, device and system, which include: obtaining multimedia information, the multimedia information including multiple segments of multimedia materials, decoding the multiple segments of multimedia materials based on different decoders to obtain video frames of each segment of multimedia materials, wherein a decoder decodes non-adjacent multimedia materials, and a segment of multimedia material corresponds to at least one video frame. In response to two adjacent video frames received by a renderer being generated by decoding by different decoders, a key frame is generated and output to an encoder based on the renderer, and a video of the multimedia information is generated based on the encoding operation of each key frame by the encoder, thereby avoiding the disadvantage of video quality freeze caused by using the IDR frame of the previous video frame in the two adjacent video frames to perform the encoding operation on the subsequent video frame, improving the video quality, and satisfying the user's viewing experience.

Description

Technical Field

[0001] The embodiments of the present disclosure relate to the field of video processing technology, and more particularly to a video processing method, device, and system. Background Art

[0002] Videos can be spliced ​​together from multiple multimedia materials based on transition processing.

[0003] Currently, during the scene transition processing and splicing process, a conventional encoding method is adopted, such as setting a fixed Instantaneous Decoding Refresh (IDR) frame for the encoder, so that the encoder encodes subsequent multiple frames to be encoded based on the IDR frame.

[0004] However, at the splicing of adjacent frames, the IDR frame is the frame corresponding to the previous multimedia material, and the frame to be encoded is the frame corresponding to the next multimedia material. Since the gap between the previous multimedia material and the next multimedia material is too large, the encoded video may have technical problems such as image quality freeze. Summary of the Invention

[0005] The embodiments of the present disclosure provide a video processing method, device, and system to overcome the technical problem of video quality freeze.

[0006] In a first aspect, an embodiment of the present disclosure provides a method for processing a video, comprising:

[0007] Acquiring multimedia information, the multimedia information including multiple segments of multimedia material, and decoding the multiple segments of multimedia material using different decoders to obtain video frames of each segment of multimedia material, wherein one decoder decodes non-adjacent multimedia materials, and one segment of multimedia material corresponds to at least one video frame;

[0008] In response to two adjacent video frames received by the renderer being decoded and generated by different decoders, the renderer generates and outputs key frames to the encoder, and the encoder generates the video of the multimedia information based on the encoding operation of each key frame.

[0009] In a second aspect, an embodiment of the present disclosure provides a video processing device, including:

[0010] An acquisition unit, configured to acquire multimedia information, wherein the multimedia information includes multiple multimedia materials;

[0011] a decoding unit, configured to decode the plurality of multimedia materials using different decoders to obtain video frames of each multimedia material segment, wherein one decoder decodes non-adjacent multimedia materials, and one multimedia material segment corresponds to at least one video frame;

[0012] an output unit, configured to, in response to two adjacent video frames received by the renderer being decoded and generated by different decoders, generate and output a key frame based on the renderer to the encoder;

[0013] The encoding unit is configured to generate a video of the multimedia information based on the encoding operation of the encoder according to each key frame.

[0014] In a third aspect, an embodiment of the present disclosure provides an electronic device, including: at least one processor and a memory;

[0015] The memory stores computer-executable instructions;

[0016] The at least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the video processing method as described in the first aspect and various possible aspects of the first aspect.

[0017] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, in which computer execution instructions are stored. When a processor executes the computer execution instructions, the video processing method as described in the first aspect and various possible aspects of the first aspect is implemented.

[0018] According to a fifth aspect of the present disclosure, a computer program product is provided, comprising: a computer program, the computer program being stored in a readable storage medium, at least one processor of an electronic device being able to read the computer program from the readable storage medium, the at least one processor executing the computer program so that the electronic device executes the first aspect and various possible video processing methods involved in the first aspect.

[0019] According to a sixth aspect of the present disclosure, a video processing system is provided, comprising: a plurality of decoders, a renderer connected to each decoder, and an encoder connected to the renderer, wherein:

[0020] Each decoder is configured to decode non-adjacent multimedia materials in multimedia information comprising multiple multimedia materials to obtain video frames, wherein one multimedia material segment corresponds to at least one video frame;

[0021] The renderer is configured to generate and output a key frame to the encoder in response to two adjacent video frames received by the renderer being generated by decoding by different decoders;

[0022] The encoder is used to generate the video of the multimedia information according to the encoding operation of each key frame.

[0023] The video processing method, device, and system provided in this embodiment include: obtaining multimedia information, the multimedia information including multiple multimedia materials; decoding the multiple multimedia materials using different decoders to obtain video frames of each multimedia material segment, wherein a decoder decodes non-adjacent multimedia materials, and a multimedia material segment corresponds to at least one video frame; in response to a renderer receiving information that two adjacent video frames are generated by decoding by different decoders, generating and outputting key frames to an encoder based on the renderer; and generating a video of the multimedia information based on encoding operations performed by the encoder based on the key frames. In this embodiment, different decoders are used to decode different multimedia materials to obtain video frames corresponding to each multimedia material; when two adjacent video frames are generated by decoding by different decoders, the renderer generates and outputs key frames to the encoder so that the encoder performs encoding operations based on the key frames to obtain a technical feature of the video, namely, the differences between the two adjacent video frames are fully considered during transition processing and splicing, avoiding the disadvantage of video quality freeze caused by using the IDR frame of the previous video frame to encode the subsequent video frame, thereby improving the video quality and satisfying the user's viewing experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0025] Figure 1 A schematic diagram of an application scenario of the video processing method according to an embodiment of the present disclosure;

[0026] Figure 2 is a schematic diagram of a video processing method according to an embodiment of the present disclosure;

[0027] Figure 3 Schematic diagram of a video processing method according to an embodiment of the present disclosure;

[0028] Figure 4 is a schematic diagram of a video processing method according to another embodiment of the present disclosure;

[0029] Figure 5 Schematic diagram of a video processing device according to an embodiment of the present disclosure;

[0030] Figure 6 is a schematic diagram of a video processing device according to another embodiment of the present disclosure;

[0031] Figure 7A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0032] To make the objectives, technical solutions, and advantages of the embodiments of the present disclosure more clear, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present disclosure without making any creative efforts shall fall within the scope of protection of the present disclosure.

[0033] A video is composed of multiple multimedia materials. By transitioning and splicing the multiple multimedia materials, a video with relatively high picture quality can be obtained.

[0034] The transition processing and splicing of multiple multimedia materials refers to the use of certain techniques, such as wiping, overlaying, and page curling, between any two adjacent multimedia materials to achieve a smooth transition between scenes or plots, or to achieve the effect of enriching the picture to attract the audience.

[0035] like Figure 1 As shown, on the time axis (0, t), there are three multimedia materials, namely Figure 1 The multimedia material 1, multimedia material 2 and multimedia material 3 shown in FIG.

[0036] In the related art, a fixed IDR frame is usually set, and based on the fixed IDR frame, the Figure 1 The multimedia material 1 and the multimedia material 2 shown in the figure are processed and spliced, and based on the Figure 1 The multimedia material 2 and the multimedia material 3 shown in the figure are transition processed and spliced ​​to obtain a video composed of the multimedia material 1, the multimedia material 2 and the multimedia material 3.

[0037] However, at the transition processing splicing of adjacent frames, such as at the transition processing splicing of multimedia material 1 and multimedia material 2 (i.e., the transition from multimedia material 1 to multimedia material 2), since the IDR frame is fixed, the IDR frame used to process multimedia material 2 is the same as the IDR frame used to process multimedia material 1. However, since multimedia material 1 and multimedia material 2 are two different multimedia materials, when multimedia material 2 is encoded with the IDR frame corresponding to multimedia material 1, the transition picture from multimedia material 1 to multimedia material 2 in the encoded video will be blurred, and the video quality will be stuck. Technical problems.

[0038] In order to avoid the above technical problems, the inventors of the present disclosure have obtained the inventive concept of the present disclosure through creative work: a decoder parses a piece of multimedia material to obtain corresponding video frames. When a renderer receives two adjacent video frames, it generates and outputs key frames to the encoder. The encoder performs encoding operations based on each key frame to obtain a video.

[0039] The following detailed description of the technical solution of the present disclosure and how the technical solution of the present disclosure solves the above-mentioned technical problems is provided with specific embodiments. The following specific embodiments may be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments. The embodiments of the present disclosure will be described below in conjunction with the accompanying drawings.

[0040] See also Figure 2 , Figure 2 A schematic diagram of a video processing method according to an embodiment of the present disclosure.

[0041] like Figure 2 As shown, the method includes:

[0042] S201: Acquire multimedia information, where the multimedia information includes multiple segments of multimedia materials. Decode the multiple segments of multimedia materials using different decoders to obtain corresponding video frames of each segment of multimedia materials.

[0043] Wherein, a decoder decodes non-adjacent multimedia materials, and a segment of multimedia material corresponds to at least one video frame.

[0044] The multimedia material may be a video material, a picture material, a moving picture material, or a mixed material of different types of multimedia materials, which is not limited in this embodiment.

[0045] Illustratively, the execution subject of this embodiment may be a video processing device (hereinafter referred to as the processing device), which may be a computer, a server, a terminal device, a processor, a chip, etc., and this embodiment does not limit this.

[0046] This embodiment does not limit the number of multimedia materials that can be decoded by any decoder. For example, in some embodiments, a decoder can decode multiple segments of multimedia materials, and any two consecutively processed segments of multimedia materials are non-adjacent in the multimedia information. In other embodiments, a decoder can only decode one segment of multimedia material.

[0047] S202: In response to the renderer receiving two adjacent video frames generated by decoding by different decoders, the renderer generates and outputs key frames to the encoder, and the encoder generates a video of the multimedia information based on the encoding operation of each key frame.

[0048] For example, Figure 3 As shown, there are two segments of multimedia materials, one segment is multimedia material A and the other segment is multimedia material B; decoder 1 is used to decode multimedia material A to obtain video frames A1 to An (n is a positive integer greater than 1), and transmit video frames A1 to An to the renderer, and decoder 2 is used to decode multimedia material B to obtain video frames B1 to Bm (m is a positive integer greater than 1, and the size between n and m is not limited), and transmit video frames B1 to Bm to the renderer.

[0049] The renderer receives video frames A1 to An and video frames B1 to Bm. Video frame An and video frame B1 are two adjacent video frames. The renderer can determine that video frame An and video frame B1 are generated by different decoders and output key frames to the encoder.

[0050] Accordingly, the encoder performs encoding operations based on key frames. For example, the renderer outputs the video frame B1 as a key frame to the encoder, and the encoder encodes the video frames B2 to Bm according to the video frame B1 to obtain the output video.

[0051] It is worth noting that since the key frame used to encode video frames B2 to Bm is video frame B1, it avoids the problem of mosaic blur in the video when encoding video frames B2 to Bm based on a certain video frame in video frames A1 to An, thereby improving the picture quality of the video and satisfying the user's viewing experience.

[0052] This embodiment does not limit the encoding operation. For example, a dynamic encoding operation (VBR), a static encoding operation (CBR), or an average bit rate encoding operation (ABR) may be used.

[0053] Based on the above analysis, it can be seen that the embodiment of the present disclosure provides a video processing method, including: obtaining multimedia information, the multimedia information including multiple multimedia materials, decoding the multiple multimedia materials based on different decoders to obtain video frames of each multimedia material segment, wherein a decoder decodes non-adjacent multimedia materials, and a multimedia material segment corresponds to at least one video frame. In response to a renderer receiving two adjacent video frames that are decoded and generated by different decoders, the renderer generates and outputs key frames to an encoder, and the encoder generates a video of the multimedia information based on encoding operations based on the key frames. In this embodiment, the following technical features are introduced: different decoders are used to decode different multimedia materials to obtain video frames corresponding to each multimedia material. When two adjacent video frames are decoded and generated by different decoders, the renderer generates and outputs key frames to the encoder so that the encoder performs encoding operations based on the key frames to obtain a video. That is, the difference between the two adjacent video frames is fully considered during the transition processing and splicing, avoiding the disadvantage of video quality freeze caused by using the IDR frame of the previous video frame of the two adjacent video frames to encode the subsequent video frame, thereby improving the video quality and satisfying the user's viewing experience.

[0054] See also Figure 4 , Figure 4 Schematic diagram of a video processing method according to another embodiment of the present disclosure.

[0055] like Figure 4 As shown, the method includes:

[0056] S401: Acquire multimedia information, where the multimedia information includes multiple segments of multimedia materials. Decode the multiple segments of multimedia materials using different decoders to obtain video frames corresponding to each segment of multimedia materials.

[0057] Among them, a decoder decodes non-adjacent multimedia materials, a section of multimedia material corresponds to at least one video frame, each decoder has a decoder identifier, and each video frame carries the decoder identifier of each video frame obtained by decoding.

[0058] In this embodiment, in order to distinguish different decoders, an identifier (ie, decoder identifier) ​​may be assigned to each decoder, and for any decoder, after the decoder decodes the multimedia material, the decoder identifier may be added to each decoded video frame.

[0059] For example, the processing device may assign decoder identifiers to decoders so that different decoders have different decoder identifiers, and determine a decoder for decoding each section of multimedia material.

[0060] It is worth noting that, in some embodiments, the multimedia material and the decoder may have a one-to-one correspondence, for example, one section of multimedia material corresponds to one decoder, and one decoder decodes one section of multimedia material.

[0061] For example, each segment of multimedia material includes multimedia material 1 to multimedia material x (x is a positive integer greater than or equal to 2), the number of decoders is also x, and one decoder decodes non-adjacent multimedia materials.

[0062] In other embodiments, the number of decoders may be less than the number of multimedia materials, and two multimedia videos consecutively decoded by any decoder are two non-adjacent multimedia materials in the multimedia information.

[0063] For example, each segment of multimedia material includes multimedia material 1 to multimedia material x, where x is a positive integer greater than or equal to 2, the number of decoders is y, and y is a positive integer less than x. For multimedia materials that are two adjacent segments of multimedia materials in multimedia information, such as multimedia material x-1 and multimedia material x, if decoder y is used to decode multimedia material x, it is not used to decode multimedia material x-1. Conversely, if decoder y is used to decode multimedia material x-1, it is not used to decode multimedia material x.

[0064] S402: If the decoder identifiers carried by two adjacent video frames are different decoder identifiers, determine based on the renderer that the two adjacent video frames are decoded and generated by different decoders, and generate and output key frames to the encoder based on the renderer.

[0065] For example, combined with Figure 3 As well as the above Figure 3 In a corresponding embodiment, video frames A1 to An carry the decoder identifier of decoder 1, and video frames B1 to Bm carry the decoder identifier of decoder 2. The renderer determines whether the decoder identifier carried in the current video frame is the same as the decoder identifier carried in the previous video frame for each video frame received from video frames A1 to An and video frames B1 to Bm, so as to generate and output key frames to the encoder.

[0066] For example, if the current video frame is video frame An and the previous video frame is video frame An-1, the renderer determines that the video frame An carries the decoder identifier of decoder 1, and determines that the video frame An-1 also carries the decoder identifier of decoder 1, then the renderer determines that the decoder identifiers carried in video frame An are the same as those carried in video frame An-1, and there is no need to output key frames to the encoder.

[0067] On the contrary, if the previous video frame is video frame An and the current video frame is video frame B1, the renderer determines that the decoder identifier carried in video frame An is that of decoder 1, and determines that the decoder identifier carried in video frame B1 is that of decoder 2, then the renderer determines that the decoder identifiers carried in video frame An are different from those carried in video frame B1, and generates and outputs a key frame to the encoder.

[0068] In this embodiment, by combining the decoder identifier to determine whether two adjacent video frames are generated by the same decoder or by different decoders, convenience and reliability of the determination can be achieved.

[0069] In some embodiments, the key frame is an Instantaneous Decoding Refresh (IDR) frame.

[0070] S403: For each adjacent key frame, the encoder performs an encoding operation on the non-key frames between each adjacent key frame based on the previous key frame to generate a video of the multimedia information.

[0071] For example, combined with Figure 3 As well as the above Figure 3 In a corresponding embodiment, if the renderer determines that the key frame output to the encoder is key frame B1 based on video frame An and video frame B1, similarly, the decoder 3 decodes the multimedia material C to generate video frames C1 to video frames Ck (k is a positive integer greater than 1, and the size between n, m, k is not limited), then the renderer can determine that the key frame output to the encoder is key frame C1 based on video frame Bm and video frame C1.

[0072] Accordingly, the encoder encodes the video frames between key frame B1 and key frame C1 according to key frame B1, that is, encodes video frames B2 to Bm (wherein video frames B2 to Bm are non-key frames) according to key frame B1.

[0073] In this embodiment, different key frames are used for encoding video frames corresponding to multimedia materials in different segments, thereby avoiding the disadvantage of image quality freeze and achieving the technical effect of improving image quality and satisfying the user's viewing experience.

[0074] In some embodiments, the processing device can set the video bit rate for the encoder. The video bit rate can be understood as the number of data bits transmitted per unit time during data transmission, and the unit is kilobits per second. Alternatively, the video bit rate can be simply understood as the amount of data output by the encoder. Accordingly, when the encoder performs the encoding operation, it can be combined with the video bit rate to improve the picture quality of the video.

[0075] For example, the processing device determines the video bit rate based on preset video requirement information, and the encoder encodes the non-key frames between each adjacent key frame based on the previous key frame and the video bit rate to generate a video of the multimedia information. The video requirement information may be video resolution information.

[0076] See also Figure 5 , Figure 5 Schematic diagram of a video processing device according to an embodiment of the present disclosure.

[0077] like Figure 5 As shown, the video processing device 500 includes:

[0078] The acquisition unit 501 is configured to acquire multimedia information, where the multimedia information includes multiple multimedia materials.

[0079] The decoding unit 502 is configured to decode multiple multimedia materials using different decoders to obtain video frames of each multimedia material segment. One decoder decodes non-adjacent multimedia materials, and one multimedia material segment corresponds to at least one video frame.

[0080] The output unit 503 is configured to generate and output a key frame to the encoder based on the renderer in response to two adjacent video frames received by the renderer being decoded and generated by different decoders.

[0081] The encoding unit 504 is configured to generate a video of the multimedia information based on the encoding operation of the encoder according to each key frame.

[0082] See also Figure 6 , Figure 6 4 is a schematic diagram of a video processing device according to another embodiment of the present disclosure.

[0083] like Figure 6 As shown, the video processing device 600 includes:

[0084] The acquisition unit 601 is configured to acquire multimedia information, where the multimedia information includes multiple multimedia materials.

[0085] The allocating unit 602 is configured to allocate a decoder identifier to each decoder.

[0086] The determining unit 603 is configured to determine a decoder for decoding each segment of multimedia material.

[0087] The decoding unit 604 is configured to decode multiple segments of multimedia materials based on different decoders to obtain video frames of each segment of multimedia materials, wherein one decoder decodes non-adjacent multimedia materials, and one segment of multimedia material corresponds to at least one video frame.

[0088] The output unit 605 is configured to generate and output a key frame to the encoder based on the renderer in response to two adjacent video frames received by the renderer being decoded and generated by different decoders.

[0089] In some embodiments, each decoder has a decoder identifier, and each video frame carries the decoder identifier of each video frame obtained by decoding. Figure 6 It can be seen that the output unit 605 includes:

[0090] The determining subunit 6051 is configured to determine that the two adjacent video frames are decoded and generated by different decoders if the decoder identifiers carried by the two adjacent video frames are different decoder identifiers.

[0091] The output subunit 6052 is configured to generate and output key frames to an encoder based on the renderer.

[0092] In some embodiments, the key frame is an Instantaneous Decoding Refresh (IDR) frame.

[0093] The encoding unit 606 is configured to generate a video of the multimedia information based on the encoding operation of the encoder according to each key frame.

[0094] In some embodiments, the encoding unit 606 is configured to, for each adjacent key frame, perform an encoding operation on non-key frames between the adjacent key frames based on a previous key frame to generate a video of the multimedia information.

[0095] In some embodiments, the encoding unit 606 is configured to generate a video of the multimedia information based on an encoding operation of the encoder according to each key frame and a preset video bit rate, wherein the video bit rate is determined based on preset video requirement information.

[0096] According to an embodiment of the present application, the present application also provides an electronic device and a readable storage medium.

[0097] According to an embodiment of the present application, the present application also provides a computer program product, which includes: a computer program, the computer program is stored in a readable storage medium, at least one processor of an electronic device can read the computer program from the readable storage medium, and at least one processor executes the computer program so that the electronic device executes the solution provided by any of the above embodiments.

[0098] refer to Figure 7, which shows a schematic structural diagram of an electronic device 700 suitable for implementing the embodiments of the present disclosure. The electronic device 700 may be a terminal device or a server. The terminal device may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (Portable Android Devices, PADs), portable multimedia players (PMPs), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 7 The electronic device shown is only an example and should not limit the functions and scope of use of the embodiments of the present disclosure.

[0099] like Figure 7 As shown, the electronic device 700 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 701, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 702 or a program loaded from a storage device 708 into a random access memory (RAM) 703. Various programs and data required for the operation of the electronic device 700 are also stored in the RAM 703. The processing device 701, the ROM 702, and the RAM 703 are connected to each other via a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.

[0100] Typically, the following devices may be connected to the I / O interface 705: an input device 706 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 707 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 708 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 709. The communication device 709 may allow the electronic device 700 to communicate with other devices wirelessly or by wire to exchange data. Although Figure 7 The electronic device 700 is shown with various devices, but it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed instead.

[0101] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network via the communication device 709, or installed from the storage device 708, or installed from the ROM 702. When the computer program is executed by the processing device 701, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

[0102] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transfer a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0103] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0104] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device executes the method shown in the above embodiment.

[0105] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0106] According to another aspect of the embodiment of the present disclosure, the embodiment of the present disclosure further provides a video processing system, comprising: a plurality of decoders, a renderer connected to each decoder, and an encoder connected to the renderer, wherein:

[0107] Each decoder is configured to decode non-adjacent multimedia materials in multimedia information comprising multiple multimedia materials to obtain video frames, wherein one multimedia material segment corresponds to at least one video frame;

[0108] The renderer is configured to generate and output a key frame to the encoder in response to two adjacent video frames received by the renderer being generated by decoding by different decoders;

[0109] The encoder is used to generate the video of the multimedia information according to the encoding operation of each key frame.

[0110] For example, combined with Figure 3 , the number of decoders can be multiple, it should be understood that, Figure 3 This is merely an illustration of the possible number of decoders in this embodiment and should not be construed as a limitation on the number of decoders.

[0111] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0112] The units involved in the embodiments described in this disclosure may be implemented in software or hardware. In some cases, the name of a unit does not limit the unit itself. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses."

[0113] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0114] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0115] In a first aspect, according to one or more embodiments of the present disclosure, a video processing method is provided, comprising:

[0116] Acquiring multimedia information, the multimedia information including multiple segments of multimedia material, and decoding the multiple segments of multimedia material using different decoders to obtain video frames of each segment of multimedia material, wherein one decoder decodes non-adjacent multimedia materials, and one segment of multimedia material corresponds to at least one video frame;

[0117] In response to two adjacent video frames received by the renderer being decoded and generated by different decoders, the renderer generates and outputs key frames to the encoder, and the encoder generates the video of the multimedia information based on the encoding operation of each key frame.

[0118] According to one or more embodiments of the present disclosure, each decoder has a decoder identifier, and each video frame carries the decoder identifier obtained by decoding each video frame. In response to a renderer receiving two adjacent video frames generated by decoding by different decoders, generating and outputting a key frame based on the renderer to an encoder includes:

[0119] If the decoder identifiers carried by the two adjacent video frames are different decoder identifiers, it is determined that the two adjacent video frames are decoded and generated by different decoders, and a key frame is generated based on the renderer and output to the encoder.

[0120] According to one or more embodiments of the present disclosure, the present invention further includes:

[0121] A decoder identifier is allocated to each decoder, and a decoder used to decode each section of multimedia material is determined.

[0122] According to one or more embodiments of the present disclosure, the key frame is an Instantaneous Decoding Refresh (IDR) frame.

[0123] According to one or more embodiments of the present disclosure, generating a video of the multimedia information based on the encoding operation of the encoder according to each key frame includes:

[0124] For each adjacent key frame, a coding operation is performed on the non-key frames between the adjacent key frames based on the previous key frame to generate a video of the multimedia information.

[0125] According to one or more embodiments of the present disclosure, generating a video of the multimedia information based on the encoding operation of the encoder according to each key frame includes:

[0126] Based on the encoding operation of the encoder according to each key frame and a preset video bit rate, a video of the multimedia information is generated, wherein the video bit rate is determined based on preset video requirement information.

[0127] In a second aspect, according to one or more embodiments of the present disclosure, a video processing apparatus is provided, comprising:

[0128] An acquisition unit, configured to acquire multimedia information, wherein the multimedia information includes multiple multimedia materials;

[0129] a decoding unit, configured to decode the plurality of multimedia materials using different decoders to obtain video frames of each multimedia material segment, wherein one decoder decodes non-adjacent multimedia materials, and one multimedia material segment corresponds to at least one video frame;

[0130] an output unit, configured to, in response to two adjacent video frames received by the renderer being decoded and generated by different decoders, generate and output a key frame based on the renderer to the encoder;

[0131] The encoding unit is configured to generate a video of the multimedia information based on the encoding operation of the encoder according to each key frame.

[0132] According to one or more embodiments of the present disclosure, each decoder has a decoder identifier, and each video frame carries the decoder identifier obtained by decoding each video frame; the output unit includes:

[0133] a determining subunit, configured to determine that the two adjacent video frames are decoded and generated by different decoders if the decoder identifiers carried by the two adjacent video frames are different decoder identifiers;

[0134] The output subunit is configured to generate and output key frames to an encoder based on the renderer.

[0135] According to one or more embodiments of the present disclosure, the present invention further includes:

[0136] an allocating unit, configured to allocate a decoder identifier to each decoder;

[0137] The determination subunit is configured to determine a decoder for decoding each segment of multimedia material.

[0138] According to one or more embodiments of the present disclosure, the key frame is an Instantaneous Decoding Refresh (IDR) frame.

[0139] According to one or more embodiments of the present disclosure, the encoding unit is configured to, for each adjacent key frame, perform an encoding operation on non-key frames between the adjacent key frames based on a previous key frame to generate a video of the multimedia information.

[0140] According to one or more embodiments of the present disclosure, the encoding unit is used to generate the video of the multimedia information based on the encoding operation of the encoder according to each key frame and a preset video bit rate, wherein the video bit rate is determined based on preset video requirement information.

[0141] In a third aspect, according to one or more embodiments of the present disclosure, there is provided an electronic device, comprising: at least one processor and a memory;

[0142] The memory stores computer-executable instructions;

[0143] The at least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the video processing method as described in the first aspect and various possible aspects of the first aspect.

[0144] In a fourth aspect, according to one or more embodiments of the present disclosure, a computer-readable storage medium is provided, in which computer-executable instructions are stored. When a processor executes the computer-executable instructions, the video processing method as described in the first aspect and various possible aspects of the first aspect is implemented.

[0145] In a fifth aspect, according to one or more embodiments of the present disclosure, a computer program product is provided, wherein the program product comprises: a computer program, wherein the computer program is stored in a readable storage medium, and at least one processor of an electronic device can read the computer program from the readable storage medium, and the at least one processor executes the computer program so that the electronic device executes the first aspect and various video processing methods that may be involved in the first aspect.

[0146] In a sixth aspect, according to one or more embodiments of the present disclosure, a video processing system is provided, comprising: a plurality of decoders, a renderer connected to each decoder, and an encoder connected to the renderer, wherein:

[0147] Each decoder is configured to decode non-adjacent multimedia materials in multimedia information comprising multiple multimedia materials to obtain video frames, wherein one multimedia material segment corresponds to at least one video frame;

[0148] The renderer is configured to generate and output a key frame to the encoder in response to two adjacent video frames received by the renderer being generated by decoding by different decoders;

[0149] The encoder is used to generate the video of the multimedia information according to the encoding operation of each key frame.

[0150] According to one or more embodiments of the present disclosure, each decoder has a decoder identifier, and each video frame carries the decoder identifier of each video frame obtained by decoding; the renderer is used to determine that the two adjacent video frames are decoded and generated by different decoders if the decoder identifiers carried by each of the two adjacent video frames are different decoder identifiers, and generate and output key frames to the encoder based on the renderer.

[0151] According to one or more embodiments of the present disclosure, the key frame is an Instantaneous Decoding Refresh (IDR) frame.

[0152] According to one or more embodiments of the present disclosure, the encoder is configured to, for each adjacent key frame, perform an encoding operation on non-key frames between the adjacent key frames based on a previous key frame to generate a video of the multimedia information.

[0153] According to one or more embodiments of the present disclosure, the encoder is used to generate the video of the multimedia information based on the encoding operation of the encoder according to each key frame and a preset video bit rate, wherein the video bit rate is determined based on preset video demand information.

[0154] The above description is merely a preferred embodiment of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above-mentioned technical features, but also includes other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned disclosed concepts. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in this disclosure.

[0155] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details have been included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0156] Although the subject matter has been described in language specific to structural features and / or methodological logical acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

1. A video processing method, comprising: Acquiring multimedia information, the multimedia information including multiple segments of multimedia material, and decoding the multiple segments of multimedia material using different decoders to obtain video frames of each segment of multimedia material, wherein one decoder decodes non-adjacent multimedia materials, and one segment of multimedia material corresponds to at least one video frame; In response to two adjacent video frames received by the renderer being decoded and generated by different decoders, generating and outputting key frames to the encoder based on the renderer, and generating a video of the multimedia information based on the encoding operation of the encoder according to each key frame; The step of generating a video of the multimedia information based on the encoding operation of the encoder according to each key frame includes: For each adjacent key frame, a coding operation is performed on the non-key frames between the adjacent key frames based on the previous key frame to generate a video of the multimedia information.

2. The method according to claim 1, wherein Each decoder has a decoder identifier, and each video frame carries the decoder identifier obtained by decoding the video frame; In response to two adjacent video frames received by a renderer being generated by decoding of different decoders, generating a key frame based on the renderer and outputting it to an encoder, comprising: If the decoder identifiers carried by the two adjacent video frames are different decoder identifiers, it is determined that the two adjacent video frames are decoded and generated by different decoders, and a key frame is generated based on the renderer and output to the encoder.

3. The method according to claim 2, further comprising: A decoder identifier is allocated to each decoder, and a decoder used to decode each section of multimedia material is determined.

4. The method according to any one of claims 1 to 3, wherein The key frame is an instantaneous decoding refresh (IDR) frame.

5. The method according to any one of claims 1 to 3, wherein Generating a video of the multimedia information based on the encoding operation of the encoder according to each key frame, including: Based on the encoding operation of the encoder according to each key frame and a preset video bit rate, a video of the multimedia information is generated, wherein the video bit rate is determined based on preset video requirement information.

6. A video processing device, comprising: An acquisition unit, configured to acquire multimedia information, wherein the multimedia information includes multiple multimedia materials; a decoding unit, configured to decode the plurality of multimedia materials using different decoders to obtain video frames of each multimedia material segment, wherein one decoder decodes non-adjacent multimedia materials, and one multimedia material segment corresponds to at least one video frame; an output unit, configured to, in response to two adjacent video frames received by the renderer being decoded and generated by different decoders, generate and output a key frame based on the renderer to the encoder; an encoding unit, configured to generate a video of the multimedia information based on an encoding operation of the encoder according to each key frame; The encoding unit is specifically configured to: For each adjacent key frame, a coding operation is performed on the non-key frames between the adjacent key frames based on the previous key frame to generate a video of the multimedia information.

7. An electronic device, characterized in that: include: at least one processor and memory; The memory stores computer-executable instructions; The at least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor performs the method according to any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer-executable instructions, and when a processor executes the computer-executable instructions, the method according to any one of claims 1 to 5 is implemented.

9. A computer program product comprising a computer program, which, when executed by a processor, implements the method according to any one of claims 1 to 5.

10. A video processing system, comprising: A plurality of decoders, a renderer connected to each decoder, an encoder connected to the renderer, wherein Each decoder is configured to decode non-adjacent multimedia materials in multimedia information comprising multiple multimedia materials to obtain video frames, wherein one multimedia material segment corresponds to at least one video frame; The renderer is configured to generate and output a key frame to the encoder in response to two adjacent video frames received by the renderer being generated by decoding by different decoders; The encoder is used to generate a video of the multimedia information according to the encoding operation of each key frame; Wherein, the encoder is specifically used for: For each adjacent key frame, a coding operation is performed on the non-key frames between the adjacent key frames based on the previous key frame to generate a video of the multimedia information.

Images