Video decoding reconstruction apparatus and method, video decoding system, electronic device
By storing the prediction data and residual data in the same storage area for reconstruction operations during video decoding, the problems of storage unit capacity overhead and hardware complexity are solved, thereby improving storage efficiency and simplifying hardware.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- FUZHOU ROCKCHIP SEMICON
- Filing Date
- 2024-11-27
- Publication Date
- 2026-05-29
AI Technical Summary
In existing technologies, video decoding requires the use of two storage units to store prediction data and residual data respectively, which increases the storage unit capacity overhead and the complexity of the hardware structure.
Predicted data and residual data are stored in the same storage area for reconstruction operations. The target channel is determined by the channel arbitration unit, and data is written and read in the target storage area for reconstruction operations. Deadlock prevention unit is used to prevent deadlock.
It reduces the number of memory units, improves storage efficiency, simplifies hardware design structure, and provides good design flexibility.
Smart Images

Figure CN122120460A_ABST
Abstract
Description
Technical Field
[0001] This disclosure belongs to the field of video encoding and decoding technology, and relates to video decoding and reconstruction technology, particularly to video decoding and reconstruction apparatus and methods, video decoding systems, and electronic equipment. Background Technology
[0002] Video decoding technology is widely used in streaming media, video conferencing, and television broadcasting. Its main function is to restore compressed, encoded video data into playable original video frames. Through video decoding, the compressed bitstream can be converted back into complete video information, thereby reducing storage and transmission costs while ensuring high-quality video presentation. Currently common video decoding standards include H.264, H.265 (HEVC), and AV1.
[0003] Video decoding and reconstruction is a crucial step in video decoding technology. It integrates prediction results and residual information to reconstruct high-quality image frames. Video decoding and reconstruction restores details from the video, ensuring that the decoded video image closely resembles its original uncompressed state. This technology not only improves the quality of video restoration but also reduces errors and artifacts introduced during compression, enhancing the overall viewing experience. Summary of the Invention
[0004] This disclosure provides video decoding and reconstruction apparatus and method, video decoding system, and electronic equipment to reduce the storage space required during the video decoding and reconstruction process.
[0005] In a first aspect, embodiments of this disclosure provide a video decoding and reconstruction apparatus. The video decoding and reconstruction apparatus includes: a reconstruction storage unit comprising multiple storage areas; a channel arbitration unit configured to arbitrate channels to determine a target channel, the channel including an inter-frame prediction channel, an intra-frame prediction channel, and an inverse transform channel; and an access request and reconstruction operation unit configured to: when no data is stored in the target storage area, send a write request signal to the reconstruction storage unit to write data of the target channel into the target storage area, wherein the target storage area is a storage area corresponding to the target channel; and when data is stored in the target storage area, send a read request signal to the reconstruction storage unit to read data from the target storage area, perform a reconstruction operation on the read data and the data of the target channel to obtain a reconstruction operation result, and write the reconstruction operation result into the target storage area.
[0006] In one implementation of the first aspect, the video decoding and reconstruction apparatus further includes: an anti-deadlock unit configured to determine whether a corresponding channel is allowed to access the reconstruction storage unit based on access request information of each channel, wherein the channel arbitration unit is configured to arbitrate the channels that are allowed to access the reconstruction storage unit to determine the target channel.
[0007] In one implementation of the first aspect, the anti-deadlock unit is configured to determine whether to allow the channel to access the reconstructed storage unit based on the access request information of the channel and the total remaining space or data of the reconstructed storage unit.
[0008] In one implementation of the first aspect, the video decoding and reconstruction apparatus further includes: a channel data writing marking unit configured to mark whether the storage area stores data by means of a storage information table, wherein the access request and reconstruction operation unit is configured to determine whether the target storage area stores data according to the storage information table.
[0009] In one implementation of the first aspect, the depth of the storage information table corresponds to the reconstructed storage unit, and different information tags are used in the storage information table to mark different states of the storage area.
[0010] In one implementation of the first aspect, the data in the target channel is predicted data, wherein the access request and reconstruction operation unit is configured to send a read request signal to the reconstruction storage unit to read the residual data from the target storage area when residual data is stored in the target storage area, and to perform a reconstruction operation on the residual data and the predicted data to obtain the reconstruction operation result.
[0011] In one implementation of the first aspect, the data in the target channel is residual data, wherein the access request and reconstruction operation unit is configured to send a read request signal to the reconstruction storage unit to read the prediction data from the target storage area when the prediction data is stored in the target storage area, and to perform a reconstruction operation on the prediction data and the residual data to obtain the reconstruction operation result.
[0012] Secondly, embodiments of this disclosure provide a video decoding system. The video decoding system includes: an entropy decoding module configured to perform entropy decoding on a video bitstream to obtain decoding information; a prediction module configured to perform inter-frame prediction or intra-frame prediction based on the decoding information to obtain prediction data; an inverse quantization and inverse transform module configured to perform inverse quantization and inverse transform calculations based on the decoding information to obtain residual data; a video decoding and reconstruction module configured to perform decoding and reconstruction based on the prediction data and the residual data; and an image filtering module configured to perform image filtering based on the decoding and reconstruction results, wherein the video decoding and reconstruction module includes: a reconstruction storage unit including multiple storage areas; and a channel arbitration unit configured to arbitrate channels to determine a target. The system includes an inter-frame prediction channel, an intra-frame prediction channel, and an inverse transform channel; and an access request and reconstruction operation unit configured to: when no data is stored in the target storage area, send a write request signal to the reconstruction storage unit to write the data of the target channel into the target storage area, wherein the target storage area is a storage area corresponding to the target channel; and when data is stored in the target storage area, send a read request signal to the reconstruction storage unit to read data from the target storage area, perform a reconstruction operation on the read data and the data of the target channel to obtain a reconstruction operation result, and write the reconstruction operation result into the target storage area.
[0013] Thirdly, embodiments of this disclosure provide a video decoding and reconstruction method. The video decoding and reconstruction method includes: arbitrating channels to determine a target channel, the channel including an inter-frame prediction channel, an intra-frame prediction channel, and an inverse transform channel; when no data is stored in the target storage area, sending a write request signal to a reconstruction storage unit to write data of the target channel into the target storage area, wherein the target storage area is a storage area corresponding to the target channel; and when data is stored in the target storage area, sending a read request signal to the reconstruction storage unit to read data from the target storage area, performing a reconstruction operation on the read data and the data of the target channel to obtain a reconstruction operation result, and writing the reconstruction operation result into the target storage area.
[0014] Fourthly, embodiments of this disclosure provide an electronic device. The electronic device includes: a memory configured to store an executable program; and a processor configured to invoke the program to cause the electronic device to perform the video decoding and reconstruction method according to embodiments of this disclosure.
[0015] In this embodiment of the disclosure, the predicted data and residual data can be stored in the same storage area as reconstructed data, thus eliminating the need for two separate memories to store the predicted data and residual data. This approach helps reduce the number of memories, improves storage efficiency, reduces storage medium capacity overhead, and simplifies hardware design.
[0016] In this embodiment of the disclosure, prediction data can be written to the storage area first, and after the residual data arrives, the prediction data can be read from the storage area to perform a reconstruction operation to obtain the reconstruction result, which is then written back to the storage area. Alternatively, residual data can be written to the storage area first, and after the prediction data arrives, the residual data can be read from the storage area to perform a reconstruction operation to obtain the reconstruction result, which is then written back to the storage area. Therefore, this embodiment of the disclosure does not limit the writing order and sequence of prediction data and residual data, and has good design flexibility. Attached Figure Description
[0017] Figure 1 The diagram shows the structure of the decoding and reconstruction module in some technical solutions.
[0018] Figure 2 The diagram shown is a structural schematic of a video decoding and reconstruction apparatus provided in an embodiment of this disclosure.
[0019] Figure 3 The diagram shown is a structural schematic of a video decoding and reconstruction apparatus provided in an embodiment of this disclosure.
[0020] Figure 4 The diagram shown is a structural schematic of a video decoding and reconstruction apparatus provided in an embodiment of this disclosure.
[0021] Figure 5 The diagram shown is a structural schematic of a video decoding system provided in an embodiment of this disclosure.
[0022] Figure 6 The flowchart shown is a video decoding and reconstruction method provided in an embodiment of this disclosure.
[0023] Figure 7 The diagram shown is a structural schematic of an electronic device provided in an embodiment of this disclosure. Detailed Implementation
[0024] The following specific examples illustrate the implementation of this disclosure. Those skilled in the art can easily understand other advantages and effects of this disclosure from the content disclosed in this specification. This disclosure can also be implemented or applied through other different specific embodiments, and various details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of this disclosure. It should be noted that, unless otherwise specified, the following embodiments and features in the embodiments can be combined with each other.
[0025] It should be noted that the illustrations provided in the following embodiments are only schematic representations of the basic concept of this disclosure. Therefore, the illustrations only show the components related to this disclosure and are not drawn according to the number, shape and size of the components in actual implementation. In actual implementation, the form, quantity and proportion of each component can be arbitrarily changed, and the layout of the components may also be more complex.
[0026] In this disclosure, the terms "exemplary" or "for example" indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in this disclosure should not be construed as being more preferred or advantageous than other embodiments or designs. Specifically, the use of terms such as "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.
[0027] In this disclosure, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple.
[0028] Video decoding and reconstruction are used to integrate prediction and residual data. However, the processes for generating prediction and residual data may differ in the hardware implementation of the video decoder. For more information on this issue, please refer to [link to relevant documentation]. Figure 1 In some technical solutions, two different storage units are used, namely Figure 1The first and second storage units in the system store prediction data and residual data, respectively. The prediction data includes inter-frame prediction data and / or intra-frame prediction data. The reconstruction unit reads the prediction data and residual data from the first and second storage units respectively to perform reconstruction operations to obtain the reconstruction result. However, this method requires two storage units, which increases storage capacity overhead, reduces storage efficiency, and increases the complexity of the hardware structure.
[0029] To address at least the aforementioned problems, this disclosure provides a video decoding and reconstruction apparatus. In this embodiment, prediction data and residual data can be stored in the same storage area as reconstructed data, thus eliminating the need for separate memories to store the prediction data and residual data. This reduces the number of memories, improves storage efficiency, reduces storage medium capacity overhead, and simplifies hardware design. Furthermore, this disclosure does not limit the writing order or sequence of prediction data and residual data, offering good design flexibility.
[0030] The technical solutions in the embodiments of this disclosure will now be described in detail with reference to the accompanying drawings.
[0031] Figure 2 This is a schematic diagram illustrating the structure of a video decoding and reconstruction apparatus provided according to an embodiment of the present disclosure. Figure 2 As shown, the video decoding and reconstruction apparatus 2 provided in this embodiment includes a channel arbitration unit 21, an access request and reconstruction operation unit 22, and a reconstruction storage unit 23.
[0032] The reconfigurable storage unit 23 includes multiple storage areas, and the size of the storage areas can be set according to actual needs. This disclosure does not impose any restrictions on this.
[0033] Channel arbitration unit 21 is configured to arbitrate channels to select a target channel entitled to access reconstructed storage unit 23. This channel includes inter-frame prediction channels (corresponding to...). Figure 2 Inter channel), intra prediction channel (corresponding to) Figure 2 The Intra channel and the inverse transform channel (corresponding to) Figure 2 The It channel in the image is used to transmit inter-frame prediction data, intra-frame prediction data, and inverse transform data.
[0034] For example, the channel arbitration unit 21 can conduct arbitration according to a certain priority arbitration method to determine the target channel.
[0035] In this embodiment of the disclosure, by using the channel arbitration unit 21 to arbitrate the channel, it is possible to prevent deadlock caused by the inability to respond in a timely manner after a request from the preceding level is issued.
[0036] The access request and reconstruction unit 22 is configured to send a write request signal to the reconstruction storage unit 23 to write the data of the target channel into the target storage area when no data is stored in the target storage area. The target storage area is the storage area corresponding to the target channel.
[0037] In addition, the access request and reconstruction unit 22 is also configured to send a read request signal to the reconstruction storage unit 23 to read data from the target storage area when data is stored in the target storage area, perform reconstruction operation on the read data and the data of the target channel to obtain the reconstruction operation result, and write the reconstruction operation result into the target storage area.
[0038] Figure 3 This is a schematic diagram illustrating the structure of a video decoding and reconstruction apparatus provided according to an embodiment of this disclosure. Please refer to... Figure 3 In some implementations, the video decoding and reconstruction apparatus 2 may further include an anti-deadlock unit 24. The anti-deadlock unit 24 is configured to determine whether a corresponding channel is allowed to access the reconstruction storage unit 23 based on the access request information of each channel. For example, the anti-deadlock unit 24 can determine whether an inter-frame prediction channel is allowed to access the reconstruction storage unit 23 based on the access request information of the inter-frame prediction channel, and so on. The channel arbitration unit 21 is configured to arbitrate the channels allowed to access the reconstruction storage unit 23 to determine the target channel.
[0039] For example, the access request information may include read request information and / or write request information. The anti-deadlock unit 24 can monitor whether the reconstructed storage unit 23 can perform write or read operations based on the access request information of the channel, and feed back the monitoring results to the channel arbitration unit 21.
[0040] For example, the anti-deadlock unit 24 is configured to determine whether to allow the channel to access the reconstructed storage unit 23 based on the channel's access request information and the total remaining space or data of the reconstructed storage unit 23.
[0041] In some implementations, the video decoding and reconstruction apparatus 2 may further include a channel data writing marking unit 25. The channel data writing marking unit 25 is configured to mark whether each storage area of the reconstruction storage unit 23 stores data using a storage information table. The access request and reconstruction calculation unit 22 is configured to determine whether a target storage area stores data based on the storage information table.
[0042] For example, the depth of the storage information table corresponds to the reconstruction storage unit 23. For instance, the depth of the storage information table can be the same as the reconstruction storage unit 23. Different information tags are used in the storage information table to mark different states of the storage area. For example, 1 can be used to indicate that data is stored in the storage area, and 0 can be used to indicate that no data is stored in the storage area, but this disclosure is not limited thereto.
[0043] For example, in a subsequent module of the video decoding and reconstruction device 2, such as the reconstruction read module, when a certain storage area is released, the flag in the storage information table corresponding to that storage area is configured to 0. If data is written to a certain storage area, the flag in the storage information table corresponding to that storage area is configured to 1.
[0044] In some implementations, the access request and reconstruction operation unit 22 may include a write request subunit, a read request subunit, and a reconstruction operation subunit.
[0045] For example, when the target storage area is marked as 1 and the target channel is about to write data to the target storage area, the read request subunit sends a read request signal to the reconstruction storage unit 23 to read data from the target storage area, the reconstruction operation subunit performs a reconstruction operation on the read data and the data to be written, and the write request subunit sends a write request signal to the reconstruction storage unit 23 to write the reconstruction operation result to the target storage area.
[0046] For example, when the target storage area is marked as 0 and the target channel is about to write data to the target storage area, the write request subunit sends a write request signal to the reconstructed storage unit 23 to write the data to be written to the target storage area.
[0047] In some implementations, the data in the target channel is predicted data. The access request and reconstruction operation unit 22 is configured to send a read request signal to the reconstruction storage unit 23 to read the residual data from the target storage area when the residual data is stored in the target storage area, and to perform reconstruction operation on the residual data and the predicted data to obtain the reconstruction operation result.
[0048] In some implementations, the data in the target channel is residual data. The access request and reconstruction operation unit 33 is configured to send a read request signal to the reconstruction storage unit 34 to read the prediction data from the target storage area when the prediction data is stored in the target storage area, and to perform reconstruction operation on the prediction data and the residual data to obtain the reconstruction operation result.
[0049] Figure 4 This is a schematic diagram illustrating the structure of a video decoding and reconstruction apparatus provided according to an embodiment of this disclosure. Please refer to... Figure 4In some implementations, the access request and reconstruction operation unit 22 may include an inter-frame read / write request and reconstruction operation unit, an intra-frame read / write request and reconstruction operation unit, and an inverse transform read / write request and reconstruction operation unit.
[0050] The inter-frame read / write request and reconstruction operation unit is used to directly write inter-frame prediction data into the target storage area when the target storage area is marked as 0, and to read residual data from the target storage area when the target storage area is marked as 1, perform reconstruction operation on the inter-frame prediction data and residual data, and then write the reconstruction operation result into the target storage area.
[0051] The intra-frame read / write request and reconstruction operation unit is used to directly write intra-frame prediction data into the target storage area when the target storage area is marked as 0, and to read residual data from the target storage area when the target storage area is marked as 1, perform reconstruction operation on the intra-frame prediction data and residual data, and then write the reconstruction operation result into the target storage area.
[0052] The inverse transform read / write request and reconstruction operation unit is used to directly write the residual data into the target storage area when the target storage area is marked as 0, and to read the prediction data from the target storage area when the target storage area is marked as 1. The prediction data can be inter-frame prediction data or intra-frame prediction data. After performing reconstruction operation on the residual data and the prediction data, the reconstruction operation result is written into the target storage area.
[0053] This disclosure also provides a video decoding system. Figure 5 This is a schematic diagram illustrating the structure of a video decoding system according to an embodiment of the present disclosure. Figure 5 As shown, the video decoding system 5 includes an entropy decoding module 51, a prediction module 52, an inverse quantization and inverse transform module 53, a video decoding and reconstruction module 54, and an image filtering module 55.
[0054] The entropy decoding module 51 is configured to perform entropy decoding on the video bitstream to obtain decoding information.
[0055] The prediction module 52 is configured to perform inter-frame prediction or intra-frame prediction based on the decoding information to obtain prediction data.
[0056] The inverse quantization and inverse transformation module 53 is configured to perform inverse quantization and inverse transformation calculations based on the decoded information to obtain residual data.
[0057] The video decoding and reconstruction module 54 is configured to perform decoding and reconstruction based on the prediction data and residual data. The video decoding and reconstruction module 54 is the same as the aforementioned video decoding and reconstruction device, and will not be described again here.
[0058] The image filtering module 55 is configured to perform image filtering based on the decoding and reconstruction results.
[0059] This disclosure also provides a video decoding and reconstruction method, which can be applied, for example, to... Figure 2 The video decoding and reconstruction device 2 shown. Figure 6 This is a flowchart illustrating a video decoding and reconstruction method according to an embodiment of the present disclosure. Figure 6 As shown, the video decoding and reconstruction method provided in this embodiment includes the following steps S61 to S63.
[0060] In step S61, the channels are arbitrated to determine the target channel, which includes an inter-frame prediction channel, an intra-frame prediction channel, and an inverse transform channel.
[0061] In step S62, when no data is stored in the target storage area, a write request signal is sent to the reconstructed storage unit to write the data of the target channel into the target storage area, which is the storage area corresponding to the target channel.
[0062] In step S63, when data is stored in the target storage area, a read request signal is sent to the reconstruction storage unit to read data from the target storage area, the read data is reconstructed with the data of the target channel to obtain the reconstruction result, and the reconstruction result is written to the target storage area.
[0063] It should be understood that the specific implementation process of the above steps has been described in detail in the above embodiments, and will not be repeated here for the sake of brevity.
[0064] The scope of protection of the video decoding and reconstruction method provided in this disclosure is not limited to the execution order of the steps listed in this embodiment. Any solution implemented by adding, subtracting, or replacing steps in the prior art based on the principles of this disclosure is included within the scope of protection of this disclosure.
[0065] The video decoding and reconstruction apparatus provided in this disclosure can implement the video decoding and reconstruction method provided in this disclosure. However, the implementation apparatus of the video decoding and reconstruction method described in this disclosure includes, but is not limited to, the structure of the video decoding and reconstruction apparatus listed in this embodiment. Any structural modifications and substitutions of the prior art made in accordance with the principles of this disclosure are included within the protection scope of this disclosure.
[0066] This disclosure also provides an electronic device. Figure 7 This is a schematic block diagram of an electronic device provided in an embodiment of this disclosure. Figure 7As shown, electronic device 700 includes: at least one processor 701, memory 702, at least one network interface 703, and user interface 705. The various components in electronic device 700 are coupled together via bus system 704. It is understood that bus system 704 is used to implement communication between these components. In addition to a data bus, bus system 704 also includes a power bus, a control bus, and a status signal bus. However, for clarity, in… Figure 7 The general will label all buses as bus systems.
[0067] User interface 705 may include a monitor, keyboard, mouse, trackball, clicker, button, touchpad, or touchscreen.
[0068] It is understood that memory 702 can be volatile memory or non-volatile memory, or both. Non-volatile memory can be read-only memory (ROM) or programmable read-only memory (PROM), which serves as an external cache. By way of example, but not limitation, many forms of RAM are available, such as static random access memory (SRAM) and synchronous static random access memory (SSRAM). The memories described in this disclosure are intended to include, but are not limited to, these and any other suitable categories of memory.
[0069] The memory 702 in this embodiment is used to store various types of data to support the operation of the electronic device 700. Examples of this data include any executable program for operation on the electronic device 700, such as operating system 7021 and application program 7022; operating system 7021 contains various system programs, such as framework layer, core library layer, driver layer, etc., for implementing various basic services and handling hardware-based tasks. Application program 7022 may contain various applications, such as media player, browser, etc., for implementing various application services. The video decoding and reconstruction method provided in this embodiment may be included in application program 7022.
[0070] The methods disclosed in the above embodiments of this disclosure can be applied to processor 701, or implemented by processor 701. Processor 701 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the integrated logic circuit of the hardware in processor 701 or by instructions in the form of software. The processor 701 may be a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Processor 701 can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this disclosure. General-purpose processor 701 may be a microprocessor or any conventional processor, etc. The steps of the accessory optimization method provided in the embodiments of this disclosure can be directly reflected as being executed by a hardware decoding processor, or being executed by a combination of hardware and software modules in the decoding processor. The software module may be located in a storage medium, which is located in memory. The processor reads the information in the memory and combines it with its hardware to complete the steps of the aforementioned method.
[0071] In an exemplary embodiment, the electronic device 700 may be used by one or more application-specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), or complex programmable logic devices (CPLDs) to perform the aforementioned method.
[0072] This disclosure also provides a computer program product comprising one or more computer instructions. When the computer instructions are loaded and executed on a computing device, all or part of the processes or functions described in this disclosure are generated. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions may be transmitted from one website, computer, or data center to another via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means.
[0073] When the computer program product is executed by a computer, the computer performs the method described in the foregoing method embodiments. The computer program product can be a software installation package; when the foregoing method is required, the computer program product can be downloaded and executed on the computer.
[0074] As used in this specification, the terms "component," "module," "system," etc., are used to refer to computer-related entities, hardware, firmware, combinations of hardware and software, software, or software in execution. For example, a component can be, but is not limited to, a process running on a processor, a processor, an object, an executable file, an execution thread, a program, and / or a computer. As illustrated, applications running on computing devices and computing devices can both be components. One or more components may reside in a process and / or an execution thread, and components may be located on a single computer and / or distributed among two or more computers. Furthermore, these components can be executed from various computer-readable media on which various data structures are stored. Components can communicate, for example, via local and / or remote processes based on signals having one or more data packets (e.g., data from two components interacting with another component between a local system, a distributed system, and / or a network, such as the Internet interacting with other systems via signals).
[0075] Those skilled in the art will recognize that the various illustrative logical blocks and steps described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this disclosure.
[0076] In the embodiments provided in this disclosure, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.
[0077] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0078] In addition, the functional units in the various embodiments of this disclosure can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.
[0079] In the above embodiments, the functions of each functional unit can be implemented, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented, in whole or in part, in the form of a computer program product. A computer program product includes one or more computer instructions (programs). When the computer program instructions (programs) are loaded and executed on a computer, all or part of the flow or function according to the embodiments of this disclosure is generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means.
[0080] If a function is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this disclosure, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this disclosure. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory, random access memory, magnetic disks, or optical disks.
[0081] In summary, the embodiments of this disclosure provide a video decoding and reconstruction apparatus and method, a video decoding system, a medium, and a device. Therefore, this disclosure effectively overcomes various shortcomings of the prior art and has high industrial applicability. In the embodiments of this disclosure, prediction data and residual data can be stored in the same storage area as reconstructed data, thus eliminating the need for two separate memories to store prediction data and residual data. This approach improves storage efficiency, reduces storage medium capacity overhead, and simplifies hardware design. Furthermore, in the embodiments of this disclosure, prediction data can be written to the storage area first, and after the residual data arrives, the prediction data can be read from the storage area to perform reconstruction operations to obtain the reconstruction result, which is then written back to the storage area. Alternatively, residual data can be written to the storage area first, and after the prediction data arrives, the residual data can be read from the storage area to perform reconstruction operations to obtain the reconstruction result, which is then written back to the storage area. Therefore, the embodiments of this disclosure do not limit the writing order and sequence of prediction data and residual data, providing good design flexibility.
[0082] The above embodiments are merely illustrative of the principles and effects of this disclosure and are not intended to limit this disclosure. Any person skilled in the art can modify or alter the above embodiments without departing from the spirit and scope of this disclosure. Therefore, all equivalent modifications or alterations made by those skilled in the art without departing from the spirit and technical concept disclosed in this disclosure should still be covered by the claims of this disclosure.
Claims
1. A video decoding and reconstruction apparatus, characterized in that, include: Reconstruct the storage unit, including multiple storage areas; A channel arbitration unit is configured to arbitrate channels to determine a target channel, said channel including an inter-frame prediction channel, an intra-frame prediction channel, and an inverse transform channel; as well as The access request and reconstruction operation unit are configured as follows: When no data is stored in the target storage area, a write request signal is sent to the reconstructed storage unit to write the data of the target channel into the target storage area, wherein the target storage area is the storage area corresponding to the target channel; as well as When data is stored in the target storage area, a read request signal is sent to the reconstruction storage unit to read data from the target storage area. The read data is then reconstructed with the data of the target channel to obtain the reconstruction result, and the reconstruction result is written to the target storage area.
2. The video decoding and reconstruction apparatus according to claim 1, characterized in that, Also includes: The deadlock prevention unit is configured to determine whether the corresponding channel is allowed to access the reconstructed storage unit based on the access request information of each channel. The channel arbitration unit is configured to arbitrate channels that are allowed to access the reconstructed storage unit to determine the target channel.
3. The video decoding and reconstruction apparatus according to claim 2, characterized in that, The anti-deadlock unit is configured to determine whether to allow the channel to access the reconstructed storage unit based on the access request information of the channel and the total remaining space or data of the reconstructed storage unit.
4. The video decoding and reconstruction apparatus according to claim 1, characterized in that, Also includes: The channel data writing marking unit is configured to mark whether the storage area stores data by means of a storage information table, wherein the access request and reconstruction operation unit is configured to determine whether the target storage area stores data according to the storage information table.
5. The video decoding and reconstruction apparatus according to claim 4, characterized in that, The depth of the storage information table corresponds to the reconstructed storage unit, and different information tags are used in the storage information table to mark different states of the storage area.
6. The video decoding and reconstruction apparatus according to claim 1, characterized in that, The data in the target channel is predicted data. The access request and reconstruction operation unit is configured to send a read request signal to the reconstruction storage unit when residual data is stored in the target storage area, so as to read the residual data from the target storage area, and perform reconstruction operation on the residual data and the prediction data to obtain the reconstruction operation result.
7. The video decoding and reconstruction apparatus according to claim 1, characterized in that, The data in the target channel is residual data. The access request and reconstruction operation unit is configured to send a read request signal to the reconstruction storage unit when the target storage area stores the prediction data, so as to read the prediction data from the target storage area, and perform reconstruction operation on the prediction data and the residual data to obtain the reconstruction operation result.
8. A video decoding system, characterized in that, include: The entropy decoding module is configured to perform entropy decoding on the video bitstream to obtain decoding information; The prediction module is configured to perform inter-frame prediction or intra-frame prediction based on the decoding information to obtain prediction data; The inverse quantization and inverse transform module is configured to perform inverse quantization and inverse transform calculations based on the decoded information to obtain residual data. The video decoding and reconstruction module is configured to perform decoding and reconstruction based on the predicted data and the residual data; as well as The image filtering module is configured to perform image filtering based on the decoding and reconstruction results. The video decoding and reconstruction module includes: Reconstruct the storage unit, including multiple storage areas; A channel arbitration unit is configured to arbitrate channels to determine a target channel, said channel including an inter-frame prediction channel, an intra-frame prediction channel, and an inverse transform channel; and The access request and reconstruction operation unit are configured as follows: When no data is stored in the target storage area, a write request signal is sent to the reconstructed storage unit to write the data of the target channel into the target storage area, wherein the target storage area is the storage area corresponding to the target channel; and When data is stored in the target storage area, a read request signal is sent to the reconstruction storage unit to read data from the target storage area. The read data is then reconstructed with the data of the target channel to obtain the reconstruction result, and the reconstruction result is written to the target storage area.
9. A video decoding and reconstruction method, characterized in that, include: Arbitration is performed on the channels to determine the target channel, which includes an inter-frame prediction channel, an intra-frame prediction channel, and an inverse transform channel; When no data is stored in the target storage area, a write request signal is sent to the reconstructed storage unit to write the data of the target channel into the target storage area, wherein the target storage area is the storage area corresponding to the target channel; as well as When data is stored in the target storage area, a read request signal is sent to the reconstruction storage unit to read data from the target storage area. The read data is then reconstructed with the data of the target channel to obtain the reconstruction result, and the reconstruction result is written to the target storage area.
10. An electronic device, characterized in that, include: The memory is configured to store executable programs; as well as The processor is configured to invoke the program to cause the electronic device to perform the video decoding and reconstruction method according to claim 9.