Image data interface conversion method and apparatus
Patent Information
- Application Number
- CN202310983505.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-08-07
- Publication Date
- 2026-11-03
- Estimated Expiration
- 2043-08-07
AI Technical Summary
Parallel bus transmission suffers from crosstalk and low common-mode interference capability, resulting in reduced parallel bandwidth, limited image output bandwidth, large image memory storage space, increased power consumption, and low image data interface conversion efficiency.
By caching luminance and chrominance component data to separate cache units and reading and converting them into the target image data format from the target image memory, the system can achieve conversion of multiple data types and formats, reduce resource and power consumption, and reduce data latency.
It improves the efficiency of image data interface conversion, reduces resource and power consumption, and lowers data latency.
Smart Images

Figure CN116801051B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of image data format conversion technology, and in particular to an image data interface conversion method and apparatus. Background Technology
[0002] During image data transmission, the interface processing module can read image data from the image memory via the Advanced eXtensible Interface (AXI) bus protocol interface, convert the image data into the target data format, and output it to the interface in parallel. For example, in a YUV420 format image, Y represents luminance, and U and V represent chroma. The Image Signal Processor (ISP) or multimedia module converts the processed raw image data into YUV420 format and divides the YUV420 image data into Y-plane data and UV-plane data, storing them in different areas of the image memory. During image data transmission, the Y-plane data and UV-plane data in the image memory can be read via the bus protocol interface, combined into YUV420 image data format, and output to the interface in parallel.
[0003] However, parallel bus transmission suffers from problems such as crosstalk and low common-mode interference capability, leading to reduced parallel bandwidth and thus limiting image output bandwidth. Furthermore, because image data is not compressed before being stored in image memory, the storage space required for image memory increases (leading to increased power consumption), or the system bandwidth becomes insufficient. Additionally, the lack of compressed and decompressed data conversion processes further reduces the efficiency of the image data interface conversion. Summary of the Invention
[0004] This application provides an image data interface conversion method and apparatus to solve the problem of low image data interface conversion efficiency.
[0005] In a first aspect, this application provides an image data interface conversion method, including: Read the image data to be processed from the target image memory, the image data to be processed including luminance component data and chrominance component data; The luminance component data is cached in a first cache unit, and the chrominance component data is cached in a second cache unit; Read the luminance component data from the first cache unit and the chrominance component data from the second cache unit, and convert the luminance component data and the chrominance component data into the target image data format to obtain the target image data; The target image data is sent to the target interface.
[0006] In an optional implementation, the method further includes: Establish luminance and chrominance channels; The luminance component data is routed to the luminance read channel module through the luminance channel, and the chrominance component data is routed to the chrominance read channel module through the chrominance channel; The luminance component data in the luminance reading channel module is cached in the first cache unit, and the chrominance component data in the chrominance reading channel module is cached in the second cache unit.
[0007] In an optional implementation, the method further includes: In response to a user-inputted command to close the chroma channel, the chroma channel is closed to block the transmission of the chroma component data; Read the luminance component data from the first cache unit and convert the luminance component data into the target image data format.
[0008] In an optional implementation, the method further includes: Obtain a first read address, and read luminance component data from the target image memory according to the first read address. The first read address is used to characterize the storage location of the luminance component data in the target image memory. Obtain the second read address, and read the chroma component data from the target image memory according to the second read address. The second read address is used to characterize the storage location of the chroma component data in the target image memory.
[0009] In an optional implementation, the method further includes: The luminance component data is cached in a single cache line of the first cache unit, and after the single cache line of the first cache unit is full, the system switches to a backup first cache unit and caches the luminance component data in a single cache line of the backup first cache unit. The single cache line is the cache line corresponding to a single storage of data. After the single cache line of the backup first cache unit is full, switch to the first cache unit and cache the luminance component data into the single cache line of the first cache unit until the luminance component data is completely cached.
[0010] In an optional implementation, the method further includes: The luminance component data is converted into a first interface data format to obtain first image data; The chromaticity component data is converted into a second interface data format to obtain second image data; The first image data is sent to the first target interface, and the second image data is sent to the second target interface.
[0011] In an optional implementation, the method further includes: The chroma component data of the second cache unit is read according to a preset number of cycles; The chromaticity component data read in a preset number of cycles and the luminance component data read in a single cycle are converted into the target image data format.
[0012] In an optional implementation, the method further includes: Read the luminance decompression data of the preset data unit corresponding to the luminance component data in row order, and read the chrominance decompression data of the preset data unit corresponding to the chrominance component data in row order. The luminance decompressed data of the preset data unit is interleaved and cached in two first cache units, and the chrominance decompressed data of the preset data unit is interleaved and cached in two second cache units.
[0013] Secondly, this application provides an image data interface conversion device, including a read arbitration module, a first data access module, a second data access module, and an interface conversion module, wherein: The read arbitration module is used to read the image data to be processed from the target image memory, the image data to be processed including luminance component data and chrominance component data; The first data access module is used to cache the luminance component data in a first cache unit, and to read the luminance component data in the first cache unit and send it to the interface conversion module. The second data access module is used to cache the chromaticity component data in the second cache unit, and to read the chromaticity component data in the second cache unit and send it to the interface conversion module; An interface conversion module is used to convert the luminance component data and the chrominance component data into a target image data format to obtain target image data; and to send the target image data to a target interface.
[0014] In an optional implementation, it further includes a luminance reading channel module and a chrominance reading channel module, wherein: The arbitration module is used to route the luminance component data to the luminance read channel module through the luminance channel; and to route the chrominance component data to the chrominance read channel module through the chrominance channel; The first data access module is used to cache the luminance component data in the luminance reading channel module to the first cache unit; The second data access module is used to cache the chroma component data in the chroma read channel module to the second cache unit.
[0015] As can be seen from the above technical solutions, this application provides an image data interface conversion method and apparatus. The method reads image data to be processed from a target image memory, wherein the image data to be processed includes luminance component data and chrominance component data. The luminance component data is cached in a first cache unit, and the chrominance component data is cached in a second cache unit. The luminance component data in the first cache unit and the chrominance component data in the second cache unit are then read, and the luminance component data and chrominance component data are converted into a target image data format to obtain the target image data. Finally, the target image data is sent to the target interface. This method can realize the conversion of multiple data types and formats, reduce the resource and power consumption of discrete modes, and can process luminance component data and chrominance component data simultaneously, reducing data latency and improving the efficiency of image data interface conversion. Attached Figure Description
[0016] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0017] Figure 1 This is a schematic diagram of the structure of the image data interface conversion device provided in the embodiments of this application; Figure 2 This is a schematic diagram of the system architecture for image data interface conversion provided in the embodiments of this application; Figure 3 This is a schematic diagram of the process for caching luminance component data provided in an embodiment of this application; Figure 4 This is a schematic diagram illustrating the process of converting YUV420 data format to YUV422 data format as provided in the embodiments of this application. Detailed Implementation
[0018] The embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described below do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application as detailed in the claims.
[0019] To save storage space and bandwidth, the Image Signal Processor (ISP) or multimedia module converts the processed raw image data into YUV420 format and divides the YUV420 image data into Y-plane data and UV-plane data, storing them separately in different areas of the image memory. During image data transmission, the Y-plane and UV-plane data in the image memory can be read through the Advanced eXtensible Interface (AXI) bus protocol, combined into YUV420 image data format, and output in parallel to the interface.
[0020] However, parallel bus transmission suffers from problems such as crosstalk and low common-mode interference capability, leading to reduced parallel bandwidth and thus limiting image output bandwidth. Furthermore, because image data is not compressed before being stored in image memory, the storage space required for image memory increases (leading to increased power consumption), or the system bandwidth becomes insufficient. Additionally, the lack of compressed and decompressed data conversion processes further reduces the efficiency of the image data interface conversion.
[0021] To improve the efficiency of image data interface conversion, some embodiments of this application provide an image data interface conversion device. This device can convert image data of various data types and formats, reducing resource and power consumption in discrete modes, and can process luminance component data and chrominance component data simultaneously, reducing data latency and improving image data interface conversion efficiency. Figure 1 As shown, Figure 1 This is a schematic diagram of the structure of the image data interface conversion device provided in the embodiment of this application. The image data interface conversion device includes a read arbitration module 100, a first data access module 200, a second data access module 300, and an interface conversion module 400.
[0022] The read arbitration module 100 is used to read image data to be processed from the target image memory. The image data to be processed includes luminance component data and chrominance component data. It can be understood that, in this embodiment, the luminance component data is y-plane data in the image memory, and the chrominance component data is uv-plane data in the image memory.
[0023] The first data access module 200 is used to cache luminance component data in the first cache unit, and to read luminance component data in the first cache unit and send it to the interface conversion module 400.
[0024] The second data access module 300 is used to cache chroma component data in the second cache unit, and to read the chroma component data in the second cache unit and send it to the interface conversion module 400.
[0025] The interface conversion module 400 is used to receive luminance component data from the first buffer unit and chrominance component data from the second buffer unit, convert the luminance component data and chrominance component data into a target image data format to obtain target image data, and send the target image data to the target interface.
[0026] In some embodiments, a luminance channel and a chrominance channel can be established for transmitting luminance component data and chrominance component data, respectively. The image data interface conversion device further includes a luminance read channel module 500 and a chrominance read channel module 600. The read arbitration module 100 is further configured to route luminance component data to the luminance read channel module 500 via the luminance channel and to route chrominance component data to the chrominance read channel module 600 via the chrominance channel. The first data access module 200 is further configured to cache the luminance component data in the luminance read channel module 500 to a first cache unit. The second data access module 300 is further configured to cache the chrominance component data in the chrominance read channel module 600 to a second cache unit.
[0027] In this embodiment, four image data formats can be converted to the interface: lossy compressed data of YUV420 two-plane format, single-plane data (only Y-plane data), original image data of YUV420 two-plane format, and two-plane data after decompressing the stored YUV420 two-plane compressed data. Specifically, this application sets four modes: Mode 1: YUV420 two-plane compressed data conversion interface mode; Mode 2: YUV420 two-plane original image data conversion interface mode; Mode 3: YUV420 two-plane decompressed data conversion interface mode; and Mode 4: single-plane data conversion interface mode. It can be understood that Mode 4 is included in Mode 1, and when switching modes, it is only necessary to turn off the luminance reading channel module 500 or the chrominance reading channel module 600.
[0028] The following section provides a detailed description of this application, taking into account various data types and formats of image data.
[0029] like Figure 2 The diagram shows a system architecture for image data interface conversion provided in this embodiment. The image data interface conversion device includes a read arbitration module 100, a luminance read channel module 500, a chrominance read channel module 600, a first data access module 200, a second data access module 300, and an interface conversion module 400. The first data access module 200 includes a first write controller and a first read controller for controlling the reading and writing of a first cache unit. The second data access module 300 includes a second write controller and a second read controller for controlling the reading and writing of a second cache unit. The interface conversion module 400 includes a compression processing module and an image data processing module.
[0030] The target image storage, decompression module, and target interface are external modules preceding and following the image data interface conversion device. The decompression module can be configured with a bypass function to bypass the decompression module.
[0031] It should be noted that the target image memory and target interface can be configured according to different application scenarios. For example, the target image memory can be Double Data Rate (DDR), and the target interface can be Camera Serial Interface (CSI), which is the interface standard specified by the Camera Working Group under the Mobile Industry Processor Interface (MIPI) consortium. Furthermore, this application does not restrict the data access module; it can be Random Access Memory (RAM).
[0032] For Mode 1: YUV420 two-plane compressed data conversion interface mode, the bypass function of the front-end decompression module can be enabled to bypass the decompression module. For the luminance component data (Y-plane compressed data) stored in the target image memory, the read arbitration module 100 obtains the first read address sent by the first data access module 200 through the luminance read channel module 500. The first read address is used to characterize the storage location of the luminance component data in the target image memory. The luminance component data is read from the target image memory in a time-division multiplexing manner according to the first read address, and then the luminance component data is routed to the luminance read channel module 500 through the luminance channel. Similarly, for the chrominance component data (UV-plane compressed data) stored in the target image memory, the read arbitration module 100 obtains the second read address sent by the second data access module 300 through the luminance read channel module 500. The second read address is used to characterize the storage location of the chrominance component data in the target image memory. The chrominance component data is read from the target image memory according to the second read address, and then the chrominance component data is routed to the chrominance read channel module 600 through the chrominance channel.
[0033] The first data access module 200 caches the luminance component data in the luminance read channel module 500 into the first cache unit through the first write controller, and reads the luminance component data in the first cache unit line by line through the first read controller according to the data requirements of the compression processing module in the interface conversion module, and sends the luminance component data to the compression data processing module in the interface conversion module 400.
[0034] Among them, when caching luminance component data, such as Figure 3As shown, luminance component data can be cached in a single cache line of the first cache unit. After the single cache line of the first cache unit is full, the system switches to a backup first cache unit and caches the luminance component data in a single cache line of the backup first cache unit. After the single cache line of the backup first cache unit is full, the system switches back to the first cache unit and caches the luminance component data in a single cache line of the first cache unit, until all luminance component data is cached. Here, a single cache line corresponds to a single data storage session; that is, after a single cache line in a cache unit is full, the system switches to the next cache unit for alternating caching. A single cache line can be a single cache line or multiple cache lines. For example, as... Figure 2 As shown, two first cache units are set up, namely first cache unit 1 and first cache unit 2. The first data access module 200 first caches the luminance component data into a cache line of the first cache unit 1 through the first write controller. After the cache line of the first cache unit 1 is full, it switches to the first cache unit 2 and caches the luminance component data into a cache line of the first cache unit 2. After the cache line of the first cache unit 2 is full, it switches back to the first cache unit 1 and caches the luminance component data into a cache line of the first cache unit 1. This process is repeated until the luminance component data is cached.
[0035] Similarly, the second data access module 300 caches the chroma component data from the chroma read channel module 600 into the second cache unit via the second write controller, and reads the chroma component data from the second cache unit line by line via the second read controller according to the data requirements of the compression processing module in the interface conversion module, and sends the luminance component data to the compression data processing module in the interface conversion module 400. There can be multiple second cache units, for example, such as... Figure 2 As shown, two second cache units are set up, namely second cache unit 3 and second cache unit 4. The second data access module 300 first caches the chroma component data into a cache line of the second cache unit 3 through the second write controller. After the cache line of the second cache unit 3 is full, it switches to the second cache unit 4 and caches the chroma component data into a cache line of the second cache unit 4. After the cache line of the second cache unit 4 is full, it switches back to the second cache unit 3 and caches the chroma component data into a cache line of the second cache unit 3. This process is repeated until the chroma component data is cached.
[0036] After receiving the luminance component data from the first buffer unit and the chrominance component data from the second buffer unit, the compressed data processing module in the interface conversion module 400 converts the luminance component data into a first interface data format to obtain first image data, and converts the chrominance component data into a second interface data format to obtain second image data. The first image data is then sent to the first target interface, and the second image data is sent to the second target interface. The first and second interface data formats are user-defined data formats.
[0037] In this embodiment, the target interface includes a first target interface and a second target interface. The compressed data processing module can convert the Y-plane compressed data and UV-plane compressed data into the first interface data format and the second interface data format, respectively. Then, through the line and field state machine in the interface conversion module, the Y-plane compressed data and UV-plane compressed data after data format conversion are sent to the first target interface and the second target interface according to the line and field timing, respectively. This enables the target interface to convert user-defined data into physical protocol interface (PPI) data, and then output the PPI data after serialization, encoding, and differential processing.
[0038] For Mode 2: YUV420 two-plane original image data conversion interface mode, the bypass function of the front-end decompression module can be enabled to bypass the decompression module. For the luminance component data (Y-plane raw data) stored in the target image memory, the read arbitration module 100 obtains the first read address sent by the first data access module 200 through the luminance read channel module 500, reads the luminance component data from the target image memory in a time-division multiplexing manner according to the first read address, and then routes the luminance component data to the luminance read channel module 500 through the luminance channel. Similarly, for the chrominance component data (UV-plane raw data) stored in the target image memory, the read arbitration module 100 obtains the second read address sent by the second data access module 300 through the luminance read channel module 500, reads the chrominance component data from the target image memory according to the second read address, and then routes the chrominance component data to the chrominance read channel module 600 through the chrominance channel.
[0039] The first data access module 200 caches the luminance component data from the luminance read channel module 500 into a first cache unit via a first write controller. Based on the data requirements of the image data processing module in the interface conversion module, it reads the luminance component data line-by-line from the first cache unit via the first read controller and sends the luminance component data to the image data processing module in the interface conversion module 400. Similarly, the second data access module 300 caches the chrominance component data from the chrominance read channel module 600 into a second cache unit via a second write controller. Based on the data requirements of the image data processing module in the interface conversion module, it reads the chrominance component data line-by-line from the second cache unit via the second read controller and sends the luminance component data to the image data processing module in the interface conversion module 400.
[0040] After receiving the luminance component data from the first buffer unit and the chrominance component data from the second buffer unit, the image data processing module in the interface conversion module 400 converts the luminance component data and chrominance component data into the target image data format to obtain the target image data. The target image data is then sent to the target interface.
[0041] The target image data format can be either YUV420 or YUV422. Similarly, the target image data itself can be either YUV420 or YUV422.
[0042] For YUV422 data format, when the second data access module 300 reads the chroma component data from the second buffer unit, it can read the chroma component data from the second buffer unit according to a preset number of cycles and send it to the image data processing module. The image data processing module converts the chroma component data read in the preset number of cycles and the luminance component data read in a single cycle into the target image data format to generate the target image data and send it to the target interface. The number of cycles represents the number of times the data is read. For example, as... Figure 4As shown, the chroma component data stored in the second buffer unit can be read twice row by row by the second read controller and sent to the image data processing module. The luminance component data stored in the first buffer unit can be read once row by row by the first read controller and sent to the image data processing module. The image data processing module can simultaneously receive the first row of chroma component data and the first row of luminance component data read in the first pass; the first row of chroma component data and the second row of luminance component data read in the second pass; ...; the nth row of chroma component data and the (2n-1)th row of luminance component data read in the first pass; and the nth row of chroma component data and the 2nth row of luminance component data read in the second pass. At the same time, the above data is converted into YUV422 data format to generate YUV422 image data, thereby realizing the conversion of YUV420 data format to YUV422 data format.
[0043] In this embodiment, the image data processing module can convert the raw Y-plane data and raw UV-plane data into YUV420 or YUV422 data format. Then, through the line and field state machine in the interface conversion module, the YUV420 or YUV422 image data is sent to the target interface according to the line and field timing. This enables the target interface to convert the YUV420 or YUV422 image data into Physical Protocol Interface (PPI) data. The PPI data is then serialized, encoded, and differentially processed before being output.
[0044] For Mode 3: YUV420 two-plane decompression data conversion interface mode, the bypass function of the front-end decompression module can be disabled. Image data read by the read arbitration module 100 from the target image memory in a time-division multiplexing manner can be decompressed by the decompression module. The decompression module can decompress each line of Y-plane compressed data stored in the target image memory into two lines of raw Y-plane data, and send them to the read arbitration module 100 in a zigzag pattern, i.e., first send one line of data, then send one line of data, and so on, until all data is sent. Similarly, the decompression module can decompress each line of UV-plane compressed data stored in the target image memory into two lines of raw UV-plane data, and send them to the read arbitration module 100 in a zigzag pattern, i.e., first send one line of data, then send one line of data, and so on, until all data is sent. In other words, the read arbitration module 100 can read the luminance decompression data (y-plane decompression data) corresponding to the preset data unit of the luminance component data in row order, and read the chrominance decompression data (uv-plane decompression data) corresponding to the preset data unit of the chrominance component data in row order, and then route them to the luminance read channel module 500 and the chrominance read channel module 600 respectively.
[0045] The preset data unit refers to the data size of a single read of decompressed data. For example, the decompression module decompresses each line of y-plane compressed data into two lines of y-plane raw data, i.e., two lines of brightness decompressed data. Each time, the preset data unit of brightness decompressed data can be read and routed to the brightness read channel module 500.
[0046] The first data access module 200 interleaves and caches the brightness decompressed data of the preset data unit in the brightness read channel module 500 into two first cache units, that is, interleaving and caching them into... Figure 2 The first cache unit 1 and the first cache unit 2 are shown. According to the data requirements of the image data processing module in the interface conversion module, the first read controller reads the luminance component data line by line from the first cache unit and sends the luminance component data to the image data processing module in the interface conversion module 400. Similarly, the second data access module 300 interleaves and caches the chroma decompressed data of the preset data unit in the chroma read channel module 600 into the two second cache units, that is, interleaving and caching... Figure 2 The second cache unit 3 and the second cache unit 4 are shown. According to the data requirements of the image data processing module in the interface conversion module, the chroma component data in the second cache unit is read line by line by the second read controller, and the luminance component data is sent to the image data processing module in the interface conversion module 400.
[0047] For example, in the caching of decompressed data, a compressed data entry contains 10 data values, which become 20 data values after decompression. The first 10 data values (the first entry) are the first row of data values, and the last 10 data values (the second entry) are the second row of data values. The first 10 data values are cached in the first cache unit 1, and the last 10 data values are cached in the first cache unit 2. That is, the first data access module 200 can interleave each data entry into the first cache unit 1 and the first cache unit 2. In other words, the first data entry is cached in the first cache unit 1, the second data entry is cached in the first cache unit 2, and so on, until the luminance component data caching is complete.
[0048] For converting YUV420 data format to YUV422 data format, the chroma component data stored in the second buffer unit can be read twice line by line by the second read controller and sent to the image data processing module.
[0049] After receiving the luminance component data from the first buffer unit and the chrominance component data from the second buffer unit, the image data processing module in the interface conversion module 400 converts the luminance component data and chrominance component data into the target image data format to obtain the target image data. The target image data is then sent to the target interface. The target image data format can be either YUV420 or YUV422. Correspondingly, the target image data can be either YUV420 or YUV422 image data.
[0050] For Mode 4: Single-plane data conversion interface mode, taking the conversion of only luminance component data as an example, the chroma channel can be closed in response to a user-inputted chroma channel close command, thus blocking the transmission of chroma component data. The read arbitration module 100 can read image data from the target image memory. Since the chroma channel is closed, the chroma component data cannot be transmitted to the chroma read channel module 600 through the chroma channel. Therefore, the luminance component data can only be cached in the first cache unit by the first data access module 200, and then read from the first cache unit and sent to the interface conversion module 400. The interface conversion module 400 converts the luminance component data into the target image data format.
[0051] Based on the above-described image data interface conversion device, some embodiments of this application also provide an image data interface conversion method, which includes the following steps: Read the image data to be processed from the target image memory. The image data to be processed includes luminance component data and chrominance component data.
[0052] The luminance component data is cached in the first cache unit, and the chrominance component data is cached in the second cache unit.
[0053] Read the luminance component data from the first buffer unit and the chrominance component data from the second buffer unit, and convert the luminance component data and chrominance component data into the target image data format to obtain the target image data.
[0054] Send the target image data to the target interface.
[0055] As can be seen from the above technical solutions, the image data interface conversion method and apparatus provided in the above embodiments can read image data to be processed from the target image memory, wherein the image data to be processed includes luminance component data and chrominance component data. The luminance component data is cached in a first cache unit, and the chrominance component data is cached in a second cache unit. Then, the luminance component data in the first cache unit and the chrominance component data in the second cache unit are read, and the luminance component data and chrominance component data are converted into the target image data format to obtain the target image data. Finally, the target image data is sent to the target interface. The method can realize the conversion of multiple data types and formats, reduce the resource and power consumption of discrete modes, and can process luminance component data and chrominance component data simultaneously, reducing data latency and improving the efficiency of image data interface conversion.
[0056] Similar parts between the embodiments provided in this application can be referred to mutually. The specific implementation methods provided above are only a few examples under the overall concept of this application and do not constitute a limitation on the scope of protection of this application. For those skilled in the art, any other implementation methods extended from the solution of this application without creative effort shall fall within the scope of protection of this application.
Claims
1. An image data interface conversion method, characterized in that, include: Read the image data to be processed from the target image memory, the image data to be processed including luminance component data and chrominance component data; The luminance component data is cached in the first cache unit via the luminance read channel, and the chrominance component data is cached in the second cache unit via the chrominance read channel; Read the luminance component data from the first cache unit and the chrominance component data from the second cache unit, and convert the luminance component data and the chrominance component data into the target image data format to obtain the target image data; Send the target image data to the target interface; The method further includes: The receiving decompression module decompresses the image data to be processed in row order and outputs the luminance decompression data and chrominance decompression data; The luminance decompressed data is read in row order, and the chrominance decompressed data is read in row order, in a preset data unit; the preset data unit is the data size of a single read of decompressed data. The luminance decompressed data of the preset data unit is interleaved and cached in two first cache units, and the chrominance decompressed data of the preset data unit is interleaved and cached in two second cache units; The method further includes: The luminance component data of the first cache unit is read according to a single cycle number, and the chrominance component data of the second cache unit is read according to a preset cycle number; the cycle number is used to characterize the number of times the data is read; wherein, when the target image data format is YUV422, the same row of chrominance component data in the second cache unit is read according to two cycle numbers, and when the target image data format is YUV420, the same row of chrominance component data in the second cache unit is read according to a single cycle number; The luminance component data read in a single cycle and the chrominance component data read in a preset cycle are converted into the target image data format.
2. The image data interface conversion method according to claim 1, characterized in that, The method further includes: Establish luminance and chrominance channels; The luminance component data is routed to the luminance read channel module through the luminance channel, and the chrominance component data is routed to the chrominance read channel module through the chrominance channel; The luminance component data in the luminance reading channel module is cached in the first cache unit, and the chrominance component data in the chrominance reading channel module is cached in the second cache unit.
3. The image data interface conversion method according to claim 1, characterized in that, The method further includes: In response to a user-inputted command to close the chroma channel, the chroma channel is closed to block the transmission of the chroma component data; Read the luminance component data from the first cache unit and convert the luminance component data into the target image data format.
4. The image data interface conversion method according to claim 1, characterized in that, The method further includes: Obtain a first read address, and read luminance component data from the target image memory according to the first read address. The first read address is used to characterize the storage location of the luminance component data in the target image memory. Obtain the second read address, and read the chroma component data from the target image memory according to the second read address. The second read address is used to characterize the storage location of the chroma component data in the target image memory.
5. The image data interface conversion method according to claim 1, characterized in that, The method further includes: The luminance component data is cached in a single cache line of the first cache unit, and after the single cache line of the first cache unit is full, the system switches to a backup first cache unit and caches the luminance component data in a single cache line of the backup first cache unit. The single cache line is the cache line corresponding to a single storage of data. After the single cache line of the backup first cache unit is full, switch to the first cache unit and cache the luminance component data into the single cache line of the first cache unit until the luminance component data is completely cached.
6. The image data interface conversion method according to claim 1, characterized in that, The method further includes: The luminance component data is converted into a first interface data format to obtain first image data; The chromaticity component data is converted into a second interface data format to obtain second image data; The first image data is sent to the first target interface, and the second image data is sent to the second target interface.
7. An image data interface conversion device, characterized in that, include: The read arbitration module is used to read the image data to be processed from the target image memory, the image data to be processed including luminance component data and chrominance component data; The first data access module is used to cache the luminance component data to the first cache unit through the luminance read channel, and to read the luminance component data in the first cache unit and send it to the interface conversion module. The second data access module is used to cache the chroma component data to the second cache unit through the chroma read channel, and to read the chroma component data of the second cache unit and send it to the interface conversion module; An interface conversion module is used to convert the luminance component data and the chrominance component data into a target image data format to obtain target image data; and to send the target image data to a target interface; The read arbitration module is further configured to receive luminance decompression data and chrominance decompression data output by the decompression module after decompressing the image data to be processed in row order; read the luminance decompression data in a preset data unit in row order, and read the chrominance decompression data in a preset data unit in row order; the preset data unit is the data size of a single read of decompression data; The first data access module is further configured to interleave and cache the brightness decompressed data of the preset data unit into two first cache units; The second data access module is further configured to interleave and cache the chroma decompressed data of the preset data unit into two second cache units; The first data access module is further configured to read the luminance component data of the first cache unit according to a single cycle number; The second data access module is further configured to read the chroma component data of the second cache unit according to a preset number of cycles; the number of cycles is used to characterize the number of times the data is read; wherein, when the target image data format is YUV422, the same row of chroma component data in the second cache unit is read according to two cycles, and when the target image data format is YUV420, the same row of chroma component data in the second cache unit is read according to a single cycle. The interface conversion module is also used to convert the luminance component data read in a single cycle and the chrominance component data read in a preset cycle into the target image data format.
8. The image data interface conversion device according to claim 7, characterized in that, It also includes a luminance reading channel module and a chrominance reading channel module, wherein: The arbitration module is used to route the luminance component data to the luminance read channel module through the luminance channel; and to route the chrominance component data to the chrominance read channel module through the chrominance channel; The first data access module is used to cache the luminance component data in the luminance reading channel module to the first cache unit; The second data access module is used to cache the chroma component data in the chroma read channel module to the second cache unit.
Citation Information
Patent Citations
Format conversion method, controller and computer readable storage medium
CN114155137A
