Image data processing method, device and display system
By generating multiple image protocol data packets and transmitting them through multiple communication interfaces, the problem that the image processing system cannot be suitable for multi-channel communication channel transmission is solved, and high-speed transmission and low-power display of image data are realized.
Patent Information
- Application Number
- CN202111622882.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-28
- Publication Date
- 2025-02-21
- Estimated Expiration
- 2041-12-28
AI Technical Summary
In the prior art, the image processing system cannot be applied to the transmission of multiple communication channels and cannot realize the high-speed transmission of image data.
By acquiring image encoding data of multiple display pixels of the image to be displayed, an image protocol data packet corresponding to a plurality of display partitions is generated. Each image protocol data packet corresponds to a first data link, and the image protocol data is used to use a multi-channel communication interface to transfer the image protocol data. The packet is transferred to the display module.
It realizes the transmission and display of image data through multiple communication channels, supports local image data transmission and variable refresh rate display, reduces module power consumption and is suitable for low-power terminals.
Smart Images

Figure CN114286133B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of display technology, and in particular to an image data processing method, device and display system. Background Art
[0002] The communication interfaces of LCD panels in current electronic consumer products are mostly complex and strict Mobile Industry Processor Interface (MIPI) and RGB interfaces, which are costly, complex in communication, require real-time image refresh, and have relatively high module power consumption. The Serial Peripheral Interface (SPI) is a high-speed, full-duplex communication bus. The standard SPI uses four data lines, which can save chip pin resources and is simple and easy to use. However, the number of SPIs that can be embedded in current image processing systems is limited, and there are no sufficient communication channels for LCD panel data signal transmission. It is impossible to realize data signal transmission for display panels through SPI, and therefore it cannot meet the current requirements for high-speed transmission of image data. Summary of the invention
[0003] The technical solution of the present invention aims to provide an image data processing method, device and display system, which are used to solve the problem that the image processing system using the prior art cannot be applied to multi-channel communication channel transmission.
[0004] An embodiment of the present invention provides an image data processing method, wherein the method includes:
[0005] Acquire image encoding data of a plurality of display pixels of an image to be displayed;
[0006] generating at least one image protocol data packet according to the image coding data; each image protocol data packet corresponds to a display partition of the image to be displayed, and includes image coding data corresponding to the plurality of display pixels in the display partition;
[0007] The at least one image protocol data packet is transmitted to the display module through the corresponding first data link respectively, so as to display the image to be displayed; wherein each image protocol data packet corresponds to one first data link.
[0008] Optionally, in the image data processing method, each image protocol data packet further includes at least one of display mode information, pixel address information and supplementary virtual data;
[0009] The pixel address information is used to indicate the address of the display pixel corresponding to the image encoding data in the corresponding image protocol data packet.
[0010] Optionally, the image data processing method further comprises:
[0011] Generate a control protocol data packet according to the image coding data; the control protocol data packet includes mode control information;
[0012] Wherein, when transmitting the at least one image protocol data packet to the display module through the corresponding first data link, the method further includes:
[0013] The control protocol data packet is transmitted to the display module via the second data link.
[0014] Optionally, in the image data processing method, the mode control information is one of the following information:
[0015] first information for indicating a self-test display mode;
[0016] Second information for indicating liquid crystal inversion;
[0017] The third information is used to indicate that the register state is reset.
[0018] Optionally, in the image data processing method, when transmitting the at least one image protocol data packet to the display module through the corresponding first data link, the method further comprises: outputting a first clock signal of a preset frequency to the display module through a third data link;
[0019] There is one first clock signal, one first clock signal corresponds to all the image protocol data packets, and data of each image protocol data packet is latched during a rising period of the first clock signal; or;
[0020] There are multiple first clock signals, and one first clock signal corresponds to one image protocol data packet. During a rising period of one of the first clock signals, data of the corresponding image protocol data packet is latched.
[0021] Optionally, in the image data processing method, when the control protocol data packet is transmitted to the display module via the second data link, the method further comprises:
[0022] Outputting a second clock signal of a preset frequency to the display module via a fourth data link;
[0023] During the rising period of the second clock signal, data of the control protocol data packet is latched.
[0024] Optionally, in the image data processing method, the number of the generated image protocol data packets is multiple, and the multiple display partitions corresponding to the multiple image protocol data packets are sequentially arranged along the first direction of the image to be displayed;
[0025] Among them, in each image protocol data packet, the image coding data of multiple display pixel groups arranged along the second direction of the image to be displayed in the corresponding display partition are arranged in sequence; each display pixel group includes at least one display module arranged along the first direction; the second direction is perpendicular to the first direction.
[0026] Optionally, in the image data processing method, after acquiring the image coding data of a plurality of display pixels of the image to be displayed, the method further comprises:
[0027] Cache the image encoding data in a cache unit;
[0028] Wherein, when generating at least one image protocol data packet according to the image coding data, the image coding data is read from the cache unit;
[0029] The cache unit includes a plurality of cache sub-units, each of which is used to store image coding data of a display pixel group, and a display pixel group includes a plurality of display pixels respectively located in different display partitions.
[0030] Optionally, in the image data processing method, the multiple display partitions corresponding to the multiple image protocol data packets are arranged in sequence along the first direction of the image to be displayed, and a display pixel group corresponding to each cache sub-unit includes multiple display pixels located in different display areas, respectively, and located in the same row arranged along the first direction on the image to be displayed.
[0031] An embodiment of the present invention further provides an image data processing device, wherein the device comprises:
[0032] A data acquisition unit, used to acquire image coding data of a plurality of display pixels of an image to be displayed;
[0033] A processing unit, configured to generate at least one image protocol data packet according to the image coding data; each image protocol data packet corresponds to a display partition of the image to be displayed, and includes image coding data corresponding to the plurality of display pixels in the display partition;
[0034] The transmission unit is used to transmit the at least one image protocol data packet to the display module through the corresponding first data link, so as to display the image to be displayed; wherein each image protocol data packet corresponds to one first data link.
[0035] An embodiment of the present invention further provides a display system, comprising:
[0036] A display control device and a display module; the display control device and the display module are connected via a multi-channel communication interface;
[0037] The display control device is used to obtain image coding data of multiple display pixels of an image to be displayed; generate at least one image protocol data packet based on the image coding data; each image protocol data packet corresponds to a display partition of the image to be displayed, including the image coding data of the multiple display pixels in the corresponding display partition; transmit the at least one image protocol data packet to the display module through the corresponding first data link, respectively, for displaying the image to be displayed; wherein each image protocol data packet corresponds to a first data link, and one first data link is correspondingly connected to one communication interface.
[0038] Optionally, the display system further comprises:
[0039] The image encoding device is used to encode the image to be displayed, obtain image encoding data of multiple display pixels of the image to be displayed, and transmit the image encoding data to the display control device.
[0040] An embodiment of the present invention further provides a readable storage medium, wherein a program is stored on the readable storage medium, and when the program is executed by a processor, the steps in the image data processing method as described in any one of the above items are implemented.
[0041] At least one of the above technical solutions in the specific embodiment of the present invention has the following beneficial effects:
[0042] The image data processing method described in the embodiment of the present invention can generate image protocol data packets corresponding to multiple display partitions after address resolution based on the image coding data of the image to be displayed, each image protocol data packet corresponds to a first data link, and each first data link corresponds to a communication channel. In this way, data distribution of multiple communication channels is performed on the generated multiple image protocol data packets, and the image coding data of the image to be displayed is transmitted to the display module through multiple data links by software programming, so as to realize the transmission and display of image data through multiple communication channels. BRIEF DESCRIPTION OF THE DRAWINGS
[0043] Figure 1 A schematic diagram of a flow chart of an image data processing method according to an embodiment of the present invention;
[0044] Figure 2 This is a schematic diagram of the structure of an image protocol data packet in an embodiment of the present invention;
[0045] Figure 3 This is a schematic diagram of the structure of a control protocol data packet in an embodiment of the present invention;
[0046] Figure 4 This is one of the timing diagrams of image protocol data packet transmission in an embodiment of the present invention;
[0047] Figure 5 This is a second timing diagram of image protocol data packet transmission in an embodiment of the present invention;
[0048] Figure 6 This is a third timing diagram of image protocol data packet transmission in an embodiment of the present invention;
[0049] Figure 7 A timing diagram of the transmission of a control protocol data packet in an embodiment of the present invention;
[0050] Figure 8 This is one of the structural schematic diagrams showing module partitioning in an embodiment of the present invention;
[0051] Fig. 9 This is a fourth timing diagram of image protocol data packet transmission in an embodiment of the present invention;
[0052] Fig.10 A schematic diagram of the principle of image coding data caching in an embodiment of the present invention;
[0053] Fig.11 is a schematic diagram of the structure of an image data processing device according to an embodiment of the present invention;
[0054] Fig.12 It is a schematic diagram of the structure of the display system described in an embodiment of the present invention. DETAILED DESCRIPTION
[0055] In order to make the technical problems, technical solutions and advantages to be solved by the present invention more clear, a detailed description will be given below with reference to the accompanying drawings and specific embodiments.
[0056] In order to solve the problem that the image processing system using the prior art cannot be applied to transmission through multiple communication channels, an embodiment of the present invention provides an image data processing method, which can perform address resolution on image coding data of an image to be displayed, and generate image protocol data packets corresponding to multiple display partitions, each image protocol data packet corresponds to a first data link, so that each first data link corresponds to a display partition, and the image protocol data packets of multiple display partitions can be transmitted to a display module for display through different first data links, thereby realizing the transmission and display of image data through multiple communication channels.
[0057] In one embodiment, the image data processing method described in the embodiment of the present invention is as follows: Figure 1 As shown, including:
[0058] S110, obtaining image coding data of a plurality of display pixels of an image to be displayed;
[0059] S120, generating at least one image protocol data packet according to the image coding data; each image protocol data packet corresponds to a display partition of the image to be displayed, and includes image coding data of the plurality of display pixels in the corresponding display partition;
[0060] S130, transmitting the at least one image protocol data packet to a display module through corresponding first data links, for displaying the image to be displayed; wherein each image protocol data packet corresponds to one first data link.
[0061] Optionally, in one embodiment, in step S110, the image encoding device obtains image encoding data of multiple display pixels of the image to be displayed. After the image encoding device obtains the image to be displayed, it performs image data conversion, image encoding and image comparison on the image to be displayed to obtain image encoding data of multiple display pixels of the image to be displayed. Optionally, the display data of each display pixel can be obtained according to the image encoding data. The display data of each display pixel includes R sub-pixel display data, G sub-pixel display data and B sub-pixel display data.
[0062] The image data processing method described in the embodiment of the present invention can generate image protocol data packets corresponding to multiple display partitions after address resolution based on the image coding data of the image to be displayed, each image protocol data packet corresponds to a first data link, and each first data link corresponds to a communication channel. In this way, data distribution of multiple communication channels is performed on the generated multiple image protocol data packets, and the image coding data of the image to be displayed is transmitted to the display module through multiple data links using software programming.
[0063] In the embodiment of the present invention, since each image protocol data packet corresponds to a display partition, different image protocol data packets can be generated separately. Therefore, the display data can be adjusted separately for different display partitions of the corresponding display module. The image data processing method described in the embodiment of the present invention is adopted to support the functions of local image data transmission and variable refresh rate display, thereby achieving the effect of reducing the power consumption of the module, and can be suitable for battery-powered low-power terminals.
[0064] In the embodiment of the present invention, optionally, each image protocol data packet further includes at least one of display mode information, pixel address information and supplementary virtual data;
[0065] The pixel address information is used to indicate the address of the display pixel corresponding to the image encoding data in the corresponding image protocol data packet.
[0066] Optionally, the display mode information includes but is not limited to indicating at least one of the following modes:
[0067] The current frame of image data is updated;
[0068] The image data is updated in the next frame;
[0069] Image data is not updated;
[0070] Pixel image data length setting.
[0071] One implementation method, such as Figure 2 As shown, each image protocol data packet includes display mode information, pixel address information, image encoding data and supplementary virtual data.
[0072] Optionally, the method further comprises:
[0073] Generate a control protocol data packet according to the image coding data; the control protocol data packet includes mode control information;
[0074] Wherein, when transmitting the at least one image protocol data packet to the display module through the corresponding first data link, the method further includes:
[0075] The control protocol data packet is transmitted to the display module via the second data link.
[0076] Optionally, the mode control information is one of the following information:
[0077] first information for indicating a self-test display mode;
[0078] Second information for indicating liquid crystal inversion;
[0079] The third information is used to indicate that the register state is reset.
[0080] The image data processing method described in the embodiment of the present invention sends image protocol data packets and control protocol data packets to the display module through different data links, wherein the image protocol data packets are used to realize the transmission and display of image data of the display module; the control protocol data packets are used to realize the various display mode settings of the display module.
[0081] The first data link for implementing the transmission of the image protocol data packet and the second data link for implementing the transmission of the control protocol data packet belong to different data links, that is, they correspond to different data transmission interfaces of the display module. Using the image data processing method described in the embodiment of the present invention, the display module includes a driver chip and a display panel, and the driver chip supports data transmission of multiple communication links.
[0082] Alternatively, if Figure 3As shown, the control protocol data packet includes not only the mode control information but also supplementary virtual data for supplementing the data in the control protocol data packet.
[0083] In the embodiment of the present invention, optionally, when transmitting the at least one image protocol data packet to the display module through the corresponding first data link, the method further includes: outputting a first clock signal of a preset frequency to the display module through a third data link;
[0084] There is one first clock signal, one first clock signal corresponds to all the image protocol data packets, and data of each image protocol data packet is latched during a rising period of the first clock signal; or;
[0085] There are multiple first clock signals, and one first clock signal corresponds to one image protocol data packet. During a rising period of one of the first clock signals, data of the corresponding image protocol data packet is latched.
[0086] In one implementation manner, optionally, when the control protocol data packet is transmitted to the display module via the second data link, the method further includes:
[0087] Outputting a second clock signal of a preset frequency to the display module via a fourth data link;
[0088] During the rising period of the second clock signal, data of the control protocol data packet is latched.
[0089] In the embodiment of the present invention, optionally, when outputting a first clock signal of a preset frequency to the display module through the third data link, and when outputting a second clock signal of a preset frequency to the display module through the fourth data link, the method further includes:
[0090] The chip select signal CS is output to the display module through the fifth data link.
[0091] The display module starts receiving the image protocol data packet and the control protocol data packet based on the received chip selection signal CS.
[0092] Optionally, the chip select signal CS transmitted in response to the image protocol data packet and the chip select signal CS transmitted in response to the control protocol data packet may be the same chip select signal CS or different chip select signals CS.
[0093] Figure 4 It is a schematic diagram of the transmission timing of the image protocol data packet; Figure 7 A schematic diagram of the transmission timing of the control protocol data packet.
[0094] See also Figure 4As shown, when the image protocol data packet is transmitted, a chip selection signal CS, a first clock signal CLK and a data signal SI are output to the display module respectively, and the data signal SI is used to transmit the image protocol data packet to the display panel.
[0095] The chip select signal CS and the first clock signal CLK output signals that switch between high level and low level by default, respectively. In addition, after the data signal SI starts transmission, the chip select signal CS switches from high level to low level, and the first clock signal CLK outputs high and low level switching signals at a preset frequency, wherein during the rising cycle of the first clock signal CLK, that is, when the first clock signal outputs a high level signal, the data signal SI is latched, that is, the data transmitted by the image protocol data packet is latched.
[0096] See also Figure 4 As shown, in the embodiment of the present invention, when the data signal SI of the image protocol data packet is output, the display mode information, the pixel address information, the image coding data and the supplementary virtual data are output in sequence.
[0097] For example, Figure 4 As shown, the data signal SI of the output image protocol data packet has 6-bit display mode information, namely M0, M1, ..., M5; the pixel address information is 10-bit data, namely AD0, AD1, ..., AD9; the image coding data is n-bit data, namely D0, D1, ..., Dn; the supplementary virtual data is m-bit data, namely DM0, DM1, ..., DMn. Wherein, n and m are both natural numbers greater than or equal to 1.
[0098] In the embodiment of the present invention, the supplementary virtual data in the data signal SI is used to maintain the clock waveform when the internal clock logic of the system is working supplementally.
[0099] In addition, using the image data processing method described in this embodiment, when outputting the data signal SI of the image protocol data packet, the data signal SI is addressed and refreshed according to the pixel address information, and the display pixels without address update maintain the previous display state, so as to effectively reduce the power consumption of the display module.
[0100] In one embodiment of the present invention, there is a plurality of first clock signals CLK, one first clock signal CLK corresponds to one image protocol data packet, and during a rising cycle of one of the first clock signals CLK, data of the corresponding image protocol data packet is latched.
[0101] like Figure 5 As shown, each first clock signal CLK corresponds to a data signal SI for transmitting an image protocol data packet.
[0102] In the embodiment of the present invention, optionally, each data signal SI transmitted by the image protocol data packet corresponds to a first data link, and the first data link may include a first output port, and the image protocol data packet is transmitted to the display module through the corresponding first output port. For example, for the data signal SIn transmitted by the nth image protocol data packet, it corresponds to the nth first data link and the nth first output port PORTx.n; different image protocol data packets correspond to different data links and output ports.
[0103] Similarly, a first clock signal CLK corresponds to an image protocol data packet, each first clock signal CLK corresponds to a third data link, and the third data link can include a second output port, and transmit the first clock signal CLK to the display module through the corresponding second output port. For example, for the first clock signal CLKn corresponding to the transmission of the nth image protocol data packet, the nth third data link and the nth second output port PORTy.n are corresponding.
[0104] In this embodiment, the first data link for transmitting the data signal SI of the image protocol data packet and the third data link for transmitting the first clock signal CLK are different data links. Each first clock signal CLK corresponds to a data signal SI for transmitting the image protocol data packet, and the data signal SI of each image protocol data packet and the corresponding clock signal CLK form a communication channel CH. Multiple communication channels can share a chip select signal CS, and the chip select signal CS can be mapped to a common hardware interface.
[0105] In this embodiment, optionally, in one implementation mode, for the first output port for outputting the data signal SI and the second output port for outputting the clock signal CLK, level state control can be performed separately and individually, and the level can be pulled up or down to control the data signal output of the port by bit; in another implementation mode, for the first output port for outputting the data signal SI and the second output port for outputting the clock signal CLK, level state control can be performed on multiple ports in a group at the same time, and the level can be pulled up or down, so that multiple interfaces can execute the level state pulling up or down at the same time to control the data signal output of the port by byte.
[0106] In another embodiment of the present invention, the first clock signal CLK for controlling the transmission of the image protocol data packet is one, such as Figure 6 As shown, one first clock signal CLK corresponds to all the image protocol data packets, and during the rising period of the first clock signal CLK, data of each image protocol data packet is latched.
[0107] Compared with one first clock signal CLK corresponding to one image protocol data packet, with this implementation, one first clock signal CLK corresponds to all image protocol data packets, which can save the use of system hardware resources and can be suitable for scenarios with a small number of display module communication channels to avoid insufficient driving capability due to excessive clock signal load.
[0108] See also Figure 7 As shown, in the embodiment of the present invention, when the control protocol data packet is transmitted, the chip select signal CS, the second clock signal CLK and the data signal SI are output to the display module respectively. When the control protocol data packet is transmitted, the data signal SI is used to transmit the control protocol data packet to the display panel.
[0109] Similarly, when the control protocol data packet is transmitted, the chip select signal CS and the second clock signal CLK output high-level and low-level switching signals by default. In addition, after the data signal SI starts transmission, the chip select signal CS switches from a high level to a low level, and the second clock signal CLK outputs a high-level and low-level switching signal at a preset frequency, wherein during the rising cycle of the second clock signal CLK, that is, when the second clock signal outputs a high-level signal, the data signal SI is latched, that is, the data transmitted by the control protocol data packet is latched.
[0110] See also Figure 7 As shown, in the embodiment of the present invention, when the control protocol data packet is output, the mode control information and the supplementary virtual data are output in sequence.
[0111] For example, Figure 7 As shown, when the data signal SI of the output control protocol data packet is output, the mode control information is 6-bit data, namely M0, M1, ..., M5; the supplementary virtual data is m-bit data, namely DM0, DM1, ..., DMn; wherein n and m are both natural numbers greater than or equal to 1.
[0112] In the image data processing method according to the embodiment of the present invention, in step S120, the number of the generated image protocol data packets is multiple, and the multiple display partitions corresponding to the multiple image protocol data packets are sequentially arranged along the first direction of the image to be displayed;
[0113] Among them, in each image protocol data packet, the image coding data of multiple display pixel groups arranged along the second direction of the image to be displayed in the corresponding display partition are arranged in sequence; each display pixel group includes at least one display module arranged along the first direction; the second direction is perpendicular to the first direction.
[0114] For example, Figure 8 As shown, on the image to be displayed, multiple display partitions CH0, CH1, ..., CHn-1 The first and second directions Y are arranged in sequence along the first direction X, that is, in sequence along the horizontal direction. Based on the display partition setting structure, each image protocol data packet corresponds to a display partition, and in each image protocol data packet, the image encoding data of multiple display pixel groups arranged along the second direction Y of the image to be displayed in the corresponding display partition are arranged in sequence. Optionally, the second direction Y is perpendicular to the first direction X. In the embodiment of the present invention, the second direction Y is a vertical direction. Using this embodiment, if Fig. 9 As shown, each image protocol data packet includes image data of multiple rows of display modules in the corresponding display partition, and the display modules included in each row constitute a display pixel group. Multiple rows of display modules are arranged in the vertical direction to form a structure in which multiple display pixel groups are arranged in the vertical direction. Each image protocol data packet includes image encoding data of multiple rows of display modules.
[0115] In the embodiment of the present invention, taking the case where the image to be displayed is divided into 16 display partitions as an example, that is, n is 16, the resolution of the display panel can be 1024x768; the data signals of the 16 image protocol data packets correspond one-to-one to the 16 display partitions, the resolution of each display partition can be 1024x48, and the order in which each data signal SI transmits the image is from the display pixel at the upper left of the display partition to the display pixel at the lower right.
[0116] For example, Fig. 9 and Fig.10 As shown, the image coded data included in the data signal SI0 of the image protocol data packet corresponding to the display partition CH0 includes the first row of image data, the second row of image data, etc. in the display partition CH0, and each row of image data is arranged and transmitted in sequence; similarly, the display partition CH 15 The image signal SI15 of the corresponding image protocol data packet includes image encoding data including display partition CH 15 The first line of image data, the second line of image data, etc., are arranged and transmitted in sequence; similarly, the image coding data in other image protocol data packets are also arranged according to this principle, and examples are not given one by one here.
[0117] The image data processing method of the embodiment of the present invention, after obtaining the image coding data of a plurality of display pixels of the image to be displayed in step S110, the method further includes:
[0118] Cache the image encoding data in a cache unit;
[0119] Wherein, when generating at least one image protocol data packet according to the image coding data, the image coding data is read from the cache unit;
[0120] The cache unit includes a plurality of cache sub-units, each of which is used to store image coding data of a display pixel group, and a display pixel group includes a plurality of display pixels respectively located in different display partitions.
[0121] Optionally, the multiple display partitions corresponding to the multiple image protocol data packets are arranged in sequence along the first direction of the image to be displayed, and a display pixel group corresponding to each cache sub-unit includes multiple display pixels located in different display areas, respectively, and located in the same row arranged along the first direction on the image to be displayed.
[0122] According to the image data processing method of the embodiment of the present invention, after the image encoding device obtains the image encoding data of the image to be displayed, it caches it in a cache unit, and when generating at least one image protocol data packet, the image encoding data is read from the cache unit.
[0123] Optionally, the cache unit includes a plurality of cache sub-units, each of which may also be a cache bit for storing image encoding data of a display pixel group, where a display pixel group includes a plurality of display pixels located in different display partitions.
[0124] In the embodiment of the present invention, optionally, the number of the cache subunits is the same as the number of ports of the image coding data interface output by the image coding device. For example, when the image coding device outputs the image coding data via the USB interface, the image coding data output by the USB interface of the image coding device includes eight bits, and the number of the corresponding cache subunits is eight, and each cache subunit is used to store one bit of image data output by the USB interface. In the embodiment of the present invention, each cache subunit is used to store image coding data of multiple display pixels located in different display partitions.
[0125] For example, Fig.10 As shown, the cache unit includes multiple cache sub-units, DATA0, DATA1, DATA2, ..., DATA7, and the data signals SI of the multiple image protocol data packets are SI0, SI1, SI2, ..., SI15, respectively. Figure 8As shown, each image protocol data packet corresponds to a display partition, and is used to transmit the image coding data of each row of display pixels in the corresponding display partition. For example, the image coding data transmitted by SI0 includes D0-M0, D0-M1, D0-M2, ..., wherein D0-M0 is the coding data of multiple display pixels in the first pixel row in the display partition CH0, D0-M1 is the coding data of multiple display pixels in the first pixel row in the display partition CH0, D0-M2 is the coding data of multiple display pixels in the second pixel row in the display partition CH0, ..., based on this principle, SI0 is used to transmit the coding data of display pixels in each pixel row in the display partition CH0. Similarly, the image coding data transmitted by the data signals of other image protocol data packets can be determined according to this rule.
[0126] When the buffer unit buffers the image coding data of the pixel to be displayed, taking the image coding data output by the USB interface of the image coding device including eight bits as an example, Fig.10 As shown, the cache subunit DATA0 is used to store the coded data D0-M0 of multiple display pixels in the first pixel row in the display partition CH0, the coded data D1-M0 of multiple display pixels in the first pixel row in the display partition CH1, the coded data D2-M0 of multiple display pixels in the first pixel row in the display partition CH2, ..., and the coded data D7-M0 of multiple display pixels in the first pixel row in the display partition CH7; the cache subunit DATA1 is used to store the coded data D8-M0 of multiple display pixels in the first pixel row in the display partition CH8, the coded data D9-M0 of multiple display pixels in the first pixel row in the display partition CH9, the coded data D10-M0 of multiple display pixels in the first pixel row in the display partition CH10, ..., and the coded data D15-M0 of multiple display pixels in the first pixel row in the display partition CH15;
[0127] The cache subunit DATA3 is used to store the encoded data D0-M1 of multiple display pixels in the second pixel row in display partition CH0, the encoded data D1-M1 of multiple display pixels in the second pixel row in display partition CH1, the encoded data D2-M1 of multiple display pixels in the second pixel row in display partition CH2, ..., and the encoded data D7-M1 of multiple display pixels in the second pixel row in display partition CH7; the cache subunit DATA4 is used to store the encoded data D8-M1 of multiple display pixels in the second pixel row in display partition CH8, the encoded data D9-M1 of multiple display pixels in the second pixel row in display partition CH9, the encoded data D10-M1 of multiple display pixels in the second pixel row in display partition CH10, ..., and the encoded data D15-M1 of multiple display pixels in the second pixel row in display partition CH15.
[0128] According to the above data caching rules, each cache subunit is used to cache the image coding data of multiple display pixels located in different display partitions, and when the stored image coding data of the display pixels are located in a display pixel group, the multiple display pixels included in a display pixel group corresponding to each cache subunit are respectively located in different display areas, and are located in the same row arranged along the first direction on the image to be displayed. For example, the cache subunit DATA0 is used to store the image coding data of multiple display pixels of the first pixel row of multiple display partitions along the horizontal direction (first direction).
[0129] In addition, when the image encoding data outputted by the USB interface of the image encoding device includes eight bits and the image to be displayed is divided into 16 display partitions, the even-numbered cache subunits in the cache unit are used to store the image encoding data corresponding to the data signals SI0 to SI7, and the odd-numbered cache subunits in the cache unit store the image encoding data corresponding to the data signals SI8 to SI15. That is, the even-numbered cache subunits are used to store the image encoding data of the display pixels in the first display partition to the eighth display partition, and the odd-numbered cache subunits are used to store the image encoding data of the display pixels in the ninth display partition to the sixteenth display partition.
[0130] According to the above rules, when reading the image coding data from the cache unit, the image coding data of the pixel units located in the same display partition can be read sequentially by multiple cache sub-units to obtain the image coding data required to be transmitted in each image protocol data packet.
[0131] By adopting the image data processing method described in the embodiment of the present invention, it is possible to perform address resolution on the image coding data of the image to be displayed, and generate image protocol data packets corresponding to multiple display partitions, each image protocol data packet corresponds to a first data link, so that each first data link corresponds to a display partition, and the image protocol data packets of multiple display partitions can be transmitted to the display module for display through different first data links, thereby realizing the transmission and display of image data through multiple communication channels.
[0132] Optionally, the image encoding data is transmitted to the display module via SPI. By adopting the image data processing method described in the embodiment of the present invention, it is possible to simulate multiple SPI communication channels through software to realize a high-speed data transmission interface to meet the image data transmission requirements of small and medium-sized liquid crystal display devices. In addition, since each data link corresponds to a display partition, image protocol data packets of multiple display partitions can be transmitted to the display module for display through different data links, real-time modulation of the display refresh rate can be achieved, and local refresh of the displayed image can be performed, thereby reducing the power consumption of the module and realizing low-power display.
[0133] Another aspect of the present invention is to provide an image data processing device. Fig.11 As shown, the device comprises:
[0134] The data acquisition unit 1110 is used to acquire the image coding data of a plurality of display pixels of the image to be displayed;
[0135] The processing unit 1120 is configured to generate at least one image protocol data packet according to the image coding data; each image protocol data packet corresponds to a display partition of the image to be displayed, and includes image coding data of the plurality of display pixels in the display partition;
[0136] The transmission unit 1130 is used to transmit the at least one image protocol data packet to the display module through the corresponding first data link, so as to display the image to be displayed; wherein each image protocol data packet corresponds to one first data link.
[0137] Optionally, in the image data processing device, each image protocol data packet further includes at least one of display mode information, pixel address information and supplementary virtual data;
[0138] The pixel address information is used to indicate the address of the display pixel corresponding to the image encoding data in the corresponding image protocol data packet.
[0139] Optionally, in the image data processing device, the processing unit 1120 is further configured to:
[0140] Generate a control protocol data packet according to the image coding data; the control protocol data packet includes mode control information;
[0141] Wherein, when the transmission unit 1130 transmits the at least one image protocol data packet to the display module through the corresponding first data link, it is also used to:
[0142] The control protocol data packet is transmitted to the display module via the second data link.
[0143] Optionally, in the image data processing device, the mode control information is one of the following information:
[0144] first information for indicating a self-test display mode;
[0145] Second information for indicating liquid crystal inversion;
[0146] The third information is used to indicate that the register state is reset.
[0147] Optionally, in the image data processing device, when transmitting the at least one image protocol data packet to the display module through the corresponding first data link, the transmission unit 1130 is further used to: output a first clock signal of a preset frequency to the display module through a third data link;
[0148] There is one first clock signal, one first clock signal corresponds to all the image protocol data packets, and data of each image protocol data packet is latched during a rising period of the first clock signal; or;
[0149] There are multiple first clock signals, and one first clock signal corresponds to one image protocol data packet. During a rising period of one of the first clock signals, data of the corresponding image protocol data packet is latched.
[0150] Optionally, in the image data processing device, when the control protocol data packet is transmitted to the display module via the second data link, the transmission unit 1130 is further configured to:
[0151] Outputting a second clock signal of a preset frequency to the display module via a fourth data link;
[0152] During the rising period of the second clock signal, data of the control protocol data packet is latched.
[0153] Optionally, in the image data processing device, the number of the generated image protocol data packets is multiple, and the multiple display partitions corresponding to the multiple image protocol data packets are sequentially arranged along the first direction of the image to be displayed;
[0154] Among them, in each image protocol data packet, the image coding data of multiple display pixel groups arranged along the second direction of the image to be displayed in the corresponding display partition are arranged in sequence; each display pixel group includes at least one display module arranged along the first direction; the second direction is perpendicular to the first direction.
[0155] Optionally, in the image data processing device, after acquiring the image coding data of a plurality of display pixels of the image to be displayed, the processing unit 1120 is further configured to:
[0156] Cache the image encoding data in a cache unit;
[0157] Wherein, when generating at least one image protocol data packet according to the image coding data, the image coding data is read from the cache unit;
[0158] The cache unit includes a plurality of cache sub-units, each of which is used to store image coding data of a display pixel group, and a display pixel group includes a plurality of display pixels respectively located in different display partitions.
[0159] Optionally, in the image data processing device, the multiple display partitions corresponding to the multiple image protocol data packets are arranged in sequence along the first direction of the image to be displayed, and a display pixel group corresponding to each cache sub-unit includes multiple display pixels located in different display areas, respectively, and located in the same row arranged along the first direction on the image to be displayed.
[0160] The embodiment of the present invention further provides a display system, such as Fig.12 As shown, including:
[0161] A display control device 10 and a display module 20; the display control device 10 and the display module 20 are connected via a multi-channel communication interface;
[0162] The display control device 10 is used to obtain image coding data of multiple display pixels of an image to be displayed; generate at least one image protocol data packet according to the image coding data; each image protocol data packet corresponds to a display partition of the image to be displayed, including the image coding data of the multiple display pixels in the corresponding display partition; transmit the at least one image protocol data packet to the display module through the corresponding first data link, for displaying the image to be displayed; wherein each image protocol data packet corresponds to a first data link, and one first data link corresponds to being connected to one communication interface.
[0163] In the display system described in the embodiment of the present invention, the display control device can perform address resolution on the image coding data of the image to be displayed, and generate image protocol data packets corresponding to multiple display partitions, each image protocol data packet corresponds to a first data link, so that each first data link corresponds to a display partition, and the image protocol data packets of the multiple display partitions can be transmitted to the display module for display through different first data links, thereby realizing the transmission and display of image data through multiple communication channels.
[0164] Optionally, the display system further includes:
[0165] The image encoding device 30 is used to encode the image to be displayed, obtain image encoding data of multiple display pixels of the image to be displayed, and transmit the image encoding data to the display control device.
[0166] Optionally, the image encoding device 30 is connected to the display control device 10 via a USB interface, and the display control device 10 may be an ARM controller, which is connected to the display module 20 via an SPI communication channel. The image encoding device 30 can realize image data conversion, image encoding, image comparison, and additional address functions in the encoded image data, and transmit the image encoding data to the display control device 10 via the USB interface, and the display control device can realize the reception, analysis, caching, and data distribution of multiple communication channels of the USB interface data; the display module 20 can support multiple communication links.
[0167] Optionally, in the display system, each image protocol data packet further includes at least one of display mode information, pixel address information and supplementary virtual data;
[0168] The pixel address information is used to indicate the address of the display pixel corresponding to the image encoding data in the corresponding image protocol data packet.
[0169] Optionally, in the display system, the display control device 10 is further used for:
[0170] Generate a control protocol data packet according to the image coding data; the control protocol data packet includes mode control information;
[0171] Wherein, when transmitting the at least one image protocol data packet to the display module through the corresponding first data link, the method further includes:
[0172] The control protocol data packet is transmitted to the display module via the second data link.
[0173] Optionally, in the display system, the mode control information is one of the following information:
[0174] first information for indicating a self-test display mode;
[0175] Second information for indicating liquid crystal inversion;
[0176] The third information is used to indicate that the register state is reset.
[0177] Optionally, in the display system, when the display control device 10 transmits the at least one image protocol data packet to the display module through the corresponding first data link, it is further used to: output a first clock signal of a preset frequency to the display module through a third data link;
[0178] There is one first clock signal, one first clock signal corresponds to all the image protocol data packets, and data of each image protocol data packet is latched during a rising period of the first clock signal; or;
[0179] There are multiple first clock signals, and one first clock signal corresponds to one image protocol data packet. During a rising period of one of the first clock signals, data of the corresponding image protocol data packet is latched.
[0180] Optionally, in the display system, when the display control device 10 transmits the control protocol data packet to the display module via the second data link, it is further configured to:
[0181] Outputting a second clock signal of a preset frequency to the display module via a fourth data link;
[0182] During the rising period of the second clock signal, data of the control protocol data packet is latched.
[0183] Optionally, in the display system, the number of the generated image protocol data packets is multiple, and the multiple display partitions corresponding to the multiple image protocol data packets are sequentially arranged along the first direction of the image to be displayed;
[0184] Among them, in each image protocol data packet, the image coding data of multiple display pixel groups arranged along the second direction of the image to be displayed in the corresponding display partition are arranged in sequence; each display pixel group includes at least one display module arranged along the first direction; the second direction is perpendicular to the first direction.
[0185] Optionally, in the display system, after the display control device 10 acquires the image coding data of a plurality of display pixels of the image to be displayed, it is further configured to:
[0186] Cache the image encoding data in a cache unit;
[0187] Wherein, when generating at least one image protocol data packet according to the image coding data, the image coding data is read from the cache unit;
[0188] The cache unit includes a plurality of cache sub-units, each of which is used to store image coding data of a display pixel group, and a display pixel group includes a plurality of display pixels respectively located in different display partitions.
[0189] Optionally, in the display system, the multiple display partitions corresponding to the multiple image protocol data packets are arranged in sequence along the first direction of the image to be displayed, and a display pixel group corresponding to each cache sub-unit includes multiple display pixels located in different display areas, respectively, and located in the same row arranged along the first direction on the image to be displayed.
[0190] In the display system of the embodiment of the present invention, the communication interface transmission between the display control device 10 and the display module 20 includes an image protocol data packet and a control protocol data packet, wherein the image protocol data packet realizes the transmission and display of image data, and the control protocol data packet performs multiple display mode settings.
[0191] In addition, in the display system described in the embodiment of the present invention, since each image protocol data packet output by the display control device 10 to the display module 20 corresponds to a display partition of the display module 20, different image protocol data packets can be generated separately, so the display data can be adjusted separately for different display partitions of the display module. The image data processing method described in the embodiment of the present invention is adopted to support the functions of local image data transmission and variable refresh rate display, thereby achieving the effect of reducing the power consumption of the module, and can be suitable for battery-powered low-power terminals.
[0192] The display system of the embodiment of the present invention realizes multiple analog SPI communication channels through software based on the ARM controller to realize a high-speed data transmission interface to meet the image data transmission requirements of small and medium-sized liquid crystal display devices. In addition, the multi-channel communication high-speed data transmission interface solution is easy to operate, convenient and flexible, easy to develop and implement, and is suitable for low-cost module driving solutions.
[0193] In the embodiment of the present invention, the display control device 10 receives image data from the display module 20, analyzes and caches the image data, and implements data distribution through multiple communication channels. Figures 1 to 10 , and refer to the above detailed description, which will not be described in detail here.
[0194] An embodiment of the present invention further provides a readable storage medium, wherein a program is stored on the readable storage medium, and when the program is executed by a processor, the steps in the image data processing method as described in any one of the above items are implemented.
[0195] The above is a preferred embodiment of the present invention. It should be pointed out that for ordinary personnel in this technical field, several improvements and modifications can be made without departing from the principles of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.
Claims
1. A method for processing image data, characterized in that: The method comprises: Acquire image encoding data of a plurality of display pixels of an image to be displayed; generating at least one image protocol data packet according to the image coding data; each image protocol data packet corresponds to a display partition of the image to be displayed, and includes image coding data corresponding to the plurality of display pixels in the display partition; Transmitting the at least one image protocol data packet to the display module through the corresponding first data link, so as to display the image to be displayed; wherein each image protocol data packet corresponds to one first data link; Generate a control protocol data packet according to the image coding data; the control protocol data packet includes mode control information; Wherein, when transmitting the at least one image protocol data packet to the display module through the corresponding first data link, the method further includes: Transmitting the control protocol data packet to the display module through a second data link, wherein the first data link and the second data link are different data links corresponding to different data transmission interfaces of the display module; Each image protocol data packet further includes at least one of display mode information, pixel address information and supplementary virtual data, wherein the pixel address information is used to indicate the address of the display pixel corresponding to the image encoding data in the corresponding image protocol data packet, and the supplementary virtual data is used to maintain the clock waveform when the system internal clock logic works supplementally, and the mode control information is one of the following information: first information for indicating a self-test display mode; Second information for indicating liquid crystal inversion; third information for indicating a reset of a register state; The image protocol data packets of multiple display partitions can be transmitted to the display module for display through different data links, so as to perform partial refresh of the displayed image.
2. The image data processing method according to claim 1, characterized in that: When transmitting the at least one image protocol data packet to the display module through the corresponding first data link, the method further includes: outputting a first clock signal of a preset frequency to the display module through a third data link; There is one first clock signal, one first clock signal corresponds to all the image protocol data packets, and data of each image protocol data packet is latched during a rising period of the first clock signal; or; There are multiple first clock signals, and one first clock signal corresponds to one image protocol data packet. During a rising period of one of the first clock signals, data of the corresponding image protocol data packet is latched.
3. The image data processing method according to claim 1, characterized in that: When transmitting the control protocol data packet to the display module via the second data link, the method further includes: Outputting a second clock signal of a preset frequency to the display module via a fourth data link; During the rising period of the second clock signal, data of the control protocol data packet is latched.
4. The image data processing method according to claim 1, characterized in that: The number of the generated image protocol data packets is multiple, and the multiple display partitions corresponding to the multiple image protocol data packets are sequentially arranged along the first direction of the image to be displayed; Among them, in each image protocol data packet, the image coding data of multiple display pixel groups arranged along the second direction of the image to be displayed in the corresponding display partition are arranged in sequence; each display pixel group includes at least one display module arranged along the first direction; the second direction is perpendicular to the first direction.
5. The image data processing method according to claim 1, characterized in that: After acquiring the image encoding data of a plurality of display pixels of the image to be displayed, the method further comprises: Cache the image encoding data in a cache unit; Wherein, when generating at least one image protocol data packet according to the image coding data, the image coding data is read from the cache unit; The cache unit includes a plurality of cache sub-units, each of which is used to store image coding data of a display pixel group, and a display pixel group includes a plurality of display pixels respectively located in different display partitions.
6. The image data processing method according to claim 5, characterized in that: The multiple display partitions corresponding to the multiple image protocol data packets are arranged in sequence along the first direction of the image to be displayed, and a display pixel group corresponding to each cache sub-unit includes multiple display pixels located in different display areas, respectively, and located in the same row arranged along the first direction on the image to be displayed.
7. An image data processing device, characterized in that: The device comprises: A data acquisition unit, used to acquire image coding data of a plurality of display pixels of an image to be displayed; A processing unit, configured to generate at least one image protocol data packet according to the image coding data; each image protocol data packet corresponds to a display partition of the image to be displayed, and includes image coding data corresponding to the plurality of display pixels in the display partition; A transmission unit, used for transmitting the at least one image protocol data packet to the display module through the corresponding first data link, so as to display the image to be displayed; wherein each image protocol data packet corresponds to one first data link; The processing unit is further used to generate a control protocol data packet according to the image coding data; the control protocol data packet includes mode control information; The transmission unit is further used to transmit the control protocol data packet to the display module through a second data link, wherein the first data link and the second data link are different data links corresponding to different data transmission interfaces of the display module; Each image protocol data packet further includes at least one of display mode information, pixel address information and supplementary virtual data, wherein the pixel address information is used to indicate the address of the display pixel corresponding to the image encoding data in the corresponding image protocol data packet, and the supplementary virtual data is used to maintain the clock waveform when the system internal clock logic works supplementally, and the mode control information is one of the following information: first information for indicating a self-test display mode; Second information for indicating liquid crystal inversion; third information for indicating a reset of a register state; The image protocol data packets of multiple display partitions can be transmitted to the display module for display through different data links, so as to perform partial refresh of the displayed image.
8. A display system, characterized in that: include: Display control device and display module; The display control device is connected to the display module via a multi-channel communication interface; The display control device is used to obtain image coding data of a plurality of display pixels of an image to be displayed; and generate at least one image protocol data packet according to the image coding data; Each image protocol data packet corresponds to a display partition of the image to be displayed, including image coding data of the plurality of display pixels in the corresponding display partition; the at least one image protocol data packet is transmitted to the display module through the corresponding first data link, respectively, for displaying the image to be displayed; wherein each image protocol data packet corresponds to a first data link, and one first data link is connected to a communication interface; a control protocol data packet is generated according to the image coding data; the control protocol data packet includes mode control information; the control protocol data packet is transmitted to the display module through the second data link, the first data link and the second data link belong to different data links, corresponding to different data transmission interfaces of the display module; Each image protocol data packet further includes at least one of display mode information, pixel address information and supplementary virtual data, wherein the pixel address information is used to indicate the address of the display pixel corresponding to the image encoding data in the corresponding image protocol data packet, and the supplementary virtual data is used to maintain the clock waveform when the system internal clock logic works supplementally, and the mode control information is one of the following information: first information for indicating a self-test display mode; Second information for indicating liquid crystal inversion; third information for indicating a reset of a register state; The image protocol data packets of multiple display partitions can be transmitted to the display module for display through different data links, so as to perform partial refresh of the displayed image.
9. The display system according to claim 8, characterized in that: The display system further comprises: The image encoding device is used to encode the image to be displayed, obtain image encoding data of multiple display pixels of the image to be displayed, and transmit the image encoding data to the display control device.
10. A readable storage medium, characterized in that: The readable storage medium stores a program, and when the program is executed by a processor, the steps in the image data processing method according to any one of claims 1 to 6 are implemented.
Citation Information
Patent Citations
Multichannel transmission subsystem and transmission method of superhigh-definition video image
CN104427302A
Display card, image display device, image display method and system
CN106293578A