Display data low-power-consumption simplified transmission method and device, medium, program product and terminal

Abstract

The invention provides a display data low-power-consumption simplified transmission method and device, a medium, a program product and a terminal, and the method comprises the steps: obtaining to-be-transmitted image data, extracting one or more kinds of same channel image information from the data according to a receiving equipment display mode, arranging the information according to an extraction sequence, and forming a to-be-transmitted queue; according to the scheme, the flexibility of channel image information extraction is improved, and a user can select one or more channels according to requirements. Meanwhile, the channel image information is arranged according to the extraction sequence, so that the transmission efficiency is improved, and the integrity and accuracy of the data are ensured through a preset packaging mode. According to the invention, based on the existing MIPI interface and protocol, in the encoding and transmission process of the front-end sender and the decoding process of the rear end, a selective data extraction and low-bandwidth mode is adopted, efficient and low-power-consumption image data transmission is realized, and the requirements of wearable equipment such as AR and VR glasses and helmets are met.

Description

Display data low-power consumption simplified transmission method, device, medium, program product and terminal TECHNICAL FIELD

[0001] The present application relates to the field of image data transmission, in particular to a display data low-power consumption simplified transmission method, device, medium, program product and terminal. BACKGROUND

[0002] With the emergence of low-power consumption devices such as AR (Augmented Reality) glasses and VR (Virtual Reality) glasses, the area of the receiving device is limited, and the manufacturing process is also limited, which leads to the inability to achieve high-resolution display. For example, a three-channel RGB receiving device is divided into three single-channel devices. After these devices receive RGB (Red, Green, Blue) data, they need to discard the data of the other two components, resulting in invalid data transmission and decoding, and increasing unnecessary energy consumption.

[0003] Specifically, the display technology based on Micro LED used by AR devices generally uses a package format in which each pixel includes red (R), green (G), and blue (B) three colors, and each pixel component is represented by 8 bits. Therefore, if the host sends monochrome video data or the receiving device only supports single-channel data, the host still needs to package according to the 24-bit encoding method. In this packaging method, the remaining 16 bits of data that do not match the display format of the receiving device are invalid, and the receiving device will not only receive all the bit data of each pixel, including invalid data, but also discard the invalid part. This not only wastes transmission bandwidth, but also increases power consumption.

[0004] SUMMARY

[0005] In view of the above-mentioned shortcomings of the prior art, the purpose of the present application is to provide a display data low-power consumption simplified transmission method, device, medium, program product and terminal, which is used to solve the problem that when the number of channels of the image required by the receiving device is less than the number of channels of the image sent by the sending device, part of the channel data needs to be discarded, resulting in the increase of invalid data transmission and decoding, and the consumption of unnecessary energy.

[0006] To achieve the above-mentioned purposes and other related purposes, the first aspect of the present application provides a display data low-power consumption simplified transmission method, comprising: obtaining to-be-sent image data; based on the display mode of a receiving device, extracting one or more channel image information corresponding from the to-be-sent image data, and arranging the extracted channel image information in the extraction order to generate a to-be-sent queue; and packing the to-be-sent queue in a preset manner to form a corresponding data packet and sending it out.

[0007] In some embodiments of the first aspect of the present application, the process of extracting a corresponding channel image information from the image data to be sent and arranging the extracted channel image information in sequence to generate a sending queue comprises: extracting a same kind of pixel data matching the display mode of the receiving device from the multi-channel image of the image data to be sent; recombining every N pixel data as a group to generate a corresponding pixel block according to the original pixel size in the image data to be sent; and arranging the pixel blocks in sequence to generate the sending queue.

[0008] In some embodiments of the first aspect of the present application, the process of packing the sending queue in a preset manner comprises: packing the sending queue in an uncompressed manner.

[0009] In some embodiments of the first aspect of the present application, the process of packing the sending queue in an uncompressed manner comprises: packing the sending queue with a data packet header and a data packet tail in an uncompressed manner to generate a corresponding data packet.

[0010] In some embodiments of the first aspect of the present application, the data packet header contains a virtual channel number, and it is determined whether the virtual channel number is 3, and if so, the extracted channel image information in the sending queue is identified as single-channel image information.

[0011] In some embodiments of the first aspect of the present application, the process of packing the sending queue in an uncompressed manner comprises: packing an identification data structure with the sending queue in an uncompressed manner to generate a sending queue; wherein the identification data structure contains a first byte and a second byte.

[0012] In some embodiments of the first aspect of the present application, two low bits in the first byte are used to represent the extracted color channel, and the second byte contains the CRC value of the first byte.

[0013] In some embodiments of the first aspect of the present application, after the sending queue is packed in a preset manner to form a corresponding data packet and sent out, the receiving device receives the data packet, verifies the first byte and the second byte; if the first byte and the second byte pass the verification, the data packet is parsed based on the color channel in the first byte; if the first byte or the second byte fails the verification, the data packet is parsed according to a standard protocol.

[0014] In some embodiments of the first aspect of the present application, the data packet header includes at least one of data type, virtual channel, word number, and error check code.

[0015] In some embodiments of the first aspect of the present application, the checksum algorithm included in the data packet tail comprises any one of the following: a CRC (Cyclic Redundancy Check) algorithm, an MD5 algorithm, an SHA-1 algorithm, and an SHA-256 algorithm.

[0016] In some embodiments of the first aspect of the present application, the process of extracting corresponding multi-channel image information from the image data to be transmitted and arranging the extracted channel image information in sequence to generate a to-be-transmitted queue comprises: extracting first pixel data and second pixel data corresponding to the display mode of the receiving device from the multi-channel image of the image data to be transmitted; recombining every N pixel data as a group according to the original pixel size in the image data to be transmitted to generate a corresponding pixel block; and arranging the pixel blocks in sequence to generate the to-be-transmitted queue.

[0017] In some embodiments of the first aspect of the present application, the process of generating a to-be-transmitted queue further comprises: performing feature extraction on all first pixel data and second pixel data, and combining the first pixel data and the second pixel data based on the similarity or difference of the features to generate a pixel block queue, and then performing an optimization operation on the pixel block queue to generate a to-be-transmitted queue.

[0018] In some embodiments of the first aspect of the present application, the optimization operation comprises at least one of color adjustment and shape correction.

[0019] In some embodiments of the first aspect of the present application, the attributes of the display mode of the receiving device comprise one or more of the following: the type of display channel of the receiving device, the number of display channels of the receiving device, the resolution of the receiving device, the refresh rate of the receiving device, the color model of the receiving device, and the color space standard corresponding to the display channel of the receiving device.

[0020] In some embodiments of the first aspect of the present application, the communication protocol standard that can be used to send the data packet comprises any one of the following: a MIPI DSI standard, an LVDS standard, an eDP standard, and an HDMI standard; and / or, the image data to be transmitted comprises an RGB image.

[0021] In some embodiments of the first aspect of the present application, when the MIPI DSI standard is used, the process of packaging the to-be-transmitted queue in a preset manner comprises: packaging the to-be-transmitted queue in a pixel stream, a 24-bit format, and a long data packet packaging manner.

[0022] To achieve the above object and other related objects, the second aspect of the present application provides a display data low-power simplified transmission device, comprising: a data acquisition module, configured to acquire image data to be sent; a channel extraction module, configured to extract one or more kinds of channel image information corresponding to the image data to be sent based on a display mode of a receiving device, and arrange the extracted channel image information in an extraction order to generate a to-be-sent queue; and a data packaging module, configured to package the to-be-sent queue in a preset manner to form a corresponding data packet and send the data packet out.

[0023] To achieve the above object and other related objects, the third aspect of the present application provides a computer readable storage medium, which stores a computer program, and the computer program is executed by a processor to implement the display data low-power simplified transmission method.

[0024] To achieve the above object and other related objects, the fourth aspect of the present application provides a computer program product, which comprises computer program code, and when the computer program code is run on a computer, the computer program code causes the computer to implement the display data low-power simplified transmission method.

[0025] To achieve the above object and other related objects, the fifth aspect of the present application provides an electronic terminal, comprising a memory, a processor and a computer program stored in the memory; the processor executes the computer program to implement the display data low-power simplified transmission method.

[0026] As described above, the display data low-power simplified transmission method, device, medium, program product and terminal of the present application have the following beneficial effects: the present application improves the flexibility of channel image information extraction, and users can select to extract information of a single channel or multiple channels according to needs. By optimizing the extraction order, the order and speed of data transmission are improved, thereby enhancing the transmission efficiency. The preset data packaging mode ensures the integrity and accuracy of data during transmission, and improves the reliability of transmission. Based on the existing MIPI interface and protocol, the present application adopts selective data extraction and low-bandwidth mode in the process of front-end sender coding, transmission and back-end decoding, to realize efficient and low-power image data transmission, and meet the needs of AR, VR glasses and headsets and other wearable devices. BRIEF DESCRIPTION OF DRAWINGS

[0027] FIG. 1 shows a flowchart of an embodiment of the display data low-power simplified transmission method of the present application.

[0028] FIG. 2 shows a structure diagram of an RGB data packet in an embodiment of the display data low-power simplified transmission method of the present application.

[0029] Figure 3 shows a flow diagram of the decimation process in an embodiment of the low power simplified transmission method of display data according to the present application.

[0030] Figure 4 shows the data format after MIPI packetization in an embodiment of the low power simplified transmission method of display data according to the present application.

[0031] Figure 5 shows a structure diagram of the identification data in an embodiment of the low power simplified transmission method of display data according to the present application.

[0032] Figure 6 shows a data transmission waveform diagram of the prior art of the low power simplified transmission of display data according to the present application.

[0033] Figure 7 shows a data transmission waveform diagram in an embodiment of the low power simplified transmission method of display data according to the present application.

[0034] Figure 8 shows a structure diagram of an embodiment of the low power simplified transmission apparatus of display data according to the present application.

[0035] Figure 9 shows a structure diagram of an embodiment of the low power simplified transmission terminal of display data according to the present application. DETAILED DESCRIPTION

[0036] The embodiments of the present application will be described in detail with specific reference felt to the drawings. Those skilled in the art can easily understand other advantages and purposes of the present application from the description of the present application. The present application can be implemented or applied in other different embodiments, and the details in the description can be modified or changed based on different views and applications without departing from the spirit of the present application. It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict.

[0037] Before the present application is further described, the nomenclature and terminology used in the embodiments of the present application are explained, and the nomenclature and terminology used in the embodiments of the present application are applicable to the following explanations:

[0038] <1> Image channel: The image channel refers to a separate path in which digital image data is separated according to color type during transmission and processing. Common image channels include an R channel representing red data, a G channel representing green data, and a B channel representing blue data.

[0039] <2> MIPI DSI (Mobile Industry Processor Interface Display Serial Interface) protocol: The MIPI DSI protocol is a specification that defines the physical layer and data link layer of high-speed wired connection, and is used to transmit pixel data, synchronization signals, and control information between mobile device components such as display controllers and display screens.

[0040] <3> RGB image: RGB image is a kind of image format that decomposes and reconstructs digital images according to the way the human eye recognizes colors. It achieves this by splitting the color components of each pixel in an image into separate three primary color channels, namely the R channel representing red, the G channel representing green, and the B channel representing blue.

[0041] <4> Resolution: Resolution refers to the number of the smallest pixel units that can be displayed on an image or display surface, usually represented by the product of the number of horizontal pixels and the number of vertical pixels. The value represents the level of detail that the image or display can express.

[0042] <5> Refresh rate: Refresh rate refers to the number of times the entire screen content can be redrawn per second by the receiving device, usually measured in Hertz (Hz). Higher refresh rates can make dynamic images appear smoother and clearer.

[0043] <6> Color model: Color model defines and describes colors using mathematical expressions, aiming to accurately represent any color in a digital environment. Common color models include RGB color model and CMYK color model. In the RGB color model, red, green, and blue colors are used to mix other colors. In the CMYK color model, cyan, magenta, yellow, and black colors are used to mix other colors.

[0044] <7> Color space standard: Color space standard defines a universal coordinate system to locate and quantify colors, enabling standardized and consistent transmission and conversion of color information between different devices. Color space standard needs to specify the origin and reference of color positioning, as well as anisotropic processing methods and other details.

[0045] To facilitate understanding of the embodiments of the present application, first, a detailed description is given in conjunction with FIG. 1. FIG. 1 shows a flowchart of a display data low-power simplified transmission method according to an embodiment of the present application. The display data low-power simplified transmission method in the present embodiment mainly includes the following steps:

[0046] Step S11: Obtain image data to be sent.

[0047] In an embodiment of the present application, the image data to be transmitted comprises an RGB image. As shown in FIG. 2, a structure of an RGB image is shown in an embodiment of the present application. The structure comprises a packet header and a variable size payload. The payload comprises a plurality of bytes, each byte or 8 bits representing a pixel component of a pixel in the image. Each pixel comprises three bytes, representing red, green and blue channels respectively. Each image comprises a plurality of pixels, and only three pixels are shown in FIG. 2, each pixel occupying three bytes, and a total of nine bytes.

[0048] Step S12: based on the display mode of the receiving device, extracting one or more channel image information from the image data to be transmitted, and arranging the extracted channel image information in the order of extraction to generate a queue to be transmitted.

[0049] In an embodiment of the present application, the attributes of the display mode of the receiving device include one or more of the following: the type of display channel of the receiving device, the number of display channels of the receiving device, the display mode of the receiving device, the refresh rate of the receiving device, the color model of the receiving device, and the color space standard corresponding to the display channel of the receiving device.

[0050] Since the present application solves the problem in the prior art that when the receiving device receives a multi-channel image, if the number of channels required by the receiving device is less than the number of channels of the received multi-channel image, the other component data needs to be discarded, resulting in an increase in the transmission and decoding of invalid data, and unnecessary energy consumption. For different types of display channels, the corresponding information is extracted according to the characteristics of various channels. For example, for RGB multi-channel, the channel image information of red, green and blue channels can be extracted. The extraction operation extracts information according to the color representation characteristics of the receiving device to ensure that the extracted channel image information can accurately represent the corresponding color space, while avoiding the transmission of invalid data.

[0051] Exemplarily, in an application scenario of AR / VR, when the receiving device can only use single-channel data for display, a suitable color channel can be selected according to actual conditions. For example, when the transmission bandwidth is limited and it is necessary to reduce the amount of transmission data as much as possible, a single color channel, such as the green channel, can be selectively extracted. The reason for selecting the green channel is that, in an RGB image, the green channel contains the most luminance information, and can better preserve the overall brightness and contrast of the image. Compared with the red and blue channels, the green channel is also more sensitive to the visual perception of the human eye, and can better express the overall structure and details of the image. Therefore, in the case of limited transmission bandwidth, selecting to transmit the green channel alone can reduce the amount of transmission data to the greatest extent, reduce the transmission load, and improve the transmission efficiency while ensuring the image quality.

[0052] In an embodiment of the present application, the process of extracting a corresponding channel image information from the to-be-sent image data and arranging the extracted channel image information in an extraction order to generate a to-be-sent queue includes: correspondingly extracting the same kind of pixel data matching the display mode of the receiving device from the multi-channel image of the to-be-sent image data; recombining every N pixel elements as a group according to the original pixel size in the to-be-sent image data to generate a corresponding pixel block; and sequentially arranging the pixel blocks to generate the to-be-sent queue.

[0053] FIG. 3 shows a schematic diagram of the extraction process in the case of extracting only the same kind of channel image information from the to-be-sent image data in the embodiment. The upper part of the picture shows the original order of the data, which includes a packet header, a pixel data queue (R, G, B), and a packet footer. The bottom of the picture shows the pixel data queue after the green pixel channel (G) is extracted and reordered. When the receiving device receives the queue, only the data required by the receiving end needs to be collected. For example, if the receiving end only needs single-component data of the green channel, the method proposed in the embodiment combines the pixel components of 3 pixels into 1 pixel in RGB format. The embodiment helps to reduce the amount of data transmission, so that the link can remain in a low-power mode for a longer time.

[0054] In an embodiment of the present application, when the receiving device needs to analyze and identify the skin color, the red channel and green channel pixel components are extracted from the multi-channel image to highlight the features. In the case of extracting the same two channel image information from the to-be-sent image data, the forming process of the to-be-sent queue includes: correspondingly extracting the same first pixel data and second pixel data matching the display mode of the receiving device from the multi-channel image of the to-be-sent image data; recombining every N pixel data as a group to generate a corresponding pixel block according to the original pixel size in the to-be-sent image data; and arranging the pixel blocks in sequence to generate the to-be-sent queue.

[0055] Further, the forming process of the to-be-sent queue also includes: performing feature extraction on all the first pixel data and the second pixel data, and combining the first pixel data and the second pixel data based on the similarity or difference of the features to generate a pixel block queue.

[0056] In an embodiment of the present application, the optimization operation includes at least one of color adjustment and shape correction. Color adjustment aims to change the hue, saturation, brightness or color balance of the image by adjusting the pixel component data to achieve a more expected or more aesthetic visual effect. Shape correction improves the shape features of the image by operating on the pixel component data, such as smoothing edges, filling holes, removing noise or adjusting sizes, and the key technologies include edge smoothing, hole filling, noise removal and size adjustment.

[0057] It is worth noting that the data transmitted in the embodiment has not been compressed, but the front-end encoding method is used to filter out the channel components of the invalid multi-channel image to save bandwidth. The embodiment can maintain lossless transmission to completely preserve the image quality, while simplifying the decoding process, saving computing resources, and being suitable for real-time low-latency scenarios. The embodiment is particularly suitable for single-channel low-power devices, because low-power devices usually have limited computing power and are not suitable for performing complex compression / decompression algorithms, and the relatively narrow bandwidth may offset the compression benefits with the encoding and decoding overhead. In applications with high requirements for real-time performance, reliability and image fidelity, and relatively weak computing power of single-channel devices, directly transmitting raw image data can greatly improve the image quality.

[0058] In an embodiment of the present application, the process of packaging the to-be-sent queue in an uncompressed manner includes: packaging the to-be-sent queue with a data packet header and a data packet tail to generate a corresponding data packet; wherein the data packet header contains a virtual channel number, and when the virtual channel number is 3, it represents that the extracted single-channel image information in the to-be-sent queue.

[0059] In an embodiment of the present application, the MIPI DSI protocol is used for image data transmission. The MIPI DSI protocol is used to connect an application processor in a mobile device and a display receiving device, and to transfer display timing and image information through data packets. The protocol includes a high-speed mode and a low-power low-speed mode, which are respectively used for data transmission and energy saving. The MIPI DSI supports four video or image transmission methods. First, Packed Pixel Stream, 16-bit Format (data type 001110) is used for efficient image transmission in a 16-bit packed pixel stream mode, which is suitable for applications with high memory bandwidth requirements. Second, Packed Pixel Stream, 18-bit Format (data type 011110) packs consecutive pixel component data into a long data packet in accordance with an 18-bit format, which is suitable for scenarios requiring high image quality. Third, Pixel Stream, 18-bit Formation Three Bytes (data type 10) organizes data in three bytes, making processing more intuitive and suitable for clear transmission. Fourth, Packed Pixel Stream, 24-bit Format (data type 111110) represents each pixel by 24-bit data, which is an ideal choice for high-end displays or video playback. AR devices commonly use Micro LED-based display technology and adopt the fourth packet format (Packed Pixel Stream, 24-bit Format). In this format, each pixel includes red (R), green (G), and blue (B) colors, and each pixel component is represented by 8 bits. When the host sends monochrome video data or the receiving device only supports single-channel data, the host still needs to package according to the 24-bit encoding method. This will result in 16 bits of remaining data being invalid, and the receiving end will receive and discard these invalid data, thereby wasting transmission bandwidth and increasing power consumption.

[0060] Further, in the MIPI DSI protocol, data transmission uses the fourth Packed Pixel Stream, 24-bit Format, Long packet packet format described above. Among them, the virtual channel field in the metadata is used to indicate the type of data transmission. When the virtual channel is equal to 3, it means that monochrome image data and its corresponding data transmission format are being transmitted. Specifically, when the virtual channel is 3, the receiving end needs to do the following processing: parse the received data packet header, extract the value of the virtual channel, and judge whether it is 3. If the virtual channel is 3, it is identified that the current transmission is monochrome image data. According to the format of the monochrome image data, the corresponding processing algorithm is called to convert or decode the data. The processed monochrome image data is displayed or stored to ensure correct display of image information.

[0061] It should be noted that Packed Pixel Stream, 24-bit Format, Long packet means a data format for effectively transmitting or storing image data, in which a packed pixel stream encoding is adopted, each pixel uses a 24-bit format, and data is organized into long packets to improve data throughput.

[0062] Figure 4 shows a corresponding encoding mode in a Packed Pixel Stream, 24-bit Format, Long packet, Data Type = 111110 (3Eh) MIPI packet format according to an embodiment of the present application. After multiplexing the packet format, 24-bit data bits of each pixel are used to transmit 8-bit red, green or blue (R, G or B) data of three adjacent pixel components, respectively. When the image contains only green, the number of data bits is only one third of the standard MIPI transmission, which significantly improves the data transmission efficiency.

[0063] As shown in Figure 4, the above-mentioned packet contains a packet header, a variable size payload and a packet tail. In the embodiment, the packet header contains data type, virtual channel, word number and error correction code (ECC, Error Correction Code) for identifying the basic attributes of the packet and ensuring the integrity of the data. The payload part contains single-channel pixel data. In this structure, the data of the first nine pixels are packed together, and the single-channel color information (R, G or B) of each pixel is stored in the form of 8 bits. The size of this part is variable, and the specific size can be determined according to the image size of the number of pixels to be transmitted. The packet tail contains checksum and other necessary end information for verifying the integrity and correctness of the data. The checksum algorithm in the packet tail includes but is not limited to CRC cyclic redundancy check (Cyclic Redundancy Check), MD5, SHA-1, SHA-256 and other algorithms.

[0064] In an embodiment of the present application, the data packet tail contains a specific marker or check code for detecting whether the transmitted data packet is modified or damaged. The sending device adds a start and end marker before and after sending the data, and calculates the checksum or check code. The receiving device checks the marker after receiving the data packet, calculates the checksum and compares it with the original check code. If they are the same, the data packet passes the verification, otherwise the sending device is requested to resend the data packet. To ensure data reliability and timely find data damage or tampering.

[0065] In an embodiment of the present application, the process of packing the to-be-sent queue in uncompressed manner includes: packing an identification data structure with the to-be-sent queue; wherein the identification data structure contains two bytes, two low bits in the first byte are used to represent the extracted color channel, and the second byte contains the CRC value of the first byte.

[0066] In the embodiment, the Magic Data is used to realize the identification of the monochrome image and the data transmission format package. The identification data structure includes: first, the first byte is defined as Magic Data, which is not only used as a data type identifier, but also contains important information about the color channel. The low two bits of Magic Data are used to indicate the type of color channel: for example, 0b00 represents red (R), 0b01 represents green (G), and 0b10 represents blue (B). In addition, the second byte is used to store the CRC check value of the first byte. The main role of the CRC check value is to ensure that the data is not tampered or damaged during transmission, thereby improving the reliability of the data.

[0067] It should be noted that Magic Data is a special identification method for data transmission, which usually contains specific flag bits and check mechanisms to indicate the type of data and ensure the integrity of the data. In this way, the bit of a specific byte is used to transmit key information such as color channel, data type, etc., and the check value is used to verify the accuracy of the data, thereby improving the reliability of the transmission process.

[0068] Figure 5 shows the structure of the identification data of the Magic Data method in the embodiment. The leftmost square represents the color channel (Color Channel), which has a width of 1 byte (Byte), and the low two bits in the first byte are used to indicate the type of color channel (not shown). The right block represents the check value of the cyclic redundancy check, which contains a check value used to check the first byte at the receiving end. It should be noted that the green channel in Figure 5 is only used to explain the embodiment and is not limited. The identification data structure in the embodiment can also be used in red channel (R) and blue channel (B) and other types of channels.

[0069] Further, when the data transmission is completed, the receiving end receives the data, and first parses the first byte and the second byte. First, confirm whether the format of the first byte is as expected, that is, whether the lower two bits in the first byte contain the data format for indicating the color channel type, and at the same time verify the CRC value of the second byte. If both verifications pass, the receiving end system processes subsequent processing according to the parsing mode of monochrome data. Otherwise, the system will parse according to the standard protocol of MIPI DSI. The identification method of Magic Data is not only simple and clear, but also provides an efficient and reliable mechanism to process monochrome image data, which helps to reduce errors and improve the effectiveness of data transmission.

[0070] In an embodiment of the present application, the data packet header further includes control information for extracting the same channel, which is used to indicate the extraction type, packaging type, sending address, receiving address, data length and other information of the data packet, so that the network device can correctly process and forward the data packet. The data packet tail further includes verification information, which is used to ensure that the data packet is not damaged during transmission and to ensure the integrity of the data packet.

[0071] In an embodiment of the present application, the communication protocol standard available for sending the data packet includes any one of the MIPI DSI standard, the LVDS standard, the eDP standard, and the HDMI standard.

[0072] FIG. 6 shows a transmission waveform diagram of image data in the prior art. As shown in FIG. 6, when all pixels are transmitted, the transmission link remains in a high-speed state for a long time, which may cause a reduction in transmission efficiency. In order to improve the transmission efficiency, an embodiment of the present application shows a more efficient image data transmission method in FIG. 7. In an embodiment of the present application, when only the pixels required by the back end are transmitted, the high-speed state time of the transmission link when transmitting a row of data is greatly shortened. By reducing unnecessary data transmission, the present application effectively improves the transmission efficiency and saves transmission time and resource consumption. This optimized transmission method can be widely used in various application scenarios, bringing higher efficiency and performance improvement for image data transmission in sub-channels, especially single channels. Sub-channels refer to image data of a single channel or multiple channels extracted from original multi-channel data. The embodiment of the present application makes full use of the data transmission link, provides a more efficient transmission method under the condition of ensuring data integrity, and brings innovation and breakthrough to the field of image data transmission. This optimized transmission method not only improves the transmission efficiency, but also helps to reduce resource waste, providing better transmission experience and service for users.

[0073] It should be noted that the words "exemplary" and "for example" are used herein to mean "an example of" rather than "an ideal example" or "an ideal implementation." Any implementation having a technical effect provided herein is described herein as an "exemplary" or "for example" implementation, whether or not it is claimed. The words "exemplary" and "for example" are used herein to mean "an example of" rather than "an ideal example" or "an ideal implementation." Any implementation having a technical effect provided herein is described herein as an "exemplary" or "for example" implementation, whether or not it is claimed.

[0074] In the embodiments of the present application, "at least one" means one or more, and "multiple" means two or more. The "and / or" describes the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B, which can represent the cases of A alone, A and B together, and B alone, where A and B can be singular or plural. The character " / " generally represents an "or" relationship between the front and rear associated objects. "At least one of the following" or the like means any combination of these items, including any combination of single item or multiple items. For example, at least one of a, b or c can represent a, b, c, a-b, a-c, b-c or a-b-c, where a, b and c can be single or multiple.

[0075] FIG. 8 is a schematic block diagram of a display data low-power consumption simplified transmission device 800 provided by an embodiment of the present application. As shown in FIG. 8, the device includes a data acquisition module, a channel extraction module and a data packaging module.

[0076] The data acquisition module 801 is configured to acquire image data to be sent.

[0077] The channel extraction module 802 is configured to extract one or more channel image information corresponding to the display mode of a receiving device from the image data to be sent, and arrange the extracted channel image information in an extraction order to generate a sending queue.

[0078] The data packaging module 803 is configured to package the sending queue in a preset manner to form a corresponding data packet and send the data packet outward.

[0079] It should be understood that the specific process of each module performing the above corresponding steps has been described in detail in the above method embodiments, and thus will not be described here again for the sake of brevity.

[0080] It should also be understood that the division of the modules in the embodiments of the present application is illustrative, and is only a logical functional division. In actual implementation, another division mode can be used. In addition, each functional module in each embodiment of the present application can be integrated in one processor, or can be physically separated, or two or more modules can be integrated in one module. The integrated module can be realized in the form of hardware or in the form of a software functional module.

[0081] FIG. 9 is a schematic block diagram of an electronic terminal according to an embodiment of the present application. As shown in FIG. 9, the electronic terminal includes at least one processor 901, a memory 902, at least one network interface 903, and a user interface 905. The various components in the apparatus are coupled together by a bus system 904. It can be understood that the bus system 904 is used for realizing the connection communication between the components. The bus system 904 includes a data bus, a power bus, a control bus, and a status signal bus in addition to the data bus. However, for the purpose of clarity, all the buses are marked as the bus system in FIG. 9.

[0082] The user interface 905 can include a display, a keyboard, a mouse, a trackball, a click gun, a key, a button, a touchpad, or a touch screen, etc.

[0083] It can be understood that the memory 902 can be a volatile memory or a non-volatile memory, and can also include both volatile and non-volatile memories. The non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), which is used as an external cache. By way of example but not limitation, many forms of RAM can be used, such as static random access memory (SRAM), synchronous static random access memory (SSRAM). The memory described in the embodiments of the present application is intended to include but not limited to these and any other suitable categories of memory.

[0084] The memory 902 in the embodiments of the present application is used to store various categories of data to support the operation of the electronic terminal 900. Examples of these data include any executable programs for operating on the electronic terminal 900, such as an operating system 9021 and an application program 9022. The operating system 9021 contains various system programs, such as a framework layer, a core library layer, a driver layer, etc., for implementing various basic services and processing hardware-based tasks. The application program 9022 can contain various application programs, such as a media player (Media Player), a browser (Browser), etc., for implementing various application services. The display data low-power consumption simplified transmission method provided by the embodiments of the present application can be included in the application program 9022.

[0085] The method disclosed in the embodiments of the present application can be applied to the processor 901 or implemented by the processor 901. The processor 901 can be an integrated circuit chip having a signal processing capability. In the implementation process, each step of the above method can be completed by an integrated logic circuit or an instruction in a software form of the hardware in the processor 901. The processor 901 can be a general-purpose processor, a digital signal processor (DSP), or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, etc. The processor 901 can implement or execute the disclosed methods, steps and logic block diagrams in the embodiments of the present application. The general-purpose processor 901 can be a microprocessor or any conventional processor, etc. In combination with the steps of the accessory optimization method provided in the embodiments of the present application, the steps can be directly embodied as a hardware decoding processor for execution, or a combination of hardware and software modules in the decoding processor for execution. The software module can be located in a storage medium in the memory, and the processor reads the information in the memory and combines the hardware to complete the steps of the foregoing method.

[0086] In the exemplary embodiments, the electronic terminal 900 can be one or more application specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), or the like for executing the foregoing method.

[0087] According to the method provided in the embodiments of the present application, the present application further provides a computer program product, which includes computer program codes, and when the computer program codes run on a computer, the computer executes the display data low-power consumption simplified transmission method in any one of the above-mentioned embodiments.

[0088] According to the method provided in the embodiments of the present application, the present application further provides a computer readable storage medium, which stores program codes, and when the program codes run on a computer, the computer executes the display data low-power consumption simplified transmission method in any one of the above-mentioned embodiments.

[0089] As used in this description, the terms "component," "module," "system," and the like are intended to refer to a computer-related entity, either hardware, firmware, a combination of hardware and software, software, or software in execution. For example, a component can be, but is not limited to being, a process running on a processor, a processor, an object, an executable, a thread of execution, a program, and / or a computer. By way of illustration, both an application running on a computing device and the computing device can be a component. One or more components can reside within a process and / or thread of execution and a component can be localized, partially localized, and / or distributed across two or more computers. Also, these components can execute from various computer readable media having various data structures stored thereon. The components can communicate by way of local and / or remote processes such as in accordance with a signal having one or more data packets (e.g., data from one component interacting with another component in a local system, distributed system, and / or across a network such as the Internet with other systems via the signal).

[0090] Those of skill in the art would understand that the various illustrative logical blocks, modules, and steps described in connection with the embodiments disclosed herein can be implemented as electronic hardware, or a combination of computer software and electronic hardware. The choice of hardware and software would depend on the particular application and general purpose nature of the technical solution. Those skilled in the art would be able to make such a choice using their general knowledge and the teachings of the present application.

[0091] Those of skill in the art would understand that, for the described convenience and brevity, the specific working processes of the above-described system, device and unit can refer to the corresponding processes in the foregoing method embodiments, which will not be described here.

[0092] In several embodiments provided in the present application, it should be understood that the disclosed system, device and method can be implemented in other ways. For example, the above-described device embodiments are only schematic, for example, the division of units is only a logical function division, and actual implementation can have another division manner, for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the shown or discussed mutual entities can be indirect coupling or communication connection through some interfaces, devices or units, and can be electrical, mechanical or other forms.

[0093] The units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, i.e., may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.

[0094] In addition, each functional unit in each embodiment of the present application can be integrated into one processing unit, or each unit can exist physically, or two or more units can be integrated into one unit.

[0095] In the above embodiments, the functions of each functional unit can be implemented by software, hardware, firmware, or any combination thereof, in whole or in part. When implemented by software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions (programs). When the computer program instructions (programs) are loaded and executed on a computer, they produce the processes or functions according to the embodiments of the present application in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. Computer instructions can be stored in a computer-readable storage medium or transferred from one computer-readable storage medium to another, for example, computer instructions can be transferred from one website, computer, server or data center to another website, computer, server or data center through wired (such as coaxial cable, optical fiber, digital subscriber line (Digital Subscriber Line, DSL)) or wireless (such as infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that the computer can access or a data storage device such as a server, data center, etc. that includes one or more available media sets. The available media can be magnetic media (for example, floppy disk, hard disk, magnetic tape), optical media (for example, high-density digital video disc (Digital Video Disc, DVD), or semiconductor media (for example, solid state disk (Solid State Disk, SSD) and the like.

[0096] If the functions are implemented in the form of software function units and sold or used as independent products, they can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application can be embodied in the form of a software product, which is stored in a storage medium and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the embodiments of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various media that can store program codes.

[0097] The above merely illustrates the specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or replacements within the technical scope disclosed by the present application, which should be covered by the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

[0098] In summary, the present application provides a display data low-power consumption simplified transmission method, device, medium, program product and terminal, and provides a method for improving the low-power consumption simplified transmission efficiency of display data. The method comprises: obtaining to-be-sent image data, extracting one or more channel image information of the same kind from the data according to a display mode of a receiving device, arranging the channel image information in an extraction order to form a to-be-sent queue, and finally packaging the to-be-sent queue into a data packet in a preset manner and sending the data packet. The present application improves the flexibility of channel image information extraction, and users can select a single channel or multiple channels according to requirements. Meanwhile, the transmission efficiency is improved by arranging the channel image information in the extraction order, and the integrity and accuracy of the data are ensured by the preset packaging manner. The present application is based on the existing MIPI interface and protocol, and in the process of encoding, transmission and decoding at the front end of the sending side and the back end, the selective data extraction and low-bandwidth mode are adopted to realize efficient and low-power consumption image data transmission, and meet the requirements of wearable devices such as AR, VR glasses and headsets.

[0099] The above embodiments only exemplarily illustrate the principles and effects of the present application, and are not used to limit the present application. Any person skilled in the art can modify or change the above embodiments without departing from the spirit and scope of the present application. Therefore, all equivalent modifications or changes made by those skilled in the art without departing from the spirit and technical thought disclosed by the present application should be covered by the claims of the present application.

Claims

1. A method for low power simplified transmission of display data, characterized in that, The method comprises: acquiring image data to be sent; extracting one or more kinds of channel image information corresponding to the image data to be sent based on a display mode of a receiving device, and arranging the extracted channel image information in an extraction order to generate a sending queue; packaging the sending queue in a preset manner to form a corresponding data packet and sending the data packet.

2. The method of claim 1, wherein, The process of extracting one kind of channel image information corresponding to the image data to be sent and arranging the extracted channel image information in an extraction order to generate a sending queue comprises: correspondingly extracting the same kind of pixel data matching the display mode of the receiving device from the multi-channel image of the image data to be sent; recombining every N pixel data as a group according to the original pixel size in the image data to be sent to generate a corresponding pixel block; sequentially arranging the pixel blocks to generate the sending queue.

3. The method of claim 1, wherein, The process of packaging the sending queue in a preset manner comprises packaging the sending queue in an uncompressed manner.

4. The method of claim 3, wherein, The process of packaging the sending queue in an uncompressed manner comprises packaging the sending queue, a data packet header and a data packet tail in an uncompressed manner to generate a corresponding data packet.

5. The method of claim 4, wherein, The data packet header contains a virtual channel number, and it is determined whether the virtual channel number is 3. If yes, it is identified that the channel image information extracted in the sending queue is single-channel image information.

6. The method of claim 3, wherein, The process of packaging the sending queue in an uncompressed manner comprises packaging an identification data structure and the sending queue in an uncompressed manner to generate a sending queue. The identification data structure contains a first byte and a second byte.

7. The method of claim 6, wherein, Two low-bit bits in the first byte are used to represent the extracted color channel, and the second byte contains a CRC value of the first byte.

8. The method of claim 7, wherein, After the sending queue is packaged in a preset manner to form a corresponding data packet and sent, the receiving device receives the data packet, verifies the first byte and the second byte, analyzes the data packet based on the color channel in the first byte if the first byte and the second byte pass the verification, and analyzes the data packet according to a standard protocol if the first byte or the second byte fails to pass the verification.

9. The method of claim 4, wherein, The data packet header comprises at least one of a data type, a virtual channel, a word number and an error check code.

10. The method of claim 4, wherein, The data packet tail contains any one of the following checksum algorithms: a CRC cyclic redundancy check algorithm, an MD5 algorithm, an SHA-1 algorithm and an SHA-256 algorithm.

11. The method of claim 1, wherein, The process of extracting multiple kinds of channel image information corresponding to the image data to be sent and arranging the extracted channel image information in an extraction order to generate a sending queue comprises: correspondingly extracting first pixel data and second pixel data matching the display mode of the receiving device from the multi-channel image of the image data to be sent; recombining every N pixel data as a group according to the original pixel size in the image data to be sent to generate a corresponding pixel block; The pixel blocks are sequentially arranged to generate the to-be-sent queue.

12. The method of claim 11, wherein, The process of generating the to-be-sent queue further includes: feature extraction is performed on all the first pixel data and the second pixel data, and the first pixel data and the second pixel data are combined based on the similarity or difference of the features to generate a pixel block queue, and then an optimization operation is performed on the pixel block queue to generate the to-be-sent queue.

13. The method of claim 12, wherein, The optimization operation includes at least one of color adjustment and shape correction.

14. The method of claim 1-13, wherein, The attribute of the display mode of the receiving device includes one or more of the following: the type of the display channel of the receiving device, the number of the display channel of the receiving device, the resolution of the receiving device, the refresh rate of the receiving device, the color model of the receiving device, and the color space standard corresponding to the display channel of the receiving device.

15. The display data low-power simplified transmission method according to any one of claims 1-13, characterized in that, The communication protocol standard available for sending the data packet includes any one of the following standards: MIPIDSI, LVDS, eDP, and HDMI; And / or, the to-be-sent image data includes an RGB image.

16. The method of claim 15, wherein, When the MIPIDSI standard is used, the process of packing the to-be-sent queue in a preset manner includes packing the to-be-sent queue in a packing pixel stream, 24-bit format, and long data packet packing manner.

17. A low-power simplified data transmission device for display, characterized in that, including: a data acquisition module configured to acquire to-be-sent image data; a channel extraction module configured to extract one or more channel image information corresponding to the display mode of the receiving device from the to-be-sent image data, and arrange the extracted channel image information in a to-be-sent queue according to the extraction order; a data packing module configured to pack the to-be-sent queue in a preset manner to form a corresponding data packet and send it out.

18. A computer readable storage medium having stored thereon a computer program, characterized in that, The computer program is executed by the processor to implement the display data low-power simplified transmission method of any one of claims 1-16.

19. A computer program product, characterised in that, The computer program product includes computer program code, which, when executed on a computer, causes the computer to implement the display data low-power simplified transmission method of any one of claims 1-16.

20. An electronic terminal comprising a memory, a processor and a computer program stored on the memory, characterized in that The processor executes the computer program to implement the display data low-power simplified transmission method of any one of claims 1-16.

Images