Display method and device for ink screen equipment, computing equipment and storage medium

Abstract

The invention provides a display method for ink screen equipment, a display device for the ink screen equipment, computing equipment and a computer readable storage medium, and the method comprises the steps: synthesizing a first image and a second image, the first image and the second image being two frames of images which are adjacent front and back; preprocessing the first image and the second image to respectively obtain a first grayscale image and a second grayscale image; compressing the first grayscale image and the second grayscale image into a driving waveform result image according to the driving waveform two-dimensional table; and refreshing the display content according to the driving waveform result image. According to the application, the power consumption of the ink screen in a dynamic scene can be reduced, and the low power consumption advantage of the ink screen is further improved.

Description

Technical Field

[0001] This application relates to the field of display technologies, and particularly to a display method for an e-ink screen device, a display device for an e-ink screen device, a computing device, and a computer-readable storage medium. Background Art

[0002] In this field, there is e-ink screen technology applicable to dynamic scenarios (such as watching videos, browsing the web, etc.). E-ink screens are popular among users due to their unique advantages such as eye protection and low power consumption, which has led to the gradual popularization of electronic products with e-ink screens from simple readers to smartphones, tablets, laptops, etc. with more application scenarios. In electronic products with richer application scenarios, e-ink screens often need to display dynamic images. However, during the process of displaying dynamic images, the power consumption advantage of e-ink screens significantly decreases, hindering the further widespread application of e-ink screens. Therefore, how to reduce the power consumption of e-ink screens in dynamic scenarios according to the characteristics of e-ink screens is an urgent problem to be solved in this field. Summary of the Invention

[0003] To this end, this application is committed to providing a display method for an e-ink screen device, a display device for an e-ink screen device, a computing device, and a computer-readable storage medium, which can reduce the power consumption in dynamic scenarios and further highlight the low-power advantage of e-ink screens.

[0004] In one aspect, this application provides a display method for an e-ink screen device, including: synthesizing a first image and a second image, where the first image and the second image are two adjacent frames of images; preprocessing the first image and the second image to obtain a first grayscale image and a second grayscale image respectively; compressing the first grayscale image and the second grayscale image into a driving waveform result image according to a driving waveform two-dimensional table; and refreshing the display content according to the driving waveform result image.

[0005] According to this aspect, the driving waveform two-dimensional table has fewer dimensions than the driving waveform multi-dimensional table, so it requires fewer query steps. Determining the driving waveform by querying the driving waveform two-dimensional table significantly improves the table lookup speed and reduces the computing load of the driving waveform compared with directly querying the driving waveform multi-dimensional table, which is beneficial to improving the battery life of the e-ink screen device.

[0006] In a particular embodiment of this application, before compressing the first grayscale image and the second grayscale image into a driving waveform result image according to the driving waveform two-dimensional table, the method further includes: performing a localization process on the driving waveform multi-dimensional table to generate the driving waveform two-dimensional table.

[0007] According to this embodiment, by localizing the multidimensional table of the driving waveform to generate a two-dimensional table of the driving waveform with fewer dimensions, it is beneficial to utilize the original multidimensional table and simplify it to make the process of querying the driving waveform more concise, thereby improving query efficiency and improving power consumption performance.

[0008] In a particular embodiment of the present application, a multidimensional table of a driving waveform includes a first dimension, a second dimension and a third dimension, the first dimension includes a first grayscale value dimension represented by the grayscale values ​​of pixels of a first grayscale image, and the second dimension includes a second grayscale value dimension represented by the grayscale values ​​of pixels of a second grayscale image; the multidimensional table of the driving waveform is localized to generate a two-dimensional table of the driving waveform, including: determining a value of the third dimension; wherein the third dimension includes a temperature dimension or a frame number dimension; and localizing the multidimensional table of the driving waveform into a two-dimensional table of the driving waveform.

[0009] According to this embodiment, by determining the value of the third dimension in the driving waveform multidimensional table in advance, the table lookup time of this dimension can be reduced, thereby converting the query process of the driving waveform multidimensional table into a query process of a two-dimensional table, greatly improving the query efficiency.

[0010] In a particular embodiment of the present application, a multidimensional table of driving waveforms includes a four-dimensional table of driving waveforms, and the four-dimensional table of driving waveforms includes a first dimension, a second dimension, a temperature dimension, and a frame number dimension; the multidimensional table of driving waveforms is localized to generate a two-dimensional table of driving waveforms, including: determining the values ​​of the temperature dimension and the frame number dimension of the four-dimensional table of driving waveforms according to the temperature of the ink screen and the driving waveform, thereby obtaining the two-dimensional table of driving waveforms through query.

[0011] According to this embodiment, the values ​​of the temperature dimension and the frame number dimension are values ​​that are easy to determine in advance, and these two values ​​will not change within a period of time. Therefore, there is no need to query the temperature dimension and the frame number dimension every time the driving waveform is refreshed and queried. Instead, the values ​​of the temperature and the frame number are directly determined, so that the query process of the four-dimensional table is reduced to the query process of the two-dimensional table. The driving waveform can be queried according to the grayscale value, which greatly improves the query efficiency of the driving waveform and reduces the power consumption and load during the driving process.

[0012] In a special embodiment of the present application, the first grayscale image and the second grayscale image are compressed into a driving waveform result image according to a two-dimensional table of driving waveforms, including: merging the first grayscale value of each pixel of the first grayscale image with the second grayscale value of the pixel at the corresponding position of the second grayscale image into a third grayscale value, and the third grayscale value of each pixel constitutes a differential image; and traversing the differential image using the two-dimensional table of driving waveforms to obtain a driving waveform result image.

[0013] According to this embodiment, by merging the first grayscale image and the second grayscale image into a differential image, it is beneficial to accelerate the query process for the two-dimensional table of the driving waveform.

[0014] In a particular embodiment of the present application, merging the first grayscale value of each pixel of the first grayscale image with the second grayscale value of the pixel at the corresponding position of the second grayscale image into a third grayscale value includes: merging the first grayscale value with the first number of bits of each pixel of the first grayscale image and the second grayscale value with the second number of bits of the pixel at the corresponding position of the second grayscale image into a third grayscale value with the third number of bits, where the third number of bits is the sum of the first number of bits and the second number of bits.

[0015] According to this embodiment, by directly merging the pixel values of the first grayscale image and the second grayscale image into a grayscale value with a larger number of bits, it is beneficial to accelerate the merging process while retaining the pixel value information of the first grayscale image and the second grayscale image without losing any useful information.

[0016] In a particular embodiment of the present application, compressing the first grayscale image and the second grayscale image into a driving waveform result image according to the two-dimensional table of the driving waveform includes: querying the first grayscale value dimension and the second grayscale value dimension of the two-dimensional table of the driving waveform according to the grayscale value of each pixel of the first grayscale image and the grayscale value of the pixel at the corresponding position of the second grayscale image to obtain the driving waveform result; where the driving waveform results corresponding to each pixel constitute the driving waveform result image.

[0017] According to this embodiment, querying the grayscale value dimension of the two-dimensional table according to the grayscale value is beneficial to determining the driving waveform result in a relatively simple manner, thereby accelerating the driving process.

[0018] In a particular embodiment of the present application, synthesizing the first image and the second image includes: determining the drawing frequency and the synthesis frequency according to the driving waveform mode of the ink screen; respectively drawing the layers of the first image and the layers of the second image according to the drawing frequency; and respectively synthesizing the layers of the first image and the layers of the second image according to the synthesis frequency to obtain the first image and the second image.

[0019] According to this embodiment, by determining the drawing frequency and the synthesis frequency according to the driving waveform mode, it is beneficial to formulate a reasonable drawing frequency and synthesis frequency according to the refresh characteristics of the ink screen, and avoid redundant images that are not used for display due to too high drawing and synthesis frequencies, resulting in increased power consumption.

[0020] In a particular embodiment of the present application, determining the drawing frequency and the synthesis frequency according to the driving waveform pattern of the ink screen includes: converting the hardware vertical synchronization signal sent by the ink screen into a software vertical synchronization signal; sending the software vertical synchronization signal to the drawing frequency thread and the synthesis frequency thread respectively; the drawing frequency thread converting the frequency of the software vertical synchronization signal into the drawing frequency according to the driving waveform pattern; and the synthesis frequency thread converting the frequency of the software vertical synchronization signal into the synthesis frequency according to the driving waveform pattern.

[0021] According to this embodiment, by controlling the drawing frequency and the synthesis frequency during the process of converting the software vertical synchronization signal into the drawing frequency signal and the synthesis frequency signal, it is beneficial to simplify the frequency control process, and as much as possible utilize the existing code and threads to implement the function addition, thereby reducing the modification cost and improving the cost-effectiveness.

[0022] In a particular embodiment of the present application, the preprocessing step and the compression step of the method are alternately executed in the first buffer and the second buffer, where the first buffer executes the preprocessing step for the first image and the second image, and the second buffer executes the compression step for the first image and the second image. When the compression step of the second buffer is completed and the preprocessing step of the first buffer is being executed, the first buffer and the second buffer are exchanged, and the second buffer executes the preprocessing step for the third image and the fourth image after the first image and the second image. When the preprocessing step of the first buffer for the first image and the second image is completed, the first buffer executes the compression step for the third image and the fourth image.

[0023] According to this embodiment, through the alternation of the first buffer and the second buffer, the preprocessing algorithm task and other tasks can be completed separately by the two buffers and then cycle alternately, avoiding the phenomenon that other tasks must wait for the preprocessing algorithm task to be completed before starting, which is beneficial to improving the operation speed and avoiding phenomena such as frame freezing.

[0024] On the other hand, the present application provides a display device for an ink screen device, including: a synthesis module for synthesizing a first image and a second image, where the first image and the second image are two adjacent frames of images; a preprocessing module for preprocessing the first image and the second image to obtain a first grayscale image and a second grayscale image respectively; a compression module for compressing the first grayscale image and the second grayscale image into a driving waveform result image according to the two-dimensional driving waveform table; and a refreshing module for refreshing the display content according to the driving waveform result image.

[0025] In a particular embodiment of the present application, before compressing the first grayscale image and the second grayscale image into a drive waveform result image according to the drive waveform two-dimensional table, the device further includes: a localization module configured to localize the drive waveform multi-dimensional table to generate a drive waveform two-dimensional table.

[0026] In a particular embodiment of the present application, the drive waveform multi-dimensional table includes a first dimension, a second dimension, and a third dimension. The first dimension includes a first grayscale value dimension represented by the grayscale values of the pixel points of the first grayscale image, and the second dimension includes a second grayscale value dimension represented by the grayscale values of the pixel points of the second grayscale image; the localization module is further configured to: determine the value of the third dimension; wherein the third dimension includes a temperature dimension or a frame number dimension; localize the drive waveform multi-dimensional table into a drive waveform two-dimensional table.

[0027] In a particular embodiment of the present application, the drive waveform multi-dimensional table includes a drive waveform four-dimensional table, and the drive waveform four-dimensional table includes a first dimension, a second dimension, a temperature dimension, and a frame number dimension; the localization module is further configured to: determine the values of the temperature dimension and the frame number dimension of the drive waveform four-dimensional table according to the temperature of the ink screen and the drive waveform, so as to query and obtain the drive waveform two-dimensional table.

[0028] In a particular embodiment of the present application, the compression module is further configured to: combine the first grayscale value of each pixel of the first grayscale image with the second grayscale value of the pixel at the corresponding position of the second grayscale image into a third grayscale value, and the third grayscale values of each pixel form a differential image; traverse the differential image using the drive waveform two-dimensional table to obtain the drive waveform result image.

[0029] In a particular embodiment of the present application, the compression module is further configured to: combine the first grayscale value with the first number of bits of each pixel of the first grayscale image and the second grayscale value with the second number of bits of the pixel at the corresponding position of the second grayscale image into a third grayscale value with the third number of bits, and the third number of bits is the sum of the first number of bits and the second number of bits.

[0030] In a particular embodiment of the present application, the compression module is further configured to: query the first grayscale value dimension and the second grayscale value dimension of the drive waveform two-dimensional table according to the grayscale value of each pixel of the first grayscale image and the grayscale value of the pixel at the corresponding position of the second grayscale image to obtain the drive waveform result; wherein, the drive waveform results corresponding to each pixel form the drive waveform result image.

[0031] In a particular embodiment of the present application, the synthesis module is further configured to: determine a drawing frequency and a synthesis frequency according to the driving waveform mode of the ink screen; draw the layers of the first image and the layers of the second image respectively according to the drawing frequency; and synthesize the layers of the first image and the layers of the second image respectively according to the synthesis frequency to obtain the first image and the second image.

[0032] In a particular embodiment of the present application, the synthesis module is further configured to: convert the hardware vertical synchronization signal sent by the ink screen into a software vertical synchronization signal; send the software vertical synchronization signal to the drawing frequency thread and the synthesis frequency thread respectively; the drawing frequency thread converts the frequency of the software vertical synchronization signal into a drawing frequency according to the driving waveform mode; and the synthesis frequency thread converts the frequency of the software vertical synchronization signal into a synthesis frequency according to the driving waveform mode.

[0033] In a particular embodiment of the present application, the preprocessing module and the compression module of the device are alternately implemented in a first buffer and a second buffer, where the first buffer implements the preprocessing module for the first image and the second image, and the second buffer implements the compression module for the first image and the second image. When the work of the compression module in the second buffer is completed and the work of the preprocessing module in the first buffer is being executed, the first buffer and the second buffer are exchanged, and the second buffer implements the preprocessing module for the second image and the third image. When the work of the preprocessing module for the first image and the second image in the first buffer is completed, the first buffer implements the compression module for the second image and the third image.

[0034] On the other hand, the present application provides a computing device, which includes an ink screen, a processor, and a memory. The ink screen, the processor, and the memory communicate with each other, and the processor is configured to execute a computer program stored in the memory to implement the above-mentioned display method for an ink screen device.

[0035] On the other hand, the present application provides a computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program, and the computer program is used to execute the above-mentioned display method for an ink screen device.

[0036] On the other hand, the present application provides a computer program product, including program code. When the computer runs the computer program product, the computer is enabled to implement the above-mentioned display method for an ink screen device.

[0037] Any of the above-mentioned devices, computing devices, computer-readable storage media, or computer program products provided are all used to execute the display method for an ink screen device provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects of the corresponding solutions in the corresponding methods provided above, and will not be elaborated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Hereinafter, specific embodiments of the present application will be described in detail with reference to the accompanying drawings, where:

[0039] Figure 1 It shows a schematic architecture diagram of a display method for an e-ink screen device according to an embodiment of the present application;

[0040] Figure 2 It shows according to Figure 1 A schematic diagram of the data conversion process in the display method for an e-ink screen device corresponding to the embodiment;

[0041] Figure 3 It shows a schematic application scenario diagram of a display method for an e-ink screen device according to another embodiment of the present application;

[0042] Figure 4 It shows a schematic flowchart of a display method for an e-ink screen device according to another embodiment of the present application;

[0043] Figure 5 It shows a schematic flowchart of a display method for an e-ink screen device according to another embodiment of the present application;

[0044] Figure 6 It shows a schematic structural diagram of a display device for an e-ink screen device according to an embodiment of the present application;

[0045] Figure 7 It shows a schematic structural diagram of a computing device according to an embodiment of the present application. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0046] In order to enable those skilled in the art to more clearly understand the concepts and ideas of the present application, the present application will be described in detail below with reference to specific embodiments. It should be understood that the embodiments given herein are only a part of all possible embodiments of the present application. After reading the specification of the present application, those skilled in the art are capable of making improvements, modifications, or substitutions to part or all of the following embodiments, and these improvements, modifications, or substitutions are also included within the scope of protection required by the present application.

[0047] In this text, the terms "a", "an" and other similar words do not mean that there is only one such thing, but rather that the relevant description is only for one of such things, and such things may have one or more. In this text, the terms "comprise", "include" and other similar words are intended to represent a logical relationship, and should not be regarded as representing a spatial structure relationship. For example, "A comprises B" is intended to mean that logically B belongs to A, rather than meaning that B is located inside A spatially. Additionally, the meanings of the terms "comprise", "include" and other similar words should be regarded as open-ended rather than closed. For example, "A comprises B" is intended to mean that B belongs to A, but B does not necessarily constitute the whole of A, and A may also include other elements such as C, D, E, etc.

[0048] In this text, the terms "first", "second" and other similar words do not mean to imply any order, quantity or importance, but are only used to distinguish different elements. In this text, the terms "embodiment", "the present embodiment", "an embodiment", "one embodiment" do not mean that the relevant description only applies to a specific embodiment, but rather that these descriptions may also apply to one or more other embodiments. Those skilled in the art should understand that in this text, any description made for one embodiment can be substituted, combined, or otherwise combined with the relevant descriptions in one or more other embodiments, and the new embodiments generated by such substitution, combination, or other combination are easily conceivable by those skilled in the art and fall within the protection scope of this application.

[0049] In various embodiments of this application, display technology may refer to a technology that uses appropriate methods to change the intensity, wavelength and other characteristics of light to form different forms of visual information. Common display technologies include liquid crystal display technology, plasma display technology, e-ink display technology, etc.

[0050] In various embodiments of the present application, an e-ink screen may refer to a display screen made using the principle of electrophoresis of electronic ink. Compared with liquid crystal display screens, e-ink screens have some unique advantages, such as ultra-low power consumption, wide viewing angles, no glare, etc., and are therefore widely used in fields such as e-book readers, smart watches, and electronic tags. An e-ink screen is a screen that uses electronic ink. The e-ink screen consists of two substrates, coated with an electronic ink composed of countless tiny transparent particles. The particles are formed by sealing many black and white particles with positive / negative charges inside liquid microcapsules. Different colored charged particles will move in different directions due to different applied electric fields, presenting black or white effects on the surface of the display screen. The display material of the e-ink screen is electronic ink. These electronic inks are in a capsule structure, and inks of different colors are attached to positive and negative charges. After being powered on, through positive and negative voltages, the charges carrying inks of different colors attract or repel each other, changing the arrangement of the charges to display text and pictures.

[0051] For e-ink screen devices equipped with intelligent operating systems, the battery life is greatly challenged. At the same time, on intelligent operating systems, more user scenarios and demands are generated for e-ink screen products, such as browsing the web, watching videos, and handwritten notes. Although the dynamic scenarios brought by the intelligent system account for a low proportion of the duration, the power consumption data is significant. Therefore, effective means are urgently needed to reduce the power consumption of dynamic scenarios.

[0052] Some embodiments of the present application reduce the operating load of the CPU by optimizing the synthesis display process, reducing redundant rendering, and reducing memory copying, aiming to solve the power consumption problem of dynamic scenarios on e-ink screens and greatly improve the battery life of e-ink screen products. Some embodiments of the present application focus on e-ink screen products, greatly reducing the CPU load and the overall power consumption in dynamic scenarios, and strongly improving the battery life of the products, having obvious advantages in the battery life of e-ink screens, which belongs to a method of process streamlining. At the same time, the adaptive vertical synchronization technology in some embodiments of the present application can better manage the problems of redundant rendering and synthesis of the screen. In addition, during the high-low order conversion process of RGBA, through the compression of front and back frame information and the localization of the conversion table, memory continuity can be achieved, reducing memory copying and the amount of memory used.

[0053] In some examples, by performing invalid drive frame deletion processing on the longest valid sequence length, the time consumed by invalid drive frames when driving the e-ink screen is reduced, and the screen update speed of the e-ink screen is increased to optimize the user experience. In contrast, some embodiments of the present application mainly aim at the software level to achieve the purpose of reducing the load and increasing the speed in dynamic scenarios by removing redundant rendering / synthesis processes and streamlining processes. It is implemented at a relatively upper layer and does not judge and streamline the frame sending to the drive layer.

[0054] In some other examples, according to the change speed of the screen within a statistically preset duration, the area information of the change area of each application window in the screen to be displayed on the e-ink screen is obtained, and the union coverage area of the change areas is confirmed according to the area information to determine whether the screen may change. If so, the refresh rate is increased; if not, the refresh speed is decreased. In contrast, some embodiments of the present application are implemented by reducing the load, without judging the screen and without the need for a judgment algorithm, and have better generality.

[0055] In another technology in this field, by quickly correcting the temperature LUT (look-up-table), the driving waveform is made more concise, so that the refresh is faster, mainly for the stylus scenario. In contrast, some embodiments of the present application mainly aim at the software level to achieve the purpose of reducing the load and increasing the speed in the dynamic scenario by removing redundant drawing / synthesis processes and streamlining the processes. It is implemented at a relatively upper layer and does not correct the LUT table, and the content of the table itself will not be modified.

[0056] Figure 1 Fig. shows a schematic architecture diagram of a display method for an e-ink screen device according to an embodiment of the present application.

[0057] As Figure 1 shown, in an electronic device using an e-ink screen, a synthesis module synthesizes two frames of images for display, namely a first image and a second image. The first image and the second image can be color images, for example, including four color channels of RGBA, and the pixel value of each channel is represented by an 8-bit number, that is, the color range is 0 to 255. Among them, the first image can be an old image, and the second image can be a new image used to replace the old image when the screen is refreshed. Through a preprocessing algorithm, the first image and the second image are respectively converted into a first grayscale image and a second grayscale image. The first grayscale image and the second grayscale image can be images with grayscale values and no color channels, where the grayscale value is represented by a 4-bit number, that is, the grayscale range is 0 to 15. On the other hand, a driving waveform multi-dimensional table is stored in the e-ink screen device. Through localization processing, the driving waveform multi-dimensional table is converted into a driving waveform two-dimensional table. By querying the driving waveform two-dimensional table, the first grayscale image and the second grayscale image can be compressed into a driving waveform result image. The pixel value of the driving waveform result image can be 0, 1, or 2, which respectively represent different driving voltage change modes. For example, 0 represents no voltage change, 1 represents applying a positive voltage, and 2 represents applying a negative voltage (those skilled in the art should understand that other methods of representing voltage change modes can also be conceived, and the corresponding relationship here is only an example). According to the driving waveform result image, the e-ink screen can drive each of its pixels to cause corresponding voltage changes, so as to display the corresponding image.

[0058] In this embodiment, the preprocessing algorithm can be a dither algorithm or other algorithms for converting a color image into a grayscale image. The dither algorithm can refer to introducing some noise into the image and dispersing the color error to nearby pixels in a certain way, so that more colors can be visually simulated. For example, a region composed of a certain proportion of black and white dots can be used to represent grayscale or color, so that the overall image has a sense of grayscale or color. For example, the pixel values of the pixels of a color image can be converted into the pixel values of a grayscale image through the dither algorithm.

[0059] In this embodiment, the driving waveform can refer to the fluctuation shape of the driving voltage change of the e-ink screen. For example, when controlling the display pattern of the e-ink screen, the process of controlling the pigment particles to adsorb at the bottom or top of the capsule through an electric field is a physical process. The e-ink screen will provide a driving waveform file. According to the driving waveform file and the current display screen of the e-ink screen, the driving waveform sequence corresponding to the intermediate process required to display the next frame of the data to be displayed is determined, and different control signals are applied to the e-ink screen according to the driving waveform sequence. In some embodiments, the driving waveform can include information such as waveform amplitude (corresponding to the driving voltage magnitude), pulse width, and pulse count.

[0060] In this embodiment, the multi-dimensional driving waveform table can refer to a driving waveform table or file with three or more dimensions. For example, the driving waveform table can be a display lookup table provided by the e-ink screen manufacturer. The lookup table is a voltage driving table that records the correspondence between different grayscales and driving waveforms. The driving waveform table is usually a multi-dimensional table with multiple dimensions. For example, the driving waveform table has four dimensions: temperature dimension, frame number dimension, old image grayscale value dimension, and new image grayscale value dimension. The temperature dimension represents the current temperature of the e-ink screen, the frame number dimension represents the number of frames used in the current refresh mode of the e-ink screen, the old image grayscale value dimension represents the grayscale value of the previous displayed image, and the new image grayscale value dimension represents the grayscale value of the next displayed image. In addition to the four dimensions exemplified above, the driving waveform table can also have other dimensions. When the value of a certain dimension among the four dimensions is determined, for example, when the temperature of the e-ink screen is determined, the remaining three dimensions are left, and these three dimensions form a three-dimensional table. When the value of a certain dimension in this three-dimensional table is determined, for example, when the current frame number is determined, the remaining two dimensions are left, and these two dimensions form a two-dimensional table.

[0061] In this embodiment, the driving waveform two-dimensional table may refer to a driving waveform table or file with two dimensions. For example, the driving waveform two-dimensional table may include the old image gray value dimension and the new image gray value dimension. For example, the new image gray value dimension is the abscissa, and the old image gray value dimension is the ordinate. When determining the pixel value of a certain pixel point in the old image, the ordinate position in the two-dimensional table is determined. When determining the pixel value of the corresponding position pixel point in the new image, the abscissa position in the two-dimensional table is determined. According to the ordinate and abscissa positions, the corresponding driving waveform (such as the driving voltage change mode) is found, and the pixels of the ink screen can be driven according to the found driving waveform to produce the corresponding display effect. Specifically, for example, the gray value of a certain pixel point in the old image is 6 (the gray value range is 0 to 15), and the gray value of this pixel point in the new image is 13. The driving waveform result is found at the position of the 6th row and the 13th column of the driving waveform two-dimensional table (16×16). For example, the driving waveform result indicates applying a positive voltage. Then, when applying voltage to the electrode of the corresponding pixel point of the ink screen, applying a positive voltage is sufficient.

[0062] In this embodiment, localization may refer to the process of reducing the dimension of the driving waveform multi-dimensional table or extracting its local part to obtain a driving waveform table with a lower dimension. For example, for a driving waveform six-dimensional table, localization processing can be performed to generate a driving waveform three-dimensional table. Performing localization processing on the driving waveform table is beneficial to accelerating the table lookup process, enabling the corresponding driving waveform or driving voltage change mode to be quickly determined according to the pixel values of the old image and the new image, thereby achieving fast refreshing and reducing the load or power consumption of the ink screen device. For details of the localization process, reference can be made to the following text and Figure 2 the description of.

[0063] In this embodiment, the driving waveform result image may refer to an image composed of the driving waveforms or driving voltage change modes found from the driving waveform table. Each pixel of this image represents the driving waveform or driving voltage change mode required for the corresponding pixel of the ink screen to refresh the display content. For example, the pixel value of each pixel of the driving waveform result image is 0, 1, or 2, where 0 indicates that the voltage remains unchanged, 1 indicates applying a positive voltage, and 2 indicates applying a negative voltage. The corresponding pixel of the ink screen adopts the corresponding driving voltage control according to the pixel value of the driving waveform result image to keep it unchanged, apply a positive voltage, or apply a negative voltage.

[0064] Figure 2 Shows a schematic diagram of the data conversion process in the display method for an ink screen device according to Figure 1 the corresponding embodiment.

[0065] As Figure 2As shown, after the interface synthesizer generates the final synthesized page, it is necessary to perform TCON (time control) conversion on the synthesized page to convert it into a format that can be displayed on the e-ink display. However, the process is redundant, so it is optimized to greatly improve the conversion efficiency. The first image and the second image are, for example, RGBA (red-green-blue-alpha) format images, and their pixel values are stored in multiple ints. An int is an integer type in Java and has 32 bits. Each pixel of the first image and the second image contains four RGBA channels, and the value of each channel is represented by 8 bits (that is, between 0 and 255). Therefore, the pixel value array of each pixel has a total of 8×4 = 32 bits, which is the same as the number of bits of an int. Therefore, an int can be used to store the pixel values of RGBA format images. It should be understood that the first image and the second image can also have other formats, such as RGB, CMYK, etc., and there can also be other storage methods, not limited to the integer type int in Java.

[0066] In some examples, the front and back frame information is compressed, and the pixel information of the front and back frame pictures is compressed into the same int, that is, the first image and the second image are converted into grayscale images. To convert the first image and the second image into the first grayscale image and the second grayscale image, a preprocessing algorithm is required. Through the preprocessing algorithm, the RGBA four-channel color pixel values stored in an int can be converted into 4-bit grayscale values (D1 and D2), that is, the grayscale value range is between 0 and 15. It should be understood that although in the figure, both D1 and D2 occupy 8-bit storage spaces in an int, the actual data includes 4 bits. In this way, through the preprocessing algorithm, the 32-bit pixel value array in an int can be compressed into a 4-bit grayscale value, and the RGBA data volume of four ints becomes the grayscale value data volume of one int.

[0067] In some examples, the data in the new and old pictures is byte-compressed, with the upper four bits being the new pixel and the lower four bits being the old pixel, generating a differential image. In the process of converting the first grayscale image and the second grayscale image into a differential image, it is necessary to combine the pixel value D1 of a certain pixel point in the first grayscale image with the pixel value D2 of the corresponding pixel point in the second grayscale image into D1D2, that is, the 4-bit of D1 and the 4-bit of D2 are combined into an 8-bit number, where the first four bits are the value of D1 and the last four bits are the value of D2.

[0068] In some examples, the driving waveform multi-dimensional table is localized, and a 16×16 conversion matrix with 256 elements at the current temperature and number of frames is extracted to generate a driving waveform two-dimensional table. The driving waveform table was originally a multi-dimensional table, and each dimension defines a limiting condition for a driving waveform. After determining the values of all dimensions, the corresponding driving waveform can be found. In this embodiment, the driving waveform table has four dimensions, namely temperature, number of frames, value of D1, and value of D2. Through the localization process, the driving waveform multi-dimensional table can be compressed into a driving waveform two-dimensional table. For example, the driving waveform multi-dimensional table is a 11×40×16×16 table, where 11 represents the temperature range, 40 represents the maximum number of frame transformations supported, the first 16 is the value range of D1, and the second 16 is the value range of D2. Among them, the meaning of the number of frames dimension is that in each driving waveform mode (such as A12, GC16, etc.) of the e-ink screen, multiple frames drawn or synthesized by the GPU or CPU are merged into one frame for display. For example, in the A12 mode, 40 synthesized frames are merged into one frame and sent to the e-ink screen for display. The current, for example, the first image corresponds to a certain sequence position among these 40 frames. For example, the first image is the 3rd frame among the 40 frames, so the value of the number of frames dimension is 3. During the localization process, the values of the temperature dimension and the number of frames dimension can be determined. For example, the temperature range is 2 at this time, and the value of the number of frames dimension is 3, so as to reduce the 11×40×16×16 four-dimensional table to a 16×16 two-dimensional table, and use this two-dimensional table for look-up table to accelerate the look-up table process.

[0069] In some examples, based on the differential image, the driving waveform result image can be obtained by querying the driving waveform table. For the differential image, the driving waveform two-dimensional table is used for scanning, and the generated results are written into the driving waveform result image. Each value of D1D2 corresponds to a value in the driving waveform table, and the value in the driving waveform table represents the change waveform of the driving voltage. For example, in one embodiment, the values in the driving waveform table include three values: 0, 1, or 2, which respectively represent that the voltage remains unchanged, the voltage is positive, or the voltage is negative. To store these three values, 2 bit positions (which can represent four numbers) are required. Since the value range of each scanned look-up table result includes 0, 1, and 2, the result writing method is to compress the results of four scans as a group, that is, one 8-bit byte contains 4 result elements, which greatly reduces the memory space. Therefore, the pixel value of each pixel in the driving waveform result image is mainly represented by 2 bit positions. In this way, a value of 8 bit positions (represented by D1D2) in the differential image becomes a value of 2 bit positions (represented by R) in the driving waveform result image after look-up table. In the driving waveform result image, the first two 8-bit positions in an int store the pixel value, the third 8-bit position stores the timing information, and the fourth 8-bit position is reserved and does not store information.

[0070] Figure 3 Schematic diagram of an application scenario of a display method for an e-ink screen device according to an embodiment of the present application is shown.

[0071] As Figure 3 shown, in this scenario, the hardware composer (HWC) of the e-ink screen device generates a hardware vertical synchronization (Vsync) signal and sends it to the Display Vertical Sync (Disp-Vsync) thread in the surface compositor, where the surface compositor includes, for example, SurfaceFlinger. The Display Vertical Sync thread is used to convert the hardware vertical synchronization signal into a software vertical synchronization signal and send the software vertical synchronization signal to the drawing frequency thread and the composition frequency thread. The drawing frequency thread can also be referred to as the Application Software Vertical Sync (App-Vsync) thread, and the composition frequency thread can also be referred to as the Surface Compositor Vertical Sync (SF-Vsync) thread. Among them, the drawing frequency thread is used to control the drawing frequency of the application software (App), and the composition frequency thread is used to control the composition frequency of the surface compositor. After receiving the software vertical synchronization signal, the drawing frequency thread converts the software vertical synchronization signal and converts it into an appropriate drawing frequency according to the driving waveform mode currently adopted by the e-ink screen (such as A12, GC16 mode, etc.), so that the user interface thread (UI-Thread) and the rendering thread (RenderThread) in the application software can draw according to this drawing frequency. After receiving the software vertical synchronization signal, the composition frequency thread converts the software vertical synchronization signal and converts it into an appropriate composition frequency according to the driving waveform mode currently adopted by the e-ink screen, so that the main thread (MainThread) in the surface compositor can compose the drawn layers according to this composition frequency. After the main thread of the surface compositor composes a color image, it needs to be processed by a preprocessing algorithm to convert it into a grayscale image, and then the grayscale image needs to be compressed to obtain a driving waveform result image. The operations of the preprocessing algorithm and compression can be performed in a dual buffer. The dual buffer module includes DitherBuffer1 and DitherBuffer2, which can be rotated to improve the efficiency of the preprocessing algorithm. After obtaining the driving waveform result image, it can be sent to the e-ink screen thread in the surface compositor. The e-ink screen thread performs time control (TCON) processing on the driving waveform result image, such as soft time control processing, and sends the processed image to the hardware composer for display.

[0072] In this embodiment, the application software may refer to the application software installed on the e-ink screen device, such as a reader, a video player, a browser, a music player, etc.

[0073] In this embodiment, the interface compositor may refer to a module mainly used to perform the layer composition function. For example, for the HarmonyOS or Android operating system, the interface compositor is an important system service in the operating system and can be used for layer composition and for passing the layer display function to the DSS (display subsystem). For example, the main functions of the interface compositor include receiving the interfaces of all windows as input, calculating the position of each interface in the final composite image according to parameters such as order, transparency, size, and position, and then (partially) handing it over to the hardware compositor to generate the final display image and display it on a specific display device. For example, the interface compositor receives graphic display data from multiple sources, composes them, and then sends them to the display device. Specifically, for example, when opening an application, there are usually three layers of display, including the status bar at the top, the navigation bar at the bottom or on the side, and the interface of the application. Each layer is updated and rendered separately, and these interfaces are all composed into a frame by the interface compositor and refreshed into the display hardware for display.

[0074] In this embodiment, the hardware compositor may refer to a module that receives multiple interfaces (surfaces) output by the interface compositor, mixes the multiple interfaces into one interface according to the attributes of the interfaces, and finally outputs it to the display. For example, the hardware compositor is used to compose the layers received from the interface compositor, thereby reducing the amount of composition performed by the GPU.

[0075] In this embodiment, the vertical synchronization signal may refer to a signal used to synchronize the drawing frequency of the display page with the refresh frequency of the display to avoid the occurrence of tearing. For example, when the interface of the application software needs to be updated, it first requests a vertical synchronization signal, and waits until the next vertical synchronization signal arrives to update the interface. For example, in the Android system, the vertical synchronization signal mechanism includes the following steps: The CPU / GPU receives the vertical synchronization signal. Each time a vertical synchronization signal command is issued, the CPU will perform a refresh operation, that is, the CPU will respond to the command of the vertical synchronization signal to perform a data refresh action; the refresh times of the CPU and GPU are the same as the FPS (frame per second) of the display, because only when the vertical synchronization signal command is issued, the CPU and GPU will perform refresh or display actions; the CPU / GPU receives the vertical synchronization signal and prepares the content to be displayed in the next frame in advance, so it can prepare the data for each frame in a timely manner to ensure the smoothness of the picture.

[0076] In this embodiment, the rendering frequency thread may refer to a thread used to control the rendering frequency and thus control the rendering timing. For example, the role of the rendering frequency thread can be that after the interface synthesizer receives the vertical synchronization signal from the underlying layer, the rendering frequency thread performs frequency conversion in software, passes it to the application side, and notifies the application to perform layer rendering work. For example, after performing rendering frequency control on the vertical synchronization refresh signal transmitted by the hardware, it is sent to the application layer, thereby reducing the application rendering frequency. At the same time, the synthesis frequency is controlled to reduce the timing control processing frequency. For example, the rendering frequency thread can perform rendering frequency adaptation, that is, reduce the number of callbacks of the vertical synchronization signal (onVsync), control the rendering (doFrame) frequency, reduce the frequency of the rendering thread, and reduce redundant rendering tasks. For example, after receiving the signal, the rendering frequency thread switches the required application software rendering frequency according to the current driving waveform mode (such as A12, GC16, GL16, GLR16, etc.). In the dynamic scenario of the e-ink screen, since the page changes every frame, the application software will frequently perform re-rendering and initiate a synthesis request to the interface synthesizer. However, due to the refresh characteristics of the e-ink screen, the rendering and synthesis frequencies do not need to be so high, so there are redundant operations. Therefore, dynamic control needs to be performed on the signal frequencies of the application software and the interface synthesizer.

[0077] In this embodiment, the synthesis frequency thread may refer to a thread used to control the synthesis frequency and thus control the synthesis timing. For example, the role of the synthesis frequency thread can be that after the interface synthesizer receives the vertical synchronization signal from the underlying layer, the synthesis frequency thread performs frequency conversion in software, passes it to the synthesis thread, and notifies the synthesis function to perform layer synthesis work. For example, the synthesis frequency thread can perform synthesis frequency adaptation, that is, reduce the number of syntheses, mainly reduce redundant preprocessing algorithms, can greatly reduce the CPU occupancy during synthesis, and thus reduce power consumption. For example, after receiving the signal, the synthesis frequency thread performs frequency control to achieve frequency reduction according to the driving waveform mode. After all current renderings are completed, the interface synthesizer will trigger the main thread to perform the timing control algorithm conversion of the driving waveform. Among them, the timing control algorithm is optimized. For the specific optimization method, please refer to Figure 1 the relevant descriptions of the corresponding embodiment, which will not be repeated here.

[0078] In this embodiment, a double buffer may refer to a module with two buffers that can rotate with each other. Considering that frame freezing may occur in the synthesis process and the preprocessing algorithm, in some cases, frequency modulation may not be possible at the normal frame rate (e.g., 85 FPS), and double buffer rotation is required to reduce the impact of dropped frames or stuttering. In the double buffer, the first buffer (buffer 1) and the second buffer (buffer 2) respectively undertake two different tasks. When the task of the first buffer is completed, the roles of the two buffers are swapped, and the first buffer undertakes the new task originally undertaken by the second buffer. When the task of the second buffer is completed, the second buffer undertakes the new task originally undertaken by the first buffer. This cycle alternates, thereby accelerating the task progress and avoiding the need to wait for the first task to be completed before proceeding with the next task. In this embodiment, the first buffer may first undertake the preprocessing task, and the second buffer may first undertake the compression task (see Figure 1 the corresponding embodiment), and then rotate with each other in the above manner.

[0079] In this embodiment, timing control may refer to the process of processing the drawn image for display. In the field of e-ink screens, data such as RGBA needs to be processed before display, and this processing process is the timing control process. For example, the timing controller is a bridge between the system-on-chip and the display driver chip, converting the image signal input by the system into a signal that the display driver chip can recognize, and at the same time establishing the control signal responsible for pixel driving. For example, the timing controller is used to control the timing and signal driving of the screen to ensure that the correct pixel data is transmitted in the correct order and finally composes an image.

[0080] Figure 4 The flowchart shows a display method for an e-ink screen device according to an embodiment of the present application.

[0081] According to this embodiment, the display method for an e-ink screen device includes steps S410 to S440, and each step is described in detail below.

[0082] S410. Synthesize a first image and a second image, where the first image and the second image are two adjacent frames of images.

[0083] In this embodiment, the first image and the second image may refer to two adjacent frames of images for display on an e-ink screen display, and the data of the first image and the second image needs to be processed before display. Two adjacent frames of images may refer to the two images with the shortest time interval in the image sequence that forms a dynamic picture through the principle of persistence of vision. These two images are displayed on the screen successively, and the time interval between them is determined by the frame rate or refresh rate of the screen.

[0084] In this embodiment, synthesis may refer to the process of combining the drawn layers into an image or surface. Generally, the picture displayed on the monitor includes multiple layers, and the process of superimposing these layers is the synthesis step.

[0085] S420. Preprocess the first image and the second image to obtain a first grayscale image and a second grayscale image respectively.

[0086] In this embodiment, converting the first image and the second image into a first grayscale image and a second grayscale image respectively may refer to converting the first image (old image) into a first grayscale image (old grayscale image) and converting the second image (new image) into a second grayscale image (new grayscale image). For details of the preprocessing algorithm, see Figure 1 the relevant descriptions in the corresponding embodiments, which will not be repeated here.

[0087] S430. Compress the first grayscale image and the second grayscale image into a driving waveform result image according to the two-dimensional driving waveform table.

[0088] In this embodiment, the pixel value of the driving waveform result image is a value representing the driving voltage change mode, and its representation method can have various forms. In one form, the pixel value of the driving waveform result image can include three options, namely 0, 1, and 2, and each value represents a driving voltage change mode. Other representation methods are also conceivable.

[0089] As an example, in order to compress the first grayscale image and the second grayscale image into a driving waveform result image according to the two-dimensional driving waveform table, the grayscale value of each pixel of the first grayscale image and the grayscale value of the corresponding pixel of the second grayscale image can be used to query the first grayscale value dimension and the second grayscale value dimension of the two-dimensional driving waveform table to obtain the driving waveform result, where the driving waveform results corresponding to each pixel constitute the driving waveform result image.

[0090] In this example, to query the two-dimensional driving waveform table, it can be queried according to the pixel values that each pixel has in the two consecutive frames of images respectively. For example, each pixel in the grayscale image has 16 levels of grayscale, and the corresponding two-dimensional driving waveform table is a 16×16 table, where the abscissa can represent the grayscale value of the old image and the ordinate can represent the grayscale value of the new image. By determining the position of the grayscale value change mode of each pixel in the table, the driving voltage change mode, that is, the pixel value of the driving waveform result image, can be determined.

[0091] As an example, in order to obtain the two-dimensional driving waveform table, the multi-dimensional driving waveform table can be localized to generate the two-dimensional driving waveform table.

[0092] In this embodiment, the multi-dimensional table of the driving waveform of the ink screen can be stored in the memory of an electronic device or a computing device having the ink screen. Through localization processing, the multi-dimensional (e.g., four-dimensional) driving waveform table is compressed into a two-dimensional driving waveform table, thereby accelerating the table lookup speed and reducing the power consumption required for driving. For details of the localization, see Figure 1 the relevant descriptions of the corresponding embodiments, which will not be repeated here.

[0093] As an example, the multi-dimensional table of the driving waveform includes a first dimension, a second dimension, and a third dimension. The first dimension includes a first gray value dimension represented by the gray values of the pixel points of the first gray image, and the second dimension includes a second gray value dimension represented by the gray values of the pixel points of the second gray image. To perform localization processing on the multi-dimensional table of the driving waveform and generate a two-dimensional table of the driving waveform, the value of the third dimension can be determined, where the third dimension includes a temperature dimension or a frame number dimension; then, the multi-dimensional table of the driving waveform is localized into a two-dimensional table of the driving waveform.

[0094] In this example, for the localization processing of the multi-dimensional table of the driving waveform, the values of other dimensions (e.g., the third dimension) except the first dimension and the second dimension are determined, and the multi-dimension is reduced to two dimensions. It should be understood that other localization processing methods can also be adopted. The present application is not limited to the dimensions whose values are determined above, and the values of other dimensions (e.g., the fourth dimension, the fifth dimension, etc.) can also be determined for localization.

[0095] As an example, the multi-dimensional table of the driving waveform includes a four-dimensional table of the driving waveform, and the four-dimensional table of the driving waveform includes a first dimension, a second dimension, a temperature dimension, and a frame number dimension. To perform localization processing on the multi-dimensional table of the driving waveform and generate a two-dimensional table of the driving waveform, the values of the temperature dimension and the frame number dimension of the four-dimensional table of the driving waveform can be determined according to the temperature of the ink screen and the driving waveform, so as to query and obtain the two-dimensional table of the driving waveform. In this example, since the temperature remains unchanged within a short period of time, the value of the temperature dimension can be set in advance, and there is no need to query the temperature dimension every time of refreshing. The value of the frame number dimension has regularity. According to which frame the current image is in, the value of the frame number dimension can be quickly determined, so there is no need to query the frame number dimension every time either. Therefore, through localization processing, the temperature dimension and the frame number dimension can be compressed, leaving the gray value dimensions of the two new images and the old image for table lookup, improving the table lookup speed and reducing the power consumption and load.

[0096] S440. Refresh the display content according to the driving waveform result image.

[0097] As an example, a rotation mechanism for two buffers can be set so that the preprocessing step S420 and the compression step S430 are alternately executed in the first buffer and the second buffer to improve the operation efficiency of S420 and S430. For example, the first buffer executes the preprocessing step S420 for the first image and the second image, and the second buffer executes the compression step S430 for the first image and the second image. When the compression step S430 of the second buffer is completed and the preprocessing step S420 of the first buffer is being executed, the first buffer and the second buffer are exchanged, and the second buffer executes the preprocessing step S420 for the subsequent second image and the third image. When the preprocessing step S420 of the first buffer for the first image and the second image is completed, the first buffer executes the compression step S430 for the second image and the third image.

[0098] In this example, the preprocessing algorithm represented by S420 takes a relatively long time, so it needs to be separated from the compression step represented by S430 and other tasks, and the two alternate with each other, which can speed up the processing speed.

[0099] In some other examples, after step S440, the second buffer can also execute the preprocessing step for the third image and the fourth image after the first image and the second image. The first buffer can also execute the compression step for the third image and the fourth image.

[0100] Figure 5 A flowchart showing a display method for an e-ink screen device according to an embodiment of the present application is shown.

[0101] According to this embodiment, the display method for the e-ink screen device includes steps S510 to S570, and each step is described in detail below.

[0102] S510. Determine the drawing frequency and the synthesis frequency according to the driving waveform mode of the e-ink screen.

[0103] In this embodiment, the driving waveform mode may refer to the refresh mode adopted by the e-ink screen according to system settings or user settings. For example, when reading an e-book, the e-ink screen adopts a driving waveform mode with a lower frame rate, and when watching a video, it adopts a driving waveform mode with a higher frame rate.

[0104] In this embodiment, the drawing frequency may refer to the number of pages drawn by the application software of the e-ink screen device per second. In some embodiments, drawing may refer to the drawing of layers. In this embodiment, the synthesis frequency may refer to the number of images synthesized by the interface synthesizer of the e-ink screen device per second, where one image or interface includes multiple layers.

[0105] As an example, in order to determine the drawing frequency and the synthesis frequency according to the driving waveform mode of the e-ink screen, the hardware vertical synchronization signal sent by the e-ink screen can be first converted into a software vertical synchronization signal; then, the software vertical synchronization signal is sent to the drawing frequency thread and the synthesis frequency thread respectively; then, the drawing frequency thread converts the frequency of the software vertical synchronization signal into the drawing frequency according to the driving waveform mode; and, the synthesis frequency thread converts the frequency of the software vertical synchronization signal into the synthesis frequency according to the driving waveform mode.

[0106] In this example, converting the software vertical synchronization signal into the drawing frequency and the synthesis frequency can be performed separately in the drawing frequency thread (such as App-Vsync) and the synthesis frequency thread (such as SF-Vsync). In traditional e-ink screens, the drawing frequency thread and the synthesis frequency thread are only used to control the timing of drawing and synthesis operations according to the software vertical synchronization signal, and do not have the function of reducing the frequency according to the driving waveform mode. In this example, the drawing frequency thread and the synthesis frequency thread are added with the function of determining the frequency according to the driving waveform mode, so that the drawing and synthesis frequencies are reduced, thus adapting to the refresh characteristics of the e-ink screen.

[0107] S520. Draw the layers of the first image and the layers of the second image respectively according to the drawing frequency.

[0108] In this embodiment, drawing the layers according to the drawing frequency means drawing the layers of each image according to the drawing frequency determined by the driving waveform mode. Compared with the traditional drawing method, the drawing frequency determined by the driving waveform mode is lower because the refresh frequency of the e-ink screen is lower, so that the computing resources and energy consumed by drawing can be saved, and the load and power consumption of the device can be reduced.

[0109] S530. Synthesize the layers of the first image and the layers of the second image respectively according to the synthesis frequency to obtain the first image and the second image, and the first image and the second image are two adjacent frames of images.

[0110] In this embodiment, synthesizing the layers into an image according to the synthesis frequency means synthesizing the layers of each image according to the synthesis frequency determined by the driving waveform mode, reducing the synthesis frequency to make it conform to the refresh characteristics of the e-ink screen, removing redundant synthesis operations, and reducing power consumption and load.

[0111] S540. Preprocess the first image and the second image to obtain the first grayscale image and the second grayscale image respectively.

[0112] For the details of S540, refer to Figure 4 the detailed description of Embodiment regarding S420, which will not be repeated here.

[0113] S550. Localize the multi-dimensional table of driving waveforms to generate a two-dimensional table of driving waveforms.

[0114] For details about S550, see Figure 4 the detailed description of S430 in the embodiments, which will not be repeated here.

[0115] S560. Combine the first gray value of each pixel in the first gray image with the second gray value of the pixel at the corresponding position in the second gray image to form a third gray value, and the third gray values of all pixels form a differential image.

[0116] In this embodiment, combining the gray values of the first gray image and the second gray image may be to combine the two gray values into a gray value with a higher number of bits. For example, two 4-bit gray values are combined into an 8-bit gray value, where the first four bits are the first gray value and the last four bits are the second gray value. Other methods can also be conceived.

[0117] As an example, in order to combine the first gray value of each pixel in the first gray image with the second gray value of the pixel at the corresponding position in the second gray image to form a third gray value, the first gray value with the first number of bits of each pixel in the first gray image and the second gray value with the second number of bits of the pixel at the corresponding position in the second gray image can be combined into a third gray value with the third number of bits, and the third number of bits is the sum of the first number of bits and the second number of bits.

[0118] In this example, the first number of bits of the first gray value is, for example, 4, and the second number of bits of the second gray value is also, for example, 4, so the third number of bits is 8. Other settings of the number of bits can also be conceived.

[0119] S570. Traverse the differential image using the two-dimensional table of driving waveforms to obtain a driving waveform result image.

[0120] In this embodiment, in order to traverse the differential image using the two-dimensional table of driving waveforms to obtain a driving waveform result image, the driving waveform change method recorded in the two-dimensional table of driving waveforms can be queried for each pixel value of the differential image. This driving waveform change method can be represented by numbers. Performing such a query (i.e., traversing) for all pixels, all the numbers representing the driving waveforms obtained form a driving waveform result image, and this result image is used for display.

[0121] Based on the foregoing Figure 4 method embodiments, the embodiments of the present application further provide a display device for an e-ink screen device, and its structural schematic diagram is as Figure 6 shown. This device is used to execute each step in the foregoing Figure 4 .

[0122] According to this embodiment, a display device 600 for an e-ink screen device includes a synthesis module 610, a preprocessing module 620, a compression module 630, and a refresh module 640. The synthesis module 610 is used to synthesize a first image and a second image, where the first image and the second image are two adjacent images. The preprocessing module 620 is used to preprocess the first image and the second image to obtain a first grayscale image and a second grayscale image respectively. The compression module 630 is used to compress the first grayscale image and the second grayscale image into a driving waveform result image according to a two-dimensional driving waveform table. The refresh module 640 is used to refresh the display content according to the driving waveform result image.

[0123] It should be noted that Figure 6 When the display device 600 for an e-ink screen device provided by the illustrated embodiment executes the display method for an e-ink screen device, only the above division of each functional module is used as an example for illustration. In practical applications, the above functions can be assigned to different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the display device 600 for an e-ink screen device provided by the above embodiment and Figure 4 the display method embodiment for an e-ink screen device shown respectively belong to the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0124] Figure 7 FIG. is a schematic hardware structure diagram of a computing device 700 provided by an embodiment of the present application.

[0125] Referring to Figure 7 , the computing device 700 includes a processor 710, a memory 720, a communication interface 730, and a bus 740. The processor 710, the memory 720, and the communication interface 730 are connected to each other through the bus 740. The processor 710, the memory 720, and the communication interface 730 can also be connected by other connection methods other than the bus 740.

[0126] Among them, the memory 720 can be various types of storage media, such as random access memory (RAM), read-only memory (ROM), non-volatile RAM (NVRAM), programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), flash memory, optical memory, hard disk, etc.

[0127] Among them, the processor 710 can be a general-purpose processor, which can execute specific steps and / or operations by reading and executing the content stored in a memory (such as the memory 720). For example, the general-purpose processor can be a central processing unit (CPU). The processor 710 can include at least one circuit to execute Figure 4 all or part of the steps of the display method for the ink screen device provided by the illustrated embodiment.

[0128] Among them, the communication interface 730 includes interfaces such as input / output (I / O) interfaces, physical interfaces, and logical interfaces for implementing interconnections between components inside the computing device 700, as well as interfaces for implementing interconnections between the computing device 700 and other devices (such as other computing devices or user devices). The physical interface can be an Ethernet interface, a fiber optic interface, an ATM interface, etc. The communication interface 730 can be externally connected to input devices and output devices. For example, the input device can be a microphone or a microphone array for capturing voice input signals; it can be a communication network connector for receiving the collected input signals from the cloud or other devices; it can also include, for example, a keyboard, a mouse, etc. The output device can output various information to the outside, including the determined distance information, direction information, etc. The output device can include, for example, a display, a speaker, a printer, and a communication network and its connected remote output devices, etc.

[0129] Among them, the bus 740 can be of any type and is a communication bus for implementing the interconnection of the processor 710, the memory 720, and the communication interface 730, such as a system bus.

[0130] The above-mentioned components can be respectively arranged on independent chips, or at least partially or entirely arranged on the same chip. Whether to arrange each component on different chips or integrate them on one or more chips often depends on the needs of product design. The embodiments of the present application do not limit the specific implementation forms of the above-mentioned components.

[0131] Figure 7 The illustrated computing device 700 is only exemplary. During implementation, the computing device 700 may further include other components, which will not be listed one by one herein.

[0132] An embodiment of the present application can also be a computer-readable storage medium, on which computer program instructions are stored. When the computer program instructions are run by a processor, the processor is caused to execute the steps in the display method for the ink screen device according to various embodiments of the present application described above in this specification.

[0133] The computer-readable storage medium may adopt any combination of one or more readable media. The readable media may be a readable signal medium or a readable storage medium. The readable storage medium may include, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0134] Those skilled in the art should understand that the embodiments of the present application are not limited to the several forms given above. After reading the present application document, those skilled in the art may make any possible improvements, substitutions, and equivalent forms to the steps, methods, devices, and components in the above embodiments. These improvements, substitutions, and equivalent forms should be regarded as falling within the scope of the present application. The protection scope of the present application is only subject to the claims.

Claims

1. A display method for an e-ink screen device, characterized in that, the method comprises: synthesizing a first image and a second image, the first image and the second image being two adjacent frames of images; preprocessing the first image and the second image to obtain a first grayscale image and a second grayscale image respectively; compressing the first grayscale image and the second grayscale image into a driving waveform result image according to a two-dimensional driving waveform table; refreshing the display content according to the driving waveform result image.

2. The display method according to claim 1, characterized in that, before compressing the first grayscale image and the second grayscale image into a driving waveform result image according to the two-dimensional driving waveform table, the method further comprises: performing a localization process on a multi-dimensional driving waveform table to generate a two-dimensional driving waveform table.

3. The display method according to claim 2, characterized in that, the multi-dimensional driving waveform table includes a first dimension, a second dimension and a third dimension, the first dimension includes a first grayscale value dimension represented by the grayscale values of the pixel points of the first grayscale image, and the second dimension includes a second grayscale value dimension represented by the grayscale values of the pixel points of the second grayscale image; the performing a localization process on the multi-dimensional driving waveform table to generate a two-dimensional driving waveform table includes: determining the value of the third dimension; wherein, the third dimension includes a temperature dimension or a frame number dimension; localizing the multi-dimensional driving waveform table into the two-dimensional driving waveform table.

4. The display method according to claim 3, characterized in that, the multi-dimensional driving waveform table includes a four-dimensional driving waveform table, the four-dimensional driving waveform table includes the first dimension, the second dimension, a temperature dimension and a frame number dimension; the performing a localization process on the multi-dimensional driving waveform table to generate a two-dimensional driving waveform table includes: determining the values of the temperature dimension and the frame number dimension of the four-dimensional driving waveform table according to the temperature of the e-ink screen and the driving waveform, so as to query and obtain the two-dimensional driving waveform table.

5. The display method according to claim 1, characterized in that, compressing the first grayscale image and the second grayscale image into a driving waveform result image according to the two-dimensional driving waveform table includes: combining the first grayscale value of each pixel of the first grayscale image with the second grayscale value of the pixel at the corresponding position of the second grayscale image to form a third grayscale value, and the third grayscale values of each pixel form a differential image; traversing the differential image using the two-dimensional driving waveform table to obtain the driving waveform result image.

6. The display method according to claim 5, characterized in that, combining the first grayscale value of each pixel of the first grayscale image with the second grayscale value of the pixel at the corresponding position of the second grayscale image to form a third grayscale value, includes: The first gray value with a first number of bits of each pixel of the first gray image and the second gray value with a second number of bits of the pixel at the corresponding position of the second gray image are combined into the third gray value with a third number of bits, and the third number of bits is the sum of the first number of bits and the second number of bits.

7. The display method according to claim 1, wherein, compressing the first gray image and the second gray image into a driving waveform result image according to the two-dimensional driving waveform table includes: querying the first gray value dimension and the second gray value dimension of the two-dimensional driving waveform table according to the gray value of each pixel of the first gray image and the gray value of the pixel at the corresponding position of the second gray image to obtain a driving waveform result; wherein, the driving waveform results corresponding to each pixel constitute the driving waveform result image.

8. The display method according to claim 1, wherein, synthesizing the first image and the second image includes: determining a drawing frequency and a synthesis frequency according to the driving waveform mode of the ink screen; drawing the layer of the first image and the layer of the second image respectively according to the drawing frequency; synthesizing the layer of the first image and the layer of the second image respectively according to the synthesis frequency to obtain the first image and the second image.

9. The display method according to claim 8, wherein, determining the drawing frequency and the synthesis frequency according to the driving waveform mode of the ink screen includes: converting the hardware vertical synchronization signal sent by the ink screen into a software vertical synchronization signal; sending the software vertical synchronization signal to a drawing frequency thread and a synthesis frequency thread respectively; the drawing frequency thread converts the frequency of the software vertical synchronization signal into the drawing frequency according to the driving waveform mode; the synthesis frequency thread converts the frequency of the software vertical synchronization signal into the synthesis frequency according to the driving waveform mode.

10. The display method according to claim 1, wherein, the preprocessing step and the compression step of the method are alternately executed in a first buffer and a second buffer, wherein the first buffer executes the preprocessing step for the first image and the second image, and the second buffer executes the compression step for the first image and the second image. When the compression step of the second buffer is completed and the preprocessing step of the first buffer is being executed, the first buffer and the second buffer are exchanged, and the second buffer executes the preprocessing step for the second image and the third image. When the preprocessing step of the first buffer for the first image and the second image is completed, the first buffer executes the compression step for the second image and the third image.

11. A display device for an ink screen device, wherein, the device includes: a synthesis module for synthesizing a first image and a second image, and the first image and the second image are two adjacent frames of images in sequence; A preprocessing module, configured to preprocess the first image and the second image to obtain a first grayscale image and a second grayscale image respectively; A compression module, configured to compress the first grayscale image and the second grayscale image into a driving waveform result image according to a two-dimensional driving waveform table; A refreshing module, configured to refresh the display content according to the driving waveform result image.

12. A computing device, characterized in that the computing device includes an e-ink screen, a processor, and a memory, the e-ink screen, the processor, and the memory communicate with each other, and the processor is configured to execute a computer program stored in the memory to implement the display method for an e-ink screen device according to any one of claims 1 to 10.

13. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program, and the computer program is configured to execute the display method for an e-ink screen device according to any one of claims 1 to 10.

Images