Display method, readable medium and electronic equipment

Abstract

The invention relates to the technical field of display, and discloses a display method, a readable medium and electronic equipment. The display method is realized in a software system of the electronic equipment, and the refreshing content of local refreshing and the refreshing content of global refreshing are respectively drawn by different modules, then are converted into grayscale images by a conversion module, and are sent to a driving module to determine a driving waveform. According to the display method provided by the invention, the local to-be-displayed data corresponding to the handwriting operation and the global to-be-displayed data corresponding to the page refreshing are asynchronously sent to the conversion module to be converted into the grayscale image, and the driving waveform is further determined; the drawing of the locally-refreshed refresh content does not need to wait for the completion of the drawing of the globally-refreshed refresh content of the previous frame, thereby shortening the delay generated by the display of the content written or drawn by the handwriting pen.

Description

Technical Field

[0001] The present application relates to the field of display technology, and in particular to a display method, a readable medium and an electronic device. Background Art

[0002] Electronic paper display (EPD, hereinafter referred to as ink screen) is widely used in electronic devices such as e-books, electronic writing tablets, and electronic signs.

[0003] The electronic ink screen is composed of multiple microcapsules, each of which contains multiple black particles and multiple white particles. The black particles and the white particles carry opposite charges. When black content needs to be displayed on the electronic ink screen, the black particles are driven by voltage to move up to the top of the screen. When white content is displayed, the white particles are driven by voltage to move up to the top of the screen.

[0004] Due to the black and white display principle of the ink screen, after the ink screen detects the display instruction, it needs to convert the color image (RGB image) into a grayscale image, and further look up the table according to the grayscale value of each pixel to obtain the driving waveform corresponding to the pixel position on the ink screen, and then drive the ink screen to display the image according to the driving waveform.

[0005] However, after the current ink screen detects the display instruction, it usually sends the RGB image to the system-on chip (SoC), which determines the driving waveform and sends the driving waveform to the timer control register (tcon) of the ink screen, and drives the ink screen to display the image according to the driving waveform. The system-on chip is a dedicated integrated circuit that determines the driving waveform of the ink screen, and has a high cost. Summary of the invention

[0006] The purpose of the present application is to provide a display method, a readable medium and an electronic device.

[0007] A first aspect of the present application provides a display method, which is applied to an electronic device, wherein the electronic device includes an ink screen, and includes: detecting a first screen refresh event; corresponding to determining that the screen refresh event belongs to a first type of refresh event, using a first module to generate first drawing data corresponding to the first screen refresh event, and driving the ink screen to refresh based on the first drawing data; corresponding to determining that the screen refresh event belongs to a second type of refresh event, using a second module to generate second drawing data corresponding to the first screen refresh event, and driving the ink screen to refresh based on the second drawing data; wherein the first module and the second module are different software modules in the electronic device.

[0008] In the embodiment of the present application, the first screen refresh event can be a handwriting operation of a user through a stylus, or a page refresh operation such as a click, slide, or page turning of the current screen by the user; the first type of refresh event can be a page refresh operation; the first module can be a layer synthesis main thread of a graphics synthesis service of a framework layer of an electronic device; the first drawing data is global data to be displayed; the second type of refresh event can be a handwriting refresh event; the second module can be a stylus service of a framework layer of an electronic device; the second drawing data is local data to be displayed. The electronic device detects a first screen refresh event, for example, a handwriting operation of a user through a stylus is detected, or for example, a page refresh operation such as a click, slide, or page turning of the current screen is detected by the user; corresponding to the first screen refresh event being a first type of refresh event, the electronic device uses the first module to generate first drawing data corresponding to the first screen refresh event; corresponding to the first screen refresh event being a second type of refresh event, the electronic device uses the second module to generate second drawing data corresponding to the first screen refresh event; based on the first drawing data / the second drawing data, the corresponding driving waveform is determined and the ink screen is driven to refresh.

[0009] In a possible implementation of the first aspect, detecting the first screen refresh event includes: detecting a page turning operation of a user, and determining that the first screen refresh event occurs; or detecting a handwriting operation of the user, and determining that the first screen refresh event occurs.

[0010] In an embodiment of the present application, the electronic device detects a first screen refresh event, for example, detecting a handwriting operation of a user using a stylus, or for example, detecting a page refresh operation such as a click, slide, or page turn of the current screen by the user.

[0011] In a possible implementation of the first aspect above, the first type of refresh event includes a page refresh event, and corresponding to determining that the screen refresh event belongs to the first type of refresh event, a first module is used to generate first drawing data corresponding to the first screen refresh event, including: obtaining the display content of the page corresponding to the first screen refresh event, and drawing at least one display layer based on the display content of the page; and using the first module to perform layer synthesis on at least one display layer to obtain first drawing data.

[0012] In an embodiment of the present application, the display content of the page may be a page view of an application window displayed on the ink screen. When the electronic device detects a page refresh operation, the page view of the application window displayed on the ink screen is drawn to obtain at least one display layer, and the globally refreshed content (at least one display layer) is layer synthesized to generate global data to be displayed.

[0013] In a possible implementation of the first aspect above, a first synthesis frequency of the first module synthesizing the layer is less than or equal to a display refresh frequency of the ink screen.

[0014] In the embodiment of the present application, the first synthesis frequency may be the layer synthesis frequency (first frequency), and the display refresh frequency of the ink screen may be the refresh frequency of the ink screen. If the first frequency is less than the refresh frequency of the ink screen, that is, the first frequency is reduced, the power consumption of the electronic device can be reduced and the probability of afterimages when the page is refreshed can be reduced.

[0015] In a possible implementation of the first aspect above, the second type of refresh event includes a local refresh event, and corresponding to determining that the screen refresh event belongs to the second type of refresh event, a second module is used to generate second drawing data corresponding to the first screen refresh event, including: determining a second refresh area of ​​the ink screen corresponding to the first screen refresh event; obtaining contact point reporting data of the first screen refresh event in the second refresh area, wherein the contact point reporting data includes position information and pixel information; and using the second module to generate second drawing data based on the contact point reporting data in the second refresh area.

[0016] In the embodiment of the present application, the second refresh area may be a local area, and the contact point reporting data may be electric shock information. The electronic device detects a handwriting operation, obtains the local area (handwriting area) of the handwriting operation on the ink screen and the contact point information in the local area, and draws the content written by the user with the stylus in the local area based on the contact point information to obtain local data to be displayed.

[0017] In a possible implementation of the first aspect above, driving the ink screen to refresh based on the first drawing data includes: converting the first drawing data into first grayscale data; determining a first driving waveform signal corresponding to the first drawing data based on the first grayscale data; and driving the ink screen to refresh based on the first driving waveform signal.

[0018] In the embodiment of the present application, the first grayscale data may be a grayscale image, and the first driving signal waveform may be a level signal. The electronic device performs image conversion on the global data to be displayed to obtain a grayscale image; determines a driving waveform based on the grayscale image and converts the driving waveform into a level signal to drive the ink screen to update and display the global data to be displayed.

[0019] In a possible implementation of the first aspect above, converting the first drawing data into first grayscale data includes: determining the timing of each pixel in the first drawing data; and filling each pixel with grayscale pixels according to the timing of each pixel in a page corresponding to the first screen refresh event to obtain the first grayscale data.

[0020] In an embodiment of the present application, the image conversion process includes: the electronic device performs timing encapsulation and pixel filling on the acquired global data to be displayed to obtain a corresponding grayscale image. The timing encapsulation can be to determine the timing of each pixel in the global data to be displayed. The pixel filling can be to fill each pixel with grayscale pixels according to the timing of each pixel in the page corresponding to the page refresh event.

[0021] In a possible implementation of the first aspect above, determining a first drive waveform signal corresponding to first drawing data based on first grayscale data includes: determining a pixel position and a pixel value of each pixel in the first grayscale data; determining a drive value of each pixel based on the pixel value of each pixel to form a first drive waveform; and converting the first drive waveform into a first drive waveform signal.

[0022] In the embodiment of the present application, the first driving waveform may be a driving waveform. The electronic device obtains the pixel position and pixel value of each pixel point in the grayscale image, and according to the grayscale value of each pixel point on the grayscale image, obtains the driving waveform corresponding to each pixel position on the ink screen by looking up the table, and stores the obtained driving waveform; and converts the driving waveform into a level signal.

[0023] In a possible implementation of the first aspect above, the system running on the electronic device is an Android system, and the first module and the second module are located in a framework layer of the electronic device.

[0024] In an embodiment of the present application, the system running on the electronic device is the Android system, and the layer synthesis main thread and the stylus service are located in the framework layer of the electronic device.

[0025] In a possible implementation of the first aspect, detecting the first screen refresh event further includes: using a third module to detect the first screen refresh event, wherein the third module is located in a kernel layer of the electronic device.

[0026] In the embodiment of the present application, the third module is a driver module of the kernel layer of the electronic device. The driver module of the kernel layer of the electronic device detects a handwriting operation or a page refresh operation.

[0027] In a possible implementation of the first aspect above, driving the ink screen to refresh based on the first drawing data includes: using a fourth module to convert the first drawing data into first grayscale data, wherein the fourth module is located in the frame layer of the electronic device; using a third module to determine a first drive waveform signal corresponding to the first drawing data based on the first grayscale data, and driving the ink screen to refresh based on the first drive waveform signal.

[0028] In the embodiment of the present application, the fourth module is a soft tcon subthread of the graphics synthesis service of the framework layer of the electronic device. The soft tcon subthread of the graphics synthesis service of the framework layer of the electronic device converts the global data to be displayed into a grayscale image, and the driver module of the core layer of the electronic device determines the corresponding driving waveform based on the grayscale image, and further converts it into a level signal, and drives the ink screen to refresh based on the level signal.

[0029] A second aspect of the present application provides a readable medium on which instructions are stored. When the instructions are executed on an electronic device, the electronic device executes any one of the methods in the first aspect.

[0030] The third aspect of the present application provides an electronic device, comprising a memory for storing instructions executed by one or more processors of the electronic device, and a processor, which is one of the processors of the electronic device, for executing any one of the methods in the above-mentioned first aspect.

[0031] A fourth aspect of the present application provides a program product, which includes instructions. When the instructions are executed by an electronic device, the electronic device can implement any one of the methods in the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0033] Figure 1a A schematic diagram of an application scenario is shown according to an embodiment of the present application;

[0034] Figure 1b A schematic diagram showing another application scenario according to an embodiment of the present application;

[0035] Figure 2a According to an embodiment of the present application, a schematic diagram of the structure of an ink screen is shown;

[0036] Figure 2b According to an embodiment of the present application, a schematic diagram of the structure of another ink screen is shown;

[0037] Figure 3 According to an embodiment of the present application, a schematic diagram of a process for realizing an ink screen display function by a hardware method is shown;

[0038] Figure 4 A schematic diagram of a software architecture of an electronic device is shown according to an embodiment of the present application;

[0039] Figure 5 According to an embodiment of the present application, a schematic flow chart of a process of implementing a driving waveform determination in a software system of an electronic device is shown;

[0040] Figure 6 A schematic diagram of a layer is shown according to an embodiment of the present application;

[0041] Figure 7a According to an embodiment of the present application, a flow chart of a display method is shown;

[0042] Figure 7b A schematic diagram of a software architecture of another electronic device is shown according to an embodiment of the present application;

[0043] Figure 8 According to an embodiment of the present application, another flowchart of a process of determining a driving waveform in a software system of an electronic device is shown;

[0044] Figure 9a According to an embodiment of the present application, a flow chart of another display method is shown;

[0045] Figure 9b According to an embodiment of the present application, a schematic diagram of a local area is shown;

[0046] Fig.10 According to an embodiment of the present application, a schematic flow chart of a display method combining modules is shown;

[0047] Fig.11 According to an embodiment of the present application, a schematic diagram of an interactive process of a display method is shown;

[0048] Fig.12 According to an embodiment of the present application, a structural schematic diagram of an electronic device is shown. DETAILED DESCRIPTION

[0049] Illustrative embodiments of the present application include, but are not limited to, a display method, a readable medium, and an electronic device.

[0050] In order to make the objectives, technical solutions and advantages of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and comprehensively described below in conjunction with the accompanying drawings.

[0051] The display method provided in the embodiments of the present application can be applied to any electronic device with an ink screen, such as a mobile phone, a smart screen, a tablet computer, a laptop computer, a netbook, a PDA, an e-book, an electronic writing board, an electronic sign, a wearable device, a teaching device, an Internet of Things (IOT) device, or a wireless terminal in a smart home. Exemplary embodiments of electronic devices include but are not limited to devices equipped with an ink screen. Or electronic devices with other operating systems. The embodiments of the present application do not impose any restrictions on the specific types of electronic devices.

[0052] For example, Figure 1a This is a schematic diagram of a scenario applicable to the embodiment of the present application. Figure 1a As shown, the electronic device 100 has an ink screen 101. The ink screen 101 can display the content of an application (application, APP) installed in the electronic device 100. In some embodiments, the electronic device 100 also supports a handwriting function, see Figure 1b Another scenario diagram to which the embodiment of the present application is applicable is shown, in which the electronic device 100 has an ink screen 102. The ink screen 102 can display the display content of the APP installed in the electronic device 100, as well as the content drawn by the user with a stylus, such as Figure 1b The notes include "The light boat has passed through thousands of mountains" etc.

[0053] Before introducing the technical solutions involved in the embodiments of the present application, some of the terms included in the embodiments of the present application are explained first.

[0054] (1) Ink display

[0055] An ink screen is a screen that does not emit light itself but relies on external reflections to achieve display effects. Its display effect is very similar to that of paper materials, so it can be compared to the experience of reading paper materials. The ink droplets in the ink screen are an electrochemical material, which relies on the movement of black and white ink droplets under an electric field to change the displayed content.

[0056] For example, Figure 2a A schematic diagram of the structure of the ink screen provided in an embodiment of the present application. Figure 2a Can be Figure 1a A cross-sectional view of the ink screen 101 in FIG. Figure 2a As shown, the ink screen includes a large number of ink droplets 203, also called microcapsules, and the ink droplets 203 contain clear liquid and white particles 204 and black particles 205 suspended in the clear liquid. The white particles 204 have positive charges, and the black particles 205 have negative charges. The ink screen also includes a top transparent electrode 201 and a bottom electrode 202 for applying an electric field to control the movement of the white particles 204 and the black particles 205 in the ink droplets 203.

[0057] For example, Figure 2a As shown in the ink droplet 203, the electric field is set to positive, and a positive voltage is applied to the bottom electrode 202. The white particles 204 with positive charge in the ink droplet 203 move toward the top of the ink droplet under the action of the electric field, that is, move upward toward the screen, thereby displaying white on the ink screen. At the same time, the black particles 205 in the ink droplet 203 move to the bottom of the ink droplet under the action of the electric field, thereby hiding the black.

[0058] For example, Figure 2b As shown in the ink droplet 203, the electric field is set to negative, and a negative voltage is applied to the bottom electrode 202. The black particles 205 in the ink droplet 203 move toward the top of the ink droplet under the action of the electric field, that is, move upward in the screen, thereby displaying black on the ink screen. At the same time, the white particles 204 in the ink droplet 203 move to the bottom of the ink droplet under the action of the electric field, thereby hiding the white.

[0059] It can be understood that the electric field applied by the top transparent electrode 201 and the bottom electrode 202 can control the movement of the white particles 204 and the black particles 205 in the ink droplets 203, so that the ink screen can present colors and display content. Among them, the colors include white, black, and grayscales between white and black (also called grayscales). The embodiment of the present application does not limit the number of grayscales, for example, 16 grayscales, 32 grayscales, etc.

[0060] The ink screen can receive a driving waveform and apply an electric field to the top transparent electrode 201 and the bottom electrode 202 according to the driving waveform, thereby controlling the ink screen to display an image.

[0061] As mentioned above, due to the black and white display principle of the ink screen, after the ink screen detects the display instruction, it needs to convert the color image (RGB image) into a grayscale image, and further look up the table according to the grayscale value of each pixel to obtain the driving waveform corresponding to the pixel position on the ink screen, and then drive the ink screen to display the image according to the driving waveform.

[0062] However, after the current ink screen detects a display instruction, it usually sends the RGB image to the system-level chip, which determines the driving waveform, sends the driving waveform to the timer control register of the ink screen, and drives the ink screen to display the image according to the driving waveform.

[0063] For example, reference Figure 3In the flowchart shown, when the electronic device 100 detects a handwriting operation by a user through a stylus, the ink screen is partially refreshed, that is, the locally refreshed content is drawn to obtain local data to be displayed, and the local data to be displayed is sent to the system-level chip through a serial peripheral interface (SPI). When the electronic device 100 detects a page refresh operation (such as a user turning pages or sliding on the current application interface of the electronic device 100), the ink screen is globally refreshed, that is, the globally refreshed content is drawn, a layer is generated and the layer is synthesized to obtain global data to be displayed, and the global data to be displayed is sent to the system-level chip through a mobile industry processor interface (MIPI). When the system-level chip receives the data to be displayed sent by the SPI interface or the MIPI interface, the data to be displayed is converted into a grayscale image, and further, according to the grayscale value of each pixel, a table is looked up to obtain a driving waveform corresponding to the pixel position on the ink screen, and then the driving waveform is sent to the ink screen to drive the ink screen to display an image according to the driving waveform.

[0064] However, the system-level chip is an integrated circuit dedicated to determining the ink screen driving waveform, that is, the process of determining the driving waveform is implemented by hardware, which is relatively costly.

[0065] In order to solve the above problems, the embodiment of the present application provides a display method, which implements the process of determining the driving waveform of the ink screen in the hardware abstraction layer and the kernel layer of the software system of the electronic device 100, thereby reducing the cost of use. Specifically, it can include: detecting a handwriting operation or a page refresh operation, and the graphics synthesis service of the framework layer draws the refresh content of the local area corresponding to the handwriting operation or the refresh content of the global area corresponding to the page refresh operation, and then sends the drawn image to the synthesis module of the hardware abstraction layer; the synthesis module performs layer synthesis to obtain a synthesized layer (RGB image), converts the synthesized layer into a grayscale image and sends it to the driver module of the kernel layer; the driver module determines the driving waveform based on the grayscale image, and then drives the ink screen to display the image according to the driving waveform.

[0066] For ease of understanding, the software architecture of the electronic device 100 is described below. The operating system and electronic equipment adopt layered architecture as an example. The layered architecture divides the software system into several layers, each layer has a clear role and division of labor, and the layers communicate with each other through software interfaces.

[0067] For example, reference Figure 4The schematic diagram of the software architecture of the electronic device 100 shown in FIG. 1 includes an application (APP) layer, a framework (framework) layer, a hardware abstract layer (HAL) and a kernel (kernal) layer from top to bottom.

[0068] The application layer is also called the application program layer, which includes the applications provided by the system to users, such as Figure 4 As shown, the application can be identified as application 1...application N, where N is a positive integer. The application includes but is not limited to: gallery, calendar, map, memo, note, reading, video, short message, etc. Application 1...application N can generate data to be displayed, and the electronic device 100 processes the data to be displayed and displays it on the display screen. In the embodiment of the present application, the display screen is an ink screen.

[0069] The framework layer is also called the framework service layer, which is used to provide application programming interfaces (APIs) and programming frameworks to the applications in the application layer. The framework layer can include some predefined functions, such as view modules and surface flingers. The view module is used to draw the layers of each application, and the surface flinger is used to implement page layout and drawing of the display interface.

[0070] The hardware abstraction layer is used to provide the framework layer with a common interface for calling drivers, such as the synthesis module (HWC module).

[0071] The kernel layer is also called the device driver layer, which is the layer between hardware and software. The device driver layer includes at least display driver and sensor driver. In the embodiment of the present application, a waveform module is also included to generate a drive waveform. The ink screen can apply an electric field according to the drive waveform, so that the ink screen displays an image.

[0072] It is understandable that the software system of the electronic device 100 can also adopt an event-driven architecture, a micro-kernel architecture, a micro-service architecture, a cloud architecture, etc., and this application does not impose any restrictions on this.

[0073] Combination Figure 4 The software architecture shown, Figure 5 According to an embodiment of the present application, a flowchart of a process of determining a driving waveform in a software system of an electronic device 100 is shown.

[0074] like Figure 5As shown, when the electronic device 100 detects the user's handwriting operation through the stylus, the ink screen is partially refreshed, that is, the graphics synthesis service of the framework layer draws the locally refreshed content, generates local data to be displayed, and sends the local data to be displayed to the HWC module of the hardware abstraction layer.

[0075] When the electronic device 100 detects a page refresh operation (for example, the user turns the page or slides the current application interface of the electronic device 100), the ink screen is globally refreshed, that is, the graphics synthesis service of the framework layer draws the globally refreshed content, generates global data to be displayed, and sends the global data to be displayed to the HWC module of the hardware abstraction layer.

[0076] The HWC module performs layer synthesis based on the received local data to be displayed or global data to be displayed, obtains a synthesized layer (RGB image), converts the synthesized layer into a grayscale image, and sends the grayscale image to the driver module of the kernel layer. Figure 6 As shown, the display area 60a includes a layer 601 and a layer 602. The HWC module can synthesize the layer 601 and the layer 602 to obtain a display image. It can be understood that the layer 601 and the layer 602 may overlap or not overlap.

[0077] The waveform module in the driving module determines the driving waveform based on the grayscale image, and then sends the driving waveform to the ink screen (ie, the display driver in the driving module of the kernel layer) through the MIPI interface to drive the ink screen to display the image according to the driving waveform.

[0078] Understandably, Figure 5 The display method shown no longer uses a system-level chip to determine the driving waveform of the ink screen, but instead determines the driving waveform of the ink screen through its own software system, thereby reducing costs.

[0079] However, the local refresh content corresponding to the handwriting operation of the stylus and the global refresh content corresponding to the page refresh operation are both drawn by the graphics synthesis service and sent to the HWC module for conversion into grayscale images, and the graphics synthesis service can only draw the next frame of content after completing the drawing of one frame of content (one refresh content).

[0080] When the electronic device 100 detects a handwriting operation performed by the user through the stylus, if the graphics synthesis service is processing the drawing of the refresh content of the previous frame (i.e., the last refresh), it is necessary to wait for the graphics synthesis service to complete the drawing of the refresh content of the previous frame, and then draw the local refresh content corresponding to the handwriting operation. Therefore, if the refresh content of the previous frame is a global refresh content, it may cause a delay in the drawing of the local refresh content, and then cause a delay in the display of the content written or drawn by the stylus (for example, a delay of 500 milliseconds).

[0081] In order to solve the above problems, an embodiment of the present application provides another display method, in which the software system of the electronic device 100 implements the process of determining the driving waveform, and the refresh content of the local refresh and the refresh content of the global refresh are drawn by different modules respectively, and then converted into grayscale images by the conversion module and sent to the driving module to determine the driving waveform. For example, the refresh content of the global refresh is drawn by the first module, and the refresh content of the local refresh is drawn by the second module. That is, the local data to be displayed corresponding to the handwriting operation and the global data to be displayed corresponding to the page refresh are asynchronously sent to the conversion module to be converted into grayscale images and further determine the driving waveform, and the drawing of the refresh content of the local refresh does not need to wait for the drawing of the refresh content of the global refresh of the previous frame to be completed, thereby shortening the delay caused by the display of the content written or drawn by the stylus (for example, a delay of 20 milliseconds).

[0082] It can be understood that the first module and the second module are different software modules in the software system of the electronic device 100 .

[0083] For example, Figure 7a According to an embodiment of the present application, a flow chart of a display method is shown. It can be understood that Figure 7a Each step of the process shown in the figure is performed by the electronic device 100. Figure 7a The execution entities of each step will not be described repeatedly in the steps of the process shown. Figure 7a As shown, the process includes but is not limited to the following steps:

[0084] S701: A first screen refresh event is detected.

[0085] In some embodiments, the electronic device 100 detects a first screen refresh event, for example, detecting a handwriting operation of a user using a stylus, or for example, detecting a page refresh operation such as a click, slide, or page turn of the current screen by the user.

[0086] S702: Determine the refresh event type.

[0087] In some embodiments, after the electronic device 100 detects the first screen refresh event, it determines the type of refresh event. If the result of the determination is a first type of refresh event, step S703 is executed to use the first module to generate first drawing data corresponding to the first screen refresh event; if the result of the determination is a second type of refresh event, step S704 is executed to use the second module to generate second drawing data corresponding to the first screen refresh event.

[0088] It can be understood that the first type of refresh event may be a page refresh event (global refresh event) and the second type of refresh event may be a handwriting refresh event (local refresh event).

[0089] S703: using the first module to generate first drawing data corresponding to the first screen refresh event.

[0090] In some embodiments, the first screen refresh event is a first type of refresh event, and the electronic device 100 uses a first module to generate first drawing data corresponding to the first screen refresh event.

[0091] It is understandable that if the software system running on the electronic device 100 is the Android system ( system), the first type of refresh event is a page refresh event, the first module can be a layer synthesis main thread of a graphics synthesis service of a framework layer of the electronic device 100, and the first drawing data is global data to be displayed.

[0092] S704: using a second module to generate second drawing data corresponding to the first screen refresh event.

[0093] In some embodiments, the first screen refresh event is a second type of refresh event, and the electronic device 100 uses a second module to generate second drawing data corresponding to the first screen refresh event.

[0094] It is understandable that if the software system running on the electronic device 100 is the Android system ( system), the second type of refresh event is a handwriting refresh event, the second module may be a pen service (pencil engine) of the framework layer of the electronic device 100, and the second drawing data is local data to be displayed.

[0095] S705: driving the ink screen to refresh based on the first drawing data / the second drawing data.

[0096] In some embodiments, the electronic device 100 determines a corresponding driving waveform based on the first drawing data / the second drawing data and drives the ink screen to refresh.

[0097] The electronic device 100 is equipped with Taking the operating system as an example, the display method provided in the embodiment of the present application is introduced.

[0098] For example, reference Figure 7b The schematic diagram of the software architecture of the electronic device 100 is shown in FIG. Figure 4 Compared with the schematic diagram of the software architecture shown in FIG, a stylus service is added to the framework layer, and the graphics synthesis service includes a layer synthesis main thread and a conversion module (soft tcon subthread).

[0099] Among them, the stylus service is used to partially refresh the ink screen when it detects the user's handwriting operation through the stylus, that is, to draw the locally refreshed content, generate local data to be displayed, and send the local data to be displayed to the soft tcon sub-thread of the graphics synthesis service.

[0100] The layer synthesis main thread is used to globally refresh the ink screen when a page refresh operation is detected (for example, the user turns the page or slides the current application interface of the electronic device 100), that is, to draw the globally refreshed content, generate global data to be displayed, and then send the global data to be displayed to the soft tcon sub-thread of the graphics synthesis service.

[0101] The soft tcon subthread is used to query a corresponding waveform file (waveform) based on the local data to be displayed or the global data to be displayed, and determine a grayscale image corresponding to the local data to be displayed or the global data to be displayed.

[0102] Combination Figure 7b The software architecture shown, Figure 8 According to an embodiment of the present application, another flowchart of a process of determining a driving waveform in a software system of an electronic device is shown.

[0103] like Figure 8 As shown, when the sensor driver of the driver module of the kernel layer of the electronic device 100 detects the handwriting operation of the user through the stylus, the ink screen is partially refreshed, that is, the stylus service of the framework layer draws the locally refreshed content, generates local data to be displayed, and sends the local data to be displayed to the soft tcon sub-thread of the graphics synthesis service.

[0104] When the sensor driver of the driver module of the kernel layer of the electronic device 100 detects a page refresh operation (for example, the user turns pages, slides, and other operations on the current application interface of the electronic device 100), the ink screen is globally refreshed, that is, the view module of the framework layer draws the application view (globally refreshed content), and then the layer synthesis main thread of the graphics synthesis service synthesizes the application view to generate global data to be displayed, and then the global data to be displayed is sent to the soft tcon sub-thread of the graphics synthesis service.

[0105] The soft tcon subthread of the graphics composition service determines a corresponding grayscale image based on the received local data to be displayed or global data to be displayed.

[0106] The waveform module in the driving module determines the driving waveform based on the grayscale image, and then sends the driving waveform to the ink screen (i.e., the display driver in the driving module of the core layer) to drive the ink screen to display the image according to the driving waveform. It can be understood that Figure 8In the display method shown, the refresh content of the local refresh and the refresh content of the global refresh are not drawn by the same module and then sent to the conversion module, but are drawn by different modules and then sent to the conversion module to determine the grayscale image, that is, they are sent to the conversion module asynchronously. Therefore, the drawing of the refresh content of the local refresh does not need to wait for the drawing of the refresh content of the previous frame to be completed, thereby shortening the delay (for example, 20 milliseconds) caused by the display of the content written or drawn by the stylus.

[0107] It is understandable that the above only takes the electronic device 100 as an example. Taking the operating system as an example, the display method provided by the embodiment of the present application is introduced. In other embodiments, the electronic device 100 may also be equipped with other operating systems. Figure 7b Each module in corresponds to a different software module in the software system of the electronic device 100.

[0108] In order to better understand the technical solution of the embodiment of the present application, Figure 1b Take the scenario shown in the figure as an example, combined with Figure 7b The software architecture shown provides a detailed introduction to some technical solutions of the present application.

[0109] Figure 9a According to an embodiment of the present application, a flow chart of a display method is shown. It can be understood that Figure 9a Each step of the process shown in the figure is performed by the electronic device 100. Figure 9a The execution entities of each step will not be described repeatedly in the steps of the process shown. Figure 9a As shown, the process includes but is not limited to the following steps:

[0110] S901: Draw the page view of the application.

[0111] In some embodiments, when the electronic device 100 detects a page refresh operation (for example, a user turning pages or sliding on the current application interface of the electronic device 100), the page view of the application window displayed on the ink screen is drawn (rendered) to obtain at least one display layer.

[0112] It can be understood that the application window displayed on the ink screen can be one, for example Figure 1a The application interface in the scene diagram shown in the figure; there may also be multiple application windows displayed on the ink screen, for example Figure 1b The application interface on the left and the application interface on the right in the scene shown. This application does not limit the specific number of application windows displayed on the ink screen.

[0113] S902: Determine the layer synthesis frequency of global refresh and the frequency of generating the driving waveform.

[0114] In some embodiments, the electronic device 100 determines the global refresh layer synthesis frequency (vysnc-app) as a first frequency (for example, 20hz), and determines the image conversion frequency (vysnc-tcon) as a second frequency (the refresh frequency of the ink screen is, for example, 85hz), that is, determines the display frequency as the second frequency, so that the layer synthesis main thread of the graphics synthesis service synthesizes the page view of the application according to the layer synthesis frequency, and the soft tcon sub-thread of the graphics synthesis service converts the RGB image into a grayscale image according to the grayscale image conversion frequency.

[0115] It can be understood that the layer synthesis frequency and the frequency of generating the driving waveform are the frequency control module ( Figure 7b not shown).

[0116] In some embodiments, the second frequency is the refresh frequency of the e-ink screen, and the first frequency is less than or equal to the refresh frequency of the e-ink screen. It can be understood that if the first frequency is set to be less than the refresh frequency of the e-ink screen, and the second frequency is equal to the refresh frequency of the e-ink screen, that is, lowering the first frequency can reduce the power consumption of the electronic device 100 and reduce the probability of residual images appearing when the page is refreshed.

[0117] S903: When the page refresh condition is met, layer synthesis is performed on the content of the global refresh area.

[0118] In some embodiments, the electronic device 100 globally refreshes the ink screen at a refresh frequency (first frequency), that is, performs layer synthesis on the globally refreshed content (page view of the application) to generate global data to be displayed.

[0119] For example, Figure 6 The layer 601 and the layer 602 shown are synthesized to obtain a synthesized image (global data to be displayed).

[0120] S904: A handwriting operation is detected, and the content of the partial refresh area is drawn.

[0121] In some embodiments, the electronic device 100 detects a user's handwriting operation using a stylus and partially refreshes the ink screen, that is, draws the locally refreshed content in a local area to generate local data to be displayed.

[0122] For example, the electronic device 100 detects a handwriting operation, obtains the local area (handwriting area) of the handwriting operation on the ink screen and the contact information in the local area, draws the content written by the user with the stylus in the local area based on the contact information, and obtains local data to be displayed.

[0123] It can be understood that the contact information may include position information and pixel information.

[0124] For example, reference Figure 9b As shown in the schematic diagram of the local area, the electronic device 100 detects the contact information and handwriting area 901 of the handwriting operation on the ink screen, and draws the refresh content of the local area handwriting area 901 based on the contact information.

[0125] S905: Obtain global data to be displayed / local data to be displayed, and convert it into a grayscale image.

[0126] In some embodiments, the electronic device 100 acquires global data to be displayed or local data to be displayed at a second frequency (eg, 85 Hz), and performs image conversion on the acquired global data to be displayed or local data to be displayed to obtain a grayscale image.

[0127] It can be understood that the global data to be displayed and the local data to be displayed are usually RGB images.

[0128] In some embodiments, the image conversion process includes: the electronic device 100 performs time-sequential packaging and pixel filling on the acquired global data to be displayed or local data to be displayed to obtain a corresponding grayscale image.

[0129] It can be understood that timing encapsulation can be to determine the timing of each pixel in the global data to be displayed or the local data to be displayed. Pixel filling can be to fill each pixel with grayscale pixels according to the timing of each pixel in the page corresponding to the page refresh event, or to fill each pixel with grayscale pixels according to the timing of each pixel in the local area corresponding to the handwriting refresh event.

[0130] Understandable, combined Figure 7b In the software architecture shown in FIG. 1 , the above step S903 (drawing of refresh content of global refresh) is executed by the layer synthesis main thread of the graphic synthesis service of the electronic device 100, step S904 (drawing of refresh content of local refresh) is executed by the stylus service of the electronic device 100, and step S905 (image conversion) is executed by the soft tcon subthread of the graphic synthesis service of the electronic device 100. In other words, compared with the above Figure 5 In the display method shown, the drawing of refresh content (layer synthesis) and image conversion are executed by two different modules (the layer synthesis main thread of the graphics synthesis service and the soft tcon sub-thread of the graphics synthesis service). Even if the soft tcon sub-thread of the graphics synthesis service is blocked, it will not affect the drawing of the refresh content, that is, frame loss will not occur.

[0131] It can be understood that after the above step S903 (drawing of the refresh content of the global refresh) and the above step S904 (drawing of the refresh content of the local refresh) are drawn by different modules respectively, they are sent to the soft tcon sub-thread of the graphics synthesis service for image conversion, that is, the local data to be displayed corresponding to the handwriting operation and the global data to be displayed corresponding to the page refresh are asynchronously sent to the soft tcon sub-thread of the graphics synthesis service and the grayscale image is further determined. The drawing of the refresh content of the local refresh does not need to wait for the drawing of the refresh content of the previous frame to be completed, thereby shortening the delay caused by the display of the content written or drawn by the stylus.

[0132] S906: Determine and store a driving waveform based on the grayscale image.

[0133] In some embodiments, the electronic device 100 obtains the pixel position and pixel value of each pixel in the grayscale image, and according to the grayscale value of each pixel on the grayscale image, obtains the driving waveform corresponding to each pixel position on the ink screen by looking up the table, and stores the obtained driving waveform for subsequent processing.

[0134] S907: Convert the driving waveform into a level signal and drive the ink screen to display an image.

[0135] In some embodiments, the electronic device 100 converts the driving waveform into a level signal (data in TTL format) and drives the ink screen to update and display the global data to be displayed or the local data to be displayed.

[0136] It can be understood that the driving waveform can be MIPI data.

[0137] It can be understood that in other embodiments, according to actual needs, the above Figure 9a The steps shown can be combined, deleted or replaced with other steps that are conducive to achieving the purpose of this application. For example, the above-mentioned step S906 and step S907 can be combined into one step, and this application does not limit this.

[0138] Combination Figure 7b The software architecture shown, Fig.10 According to an embodiment of the present application, a flow chart of another display method is shown.

[0139] like Fig.10 As shown, the display method includes:

[0140] When the electronic device 100 detects the user's handwriting operation through the stylus, the ink screen is partially refreshed, that is, the stylus service of the framework layer draws the locally refreshed content, generates local data to be displayed, and sends the data to be displayed in the local area to the soft tcon sub-thread of the graphics synthesis service; the soft tcon sub-thread of the graphics synthesis service converts the received local data to be displayed into a grayscale image, and then sends the grayscale image to the waveform module of the driving module, the waveform module converts the grayscale image into a driving waveform and stores the driving waveform, the waveform module converts the driving waveform into TTL format through the bridge chip and sends it to the ink screen (that is, the display driver of the kernel layer) to drive the ink screen to display the image according to the driving waveform.

[0141] When the electronic device 100 detects a page refresh operation (for example, the user turns pages, slides, etc. on the current application interface of the electronic device 100), or globally refreshes the ink screen at the refresh frequency (first frequency), the layer synthesis main thread of the graphics synthesis service of the framework layer draws the globally refreshed content, generates global data to be displayed, and then sends the global data to be displayed to the soft tcon sub-thread of the graphics synthesis service; the soft tcon sub-thread of the graphics synthesis service converts the received global data to be displayed into a grayscale image, and then sends the grayscale image to the waveform module of the driving module, the waveform module converts the grayscale image into a driving waveform and stores the driving waveform, the waveform module converts the driving waveform into TTL format through the bridge chip and sends it to the ink screen (that is, the display driver of the kernel layer) to drive the ink screen to display the image according to the driving waveform.

[0142] Among them, the process of the soft tcon sub-thread of the graphics synthesis service converting the received local data to be displayed or global data to be displayed into a grayscale image may include: obtaining the local data to be displayed or the global data to be displayed; performing time packaging and pixel filling on the local data to be displayed or the global data to be displayed to obtain a grayscale image.

[0143] It can be understood that both the local data to be displayed and the global data to be displayed are RGB images. The bridge chip can be any chip that can realize the waveform data format conversion function.

[0144] Fig.11 According to an embodiment of the present application, a schematic diagram of an interaction process of a display method is shown.

[0145] like Fig.11 As shown, the process includes but is not limited to the following steps:

[0146] S1101: The frequency control module 20 sends the layer synthesis frequency to the layer synthesis main thread 50 of the graphics synthesis service.

[0147] In some embodiments, the frequency control module 20 determines that the layer synthesis frequency is a first frequency (for example, 20hz), and sends the layer synthesis frequency to the layer synthesis main thread 50 of the graphics synthesis service, so that the layer synthesis main thread 50 of the graphics synthesis service synthesizes the page view of the application according to the layer synthesis frequency.

[0148] S1102: The frequency control module 20 sends the image conversion frequency to the soft tcon subthread 60 of the graphics composition service.

[0149] In some embodiments, the frequency control module 20 determines that the image conversion frequency is a second frequency (e.g., 85 Hz), and sends the image conversion frequency to the soft tcon sub-thread 60 of the graphics synthesis service, so that the soft tcon sub-thread 60 of the graphics synthesis service converts the RGB data into a grayscale image according to the frequency of the grayscale image conversion.

[0150] S1103 : The sensor driver 90 detects a page refresh operation by the user 10 .

[0151] In some embodiments, when it is detected that the user 10 has turned pages, slid, or performed other operations on the current application interface of the electronic device 100 , a page refresh operation is sent to the sensor driver 90 .

[0152] S1104 : the sensor driver 90 sends a page refresh event to the drawing module 30 .

[0153] In some embodiments, after receiving the page refresh operation, the sensor driver 90 obtains a page refresh event corresponding to the page refresh operation, and sends the page refresh event to the drawing module 30 .

[0154] It can be understood that the page refresh event includes the application interface corresponding to the refreshed page.

[0155] S1105: The drawing module 30 draws the application view.

[0156] In some embodiments, after receiving the page refresh event, the drawing module 30 draws the application view.

[0157] It can be understood that the refreshed page includes an application interface of at least one application program, and the drawing module 30 draws the application interface of the at least one application program to obtain an application view.

[0158] S1106: The drawing module 30 sends the application view to the layer synthesis main thread 50 of the graphics synthesis service.

[0159] In some embodiments, after the drawing module 30 completes drawing of the application view, it sends the application view to the layer synthesis main thread 50 of the graphics synthesis service, and the layer synthesis main thread 50 of the graphics synthesis service further processes the application view.

[0160] S1107: The layer synthesis main thread 50 of the graphics synthesis service performs layer synthesis on the application view.

[0161] In some embodiments, the layer synthesis main thread 50 of the graphics synthesis service performs layer synthesis on the received application layer at a first frequency to obtain a synthesized image (global data to be displayed).

[0162] S1108: The layer synthesis main thread 50 of the graphics synthesis service sends the global data to be displayed to the soft tcon sub-thread 60 of the graphics synthesis service.

[0163] In some embodiments, after the layer synthesis main thread 50 of the graphics synthesis service obtains the global data to be displayed, it sends the global data to be displayed to the soft tcon sub-thread 60 of the graphics synthesis service, and the soft tcon sub-thread 60 of the graphics synthesis service performs image conversion on the global data to be displayed.

[0164] It can be understood that the global data to be displayed is an RGB image, and the global data to be displayed can be stored in the cache queue in the order of transmission, so that the soft tcon sub-thread 60 of the graphics synthesis service can obtain it from the cache queue, and the cache queue adopts the "first in, first out" rule.

[0165] S1109: The soft tcon subthread 60 of the graphics composition service converts the global data to be displayed into a grayscale image.

[0166] In some embodiments, the soft tcon subthread 60 of the graphics composition service converts the received global data to be displayed into a grayscale image at the second frequency.

[0167] It can be understood that the soft tcon sub-thread 60 of the graphics composition service can obtain the global data to be displayed from the cache queue at the second frequency, and convert the global data to be displayed into a grayscale image.

[0168] In some embodiments, the image conversion process includes: the soft tcon subthread 60 of the graphics synthesis service performs time-series packaging and pixel filling on the acquired global data to be displayed to obtain a corresponding grayscale image.

[0169] S1110 : The soft tcon subthread 60 of the graphics synthesis service sends a grayscale image to the waveform module 70 .

[0170] In some embodiments, after obtaining the grayscale image, the soft tcon subthread 60 of the graphics composition service sends the grayscale image to the waveform module 70 for waveform determination.

[0171] S1111 : The waveform module 70 generates a driving waveform based on the grayscale image.

[0172] In some embodiments, after receiving the grayscale image, the waveform module 70 looks up the table to obtain the driving waveform corresponding to each pixel position on the ink screen according to the grayscale value of each pixel point on the grayscale image, and stores the obtained driving waveform for subsequent processing.

[0173] S1112 : The waveform module 70 sends a driving waveform to the bridge chip 80 .

[0174] In some embodiments, the waveform module 70 sends the driving waveform to the bridge chip 80 through the MIPI interface.

[0175] S1113: The bridge chip 80 converts the driving waveform into a waveform in a level format.

[0176] In some embodiments, after receiving the driving waveform sent by the waveform module 70 , the bridge chip 80 converts the driving waveform into a waveform in a level format (TTL).

[0177] S1114 : the bridge chip 80 sends a waveform in a level format to the display driver 11 .

[0178] In some embodiments, after the bridge chip 80 obtains the waveform in the level format, it sends the waveform in the level format to the display driver 11, so that the display driver drives the ink screen to display the global data to be displayed based on the waveform in the level format.

[0179] S1115 : The sensor driver 90 detects the handwriting operation of the user 10 .

[0180] In some embodiments, a handwriting operation of the user 10 on the current application interface of the electronic device 100 is detected, and the handwriting operation is sent to the sensor driver 90 .

[0181] S1116 : The sensor driver 90 sends a handwriting event to the stylus service 40 .

[0182] In some embodiments, after receiving a handwriting operation, the sensor driver 90 obtains a handwriting event corresponding to the handwriting operation and sends the handwriting event to the stylus service 40 .

[0183] It can be understood that the handwriting event includes the contact information of the stylus on the ink screen.

[0184] S1117: The stylus service 40 draws the handwritten content.

[0185] In some embodiments, after receiving a handwriting event, the stylus service 40 draws the handwriting content based on the handwriting event to obtain partial data to be displayed.

[0186] S1118: The stylus service 40 sends the local data to be displayed to the soft tcon subthread 60 of the graphics composition service.

[0187] In some embodiments, after obtaining the local data to be displayed, the stylus service 40 sends the local data to be displayed to the soft tcon sub-thread 60 of the graphics synthesis service, and the soft tcon sub-thread 60 of the graphics synthesis service performs image conversion on the local data to be displayed.

[0188] It can be understood that the local data to be displayed is an RGB image. If the soft tcon subthread 60 of the graphics synthesis service is processing data, the local data to be displayed is obtained after the processing is completed and image conversion processing is performed.

[0189] S1119: The soft tcon subthread 60 of the graphics composition service converts the global data to be displayed into a grayscale image.

[0190] S1120: The soft tcon subthread 60 of the graphics synthesis service sends a grayscale image to the waveform module 70.

[0191] S1121: The waveform module 70 generates a driving waveform based on the grayscale image.

[0192] S1122 : The waveform module 70 sends a driving waveform to the bridge chip 80 .

[0193] S1123: The bridge chip 80 converts the driving waveform into a waveform in a level format.

[0194] S1124 : the bridge chip 80 sends a waveform in a level format to the display driver 11 .

[0195] It can be understood that steps S1119 to S1124 can refer to the above-mentioned steps S1109 to S1114, and this application will not elaborate on them here.

[0196] In summary, in the display method provided by the embodiment of the present application, the refresh content of the local refresh and the refresh content of the global refresh are not drawn by the same module and then sent to the conversion module, but are drawn by different modules and then sent to the conversion module to determine the grayscale image, that is, they are sent to the conversion module asynchronously. Therefore, the drawing of the refresh content of the local refresh does not need to wait for the drawing of the refresh content of the previous frame to be completed, thereby shortening the delay caused by the display of the content written or drawn by the stylus.

[0197] In order to better understand the technical solutions of the embodiments of the present application, the structure of the equipment involved in the present application is introduced below with reference to the accompanying drawings.

[0198] For example, Fig.12 According to an embodiment of the present application, a structural schematic diagram of an electronic device 100 is shown.

[0199] like Fig.12 As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, an interface module 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0200] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0201] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and / or a neural network processor (neural-network processing unit, NPU), etc. Among them, different processing units can be independent devices or integrated in one or more processors. The processor 110 can be used to execute the display method provided in the embodiment of the present application.

[0202] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0203] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0204] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a MIPI interface, an SPI interface, a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc. In some embodiments, the electronic device 100 sends image data and waveform data through interfaces such as the MIPI interface and the SPI interface.

[0205] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the display screen 194 communicate via the DSI interface to realize the display function of the electronic device 100.

[0206] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0207] The mobile communication module 150 can provide wireless communication solutions including 2G / 3G / 4G / 5G etc. applied on the electronic device 100 .

[0208] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN), blue tooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc. for application in the electronic device 100.

[0209] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0210] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light emitting diode or an active-matrix organic light emitting diode (AMOLED), a flexible light-emitting diode (FLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1. In the embodiment of the present application, the display screen 194 is an ink screen.

[0211] The external memory interface 120 may be used to connect an external memory card to expand the storage capacity of the electronic device 100 .

[0212] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as an image playback function), etc. The data storage area may store data (such as image data) created during the use of the electronic device 100, etc. In addition, the internal memory 121 may include a high-speed random access memory and may also include a non-volatile memory. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor. In some implementation examples, the processor 110 executes the display method provided in the embodiment of the present application by running instructions stored in the memory 120.

[0213] The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

[0214] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 194. The pressure sensor 180A can include a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, etc. When a touch operation is applied to the display screen 194, the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic device 100 can also calculate the position of the touch according to the detection signal of the pressure sensor 180A. In some embodiments, the electronic device 100 detects the handwriting operation and page refresh operation (sliding, turning pages, etc.) of the user through the pressure sensor 180A.

[0215] The various embodiments of the mechanism disclosed in the present application can be implemented in hardware, software, firmware or a combination of these implementation methods. The embodiments of the present application can be implemented as a computer program or program code executed on a programmable system, which includes at least one processor, a storage system (including volatile and non-volatile memory and / or storage elements), at least one input device and at least one output device.

[0216] Program code may be applied to input instructions to perform the functions described herein and to generate output information. The output information may be applied to one or more output devices in a known manner. For purposes of this application, a processing system includes any system having a processor such as, for example, a digital signal processor (DSP), a microcontroller, an application specific integrated circuit (ASIC), or a microprocessor.

[0217] Program code can be implemented with high-level programming language or object-oriented programming language to communicate with the processing system. When necessary, program code can also be implemented with assembly language or machine language. In fact, the mechanism described in this application is not limited to the scope of any specific programming language. In either case, the language can be a compiled language or an interpreted language.

[0218] In some cases, the disclosed embodiments may be implemented in hardware, firmware, software, or any combination thereof. The disclosed embodiments may also be implemented as instructions carried or stored on one or more temporary or non-temporary machine-readable (e.g., computer-readable) storage media, which may be read and executed by one or more processors. For example, instructions may be distributed over a network or through other computer-readable media. Therefore, a machine-readable medium may include any mechanism for storing or transmitting information in a machine (e.g., computer) readable form, including, but not limited to, a floppy disk, an optical disk, an optical disk, a magneto-optical disk, a read-only memory (ROM), a random access memory (RAM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic card or an optical card, a flash memory, or a tangible machine-readable memory for transmitting information (e.g., a carrier wave, an infrared signal, a digital signal, etc.) using the Internet in an electrical, optical, acoustic, or other form of propagation signal. Accordingly, machine-readable media include any type of machine-readable media suitable for storing or transmitting electronic instructions or information in a form readable by a machine (eg, a computer).

[0219] In the accompanying drawings, some structural or method features may be shown in a specific arrangement and / or order. However, it should be understood that such a specific arrangement and / or order may not be required. Instead, in some embodiments, these features may be arranged in a manner and / or order different from that shown in the illustrative drawings. In addition, the inclusion of structural or method features in a particular figure does not mean that such features are required in all embodiments, and in some embodiments, these features may not be included or may be combined with other features.

[0220] It should be noted that the units / modules mentioned in the various device embodiments of the present application are all logical units / modules. Physically, a logical unit / module can be a physical unit / module, or a part of a physical unit / module, or can be implemented as a combination of multiple physical units / modules. The physical implementation method of these logical units / modules themselves is not the most important. The combination of functions implemented by these logical units / modules is the key to solving the technical problems proposed by the present application. In addition, in order to highlight the innovative part of the present application, the above-mentioned device embodiments of the present application do not introduce units / modules that are not closely related to solving the technical problems proposed by the present application, which does not mean that there are no other units / modules in the above-mentioned device embodiments.

[0221] It should be noted that in the examples and description of this patent, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "including one" do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0222] Although the present application has been illustrated and described with reference to certain preferred embodiments thereof, it will be apparent to those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present application.

Claims

1. A display method, characterized in that: Applicable to electronic devices, wherein the electronic devices include an ink screen, including: The first screen refresh event is detected; In response to determining that the screen refresh event belongs to the first type of refresh event, using a first module to generate first drawing data corresponding to the first screen refresh event, and driving the ink screen to refresh based on the first drawing data; In response to determining that the screen refresh event belongs to the second type of refresh event, using a second module to generate second drawing data corresponding to the first screen refresh event, and driving the ink screen to refresh based on the second drawing data; The first module and the second module are different software modules in the electronic device.

2. The method according to claim 1, characterized in that The detecting of the first screen refresh event comprises: Detecting a page turning operation by the user and determining that a first screen refresh event occurs; or A handwriting operation of the user is detected, and it is determined that a first screen refresh event occurs.

3. The method according to claim 1, characterized in that The first type of refresh event includes a page refresh event, and The step corresponding to determining that the screen refresh event belongs to the first type of refresh event, using a first module to generate first drawing data corresponding to the first screen refresh event includes: Acquire the display content of the page corresponding to the first screen refresh event, and draw at least one display layer based on the display content of the page; The first module is used to perform layer synthesis on the at least one display layer to obtain the first drawing data.

4. The method according to claim 3, characterized in that The first synthesis frequency of the first module synthesis layer is less than or equal to the display refresh frequency of the ink screen.

5. The method according to claim 1, characterized in that The second type of refresh event includes a partial refresh event, and The step corresponding to determining that the screen refresh event belongs to the second type of refresh event, using a second module to generate second drawing data corresponding to the first screen refresh event includes: Determine that the first screen refresh event corresponds to a second refresh area of ​​the ink screen; Acquire the touch point reporting data of the first screen refresh event in the second refresh area, wherein the touch point reporting data includes position information and pixel information; The second module is used to generate the second drawing data in the second refresh area based on the contact point reporting data.

6. The method according to claim 1, characterized in that The driving the ink screen to refresh based on the first drawing data includes: converting the first drawing data into first grayscale data; determining a first driving waveform signal corresponding to the first drawing data based on the first grayscale data; The ink screen is driven to be refreshed based on the first driving waveform signal.

7. The method according to claim 6, characterized in that The converting the first drawing data into first grayscale data comprises: Determining the timing of each pixel in the first drawing data; In the page corresponding to the first screen refresh event, grayscale pixel filling is performed on each pixel point according to the time sequence of each pixel point to obtain first grayscale data.

8. The method according to claim 7, characterized in that The determining, based on the first grayscale data, a first driving waveform signal corresponding to the first drawing data comprises: Determine the pixel position and pixel value of each pixel in the first grayscale data; Based on the pixel values ​​of the respective pixel points, a driving value of each pixel point is determined to form a first driving waveform; The first driving waveform is converted into a first driving waveform signal.

9. The method according to claim 1, characterized in that: The electronic device runs an Android system, and the first module and the second module are located in the framework layer of the electronic device.

10. The method according to claim 9, characterized in that The detecting of the first screen refresh event further includes: A third module is used to detect the first screen refresh event, wherein the third module is located in the kernel layer of the electronic device.

11. The method according to claim 10, characterized in that The driving the ink screen to refresh based on the first drawing data includes: Using a fourth module to convert the first drawing data into first grayscale data, wherein the fourth module is located in the frame layer of the electronic device; The third module is used to determine a first driving waveform signal corresponding to the first drawing data based on the first grayscale data, and the ink screen is driven to refresh based on the first driving waveform signal.

12. A readable medium, characterized in that The readable medium stores instructions, which, when executed on an electronic device, enable the electronic device to execute the method according to any one of claims 1 to 11.

13. An electronic device, characterized in that: include: a memory for storing instructions to be executed by one or more processors of the electronic device, and The processor is one of the processors of the electronic device, and is used to execute the method according to any one of claims 1 to 11.

Images