Terminal equipment and display method

Abstract

The invention provides terminal equipment and a display method, which are applied to the technical field of terminals and are used for solving the problem of high power consumption during display of the terminal equipment. The terminal equipment comprises a first processing unit, a second processing unit and a display screen. The first processing unit is used for determining whether the current scene is a scene controlled by the second processing unit; the first processing unit is further used for generating processing data if the current scene is the scene controlled by the second processing unit; the second processing unit is used for synchronously processing data from the first processing unit and generating first display driving data according to the processed data; the display screen is used for displaying according to the first display driving data; the first processing unit is further used for generating second display driving data if the current scene is not the scene controlled by the second processing unit; and the display screen is used for displaying according to the second display driving data. The method is applied to the display process of the terminal equipment.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a terminal device and a display method. Background Art

[0002] With the continuous development and progress of terminal technology, the types and functions of terminal devices are becoming increasingly rich. While improving the performance of terminal devices, we also focus on reducing the power consumption of terminal devices. During the use of terminal devices, display power consumption has become a more prominent aspect of power consumption issues. Therefore, how to reduce the display power consumption of terminal devices without affecting the display effect has become a technical problem that needs to be solved urgently. Summary of the invention

[0003] The present application provides a terminal device and a display method, which reduce the display power consumption of the terminal device and improve the battery life of the terminal device without affecting the display effect.

[0004] In order to achieve the above technical objectives, the embodiments of the present application provide the following technical solutions:

[0005] In a first aspect, a terminal device is provided, the terminal device comprising a first processing unit, a second processing unit and a display screen; the first processing unit is used to determine whether the current scene is a scene controlled by the second processing unit; the first processing unit is also used to generate processing data if the current scene is a scene controlled by the second processing unit; the second processing unit is used to synchronize processing data from the first processing unit and generate first display drive data based on the processing data; the display screen is used to display according to the first display drive data; the first processing unit is also used to generate second display drive data if the current scene is not a scene controlled by the second processing unit; the display screen is used to display according to the second display drive data; wherein the first processing unit is a high power consumption processing unit and the second processing unit is a low power consumption processing unit.

[0006] Based on the above scheme, in the scenario controlled by the second processing unit, the terminal device is first processed by the high-power first processing unit (such as AP) to obtain the processed data, and then the low-power second processing unit (such as CP) processes the data synchronously, generates display drive data, and sends the display drive data to the display. That is, the high-power first processing unit processes the data required for display, and the low-power second processing unit sends the processed data to the display screen for display. In this way, part of the display load on the high-power first processing unit is deployed to the low-power second processing unit, which reduces the display load of the high-power first processing unit and increases the sleep probability of the high-power first processing unit. Moreover, the low-power second processing unit has the ability to take over the display interaction in the application scenario, broadens the application scenario of the low-power second processing unit, and the low-power second processing unit has lower power consumption, which can reduce the overall power consumption of the terminal device and improve the battery life of the terminal device.

[0007] According to the first aspect, in a possible implementation, the first display driving data is generated by the second processing unit and is used to drive the display screen to display image data; the second display driving data is generated by the first processing unit and is used to drive the display screen to display image data.

[0008] According to the first aspect, in a possible implementation, the display screen is an electronic ink screen, and the processed data includes pre-processed data, the pre-processed data is the first graphic metadata drawn and generated by the first processing unit; the second processing unit is also used to generate first data to be displayed based on the pre-processed data; the second processing unit is also used to convert the first data to be displayed to generate first display driving data.

[0009] According to the first aspect, in a possible implementation manner, the first data to be displayed is a first graphic element control obtained by combining preprocessed data.

[0010] In some examples, the second processing unit combines the preprocessed data according to a preset method to generate first data to be displayed.

[0011] In other examples, the second processing unit generates first data to be displayed based on preprocessed data; the second processing unit reads pixel data in the first data to be displayed in parallel; the second processing unit converts the pixel data into grayscale data; and the second processing unit generates first display driving data based on the grayscale data.

[0012] Based on this design, the high-power first processing unit draws and generates pre-processed data, and the low-power second processing unit combines and converts the pre-processed data to generate the first display drive data. The low-power second processing unit processes the subsequent display load, which reduces the display load of the high-power first processing unit and can effectively reduce the overall power consumption of the terminal device.

[0013] According to the first aspect, in a possible implementation method, the display screen is an electronic ink screen, and the processed data includes conversion data, which is second graphics data generated after the first processing unit performs a conversion operation on the first graphics data generated by the first processing unit; the second processing unit is also used to generate second data to be displayed based on the conversion data; the second processing unit is also used to determine the second data to be displayed as the first display drive data.

[0014] According to the first aspect, in a possible implementation manner, the second data to be displayed is a second graphic element control obtained by combining the converted data.

[0015] In some examples, the second processing unit combines the converted data according to a preset method to generate second data to be displayed.

[0016] Based on this design, the high-power first processing unit generates conversion data, and the low-power second processing unit combines the pre-processed data to generate the second data to be displayed. The low-power second processing unit completes the display operation, which can speed up data processing and reduce the power consumption of the terminal device.

[0017] According to the first aspect, in a possible implementation, the first processing unit is further used to classify each graphic element in the currently displayed image; the first processing unit is further used to draw and generate processing data according to the classified graphic element elements.

[0018] In some examples, the metadata includes constant mode primitives, enumerable mode primitives, and combined mode primitives. A primitive is the most basic data unit displayed by a terminal device, and can be understood as valid data actually displayed in an image.

[0019] Based on this design, the high-power first processing unit does not need to draw and process the entire image, but only needs to draw and generate the processing data corresponding to each metadata according to the metadata contained in the image. While not affecting the image display effect, the data size is greatly reduced, and memory storage is optimized so that the display load can be executed based on the processing data with a smaller data volume in the future. It can effectively reduce the amount of data calculation and memory usage, thereby reducing the overall power consumption of the terminal device during display and improving the endurance of the terminal device.

[0020] According to the first aspect, in a possible implementation manner, the conversion operation includes: grayscale processing or timing processing.

[0021] According to the first aspect, in a possible implementation, the display screen is a non-electronic ink screen, and the processed data includes pre-processed data, which is the first graphic metadata drawn and generated by the first processing unit; the second processing unit is also used to combine the pre-processed data according to a preset method to generate first display drive data.

[0022] Based on this design, when the display screen of the terminal device is a non-electronic ink screen and the low-power second processing unit is currently controlling the scene, the high-power first processing unit generates processing data with a small amount of data, and the low-power second processing unit generates the first display drive data based on the processing data combination, which effectively reduces the amount of calculation of the display load processing data. In addition, the low-power second processing unit has the ability to take over the display interaction in the application scenario, which broadens the application scenario of the low-power second processing unit, and can also reduce the display power consumption of the terminal device and improve the endurance of the terminal device.

[0023] According to the first aspect, in a possible implementation, the second processing unit is further configured to take over the display control right from the first processing unit after synchronously processing the data from the first processing unit if the display control right belongs to the first processing unit.

[0024] According to the first aspect, in a possible implementation manner, the display control right is a right to control a display subsystem.

[0025] It should be understood that the display control right is the right to control the display subsystem, which is responsible for extracting image data from the memory and sending the processed image data to the display screen. At the same time, only one processing unit in the terminal device can have the display control right.

[0026] Based on this design, in the scenario controlled by the second processing unit, if the display control right belongs to the first processing unit, the display control right belonging to the high-power first processing unit will be switched to the low-power second processing unit. The low-power second processing unit takes over the display control right, can process the data synchronized from the high-power first processing unit, and send the processed data to the display screen for display, which can reduce the power consumption of the terminal device and improve the battery life of the terminal device.

[0027] According to the first aspect, in a possible implementation manner, the second processing unit controls a scene including a reading and browsing scene or a screen-on standby scene.

[0028] In a second aspect, a display method is provided, which is applied to a terminal device including a first processing unit, a second processing unit and a display screen, the method comprising: determining whether the current scene is a scene controlled by the second processing unit. If the current scene is a scene controlled by the second processing unit, after the processing data is generated by the first processing unit, the data is synchronously processed from the first processing unit by the second processing unit, and first display driving data is generated according to the processing data; display is performed according to the first display driving data; the first display driving data is generated by the second processing unit and is used to drive the image data displayed on the display screen. If the current scene is not a scene controlled by the second processing unit, second display driving data is generated by the first processing unit; display is performed according to the second display driving data; the second display driving data is generated by the first processing unit and is used to drive the image data displayed on the display screen.

[0029] According to the second aspect, in a possible implementation manner, the first processing unit is a high power consumption processing unit, and the second processing unit is a low power consumption processing unit.

[0030] According to the second aspect, in a possible implementation manner, the second processing unit controls a scene including a reading and browsing scene or a screen-on standby scene.

[0031] In some examples, the terminal device can determine whether the second processing unit is currently controlling the scene based on the application used by the user.

[0032] According to the second aspect, in a possible implementation, the display screen is an electronic ink screen, and the processed data includes pre-processed data, which is the first graphic metadata drawn and generated by the first processing unit; the first display driving data is generated by the second processing unit according to the processed data, including: generating first data to be displayed according to the pre-processed data by the second processing unit; and performing a conversion operation on the first data to be displayed to generate the first display driving data.

[0033] According to the second aspect, in a possible implementation manner, the first data to be displayed is a first graphic element control obtained by combining preprocessed data.

[0034] According to the second aspect, in a possible implementation method, the display screen is an electronic ink screen, and the processed data includes conversion data, which is second graphics data generated after the first processing unit performs a conversion operation on the first graphics data drawn and generated by the first processing unit; the first display driving data is generated by the second processing unit according to the processed data, including: generating second data to be displayed according to the conversion data by the second processing unit; and determining the second data to be displayed as the first display driving data.

[0035] According to the second aspect, in a possible implementation manner, the second data to be displayed is a second graphic element control obtained by combining the converted data.

[0036] According to the second aspect, in a possible implementation manner, the conversion operation includes: grayscale processing or timing processing.

[0037] According to the second aspect, in a possible implementation, generating processing data by the first processing unit includes: classifying each element of graphics data in the currently displayed image by the first processing unit; and generating processing data by drawing according to the classified graphics element data.

[0038] According to the second aspect, in a possible implementation method, the display screen is a non-electronic ink screen, and the processed data includes pre-processed data, which is the first graphic metadata drawn and generated by the first processing unit; the first display driving data is generated according to the processed data by the second processing unit, including: by the second processing unit, the pre-processed data is combined according to a preset method to generate the first display driving data.

[0039] According to the second aspect, in a possible implementation, after the second processing unit synchronously processes data from the first processing unit, the method further includes: if the display control right belongs to the first processing unit, the second processing unit taking over the display control right from the first processing unit.

[0040] According to the second aspect, in a possible implementation manner, the display control right is a right to control a display subsystem.

[0041] In a third aspect, a terminal device is provided, comprising: a processor and a memory, wherein the memory is coupled to the processor, and the memory is used to store computer-readable instructions. When the processor reads the computer-readable instructions from the memory, the terminal device executes the method of the second aspect or any one of the implementations of the second aspect.

[0042] In a fourth aspect, a chip system is provided, comprising at least one processor and at least one interface circuit, wherein the at least one interface circuit is used to perform transceiver functions and send instructions to the at least one processor, the at least one processor executes instructions, and the at least one processor executes the method of the second aspect or any one of the embodiments of the second aspect.

[0043] According to a fifth aspect, a computer-readable storage medium is provided, which includes a computer program. When the computer program runs on an electronic device, the electronic device executes the method according to the second aspect or any one of the embodiments of the second aspect.

[0044] According to a sixth aspect, a computer program product is provided. When the computer program product is run on a computer, the computer executes the method according to the second aspect or any one of the embodiments of the second aspect.

[0045] The technical effects corresponding to the second to sixth aspects and any implementation method in each aspect can be referred to the technical effects corresponding to the above-mentioned first aspect and any implementation method in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] Figure 1 A schematic diagram of the usage time of a terminal device in different scenarios provided in an embodiment of the present application;

[0047] Figure 2 A schematic diagram of a display framework flow chart of a terminal device provided in an embodiment of the present application;

[0048] Figure 3 A schematic diagram of the structure of a terminal device provided in an embodiment of the present application;

[0049] Figure 4 A schematic diagram of a system architecture of a terminal device provided in an embodiment of the present application;

[0050] Figure 5 A schematic diagram of the structure of a data collaborative management module provided in an embodiment of the present application;

[0051] Figure 6 A schematic diagram of the structure of a state collaborative management module provided in an embodiment of the present application;

[0052] Figure 7 A schematic diagram of the structure of a LiteTCON lightweight image processing module provided in an embodiment of the present application;

[0053] Figure 8 A flow chart of a display method provided in an embodiment of the present application;

[0054] Fig. 9 A schematic diagram of an interface provided in an embodiment of the present application;

[0055] Fig.10 A schematic diagram of generating display drive data provided by an embodiment of the present application;

[0056] Fig.11 A memory optimization schematic diagram provided for an embodiment of the present application;

[0057] Fig.12 A schematic diagram of a display effect provided in an embodiment of the present application;

[0058] Fig.13 A schematic diagram of a benefit effect provided by an embodiment of the present application;

[0059] Fig.14 A schematic diagram of another benefit effect provided by an embodiment of the present application;

[0060] Fig.15 A flowchart of another display method provided in an embodiment of the present application;

[0061] Fig.16 A schematic diagram of the structure of another terminal device provided in an embodiment of the present application;

[0062] Fig.17 A schematic diagram of the structure of another terminal device provided in an embodiment of the present application;

[0063] Fig.18 A schematic diagram of the structure of a chip system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0064] In the description of this application, unless otherwise specified, " / " indicates that the objects associated with each other are in an "or" relationship, for example, A / B can represent A or B; "and / or" in this application is merely a description of the association relationship between associated objects, indicating that three relationships may exist, for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural.

[0065] In the description of this application, unless otherwise specified, "plurality" means two or more than two. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b, or c can mean: a, b, c, a and b, a and c, b and c, a and b and c, where a, b, and c can be single or multiple.

[0066] In addition, in order to clearly describe the technical solutions of the embodiments of the present application, in the embodiments of the present application, words such as "first" and "second" are used to distinguish the same items or similar items with substantially the same functions and effects. Those skilled in the art can understand that words such as "first" and "second" do not limit the quantity and execution order, and words such as "first" and "second" do not necessarily limit the difference.

[0067] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a concrete way for easy understanding.

[0068] The features, structures or characteristics in this application may be combined in one or more embodiments in any suitable manner. In various embodiments of this application, the size of the sequence number of each process does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0069] Some optional features in the embodiments of the present application may be implemented independently in some scenarios without relying on other features to solve corresponding technical problems and achieve corresponding effects. They may also be combined with other features in some scenarios as needed.

[0070] In this application, unless otherwise specified, the same or similar parts between the various embodiments can refer to each other. In each embodiment of this application, if there is no special description and logical conflict, the terms and / or descriptions between different embodiments are consistent and can be referenced to each other, and the technical features in different embodiments can be combined to form new embodiments according to their inherent logical relationships. The implementation methods of this application do not constitute a limitation on the scope of protection of this application.

[0071] In addition, the network architecture and business scenarios described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. Ordinary technicians in this field can know that with the evolution of network architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0072] In order to better understand the technical solution of the present application, the technical terms and related concepts that may be involved in the embodiments of the present application are first introduced below.

[0073] 1. Heterogeneous collaborative display architecture

[0074] Heterogeneous collaborative display architecture is an architectural model for controlling device display. In some scenarios, heterogeneous collaborative display architecture may refer to the inclusion of different processing units (or computing modules, or computing units, or processing cores, etc.) in a device. Exemplarily, the processing unit may include but is not limited to an application processor (AP), a coprocessor (CP), a graphics processing unit (GPU), etc. Different operating systems (OS) can be deployed in these processing units, for example: an AP can be deployed with Embedded real-time operating systems such as Huawei LiteOS, Binary operating systems can be deployed on GPUs.

[0075] In some embodiments, when a device using a heterogeneous collaborative display architecture provides a display function, different processing units need to cooperate with each other, such as communicating, synchronizing data or status, etc. This execution logic of collaborating to complete the display function can be called heterogeneous collaborative display.

[0076] 2. E-ink screen

[0077] Electronic ink screen generally refers to ink screen, which uses electrophoretic display technology (EDP) to realize interface display. The display effect of electronic ink screen is very close to traditional paper, so it is also called "electronic paper".

[0078] The electronic ink screen is composed of two substrates, and a number of light-emitting units are arranged on the surface of the substrate. Each light-emitting unit can be regarded as a pixel. Countless small electronic inks are attached to the surface of the substrate. The electronic ink is composed of a number of liquid microcapsules. Each pixel corresponds to at least one liquid microcapsule, and positive and negative particles are sealed in the liquid microcapsules. Among them, the positive and negative particles have different colors. For example, positive particles are white and negative particles are black. When the input level is applied to the substrate, the positive and negative particles in the liquid microcapsule will be attracted and repelled respectively, reaching the two ends of the liquid microcapsule, so that each pixel appears black or white.

[0079] The electronic ink screen does not need a backlight. The ambient light hits the electronic ink screen, and then the electronic ink screen reflects the ambient light to the user's eyes. This method simulates the characteristics of ink and paper, ensuring that the text looks comfortable and clear under any light source.

[0080] 3. Lightweight timing controller (LiteTCON)

[0081] A lightweight timing controller is a timing controller that controls the display of an electronic ink screen. When the screen of a terminal device (such as a mobile phone) switches images under normal circumstances, the OS draws, renders, and synthesizes the image, and sends the synthesized image directly to the screen to complete the image switching. However, due to the physical characteristics of the electronic ink screen, each pixel changes according to its corresponding level change. Therefore, the image synthesized by the OS in the electronic ink screen needs to be strictly processed by the lightweight timing controller before it can be displayed normally on the electronic ink screen.

[0082] 4. CP full control display mode

[0083] The CP full control display mode is a mode in which a low-power processing unit controls the display interaction of the terminal device. For example, since the AP has very strong processing and computing capabilities and high computing power, the display interaction of the terminal device is usually completed by the AP (such as in a reading display scenario, the reading content is displayed in the reading area of ​​the display page, and the next page of content is displayed in response to user operations, etc.). The CP is a low-energy general-purpose processing unit with low computing power, and can only complete simple computing tasks (such as in a reading display scenario, the time and power are displayed in the status bar of the display page). In the CP full control display mode, the CP can achieve the same display effect as the AP, and the display interaction of the terminal device is completed by the CP (such as, in a reading display scenario, the reading content is displayed in the reading area of ​​the display page, and the next page of content is displayed in response to user operations, and the time and power are displayed in the status bar of the display page).

[0084] 5. Display control

[0085] The display subsystem (DSS) is a general term for display-related hardware, which is responsible for extracting image data from the memory and sending the processed image data to the display screen. The DSS can be controlled by the operating system in the processing unit. At the same time, the DSS can only be controlled by one processing unit. The right of this processing unit to control the DSS can be called display control rights.

[0086] For example, a device adopts a heterogeneous architecture, and the processing units included in the heterogeneous architecture include AP and CP. In some embodiments, when the device is in high-performance mode, DSS can be controlled by AP. When the device switches from high-performance mode to low-power mode, DSS can be switched from AP control to CP control, and CP takes over display control. The process of switching the control right of the processing unit to DSS between two processing units can be called display control switching.

[0087] At present, there are many types of terminal devices. Electronic ink screens can be applied to terminal devices with interface display functions such as mobile phones and tablet computers. Take the terminal device using electronic ink screen as an example. Figure 1 As shown, it is a schematic diagram of the usage time of a terminal device in different scenarios provided by an embodiment of the present application.

[0088] Understandably, Figure 1 The scenarios mentioned above are scenarios when users use terminal devices, and do not include lock screen standby scenarios when users are not using electronic ink screen terminal devices.

[0089] like Figure 1As shown in the figure, when using the terminal device with electronic ink screen, the usage time of reading and browsing scenarios (such as reading documents and browsing notes) is longer than that of other scenarios (such as entertainment and social interaction). Among them, the usage time of reading and browsing scenarios accounts for more than 50%. Correspondingly, the display power consumption of electronic ink screen terminal devices is mainly concentrated in the reading and browsing scenarios, that is, the display power consumption of electronic ink screen terminal devices in the reading and browsing scenarios is higher than that in other scenarios.

[0090] In the related technology, electronic ink screen terminal devices usually adopt a heterogeneous collaborative display architecture. When implementing the display service function, the display loads such as image drawing, rendering, and synthesis are usually uniformly handed over to the AP in the system for execution (such as the AP completing the display interaction when a certain application in the electronic ink screen terminal device is running). The CP is only responsible for simple display tasks (such as displaying simple controls such as clocks), and the application scenarios are limited. It cannot complete the display interaction when a certain application in the electronic ink screen terminal device is running. However, although the AP has strong computing power and can provide better display effects, the AP has high power consumption, resulting in high overall system power consumption when the electronic ink screen terminal device is displaying.

[0091] It is understandable that in the embodiment of the present application, the operations related to image display are referred to as display load. For example, as shown in Table 1, it is a display performance comparison table of electronic ink screen terminal devices of different brands provided in the embodiment of the present application.

[0092] Table 1

[0093]

[0094] According to the information shown in Table 1, the chip energy efficiency should be ranked from high to low as Chip 2 > Chip 3 > Chip 1.

[0095] According to the information shown in Table 1, the display load of Brand 1 is deployed on the AP, and the computing power and energy efficiency of the chip 1 used by Brand 1 are both low. Therefore, Brand 1 has low power consumption and high battery life, but the display effect is poor (clear reading, no ghosting problem). In addition, Brand 1 has an independent operating ecosystem with a single and closed system. Therefore, the functions of Brand 1 are relatively single, and applications of other systems cannot be quickly installed. In addition, the operation method is different from that of the mobile platform, and the user learning cost is high.

[0096] As shown in Table 1, the display loads of Brand 2 and Brand 3 are also deployed on the AP, and the computing power of Chip 2 and Chip 3 is high. Therefore, in terms of display effect, Brand 2 and Brand 3 have the same display effect, both can provide high-definition reading and page turning functions, and there will be no residual interference when the electronic ink screen switches images. However, the design process of Chip 2 and Chip 3 is different. Chip 2 has a better design process. Therefore, the energy efficiency of Chip 2 is higher than that of Chip 3, and Chip 2 has more advantages in base power consumption. That is, in terms of overall system power consumption, the overall system power consumption of Brand 2 is better than that of Brand 3. Moreover, Brand 2 and Brand 3 are compatible with the Android system. Therefore, Brand 2 and Brand 3 can use the Android system, can install various applications, and the operation method is the same as the Android system, and the user learning cost is low.

[0097] After understanding the display performance of the electronic ink screen terminal device in the related technology, the following introduces the processing flow of the display load when the electronic ink screen terminal device displays an image in the related technology.

[0098] For example, Figure 2 A schematic diagram of a display framework flow of an electronic ink screen terminal device provided in an embodiment of the present application is shown. Figure 2 As shown, the terminal device adopts a heterogeneous collaborative display architecture, in which the processing unit includes an AP with strong computing power and a CP with low power consumption. The terminal device system deploys all UI display loads on the AP.

[0099] like Figure 2 As shown, the system of the terminal device may include an application layer, a system layer, a driver layer, and a hardware layer.

[0100] It can be understood that in the embodiments of the present application, various operations performed by the terminal device that require consumption of power of the terminal device are referred to as loads.

[0101] In the embodiment of the present application, the application layer includes system applications (application, APP) and / or third-party applications that come with the terminal device.

[0102] Among them, system applications can also be called embedded applications, which are applications that are part of the functions implemented by the terminal device. Third-party applications can also be called downloadable applications. A downloadable application is an application that can provide its own Internet protocol multimedia subsystem (IMS) connection. The downloadable application can be an application pre-installed in the terminal device or can be an application downloaded and installed in the terminal device by the user.

[0103] In the embodiment of the present application, the application layer is used to determine the display content of the terminal device UI. Figure 2 As shown, the application layer includes reading applications, work applications, note applications, etc. If the reading application is started, the terminal device UI displays the reading content corresponding to the reading application (such as novel documents, chapters, novel names, time, etc.).

[0104] In an embodiment of the present application, the system layer includes a UI display load, and the UI display load includes UI drawing, UI rendering, compositor synthesis, grayscale clipping, and TCON image processing.

[0105] In an embodiment of the present application, the system layer is used to draw and render the display content of the terminal device UI determined by the application layer.

[0106] It is understandable that, since each pixel of the electronic ink screen presents a black or white effect according to its corresponding level change when displaying, the electronic ink screen needs to perform grayscale clipping and timing controller (TCON) image processing when displaying compared to other types of display screens.

[0107] In the embodiment of the present application, UI drawing is mainly used to complete the image position calculation and the drawing operations of each layer in the image. Specifically, UI drawing can complete the drawing operations by processing UI events, animation, measurement, layout, drawing, etc. Among them, when a UI element, such as a view (control), is operated by the user in a specific way, the terminal device will generate an event corresponding to the UI element, referred to as a UI event. Animation can be used to achieve UI animation effects. Measurement and layout can be used to determine the size and position of each control included in the layer that needs to be drawn, and drawing is used to complete the drawing of the control, etc.

[0108] In an embodiment of the present application, UI rendering is mainly used to complete the rendering operation of each layer in the image. Specifically, UI rendering can complete the rendering operation by synchronizing the vertical synchronization (VSYNC) signal, updating the rendering cache, etc. In some embodiments, the VSYNC signal can be used to trigger the drawing, rendering and synthesis process of the next frame of the image. Updating the rendering cache can be used to store the rendered layers in the cache. Optionally, the relevant calculations in UI rendering can be completed by a central processing unit (CPU) or a graphics processing unit (GPU).

[0109] In the embodiment of the present application, the synthesizer (composer) synthesis is mainly used to synthesize one or more rendered layers into a frame of image.

[0110] In the embodiment of the present application, grayscale cropping is mainly used to perform grayscale processing and cropping on a synthesized frame of image to obtain an image to be displayed.

[0111] In the embodiment of the present application, TCON image processing is mainly used to perform timing processing and image processing on the image to be displayed, obtain display driving data, and transmit the display driving data to the display screen.

[0112] The display driving data may also be referred to as timing control data, and the display driving data may include waveforms and timings required for displaying pixels on the electronic ink screen.

[0113] It is understandable that the electronic ink screen terminal device uses electrophoretic display technology to realize interface display, and attracts and repels positive and negative particles in liquid microcapsules by inputting different electrical levels, thereby changing the pixel points to display white or black, thereby displaying different pictures. Therefore, the electronic ink screen terminal device needs to perform timing processing and image processing on the image to be displayed, and convert the image to be displayed into display drive data. The electronic ink screen applies different voltages according to the waveform and timing in the display drive data, controls the display color of each corresponding pixel, and thus drives the screen to display different content.

[0114] In the embodiment of the present application, the driver layer includes a general memory manager ion, inter-process communication (IPC), shared memory (shared memory) and a mobile industry processor interface (MIPI).

[0115] In an embodiment of the present application, the universal memory manager ion can provide a universal memory management interface to manage different types of memory. Inter-process communication is used to transmit or exchange information between different processes. Shared memory is used to share data between different processes. The mobile industry processor interface is an interface between the processor and the display screen. The mobile industry processor interface is mainly used to send the display driver data generated by the system layer to the display screen (such as an electronic ink screen), and the display screen displays the screen according to the display driver data.

[0116] In the embodiment of the present application, the hardware layer includes AP, double data rate SDRAM (also described as DDR memory), display, and CP.

[0117] In the embodiment of the present application, AP is a high-energy core, which can be used as a main central processing unit (CPU), connected to peripheral devices (such as DDR memory, display screen, etc.), and is mainly responsible for the operation of the electronic ink screen terminal device system and the operation of the application. Exemplarily, AP responds to the reading application, is responsible for the drawing, rendering, synthesis, grayscale clipping and timing processing of the novel text part in the display content to obtain display drive data, and transmits the display drive data to the display screen through MIPI. DDR memory can be used to store calculation data, as well as data exchanged with external storage devices such as hard disks. The display screen displays the corresponding picture according to the display drive data transmitted by MIPI. CP is a low-energy core. Usually, a microcontroller (MCU) is used as the CP, which is connected to various sensors (such as accelerometers) and is mainly responsible for processing simple computing tasks and tasks with high real-time requirements. Exemplarily, CP responds to the reading application and generates a time-corresponding image in the display content.

[0118] Since the terminal device often needs to execute the UI display load, but as mentioned above, the terminal device deploys the UI display load on the AP with higher power consumption, which makes the terminal device have higher power consumption and poorer battery life.

[0119] It can be seen that although the electronic ink screen terminal device in the above-mentioned related technologies adopts a heterogeneous collaborative display architecture, due to the high computing power of the AP, the terminal device deploys all the display loads of the user interface (UI) to the AP, and the AP runs various loads to complete the display interaction. Although the AP has strong computing power, the AP needs to run at a high frequency for a long time to complete all display-related loads, so that the power consumption of the terminal device is still relatively high. For example, if the frame rate of the user interface (UI) of the terminal device is 60 Hz (hertz, Hz), the AP is required to execute all display-related loads within 16.6 milliseconds, and the system power consumption is relatively high. Moreover, the low-power CP cores in the heterogeneous collaborative display architecture are idle and not fully utilized, and the application scenarios are limited, resulting in a waste of resources.

[0120] Based on this, the embodiment of the present application provides a display method, which is applied to a terminal device including a first processing unit and a second processing unit. The method includes: the terminal device determines whether the second processing unit is currently controlling the scene, and if so, the first processing unit generates processing data; the second processing unit synchronizes the processing data from the first processing unit, determines the first display driving data according to the processing data, and then transmits the first display driving data to the display screen. Otherwise, the first processing unit processes and generates the second display driving data and sends it for display. In the technical solution provided by the embodiment of the present application, when the terminal is in the scene controlled by the second processing unit, the first processing unit performs the first processing to obtain the processing data, and then the second processing unit synchronizes the processing data, and generates the display driving data and the display sending operation according to the processing data, and the second processing unit processes and sends it for display. The first processing unit can be a processing unit with high power consumption, such as AP, and the second processing unit can be a processing unit with low power consumption, such as CP. In this way, the terminal device deploys part of the UI display load on the AP to the CP, reduces the UI display load on the AP, and can increase the probability of AP sleep. Moreover, the CP is a low-power core, and the execution power consumption is lower than the execution power consumption of the AP, thereby reducing the power consumption of the terminal device and improving the endurance of the terminal device.

[0121] The technical solution provided in the embodiment of the present application can be applied to the terminal device 100, or to a system including the terminal device 100.

[0122] For example, Figure 3 The schematic diagram of the structure of the terminal device 100 is shown. The terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a sensor module 130, and an electronic ink screen 140, etc. The sensor module 130 may include a pressure sensor 130A and a touch sensor 130K, etc.

[0123] The structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0124] The processor 110 may include a plurality of different processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), a coprocessor (CP), an image signal processor (ISP), a controller, a memory, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.

[0125] In some embodiments of the present application, the processor 110 may include one or more processing units with high power consumption, such as AP, and one or more processing units with low power consumption, such as CP. In some examples, if the power consumption of a processing unit is greater than or equal to a power consumption threshold, the processing unit is a processing unit with high power consumption. If the power consumption of a processing unit is less than the power consumption threshold, the processing unit is a processing unit with low power consumption. Optionally, the power consumption threshold can be set by the developer according to actual needs. Among them, the controller can generate an operation control signal based on the instruction opcode and the timing signal to complete the control of fetching and executing instructions.

[0126] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0127] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0128] The terminal device 100 implements the display function through a GPU, an electronic ink screen 140, an AP, and a CP. The GPU is a microprocessor for image processing, which connects the electronic ink screen 140 and the AP. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information. The AP and the CP collaborate to process images. The electronic ink screen 140 is used to display images. In some embodiments, the terminal device 100 may include 1 or N electronic ink screens 140, where N is a positive integer greater than 1. In some embodiments of the present application, the display screen can be used to display an image synthesized from one or more layers. The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the terminal device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0129] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function.

[0130] The internal memory 121 may be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the terminal device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area.

[0131] The program storage area may store an operating system, an application required for at least one function (such as an image display function), etc. The data storage area may store data created during the use of the terminal device 100, etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0132] The sensor module 130 may include a pressure sensor 130A and a touch sensor 130K, also known as a “touch panel.” The pressure sensor 130A is used to sense pressure signals and convert the pressure signals into electrical signals.

[0133] In some embodiments, the pressure sensor 130A may be disposed on the electronic ink screen 140. When a force is applied to the pressure sensor 130A, the capacitance between the electrodes changes. The terminal device 100 determines the intensity of the pressure based on the change in capacitance. When a touch operation is applied to the electronic ink screen 140, the terminal device 100 detects the intensity of the touch operation based on the pressure sensor 130A. The terminal device 100 may also calculate the position of the touch based on the detection signal of the pressure sensor 130A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions.

[0134] The touch sensor 130K is also called a "touch panel". The touch sensor 130K can be set on the electronic ink screen 140. The touch sensor 130K and the electronic ink screen 140 form a touch screen, also called a "touch screen". The touch sensor 130K is used to detect touch operations acting on or near it. For example, the user can contact the electronic ink screen 140 through an active capacitive pen, a passive capacitive pen, an electromagnetic pen, etc., so as to input a touch operation to the electronic ink screen 140. The touch sensor 130K can detect the touch operation input by the user to the electronic ink screen 140 through an active capacitive pen, a passive capacitive pen, an electromagnetic pen, etc.

[0135] The touch sensor 130K may also transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation may be provided through the electronic ink screen 140. In other embodiments, the touch sensor 130K may also be disposed on the surface of the terminal device 100, which is different from the position of the electronic ink screen 140.

[0136] Exemplarily, in an embodiment of the present application, the touch sensor 130K can be used to detect a refresh operation of refreshing the user interface indicated by a user input through touching the "touch screen", and transmit the detected refresh operation to the processor 100 so that the processor 100 controls the refresh of the content displayed on the electronic ink screen 140.

[0137] In some other embodiments of the present application, the terminal device 100 may include Figure 3 More or fewer components are shown, or some components are combined, or some components are separated, or different component arrangements are arranged. The components shown in the figure can be implemented in hardware, software, or a combination of software and hardware. The embodiment of the present application does not limit the structure and form of the terminal device 100.

[0138] For example, the processing unit installed in the terminal device 100 includes an AP and a CP. Figure 4 A schematic diagram of the system architecture of a terminal device 100 provided in an embodiment of the present application is shown.

[0139] like Figure 4 As shown, the system of the terminal device 100 may include an application layer, a system layer, a driver layer, and a hardware layer.

[0140] In the embodiment of the present application, the application layer includes system applications and / or third-party applications that come with the terminal device. The application layer is used to determine the display content of the terminal device UI. The specific description of the application layer can be found in the above description.

[0141] In the embodiment of the present application, the system layer includes a UI display load, a touch interaction load, an AP heterogeneous collaborative network service module, and a CP heterogeneous collaborative network service module.

[0142] Specifically, the UI display load includes UI drawing, UI rendering, compositor synthesis, grayscale clipping and TCON image processing. The UI display load is deployed on the AP. For a detailed description of the UI display load, please refer to the above. The touch interaction load is used to detect and respond to user touch operations. The AP heterogeneous collaborative network service module is deployed on the AP, including a data collaborative management module and a state collaborative management module. The CP heterogeneous collaborative network service module is deployed on the CP, including a data collaborative management module, a state collaborative management module and a LiteTCON lightweight image processing module.

[0143] In the embodiment of the present application, the terminal device determines whether the current scene is a CP control scene. If it is a CP control scene, the AP heterogeneous cooperative network service module and the CP heterogeneous cooperative network service module cooperate to perform display processing. If it is not a CP control scene, the AP performs display processing. For specific implementation methods, see the above Figure 2 Detailed description.

[0144] The system layer of the system architecture in the embodiment of the present application adds an AP heterogeneous networking service module and a CP heterogeneous networking service module compared to the system layer of the system architecture in the related technology. The functions and structures of each module in the newly added AP heterogeneous networking service module and CP heterogeneous networking service module are introduced in detail below.

[0145] In the embodiment of the present application, the data collaboration management module is used to manage the data collaboration between the AP and the CP and determine the display image to the display screen through the MIPI. Exemplarily, the data collaboration management module is mainly responsible for operations such as data protocol, data update and data destruction between the AP and the CP.

[0146] For example, Figure 5 , which is a schematic diagram of the structure of a data collaborative management module provided in an embodiment of the present application. The data collaborative management module on the AP side (also described as an AP data collaborative management module 500) includes a data drawing interface 501, a data management module 502, and a data synchronization module 503. The data collaborative management module on the CP side (also described as a CP data collaborative management module 504) includes a data display interface 505, a data management module 502, and a data synchronization module 503.

[0147] The data drawing interface 501 at the AP side includes a constant mode primitive drawing unit 5011 , an enumerable mode primitive drawing unit 5012 , and a combined mode primitive drawing unit 5013 .

[0148] Among them, the constant mode primitive drawing unit 5011 is used to draw the corresponding constant mode primitive data according to the constant mode primitive in the current display image; the enumerable mode primitive drawing unit 5012 is used to draw the corresponding enumerable mode primitive data according to the enumerable mode primitive in the current display image; the combined mode primitive drawing unit 5013 is used to draw the corresponding combined mode primitive data according to the combined mode primitive in the current display image.

[0149] The data drawing interface 501 is used to draw and generate processing data, wherein the processing data includes pre-processing data or operation data.

[0150] Specifically, the data drawing interface 501 is further used to integrate the primitive data drawn by each primitive drawing unit (the constant mode primitive drawing unit 5011 , the enumerable mode primitive drawing unit 5012 , and the combined mode primitive drawing unit 5013 ) into pre-processed data.

[0151] Alternatively, after obtaining the pre-processed data, the data drawing interface 501 may also perform a conversion operation on the pre-processed data to obtain converted data.

[0152] In the embodiment of the present application, whether the data drawing interface 501 generates processing data is related to the usage scenario of the terminal device 100. When the terminal device 100 is currently in the CP control scenario (such as a reading and browsing scenario or a screen-on standby scenario), the terminal device 100 performs display interaction between the CP and the AP, and the data drawing interface 501 generates processing data.

[0153] Exemplarily, when the terminal device 100 is in a social scene, the display control right belongs to the AP. When the terminal device 100 switches from the social scene to the reading and browsing scene, the drawing interface 501 generates and processes data.

[0154] For example, if the previous scene and the current scene are both CP-controlled scenes, since the display control right has been switched from AP to CP in the first scene, the display control right is still controlled by CP in the second scene. The display control right is not switched from CP to AP until the terminal usage scenario is not a CP-controlled scene, and the display control is performed by AP.

[0155] The data display interface 505 on the CP side includes a constant mode primitive control unit 5051 , an enumerable mode primitive control unit 5052 , and a combined mode control drawing unit 5053 .

[0156] Among them, the constant mode primitive control unit 5051 generates a constant mode primitive control according to the constant mode primitive data in the processing data, the enumerable mode primitive control unit 5052 generates an enumerable mode primitive control according to the enumerable mode primitive data in the processing data; the combined mode primitive control unit 5053 generates a combined mode primitive control according to the combined mode primitive data in the processing data.

[0157] Among them, the constant mode primitive control includes a first constant mode primitive control and a second constant mode primitive control. The enumerable mode primitive control includes a first enumerable mode primitive control and a second enumerable mode primitive control. The combined mode primitive control includes a first combined mode primitive control and a second combined mode primitive control.

[0158] Optionally, the first constant mode primitive control, the first enumerable mode primitive control and the first combination mode primitive control are first primitive controls generated by each primitive control unit in the data display interface 505 according to preprocessed data.

[0159] Optionally, the second constant mode primitive control, the second enumerable mode primitive control and the second combination mode primitive control are second primitive controls generated by each primitive control unit in the data display interface 505 according to the conversion data.

[0160] The data display interface 505 is also used to generate data to be displayed according to the graphic element control, wherein the data to be displayed includes first data to be displayed or second data to be displayed.

[0161] Specifically, the data display interface 505 is further used to integrate the first graphic element controls generated by each graphic element control unit into the first data to be displayed.

[0162] Alternatively, the data display interface 505 is further used to integrate the second graphic element controls generated by each graphic element control unit into the second data to be displayed.

[0163] The data management module 502 at the AP side includes a primitive management unit 5021 and a primitive sending unit 5022. The primitive management unit 5021 is used to manage the processed data (pre-processed data or converted data) generated by the data drawing interface. The primitive sending unit 5022 is used to send the processed data (pre-processed data or converted data) generated by the data drawing interface to the data synchronization module, so as to synchronize the processed data (pre-processed data or converted data) from the AP side to the CP side.

[0164] The data management module 502 on the CP side includes a primitive management unit 5021 and a primitive update unit 5023. The primitive management unit 5021 is used to manage the primitive controls (first primitive controls or second primitive controls) generated by each unit in the data display interface 505. The primitive update unit 5023 is used to update each primitive control (first primitive control or second primitive control).

[0165] The data synchronization module 503 is used to synchronize data between the AP side and the CP side.

[0166] It is understandable that the embodiments of the present application do not limit the specific implementation method of data coordination interaction between the AP and the CP.

[0167] In this way, the data collaborative management module on the AP side and the data collaborative management module on the CP side manage and synchronize the data between the AP and the CP through the shared memory.

[0168] Understandably, Figure 5 The data collaborative management module included in the terminal device 100 is only used as a possible division method. In actual applications, the data collaborative management module in the terminal device 100 may include more or fewer modules, or there may be other module division methods, and this application does not impose any restrictions on this.

[0169] In the embodiment of the present application, the state collaborative management module is used to manage the collaborative state of the synchronized AP and CP, and is also used to determine the processor that controls the display of the current terminal device 100. For example, the state collaborative management module determines whether the processor that takes over and controls the display of the display screen of the current terminal device 100 is the AP or the CP, and then coordinates the state of the AP and the CP. The state collaborative management module is mainly responsible for operations such as enabling the collaborative state between the AP and the CP, disabling the collaborative state, synchronizing the collaborative state, and updating the collaborative state.

[0170] For example, Figure 6 , which is a schematic diagram of the structure of a state collaborative management module provided in an embodiment of the present application. The state collaborative management module on the AP side (also described as an AP state collaborative management module 600) and the state collaborative management module on the CP side (also described as a CP state collaborative management module 601) include an enabling state interface 602, a collaborative state management module 603, and a collaborative state synchronization module 604.

[0171] Specifically, the enabling state interface 602 is responsible for opening and closing the heterogeneous collaborative display function and is the entrance to the UI heterogeneous collaborative display.

[0172] For example, when the enabling state interface 602 is turned on, the AP and CP can perform collaborative interaction, and the AP switches the display control right to the CP, and the CP takes over the display control right and sends the display to the display screen. When the enabling state interface 602 is turned off, the AP and CP do not perform collaborative interaction, the display control right belongs to the AP, and the AP is responsible for display processing and sending the display to the display screen.

[0173] Specifically, the collaborative state management module 603 is responsible for managing and updating the collaborative state between the AP and the CP. The collaborative state includes collaborative state on, data drawing state, data transmission state, collaborative state off, etc. The collaborative state on is used to indicate that the AP and / or CP are in the collaborative state on, the data drawing state is used to indicate that the AP and / or CP are in the state of drawing and displaying data, the data transmission state is used to indicate that the AP and / or CP are in the state of data transmission, and the collaborative state off is used to indicate that the AP and / or CP are in the collaborative state off.

[0174] Specifically, the collaborative state synchronization module 604 is responsible for synchronizing the states of the AP and the CP. Exemplarily, the collaborative state synchronization module 604 on the AP side can complete state synchronization with the collaborative state synchronization module 604 on the CP side through IPC.

[0175] Understandably, Figure 6The state collaborative management module included in the terminal device 100 is only used as a possible division method. In actual applications, the state collaborative management module in the terminal device 100 may include more or fewer modules, or there may be other module division methods, and this application does not impose any restrictions on this.

[0176] In an embodiment of the present application, the LiteTCON lightweight image processing module is deployed on the CP. The LiteTCON lightweight image processing module has a lightweight timing controller (not shown in the figure) for providing lightweight ink screen image processing capabilities on the CP side. Specifically, the LiteTCON lightweight image processing module is used to process the data to be displayed generated by the data collaborative management module on the CP side, and transmit the processed display driver data to the display screen through MIPI, so that the display screen displays the corresponding picture according to the processed display driver data.

[0177] For example, Figure 7 , which is a schematic diagram of the structure of a LiteTCON lightweight image processing module provided in an embodiment of the present application. The LiteTCON lightweight image processing module 700 includes an image input module 701, a processing mode selection module 702, a direct processing module 703, an image sending and displaying module 704, a high-definition processing module 705, a parallel reading module 706, a pixel conversion module 707, and a parallel processing module 708.

[0178] In the embodiment of the present application, the image input module 701 is used to receive the to-be-displayed data generated by the CP-side data collaborative management module, and send it to the processing mode selection module 702 .

[0179] Specifically, the data received by the image input module 701 may be the first data to be displayed, or the second data to be displayed.

[0180] In the embodiment of the present application, the processing mode selection module 702 is used to determine the processing mode according to the data to be displayed transmitted by the image input module 701, and transmit the data to be displayed to the corresponding processing module.

[0181] Specifically, if the transmitted data is the first data to be displayed, the processing mode is determined to be the high-definition mode; if the transmitted data is the second data to be displayed, the processing mode is determined to be the pass-through mode.

[0182] In the embodiment of the present application, the direct processing module 703 is a processing module corresponding to the direct mode, which is used to determine the second data to be displayed as display driving data, and transmit the display driving data to the image sending module 704.

[0183] In the embodiment of the present application, the image sending and displaying module 704 is used to send the display driving data processed by different processing modes to the display screen.

[0184] Specifically, the image display module 704 is connected to the display screen via MIPI, and when the processing mode is the pass-through mode, the display driver data sent by the pass-through processing module 703 is transmitted to the display screen via MIPI. Alternatively, when the processing mode is the high-definition mode, the display driver data sent by the parallel processing module 708 is transmitted to the display screen via MIPI.

[0185] In the embodiment of the present application, the high-definition processing module 705 is a processing module corresponding to the high-definition mode, and is used to transmit the first to-be-displayed data to the parallel reading module 706 .

[0186] In the embodiment of the present application, the parallel reading module 706 is used to read the pixel data in the first data to be displayed in parallel, and transmit the pixel data to the pixel conversion module 707 .

[0187] It is understandable that, usually, the way the AP side reads and writes pixel data from the memory is to read a pixel point data, process the pixel point data, and then write the pixel point data. However, the computing power of the CP is much lower than that of the AP. If the CP side uses the same reading and writing method as the AP side to read and write pixel data, the reading and writing time is too long and cannot be read quickly. Therefore, in order to overcome the problem of slow reading and writing data on the CP side, in an embodiment of the present application, the CP side adopts a parallel reading method, that is, reads a large block of pixel point data, processes this large block of pixel point data, and then writes the processed large block of pixel point data. For example, read a whole row of pixel point data, process a whole row of pixel point data, and write a whole row of processed pixel point data.

[0188] In this way, data processing speed is accelerated through parallel processing.

[0189] In the embodiment of the present application, the pixel conversion module 707 is used to perform image processing on the pixel data, convert the pixel data into grayscale data, and transmit the grayscale data to the parallel processing module 708 .

[0190] In the embodiment of the present application, the parallel processing module 708 is used to generate display driving data according to the grayscale data, and transmit the display driving data to the image sending module 704 .

[0191] It is understandable that when the CP side sends the data for display, the data displayed on the display screen is the display driving data. In the embodiment of the present application, the CP side performs corresponding operations according to the different types of data transmitted by the AP side. In the pass-through mode, the CP side directly transmits the second data to be displayed as the display driving data to the display screen. In the high-definition mode, the CP side performs image processing operations such as conversion operations on the first data to be displayed to obtain the display driving data, and then transmits the display driving data to the display screen.

[0192] Understandably, Figure 7 The LiteTCON lightweight image processing module included in the terminal device 100 is only used as a possible division method. In actual applications, the LiteTCON lightweight image processing module in the terminal device 100 may include more or fewer modules, or there may be other module division methods, which is not limited in this application.

[0193] In this way, after the interactive processing of the AP heterogeneous networking service module and the CP heterogeneous networking service module, the system layer can determine whether the display control sovereignty lies with the AP or the CP, thereby enriching the display function of the CP. When the display control sovereignty lies with the CP, the CP is responsible for display, which can reduce the overall power consumption of the system.

[0194] In an embodiment of the present application, the AP side driver layer includes a general memory manager ion, IPC, shared memory and MIPI.

[0195] Exemplarily, the universal memory manager ion of the AP side driver layer can provide a universal memory management interface to manage different types of memory. Inter-process communication is used to transmit or exchange information between different processes. Shared memory is used to share data between different processes (such as sharing display data between AP and CP, etc.). MIPI is an interface between AP and display screen, which is used to send the first display data generated by the AP side system layer to the display screen so that the display screen displays the first display data.

[0196] In an embodiment of the present application, the CP side driver layer includes shared memory and MIPI.

[0197] Exemplarily, the shared memory is used to share data between the AP and the CP (such as display data (first display data, second display data), pixel data, etc.). The MIPI connects the display screen to send the second display data generated by the system layer on the CP side to the display screen, and the display screen displays the second display data.

[0198] In the embodiment of the present application, the hardware layer includes AP, double data rate SDRAM (also described as DDR memory), display, and CP. AP and CP serve in collaboration, and the two interact to determine the ownership of the sovereignty of display control. If the display control right belongs to AP, AP generates an image and sends it for display. If the display control right belongs to CP, AP generates an image first, CP synchronously obtains the image generated by AP, and then CP sends it to the display according to the image obtained from AP.

[0199] Understandably, Figure 4The system architecture of the terminal device 100 is only used as a possible division method. In actual applications, the system architecture of the terminal device 100 may include more or fewer modules, or there may be other module division methods, which is not limited in this application.

[0200] It is understandable that in the embodiment of the present application, the terminal device can perform some or all of the steps in the embodiment of the present application, and these steps or operations are only examples. The embodiment of the present application can also perform other operations or variations of various operations. In addition, the various steps can be performed in different orders presented in the embodiment of the present application, and it is possible that not all operations in the embodiment of the present application need to be performed.

[0201] Exemplarily, the technical solutions involved in the following embodiments can all be implemented in the above-mentioned terminal device 100. The display method provided in the embodiments of the present application is described in detail below in conjunction with the accompanying drawings and application scenarios.

[0202] The technical solutions involved in the following embodiments are all described with the first processing unit being the AP and the second processing unit being the CP.

[0203] For example, Figure 8 A flow chart of a display method provided in an embodiment of the present application is shown, and the method includes the following steps S801-S805:

[0204] S801. The terminal device determines whether the current scenario is a CP control scenario.

[0205] If yes, execute step S802, if no, execute step S805.

[0206] In the embodiment of the present application, the CP control scene is a scene controlled by the CP. Exemplarily, the CP control scene can be a reading and browsing scene or a screen-on standby scene. That is, a scene in which a user uses a terminal device to read text or pictures or a scene in which the user does not operate the terminal device when the terminal device is on. For example, a user uses a terminal device to read documents, novels, notes, or browse web pages.

[0207] In one possible implementation, the terminal device can determine whether the current scene is a CP control scene based on the application used by the user. Exemplarily, the terminal device starts a reading application in response to a user operation and displays the reading content, and then it can be determined that the current scene is a CP control scene. The embodiment of the present application does not limit the specific implementation method of the terminal device to determine whether the current scene is a CP control scene.

[0208] It is understandable that the embodiments of the present application are based on Figure 1Based on the experimental data, the reading and browsing scene is preconfigured as the CP control scene, and the CP takes over the display control of the reading and browsing scene. Moreover. When the terminal device is in the screen-on standby scene, the content displayed by the terminal device remains unchanged, and the CP can also take over the display control of the screen-on standby scene. That is, the low-power processing unit CP takes over the display control of the reading and browsing scene and the screen-on standby scene, thereby effectively reducing the power consumption of the system. In the future, as the terminal device is upgraded and changed, other scenes can also be preconfigured as CP control scenes.

[0209] S802. The AP of the terminal device generates processing data.

[0210] In the embodiment of the present application, the processed data includes pre-processed data or converted data, and the pre-processed data is graphic element data that can be displayed on the CP side.

[0211] The pre-processed data is the image metadata obtained after the AP performs a pre-processing operation on the current display image, and the converted data is the image metadata obtained after the AP performs a conversion operation on the pre-processed data.

[0212] The metadata includes constant mode primitives, enumerable mode primitives and combined mode primitives. The primitive is the most basic data unit displayed by the terminal device. For example, if the number "13" is displayed on the current terminal device, the primitives of "13" are "1" and "3".

[0213] Among them, constant mode primitives are primitives that remain unchanged during display, such as the Bluetooth icon in the status bar of the terminal device display interface or each word in the document content displayed on the display interface (one word is a primitive), etc. Enumerable mode primitives are images that change but the changes are limited during display, such as each primitive of time in the terminal device display interface. Combined mode primitives are primitives composed of scene mode primitives and enumerable mode primitives.

[0214] In some embodiments of the present application, the AP of the terminal device performs a preprocessing operation on the currently displayed image to obtain preprocessing data.

[0215] Among them, the preprocessing operations include classifying metadata, drawing metadata and other preprocessing operations.

[0216] Exemplarily, the AP classifies each element of the graphic element in the currently displayed image according to the graphic element category, and generates corresponding pre-processed data according to the classified graphic element element.

[0217] In some other embodiments of the present application, the AP of the terminal device first performs a preprocessing operation on the current display image to obtain preprocessing data; and then performs a conversion operation on the preprocessing data to obtain conversion data.

[0218] The conversion operation includes image conversion processing operations such as grayscale processing and timing processing.

[0219] Exemplarily, after the AP side performs a preprocessing operation on the current display image to obtain preprocessing data, the AP side may also read pixel data in the preprocessing data, and the AP converts the pixel data into grayscale data, and the AP generates conversion data according to the grayscale data.

[0220] The grayscale data may be any one of the three modes: black / white / gray.

[0221] In a possible implementation, the AP side reads a pixel data in the preprocessed data, determines the grayscale data corresponding to the pixel data from a preset grayscale conversion table according to the pixel data, and performs time series processing on the grayscale data to generate conversion data.

[0222] It is understandable that when the AP generates processed data, if only the preprocessing operation is performed on the current display image, and the obtained preprocessed data is synchronized to the CP side. Then, the data sent from the AP side to the CP side has not been converted, so the CP side needs to perform conversion after receiving the preprocessed data sent by the AP side, and send the converted data for display. Alternatively, when the AP generates processed data, if after the preprocessing operation is performed on the current display image, the preprocessed data obtained by the preprocessing operation is converted, and then the converted data is synchronized to the CP side. Then, the data sent from the AP side to the CP side has been converted, so after receiving the converted data sent by the AP side, the CP side does not need to perform conversion again, and the converted data sent by the AP side can be combined according to a preset method and sent directly for display.

[0223] In the embodiment of the present application, the AP does not need to perform drawing processing on all currently displayed images, but only needs to draw and generate pre-processed data corresponding to each metadata according to the metadata contained in the currently displayed image.

[0224] For example, the currently displayed image is as follows Fig. 9As shown, the current display image 900 includes a signal icon 901 and a time 902. After determining the current display image 900, the AP first classifies the metadata in the current display image 900 according to the metadata category, and obtains two types of metadata, namely: constant mode metadata: signal icon; enumerable mode metadata: "0", "8", ":". Then, the corresponding pre-processed data is drawn according to the classified metadata. For example, according to the signal icon, the constant mode metadata related to the signal icon is drawn: Bluetooth icon, alarm clock icon, etc. According to "0", "8", ":", the enumerable mode metadata related to "0", "8", ":" are drawn: "0", "1", "2", "3", "4", "5", "6", "7", "8", "9" and ":", and the related metadata generated by integrating the metadata of different categories are obtained by drawing the pre-processed data.

[0225] In this way, the preprocessed data after AP preprocessing only includes relevant metadata, and only the preprocessed data needs to be transmitted and stored, which greatly reduces the data size and can optimize memory storage.

[0226] In the embodiment of the present application, an AP heterogeneous network service module is deployed on the AP, and the AP heterogeneous network service module includes a data collaborative management module and a state collaborative management module. A CP heterogeneous network service module is deployed on the CP, and the CP heterogeneous network service module includes a data collaborative management module, a state collaborative management module, and a LiteTCON lightweight image processing module.

[0227] The data collaboration management module on the AP side is used to interact with the data collaboration management module on the CP side and is responsible for managing the data collaboration between the AP and the CP. The state collaboration management module on the AP side is used to interact with the state collaboration management module on the CP side and is responsible for managing the state collaboration between the AP and the CP. The LiteTCON lightweight image processing module on the CP side is used to provide lightweight ink screen image processing capabilities on the CP side so that the CP can take over the display control and complete the display interaction.

[0228] In step S802, after the terminal device determines that the current scene is a CP control scene, the data collaborative management module on the AP side of the terminal device generates processing data according to the current display image.

[0229] Specifically, the data collaborative management module on the AP side includes a data drawing interface, a data management module, and a data synchronization module.

[0230] The data drawing interface includes a constant mode primitive drawing unit, an enumerable mode primitive drawing unit and a combined mode primitive drawing unit. The constant mode primitive drawing unit is used to draw corresponding constant mode primitive data according to the constant mode primitive in the current display image; the enumerable mode primitive drawing unit is used to draw corresponding enumerable mode primitive data according to the enumerable mode primitive in the current display image; and the combined mode primitive drawing unit is used to draw corresponding combined mode primitive data according to the combined mode primitive in the current display image.

[0231] The data drawing interface is also used to integrate the primitive data drawn by each primitive drawing unit into pre-processed data.

[0232] The data drawing interface is also used to perform conversion operations on the preprocessed data to obtain converted data.

[0233] The data management module includes a graphic element management unit and a graphic element sending unit. The graphic element management unit is used to manage the processed data (pre-processed data or converted data) generated by the data drawing interface. The graphic element sending unit is used to send the processed data (pre-processed data or converted data) generated by the data drawing interface to the data synchronization module, so as to synchronize the processed data (pre-processed data or converted data) from the AP side to the CP side.

[0234] The data synchronization module is used to synchronize the processed data (pre-processed data or converted data) generated by the AP side to the CP side.

[0235] In the embodiment of the present application, after generating the processed data, the data collaborative management module on the AP side saves the processed data in the shared content, so that the data collaborative management module on the CP side obtains the processed data from the shared memory.

[0236] S803: The terminal device synchronizes the processed data from the AP to the CP.

[0237] In the embodiment of the present application, after generating the processing data, the AP sends the processing data to the CP. Correspondingly, the CP receives the processing data from the AP.

[0238] Specifically, the data collaborative management module on the CP side includes a data display interface, a data management module, and a data synchronization module.

[0239] The data synchronization module is used to receive the processed data sent by the AP side. That is, the data synchronization module on the AP side sends the processed data to the data synchronization module on the CP side, thereby synchronizing the processed data from the AP to the CP.

[0240] In the embodiment of the present application, the manner in which the data synchronization module on the AP side synchronizes data with the data synchronization module on the CP side includes but is not limited to shared memory interaction.

[0241] In the embodiment of the present application, after receiving the processed data from the AP, the CP returns response information to the AP so that the AP can determine that the CP has received the processed data.

[0242] In some embodiments of the present application, after the terminal device synchronizes the processed data from the AP to the CP, if the display control right belongs to the AP, the terminal device first switches the display control right from the AP to the CP, and the CP takes over the display control right; after the CP takes over the display control right, S804 is executed.

[0243] For example, if the previous scene is not a CP control scene and the current scene is a CP control scene, when the terminal device is displayed in the previous scene, the display is controlled by the AP, and the display control right belongs to the AP. In the current scene, since the current scene is a CP control scene, the terminal device switches the display control right from the AP to the CP, and the CP takes over the display control right.

[0244] In an embodiment of the present application, the terminal device switches the display control right of the AP to the CP according to the synchronous collaboration state.

[0245] In the embodiment of the present application, after receiving the response information sent by the CP, the AP side turns on the heterogeneous collaborative display function, changes the collaborative state, and synchronizes the changed collaborative state to the CP, switching the display control of the AP to the CP. Correspondingly, the CP receives and synchronizes the changed collaborative state sent by the AP, takes over the display control according to the synchronized collaborative state, and the CP exercises the display control.

[0246] Specifically, the state collaborative management module on the AP side and the state collaborative module on the CP side both include an enabling state interface, a collaborative state management module, and a collaborative state synchronization module.

[0247] The enabling state interface is responsible for turning on and off the heterogeneous collaborative display function and is the entrance to the UI heterogeneous collaborative display. The collaborative state management module is responsible for managing and updating the collaborative state between the AP and the CP. The collaborative state synchronization module is responsible for synchronizing the states of the AP and the CP.

[0248] Exemplarily, after receiving the response information sent by the CP, the AP turns on the enable state interface of the state collaboration module on the AP side, and the collaborative state management module on the AP side responds to the turn-on operation of the enable state interface on the AP side and changes the collaborative state to collaborative state on. The collaborative state synchronization module on the AP side synchronizes the changed collaborative state (collaborative state on) to the collaborative state synchronization module of the state collaboration module on the CP side. Correspondingly, the collaborative state management module on the CP side changes the collaborative state to collaborative state on, and turns on the enable state interface on the CP side. At this time, the CP takes over the display control.

[0249] Optionally, when the terminal device exits the CP control scenario, the CP side turns off the heterogeneous collaborative display function, changes the collaborative state, and synchronizes the changed collaborative state to the AP, switching the display control of the CP to the AP. Correspondingly, the AP receives and synchronizes the changed collaborative state sent by the CP, takes over the display control according to the synchronized collaborative state, and the AP exercises the display control.

[0250] It should be understood that the CP is a low-power processing unit. Taking over the display control by the CP can reduce the AP running time, increase the probability of AP sleep, and greatly save power consumption.

[0251] It is understandable that the present application does not limit the execution order of the terminal device synchronizing the processing data from the AP to the CP and the terminal device switching the display control right from the AP to the CP when the display control right belongs to the AP. They can be executed synchronously or sequentially. When executed sequentially, the present application does not limit the sequential order.

[0252] In some other embodiments of the present application, after the terminal synchronizes the processed data from the AP to the CP, if the display control right belongs to the CP, S804 may be directly executed.

[0253] For example, if the previous scene and the current scene are both CP-controlled scenes, since the display control right has been switched from AP to CP in the first scene, the display control right is still controlled by CP in the second scene. The display control right is not switched from CP to AP until the terminal usage scenario is not a CP-controlled scene, and the display control is performed by AP.

[0254] S804: The CP of the terminal device determines display driving data according to the processed data, and transmits the display driving data to a display screen of the terminal device.

[0255] The display driving data may also be referred to as timing control data, and the display driving data may include waveforms and timings required for displaying pixels on a terminal device.

[0256] In some embodiments of the present application, if the processed data synchronized by the CP is pre-processed data, the CP of the terminal device determines the display driving data based on the processed data, including: the CP generates first data to be displayed based on the pre-processed data; the CP reads pixel data in the first data to be displayed in parallel; the CP converts the pixel data into grayscale data; and the CP generates display driving data based on the grayscale data.

[0257] In a possible implementation manner, after synchronizing the pre-processed data sent by the AP side, the CP combines the pre-processed data according to a preset method to generate first data to be displayed.

[0258] For example, based on the above S802 and Fig. 9In the example, the preprocessed data includes constant mode metadata: a signal icon, and enumerable mode metadata: “0”, “1”, “2”, “3”, “4”, “5”, “6”, “7”, “8”, “9”, and “:”. The CP side determines the metadata to be displayed in the preprocessed data, and encapsulates and combines the metadata to be displayed to generate the first data to be displayed. That is, the CP side combines the signal icon of the constant mode metadata in the preprocessed data, and the “0”, “8”, “:” encapsulation of the enumerable mode metadata to generate the first data to be displayed.

[0259] Specifically, after the data synchronization module of the data collaborative management module on the CP side synchronizes the pre-processed data generated on the AP side, the data display interface of the data collaborative management module on the CP side generates the first data to be displayed based on the pre-processed data.

[0260] The data display interface on the CP side includes a constant mode primitive control unit, an enumerable mode primitive control unit, and a combined mode control drawing unit.

[0261] Among them, the constant mode primitive control unit generates a first constant mode primitive control according to the constant mode primitive data in the preprocessed data, the enumerable mode primitive control unit generates a first enumerable mode primitive control according to the enumerable mode primitive data in the preprocessed data; and the combination mode primitive control unit generates a first combination mode primitive control according to the combination mode primitive data in the preprocessed data.

[0262] The data display interface is also used to integrate the first primitive controls generated by each primitive control unit (the constant mode primitive control unit, the enumerable mode primitive control unit and the combined mode primitive control unit) into the first data to be displayed.

[0263] The data management module on the CP side includes a primitive management unit and a primitive update unit. The primitive management unit is used to manage the first primitive controls (the first primitive controls include the first constant mode primitive control, the first enumerable mode primitive number control, and the first combination mode primitive control) generated by each unit in the data display interface. The primitive update unit is used to update each first primitive control.

[0264] In a possible implementation, the CP reads pixel data in the first data to be displayed in parallel through direct memory access (DMA).

[0265] In a possible implementation, after the terminal device CP reads the pixel data of the first pixel to be displayed in parallel, the terminal device CP converts the pixel data into grayscale data according to a preset grayscale conversion table.

[0266] The preset grayscale conversion table may be determined based on experimental tests, historical data or experience.

[0267] Specifically, after the pixel data of the pixel to be displayed is read in parallel, the grayscale data corresponding to the RGBA value of the pixel data is determined from a preset grayscale conversion table according to the red, green, blue alpha (RGBA) value of the pixel data. In this way, the grayscale data corresponding to the pixel data is determined by looking up the table with the RGBA value of the pixel data as an index, and the pixel data is converted into grayscale data.

[0268] In a possible implementation, after the terminal device CP converts the pixel data into grayscale data, it performs a conversion operation according to the current display image and the grayscale data to generate display driving data.

[0269] The conversion operation includes image conversion processing operations such as grayscale processing and timing processing.

[0270] For example, Fig.10 As shown, a schematic diagram of generating display drive data provided by an embodiment of the present application is provided. S1 in the figure is the current display image data of the terminal device interface (which can be understood as the first frame image). In the second frame image processing cycle, the CP side performs a conversion operation based on the currently displayed image data S1, the grayscale data and the screen refresh rate of the terminal device to generate display drive data S2 (which can be understood as the second frame image). Among them, the grayscale data is obtained based on the AP original processing data read in parallel from the memory by the CP. Subsequently, the display screen of the terminal device displays the display drive data S2. After the terminal device displays the display drive data S2, the display drive data S2 becomes the current display image data corresponding to the next processing cycle. That is, in the third frame image processing cycle, the CP side performs a conversion operation based on the display drive data S2, the grayscale data and the screen refresh rate of the terminal device to generate display drive data S3 (which can be understood as the third frame image). According to the above method, the CP side finally generates n frames of display drive data S2, S3, ..., Sn+1, and sends n frames of display drive data to the display screen frame by frame so that the display screen displays. In this way, the display driving data to be displayed is generated according to the currently displayed image data, grayscale data and the screen refresh rate of the terminal device.

[0271] In the embodiment of the present application, after the CP side generates the first data to be displayed, it transmits the first data to be displayed to the LiteTCON lightweight image processing module, and the image input module transmits the first data to be displayed to the processing mode selection module.

[0272] In an embodiment of the present application, the LiteTCON lightweight image processing module on the CP side of the terminal device has a lightweight timing controller, so the CP side has the ability to convert images. In this way, the conversion operation is completed in a low-power core, reducing the calculation amount and memory occupancy of the timing control in the conversion operation.

[0273] The processing mode selection module of the LiteTCON lightweight image processing module determines that the current processing mode is the high-definition mode according to the first data to be displayed, and transmits the first data to be displayed to the high-definition processing module.

[0274] The high-definition processing module of the LiteTCON lightweight image processing module is a processing module corresponding to the high-definition mode, and is used for transmitting the first data to be displayed to the parallel reading module.

[0275] The parallel reading module of the LiteTCON lightweight image processing module is used for reading the pixel data in the first data to be displayed in parallel, and transmitting the pixel data to the pixel conversion module.

[0276] The pixel conversion module of the LiteTCON lightweight image processing module is used to perform image processing on pixel data, convert the pixel data into grayscale data, and transmit the grayscale data to the parallel processing module.

[0277] The parallel processing module of the LiteTCON lightweight image processing module is used to generate display drive data according to the grayscale data, and transmit the display drive data to the image display module.

[0278] In some other embodiments of the present application, if the processed data synchronized by the CP is conversion data, the CP of the terminal device determines the display driving data according to the processed data, including: the CP generates second data to be displayed according to the conversion data; the CP determines the second data to be displayed as the display driving data.

[0279] In a possible implementation, after synchronizing the conversion data sent by the AP side, the CP combines the conversion data according to a preset method to generate second data to be displayed.

[0280] Specifically, after the data synchronization module of the data collaborative management module on the CP side synchronizes the conversion data generated on the AP side, the data display interface of the data collaborative management module on the CP side generates the second data to be displayed based on the conversion data.

[0281] The constant mode primitive control unit in the data display interface on the CP side generates a second constant mode primitive control according to the constant mode primitive data in the conversion data; the enumerable mode primitive control unit generates a second enumerable mode primitive control according to the enumerable mode primitive data in the conversion data; and the combination mode primitive control unit generates a second combination mode primitive control according to the combination mode primitive data in the conversion data.

[0282] The data display interface is also used to integrate the second graphic element controls generated by each graphic element control unit (constant mode graphic element control unit, enumerable mode graphic element control unit and combined mode graphic element control unit) into the second data to be displayed.

[0283] The data management module on the CP side includes a primitive management unit and a primitive update unit. The primitive management unit is used to manage the second primitive controls (the second primitive controls include the second constant mode primitive control, the second enumerable mode primitive number control, and the second combination mode primitive control) generated by each unit in the data display interface. The primitive update unit is used to update each second primitive control.

[0284] It can be understood that the data synchronized by the CP side from the AP side is the converted data that has been converted. Therefore, the CP side does not need to convert the converted data again. The CP side can directly send the second data to be displayed after packaging and combining the converted data according to a preset method.

[0285] In the embodiment of the present application, after the CP side generates the second data to be displayed, it transmits the second data to be displayed to the image input module of the LiteTCON lightweight image processing module, and the image input module transmits the second data to be displayed to the processing mode selection module.

[0286] The processing mode selection module of the LiteTCON lightweight image processing module determines that the current processing mode is the direct mode according to the second data to be displayed, and transmits the second data to be displayed to the direct processing module.

[0287] The direct processing module of the LiteTCON lightweight image processing module determines the second data to be displayed as display driving data, and transmits the display driving data to the image display sending module.

[0288] For example, Fig.11 As shown in FIG. 1 , a memory optimization schematic diagram provided in an embodiment of the present application is provided. Fig.11 As described above, the screen pixel of the terminal device is 1920*1421, so the data size required to process one frame of image is 1920*1421*32 / 8=10.4M.

[0289] Fig.11 1100 in the figure is the image data transmitted from the AP side to the display screen when the display control right belongs to the AP side in the related technology. The data size is also 1920*1421*32 / 8=10.4M. Moreover, 1100 is discretely stored in the memory in a discontinuous storage manner. However, the actual effective image data (such as picture elements) of the display screen only occupies a small part of 1100. For example, 1101 is the actual effective image data ( Fig.11The data size is 276*1421*4=1.5M.

[0290] Fig.11 1102 is the image data transmitted from the CP side to the display screen when the display control right belongs to the CP side in the technical solution provided in the embodiment of the present application. In the embodiment of the present application, the AP side first determines the valid image data in the image and only draws and processes the valid image data. The data size actually processed in the embodiment of the present application is 276*1421*4=1.5M. Moreover, 1102 is continuously stored in the memory in a continuous storage manner, which speeds up the memory processing speed, memory occupancy, and optimizes the memory storage effect.

[0291] In some embodiments of the present application, transmitting display driver data to a display screen of a terminal device includes: a CP side transmitting the display driver data to a display screen of the terminal device via MIPI.

[0292] In the embodiment of the present application, the image transmission module of the LiteTCON lightweight image processing module receives the display driving data sent by the parallel processing module, or the image transmission module receives the display driving data sent by the direct processing module. The image transmission module transmits the received display driving data to the display screen via MIPI.

[0293] In the embodiment of the present application, after receiving the display driving data, the display screen displays an image according to the display driving data.

[0294] S805. The terminal device uses the AP to perform display control.

[0295] In the embodiment of the present application, if the terminal device determines that the current scene is not a CP control scene, the display control right belongs to the AP, and the AP performs display control. In a possible implementation, the terminal device uses the AP to perform image processing and image display. Figure 2 The processing flow shown executes each UI display load, such as drawing, rendering, synthesis, grayscale clipping, TCON image processing, etc. to obtain display driver data. The AP side transmits the display driver data to the display screen of the terminal device through MIPI, and the display screen displays the image according to the display driver data.

[0296] Based on the above technical solution, after the terminal device determines that the current scenario is CP control, the AP side pre-processes and generates pre-processed data, and synchronizes the pre-processed data to the CP side, and the CP side completes the display interaction based on the pre-processed data. That is to say, in the CP control scenario, the AP processes the data required for display, and the CP sends the processed data to the display screen for display. By sharing the computing power of the AP side, the CP side uses the pre-processed data generated by the AP side to deploy the UI display load (such as display sending operations, etc.) on the AP to the CP, reducing the UI display load deployed on the AP. Moreover, the lightweight timing controller is deployed on the CP, so that the low-power CP has the ability to take over the display interaction in the application scenario, broadening the CP application scenario. The power consumption of the CP core is lower than that of the AP. After the CP takes over the display control, the probability of AP sleep can be increased, thereby reducing the power consumption of the terminal device and improving the battery life of the terminal device.

[0297] For example, Fig.12 A schematic diagram of a display effect provided by an embodiment of the present application is shown. Fig.12 The first interface 1201 in the figure is the image displayed by the terminal device when the display control right belongs to the AP side. The second interface 1202 is the image displayed by the terminal device when the display control right belongs to the CP side. It can be seen that there is no difference in the display effects of the two, the content is clear without burrs, and there is no residual image when turning pages.

[0298] For example, Fig.13 A schematic diagram showing a benefit effect provided by an embodiment of the present application is shown. It can be understood that Fig.13 The following description is made by taking a reading scenario in which a terminal device turns pages once a minute as an example. In this scenario, the technical solution provided by the embodiment of the present application can reduce the power consumption of the terminal device by about 20 mA.

[0299] like Fig.13 As shown in (a), the current power consumption of the terminal device when the display control right belongs to the AP and the AP processes and sends the display, for example, within 1 minute to 2 minutes, the current power consumption of the terminal device is 107.05 mA.

[0300] like Fig.13 As shown in (b), the current power consumption of the terminal device corresponding to the technical solution provided in the embodiment of the present application, that is, when the display control right belongs to the CP and the CP takes over the display, the current power consumption of the terminal device is 82.35 mA during 3 to 4 minutes, which is reduced by about 20 mA.

[0301] For example, Fig.14 A schematic diagram showing another benefit effect provided by an embodiment of the present application is shown. It can be understood that Fig.14The following description is made by taking the scenario of the terminal device being on standby with the screen on as an example. In this scenario, the technical solution provided by the embodiment of the present application can reduce the power consumption of the terminal device by about 10 mA.

[0302] like Fig.14 As shown in (a), the current power consumption of the terminal device when the display control right belongs to the AP and the AP processes and sends the display, for example, during the period from 2 minutes to 3 minutes, the current power consumption of the terminal device is 93.37 mA.

[0303] like Fig.14 As shown in (b), the current power consumption of the terminal device corresponding to the technical solution provided in the embodiment of the present application, that is, when the display control right belongs to the CP and the CP takes over the display, the current power consumption of the terminal device is 82.87 mA during 2 to 3 minutes, which is reduced by about 10 mA.

[0304] It is understandable that the above description is based on the example of an electronic ink screen terminal device, and the technical solution provided in the embodiment of the present application can also be applied to a terminal device whose display screen is not an electronic ink screen. When the display screen of the terminal device is not an electronic ink screen, there is no need to perform grayscale processing and timing processing.

[0305] Exemplarily, the display screen other than the electronic ink screen can be a liquid crystal display (LCD), an organic light-emitting diode display (OLED) (also described as an OLED screen), an active-matrix organic light-emitting diode screen (AMOLED), a low temperature polycrystalline oxide screen (LTPO), a flexible display, and any other product or component with a display function.

[0306] It should be understood that the image displayed by the display screen other than the electronic ink screen only needs to be drawn, rendered and synthesized before being displayed, and the synthesized image is directly sent to the display. Unlike the electronic ink screen, after obtaining the synthesized image, it is not necessary to perform grayscale processing and timing processing on the synthesized image before sending it to the display.

[0307] For example, Fig.15 FIG. 1 is a flow chart of another display method provided in an embodiment of the present application, the method comprising the following steps S1501-S1505:

[0308] S1501. The terminal device determines whether the current scenario is a CP control scenario.

[0309] If yes, execute step S1502, if no, execute step S1505.

[0310] The specific implementation method of the terminal device determining whether the current scenario is a CP control scenario is as described in S801 above and will not be repeated here.

[0311] S1502. The AP of the terminal device generates pre-processed data.

[0312] In an embodiment of the present application, when the terminal device is currently in a CP control scenario, the AP only needs to perform a preprocessing operation on the currently displayed image to obtain preprocessing data.

[0313] In the embodiment of the present application, an AP heterogeneous network service module is deployed on the AP of the terminal device, and the AP heterogeneous network service module includes a data collaborative management module and a state collaborative management module. A CP heterogeneous network service module is deployed on the CP, and the CP heterogeneous network service module includes a data collaborative management module and a state collaborative management module.

[0314] The specific implementation method of the AP of the terminal device generating pre-processed data can be found in S802 above and will not be repeated here.

[0315] S1503: The terminal device synchronizes the pre-processed data from the AP to the CP.

[0316] In an embodiment of the present application, the terminal device synchronizes the pre-processed data from the AP to the CP so that the CP sends and displays the pre-processed data.

[0317] The specific implementation method of the terminal device synchronizing the pre-processed data from the AP to the CP is shown in S803 above, which will not be repeated here.

[0318] In some embodiments of the present application, after the terminal device synchronizes the processed data from the AP to the CP, if the display control right belongs to the AP, the terminal device first switches the display control right from the AP to the CP, and then executes S1504.

[0319] In some other embodiments of the present application, after the terminal device synchronizes the processed data from the AP to the CP, if the display control right belongs to the CP, S1504 is directly executed.

[0320] S1504: The CP of the terminal device determines display driving data according to the preprocessing data, and transmits the display driving data to a display screen of the terminal device.

[0321] In a possible implementation, after synchronizing the preprocessed data sent by the AP side, the CP combines the preprocessed data according to a preset method to generate display driver data, and the CP transmits the display driver data to the display screen of the terminal device through MIPI.

[0322] S1505. The terminal device uses the AP to perform display control.

[0323] The specific implementation method of the terminal device using the AP to perform display control is shown in S805 above and will not be repeated here.

[0324] In this way, the terminal device can be displayed by the CP and AP in collaboration, and part of the UI display load can be deployed on the CP, so that the CP has the ability to take over the display interaction in the application scenario, and the display is completed through the low-power core CP. On the basis of ensuring the same effect on the CP side and the AP side, the overall power consumption of the terminal device during display is reduced, and the battery life of the terminal device is improved.

[0325] The above mainly introduces the solution provided by the embodiment of the present application from the perspective of the method. It is understandable that in order to realize the above functions, the terminal device includes a hardware structure and / or software module corresponding to each function. In combination with the units and algorithm steps of each example described in the embodiment disclosed in this application, the embodiment of the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in hardware or computer-driven hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the technical solution of the embodiment of the present application.

[0326] The present application is an embodiment that can divide the functional modules of the terminal device according to the above method example. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing unit. The above integrated unit can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of units in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0327] like Fig.16 1600 is a schematic diagram of the structure of another terminal device provided in an embodiment of the present application. The terminal device 1600 can be used to implement the methods described in the above method embodiments. Exemplarily, the terminal device 1600 may specifically include: a processing module 1601, an acquisition module 1602, and a display module 1603.

[0328] The processing module 1601 is used to execute the support terminal device 1600 to execute Figures 4 to 15 The processing function of any one of the items.

[0329] The acquisition module 1602 is used to execute the support terminal device 1600 to execute Figures 4 to 15The acquisition function of any item in. For example, obtaining the currently displayed image, etc.

[0330] The display module 1603 may be used to display a screen according to the display driver data, etc. And / or, the display module 1603 may also be used to support the terminal device 1600 to perform other display operations performed by the terminal device in the embodiment of the present application.

[0331] Optional, Fig.16 The terminal device 1600 shown may also include a communication module ( Fig.16 (not shown), the communication module is used to support the terminal device 1600 to execute the steps of communication between the terminal device and other devices in the embodiment of the present application.

[0332] Optional, Fig.16 The terminal device 1600 shown may also include a storage module ( Fig.16 (not shown in the figure), the storage module stores a program or instruction. When the processing module 1601 executes the program or instruction, Fig.16 The terminal device 1600 shown can execute the method shown in the above method embodiment.

[0333] Fig.16 The technical effects of the terminal device 1600 shown can refer to the technical effects of the method described in the above method embodiment, and will not be repeated here. Fig.16 The processing module 1601 involved in the terminal device 1600 shown can be implemented by a processor or a processor-related circuit component, which can be a processor or a processing module. The communication module can be implemented by a transceiver or a transceiver-related circuit component, which can be a transceiver or a transceiver module. The display module 1603 can be implemented by display screen-related components.

[0334] like Fig.17 1700 is a schematic diagram of the structure of another terminal device provided in an embodiment of the present application. The terminal device 1700 can be used to implement the methods described in the above method embodiments. Exemplarily, the terminal device 1700 may specifically include: a first processing unit 1701, a second processing unit 1702, and a display screen 1703.

[0335] In the embodiment of the present application, the first processing unit 1701 is used to determine whether the current scene is a scene controlled by the second processing unit.

[0336] In the embodiment of the present application, the first processing unit 1701 is also used to generate processing data if the current scene is a scene controlled by the second processing unit; the first processing unit 1701 is also used to switch the display control right from the first processing unit 1701 to the second processing unit 1702; the second processing unit 1702 is used to generate first display driving data according to the processing data; the display screen 1703 is used to display according to the first display driving data.

[0337] In the embodiment of the present application, the first processing unit 1701 is further used to generate second display driving data if the current scene is not the scene controlled by the second processing unit; the display screen 1703 is further used to display according to the second display driving data.

[0338] In the embodiment of the present application, the first processing unit 1701 is a high power consumption processing unit, and the second processing unit 1702 is a low power consumption processing unit.

[0339] In an embodiment of the present application, if the display screen is an electronic ink screen, the processed data includes pre-processed data, and the pre-processed data is the first graphic element data drawn and generated by the first processing unit 1701, then the second processing unit 1702 is also used to generate first data to be displayed based on the pre-processed data; the second processing unit 1702 is also used to perform a conversion operation on the first data to be displayed to generate first display driving data.

[0340] In the embodiment of the present application, the first data to be displayed is a first graphic element control obtained by combining preprocessed data.

[0341] In an embodiment of the present application, if the display screen is an electronic ink screen, the processed data includes conversion data, and the conversion data is second graphics data generated after the first processing unit 1701 performs a conversion operation on the first graphics data generated by the first processing unit, then the second processing unit 1702 is also used to generate second data to be displayed based on the conversion data; the second processing unit 1702 is also used to determine the second data to be displayed as the first display drive data.

[0342] In the embodiment of the present application, the second data to be displayed is a second graphic element control obtained by combining the converted data.

[0343] In the embodiment of the present application, the first processing unit 1701 is further used to classify each graphic element in the currently displayed image; the first processing unit 1701 is further used to draw and generate processing data according to the classified graphic element information.

[0344] In the embodiment of the present application, the conversion operation includes: grayscale processing or timing processing.

[0345] In an embodiment of the present application, if the display screen is a non-electronic ink screen, the processed data includes pre-processed data, and the pre-processed data is the first graphic element data drawn and generated by the first processing unit 1701. Then the second processing unit 1702 is also used to combine the pre-processed data according to a preset method to generate first display drive data.

[0346] In the embodiment of the present application, the second processing unit 1702 is further used to synchronously process data from the first processing unit 1701 before switching the display control right from the first processing unit 1701 to the second processing unit 1702.

[0347] In an embodiment of the present application, the second processing unit controls a scene including a reading and browsing scene or a screen-on standby scene.

[0348] The present application also provides a chip system, such as Fig.18 As shown, the chip system includes at least one processor 1801 and at least one interface circuit 1802. The processor 1801 and the interface circuit 1802 can be interconnected via lines. For example, the interface circuit 1802 can be used to receive signals from other devices. For another example, the interface circuit 1802 can be used to send signals to other devices (such as processor 1801). Exemplarily, the interface circuit 1802 can read instructions stored in the memory and send the instructions to the processor 1801. When the instructions are executed by the processor 1801, the terminal device can execute the various steps executed by the terminal device in the above embodiment. Of course, the chip system can also include other discrete devices, which are not specifically limited in the embodiments of the present application.

[0349] Optionally, the processor in the chip system may be one or more. The processor may be implemented by hardware or by software. When implemented by hardware, the processor may be a logic circuit, an integrated circuit, etc. When implemented by software, the processor may be a general-purpose processor implemented by reading software code stored in a memory.

[0350] Optionally, the memory in the chip system may be one or more. The memory may be integrated with the processor or may be separately provided with the processor, which is not limited in the present application. Exemplarily, the memory may be a non-transient processor, such as a read-only memory ROM, which may be integrated with the processor on the same chip or may be provided on different chips. The present application does not specifically limit the type of memory and the arrangement of the memory and the processor.

[0351] Exemplarily, the chip system can be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a microcontroller unit (MCU), a programmable logic device (PLD) or other integrated chips.

[0352] It should be understood that each step in the above method embodiment can be completed by an integrated logic circuit of hardware in a processor or by instructions in the form of software. The method steps disclosed in the embodiments of the present application can be directly embodied as being executed by a hardware processor, or by a combination of hardware and software modules in a processor.

[0353] An embodiment of the present application also provides a computer storage medium, in which computer instructions are stored. When the computer instructions are executed on a terminal device, the terminal device executes the method described in the above method embodiment.

[0354] An embodiment of the present application provides a computer program product, which includes: a computer program or instructions, when the computer program or instructions are executed on a computer, the computer executes the method described in the above method embodiment.

[0355] In addition, an embodiment of the present application also provides a device, which can specifically be a chip, component or module, and the device may include a connected processor and memory; wherein the memory is used to store computer-executable instructions, and when the device is running, the processor can execute the computer-executable instructions stored in the memory so that the device executes the methods in the above-mentioned method embodiments.

[0356] Among them, the terminal device, computer storage medium, computer program product or chip provided in this embodiment is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.

[0357] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0358] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The various embodiments can be combined with each other or referenced to each other without conflict. The device embodiments described above are merely schematic. For example, the division of modules or units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0359] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0360] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0361] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0362] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A terminal device, comprising a first processing unit, a second processing unit and a display screen, characterized in that: The first processing unit is used to determine whether the current scene is a scene controlled by the second processing unit; The first processing unit is further configured to generate processing data if the current scene is a scene controlled by the second processing unit; the second processing unit is configured to synchronize the processing data from the first processing unit and generate first display driving data according to the processing data; The display screen is used to display according to the first display driving data; the first display driving data is generated by the second processing unit and is used to drive the display screen to display image data; The first processing unit is further configured to generate second display driving data if the current scene is not the scene controlled by the second processing unit; The display screen is used to display according to the second display driving data; The second display driving data is generated by the first processing unit and is used to drive the display screen to display image data; The first processing unit is a high power consumption processing unit, and the second processing unit is a low power consumption processing unit.

2. The terminal device according to claim 1, characterized in that: The display screen is an electronic ink screen, the processed data includes pre-processed data, and the pre-processed data is first graphic element data generated by the first processing unit; The second processing unit is further used to generate first data to be displayed according to the pre-processed data; The first data to be displayed is a first graphic element control obtained by combining the preprocessed data; The second processing unit is further configured to perform a conversion operation on the first data to be displayed to generate the first display driving data.

3. The terminal device according to claim 1, characterized in that: The display screen is an electronic ink screen, the processed data includes conversion data, and the conversion data is second graphic element data generated after the first processing unit performs a conversion operation on the first graphic element data generated by the first processing unit; The second processing unit is further used to generate second data to be displayed according to the conversion data; the second data to be displayed is a second graphic element control obtained by combining the conversion data; The second processing unit is further configured to determine the second data to be displayed as the first display driving data.

4. The terminal device according to any one of claims 1 to 3, characterized in that: The first processing unit is further used to classify each metadata in the currently displayed image; The first processing unit is further configured to generate the processed data by drawing according to the classified graphic metadata.

5. The terminal device according to any one of claims 2 to 3, characterized in that: The conversion operation includes: grayscale processing or timing processing.

6. The terminal device according to claim 1, characterized in that: The display screen is a non-electronic ink screen, the processed data includes pre-processed data, and the pre-processed data is first graphic element data generated by the first processing unit; The second processing unit is further configured to combine the preprocessed data according to a preset method to generate the first display driving data.

7. The terminal device according to any one of claims 1 to 6, characterized in that: The second processing unit is further configured to take over the display control right from the first processing unit after synchronizing the processed data from the first processing unit if the display control right belongs to the first processing unit; the display control right is the right to control the display subsystem.

8. The terminal device according to any one of claims 1 to 7, characterized in that: The second processing unit controls a scene including a reading and browsing scene or a screen-on standby scene.

9. A display method, characterized in that: Applied to a terminal device including a first processing unit, a second processing unit and a display screen, the method includes: Determining whether the current scene is a second processing unit control scene; If the current scene is the scene controlled by the second processing unit, after the processing data is generated by the first processing unit, the processing data is synchronized from the first processing unit by the second processing unit, and first display driving data is generated according to the processing data; display is performed according to the first display driving data; the first display driving data is generated by the second processing unit and is used to drive the image data displayed on the display screen; If the current scene is not the scene controlled by the second processing unit, generating second display driving data through the first processing unit; displaying according to the second display driving data; the second display driving data is generated by the first processing unit and is used to drive the image data displayed on the display screen; The first processing unit is a high power consumption processing unit, and the second processing unit is a low power consumption processing unit.

10. The method according to claim 9, characterized in that The display screen is an electronic ink screen, the processed data includes pre-processed data, and the pre-processed data is first graphic element data generated by the first processing unit; The generating first display driving data according to the processed data by the second processing unit includes: Generate first data to be displayed according to the preprocessed data by the second processing unit; the first data to be displayed is a first graphic element control obtained by combining the preprocessed data; A conversion operation is performed on the first data to be displayed to generate the first display driving data.

11. The method according to claim 9, characterized in that The display screen is an electronic ink screen, the processed data includes conversion data, and the conversion data is second graphic element data generated after the first processing unit performs a conversion operation on the first graphic element data generated by the first processing unit; The generating first display driving data according to the processed data by the second processing unit includes: Generate second data to be displayed according to the conversion data by the second processing unit; the second data to be displayed is a second graphic element control obtained by combining the conversion data; The second data to be displayed is determined as the first display driving data.

12. The method according to any one of claims 9 to 11, characterized in that: The generating of processing data by the first processing unit includes: Classify each element of the graphic data in the currently displayed image by the first processing unit; The processed data is generated by drawing according to the classified image element data.

13. The method according to any one of claims 10-11, characterized in that: The conversion operation includes: grayscale processing or timing processing.

14. The method according to claim 9, characterized in that The display screen is a non-electronic ink screen, the processed data includes pre-processed data, and the pre-processed data is first graphic element data generated by the first processing unit; The generating first display driving data according to the processed data by the second processing unit includes: The second processing unit combines the preprocessed data according to a preset method to generate the first display driving data.

15. The method according to any one of claims 9 to 14, characterized in that: After the second processing unit synchronizes the processing data from the first processing unit, the method further includes: If the display control right belongs to the first processing unit, the second processing unit takes over the display control right from the first processing unit; the display control right is the right to control the display subsystem.

16. The method according to any one of claims 9 to 15, characterized in that: The second processing unit controls a scene including a reading and browsing scene or a screen-on standby scene.

17. A chip system, characterized in that: It includes at least one processor and at least one interface circuit, wherein the at least one interface circuit is used to perform transceiver functions and send instructions to the at least one processor, and the at least one processor executes the instructions, and the at least one processor executes the method as described in any one of claims 9-16.

18. A computer-readable storage medium, characterized in that: The computer-readable storage medium comprises a computer program, and when the computer program is executed on an electronic device, the electronic device is caused to execute the method according to any one of claims 9 to 16.

19. A computer program product, characterized in that When the computer program product is run on a computer, the computer is caused to execute the method according to any one of claims 9 to 16.

Images