Display method, electronic device, readable storage medium and computer program product

Abstract

The invention relates to the technical field of terminals, in particular to a display method, electronic equipment, a readable storage medium and a computer program product. In the method, in response to a touch operation of a user, screen parameters of a screen corresponding to the touch operation are obtained, and the corresponding screen is controlled to be switched from a global all-weather display state to a screen-on state based on the screen parameters of the screen. In this way, by obtaining the screen parameters of the screens corresponding to the touch operation, the screens corresponding to the screen parameters of the screens in the multiple screens can be accurately controlled to be switched to the bright screen state from the global all-weather display state.

Description

Technical Field

[0001] This invention relates to the field of terminal technology, and in particular to a display method, electronic device, readable storage medium, and computer program product. Background Technology

[0002] Typically, the screen 110 of a candybar phone 100 can respond to user touch operations, such as responding to user click operations, from... Figure 1 The global always-on display (AOD) status shown in (a) is switched to the state as follows: Figure 1 The screen-on state shown in (b) is a low-power display mode that allows electronic devices such as mobile phones to still display certain information, such as time, date, and notifications, even when the screen is off.

[0003] Compared to foldable phones with multiple screens, a traditional smartphone 100 typically has only one screen. Therefore, when the operating system of the traditional smartphone 100 detects a user's touch operation, it doesn't need to determine which screen needs to switch from the global AOD state to the on-screen state; it can directly switch screen 110 from the global AOD state to the on-screen state. However, for foldable phones with multiple screens, because they have multiple screens, the operating system, upon detecting a user's touch operation, cannot determine which screen should switch from the global AOD state to the on-screen state. This results in the foldable phone being unable to respond to the user's touch operation and switch from the global AOD state to the on-screen state. Summary of the Invention

[0004] To address the issue that foldable phones cannot respond to user touch operations and switch from global AOD (Always On Demand) state to screen-on state, embodiments of this application provide a display method, an electronic device, a readable storage medium, and a computer program product.

[0005] In a first aspect, embodiments of this application provide a display method applied to a foldable electronic device. The foldable electronic device includes a first screen and a second screen located on both sides of the foldable electronic device. The method includes: detecting a first touch operation by a user on the first screen, causing the first screen to transition from a current first display state to a second display state; and detecting a second touch operation by a user on the second screen, causing the second screen to transition from a current third display state to a fourth display state.

[0006] It can be understood that the first screen can be an outer screen that is not foldable, and the second screen can be an inner screen that is foldable. The first touch operation and the second touch operation can each include a single-click touch operation, a double-click touch operation, and a sliding touch operation. The first display state can be the same as the third display state, which is a global AOD state. The second display state can be the same as the fourth display state, which is a bright screen state.

[0007] Based on the above scheme, in the foldable electronic device, when the touch operation of the user on the specific screen is detected, the specific screen is controlled to switch from the global AOD state to the bright screen state, so that the foldable electronic device can switch from the global AOD state to the bright screen state in response to the touch operation of the user.

[0008] In some optional implementations of the first aspect, the first display state and the third display state are both off-screen states, and the second display state and the fourth display state are both global AOD states. In this way, the foldable electronic device can switch from the off-screen state to the global AOD state in response to the touch operation of the user.

[0009] In some optional implementations of the first aspect, the first display state and the third display state are global all-weather display states, and the second display state and the fourth display state are bright screen states.

[0010] In the embodiments of the present application, when the foldable electronic device is in the global AOD state, if the touch operation of the user on the first screen or the second screen is detected, the first screen or the second screen can be accurately controlled to switch from the global AOD state to the bright screen state, that is, the foldable electronic device can switch from the global AOD state to the bright screen state in response to the touch operation of the user.

[0011] In some optional implementations of the first aspect, the first display state and the third display state are off-screen states, and the second display state and the fourth display state are global all-weather display states.

[0012] In the embodiments of the present application, when the foldable electronic device is in the global AOD state, if the touch operation of the user on the first screen or the second screen is detected, the first screen or the second screen can be accurately controlled to switch from the off-screen state to the global all-weather display state, that is, the foldable electronic device can switch from the off-screen state to the global all-weather display state in response to the touch operation of the user.

[0013] In some optional implementations of the first aspect, detecting the first touch operation of the user on the first screen includes: receiving a first display instruction; obtaining a first screen touch parameter corresponding to the first display instruction; and determining that the first display instruction corresponds to the first screen according to the first screen touch parameter, and detecting the first touch operation of the user on the first screen.

[0014] In the embodiments of the present application, by acquiring the screen parameter of the touch screen corresponding to the touch operation, the screen parameter of the touch screen in the plurality of touch screens in the foldable electronic device can be accurately determined, so as to control the corresponding touch screen to switch the state.

[0015] In some optional implementation forms of the first aspect, the first screen touch control parameter comprises capacitance data, and the first screen touch control parameter indicating that the first display instruction corresponds to the first screen comprises: collecting capacitance data of the first screen at a plurality of sampling moments; determining capacitance difference data of the first screen according to the capacitance data of the first screen at the plurality of sampling moments; and determining that the first screen touch control parameter indicates that the first display instruction corresponds to the first screen, in correspondence with the capacitance difference data of the first screen being greater than a preset capacitance difference threshold.

[0016] In some optional implementation forms of the first aspect, detecting the second touch operation of the user on the second screen comprises: receiving a second display instruction; acquiring a second screen touch control parameter corresponding to the second display instruction; and detecting the second touch operation of the user on the second screen, in correspondence with the second screen touch control parameter indicating that the second display instruction corresponds to the second screen.

[0017] In some optional implementation forms of the first aspect, the second screen touch control parameter comprises capacitance data, and the second screen touch control parameter indicating that the second display instruction corresponds to the second screen comprises: collecting capacitance data of the second screen at a plurality of sampling moments; determining capacitance difference data of the second screen according to the capacitance data of the second screen at the plurality of sampling moments; and determining that the second screen touch control parameter indicates that the second display instruction corresponds to the second screen, in correspondence with the capacitance difference data of the second screen being greater than a preset capacitance difference threshold.

[0018] In some optional implementation forms of the first aspect, the first touch operation and the second touch operation comprise any one of the following: a single-click touch operation, a double-click touch operation, and a sliding touch operation.

[0019] In some optional implementation forms of the first aspect, the second screen is a foldable screen.

[0020] In some optional implementation forms of the first aspect, the first display state and the third display state are a screen-on state, and the second display state and the fourth display state are a screen-off state.

[0021] In some optional implementation forms of the first aspect, the first touch operation or the second touch operation corresponds to a preset gesture, or the first touch operation or the second touch operation corresponds to a screen-off component.

[0022] In the embodiments of this application, when the foldable electronic device is in the bright screen state, if the touch operation of the user on the first screen or the second screen is detected, the first screen or the second screen can be accurately controlled to enter the screen-off state from the bright screen state, that is, the foldable electronic device can be switched from the bright screen to the screen-off state in response to the touch operation of the user.

[0023] In a second aspect, the present application provides an electronic device, comprising: a memory configured to store instructions for execution by one or more processors of the electronic device, and a processor configured to be one of the one or more processors of the electronic device, and configured to execute the display method of the first aspect of the present application or any of the mentioned display methods of the first aspect.

[0024] In a third aspect, the present application provides a readable storage medium, and the readable medium stores instructions, and the instructions, when executed on an electronic device, cause the electronic device to execute the display method of the first aspect of the present application or any of the mentioned display methods of the first aspect.

[0025] In a fourth aspect, the embodiments of the present application provide a computer program product, and the computer program product comprises computer instructions, and when executed on an electronic device, the electronic device executes the display method of the first aspect of the present application or any of the mentioned display methods of the first aspect.

[0026] The beneficial effects of the above-mentioned second aspect to the fourth aspect can refer to the related description in the above-mentioned first aspect and various possible implementations of the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF DRAWINGS

[0027] Figure 1 A schematic diagram of a straight phone 100 is shown;

[0028] Figure 2 According to some embodiments of the present application, schematic diagrams of various foldable phones are shown;

[0029] Figure 3 According to some embodiments of the present application, schematic diagrams of a foldable phone in different states are shown;

[0030] Figure 4 According to some embodiments of the present application, a schematic diagram of a software system of a first foldable phone is shown;

[0031] Figure 5 According to some embodiments of the present application, a flowchart of a display method is shown;

[0032] Figure 6 According to some embodiments of the present application, a schematic diagram of a software system of a foldable phone is shown;

[0033] Figure 7According to some embodiments of the present application, a schematic diagram of a software system of a second foldable mobile phone is shown.

[0034] Figure 8 According to some embodiments of the present application, a schematic diagram of the interaction between layers in a software system of a foldable mobile phone is shown.

[0035] Figure 9 According to some embodiments of the present application, a schematic diagram of the hardware structure of a foldable electronic device is shown. DETAILED DESCRIPTION

[0036] Illustrative embodiments of the present application include, but are not limited to, a display method, an electronic device, a storage medium, and a computer program product.

[0037] It can be understood that the display method involved in the present application is applicable to various foldable electronic devices, including but not limited to foldable mobile phones, foldable tablets, etc. Among them, the foldable mobile phone can be a foldable mobile phone 200 as shown in Figure 2 (a), or a foldable mobile phone 300 as shown in Figure 2 (b), or any other foldable electronic device not shown, for example, a foldable mobile phone including three screens, which is not specifically limited in the embodiments of the present application. Among them, the range of folding angle a of the foldable mobile phone 200 in the embodiments of the present application can be 0≤a≤180. When a = 0°, it can represent that the foldable mobile phone 200 is in a folded state, and when a = 180°, it can represent that the foldable mobile phone 200 is in an unfolded state. For ease of description, the display method will be described below with the foldable mobile phone 200 as shown in Figure 2 (a) as an example.

[0038] Continuing as shown in Figure 2 (a), the foldable mobile phone 200 can include multiple screens, such as a foldable inner screen 210 and a non-foldable outer screen 220.

[0039] As shown in Figure 3 (a), when the foldable mobile phone 200 is in a folded state, the outer screen 220 can be used to display information, such as time, date, or notification information, etc. As shown in Figure 3 (b), when the foldable mobile phone 200 is in an unfolded state, the inner screen 210 can be used to display the above-mentioned time, date, or notification information, etc.

[0040] As mentioned earlier, the foldable mobile phone 200 has multiple screens, and when detecting a user's touch operation, it cannot be clear which of the multiple screens should be controlled to switch from the global AOD state to the bright screen state, so that it cannot be switched from the global AOD state to the bright screen state in response to the user's touch operation.

[0041] The following further describes the reason why the foldable phone cannot switch from the global AOD state to the screen-on state in response to the user's touch operation, in combination with the software system of the foldable phone 200.

[0042] Specifically, Figure 4 A schematic diagram of a software system of a foldable phone 200 is shown.

[0043] As Figure 4 shown, the software system 410 of the foldable phone 200 can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture, etc. The following exemplarily illustrates the software system 410 of the foldable phone 200 by taking the layered architecture as an example.

[0044] Continuing as Figure 4 shown, the software system 410 adopting the layered architecture includes a plurality of layers, each layer having a clear role and division of labor. The layers communicate with each other through software interfaces. In some specific implementation manners, the software system 410 can include an application layer 411, a framework layer 412, and a kernel layer 413.

[0045] The application layer 411 can include a lock screen application 4111. The application layer 411 can also include other application programs such as a gallery, a calendar, a call, a map, a navigation, a Bluetooth, music, a video, a short message, etc., which are not specifically limited by the embodiments of the present application.

[0046] The framework layer 412 can provide application programming interfaces (APIs) and programming frameworks for the application programs of the application layer 411.

[0047] In some specific implementation manners, the framework layer 412 can include an all-day display service (AOD service) 4121. The framework layer 412 can also include an input manager, etc., which are not specifically limited by the embodiments of the present application.

[0048] The all-day display service (AOD service) 4121 is configured to issue a global AOD echo instruction to the underlying software to instruct the screen to display the global AOD state.

[0049] The kernel layer 413 is a layer between the software system and the hardware. The kernel layer 413 can include a touch panel driver (TP Driver) 4131, etc.

[0050] Continuing as Figure 3 and Figure 4As shown, when the global AOD function of the foldable mobile phone 200 is in an open state, if the processor detects that the foldable mobile phone 200 meets a preset condition, for example, detects a pressure signal on the power key 130, or detects that the screen-on time exceeds a preset time threshold, the AOD service 4121 in the framework layer 412 can issue a global AOD echo instruction to the touch screen driver 4131 in the kernel layer 413, and the global AOD echo instruction is used to instruct the screen to display the global AOD state. However, since the AOD service 4121 issues the global AOD echo instruction to the touch screen driver 4131, the information of the screen corresponding to the screen in which the global AOD echo instruction is not issued is not issued, so that it is not possible to control which screen in the multiple screens displays the global AOD state.

[0051] In addition, if the touch operation of the user on the screen is detected, the touch screen driver 4131 in the kernel layer 413 can report an input event (for example, a single-click input event, a double-click input event, etc.) to the lock screen application 4111 in the application layer 411. However, since the touch screen driver 4131 reports the input event to the application layer 411, the information of the screen corresponding to the input event is not reported, and further, it is not possible to control which screen in the multiple screens switches from the global AOD state to the screen-on state.

[0052] To solve the above problems, an embodiment of the present application provides a display method. In the method, in response to a touch operation of a user, a screen parameter of a screen corresponding to the touch operation (i.e., the touch operation parameter mentioned above, for example, the screen parameter "0" corresponding to the inner screen, and the screen parameter "1" corresponding to the outer screen) is acquired, and the corresponding screen is controlled to switch from the global AOD state to the screen-on state based on the screen parameter of the screen. In this way, by acquiring the screen parameter of the screen corresponding to the touch operation, it is possible to accurately control the screen corresponding to the screen parameter of the screen in the multiple screens to switch from the global AOD state to the screen-on state.

[0053] In some optional implementations, the screen parameter of the screen can be acquired in the following manner:

[0054] The capacitance data of each screen in the plurality of screens at a plurality of sampling time points is collected, and capacitance difference data representing capacitance changes is determined according to the capacitance data, and then the screen corresponding to the touch operation of the user is determined according to the capacitance difference data, and the screen parameter of the screen is taken as the screen parameter of the screen corresponding to the touch operation. For example, when it is detected that the capacitance difference data of a part of the area of the inner screen is greater than a preset capacitance difference threshold value, it is represented that the user performs a touch operation on the inner screen, at this time, the inner screen can be taken as the screen corresponding to the touch operation of the user, and the screen parameter "0" corresponding to the inner screen is taken as the screen parameter, so that the inner screen can be controlled to switch from the global AOD state to the bright screen state. When it is detected that the capacitance difference data of a part of the area of the outer screen is greater than a preset capacitance difference threshold value, it is represented that the user performs a touch operation on the outer screen, the outer screen can be taken as the screen corresponding to the touch operation of the user, and the screen parameter "1" corresponding to the outer screen is taken as the screen parameter, so that the outer screen can be controlled to switch from the global AOD state to the bright screen state.

[0055] The way of how to control the screen to display the global AOD state is further described below.

[0056] In some embodiments, different screens can be controlled to display the global AOD state according to the state of the foldable electronic device.

[0057] For example, when the global AOD function of the foldable mobile phone is in an enabled state, an AOD state trigger is detected, for example, the user sets a time without operating the mobile phone, or clicks the power key, or a preset touch gesture such as drawing a circle, drawing a triangle, or other any operation causing the AOD state trigger is detected when the global AOD function of the foldable mobile phone is in the enabled state, at this time, if it is detected that the foldable electronic device is in a folded state, it is indicated that the outer screen needs to display the AOD state, at this time, the echo global AOD instruction can be issued to the touch screen driver, wherein the echo global AOD instruction can include the screen parameter of the screen indicating the global AOD state, for example, the screen parameter "1" corresponding to the outer screen.

[0058] If it is detected that the foldable electronic device is in an unfolded state, it is indicated that the inner screen needs to display the AOD state, at this time, the echo global AOD instruction can be issued to the touch screen driver, wherein the echo global AOD instruction can include the screen parameter of the screen indicating the global AOD state, for example, the screen parameter "0" corresponding to the inner screen.

[0059] The display method mentioned in the embodiments of the present application is described in detail below. For example, Figure 5As shown, a flowchart of a display method is shown. Specifically, the display method can be performed by a foldable electronic device, such as the foldable phone mentioned above, where the foldable electronic device includes a first screen and a second screen on two sides of the foldable electronic device, and the display method can include:

[0060] 501: detecting a touch operation of a user on the foldable electronic device.

[0061] 502: if a first touch operation of a user on the first screen is detected, the first screen enters a second display state from a current first display state.

[0062] It can be understood that the first touch operation can be a single-click touch operation, a double-click touch operation, or a sliding touch operation. The first screen can be an outer screen of the foldable electronic device.

[0063] In some optional implementations, the first display state can be a global AOD state, and the second display state can be a screen-on state. The first display state can be an off-screen state, and the second display state can be a global AOD state.

[0064] In some optional implementations, when the first display instruction is received, a first screen touch control parameter corresponding to the first display instruction can be obtained, and if the first screen touch control parameter indicates that the first display instruction corresponds to the first screen, it can be determined that the first touch operation of the user on the first screen is detected.

[0065] 503: if a second touch operation of a user on the second screen is detected, the second screen enters a fourth display state from a current third display state.

[0066] It can be understood that the second touch operation can be a single-click touch operation, a double-click touch operation, or a sliding touch operation. The second screen can be an inner screen of the foldable electronic device.

[0067] In some optional implementations, the third display state can be a global AOD state, and the fourth display state can be a screen-on state. The third display state can be an off-screen state, and the fourth display state can be a global AOD state.

[0068] In some optional implementations, when the second display instruction is received, a second screen touch control parameter corresponding to the second display instruction can be obtained, and if the second screen touch control parameter indicates that the second display instruction corresponds to the second screen, it can be determined that the second touch operation of the user on the second screen is detected.

[0069] In some specific implementation manners, the capacitance data of the first screen and the second screen at a plurality of sampling moments can be respectively collected, and the capacitance difference value data of the first screen and the second screen can be respectively determined. When the capacitance difference value data corresponding to the first screen is greater than a preset capacitance difference value threshold, the screen parameter of the first screen is determined as the first screen touch parameter corresponding to the first display instruction. When the capacitance difference value data corresponding to the second screen is greater than the preset capacitance difference value threshold, the screen parameter of the second screen is determined as the second screen touch parameter corresponding to the second display instruction.

[0070] The display method mentioned in the embodiments of the present application can be applied to the foldable mobile phone 200. The display method mentioned in the embodiments of the present application will be described in detail in combination with the system architecture of the foldable mobile phone 200.

[0071] In some specific implementation manners, the system architecture of the foldable mobile phone 200 can include a software system and hardware. The software system can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture, etc.

[0072] The software system adopting the layered architecture includes a plurality of layers, and each layer has a clear role and division of labor. The layers communicate with each other through a software interface.

[0073] The following two specific embodiments will be described exemplarily with the layered architecture as an example.

[0074] Embodiment one

[0075] As shown in Figure 6 In some specific implementation manners, the software system 610 of the foldable mobile phone 200 can be divided into four layers from top to bottom, i.e., an application layer 611, a framework layer 612, a hardware abstract layer (HAL) 613, and a kernel layer 614.

[0076] The application layer 611 can include a lock screen application 6111. The application layer 611 can also include other application programs such as a gallery, a calendar, a call, a map, navigation, Bluetooth, music, video, short message, etc., which are not limited in the embodiments of the present application.

[0077] The framework layer 612 can provide an application programming interface (API) and a programming framework for the application programs of the application layer 611.

[0078] In some specific implementations, the framework layer 612 may include an Always-On Display (AOD) service 6121, an input manager 6122, etc. The framework layer 612 may also include a content provider, a view system, a phone manager, a resource manager, a notification manager, etc., but this application embodiment does not specifically limit the scope.

[0079] The AOD service 6121 is used to send a global AOD instruction to the hardware abstraction layer 613. The global AOD instruction is used to indicate that the screen of the foldable phone 200 (e.g., the inner screen 110 or the outer screen 120) is in a global AOD state.

[0080] The input manager 6122 is used to report input events to the lock screen application 6111. For example, when a touch operation corresponding to a user's touch gesture (such as a single click, double click, or swipe) is detected, the input event (such as a single click, double click, or swipe) can be reported to the lock screen application 6111.

[0081] The hardware abstraction layer 613 can provide a unified interface for upper-layer software, so that upper-layer software does not have to care about the implementation details of the underlying hardware, thereby improving the portability and reusability of the code.

[0082] In some specific implementations, the hardware abstraction layer 613 may include a touch panel hardware abstraction layer (TP HAL) 6131. ​​The touch panel hardware abstraction layer (TP HAL) 6131 can provide an AIDL interface or an HDIL interface for the AOD service 6121 to receive and echo global AOD commands issued by the AOD service 6121.

[0083] Kernel layer 614 is the layer between software system 610 and hardware 620. Kernel layer 614 may include touch panel driver (TP Driver) 6141, etc.

[0084] Continue as Figure 6 As shown, hardware 620 may include an inner screen 110 and an outer screen 120. Exemplarily, the inner screen 110 may be described as an inner screen touch panel integrated circuit (TP IC), and the outer screen may be described as an outer screen touch panel integrated circuit.

[0085] In some specific implementations, the inner screen 110 can report an input event to the upper-layer software in response to a touch operation corresponding to the user touch gesture. For example, the inner screen 110 can report a click input event to the upper-layer software (e.g., the input manager 6122 mentioned above) in response to a touch operation corresponding to the user single-click touch gesture. The inner screen 110 can also report a double-click input event to the upper-layer software in response to a touch operation corresponding to the user double-click touch gesture. The inner screen 110 can also report a sliding input event to the upper-layer software in response to a touch operation corresponding to the user sliding touch gesture.

[0086] Likewise, the outer screen 120 can also report a click input event to the upper-layer software in response to a touch operation corresponding to the user single-click touch gesture. To avoid repetition, details are not described herein.

[0087] Embodiment Two

[0088] As shown in FIG. 7, in some specific implementations, the software system 710 can be divided into four layers, from top to bottom, an application layer 711, a framework layer 712, a native service layer 713, and a kernel layer 714. Figure 7 The application layer 711 can include a lock screen application 7111. The application layer 711 can also include other application programs such as a gallery, a calendar, a call, a map, a navigation, a Bluetooth, music, video, short message, etc., and the present embodiments are not limited in this regard.

[0089] The framework layer 712 can provide an application programming interface (API) and a programming framework for the application programs of the application layer 711.

[0090] In some specific implementations, the framework layer 712 can include a base framework 7121, an always-on display service (AOD service) 7122, an input manager 7123, etc. The framework layer 712 can also include a view system, a content provider, a phone manager, a resource manager, a notification manager, etc., and the present embodiments are not limited in this regard.

[0091] The base framework 7121 is configured to issue folding state information to the touch screen hardware abstraction layer 7131, issue an on-off screen instruction to the AOD service 7122, and issue a global always-on display echo instruction to the AOD service 7122.

[0092]

[0093] ​In some specific implementations, when it is detected that the folding angle of the foldable phone 200 is 0°, the foldable phone 200 in the folded state information can be issued to the touch screen hardware abstraction layer 7131. When it is detected that the folding angle of the foldable phone 200 is 180°, the foldable phone 200 in the unfolded state information can be issued to the touch screen hardware abstraction layer 7131.

[0094] The AOD service 7122 is configured to issue a global AOD echo instruction to the local service layer 713, where the global AOD echo instruction is configured to indicate that the screen (e.g., the inner screen 110 or the outer screen 120) of the foldable phone 200 is in a global AOD state.

[0095] The input manager 7123 is configured to report an input event to the lock screen application 7111. For example, when a touch operation (e.g., a single-click operation, a double-click operation, a sliding operation) corresponding to a user touch gesture is detected, an input event (e.g., a single-click input event, a double-click input event, a sliding input event) can be reported to the lock screen application 7111.

[0096] The view system includes visual controls, such as controls that display text, controls that display pictures, and the like. A display interface can be composed of one or more views, such as a view that includes information such as time, date, or notifications.

[0097] The local service layer 713 can provide a unified interface for the upper layer software, so that the upper layer software does not have to care about the implementation details of the underlying hardware, thereby improving the portability and reusability of the code.

[0098] In some specific implementations, the local service layer 713 can include a touch panel hardware abstraction layer (TP HAL) 7131, a sensor hardware abstraction layer (Sensor HAL) 7132, and other hardware abstraction layers. The touch panel hardware abstraction layer (TP HAL) 7131 can receive the global AOD echo instruction issued by the AOD service 7122 through the touch panel hardware abstraction layer interface.

[0099] The kernel layer 714 is a layer between the software system and the hardware. The kernel layer 714 can include a touch panel driver (TP Driver) 7141, a sensor driver 7142, and the like.

[0100] Continuing as Figure 7As shown, the hardware 720 can include a sensor 721, an inner screen 110, and an outer screen 120. Exemplarily, the sensor 721 can be referred to as a sensor integrated circuit (Sensor IC), the inner screen 110 can be described as an inner screen touch panel integrated circuit (TP IC), and the outer screen can be described as an outer screen touch panel integrated circuit.

[0101] In some specific implementations, the sensor 721 can be disposed on the inner screen 110. The sensor 721 determines the state of the foldable mobile phone 200 by detecting the folding angle of the inner screen 110. For example, when the folding angle of the inner screen 110 is detected to be 0°, it can be determined that the foldable mobile phone 200 is in a folded state, and when the folding angle of the inner screen 110 is detected to be 180°, it can be determined that the foldable mobile phone 200 is in an unfolded state.

[0102] In addition, the sensor 721 on the inner screen 110 can also detect touch operations acting on or near it. For example, the touch distance and the touch times corresponding to the touch distance can be detected. In addition, the sensor 721 can pass the detected touch operation to the corresponding inner screen 110.

[0103] Likewise, the sensor 721 can also be disposed on the outer screen 120 to detect touch operations acting on or near it. To avoid repetition, it will not be described here.

[0104] When there is a touch operation acting on the inner screen 110 or the outer screen 120, the foldable mobile phone 200 can detect the touch operation times according to the sensor 721. In some specific implementations, touch operations of different touch times can correspond to different instructions. For example, when the touch times is 1 (i.e., single click), the report single click event instruction is executed. When the touch times is 2 (i.e., double click) within a preset time threshold, the report double click event instruction is executed.

[0105] Alternatively, when there is a sliding operation acting on the inner screen 110 or the outer screen 120, the foldable mobile phone 200 can detect the sliding distance according to the sensor 721. In some specific implementations, sliding operations of different sliding distances can correspond to different responses. For example, when the sliding distance is greater than a preset distance threshold, the report sliding event instruction is executed. When the sliding distance is less than or equal to the preset distance threshold, the report event instruction is not executed.

[0106] The display method mentioned in the embodiments of the present application will be described in detail below in combination with the system architecture of the foldable mobile phone 200 as shown. Figure 7

[0107] ​Figure 8 An interaction schematic of a display method is shown, which can include:

[0108] 801: The base framework 7121 issues the folding state information to the touch screen hardware abstraction layer 7131.

[0109] It can be understood that when the sensor 721 on the inner screen 110 detects that the folding angle of the inner screen 110 is less than 180°, it can be determined that the foldable mobile phone 200 is in a folding state, and then the sensor 721 on the inner screen 110 can trigger an interrupt and sequentially report the state information of the foldable mobile phone to the base framework 7121 through the sensor driver 7141 and the sensor hardware abstraction layer (Sensor HAL) 7131. For example, the folding state information is reported. When the base framework 7121 receives the folding state information, it can issue the folding state information to the touch screen hardware abstraction layer (TP HAL) 7131.

[0110] 802: The touch screen hardware abstraction layer 7131 issues the folding state information to the touch screen driver 7141.

[0111] It can be understood that when the touch screen hardware abstraction layer (TP HAL) 7131 receives the folding state information, it can issue the folding state information to the touch screen driver (TP Driver) 7141.

[0112] 803: The touch screen driver 7141 issues a power down instruction to the inner screen touch screen integrated circuit 110.

[0113] It can be understood that the power down instruction can be a power down command prompt (command, CMD).

[0114] In some specific implementations, when the touch screen driver (TP Driver) 7141 receives the folding state information, it can send a power down instruction, such as a power off instruction, to the inner screen touch screen integrated circuit 110, where the power off instruction is used to instruct the inner screen touch screen integrated circuit 110 to completely power down.

[0115] 804: The touch screen driver 7141 issues a power down instruction to the outer screen touch screen integrated circuit 120.

[0116] In some specific implementations, when the touch screen driver (TP Driver) 7141 receives the folding state information, it can send a power down instruction, such as a suspend instruction, to the outer screen touch screen integrated circuit 120, where the suspend instruction is used to instruct the outer screen touch screen integrated circuit 120 to be in an open gesture detection state.

[0117] It can be understood that the execution order of steps 803 and 804 can be to execute step 803 first and then execute step 804. It can also be to execute step 804 first and then execute step 803. It can also be to execute steps 803 and 804 in parallel, and the embodiments of the present application do not make specific limitations.

[0118] 805: The basic framework 7121 issues a screen-on / off instruction to the all-weather display service 7122.

[0119] It can be understood that when the sensor 721 on the inner screen 110 detects that the folding angle of the inner screen 110 is less than 180°, the basic framework 7121 issues a screen-on / off instruction to the all-weather display service (AOD Service) 7122. Wherein, the screen-on / off instruction is used to instruct the all-weather display service to issue a corresponding instruction to the touch screen hardware abstraction layer according to the state information of the inner screen 110 of the foldable mobile phone 200. For example, when the state information of the inner screen 110 of the foldable mobile phone 200 is folding state information, the all-weather display service can be instructed to issue an outer screen power-on instruction and an inner screen power-off instruction to the touch screen hardware abstraction layer.

[0120] 806: The all-weather display service 7122 issues an outer screen power-on instruction to the touch screen hardware abstraction layer 7131.

[0121] In some specific implementations, when the all-weather display service (AOD Service) 7122 receives the screen-on / off instruction, an outer screen power-on instruction can be issued to the touch screen hardware abstraction layer (TP HAL) 7131.

[0122] 807: The touch screen hardware abstraction layer 7131 issues an outer screen power-on instruction to the touch screen driver 7141.

[0123] It can be understood that when the touch screen hardware abstraction layer (TP HAL) 7131 receives the outer screen power-on instruction, the touch screen driver (TP Driver) 7141 can be sent to issue the outer screen power-on instruction.

[0124] 808: The all-weather display service 7122 issues an inner screen power-off instruction to the touch screen hardware abstraction layer 7131.

[0125] In some specific implementations, when the all-weather display service (AOD Service) 7122 receives the screen-on / off instruction, an inner screen power-off instruction can be issued to the touch screen hardware abstraction layer (TP HAL) 7131.

[0126] 809: The touch screen hardware abstraction layer 7131 issues an inner screen power-off instruction to the touch screen driver 7141.

[0127] It can be understood that when the touch screen hardware abstraction layer (TP HAL) 7131 receives the internal screen power-off instruction, the touch screen driver (TP Driver) 7141 can be sent to issue the internal screen power-off instruction.

[0128] It can be understood that the execution order of steps 806 and 808 can be to execute step 806 first and then execute step 808. It can also be to execute step 808 first and then execute step 806. It can also be to execute steps 806 and 808 in parallel, and the embodiments of the present application are not limited specifically.

[0129] It should be noted that the touch screen driver (TP Driver) 7141 can determine whether to filter the outer screen power-on instruction according to the opening state of the outer screen power-off function after folding. When the foldable mobile phone 200 does not open the outer screen power-off function after folding, the touch screen driver (TP Driver) 7141 filters the outer screen power-on instruction and executes step 810. Otherwise, the touch screen driver (TP Driver) 7141 does not filter the outer screen power-on instruction, but issues the outer screen power-on instruction to the internal screen touch screen integrated circuit 110.

[0130] 810: The base framework 7121 issues a global AOD echo instruction to the all-weather display service 7122.

[0131] It can be understood that when the sensor 721 on the internal screen 110 detects that the folding angle of the internal screen 110 is less than 180°, and the foldable mobile phone 200 does not open the outer screen power-off function after folding, the base framework 7121 can issue a global AOD echo instruction to the all-weather display service (AOD Service) 7122. The global AOD echo instruction can include a screen parameter indicating a screen displaying a global AOD state.

[0132] 811: The all-weather display service 7122 issues a global AOD echo instruction to the touch screen hardware abstraction layer 7131.

[0133] In some specific implementations, when the all-weather display service (AOD Service) 7122 receives the global AOD echo instruction, the touch screen hardware abstraction layer (TP HAL) 7131 can be issued to issue the global AOD echo instruction.

[0134] 812: The touch screen hardware abstraction layer 7131 issues a global AOD echo instruction to the touch screen driver 7141.

[0135] In some specific implementations, when the touch screen hardware abstraction layer (TP HAL) 7131 receives the global AOD echo instruction, the touch screen driver (TP Driver) 7141 can be issued to issue the global AOD echo instruction.

[0136] 813: The touch screen driver 7141 parses the echo global all-weather display instruction to obtain a screen parameter, and sends a support global all-weather display instruction to the outer screen touch screen integrated circuit 120.

[0137] It can be understood that when the touch screen driver (TP Driver) 7141 receives the echo global all-weather display instruction, the echo global all-weather display instruction can be parsed to obtain a screen parameter. The screen parameter indicates the screen corresponding to the echo global all-weather display instruction. For example, when the screen parameter is “0”, it indicates that the echo global all-weather display instruction corresponds to the inner screen 110, and when the screen parameter is “1”, it indicates that the echo global all-weather display instruction corresponds to the outer screen 120. Here, since it is detected that the folding angle of the inner screen 110 is less than 180°, the screen parameter is “1”.

[0138] 814: When the outer screen touch screen integrated circuit 120 detects a touch operation corresponding to a user touch gesture, an input event is reported to the touch screen driver 7141.

[0139] It can be understood that when the folding angle of the inner screen 110 is 0°, that is, the foldable mobile phone 200 is in a folded state, if a touch operation corresponding to a user touch gesture is detected, the outer screen touch screen integrated circuit 7141 can report an input event to the touch screen driver (TP Driver). For example, a single-click input event, a double-click input event, a sliding input event, and the like, which are specifically described above, and will not be described in detail here.

[0140] It can be understood that the input event can include a screen parameter corresponding to the touch operation of the user. In some specific implementation manners, the screen parameter of the screen can be obtained by the following manner: collecting the capacitance data of each screen in the plurality of screens at a plurality of sampling moments, and determining the capacitance difference data representing the capacitance change according to the capacitance data, and then determining the screen corresponding to the touch operation of the user according to the capacitance difference data, and taking the screen parameter of the screen as the screen parameter of the screen corresponding to the touch operation. Here, if it is detected that the capacitance difference value data of the partial area of the outer screen is greater than a preset capacitance difference value threshold, the outer screen can be taken as the screen corresponding to the touch operation of the user, and the screen parameter “1” corresponding to the outer screen can be taken as the screen parameter.

[0141] 815: The touch screen driver 7141 reports the input event to the input manager 7123.

[0142] In some specific implementation manners, when the touch screen driver (TP Driver) receives the input event, the input event can be reported to the input manager.

[0143] It is understandable that after the input manager 7123 receives an input event, it can report the input event to the lock screen application 7111. Thus, the lock screen application 7111 can control the external screen 120 to switch from the global AOD state to the on screen state based on the screen parameter "1" in the input event.

[0144] The following is combined with Figure 9 The hardware structure of the foldable electronic device shown will be described in detail with reference to the display method mentioned in the embodiments of this application.

[0145] like Figure 9 As shown, the foldable electronic device 900 may include a processor 910, an external memory interface 920, an internal memory 921, a universal serial bus (USB) interface 930, a charging management module 940, a power management module 941, a battery 942, antenna 1, antenna 2, a mobile communication module 950, a wireless communication module 960, an audio module 970, a speaker 970A, a receiver 970B, a microphone 970C, a headphone jack 970D, a sensor module 980, buttons 990, a motor 991, an indicator 992, a camera 993, a display screen 994, and a subscriber identification module (SIM) card interface 999, etc. The sensor module 980 may include a pressure sensor 980A, etc.

[0146] It is understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the foldable electronic device. In other embodiments of this application, the foldable electronic device 900 may include more or fewer components than illustrated, or combine some components, or separate some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0147] Processor 910 may include one or more processing units, such as application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU). These different processing units may be independent devices or integrated into one or more processors.

[0148] In some alternative implementations, the processor 910 can execute the display method mentioned in embodiments of the present application.

[0149] The controller can generate operation control signals according to the instruction operation code and the timing signal, and complete the control of fetching and executing instructions.

[0150] The processor 910 can also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 910 is a cache memory. The memory can store instructions or data that have just been used or are used repeatedly by the processor 910. If the processor 910 needs to use the instructions or data again, it can directly call them from the memory. This avoids repeated access and reduces the waiting time of the processor 910, thereby improving the efficiency of the system.

[0151] In some alternative implementations, the memory can store instructions or data of the display method mentioned in embodiments of the present application.

[0152] The wireless communication function of the foldable electronic device can be realized by the antenna 1, the antenna 2, the mobile communication module 950, the wireless communication module 960, the modem processor, and the baseband processor, etc.

[0153] The antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the foldable electronic device can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example, the antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0154] The mobile communication module 950 can provide a solution including 2G / 3G / 4G / 5G wireless communication applied to the foldable electronic device. The mobile communication module 950 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 950 can receive electromagnetic waves from the antenna 1, and perform filtering, amplification, etc. on the received electromagnetic waves, and transmit them to the modem processor for demodulation. The mobile communication module 950 can also amplify the signals modulated by the modem processor, and convert them into electromagnetic waves radiated by the antenna 1. In some embodiments, at least part of the functional modules of the mobile communication module 950 can be arranged in the processor 910. In some embodiments, at least part of the functional modules of the mobile communication module 950 and at least part of the modules of the processor 910 can be arranged in the same device.

[0155] The modem processor can include a modulator and a demodulator. The modulator is configured to modulate a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is configured to demodulate a received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal processed by the baseband processor is transmitted to the application processor. The application processor outputs an audio signal through an audio device (not limited to a speaker 970A, a microphone 970B, etc.), or displays an image or a video through the display 994. In some embodiments, the modem processor can be a separate device. In other embodiments, the modem processor can be independent of the processor 910, and can be disposed in the same device as the mobile communication module 950 or other functional modules.

[0156] The wireless communication module 960 can provide a wireless communication solution including wireless local area networks (WLAN) (such as a wireless fidelity (Wi-Fi) network), Bluetooth (BT), a global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, and the like, which can be applied to a foldable electronic device. The wireless communication module 960 can be one or more devices that integrate at least one communication processing module. The wireless communication module 960 receives an electromagnetic wave via an antenna 2, performs frequency modulation and filtering processing on the electromagnetic wave signal, and transmits the processed signal to the processor 910. The wireless communication module 960 can also receive a signal to be transmitted from the processor 910, perform frequency modulation and amplification thereon, and radiate the signal as an electromagnetic wave via the antenna 2.

[0157] In some embodiments, the antennas 1 and the mobile communication module 950 of the foldable electronic device are coupled, and the antennas 2 and the wireless communication module 960 are coupled, so that the foldable electronic device can communicate with a network and other devices through wireless communication technology. The wireless communication technology can include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS can include a global positioning system (GPS), a global navigation satellite system (GLONASS), a beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and / or a satellite based augmentation systems (SBAS).

[0158] The foldable electronic device implements a display function through a GPU, a display screen 994, and an application processor, etc. The GPU is a microprocessor for image processing, which is connected to the display screen 994 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 910 can include one or more GPUs, which execute program instructions to generate or change display information.

[0159] The display screen 994 is configured to display images, videos, and the like. The display screen 994 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flex light-emitting diode (FLED), a Mini-LED, a MicroLED, a Micro-OLED, a quantum dot light emitting diodes (QLED), or the like. In some embodiments, the foldable electronic device can include N display screens 994, where N is a positive integer greater than 1.

[0160] The pressure sensor 980A is configured to sense a pressure signal and convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 980A can be disposed on the display screen 994. The pressure sensor 980A can be of various types, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like. The capacitive pressure sensor can include at least two parallel plates of conductive material. When a force is applied to the pressure sensor 980A, the capacitance between the electrodes changes. The foldable electronic device determines the intensity of the force based on the change in capacitance. When a touch operation is applied to the display screen 994, the foldable electronic device detects the intensity of the touch operation based on the pressure sensor 980A. The foldable electronic device can also calculate the position of the touch based on the detection signal of the pressure sensor 980A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation instructions. For example, when a touch operation with a touch operation intensity less than a first pressure threshold is applied to a short message application icon, an instruction to view short messages is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold is applied to the short message application icon, an instruction to create a new short message is executed.

[0161] The embodiments disclosed herein can also be implemented as instructions and / or logic embodied upon one or more transitory or non-transitory machine-readable (e.g., computer-readable) media, which, when read and executed by one or more processors, software popularity, cause the electronic device to perform the actions indicated in the instructions and / or logic. For example, the instructions can be fetched from a network, or from another computer-readable medium, and executed by the processor. Thus, a machine-readable medium can take many forms of tangible and / or non-transitory media for storing or transmitting information in a form readable by the machine (e.g., a computer). For example, the machine-readable media can include recordable / non-recordable media, volatile / non-volatile media, removable media, and / or non-removable media implemented in a method or technology for storage or transmission of information, such as program code, but the machine-readable media is not limited to the sole use of these technologies. The machine-readable media can also include, but is not limited to, magnetic storage media, optical storage media, and / or solid state storage media.

[0162] Embodiments of the present application can be implemented as computer programs or program code executing on programmable systems including at least one processor, a storage system (including volatile and non-volatile memory and / or storage elements), at least one input device, and at least one output device.

[0163] Program code can be applied to input instructions to perform the functions described and generate output information. The output information can be applied to one or more output devices, in known fashion. For purposes of this application, a processing system includes any system that has a processor, such as a digital signal processor (DSP), a microcontroller, an application specific integrated circuit (ASIC), or a microprocessor.

[0164] The program code can be implemented in a high level procedural or object oriented programming language to communicate with a processing system. The program code can be implemented in assembly or machine language, if desired. In fact, the mechanisms described herein are not limited in scope to any particular programming language. In any case, the language can be a compiled or interpreted language.

[0165] The above introduces the hardware structure that the electronic device can have, and it can be understood that the structure illustrated by the embodiments of the present application does not constitute a specific limitation on the electronic device. In some other embodiments of the present application, the electronic device can include more or fewer components than the illustrated components, or combine certain components, or split certain components, or different arrangement of components. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.

[0166] In the drawings, some of the structures or method features can be shown in particular arrangements and / or orders. However, it will be appreciated that such specific arrangements and / or orders can not be required. Instead, these features can be arranged in a different manner and / or order than shown in the illustrative drawings, in some embodiments. Additionally, inclusion of a structural or method feature in a particular figure is not meant to imply that such feature is required in all embodiments, and these features can be excluded or combined with other features in some embodiments.

[0167] It has to be noted that, with respect to the prior art described herein, for example in the examples and descriptions of the patent, the terms relating to relationships, such as first and second, are used merely to distinguish one entity or operation from another entity or operation, without necessarily requiring or implying any such actual relationship or order between such entities or operations. Also, the terms "comprises", "comprising", or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can also include other elements not expressly listed or inherent to such process, method, article, or apparatus. An element proceeded by "comprises... a" does not, without more constraints, exclude the existence of additional identical elements in the process, method, article, or apparatus that comprises the element.

[0168] While the application has been illustrated and described in relation to certain embodiments thereof, it will be appreciated that various changes in form and detail can be made therein without departing from the scope of the application.

Claims

1. A display method characterized by comprising: The method is applied to a foldable electronic device, the foldable electronic device comprises a first screen and a second screen located on two sides of the foldable electronic device, and the method comprises: detecting a first touch operation of a user on the first screen, the first screen entering a second display state from a current first display state; detecting a second touch operation of a user on the second screen, the second screen entering a fourth display state from a current third display state.

2. The method of claim 1, wherein, The first display state and the third display state are global all-weather display states, The second display state and the fourth display state are bright screen states.

3. The method of claim 1, wherein, The first display state and the third display state are dark screen states, The second display state and the fourth display state are global all-weather display states.

4. The method of claim 1, wherein, The detecting of the first touch operation of the user on the first screen comprises: receiving a first display instruction; obtaining a first screen touch parameter corresponding to the first display instruction; corresponding to the first screen touch parameter, it is detected that the first touch operation of the user on the first screen corresponds to the first display instruction.

5. The method of claim 4, wherein, The first screen touch parameter comprises capacitance data, and corresponding to the first screen touch parameter, it is detected that the first touch operation of the user on the first screen corresponds to the first display instruction, which comprises: collecting capacitance data of the first screen at a plurality of sampling moments; determining capacitance difference data of the first screen according to the capacitance data of the first screen at the plurality of sampling moments; corresponding to the capacitance difference data of the first screen being greater than a preset capacitance difference threshold, it is determined that the first screen touch parameter indicates that the first display instruction corresponds to the first screen.

6. The method of claim 1, wherein, The detecting of the second touch operation of the user on the second screen comprises: receiving a second display instruction; obtaining a second screen touch parameter corresponding to the second display instruction; corresponding to the second screen touch parameter, it is detected that the second touch operation of the user on the second screen corresponds to the second display instruction.

7. The method of claim 6, wherein, The second screen touch parameter comprises capacitance data, and corresponding to the second screen touch parameter, it is detected that the second touch operation of the user on the second screen corresponds to the second display instruction, which comprises: collecting capacitance data of the second screen at a plurality of sampling moments; determining capacitance difference data of the second screen according to the capacitance data of the second screen at the plurality of sampling moments; corresponding to the capacitance difference data of the second screen being greater than a preset capacitance difference threshold, it is determined that the second screen touch parameter indicates that the second display instruction corresponds to the second screen.

8. The method of claim 1, wherein, The first touch operation and the second touch operation comprise any one of the following: single-click touch operation, double-click touch operation, sliding touch operation.

9. The method according to any one of claims 1 to 8, characterized in that, The second screen is a foldable screen.

10. The method according to any one of claims 1 to 8, characterized in that, The first display state and the third display state are bright screen states, and the second display state and the fourth display state are dark screen states.

11. The method of claim 10, wherein, The first touch operation or the second touch operation corresponds to a preset gesture, or The first touch operation or the second touch operation corresponds to a dark screen component.

12. An electronic device, comprising: It comprises: A memory for storing instructions executed by one or more processors of the electronic device, and a processor, which is one of the one or more processors of the electronic device, for executing the display method of any one of claims 1-11.

13. A readable storage medium, characterized by, The readable storage medium has instructions stored thereon, which, when executed on an electronic device, cause the electronic device to perform the display method of any one of claims 1-11.

14. A computer program product, characterised in that, The computer program product includes computer instructions, which, when executed on an electronic device, cause the electronic device to perform the display method of any one of claims 1-11.

Images