Display method, outer folding screen equipment and storage medium
By adding masks and setting offsets on the home screen of foldable electronic devices, the main logic display is offset from the home screen to the secondary screen, solving the splashing problem when switching to the home screen, improving the user experience and interface Switching efficiency.
Patent Information
- Application Number
- CN202410213731.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-02-26
- Publication Date
- 2025-01-03
- Estimated Expiration
- 2044-02-26
AI Technical Summary
In foldable electronic devices, when the main screen switches to the secondary screen, it is easy to have splash screen problems caused by logical display offset, affecting the user experience.
By adding masks on the main logic monitor and setting offsets, offsetting the main logic monitor from the main screen to the secondary screen, and removing the masks at the same time during switching, avoiding the application interface re-drawing, thereby improving the interface screen-slicing efficiency And solve the splash screen problem.
It effectively avoids the splash screen problem caused by improper display of the application interface, improves the user experience, and realizes flexible switching between the main and secondary screens and efficient display of the application interface.
Smart Images

Figure CN119254869A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of smart terminal technology, and in particular to a display method, an external folding screen device, and a storage medium. Background Art
[0002] With the development of flexible screen technology, foldable electronic devices (such as foldable mobile phones) have come into being.
[0003] Take a foldable mobile phone as an example. It has only one flexible screen, which adopts an outward folding solution. After the flexible screen is unfolded, the user can use the larger whole screen; after the flexible screen is folded, the flexible screen is divided into a main screen and a sub-screen located on different sides of the foldable screen mobile phone. At this time, the user can use the main screen or the sub-screen. The interface displayed on the main screen can be switched to the sub-screen, and the switching effect directly affects the user experience. Summary of the invention
[0004] The present application provides a display method, an external folding screen device, and a storage medium. In this method, when the interface displayed on the main screen is switched to the secondary screen, the screen flashing problem caused by the offset of the logical display screen can be avoided, thereby improving the user experience.
[0005] In the first aspect, an embodiment of the present application provides a display method. The method is applied to an external folding screen device, the external folding screen device includes a flexible screen, the flexible screen is divided into a first screen and a second screen after being folded outward along a rotating axis, and the size of the first screen is larger than the size of the second screen. Among them, the first screen can refer to the main screen of the external folding screen mobile phone mentioned below, and the second screen can refer to the secondary screen of the external folding screen mobile phone mentioned below.
[0006] The display method includes:
[0007] The main logic display display of the external folding screen device is located on the first screen, and the content of the main logic display is the first interface of the first application; in response to the first operation, the first application generates a first request, and the first request includes a target mode, and the target mode is used to indicate the display mode of the application interface on the second screen after switching from the first screen to the second screen;
[0008] The external folding screen device adds a mask on the main logic display in response to the first request;
[0009] The external folding screen device sets the offset of the main logic display according to the target mode, and adjusts the size of the main logic display according to the target mode; wherein the offset is used to shift the main logic display from the first screen to the second screen;
[0010] The external folding screen device adds offsetting the main logic display and removing the mask on the main logic display to the first transaction;
[0011] The external folding screen device executes the first transaction, and the main logic display is displayed on the second screen according to the target mode. The content of the main logic display is the second interface of the first application.
[0012] Among them, the request generated by the application can be understood as the secondary screen display request mentioned below, and the target mode can be understood as the secondary screen display mode requested by the application mentioned below.
[0013] In this way, the switching between the main and secondary screens is achieved by offsetting the main logic display, so that the application side will not perceive the change in the display screen, and the application side does not need to redraw the application interface, thereby improving the efficiency of interface screen switching display (such as switching the application interface from the main screen to the secondary screen). Moreover, since the offset of the main logic display and the cancellation of the mask on the main logic display are effective at the same time, the screen flashing problem caused by improper display of the application interface is solved, thereby improving the user experience.
[0014] According to the first aspect, the target mode includes: a first mode, the first mode is used to indicate that the application interface is displayed in the center of the second screen after being scaled; and a second mode, the second mode is used to indicate that the application interface is displayed at the bottom of the second screen after being scaled.
[0015] Among them, the first mode can refer to the "rear selfie" display mode mentioned below, and the second mode can refer to the "sub-screen card" display mode mentioned below.
[0016] According to the first aspect, or any implementation of the first aspect above, the display method further includes:
[0017] In response to the first operation, the first application adds a first boot animation to the virtual logic display; wherein the virtual logic display is located on the second screen;
[0018] When the external folding screen device determines that there is content in the virtual logical display, it sets the offset of the virtual logical display, and the offset is used to offset the virtual logical display from the second screen to the first screen;
[0019] The external folding screen device adds the offset virtual logic display and the full-screen display area to the second transaction;
[0020] The external folding screen device executes the second transaction, the virtual logic display is displayed on the first screen, and the first boot animation is played in the virtual logic display.
[0021] Among them, the virtual logic display can be created during the startup phase of the external folding screen device.
[0022] Among them, full-screen display area refers to setting the display area of the external folding screen device to the entire area of the flexible screen.
[0023] In this way, since the offset of the virtual logic display and the full screen of the display area are effective at the same time, there will be no problem that the boot animation cannot be displayed due to the conflict between the display area setting and the display of the virtual logic display.
[0024] According to the first aspect, or any implementation of the first aspect above, the display method further includes:
[0025] The main logic display of the external folding screen device is located on the first screen, and the content of the main logic display is the interface of the second application;
[0026] In response to the second operation, the second application generates a second request, the second request includes a third mode, an identifier of a target application, and an identifier of a target Activity of the target application, the third mode being used to indicate a display mode of an interface of the target application on the second screen;
[0027] The external folding screen device adds a mask on the main logic display in response to the second request;
[0028] The external folding screen device sets the offset of the main logic display according to the third mode, and adjusts the size of the main logic display according to the third mode;
[0029] The external folding screen device adds the offset main logic display to the third transaction and executes the third transaction;
[0030] The external folding screen device starts the target application, and when the target Activity of the target application is drawn, the mask on the main logic display is removed and added to the fourth transaction;
[0031] The external folding screen device executes the fourth transaction, and the main logic display is displayed on the second screen according to the third mode, and the content of the main logic display is the interface of the target application.
[0032] Exemplarily, the target application may be the “Baibian Wallet” application mentioned below.
[0033] In this way, after the main and sub-screens of the external folding screen are switched, the target application is started so that the interface of the target application is fully displayed on the second screen, solving the screen flashing problem caused by improper display area of the target application interface.
[0034] According to the first aspect, or any implementation of the first aspect above, the third mode is used to instruct the application interface to be displayed in full screen on the second screen. The third mode may be the "variable wallet" display mode mentioned below.
[0035] According to the first aspect, or any implementation of the first aspect above, the display method further includes:
[0036] In response to the second operation, the second application adds a second boot animation to the virtual logic display; wherein the virtual logic display is located on the second screen;
[0037] When the external folding screen device determines that there is content in the virtual logical display, it sets the offset of the virtual logical display, and the offset is used to offset the virtual logical display from the second screen to the first screen;
[0038] The external folding screen device adds the offset virtual logic display and the full-screen display area to the fifth transaction;
[0039] The external folding screen device executes the fifth transaction, the virtual logic display is displayed on the first screen, and the second boot animation is played in the virtual logic display.
[0040] In this way, since the offset of the virtual logic display and the full screen of the display area are effective at the same time, there will be no problem that the boot animation cannot be displayed due to the conflict between the display area setting and the display of the virtual logic display.
[0041] According to the first aspect, or any implementation of the first aspect above, the display method further includes:
[0042] The main logic display of the external folding screen device is located on the second screen, and the content of the main logic display is the interface of the third application; the display mode of the interface of the third application on the second screen is the target mode;
[0043] In response to the third operation, the fourth application generates a third request, the third request including a third mode, an identifier of a target application, and an identifier of a target Activity of the target application, the third mode being used to indicate a display mode of an interface of the target application on the second screen;
[0044] The external folding screen device adds a mask on the second screen in response to the third request; the external folding screen device adjusts the main logic display according to the third mode; the external folding screen device starts the target application, and when the target Activity of the target application is drawn, removes the mask on the second screen and adds it to the sixth transaction;
[0045] The external folding screen device executes the sixth transaction, and the main logic display is displayed on the second screen according to the third mode, and the content of the main logic display is the interface of the target application.
[0046] In this way, when the secondary screen of the external folding screen device displays the application interface, a mask is added, and the mask is removed after the secondary screen display mode is adjusted to the display mode most recently requested by the application. This enables the external folding screen device to flexibly switch between different secondary screen display modes without the problem of mutual exclusion of various secondary screen display modes.
[0047] According to the first aspect, or any implementation of the first aspect above, the external folding screen device includes a camera arranged back to back with the flexible screen, and after the flexible screen is folded along the hinge, the second screen and the camera are located on the same side of the external folding screen device; the first application is a camera application, and the images in the first interface and the second interface are captured by the camera.
[0048] In a second aspect, an embodiment of the present application provides a folding screen device. The folding screen device includes: one or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and when the computer programs are executed by the one or more processors, the folding screen device executes the display method of the first aspect and any one of the first aspects.
[0049] Exemplarily, the folding screen device is an external folding screen device. The external folding screen device includes a flexible screen, which is divided into a first screen and a second screen after being folded outward along a rotating axis, and the size of the first screen is larger than the size of the second screen. The first screen can refer to the main screen of the external folding screen mobile phone mentioned below, and the second screen can refer to the secondary screen of the external folding screen mobile phone mentioned below.
[0050] The second aspect and any implementation of the second aspect correspond to the first aspect and any implementation of the first aspect respectively. The technical effects corresponding to the second aspect and any implementation of the second aspect can refer to the technical effects corresponding to the above-mentioned first aspect and any implementation of the first aspect, which will not be repeated here.
[0051] In a third aspect, an embodiment of the present application provides a computer-readable storage medium. The computer-readable storage medium includes a computer program, and when the computer program is executed on an electronic device, the electronic device executes the display method of the first aspect and any one of the first aspects.
[0052] The third aspect and any implementation of the third aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the third aspect and any implementation of the third aspect can refer to the technical effects corresponding to the first aspect and any implementation of the first aspect, which will not be repeated here.
[0053] In a fourth aspect, an embodiment of the present application provides a computer program product, including a computer program, which, when executed, enables a computer to execute a display method as described in the first aspect or any one of the items in the first aspect.
[0054] The fourth aspect and any implementation of the fourth aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the fourth aspect and any implementation of the fourth aspect can refer to the technical effects corresponding to the above-mentioned first aspect and any implementation of the first aspect, which will not be repeated here.
[0055] In a fifth aspect, the present application provides a chip, the chip comprising a processing circuit and a transceiver pin, wherein the transceiver pin and the processing circuit communicate with each other through an internal connection path, and the processing circuit executes the display method of the first aspect or any one of the first aspects to control the receiving pin to receive a signal, and to control the sending pin to send a signal.
[0056] The fifth aspect and any implementation of the fifth aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the fifth aspect and any implementation of the fifth aspect can refer to the technical effects corresponding to the first aspect and any implementation of the first aspect, which will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0057] Figure 1 is a schematic diagram of the hardware structure of an electronic device shown as an example;
[0058] Figure 2 is a schematic diagram of an external folding screen mobile phone shown as an example;
[0059] Figure 3a This is a schematic diagram of an application scenario of "rear selfie" for an external folding screen mobile phone as an example;
[0060] Figure 3b This is a schematic diagram of an application scenario of a "Versatile Wallet" for an external folding screen mobile phone as an example;
[0061] Figure 3c This is a schematic diagram of an application scenario of a "Versatile Wallet" for an external folding screen mobile phone as an example;
[0062] Figure 3dSchematic diagram of the "secondary screen card" application scenario of an external folding screen mobile phone
[0063] Figure 4a This is a schematic diagram of a flash screen involved in a "rear selfie" application scenario of an external folding screen mobile phone shown as an example;
[0064] Figure 4b A schematic diagram of a flash screen involved in the "Versatile Wallet" application scenario of an external folding screen mobile phone is shown as an example;
[0065] Figure 4c A schematic diagram of a flash screen involved in an application scenario of a "secondary screen card" of an external folding screen mobile phone is shown as an example;
[0066] Figure 5a A schematic diagram of a problem when an external folding screen mobile phone switches from a "rear selfie" scene to a "variable wallet" scene is shown as an example;
[0067] Figure 5b A schematic diagram of a problem when an external folding screen mobile phone switches from a "secondary screen card" scene to a "variable wallet" scene is shown as an example;
[0068] Figure 5c This is a schematic diagram showing the mutual exclusion of several secondary screen application scenarios of an external folding screen mobile phone;
[0069] Figure 6 A schematic diagram of the software structure of an electronic device is shown as an example;
[0070] Figure 7a This is a schematic diagram of module interaction when the "rear selfie" scene of an external folding screen mobile phone is activated;
[0071] Figure 7b This is a schematic diagram showing an example of the offset of the main screen display of an external folding screen mobile phone;
[0072] Figure 7c This is a schematic diagram of screen switching when the “rear selfie” scene of an external folding screen mobile phone is activated;
[0073] Figure 7d This is a schematic diagram of screen switching when the "secondary screen card" scene of an external folding screen mobile phone is activated;
[0074] Figure 7e This is a schematic diagram of module interactions involved in displaying a guide animation when the main screen of an external folding screen mobile phone switches to the secondary screen as an example;
[0075] Figure 8a This is a schematic diagram of module interaction when the "Changeable Wallet" scenario of an external folding screen mobile phone is activated;
[0076] Figure 8bThis is a schematic diagram of screen switching when the "Versatile Wallet" scene of an external folding screen mobile phone is activated;
[0077] Figure 9a The schematic diagram of module interaction when an external folding screen mobile phone switches from a "rear selfie" scene or a "secondary screen card" scene to a "variable wallet" scene is shown as an example;
[0078] Figure 9b This is a schematic diagram of the interface when an external folding screen mobile phone switches from the "rear selfie" scene to the "variable wallet" scene as shown by way of example;
[0079] Fig.9c This is a schematic diagram of the interface when an external folding screen mobile phone switches from the "secondary screen card" scene to the "variable wallet" scene. DETAILED DESCRIPTION
[0080] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0081] The term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.
[0082] The terms "first" and "second" in the description and claims of the embodiments of the present application are used to distinguish different objects rather than to describe a specific order of objects. For example, a first target object and a second target object are used to distinguish different target objects rather than to describe a specific order of target objects.
[0083] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.
[0084] In the description of the embodiments of the present application, unless otherwise specified, the meaning of "multiple" refers to two or more than two. For example, multiple processing units refer to two or more processing units; multiple systems refer to two or more systems.
[0085] Figure 11 shows a schematic diagram of the structure of the electronic device 100. It should be understood that Figure 1 The electronic device 100 shown is only an example of an electronic device, and the electronic device 100 may have more or fewer components than shown in the figure, may combine two or more components, or may have a different component configuration. Exemplarily, the electronic device 100 may be a folding screen mobile phone, such as an external folding screen mobile phone. Figure 1 The various components shown in the EMBODIMENTS 2000 may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.
[0086] The electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.
[0087] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0088] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.
[0089] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0090] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0091] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.
[0092] The charging management module 140 is used to receive charging input from the charger. The charging management module 140 can also power the electronic device through the power management module 141 while charging the battery 142. The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. In some embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.
[0093] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
[0094] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The wireless communication module 160 can provide solutions for wireless communications including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication technology (NFC), infrared technology (IR), etc., applied to the electronic device 100. In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology.
[0095] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information. The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.
[0096] In the case where the electronic device 100 is a folding screen device, the display screen 194 may be a flexible screen. Taking the electronic device 100 as an external folding screen mobile phone as an example, Figure 2 The schematic diagram of the appearance of an external folding screen mobile phone is shown as an example. Figure 2 , Figure 2 (1) shows an exemplary schematic diagram of an external folding screen mobile phone in an unfolded state. Figure 2 (2) shows an exemplary schematic diagram of an external folding screen mobile phone in a semi-folded state (or semi-unfolded state). Figure 2 (3) shows an exemplary schematic diagram of an external folding screen mobile phone in a folded state.
[0097] Reference Figure 2In (1), exemplarily, an external folding screen mobile phone may include a display screen 194, which is a flexible screen and folds outward, as shown in the figure. That is, the user can fold the display screen 194 outside the mobile phone, so that the display screen 194 in any posture (such as unfolded state, semi-folded state, folded state) can be used by the user. The external folding screen mobile phone also includes a shell, which may include devices for setting a camera, a flash, an audio module (such as a speaker, a receiver, a microphone, etc.). Refer to Figure 2 In (3), the housing may include housing 196.
[0098] Continue to refer to Figure 2 In (1), the display screen 194 may include a first display area 194-1 (hereinafter referred to as a secondary screen), a second display area 194-2 and a third display area 194-3 (hereinafter referred to as a primary screen). Optionally, the width of the secondary screen and the housing area 196 is the same as the width of the primary screen.
[0099] Among them, the second display area 194-2 is the area corresponding to the folding axis (hereinafter referred to as the axis area), and the display screen 194 can be folded or unfolded along the folding axis to adjust the posture of the display screen 194. When the display screen is in the unfolded state, the user can use the entire area of the display screen 194 (that is, the first display area 194-1, the second display area 194-2 and the third display area 194-3). When the display screen is in the folded state, the user can use the third display area 194-3 or the first display area 194-1.
[0100] It can be understood that when the posture of the display screen 194 of the external folding screen mobile phone changes, it will trigger the switching of the display area of the display screen 194. For example, when the display screen 194 switches from the unfolded state to the folded state, the display area of the display screen 194 switches from the entire area of the display screen 194 to the third display area 194-3 or to the first display area 194-1. For another example, when the display screen 194 switches from the folded state to the unfolded state, the display area of the display screen 194 switches from the third display area 194-3 or the first display area 194-1 to the entire area of the display screen 194.
[0101] In some application scenarios, the display area of the display screen 194 can be switched from the third display area 194-3 to the first display area 194-1, or the display area of the display screen 194 can be switched from the first display area 194-1 to the third display area 194-3.
[0102] The electronic device 100 can realize the shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor. The ISP is used to process the data fed back by the camera 193. In some embodiments, the ISP can be set in the camera 193. The camera 193 is used to capture a static image or a video. The object generates an optical image through the lens and projects it onto the photosensitive element. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
[0103] In such Figure 2 In the example shown, the camera 193 may include a front camera 193-1 and a rear camera 193-2 of the external folding screen mobile phone. It should be noted that the "front" and "rear" mentioned here refer to the display screen 194 when the external folding screen mobile phone is in the unfolded state, or to the main screen 194-3 when the external folding screen mobile phone is in the folded state. Generally, the pixels of the rear camera 193-2 are higher than those of the front camera 193-1.
[0104] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.
[0105] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0106] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0107] The pressure sensor is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor can be set on the display screen 194. When a touch operation is applied to the display screen 194, the electronic device 100 detects the touch operation intensity according to the pressure sensor. The electronic device 100 can also calculate the touch position according to the detection signal of the pressure sensor. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions.
[0108] The gyro sensor may be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (ie, x, y, and z axes) may be determined by the gyro sensor.
[0109] The acceleration sensor can detect the magnitude of the acceleration of the electronic device 100 in all directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and is applied to applications such as horizontal and vertical screen switching and pedometers.
[0110] The touch sensor is also called a "touch panel". The touch sensor can be set on the display screen 194. The touch sensor and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor is used to detect touch operations acting on or near it.
[0111] As Figure 2 Taking the external folding screen mobile phone shown as an example, more and more users are using the secondary screen. Figure 3a-3c Several application scenarios related to the secondary screen of an external folding screen mobile phone are shown by way of example.
[0112] Figure 3a The example shows the "rear selfie" application scenario related to the secondary screen of the external folding screen mobile phone. For example, when the external folding screen mobile phone is in the folded state, the user opens the camera application on the main screen 194-3. Figure 3a As shown in (1), the main screen 194-3 displays the shooting preview interface 201 of the camera application. The preview image displayed in the shooting preview interface 201 is captured by the rear camera 193-2 of the external folding screen mobile phone. Figure 3a In (1), the shooting preview interface 201 includes a "switch to sub-screen" control 2011. The user clicks the "switch to sub-screen" control 2011 to switch the shooting preview interface of the camera application to the sub-screen 194-1 for display. In response to the user operation, the main screen 194-3 of the external folding screen mobile phone can display an interface 202 (such as a black screen interface), and a prompt animation can be played in the interface 202 (the prompt animation can disappear after playing for a preset time). The prompt animation is used to prompt the user to flip the external folding screen mobile phone to use the sub-screen for viewing. For reference, Figure 3aAs shown in (2). After the user flips over the external folding screen mobile phone, the user can view the display content on the secondary screen 194-1. Figure 3a As shown in (3), a shooting preview interface 203 is displayed on the secondary screen 194-1, and a "switch to main screen" control 2031 can also be displayed on the secondary screen 194-1. At this time, the rear camera 193-2 can capture the image of the user holding the external folding screen mobile phone, such as Figure 3a As shown in (3), a user experience of "a user takes a selfie with the rear camera 193-2" can be generated. It can be understood that due to the different sizes of the main screen 194-3 and the secondary screen 194-1, the size of the shooting preview interface 201 displayed on the main screen 194-3 is different from the size of the shooting preview interface 203 displayed on the secondary screen 194-1. The size of the shooting preview interface 203 can be obtained by proportionally reducing the size of the shooting preview interface 201. On the secondary screen 194-1, the shooting preview interface 203 can be displayed based on the Letterbox display mode. The shooting preview interface 203 is displayed after being offset from top to bottom on the secondary screen 194-1 by a preset pixel value, so as to ensure that the mobile phone leather case can be displayed in a window. In this way, in the secondary screen 194-1, there are Letterbox background areas above and below the shooting preview interface 203. Among them, the "switch to main screen" control 2031 can be displayed in the Letterbox background area. If the user wants to switch the shooting preview interface back to the main screen 194-3 for display, he can click the "switch to main screen" control 2031 and flip the external folding screen mobile phone. I will not go into details here. Optionally, in response to the user clicking the "switch to main screen" control 2031, a black screen interface can be displayed on the main screen 194-1 of the external folding screen mobile phone, and a prompt animation can be played in the black screen interface (the prompt animation can disappear after playing for a preset time), and the prompt animation is used to prompt the user to flip the external folding screen mobile phone to use the main screen for viewing.
[0113] It should be pointed out that Figure 3a An example of a way to start the "rear selfie" function of an external folding screen mobile phone is shown. The "rear selfie" function of an external folding screen mobile phone can also be triggered and started by other methods, which is not limited in the embodiments of the present application.
[0114] Figure 3b The example shows the application scenario of "variable wallet" related to the secondary screen of the external folding screen mobile phone. Figure 3b As shown in (1), when the external folding screen mobile phone is in the folded state, the interface 301 is displayed on the main screen 194-3, and the interface 301 displays a versatile wallet card 3011. Figure 3bIn (1), the user clicks on the Variety Wallet card 3011 to activate the Variety Wallet function. In response to the user operation, the main screen 194-3 of the external folding screen mobile phone may display an interface 302 (such as a black screen interface), and a prompt animation may be played in the interface 302 (the prompt animation may disappear after playing for a preset time). The prompt animation is used to prompt the user to flip the external folding screen mobile phone to use the secondary screen for viewing. Figure 3b After the user flips over the external folding screen mobile phone, the user can view the display content on the secondary screen 194-1. Figure 3b As shown in (3), a versatile wallet interface 303 is displayed on the secondary screen 194-1. The versatile wallet interface 303 is displayed in full screen on the secondary screen 194-1. At this time, the user is holding the external folding screen mobile phone just like holding a "wallet", and the versatile wallet interface displayed on the secondary screen 194-1 can be flexibly set.
[0115] Figure 3c The example shows the application scenario of "variable wallet" related to the secondary screen of the external folding screen mobile phone. Figure 3c As shown in (1), when the external folding screen mobile phone is in the folded state, the secondary screen 194-1 is in the off screen state. At the same time, the main screen 194-3 can be in the off screen state, and can display the AOD (Always On Display) interface or the interface of any application. This example does not limit this. Figure 3c In (1), the user presses the power button 190-1 of the external folding screen mobile phone to start the versatile wallet function. In response to the user operation, the versatile wallet interface 304 is displayed on the secondary screen 194-1. Optionally, in response to the user clicking the power button 190-1, the main screen 194-3 of the external folding screen mobile phone can display an interface 302 (such as a black screen interface), and a prompt animation can be played in the interface 302 (the prompt animation can disappear after playing for a preset length of time). The prompt animation is used to prompt the user to flip the external folding screen mobile phone to use the secondary screen for viewing. For reference, Figure 3b As shown in (2).
[0116] It should be pointed out that Figure 3b and Figure 3c A method of starting the "Versatile Wallet" function of an external folding screen mobile phone is shown as an example. The "Versatile Wallet" function of an external folding screen mobile phone can also be triggered and started by other methods, which is not limited in the embodiments of the present application.
[0117] There are also some third-party applications or system applications (the following explanation takes third-party applications as an example) whose interfaces can also be displayed on the secondary screen of the external folding screen mobile phone. This function will be referred to as the secondary screen card function later. Figure 3dThe example shows an application scenario in which a third-party application is displayed on the secondary screen of an external folding screen mobile phone through a secondary screen card. For example, when the external folding screen mobile phone is in the folded state, the user opens the navigation application on the main screen 194-3. Figure 3d As shown in (1), the main screen 194-3 displays the interface 401 of the navigation application. For example, if the user wants to switch the interface of the navigation application to the secondary screen 194-1, the user can perform an operation corresponding to gesture 1 on the main screen 194-3. In response to the user operation, the main screen 194-3 of the external folding screen mobile phone can display an interface 402 (such as a black screen interface), and a prompt animation can be played in the interface 402 (the prompt animation can disappear after playing for a preset time). The prompt animation is used to prompt the user to flip the external folding screen mobile phone to use the secondary screen for viewing. Figure 3d After the user flips over the external folding screen mobile phone, the user can view the display content on the secondary screen 194-1. Figure 3d As shown in (3), the interface 403 of the navigation application is displayed on the secondary screen 194-1. It can be understood that due to the different sizes of the main screen 194-3 and the secondary screen 194-1, the size of the navigation application interface 401 displayed on the main screen 194-3 is different from the size of the navigation application interface 403 displayed on the secondary screen 194-1, and the size of the navigation application interface 403 can be obtained by proportionally reducing the size of the navigation application interface 401. On the secondary screen 194-1, the navigation application interface 403 can be displayed based on the Letterbox display mode. The navigation application interface 403 is displayed at the bottom of the secondary screen 194-1, and there is a Letterbox background area on the upper side of the navigation application interface 403. Exemplarily, the Letterbox background area on the upper side of the navigation application interface 403 is blurred. If the user wants to switch the shooting preview interface back to the main screen 194-3 for display, the user can perform an operation corresponding to gesture 2 (gesture 2 can be the same as or different from gesture 1) on the secondary screen 194-1 and flip the external folding screen mobile phone, which will not be repeated here. Optionally, in response to the user performing an operation corresponding to gesture 2 on the secondary screen 194-1, a black screen interface can be displayed on the main screen 194-1 of the external folding screen mobile phone, and a prompt animation can be played in the black screen interface (the prompt animation can disappear after playing for a preset time), and the prompt animation is used to prompt the user to flip the external folding screen mobile phone to use the main screen for viewing.
[0118] It should be pointed out that Figure 3d A triggering method for displaying a third-party application on the secondary screen of an external folding screen mobile phone in the form of a secondary screen card is shown by way of example. The display of a third-party application on the secondary screen of an external folding screen mobile phone in the form of a secondary screen card can also be triggered by other methods, which is not limited to the embodiments of the present application.
[0119] The above examples show several scenarios in which users use the secondary screen of an external folding screen mobile phone. In the above application scenarios, when the display interface of the external folding screen mobile phone switches from the main screen to the secondary screen, a screen flickering problem may occur.
[0120] by Figure 3a Take the "rear selfie" scene shown as an example. Figure 4a The schematic diagram of the screen flashing problem is shown as an example. It should be pointed out that Figure 4a In the schematic diagram shown, in order to clarify the switching of the interface display area and clearly illustrate the flash screen problem, the expanded display screen is used for illustration. Figure 3a In the example shown, before the user switches the shooting preview interface of the camera application to the secondary screen, such as before clicking the "switch to secondary screen" control 2011, the camera application interface 201 is displayed on the main screen 194-3, such as Figure 4a In response to the user clicking the "switch to secondary screen" control 2011, the camera application interface 201 is shifted to the secondary screen 194-1 and then displayed in a proportionally reduced manner. Before the secondary screen displays the camera application interface 203, the secondary screen may display the camera application interface 201' which is shifted from the camera application interface 201 to the secondary screen, as shown in FIG. Figure 4a As shown in (2), at this time, the display area of the camera application interface 201' is the secondary screen 194-1 and the hinge area 194-2. After the camera application interface 201' is proportionally reduced and offset from top to bottom by a preset pixel value, the camera application interface 203 is displayed on the secondary screen 194-1. It can be understood that referring to Figure 4a As shown in (2), the camera application interface 201' should not be displayed in the hinge area 194-2. Figure 4a The display time of the situation shown in (2) is extremely short. For example, only one or two frames of the camera application interface are displayed in this situation, which gives users the experience that the external folding screen mobile phone has a screen flashing problem when the "rear selfie" function is activated.
[0121] It should be pointed out that Figure 3a The "rear selfie" scene shown is triggered when the external folding screen mobile phone is in the folded state. The "rear selfie" scene can also be triggered when the external folding screen mobile phone is in the unfolded state. In this case, the following may also appear when the "rear selfie" function is activated. Figure 4a The screen flashing problem shown in (2) and (3) will not be described in detail here.
[0122] by Figure 3b Take the "Changeable Wallet" scenario shown as an example. Figure 4b The schematic diagram of the screen flashing problem is shown as an example. It should be pointed out that Figure 4b In the schematic diagram shown, in order to clarify the switching of the interface display area and clearly illustrate the flash screen problem, the expanded display screen is used for illustration. Figure 3b In the example shown, before the user turns on the Variety Wallet function, such as before clicking on the Variety Wallet card 3011, the interface 301 where the Variety Wallet card 3011 is located is displayed on the main screen 194-3, such as Figure 4b In response to the user clicking on the Variety Wallet card 3011, the Variety Wallet function is activated and the Variety Wallet interface is displayed on the secondary screen 194-1. Before the secondary screen displays the Variety Wallet interface 303, the secondary screen may display the Variety Wallet interface 303' of the same size as the main screen, as shown in FIG. Figure 4b As shown in (2), at this time, the display area of the versatile wallet interface 303' is the secondary screen 194-1 and the hinge area 194-2. After the size of the versatile wallet interface 303' is adjusted, the versatile wallet interface 303 is displayed on the secondary screen 194-1. It can be understood that, referring to Figure 4b As shown in (2), the wallet interface 303' should not be displayed in the rotation axis area 194-2. Figure 4b The display time of the situation shown in (2) is very short. For example, only one or two frames of the Wallet interface are displayed in this situation, which gives users the experience that the foldable screen mobile phone has a flashing screen problem when the "Wallet" function is activated. Figure 3c Take the "Changeable Wallet" scenario shown as an example. Figure 4b (2) and (3) can also exemplarily illustrate the screen flashing problem when the "Baibian Wallet" function is started, which will not be repeated here.
[0123] It should be pointed out that Figure 3b , Figure 3c The "Changeable Wallet" scene shown is triggered when the external folding screen mobile phone is in the folded state. The "Changeable Wallet" scene can also be triggered when the external folding screen mobile phone is in the unfolded state. In this case, the "Changeable Wallet" function may also appear when it is activated. Figure 4b The screen flashing problem shown in (2) and (3) will not be described in detail here.
[0124] by Figure 3d Take the scenario shown in the figure "the third-party application is displayed on the secondary screen of the external folding screen mobile phone in the form of secondary screen cards" as an example. Figure 4c The schematic diagram of the screen flashing problem is shown as an example. It should be pointed out that Figure 4c In the schematic diagram shown, in order to clarify the switching of the interface display area and clearly illustrate the flash screen problem, the expanded display screen is used for illustration. Figure 3d In the example shown, before the user switches the third-party application interface (such as the navigation application interface) to the secondary screen, such as before performing the operation corresponding to gesture 1 on the main screen 194-3, the third-party application interface 401 is displayed on the main screen 194-3, such as Figure 4cIn response to the user performing an operation corresponding to gesture 1 on the main screen 194-3, the third-party application interface 401 is shifted to the secondary screen 194-1 and then displayed in a proportionally reduced manner. Before the secondary screen displays the third-party application interface 403, the secondary screen may display the third-party application interface 401' shifted from the third-party application interface 401 to the third-party application interface displayed on the secondary screen, as shown in FIG. Figure 4c As shown in (2), at this time, the display area of the three-party application interface 401' is the secondary screen 194-1 and the hinge area 194-2. The three-party application interface 401' is proportionally reduced and offset to the bottom of the secondary screen, and the three-party application interface 403 is displayed on the secondary screen 194-1. It can be understood that referring to Figure 4c As shown in (2), the third-party application interface 401' should not be displayed in the rotation axis area 194-2. Figure 4c The display time of the situation shown in (2) is extremely short. For example, only one or two frames of the third-party application interface are displayed in this situation, which gives users the experience that the external folding screen mobile phone has a screen flashing problem when the "third-party application interface switches from the main screen to the secondary screen".
[0125] It should be pointed out that Figure 3d The "secondary screen card" scene shown is triggered when the external folding screen mobile phone is in the folded state. The "secondary screen card" scene can also be triggered when the external folding screen mobile phone is in the unfolded state. In this case, the "secondary screen card" function may also appear when it is activated. Figure 4c The screen flashing problem shown in (2) and (3) will not be described in detail here.
[0126] As the secondary screen of external folding screen mobile phones is used in more and more scenarios, problems may arise in switching between multiple application scenarios.
[0127] Figure 5a The following example shows a problem when using the secondary screen of an external folding screen mobile phone. Figure 5a As shown in (1), the shooting preview interface of the camera application is displayed on the secondary screen of the external folding screen mobile phone, providing the user with the effect of "rear selfie". In this case, if the user clicks the power button 190-1, the external folding screen mobile phone is triggered to start the "variable wallet" function. In response to the user operation, the variable wallet interface 502 is displayed on the secondary screen of the external folding screen mobile phone, as shown in FIG. Figure 5a As shown in (2). Figure 5a As can be seen from (1) and (2), the layout of the Wallet interface 502 in the secondary screen 194-1 is the same as the layout of the camera application shooting preview interface 501 in the secondary screen 194-1. The Wallet interface 502 is not displayed in full screen in the secondary screen 194-1. There are Letterbox background areas above and below the Wallet interface 502, and the "Switch to Main Screen" control is also displayed in the Letterbox background area below. Obviously, Figure 5aThe versatile wallet interface 502 shown in (2) does not conform to the design concept of the versatile wallet function, and brings a poor user experience to the user.
[0128] Figure 5b The following example shows a problem when using the secondary screen of an external folding screen mobile phone. Figure 5b As shown in (1), the external folding screen mobile phone's secondary screen displays a third-party application interface (such as a navigation application interface) 503 in the form of a secondary screen card. In this case, if the user clicks the power button 190-1, the external folding screen mobile phone is triggered to start the "Baibian Wallet" function. In response to the user operation, the external folding screen mobile phone displays a Baibian Wallet interface 504, such as Figure 5b As shown in (2). Figure 5b As can be seen from (1) and (2), the layout of the wallet interface 504 in the secondary screen 194-1 is the same as the layout of the third-party application interface 503 in the secondary screen 194-1. The wallet interface 504 is not displayed in full screen in the secondary screen 194-1, and there is a letterbox background area above the wallet interface 504. Obviously, Figure 5b The versatile wallet interface 504 shown in (2) does not conform to the design concept of the versatile wallet function, and brings a poor user experience to the user.
[0129] For the three sub-screen usage scenarios of the external folding screen mobile phone described above, namely the sub-screen usage scenario corresponding to the "rear selfie" function, the sub-screen usage scenario corresponding to the "variable wallet" function, and the sub-screen usage scenario corresponding to the "sub-screen card" function, Figure 5c (1), (2) and (3) respectively show schematic diagrams of the secondary screen interface layout. Figure 5a The example shows Figure 5c The secondary screen interface layout shown in (1) cannot be switched directly to Figure 5c The layout of the secondary screen interface shown in (2) is as follows: Figure 5b The example shows Figure 5c The secondary screen interface layout shown in (3) cannot be switched directly to Figure 5c The layout of the secondary screen interface is shown in (2). Figure 5c Zhong (1) and Figure 5c In the case where there is a quick start method for the secondary screen usage scenario shown in (2), Figure 5c Medium (2) or Figure 5c The secondary screen interface layout shown in (3) cannot be switched directly to Figure 5c The secondary screen interface layout shown in (1) is as follows: Figure 5c Medium (1) or Figure 5c The secondary screen interface layout shown in (3) cannot be switched directly to Figure 5cThe secondary screen interface layout is shown in (2). Therefore, the switching between the three secondary screen usage scenarios of the external folding screen mobile phone mentioned above is problematic.
[0130] In order to solve the above problems, an embodiment of the present application provides a display method. In this method, three secondary screen display modes of external folding screen mobile phones are defined, namely, rear selfie mode, versatile wallet mode and secondary screen card mode. When an application requests an interface display on the secondary screen of an external folding screen mobile phone, the secondary screen display mode requested by the application can be indicated by relevant parameters. Moreover, when the display is switched, the related transactions are submitted uniformly to avoid the problem of screen flashing and the problem of mutual exclusion of various secondary screen states.
[0131] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software structure of the electronic device 100.
[0132] Figure 6 It is a software structure block diagram of the electronic device 100 according to an embodiment of the present application.
[0133] The layered architecture of the electronic device 100 divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely, the application layer, the application framework layer, the Android runtime (Android Runtime) and the system library, and the kernel layer.
[0134] The application layer can include a series of application packages.
[0135] like Figure 6 As shown, the application package may include applications such as camera, wallet, navigation, gallery, settings, video, short message, calendar, map, music, etc.
[0136] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.
[0137] like Figure 6 As shown, the application framework layer may include window management services, display management services, display manager, resource management services, folding screen management services, device management services, View framework, Surface Flinger, phone manager, notification manager, etc.
[0138] The Window Manager Service (WMS) is the manager of the window, responsible for starting, adding and deleting windows. The size and hierarchy of windows are also managed by the Window Manager Service. The Window Manager Service can obtain the display size, determine whether there is a status bar, lock the screen, capture the screen, etc.
[0139] The Display Manager Service (DMS) is one of the system services responsible for display management. DMS can be used to manage the life cycle of the display. It determines how to control its logical display based on the currently connected physical display device, and sends notifications to the system and applications when the state changes, etc. The Display Management Service provides an external interface through the Display Manager (DM).
[0140] The foldable screen management service can be used to implement the management of foldable screens, such as the management of foldable screen postures (such as unfolded state, folded state, stand state, main screen state, secondary screen state, etc.).
[0141] The device state management service can be used to manage the device state switching, for example, to determine whether to switch the screen display. In the embodiment of the present application, the device state management service can be used to determine whether to switch from the main screen to the secondary screen.
[0142] The View framework can be used to manage views in a window and is responsible for displaying the UI (User Interface) to the user and interacting with the user. The View framework includes visual controls, such as controls for displaying text and controls for displaying images. The view system can be used to build applications. The display interface can be composed of one or more views. For example, the display interface including a text notification icon can include a view for displaying text and a view for displaying images.
[0143] SurfaceFlinger is an important component in the Android system, which is responsible for drawing and rendering all graphical interfaces and applications in the display system. It is a core part of the Android graphics subsystem, responsible for managing and operating all Surface objects (i.e., screen buffers).
[0144] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).
[0145] The notification manager enables applications to display notification information in the status bar, which can be used to convey notification-type messages and disappear automatically after a short stay without user interaction.
[0146] Android Runtime includes core libraries and virtual machines. Android Runtime is responsible for scheduling and management of the Android system.
[0147] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.
[0148] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
[0149] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.
[0150] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.
[0151] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0152] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0153] A 2D graphics engine is a drawing engine for 2D drawings.
[0154] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, audio driver, Wi-Fi driver, sensor driver, etc. Among them, the hardware includes at least processor, display, Wi-Fi module, sensor, etc.
[0155] Understandably, Figure 6 The layers in the software structure shown and the components included in each layer do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer layers than shown in the figure, and each layer may include more or fewer components, or combine some components, or split some components, or arrange the components differently, which is not limited in the present application.
[0156] It is understandable that, in order to implement the display method in the embodiment of the present application, the electronic device includes hardware and / or software modules corresponding to the execution of each function. In combination with the algorithm steps of each example described in the embodiment disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of the present application.
[0157] Scene 1
[0158] This scenario provides detailed explanations for the use scenarios of the secondary screen "rear selfie" and "secondary screen card". Among them, the camera application interface displayed on the main screen of the external folding screen mobile phone can be switched to the secondary screen, and its secondary screen display mode is the "rear selfie" mode. You can refer to Figure 5c As shown in (1); the third-party application interface or system application interface displayed on the main screen of the external folding screen mobile phone can also be switched to the secondary screen for display, and the secondary screen display mode is the "secondary screen card" mode, which can be referred to Figure 5c As shown in (3).
[0159] like Figure 7a The following is a schematic diagram of the interaction between the modules. Figure 7a Taking the "rear selfie" usage scenario as an example, the process of the display method provided in the embodiment of the present application specifically includes:
[0160] S601, in response to a user operation, the camera application sends a secondary screen display request to the folding screen management service.
[0161] Exemplarily, the user operation may be an operation that triggers the start of the “rear selfie” function, for example Figure 3a The operation shown is to click the "switch to sub-screen" control 2011 in the camera application interface. In response to the user operation, the camera application sends a sub-screen display request to the folding screen management service.
[0162] Among them, the parameters carried by the sub-screen display request may include but are not limited to the package name of the requested application (requestPackage Name), the requested sub-screen display mode (sub Mode), the sub-screen display position (sub Position), and the current display mode (display Mode). The requested sub-screen display mode may include but is not limited to the "rear selfie" display mode, the "variable wallet" display mode, and the "sub-screen card" display mode. The current display mode may include but is not limited to the full-screen state, the main screen state, and the sub-screen state. The full-screen state refers to the state in which the entire display area of the folding screen (i.e., display areas 194-1, 194-2, and 194-3) is used to display the interface when the external folding screen mobile phone is in the unfolded state, the main screen state refers to the state in which the display area 194-3 of the folding screen is used to display the interface when the external folding screen mobile phone is in the folded state, and the sub-screen state refers to the state in which the display area 194-1 of the folding screen is used to display the interface when the external folding screen mobile phone is in the folded state.
[0163] In this process, Figure 3a Taking the scenario shown in the figure as an example, in the secondary screen display request sent by the camera application: the package name of the requested application is "package name of the camera application"; the requested secondary screen display mode is the "rear selfie" display mode; the secondary screen display position is as follows Figure 4a The display position of the application interface shown in (3) may, for example, include a display offset of the application interface (such as a pixel offset from top to bottom of the application interface on the secondary screen); the current display mode is the primary screen state.
[0164] In another possible application scenario, in response to a user operation, the camera application interface displayed on the entire folding screen of the external folding screen mobile phone is switched to the secondary screen. In this case, in the secondary screen display request sent by the camera application: the package name of the requested application is "package name of the camera application"; the requested secondary screen display mode is the "rear selfie" display mode; the secondary screen display position is as follows: Figure 4a The application interface display position shown in (3) is shown in the figure; the current display mode is full screen. Understandably, in this case, the user needs to fold the external folding screen mobile phone and make the secondary screen of the external folding screen mobile phone face the user, so as to realize the "rear selfie" function of the external folding screen mobile phone.
[0165] S602, the folding screen management service sends a screen switching request to the device status management service.
[0166] After receiving the secondary screen display request, the folding screen management service parses the secondary screen display request, generates a screen switching request based on it, and sends the screen switching request to the device state management service. The screen switching request may include but is not limited to the device posture, the requested secondary screen display mode, and the secondary screen display position. The device posture can be used to indicate the posture of the folding screen, such as the unfolded state, the folded state, the stand state (or the desk calendar state), etc.
[0167] In this process, Figure 3a Taking the scenario shown in the figure as an example, in the screen switching request sent by the folding screen management service: the device posture is folded; the requested secondary screen display mode is the "rear selfie" display mode; the secondary screen display position is as follows Figure 4a The display position of the application interface shown in (3) may, for example, include a display offset of the application interface (eg, a pixel offset from top to bottom of the application interface on the secondary screen).
[0168] S603: The device state management service sends screen switching state change information to the display management service.
[0169] The screen switching state change information is used to indicate how the interface display of the external folding screen mobile phone changes. Figure 3a Taking the scenario shown as an example, the screen switching state change information is used to indicate that the interface display of the external folding screen mobile phone switches from the main screen to the secondary screen. Exemplarily, the screen switching state change information may also include but is not limited to the requested secondary screen display mode (such as the "rear selfie" display mode) and the secondary screen display position.
[0170] S604: The display management service instructs the window management service to add a mask to the main screen display (or main logical display, main logical display screen, etc.).
[0171] After receiving the screen switching state change notification from the device state management service, the display management service determines that the interface display of the external folding screen mobile phone is switched from the main screen to the secondary screen. When the display management service instructs the window management service to add a mask to the main screen display, the window management service can also be notified of the secondary screen display mode and secondary screen display position requested by the application.
[0172] In this embodiment, the interface display is switched from the main screen to the secondary screen based on the offset of the main screen display. In this way, the application side will not perceive the change of the display screen (or the folding screen display area), and the application side does not need to redraw the application interface, thereby improving the efficiency of interface screen switching display (such as switching the application interface from display on the main screen to display on the secondary screen).
[0173] In order to prevent users from feeling the shift of the main screen display and improve the user's screen switching experience, when the display management service determines that the application interface display needs to be switched from the main screen to the secondary screen, it instructs the window management service to add a mask to the main screen display. It can be understood that when the main screen display shifts, the mask shifts synchronously with the main screen display, and the user will not feel the shift of the main screen display.
[0174] S605: The window management service adds a mask on the main screen display.
[0175] The window management service adds a mask on the main screen display according to the instruction of the display management service. The size of the mask is the same as the size of the main screen display. Optionally, the mask is a black mask.
[0176] In this step, the window management service can add a mask to the main screen display and submit the transaction corresponding to the added mask to SurfaceFlinger, which executes the corresponding transaction. At this time, the user cannot view the main screen display, but can see the mask on the main screen display.
[0177] It is understandable that since the size of the main screen is larger than that of the secondary screen, when the main screen display is offset to the secondary screen for display, the main screen display will not only cover the secondary screen area 194-1, but also cover the display area 194-2. Adding a mask to the main screen display can prevent the user from perceiving that the main screen display covers the display area 194-2.
[0178] S606, the window management service calculates the primary screen display offset according to the secondary screen display mode and the secondary screen display position requested by the application, and triggers the display management service to perform the primary screen display offset setting operation.
[0179] The window management service calculates the offset of the main screen display according to the current display position of the main screen display (that is, the display position on the main screen) and the display position of the secondary screen requested by the application. For example, the offset of the main screen display may refer to the offset of the upper left vertex of the main screen display. Figure 7b ,In the “rear selfie” application scenario, the offset of the main screen display is shown in the figure.
[0180] S607: The display management service performs a main screen display offset setting operation.
[0181] After the display management service obtains the offset of the main screen display calculated by the window management service, it performs the main screen display offset setting operation according to the offset. It should be pointed out that after the display management service performs the main screen display offset setting operation, the main screen display does not start to offset, that is, the main screen display offset does not take effect. The display management service performs the main screen display offset setting operation, which can be understood as the display management service only sets the offset of the main screen display, and the offset of the main screen display is not actually effective. It is necessary to wait for the window management service to submit the transaction corresponding to the main screen display offset to SurfaceFlinger, and then SurfaceFlinger will perform the main screen display offset operation to make the main screen display offset truly effective.
[0182] S608, the display management service calculates the scaling ratio of the main screen display according to the size of the secondary screen, and triggers the window management service to perform a scaling operation on the main screen display.
[0183] The display management service calculates the scaling ratio of the primary display according to the size of the secondary display and the size of the primary display. Since the scaled primary display can fill the secondary display area in the width direction, the display management service can calculate the scaling ratio of the primary display according to the width of the secondary display and the width of the primary display, and send the scaling ratio of the primary display to the window management service.
[0184] S609: The window management service performs a scaling operation on the main screen display according to the scaling ratio.
[0185] The window management service performs a proportional scaling operation on the main screen display according to the scaling ratio. It can be understood that when the main screen display is scaled, the mask added to the main screen display is scaled simultaneously with the main screen display.
[0186] S610: The window management service executes a mask removal setting operation.
[0187] After the window management service completes the scaling operation of the main screen display, the mask removal setting operation on the main screen display can be performed. It should be noted that after the window management service performs the mask removal setting operation, the mask is not actually removed, that is, the mask removal on the main screen display is not effective. The window management service performs the mask removal setting operation, which can be understood as the window management service setting the attribute of the mask on the main screen display to remove.
[0188] S611, the window management service adds the main screen display offset and mask removal to the same transaction and submits the transaction to SurfaceFlinger.
[0189] The window management service collects the main screen display offset settings and the mask removal settings on the main screen display, adds them to a transaction and submits them to SurfaceFlinger.
[0190] S612, SurfaceFlinger simultaneously implements the main screen display offset and mask removal, and returns feedback information of screen switching completion to the folding screen management service, and then the folding screen management service feeds back feedback information of successful screen switching to the camera application.
[0191] SurfaceFlinger receives the transaction submitted by the window management service and executes the transaction, so that the main screen display position update and the mask removal on the main screen display are executed simultaneously. That is, when the mask is removed on the main screen display, the main screen display also completes the position update according to the offset setting. There will be no situation where the main screen display does not complete the position offset after the mask is removed, and the user will not perceive similar Figure 4a The screen flashing problem shown in (2) and (3).
[0192] Figure 7c The figure shows a schematic diagram of solving the screen flickering problem in the "rear selfie" usage scenario. Figure 7c In the schematic diagram shown, in order to make the switching of the interface display area clear, the expanded display screen is used for illustration. Figure 3a In the example shown, before the user switches the shooting preview interface of the camera application to the secondary screen, such as before clicking the "switch to secondary screen" control 2011, the camera application interface 201 is displayed on the main screen 194-3, such as Figure 7c In response to the user clicking the "switch to secondary screen" control 2011, the camera application interface is proportionally reduced and offset, and then the camera application interface 203 is displayed on the secondary screen 194-1. Since the camera application interface offset (i.e., the primary screen display offset) and the mask removal on the primary screen display are effective at the same time, before the camera application interface 203 is displayed on the secondary screen 194-1, the user will not see the situation where the interface is improperly displayed, such as due to Figure 4a The screen flickering problem caused by the display conditions shown in (2) and (3).
[0193] In the above process, the "rear selfie" scenario is used as an example. The same is true for the "secondary screen card" scenario, which will not be described here. The difference is that in the "secondary screen card" scenario, in the secondary screen display request sent by the application to the folding screen management service, the requested secondary screen display mode is the "secondary screen card" display mode, and the secondary screen display position is as follows: Figure 4c The display position of the application interface shown in (3) may, for example, include a display offset of the application interface (eg, a pixel offset from top to bottom of the application interface on the secondary screen).
[0194] Figure 7d The following is a schematic diagram of solving the screen flickering problem when using the "secondary screen card". Figure 7d In the schematic diagram shown, in order to make the switching of the interface display area clear, the expanded display screen is used for illustration. Figure 3d In the example shown, before the user switches the interface of the navigation application to the secondary screen, such as before performing gesture 1, the navigation application interface 401 is displayed on the primary screen 194-3, such as Figure 7d In response to the user performing gesture 1, the navigation application interface is proportionally reduced and offset, and then the navigation application interface 403 is displayed on the secondary screen 194-1. Since the navigation application interface offset (i.e., the main screen display offset) and the mask removal on the main screen display are effective at the same time, before the navigation application interface 403 is displayed on the secondary screen 194-1, the user will not see the improper interface display situation, such as due to Figure 4c The screen flickering problem caused by the display conditions shown in (2) and (3).
[0195] In the above-mentioned "rear selfie" usage scenario and "secondary screen card" usage scenario, when the display screen of the application interface switches from the main screen to the secondary screen, a guide animation can also be displayed on the main screen of the external folding screen mobile phone to guide the user to flip the screen so that the secondary screen faces the user. Alternatively, when the display screen of the application interface switches from the entire folding screen (including the main screen area 194-3, the display area 194-2 and the secondary screen area 194-1) to the secondary screen, a guide animation can also be displayed on the entire folding screen of the external folding screen mobile phone to guide the user to fold the phone so that the secondary screen faces the user.
[0196] The following takes the display of the boot animation on the main screen of the external folding screen mobile phone as an example to explain the display process of the boot animation. Among them, the boot animation is displayed based on the logical display of the virtual display (hereinafter referred to as the virtual logical display). Figure 7e (1) shows an example of the process of creating a virtual logic Display during the startup phase of an external folding screen mobile phone. Figure 7e (2) exemplarily shows the process of adding a boot animation in the virtual logic Display to display the boot animation on the main screen.
[0197] like Figure 7e As shown in (1), the process of creating a virtual logic Display during the startup phase of the external folding screen mobile phone may specifically include:
[0198] S001, in response to the user turning on the external folding screen mobile phone, the display management service is started.
[0199] S002: The display management service creates a virtual display.
[0200] Exemplarily, the size of the virtual display is the same as the size of the secondary screen. Exemplarily, the initial position of the virtual display is the position of the secondary screen.
[0201] S003, the display management service instructs LogicalDisplayMapper to create a logical display for the virtual display.
[0202] S004, LogicalDisplayMapper creates a logical display for the virtual display.
[0203] Exemplarily, LogicalDisplayMapper can create a logical display of a virtual display through the createNewLogicalDisplayLocked method.
[0204] S005, LogicalDisplayMapper creates DisplayContent.
[0205] S006, DisplayContent mounts the layer of the virtual logic display onto the main screen.
[0206] Reference Figure 7e In (2), the process of the display method provided in the embodiment of the present application may further include:
[0207] S613: In response to the user operation, the camera application obtains a virtual logical display.
[0208] Exemplarily, the user operation may be an operation that triggers the start of the “rear selfie” function, for example Figure 3a The operation shown is to click the "switch to sub-screen" control 2011 in the camera application interface. In response to the user operation, the camera application obtains the virtual logic display created during the startup phase of the external folding screen mobile phone.
[0209] S614, the camera application adds a guide animation to the virtual logic display.
[0210] Among them, the guide animation can be preset. The guide animation may be different when the external folding screen mobile phone is in different postures. For example, when the display screen of the application interface switches from the main screen to the secondary screen, that is, when the external folding screen mobile phone is in a folded state, the guide animation is used to instruct the user to flip the screen so that the secondary screen faces the user. For another example, when the display screen of the application interface switches from the entire folding screen to the secondary screen, that is, when the external folding screen mobile phone is in an unfolded state, the guide animation is used to instruct the user to fold the phone and make the secondary screen face the user.
[0211] S615, the window management service determines whether there is content in the virtual logic display each time the window is refreshed, and notifies the display management service if there is content.
[0212] Each time the window is refreshed, the window management service determines whether content has been added to the virtual logic display. In this embodiment, it can specifically determine whether a boot animation has been added to the virtual logic display. If a virtual animation has been added to the virtual logic display, the display management service is notified that a boot animation has been added to the virtual logic display. The addition of a boot animation to the virtual logic display indicates that the virtual logic display needs to be displayed.
[0213] S616: The display management service executes a setting operation to make the display area full screen.
[0214] Among them, the full screen display area refers to setting the display area of the external folding screen mobile phone to the entire area of the folding screen, that is, the main screen area 194-3, the display area 194-2 and the secondary screen area 194-1. It can be understood that when the external folding screen mobile phone is in a folded state and the camera application is displayed on the main screen area 194-3, the display area of the external folding screen mobile phone is the main screen area 194-3. In order to enable the animation to be displayed on the main screen and the application interface to be displayed on the secondary screen at the same time, the display management service sets the display area to the entire folding screen area.
[0215] S617: The display management service performs a virtual logic display offset setting operation.
[0216] Optionally, the display management service performs a virtual logic display offset setting operation and a scaling setting operation. The virtual logic display setting operation is used to set the offset of the virtual logic display so that the virtual logic display can be displayed in the main screen area. The virtual logic display scaling setting operation is used to set the scaling ratio of the virtual logic display so that the size of the virtual logic display matches the size of the main screen. Among them, the scaling can be proportional scaling or non-proportional scaling, which is not limited in this embodiment.
[0217] This embodiment does not limit the sequence of S616 and S617.
[0218] It should be pointed out that after the display management service performs the setting operation of setting the display area to full screen, the display area is not set to folding screen full screen, that is, the display area full screen does not take effect. The display management service performs the setting operation of setting the display area to full screen, which can be understood as the display management service setting the range attribute value of the display area to folding screen full screen, and the range adjustment of the display area has not actually taken effect. It is necessary to wait for the display management service to submit the transaction corresponding to the display area full screen to SurfaceFlinger, and then SurfaceFlinger will perform the display area full screen operation, so that the range adjustment of the display area can really take effect.
[0219] Similarly, after the display management service performs the virtual logical display offset setting (and / or scaling setting) operation, the virtual logical display does not start to shift (and / or scale), that is, the virtual logical display offset (and / or scaling) does not take effect. The display management service performs the virtual logical display offset setting (and / or scaling setting) operation, which can be understood as the display management service only sets the offset of the virtual logical display (and / or sets the scaling ratio of the virtual logical display), and the offset (and / or scaling) of the virtual logical display is not actually effective. It is necessary to wait for the display management service to submit the transaction corresponding to the virtual logical display offset (and / or scaling) to SurfaceFlinger, and then SurfaceFlinger performs the virtual display offset (and / or scaling) operation to make the virtual logical display offset (and / or scaling) truly effective.
[0220] S618, the display management service adds the full screen display area and the virtual logical display offset to the same transaction, and submits the transaction to SurfaceFlinger.
[0221] The display management service collects virtual display offset settings and display area range settings, adds them to the same transaction and submits them to SurfaceFlinger.
[0222] S619, SurfaceFlinger simultaneously takes effect on the full screen display area and the virtual logic display offset.
[0223] SurfaceFlinger receives the transaction submitted by the display management service and executes the transaction, so that the virtual logic display position update and the display area range adjustment are executed simultaneously. That is, while the virtual logic display is offset, the display area is adjusted, so there will be no problem of the virtual logic display offset but the display area is not adjusted, and there will be no problem of the boot animation not being able to be displayed due to mismatched display area settings.
[0224] When the boot animation is completed, or when the boot animation reaches a preset duration (for example, 3 seconds), the virtual logic display can be offset back to the secondary screen position, and the display area of the external folding screen mobile phone can be reset to the secondary screen area.
[0225] Scene 2
[0226] This scenario provides a detailed explanation of the use of the secondary screen "Baibian Wallet". After the main screen display of the external folding screen mobile phone is switched to the secondary screen, the interface of the Baibian Wallet can be displayed on the secondary screen. The secondary screen display mode is the "Baibian Wallet" mode. Please refer to Figure 5c As shown in (2).
[0227] Different from the "rear selfie" scene and the "secondary screen card" scene in scene 1, the Wallet app is not started before the main screen display of the external folding screen phone switches to the secondary screen. The Wallet app is started after the main screen display of the external folding screen phone switches to the secondary screen display, and then the interface of the Wallet app can be displayed on the secondary screen.
[0228] like Figure 8a The following is a schematic diagram of the interaction between the modules. Figure 8a , the process of the display method provided in the embodiment of the present application specifically includes:
[0229] S701, in response to a user operation, the desktop application sends a secondary screen display request to the folding screen management service.
[0230] For example, the user operation may be an operation that triggers the activation of the "Baibian Wallet" function, for example Figure 3b The operation of clicking the wallet card 3011 is shown. Figure 3c The operation of pressing the power key 190-1 is shown. In response to the user operation, the desktop application sends a secondary screen display request to the folding screen management service.
[0231] In this scenario, the parameters carried by the sub-screen display request may include but are not limited to the requested application package name (request Package Name), the requested sub-screen display mode (sub Mode), the sub-screen display position (subPosition), and the current display mode (display Mode).
[0232] In this process, Figure 3b or Figure 3c Taking the scenario shown in the figure as an example, in the secondary screen display request sent by the desktop application, the package name of the requested application is "the package name of the desktop application"; the secondary screen display mode requested is the "variable wallet" display mode; the secondary screen display position is as follows Figure 4b The application interface display position shown in (3) is as follows; the current display mode is the main screen state.
[0233] In this scenario, when the requested secondary screen display mode is the "Baibian Wallet" display mode, the parameters carried in the secondary screen display request may also include the package name of the application to be launched and the name of the application's activity. Figure 3b or Figure 3c In the scenario shown, the package name of the application that needs to be launched is the package name of the "Baibian Wallet" application, as well as the corresponding Activity name of the "Baibian Wallet" application.
[0234] S702, the folding screen management service sends a screen switching request to the device status management service.
[0235] In this process, Figure 3b or Figure 3c Taking the scenario shown in the figure as an example, in the screen switching request sent by the folding screen management service: the device posture is folded; the requested secondary screen display mode is the "variable wallet" display mode; the secondary screen display position is as follows Figure 4b The application interface shown in (3) is displayed at the location.
[0236] S703: The device state management service sends screen switching state change information to the display management service.
[0237] In this process, Figure 3b or Figure 3c Taking the scenario shown as an example, the screen switching state change information can be used to indicate that the interface display of the external folding screen mobile phone switches from the main screen to the secondary screen. Exemplarily, the screen switching state change information may also include but is not limited to the requested secondary screen display mode (such as the "variable wallet" display mode) and the secondary screen display position.
[0238] S704: The display management service instructs the window management service to add a mask to the main screen display.
[0239] S705: The window management service adds a mask to the main screen display.
[0240] The window management service adds a mask on the main screen display according to the instruction of the display management service. The size of the mask is the same as the size of the main screen display. Optionally, the mask is a black mask.
[0241] In this step, the window management service can add a mask to the main screen display, and submit the transaction corresponding to the newly added mask to SurfaceFlinger, and SurfaceFlinger performs the corresponding transaction. At this time, the user cannot view the main screen display, but can see the mask on the main screen display.
[0242] It is understandable that since the size of the main screen is larger than that of the secondary screen, when the main screen display is offset to the secondary screen for display, the main screen display will not only cover the secondary screen area 194-1, but also cover the display area 194-2. Adding a mask to the main screen display can prevent the user from perceiving that the main screen display covers the display area 194-2.
[0243] S706, the window management service calculates the main screen display offset according to the secondary screen display mode and secondary screen display position requested by the application, sets the main screen display size to be the same as the secondary screen size, and triggers the display management service to perform the main screen display offset setting operation.
[0244] S707: The display management service performs a main screen display offset setting operation.
[0245] Among them, the main screen display offset setting is used to set the display position of the main screen display to the secondary screen area.
[0246] S708, the window management service submits the main screen display offset transaction to SurfaceFlinger.
[0247] S709, SurfaceFlinger executes the main screen display offset transaction and returns feedback information of screen switching completion to the folding screen management service, and then the folding screen management service feeds back feedback information of successful screen switching to the desktop application.
[0248] S710, the folding screen management service starts the versatile wallet application.
[0249] After the folding screen management service receives the screen switching completion information fed back from SurfaceFlinger, it determines that the main screen display has been switched from the main screen to the secondary screen. Then, the folding screen management service starts the Variety Wallet application.
[0250] S711, the folding screen management service instructs the View framework to draw the Activity of the Variety Wallet application.
[0251] The Activity of the Variety Wallet application mentioned here is the application Activity carried in the secondary screen display request in S701.
[0252] S712, after the View framework completes the Activity of the Variety Wallet application, it notifies the window management service.
[0253] S713, the window management service performs a mask removal setting operation and submits a mask removal transaction to SurfaceFlinger.
[0254] After receiving the notification that the Activity of the Variety Wallet application has been drawn, the window management service removes the mask on the main screen display and submits the mask removal transaction to SurfaceFlinger.
[0255] S714, SurfaceFlinger performs a mask removal transaction.
[0256] SurfaceFlinger executes the mask removal transaction to remove the mask on the main screen display. The interface of the Variety Wallet application is displayed on the main screen display. You can refer to Figure 3b Medium (3) or Figure 3c As shown in (2).
[0257] When SurfaceFlinger performs the mask removal transaction, the Activity of the Variety Wallet application has been drawn. Then, after the mask on the main screen display is removed, the user can see the Variety Wallet interface displayed on the secondary screen, and there will be no problem of incomplete position offset of the main screen display after the mask is removed, and the user will not perceive similar Figure 4b The screen flashing problem shown in (2) and (3).
[0258] For details not explained in this process, please refer to Scenario 1, which will not be repeated here.
[0259] Figure 8b The following is a schematic diagram of solving the screen flashing problem when using the "Baibian Wallet". Figure 8b In the schematic diagram shown, in order to make the switching of the interface display area clear, the expanded display screen is used for illustration. Figure 3b or Figure 3cIn the example shown, before the user starts the Variety Wallet function, such as before clicking the Variety Wallet card 3011, or before pressing the power button 190-1, the desktop application interface (such as the interface 301 where the Variety Wallet card is located) is displayed on the main screen 194-3, such as Figure 7c In response to the user clicking the "switch to secondary screen" control 2011, the camera application interface is proportionally reduced and offset, and then the camera application interface 203 is displayed on the secondary screen 194-1. Since the camera application interface offset (i.e., the primary screen display offset) and the mask removal on the primary screen display are effective at the same time, before the camera application interface 203 is displayed on the secondary screen 194-1, the user will not see the situation where the interface is improperly displayed, such as due to Figure 4a The screen flickering problem caused by the display conditions shown in (2) and (3).
[0260] In the "Changeable Wallet" usage scenario, when the display screen of the application interface switches from the main screen to the secondary screen, a guidance animation may also be displayed on the main screen of the external folding screen mobile phone to guide the user to flip the screen so that the secondary screen faces the user. Alternatively, when the display screen of the application interface switches from the entire folding screen (including the main screen area 194-3, the display area 194-2 and the secondary screen area 194-1) to the secondary screen, a guidance animation may also be displayed on the entire folding screen of the external folding screen mobile phone to guide the user to fold the phone so that the secondary screen faces the user. Similar to scenario one, the guidance animation is also displayed based on the virtual logic display. For the process of creating a virtual logic display during the startup phase of an external folding screen mobile phone, and the process of adding a guidance animation to the virtual logic display to display the guidance animation on the main screen, please refer to Figure 7e and Figure 7e The relevant explanations will not be repeated here.
[0261] Scene 3
[0262] The three secondary screen display modes mentioned above (i.e., "rear selfie", "secondary screen card" and "variable wallet") may also be switched to each other. This embodiment does not limit the switching method between any two secondary screen display modes. The following explanation is given by taking the switching of the secondary screen display mode from the "rear selfie" mode or the "secondary screen card" mode to the "variable wallet" mode as an example.
[0263] like Figure 9a The following is a schematic diagram of the interaction between the modules. Figure 9a , the process of the display method provided in the embodiment of the present application specifically includes:
[0264] S801, in response to a user operation, the desktop application sends a secondary screen display request to the folding screen management service.
[0265] For example, the external folding screen mobile phone is in the folded state, the secondary screen display mode is "secondary screen card" or "rear selfie", and the user presses the power button 190-1. In response to the user operation, the desktop application sends a secondary screen display request to the folding screen management service.
[0266] In this scenario, the parameters carried by the sub-screen display request may include but are not limited to the requested application package name (request Package Name), the requested sub-screen display mode (sub Mode), the sub-screen display position (subPosition), and the current display mode (display Mode).
[0267] In this process, in the secondary screen display request sent by the desktop application, the package name of the requested application is "package name of the desktop application"; the requested secondary screen display mode is the "variable wallet" display mode; the secondary screen display position is as follows: Figure 4b The application interface display position shown in (3); the current display mode is the main screen state. Since the requested secondary screen display mode is the "Baibian Wallet" display mode, the parameters carried by the secondary screen display request can also include the package name of the application to be launched (such as the package name of the "Baibian Wallet" application) and the Activity name of the application (such as the Activity name of the "Baibian Wallet" application).
[0268] S802, the folding screen management service sends a screen switching request to the device status management service.
[0269] S803: The device state management service sends screen switching state change information to the display management service.
[0270] Different from scenes one and two, the screen switching state change information can be used to indicate that the secondary screen display mode of the external folding screen has changed, for example, from the "secondary screen card" or "rear selfie" display mode to the "variable wallet" display mode. Exemplarily, the screen switching state change information may also include but is not limited to the requested secondary screen display mode (such as the "variable wallet" display mode) and the secondary screen display position.
[0271] S804: The display management service instructs the window management service to add a mask for the secondary screen.
[0272] In this scenario, when the desktop application requests to start the "Baibian Wallet" application on the secondary screen, the display management service learns from the screen switching state change information sent by the device status management service that the external folding screen phone is currently in secondary screen display mode, and the secondary screen display mode is different from the secondary screen display mode requested by the desktop application. At this time, the display management service can instruct the window management service to add a mask to the secondary screen area to prevent the user from perceiving the size change of the main screen display displayed on the secondary screen.
[0273] S805: The window management service adds a mask to the secondary screen area.
[0274] The window management service adds a mask to the secondary screen area according to the instruction of the display management service, wherein the size of the mask is the same as the size of the secondary screen, and the color of the mask can be black.
[0275] In this step, the window management service can add a mask to the secondary screen area and submit the transaction corresponding to the newly added mask to SurfaceFlinger, which executes the corresponding transaction. At this time, the user cannot view the main screen display displayed in the secondary screen area, but can only see the mask on the secondary screen area.
[0276] S806: The window management service sets the size of the primary screen display to be the same as the size of the secondary screen.
[0277] When the secondary screen display mode requested by the application is different from the current secondary screen display mode of the external folding screen mobile phone, the window management service needs to adjust the size of the main screen display to match the requested secondary screen display mode.
[0278] In this scenario, the requested secondary screen display mode is the "Baibian Wallet" display mode, so the window management service adjusts the size of the main screen display to the same size as the secondary screen, so that the Baibian Wallet application interface can be displayed in full screen on the secondary screen. From the user's perspective, the user can only see the mask and will not perceive the screen flashing problem caused by the change in the size of the main screen display.
[0279] In this step, the window management service can submit the transaction related to setting the main screen display size to SurfaceFlinger, and SurfaceFlinger executes the corresponding transaction to complete the adjustment of the main screen display size. Then, SurfaceFlinger can return feedback information of screen switching completion to the folding screen management service, and the folding screen management service can return feedback information of successful screen switching to the desktop application.
[0280] S807, the folding screen management service starts the versatile wallet application.
[0281] After the folding screen management service receives the screen switching completion information fed back from SurfaceFlinger, it determines that the main screen display has been switched from the main screen to the secondary screen. Then, the folding screen management service starts the Variety Wallet application.
[0282] S808, the folding screen management service instructs the View framework to draw the Activity of the Variety Wallet application.
[0283] The Activity of the Variety Wallet application mentioned here is the application Activity carried in the secondary screen display request in S801.
[0284] S809, after the View framework completes the Activity of the Variety Wallet application, it notifies the window management service.
[0285] S810, the window management service performs a mask removal setting operation and submits a mask removal transaction to SurfaceFlinger.
[0286] After receiving the notification that the Activity of the Variety Wallet application has been drawn, the window management service removes the mask on the secondary screen area (that is, the main screen display) and submits the mask removal transaction to SurfaceFlinger.
[0287] S811, SurfaceFlinger performs a mask removal transaction.
[0288] SurfaceFlinger performs the mask removal transaction to remove the mask on the main screen display, and the secondary screen area displays the interface of the Variety Wallet application in full screen. You can refer to Figure 3b Medium (3) or Figure 3c As shown in (2).
[0289] When SurfaceFlinger performs the mask removal transaction, the Activity of the Variety Wallet application has been drawn. Then, after the mask on the main screen display is removed, the user can see the Variety Wallet interface displayed in full screen on the secondary screen, and there will be no situation where the Variety Wallet interface is not displayed in full screen on the secondary screen, that is, there will be no similar Figure 5a Medium (2) or Figure 5b The problem of inappropriate display area shown in (2) is.
[0290] Figure 9b The example shows a schematic diagram of a scenario in which the secondary screen display mode switches from the "rear selfie" mode to the "variable wallet" mode. Fig.9c The example shows a schematic diagram of a scenario in which the secondary screen display mode switches from the "secondary screen card" mode to the "variable wallet" mode. Figure 5a and Figure 9b , and contrast Figure 5b and Fig.9c The method provided in this embodiment can flexibly switch between different secondary screen display modes without the problem of mutual exclusion between various secondary screen display modes.
[0291] This embodiment further provides a computer storage medium, in which computer instructions are stored. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the display method in the above-mentioned embodiment.
[0292] This embodiment further provides a computer program product. When the computer program product is run on a computer, the computer is enabled to execute the above-mentioned related steps to implement the display method in the above-mentioned embodiment.
[0293] In addition, an embodiment of the present application also provides a device, which may specifically be a chip, component or module, and the device may include a connected processor and memory; wherein the memory is used to store computer execution instructions, and when the device is running, the processor may execute the computer execution instructions stored in the memory so that the chip executes the display method in the above-mentioned method embodiments.
[0294] Among them, the electronic device (such as a mobile phone, etc.), computer storage medium, computer program product or chip provided in this embodiment is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.
[0295] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0296] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0297] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
Claims
1. A display method, characterized in that: Applied to an external folding screen device, the external folding screen device includes a flexible screen, the flexible screen is divided into a first screen and a second screen after being folded outward along a rotating axis, and the size of the first screen is larger than the size of the second screen; the method includes: The main logic display of the external folding screen device is located on the first screen, and the content of the main logic display is the first interface of the first application; In response to the first operation, the first application generates a first request, wherein the first request includes a target mode, and the target mode is used to indicate a display mode of the application interface on the second screen after switching from the first screen to the second screen; In response to the first request, adding a mask on the main logic display; Setting the offset of the main logic display according to the target mode, and adjusting the size of the main logic display according to the target mode; wherein the offset is used to shift the main logic display from the first screen to the second screen; Adding offsetting the main logic display and removing the mask on the main logic display to the first transaction; The first transaction is executed, and the main logic display is displayed on the second screen according to the target mode, and the content of the main logic display is the second interface of the first application.
2. The method according to claim 1, characterized in that The target modes include: A first mode, wherein the first mode is used to indicate that the application interface is scaled proportionally and displayed in the center of the second screen; The second mode is used to indicate that the application interface is scaled proportionally and displayed at the bottom of the second screen.
3. The method according to claim 1, characterized in that Also includes: In response to the first operation, the first application adds a first boot animation to a virtual logic display; wherein the virtual logic display is located on the second screen; When it is determined that there is content in the virtual logic display, setting an offset of the virtual logic display, wherein the offset is used to offset the virtual logic display from the second screen to the first screen; Adding the offset virtual logic display and the full-screen display area to the second transaction; The second transaction is executed, the virtual logic display is displayed on the first screen, and the first boot animation is played in the virtual logic display.
4. The method according to any one of claims 1 to 3, characterized in that: Also includes: The main logic display of the external folding screen device is located on the first screen, and the content of the main logic display is the interface of the second application; In response to the second operation, the second application generates a second request, wherein the second request includes a third mode, an identifier of a target application, and an identifier of a target Activity of the target application, wherein the third mode is used to indicate a display mode of an interface of the target application on the second screen; In response to the second request, adding a mask on the main logic display; Setting the offset of the main logic display according to the third mode, and adjusting the size of the main logic display according to the third mode; Add the offset of the main logic display to the third transaction, and execute the third transaction; Starting the target application, and when the target Activity of the target application is drawn, adding removing the mask on the main logic display to the fourth transaction; The fourth transaction is executed, the main logic display is displayed on the second screen according to the third mode, and the content of the main logic display is the interface of the target application.
5. The method according to claim 4, characterized in that The third mode is used to instruct the application interface to be displayed in full screen on the second screen.
6. The method according to claim 4 or 5, characterized in that: Also includes: In response to the second operation, the second application adds a second boot animation to a virtual logic display; wherein the virtual logic display is located on the second screen; When it is determined that there is content in the virtual logic display, setting an offset of the virtual logic display, wherein the offset is used to offset the virtual logic display from the second screen to the first screen; Adding the offset virtual logic display and the full-screen display area to the fifth transaction; The fifth transaction is executed, the virtual logic display is displayed on the first screen, and the second boot animation is played in the virtual logic display.
7. The method according to any one of claims 1 to 6, characterized in that: Also includes: The main logic display of the external folding screen device is located on the second screen, and the content of the main logic display is the interface of the third application; The display mode of the interface of the third application on the second screen is the target mode; In response to the third operation, the fourth application generates a third request, wherein the third request includes a third mode, an identifier of a target application, and an identifier of a target Activity of the target application, wherein the third mode is used to indicate a display mode of an interface of the target application on the second screen; In response to the third request, adding a mask on the second screen; adjusting the main logic display according to the third mode; Starting the target application, and when the target Activity of the target application is drawn, adding removing the second on-screen mask to a sixth transaction; The sixth transaction is executed, the main logic display is displayed on the second screen according to the third mode, and the content of the main logic display is the interface of the target application.
8. The method according to claim 1, characterized in that: The external folding screen device includes a camera disposed opposite to the flexible screen, and after the flexible screen is folded along the rotating axis, the second screen and the camera are located on the same side of the external folding screen device; The first application is a camera application, and the images in the first interface and the second interface are captured by the camera.
9. An external folding screen device, characterized in that: include: one or more processors; Memory; And one or more computer programs, wherein the one or more computer programs are stored in the memory, and when the computer programs are executed by the one or more processors, the external folding screen device executes the display method as described in any one of claims 1-8.
10. A computer-readable storage medium comprising a computer program, characterized in that: When the computer program is executed on an electronic device, the electronic device executes the display method according to any one of claims 1 to 8.
Citation Information
Patent Citations
Picture browsing method, flexible wearable device and computer readable storage medium
CN110456962A
Compensation method and electronic equipment
CN112825232A
Adaptive interface display method and terminal equipment
CN116680023A
Same-screen picture rendering method and device and electronic equipment
CN116712727A
Display method for electronic apparatus having flexible screen, and electronic apparatus
WO2021121335A1
