Display method, external folding screen device, and storage medium
By adding a mask to the main logical display and adjusting the offset in external folding screen devices, the screen flashing problem during interface switching is solved, and the interface switching efficiency and user experience are improved.
Patent Information
- Application Number
- CN202410213731.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-02-26
- Publication Date
- 2025-10-03
- Estimated Expiration
- 2044-02-26
AI Technical Summary
In external folding screen devices, the screen flickering problem caused by logical display offset when switching interfaces affects the user experience.
By adding a mask to the main logical display and adjusting the offset, the main logical display is offset from the main screen to the secondary screen, and the mask is removed at the same time to achieve interface switching and avoid display area conflicts.
Improved the efficiency of interface switching, solved the screen flashing problem, and improved user experience.
Smart Images

Figure CN119254869B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of smart terminal technology, and in particular to a display method, an external folding screen device, and a storage medium. Background Art
[0002] With the development of flexible screen technology, foldable electronic devices (such as foldable mobile phones) have come into being.
[0003] For example, a foldable phone has a single flexible screen that folds outward. When unfolded, the user can use the entire, larger screen. When folded, it splits into a main screen and a secondary screen, located on different sides of the phone. The user can now use either screen. The interface displayed on the main screen can be switched to the secondary screen, and the switching effect directly impacts the user experience. Summary of the Invention
[0004] The present application provides a display method, an external folding screen device, and a storage medium. In this method, when the interface displayed on the main screen is switched to the secondary screen, the screen flickering problem caused by the offset of the logical display screen can be avoided, thereby improving the user experience.
[0005] In a first aspect, embodiments of the present application provide a display method. This method is applied to an external folding screen device, which includes a flexible screen. The flexible screen is divided into a first screen and a second screen after being folded outward along a hinge, and the size of the first screen is larger than the size of the second screen. The first screen can be referred to as the main screen of the external folding screen mobile phone mentioned below, and the second screen can be referred to as the secondary screen of the external folding screen mobile phone mentioned below.
[0006] The display method includes:
[0007] The external folding screen device has a primary logical display located on the first screen, and the content of the primary logical display is a first interface of a first application; in response to a first operation, the first application generates a first request, and the first request includes a target mode, which is used to indicate a display mode of the application interface on the second screen after switching from the first screen to the second screen;
[0008] The external folding screen device adds a mask on the main logical display in response to the first request;
[0009] The external folding screen device sets the offset of the main logical display according to the target mode and adjusts the size of the main logical display according to the target mode; wherein the offset is used to shift the main logical display from the first screen to the second screen;
[0010] The external folding screen device adds offsetting the main logic display and removing the mask on the main logic display to the first transaction;
[0011] The external folding screen device executes the first transaction, and the main logic display is displayed on the second screen according to the target mode. The content of the main logic display is the second interface of the first application.
[0012] The request generated by the application can be understood as the secondary screen display request mentioned below, and the target mode can be understood as the secondary screen display mode requested by the application mentioned below.
[0013] By shifting the primary and secondary displays, the application won't notice any display changes, eliminating the need to redraw the interface. This improves the efficiency of screen switching (e.g., switching the application from the primary to the secondary screen). Furthermore, because the shifting of the primary display and the removal of the mask on the primary display take effect simultaneously, this eliminates screen flickering caused by improper application interface display, improving the user experience.
[0014] According to the first aspect, the target mode includes: a first mode, the first mode is used to indicate that the application interface is displayed in the center of the second screen after being scaled; and a second mode is used to indicate that the application interface is displayed at the bottom of the second screen after being scaled.
[0015] Among them, the first mode can refer to the "rear selfie" display mode mentioned below, and the second mode can refer to the "sub-screen card" display mode mentioned below.
[0016] According to the first aspect, or any implementation of the first aspect above, the display method further includes:
[0017] In response to the first operation, the first application adds a first boot animation to the virtual logic display; wherein the virtual logic display is located on the second screen;
[0018] When the external folding screen device determines that there is content in the virtual logical display, it sets the offset of the virtual logical display. The offset is used to shift the virtual logical display from the second screen to the first screen.
[0019] The external folding screen device adds the offset virtual logical display and the full-screen display area to the second transaction;
[0020] The external folding screen device executes the second transaction, the virtual logic display is displayed on the first screen, and the first boot animation is played in the virtual logic display.
[0021] Among them, the virtual logic display can be created during the startup phase of the external folding screen device.
[0022] Among them, full-screen display area refers to setting the display area of the external folding screen device to the entire area of the flexible screen.
[0023] In this way, since the offset of the virtual logic display and the full screen display area are effective at the same time, the problem of the boot animation not being able to be displayed due to the conflict between the display area setting and the display of the virtual logic display will not occur.
[0024] According to the first aspect, or any implementation of the first aspect above, the display method further includes:
[0025] The main logic display of the external folding screen device is located on the first screen, and the content of the main logic display is the interface of the second application;
[0026] In response to the second operation, the second application generates a second request, where the second request includes a third mode, an identifier of a target application, and an identifier of a target activity of the target application, where the third mode is used to indicate a display mode of the interface of the target application on the second screen;
[0027] The external folding screen device adds a mask on the main logical display in response to the second request;
[0028] The external folding screen device sets the offset of the main logic display according to the third mode and adjusts the size of the main logic display according to the third mode;
[0029] The external folding screen device adds the offset main logic display to the third transaction and executes the third transaction;
[0030] The external folding screen device starts the target application. When the target activity of the target application is drawn, the mask on the main logic display is removed and added to the fourth transaction.
[0031] The external folding screen device executes the fourth transaction, and the main logic display is displayed on the second screen according to the third mode. The content of the main logic display is the interface of the target application.
[0032] For example, the target application may be the "Baibian Wallet" application mentioned below.
[0033] In this way, after the main and sub-screens of the external folding screen are switched, the target application is started so that the interface of the target application is completely displayed on the second screen, solving the screen flashing problem caused by improper display area of the target application interface.
[0034] According to the first aspect, or any implementation of the first aspect above, the third mode is used to instruct the application interface to be displayed in full screen on the second screen. The third mode may be the "Various Wallet" display mode mentioned below.
[0035] According to the first aspect, or any implementation of the first aspect above, the display method further includes:
[0036] In response to the second operation, the second application adds a second boot animation to the virtual logic display; wherein the virtual logic display is located on the second screen;
[0037] When the external folding screen device determines that there is content in the virtual logical display, it sets the offset of the virtual logical display. The offset is used to shift the virtual logical display from the second screen to the first screen.
[0038] External folding screen devices add offset virtual logic display and full-screen display area to the fifth transaction;
[0039] The external folding screen device executes the fifth transaction, the virtual logic display is displayed on the first screen, and the second boot animation is played in the virtual logic display.
[0040] In this way, since the offset of the virtual logic display and the full screen display area are effective at the same time, the problem of the boot animation not being able to be displayed due to the conflict between the display area setting and the display of the virtual logic display will not occur.
[0041] According to the first aspect, or any implementation of the first aspect above, the display method further includes:
[0042] The main logic display of the external folding screen device is located on the second screen, and the content of the main logic display is the interface of the third application; the display mode of the interface of the third application on the second screen is the target mode;
[0043] In response to the third operation, the fourth application generates a third request, where the third request includes a third mode, an identifier of a target application, and an identifier of a target activity of the target application, where the third mode is used to indicate a display mode of the interface of the target application on the second screen;
[0044] The external folding screen device adds a mask to the second screen in response to the third request; the external folding screen device adjusts the main logic display according to the third mode; the external folding screen device starts the target application, and when the target activity of the target application is drawn, removes the mask on the second screen and adds it to the sixth transaction;
[0045] The external folding screen device executes the sixth transaction, and the main logic display is displayed on the second screen according to the third mode. The content of the main logic display is the interface of the target application.
[0046] In this way, when the secondary screen of the external folding screen device displays the application interface, a mask is added, and the mask is removed after the secondary screen display mode is adjusted to the display mode most recently requested by the application, thereby achieving flexible switching of the external folding screen device between different secondary screen display modes, and there will be no problem of mutual exclusion of various secondary screen display modes.
[0047] According to the first aspect, or any implementation of the first aspect above, the external folding screen device includes a camera arranged back to back with the flexible screen, and after the flexible screen is folded along the hinge, the second screen and the camera are located on the same side of the external folding screen device; the first application is a camera application, and the images in the first interface and the second interface are captured by the camera.
[0048] In a second aspect, embodiments of the present application provide a foldable screen device. The foldable screen device includes: one or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and when the computer programs are executed by the one or more processors, the foldable screen device performs the display method of the first aspect and any one of the first aspects.
[0049] Exemplarily, the foldable screen device is an external foldable screen device. The external foldable screen device includes a flexible screen that, when folded outward along a hinge, is divided into a first screen and a second screen, with the first screen being larger than the second screen. The first screen can be referred to as the main screen of an external foldable screen mobile phone mentioned below, and the second screen can be referred to as the secondary screen of an external foldable screen mobile phone mentioned below.
[0050] The second aspect and any implementation of the second aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the second aspect and any implementation of the second aspect can be referred to the technical effects corresponding to the first aspect and any implementation of the first aspect, and will not be repeated here.
[0051] In a third aspect, an embodiment of the present application provides a computer-readable storage medium comprising a computer program, which, when executed on an electronic device, causes the electronic device to execute the display method of the first aspect and any one of the first aspects.
[0052] The third aspect and any implementation of the third aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the third aspect and any implementation of the third aspect can be referred to the technical effects corresponding to the first aspect and any implementation of the first aspect, and will not be repeated here.
[0053] In a fourth aspect, an embodiment of the present application provides a computer program product, comprising a computer program, which, when executed, enables a computer to execute a display method as described in the first aspect or any one of the items in the first aspect.
[0054] The fourth aspect and any implementation of the fourth aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the fourth aspect and any implementation of the fourth aspect can be referred to the technical effects corresponding to the first aspect and any implementation of the first aspect, and will not be repeated here.
[0055] In a fifth aspect, the present application provides a chip comprising a processing circuit and a transceiver pin. The transceiver pin and the processing circuit communicate with each other via an internal connection path, and the processing circuit executes the display method according to the first aspect or any one of the first aspects to control the receiving pin to receive a signal and to control the transmitting pin to send a signal.
[0056] The fifth aspect and any implementation of the fifth aspect correspond to the first aspect and any implementation of the first aspect, respectively. The technical effects corresponding to the fifth aspect and any implementation of the fifth aspect can be referred to the technical effects corresponding to the first aspect and any implementation of the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0057] Figure 1 is a schematic diagram of the hardware structure of an electronic device shown as an example;
[0058] Figure 2 is a schematic diagram of an external folding screen mobile phone shown as an example;
[0059] Figure 3a This is a schematic diagram illustrating an exemplary "rear-mounted selfie" application scenario for an external folding screen mobile phone;
[0060] Figure 3b This is a schematic diagram of an exemplary "Versatile Wallet" application scenario for an external folding screen mobile phone;
[0061] Figure 3c This is a schematic diagram of an exemplary "Versatile Wallet" application scenario for an external folding screen mobile phone;
[0062] Figure 3dSchematic diagram of the "secondary screen card" application scenario of an external folding screen mobile phone
[0063] Figure 4a This is a schematic diagram of the splash screen involved in the "rear selfie" application scenario of an external folding screen mobile phone;
[0064] Figure 4b This is a schematic diagram of the splash screen involved in the "Versatile Wallet" application scenario of an external folding screen mobile phone;
[0065] Figure 4c This is a schematic diagram of the splash screen involved in the "secondary screen card" application scenario of an external folding screen mobile phone;
[0066] Figure 5a This is a schematic diagram illustrating an example of a problem when a foldable phone switches from a "rear-mounted selfie" scenario to a "versatile wallet" scenario.
[0067] Figure 5b This is a schematic diagram illustrating an example of a problem when a foldable phone switches from the "secondary screen card" scenario to the "variable wallet" scenario.
[0068] Figure 5c This is a schematic diagram illustrating the mutually exclusive application scenarios of several secondary screens in an external folding screen mobile phone;
[0069] Figure 6 is a schematic diagram of the software structure of an electronic device shown as an example;
[0070] Figure 7a This is a schematic diagram of module interaction when the "rear selfie" scene of an external folding screen mobile phone is activated;
[0071] Figure 7b This is a schematic diagram showing the offset of the main screen display of an external folding screen mobile phone;
[0072] Figure 7c This is a schematic diagram of the screen switching when the "rear selfie" scene of an external folding screen mobile phone is activated;
[0073] Figure 7d This is a schematic diagram of screen switching when the "secondary screen card" scene of an external folding screen mobile phone is activated;
[0074] Figure 7e This is a schematic diagram of the module interactions involved in displaying a guide animation when switching from the main screen to the secondary screen of an external folding screen mobile phone;
[0075] Figure 8a This is a schematic diagram of module interaction when the "Various Wallet" scenario of an external folding screen mobile phone is activated;
[0076] Figure 8bThis is a schematic diagram of the screen switching when the "Various Wallet" scene of an external folding screen mobile phone is activated;
[0077] Figure 9a This is a schematic diagram of module interaction when an external folding screen mobile phone switches from the "rear selfie" scene or the "secondary screen card" scene to the "variable wallet" scene.
[0078] Figure 9b This is a schematic diagram of the interface of an external folding screen mobile phone switching from the "rear selfie" scene to the "variable wallet" scene;
[0079] Figure 9c This is a schematic diagram of the interface when an external folding screen mobile phone switches from the "secondary screen card" scene to the "variable wallet" scene. DETAILED DESCRIPTION
[0080] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.
[0081] The term "and / or" in this article is merely a description of the association relationship between associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.
[0082] In the description and claims of the embodiments of this application, the terms "first" and "second" are used to distinguish different objects, rather than to describe a specific order of objects. For example, the terms "first target object" and "second target object" are used to distinguish different objects, rather than to describe a specific order of objects.
[0083] In the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be interpreted as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.
[0084] In the description of the embodiments of this application, unless otherwise specified, "multiple" means two or more. For example, "multiple processing units" means two or more processing units; "multiple systems" means two or more systems.
[0085] Figure 11 shows a schematic diagram of the structure of the electronic device 100. It should be understood that, Figure 1 The electronic device 100 shown is only an example of an electronic device, and the electronic device 100 may have more or fewer components than shown in the figure, may combine two or more components, or may have a different component configuration. For example, the electronic device 100 may be a foldable screen mobile phone, such as an external foldable screen mobile phone. Figure 1 The various components shown in the illustrative embodiment may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.
[0086] The electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identification module (SIM) card interface 195. The sensor module 180 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.
[0087] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.
[0088] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.
[0089] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.
[0090] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.
[0091] It is understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.
[0092] The charging management module 140 is configured to receive charging input from a charger. While charging the battery 142, the charging management module 140 can also power the electronic device through the power management module 141. The power management module 141 is configured to connect the battery 142, the charging management module 140, and the processor 110. In some embodiments, the power management module 141 and the charging management module 140 can also be provided in the same device.
[0093] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
[0094] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The wireless communication module 160 can provide solutions for wireless communications including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. applied to the electronic device 100. In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology.
[0095] The electronic device 100 implements display functionality through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing that connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information. The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. In some embodiments, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.
[0096] In the case where the electronic device 100 is a folding screen device, the display screen 194 can be a flexible screen. Taking the electronic device 100 as an external folding screen mobile phone as an example, Figure 2 The schematic diagram of the external folding screen mobile phone is shown as an example. Figure 2 , Figure 2 (1) shows an example of a schematic diagram of a folding screen mobile phone in an unfolded state. Figure 2 (2) shows an example of a schematic diagram of a foldable phone in a semi-folded state (or semi-unfolded state). Figure 2 (3) shows an example of a schematic diagram of an external folding screen mobile phone in a folded state.
[0097] Reference Figure 2In (1), for example, the external folding screen mobile phone may include a display screen 194, which is a flexible screen and folds outward, as shown in the figure. That is, the user can fold the display screen 194 outside the mobile phone so that the display screen 194 in any posture (such as unfolded state, semi-folded state, folded state) can be used by the user. The external folding screen mobile phone also includes a shell, which may include devices for setting a camera, a flash, an audio module (such as a speaker, a receiver, a microphone, etc.). Figure 2 In (3), the housing may include housing 196.
[0098] Continue to refer to Figure 2 In (1), the display screen 194 may include a first display area 194-1 (hereinafter referred to as a secondary screen), a second display area 194-2, and a third display area 194-3 (hereinafter referred to as a primary screen). Optionally, the width of the secondary screen and the housing area 196 is the same as the width of the primary screen.
[0099] Among them, the second display area 194-2 is the area corresponding to the folding axis (hereinafter referred to as the axis area). The display screen 194 can be folded or unfolded along the folding axis to adjust the posture of the display screen 194. When the display screen is in the unfolded state, the user can use the entire area of the display screen 194 (i.e., the first display area 194-1, the second display area 194-2, and the third display area 194-3). When the display screen is in the folded state, the user can use the third display area 194-3 or the first display area 194-1.
[0100] It is understood that when the posture of the display screen 194 of the external folding screen mobile phone changes, it will trigger the switching of the display area of the display screen 194. For example, when the display screen 194 switches from the unfolded state to the folded state, the display area of the display screen 194 switches from the entire area of the display screen 194 to the third display area 194-3 or to the first display area 194-1. For another example, when the display screen 194 switches from the folded state to the unfolded state, the display area of the display screen 194 switches from the third display area 194-3 or the first display area 194-1 to the entire area of the display screen 194.
[0101] In some application scenarios, the display area of the display screen 194 can be switched from the third display area 194-3 to the first display area 194-1, or the display area of the display screen 194 can be switched from the first display area 194-1 to the third display area 194-3.
[0102] Electronic device 100 can implement a camera function using an ISP, camera 193, a video codec, a GPU, a display 194, and an application processor. The ISP processes data fed back by camera 193. In some embodiments, the ISP can be incorporated into camera 193. Camera 193 is used to capture still images or video. An object is projected onto a photosensitive element through a lens to generate an optical image. In some embodiments, electronic device 100 can include one or N cameras 193, where N is a positive integer greater than one.
[0103] In such Figure 2 In the example shown, the camera 193 may include a front camera 193-1 and a rear camera 193-2 for an external foldable screen phone. It should be noted that the "front" and "rear" mentioned here refer to the display screen 194 when the external foldable screen phone is in the unfolded state, or to the main screen 194-3 when the external foldable screen phone is in the folded state. Typically, the pixels of the rear camera 193-2 are higher than those of the front camera 193-1.
[0104] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.
[0105] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0106] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0107] The pressure sensor is used to sense pressure signals and convert them into electrical signals. In some embodiments, the pressure sensor can be provided on the display screen 194. When a touch operation is applied to the display screen 194, the electronic device 100 detects the intensity of the touch operation using the pressure sensor. The electronic device 100 can also calculate the location of the touch based on the detection signal from the pressure sensor. In some embodiments, touch operations applied to the same touch location but with different touch operation intensities can correspond to different operation instructions.
[0108] The gyroscope sensor can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (ie, x, y, and z axes) can be determined by the gyroscope sensor.
[0109] The accelerometer can detect the magnitude of acceleration of the electronic device 100 in all directions (generally three axes). When the electronic device 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the electronic device's posture, enabling applications such as switching between landscape and portrait modes and pedometers.
[0110] A touch sensor, also known as a "touch panel," can be provided on the display screen 194. The touch sensor and the display screen 194 form a touch screen, also known as a "touch screen." The touch sensor is used to detect touch operations applied to or near the touch sensor.
[0111] As Figure 2 Taking the external folding screen mobile phone shown as an example, more and more users are using the secondary screen. Figure 3a-3c Several application scenarios related to the secondary screen of an external folding screen mobile phone are shown as examples.
[0112] Figure 3a The example shows the "rear selfie" application scenario related to the secondary screen of the external folding screen mobile phone. For example, when the external folding screen mobile phone is in the folded state, the user opens the camera application on the main screen 194-3. Figure 3a As shown in (1), the main screen 194-3 displays the shooting preview interface 201 of the camera application. The preview image displayed in the shooting preview interface 201 is captured by the rear camera 193-2 of the external folding screen mobile phone. Figure 3a In (1), the shooting preview interface 201 includes a "switch to sub-screen" control 2011. The user clicks the "switch to sub-screen" control 2011 and wants to switch the shooting preview interface of the camera application to the sub-screen 194-1 for display. In response to the user operation, the main screen 194-3 of the external folding screen mobile phone can display the interface 202 (such as a black screen interface), and a prompt animation can be played in the interface 202 (the prompt animation can disappear after playing for a preset time). The prompt animation is used to prompt the user to flip the external folding screen mobile phone to use the sub-screen for viewing. You can refer to Figure 3aAs shown in (2). After the user flips over the outer folding screen mobile phone, the user can view the display content on the secondary screen 194-1. Figure 3a As shown in (3), a shooting preview interface 203 is displayed on the secondary screen 194-1, and a "switch to main screen" control 2031 can also be displayed on the secondary screen 194-1. At this time, the rear camera 193-2 can capture the image of the user holding the external folding screen mobile phone, such as Figure 3a As shown in (3), a user experience of "a user taking a selfie with the rear camera 193-2" can be generated. It can be understood that due to the different sizes of the main screen 194-3 and the secondary screen 194-1, the size of the shooting preview interface 201 displayed on the main screen 194-3 is different from the size of the shooting preview interface 203 displayed on the secondary screen 194-1. The size of the shooting preview interface 203 can be obtained by proportionally reducing the size of the shooting preview interface 201. On the secondary screen 194-1, the shooting preview interface 203 can be displayed based on the Letterbox display mode. The shooting preview interface 203 is displayed after being offset from top to bottom by a preset pixel value on the secondary screen 194-1, so as to ensure that the mobile phone leather case can be displayed in a window. In this way, in the secondary screen 194-1, there are Letterbox background areas above and below the shooting preview interface 203. Among them, the "switch to main screen" control 2031 can be displayed in the Letterbox background area. If the user wants to switch the shooting preview interface back to the main screen 194-3 for display, he or she can click the "switch to main screen" control 2031 and flip the external folding screen mobile phone. No further details are given here. Optionally, in response to the user clicking the "switch to main screen" control 2031, a black screen interface can be displayed on the main screen 194-1 of the external folding screen mobile phone, and a prompt animation can be played in the black screen interface (the prompt animation can disappear after playing for a preset time), and the prompt animation is used to prompt the user to flip the external folding screen mobile phone to use the main screen for viewing.
[0113] It should be pointed out that Figure 3a An example of a method for starting the "rear selfie" function of an external folding screen mobile phone is shown. The "rear selfie" function of an external folding screen mobile phone can also be triggered and started in other ways, which is not limited in the embodiments of the present application.
[0114] Figure 3b The example shows the application scenario of "variable wallet" related to the secondary screen of the external folding screen mobile phone. Figure 3b As shown in (1), when the external folding screen mobile phone is in the folded state, the interface 301 is displayed on the main screen 194-3, and the interface 301 displays a versatile wallet card 3011. Figure 3bIn (1), the user clicks on the Variety Wallet card 3011 to start the Variety Wallet function. In response to the user operation, the main screen 194-3 of the external folding screen mobile phone can display an interface 302 (such as a black screen interface), and a prompt animation can be played in the interface 302 (the prompt animation can disappear after playing for a preset time). The prompt animation is used to prompt the user to flip the external folding screen mobile phone to use the secondary screen for viewing. Figure 3b As shown in (2). After the user flips over the outer folding screen mobile phone, the user can view the display content on the secondary screen 194-1. Figure 3b As shown in (3), a versatile wallet interface 303 is displayed on the secondary screen 194-1. The versatile wallet interface 303 is displayed in full screen on the secondary screen 194-1. At this time, the user carries the foldable screen mobile phone like a "wallet", and the versatile wallet interface displayed on the secondary screen 194-1 can be flexibly set.
[0115] Figure 3c The example shows the application scenario of "variable wallet" related to the secondary screen of the external folding screen mobile phone. Figure 3c As shown in (1), when the external folding screen mobile phone is in the folded state, the secondary screen 194-1 is in the off state. At the same time, the main screen 194-3 can be in the off state, and can display the AOD (Always On Display) interface or the interface of any application. This example does not limit this. Figure 3c In (1), the user presses the power button 190-1 of the external folding screen mobile phone to start the versatile wallet function. In response to the user operation, the versatile wallet interface 304 is displayed on the secondary screen 194-1. Optionally, in response to the user clicking the power button 190-1, the main screen 194-3 of the external folding screen mobile phone can display an interface 302 (such as a black screen interface), and a prompt animation can be played in the interface 302 (the prompt animation can disappear after playing for a preset time). The prompt animation is used to prompt the user to flip the external folding screen mobile phone to use the secondary screen to view it. You can refer to Figure 3b As shown in (2).
[0116] It should be pointed out that Figure 3b and Figure 3c A method of starting the "Versatile Wallet" function of an external folding screen mobile phone is shown as an example. The "Versatile Wallet" function of an external folding screen mobile phone can also be triggered and started in other ways, which is not limited in the embodiments of the present application.
[0117] There are also some third-party applications or system applications (the following explanation is based on third-party applications as an example) whose interfaces can also be displayed on the secondary screen of the external folding screen mobile phone. This function will be referred to as the secondary screen card function in the future. Figure 3dThe example shows the application scenario of displaying the interface of the third-party application on the secondary screen of the external folding screen mobile phone through the secondary screen card. For example, when the external folding screen mobile phone is in the folded state, the user opens the navigation application on the main screen 194-3. Figure 3d As shown in (1), the interface 401 of the navigation application is displayed on the main screen 194-3. For example, if the user wants to switch the interface of the navigation application to the secondary screen 194-1 for display, the user can perform an operation corresponding to gesture 1 on the main screen 194-3. In response to the user operation, the main screen 194-3 of the external folding screen mobile phone can display an interface 402 (such as a black screen interface), and a prompt animation can be played in the interface 402 (the prompt animation can disappear after playing for a preset time). The prompt animation is used to prompt the user to flip the external folding screen mobile phone to use the secondary screen for viewing. You can refer to Figure 3d As shown in (2). After the user flips over the outer folding screen mobile phone, the user can view the display content on the secondary screen 194-1. Figure 3d As shown in (3), the interface 403 of the navigation application is displayed on the secondary screen 194-1. It can be understood that due to the different sizes of the main screen 194-3 and the secondary screen 194-1, the size of the navigation application interface 401 displayed on the main screen 194-3 is different from the size of the navigation application interface 403 displayed on the secondary screen 194-1. The size of the navigation application interface 403 can be obtained by proportionally reducing the size of the navigation application interface 401. On the secondary screen 194-1, the navigation application interface 403 can be displayed based on the Letterbox display mode. The navigation application interface 403 is displayed at the bottom of the secondary screen 194-1, and there is a Letterbox background area on the upper side of the navigation application interface 403. Exemplarily, the Letterbox background area on the upper side of the navigation application interface 403 is blurred. If the user wants to switch the shooting preview interface back to the main screen 194-3 for display, the user can perform an operation corresponding to gesture 2 (gesture 2 can be the same as or different from gesture 1) on the secondary screen 194-1 and flip the external folding screen mobile phone. This will not be repeated here. Optionally, in response to the user performing an operation corresponding to gesture 2 on the secondary screen 194-1, a black screen interface can be displayed on the main screen 194-1 of the external folding screen mobile phone. A prompt animation can be played in the black screen interface (the prompt animation can disappear after playing for a preset time length). The prompt animation is used to prompt the user to flip the external folding screen mobile phone to use the main screen for viewing.
[0118] It should be pointed out that Figure 3d An example is shown of a triggering method for displaying a third-party application on the secondary screen of an external folding screen mobile phone in the form of a secondary screen card. The display of a third-party application on the secondary screen of an external folding screen mobile phone in the form of a secondary screen card can also be triggered by other methods, which is not limited in the embodiments of the present application.
[0119] The above examples illustrate several scenarios in which users use the secondary screen of an external folding screen mobile phone. In the above application scenarios, when the display interface of the external folding screen mobile phone switches from the main screen to the secondary screen, a screen flickering problem may occur.
[0120] by Figure 3a Take the "rear selfie" scene shown as an example. Figure 4a The following is an example of a screen flash problem. Figure 4a In the schematic diagram shown, in order to clearly illustrate the switching of the interface display area and the problem of screen flashing, the expanded display screen is used for illustration. Figure 3a In the example shown, before the user switches the shooting preview interface of the camera application to the secondary screen, such as before clicking the "switch to secondary screen" control 2011, the camera application interface 201 is displayed on the main screen 194-3, such as Figure 4a In response to the user clicking the "switch to the secondary screen" control 2011, the camera application interface 201 is shifted to the secondary screen 194-1 and then displayed in a proportionally reduced manner. Before the secondary screen displays the camera application interface 203, the secondary screen may display the camera application interface 201' that is shifted from the camera application interface 201 to the secondary screen, as shown in FIG. Figure 4a As shown in (2), at this time, the display area of the camera application interface 201' is the secondary screen 194-1 and the hinge area 194-2. After the camera application interface 201' is proportionally reduced and offset from top to bottom by a preset pixel value, the camera application interface 203 is displayed on the secondary screen 194-1. It can be understood that, referring to Figure 4a As shown in (2), the camera application interface 201' should not be displayed in the hinge area 194-2. Figure 4a The display time of the situation shown in (2) is extremely short. For example, only one or two frames of the camera application interface are displayed in this situation, which gives users the experience that the external folding screen mobile phone has a screen flashing problem when the "rear selfie" function is activated.
[0121] It should be pointed out that Figure 3a The "rear selfie" scene shown is triggered when the external folding screen phone is in the folded state. The "rear selfie" scene can also be triggered when the external folding screen phone is in the unfolded state. In this case, the following may also appear when the "rear selfie" function is activated. Figure 4a The screen flashing problem shown in (2) and (3) will not be described in detail here.
[0122] by Figure 3b Take the "Various Wallets" scenario shown as an example. Figure 4b The following is an example of a screen flash problem. Figure 4b In the schematic diagram shown, in order to clearly illustrate the switching of the interface display area and the problem of screen flashing, the expanded display screen is used for illustration. Figure 3b In the example shown, before the user turns on the Variety Wallet function, such as before clicking the Variety Wallet card 3011, the interface 301 where the Variety Wallet card 3011 is located is displayed on the main screen 194-3, such as Figure 4b In response to the user clicking on the Variety Wallet card 3011, the Variety Wallet function is activated and the Variety Wallet interface is displayed on the secondary screen 194-1. Before the secondary screen displays the Variety Wallet interface 303, the secondary screen may display the Variety Wallet interface 303' which is equal to the size of the main screen, as shown in FIG. Figure 4b As shown in (2), at this time, the display area of the wallet interface 303' is the secondary screen 194-1 and the hinge area 194-2. After the size of the wallet interface 303' is adjusted, the wallet interface 303 is displayed on the secondary screen 194-1. It can be understood that, referring to Figure 4b As shown in (2), the wallet interface 303' should not be displayed in the axis area 194-2. Figure 4b The display time of the situation shown in (2) is extremely short. For example, only one or two frames of the Wallet interface are displayed in this situation, which gives users the experience that the foldable screen phone has a flashing screen problem when the "Wallet" function is activated. Figure 3c Take the "Various Wallets" scenario shown as an example. Figure 4b (2) and (3) can also exemplify the screen flashing problem when the "Various Wallet" function is started, which will not be repeated here.
[0123] It should be pointed out that Figure 3b 、 Figure 3c The "Various Wallet" scene shown is triggered when the external folding screen phone is in the folded state. The "Various Wallet" scene can also be triggered when the external folding screen phone is in the unfolded state. In this case, the "Various Wallet" function may also appear when it is activated. Figure 4b The screen flashing problem shown in (2) and (3) will not be described in detail here.
[0124] by Figure 3d Take the scenario shown in the figure "the third-party application is displayed on the secondary screen of the external folding screen mobile phone in the form of a secondary screen card" as an example. Figure 4c The following is an example of a screen flash problem. Figure 4c In the schematic diagram shown, in order to clearly illustrate the switching of the interface display area and the problem of screen flashing, the expanded display screen is used for illustration. Figure 3d In the example shown, before the user switches the third-party application interface (such as the navigation application interface) to the secondary screen, such as before performing the operation corresponding to gesture 1 on the main screen 194-3, the third-party application interface 401 is displayed on the main screen 194-3, such as Figure 4cIn response to the user performing an operation corresponding to gesture 1 on the main screen 194-3, the three-party application interface 401 is shifted to the secondary screen 194-1 and then displayed in a proportionally reduced manner. Before the secondary screen displays the three-party application interface 403, the secondary screen may display the three-party application interface 401' shifted from the three-party application interface 401 to the three-party application interface displayed on the secondary screen, as shown in FIG. Figure 4c As shown in (2), at this time, the display area of the three-party application interface 401' is the secondary screen 194-1 and the hinge area 194-2. The three-party application interface 401' is proportionally reduced and offset to the bottom of the secondary screen, and the three-party application interface 403 is displayed on the secondary screen 194-1. It can be understood that, referring to Figure 4c As shown in (2), the three-party application interface 401' should not be displayed in the rotation axis area 194-2. Figure 4c The display time of the situation shown in (2) is extremely short. For example, only one or two frames of the third-party application interface are displayed in this situation, which gives users the experience that the external folding screen mobile phone has a screen flashing problem when the "third-party application interface switches from the main screen to the sub-screen".
[0125] It should be pointed out that Figure 3d The "Secondary Screen Card" scene shown is triggered when the external folding screen phone is in the folded state. The "Secondary Screen Card" scene can also be triggered when the external folding screen phone is in the unfolded state. In this case, the following may also appear when the "Secondary Screen Card" function is activated. Figure 4c The screen flashing problem shown in (2) and (3) will not be described in detail here.
[0126] As the secondary screen of external folding screen mobile phones is used in more and more scenarios, problems may arise in switching between multiple application scenarios.
[0127] Figure 5a The following example shows a problem situation when using the secondary screen of an external folding screen mobile phone. Figure 5a As shown in (1), the shooting preview interface of the camera application is displayed on the secondary screen of the external folding screen mobile phone, providing the user with the use effect of "rear selfie". In this case, if the user clicks the power button 190-1, the external folding screen mobile phone is triggered to start the "variable wallet" function. In response to the user operation, the variable wallet interface 502 is displayed on the secondary screen of the external folding screen mobile phone, as shown in FIG. Figure 5a As shown in (2). Figure 5a As can be seen from (1) and (2), the layout of the Wallet interface 502 in the secondary screen 194-1 is the same as the layout of the camera application shooting preview interface 501 in the secondary screen 194-1. The Wallet interface 502 is not displayed in full screen in the secondary screen 194-1. There are Letterbox background areas above and below the Wallet interface 502, and the "Switch to Main Screen" control is also displayed in the Letterbox background area below. Obviously, Figure 5aThe versatile wallet interface 502 shown in (2) does not conform to the design concept of the versatile wallet function, and brings a poor user experience to the user.
[0128] Figure 5b The following example shows a problem situation when using the secondary screen of an external folding screen mobile phone. Figure 5b As shown in (1), the third-party application interface (such as the navigation application interface) 503 is displayed in the form of a secondary screen card on the secondary screen of the external folding screen mobile phone. In this case, if the user clicks the power button 190-1, the external folding screen mobile phone is triggered to start the "Various Wallet" function. In response to the user operation, the Variety Wallet interface 504 is displayed on the secondary screen of the external folding screen mobile phone, as shown in FIG. Figure 5b As shown in (2). Figure 5b As can be seen from (1) and (2), the layout of the Wallet interface 504 in the secondary screen 194-1 is the same as the layout of the third-party application interface 503 in the secondary screen 194-1. The Wallet interface 504 is not displayed in full screen in the secondary screen 194-1. There is a Letterbox background area above the Wallet interface 504. Obviously, Figure 5b The versatile wallet interface 504 shown in (2) does not conform to the design concept of the versatile wallet function, and brings a poor user experience to the user.
[0129] Regarding the three sub-screen usage scenarios of the external folding screen mobile phone described above, namely the sub-screen usage scenario corresponding to the "rear selfie" function, the sub-screen usage scenario corresponding to the "variable wallet" function, and the sub-screen usage scenario corresponding to the "sub-screen card" function, Figure 5c (1), (2) and (3) respectively show schematic diagrams of the secondary screen interface layout. Figure 5a An example is shown Figure 5c The secondary screen interface layout shown in (1) cannot be switched directly to Figure 5c The layout of the secondary screen interface shown in (2) is as follows: Figure 5b An example is shown Figure 5c The secondary screen interface layout shown in (3) cannot be switched directly to Figure 5c The layout of the secondary screen interface is shown in (2). Similarly, Figure 5c Zhong (1) and Figure 5c In the case of a quick start method in the secondary screen usage scenario shown in (2), Figure 5c Medium (2) or Figure 5c The secondary screen interface layout shown in (3) cannot be switched directly to Figure 5c The secondary screen interface layout shown in (1) is as follows: Figure 5c (1) or Figure 5c The secondary screen interface layout shown in (3) cannot be switched directly to Figure 5cThe secondary screen interface layout shown in (2) is shown in Figure 2. Therefore, the switching between the three secondary screen usage scenarios of the external folding screen mobile phone mentioned above is problematic.
[0130] To solve the above problems, an embodiment of the present application provides a display method. In this method, three secondary screen display modes for external folding screen mobile phones are defined, namely rear selfie mode, versatile wallet mode, and secondary screen card mode. When an application requests an interface display on the secondary screen of an external folding screen mobile phone, the secondary screen display mode requested by the application can be indicated by relevant parameters. Moreover, when the display is switched, the related transactions are submitted uniformly to avoid the problem of screen flashing and the problem of mutual exclusion of various secondary screen states.
[0131] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present application, the Android system with a layered architecture is used as an example to illustrate the software structure of the electronic device 100.
[0132] Figure 6 It is a software structure block diagram of the electronic device 100 according to an embodiment of the present application.
[0133] The layered architecture of electronic device 100 divides the software into several layers, each with a clear role and division of labor. Layers communicate with each other via software interfaces. In some embodiments, the Android system is divided into four layers: from top to bottom, the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.
[0134] The application layer can include a series of application packages.
[0135] like Figure 6 As shown, the application package may include applications such as camera, wallet, navigation, gallery, settings, video, short message, calendar, map, music, etc.
[0136] The application framework layer provides an application programming interface (API) and programming framework for the applications in the application layer. The application framework layer includes some predefined functions.
[0137] like Figure 6 As shown, the application framework layer can include window management services, display management services, display manager, resource management services, folding screen management services, device management services, View framework, Surface Flinger, phone manager, notification manager, etc.
[0138] The Window Manager Service (WMS) manages windows, starting, adding, and removing them. It also manages the size and hierarchy of windows. It can retrieve the display size, determine whether a status bar is present, lock the screen, and take screenshots.
[0139] The Display Manager Service (DMS) is one of the system services responsible for display management. DMS can be used to manage the life cycle of the display. It determines how to control its logical display based on the currently connected physical display device, and sends notifications to the system and applications when the state changes. Among them, the Display Management Service provides an external interface through the Display Manager (DM).
[0140] The foldable screen management service can be used to manage foldable screens, such as the management of foldable screen postures (such as unfolded state, folded state, stand state, main screen state, secondary screen state, etc.).
[0141] The device state management service can be used to manage the device state switching, such as determining whether to switch the screen display. In the embodiment of the present application, the device state management service can be used to determine whether to switch from the main screen to the secondary screen.
[0142] The View framework manages views within a window and is responsible for displaying and interacting with the user interface (UI). The View framework includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface for a text notification icon might include a view for displaying text and a view for displaying images.
[0143] SurfaceFlinger is an important component of the Android system. It is responsible for drawing and rendering all graphical interfaces and applications in the display system. It is a core part of the Android graphics subsystem and is responsible for managing and operating all Surface objects (i.e., screen buffers).
[0144] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including answering, hanging up, etc.).
[0145] The notification manager enables applications to display notification information in the status bar, which can be used to convey informational messages and disappear automatically after a short stay without user interaction.
[0146] Android Runtime includes core libraries and a virtual machine. Android Runtime is responsible for scheduling and management of the Android system.
[0147] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.
[0148] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.
[0149] The system library can include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.
[0150] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.
[0151] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0152] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0153] A 2D graphics engine is a drawing engine for 2D drawings.
[0154] The kernel layer is the layer between hardware and software. The kernel layer includes at least display drivers, audio drivers, Wi-Fi drivers, sensor drivers, etc. Hardware includes at least processors, displays, Wi-Fi modules, sensors, etc.
[0155] It is understandable that Figure 6 The layers in the illustrated software structure and the components included in each layer do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer layers than shown, and each layer may include more or fewer components, or some components may be combined, some components may be separated, or the components may be arranged differently, and this application does not limit this.
[0156] It is understandable that, in order to implement the display method in the embodiment of the present application, the electronic device includes hardware and / or software modules that perform the corresponding functions. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of this application.
[0157] Scene 1
[0158] This scenario provides detailed explanations for the use of the secondary screen "rear selfie" and "secondary screen card". Among them, the camera application interface displayed on the main screen of the external folding screen mobile phone can be switched to the secondary screen, and its secondary screen display mode is "rear selfie" mode. You can refer to Figure 5c As shown in (1); the third-party application interface or system application interface displayed on the main screen of the folding screen mobile phone can also be switched to the secondary screen for display. The secondary screen display mode is the "secondary screen card" mode, which can be referred to Figure 5c As shown in (3).
[0159] like Figure 7a The following is a schematic diagram of the interaction between modules. Figure 7a Taking the "rear-mounted selfie" usage scenario as an example, the process of the display method provided in the embodiment of the present application specifically includes:
[0160] S601: In response to a user operation, the camera application sends a secondary screen display request to the folding screen management service.
[0161] For example, the user operation may be an operation that triggers the activation of the “rear selfie” function, for example Figure 3a The operation shown is to click the "switch to sub-screen" control 2011 in the camera application interface. In response to the user operation, the camera application sends a sub-screen display request to the folding screen management service.
[0162] Among them, the parameters carried by the sub-screen display request may include but are not limited to the package name of the requested application (requestPackage Name), the requested sub-screen display mode (sub Mode), the sub-screen display position (sub Position), and the current display mode (display Mode). The requested sub-screen display mode may include but is not limited to the "rear selfie" display mode, the "variable wallet" display mode, and the "sub-screen card" display mode. The current display mode may include but is not limited to the full-screen state, the main screen state, and the sub-screen state. The full-screen state refers to the state of using the entire display area of the folding screen (i.e., display areas 194-1, 194-2, and 194-3) to display the interface when the external folding screen mobile phone is in the unfolded state, the main screen state refers to the state of using the display area 194-3 of the folding screen to display the interface when the external folding screen mobile phone is in the folded state, and the sub-screen state refers to the state of using the display area 194-1 of the folding screen to display the interface when the external folding screen mobile phone is in the folded state.
[0163] In this process, Figure 3a Take the scenario shown as an example, in the secondary screen display request sent by the camera application: the package name of the requested application is "camera application package name"; the requested secondary screen display mode is "rear selfie" display mode; the secondary screen display position is as follows Figure 4a The display position of the application interface shown in (3) is, for example, that of the secondary screen, which may include the display offset of the application interface (such as the pixel offset from top to bottom of the application interface on the secondary screen); the current display mode is the main screen state.
[0164] In another possible application scenario, in response to a user operation, the camera application interface displayed on the entire folding screen of the external folding screen mobile phone switches to the secondary screen. In this case, in the secondary screen display request sent by the camera application: the package name of the requested application is "camera application package name"; the requested secondary screen display mode is "rear selfie" display mode; the secondary screen display position is as follows: Figure 4a The application interface is displayed in the position shown in (3); the current display mode is full screen. Understandably, in this case, the user needs to fold the external folding screen mobile phone and make the secondary screen of the external folding screen mobile phone face the user, so as to realize the "rear selfie" function of the external folding screen mobile phone.
[0165] S602: The folding screen management service sends a screen switching request to the device status management service.
[0166] After receiving the secondary screen display request, the Folding Screen Management Service parses the secondary screen display request and generates a screen switching request based on it, which is then sent to the Device State Management Service. The screen switching request may include, but is not limited to, the device posture, the requested secondary screen display mode, and the secondary screen display position. The device posture can be used to indicate the posture of the folding screen, such as the unfolded state, the folded state, the stand state (also known as the desk calendar state), etc.
[0167] In this process, Figure 3a Taking the scenario shown in the figure as an example, in the screen switching request sent by the folding screen management service: the device posture is folded; the requested secondary screen display mode is the "rear selfie" display mode; the secondary screen display position is as follows Figure 4a The display position of the application interface shown in (3) can, for example, include the display offset of the application interface (such as the pixel offset from top to bottom of the application interface on the secondary screen).
[0168] S603: The device state management service sends screen switching state change information to the display management service.
[0169] The screen switching status change information is used to indicate how the interface display of the external folding screen mobile phone changes. Figure 3a Taking the scenario shown as an example, the screen switching state change information is used to indicate that the interface display of the external folding screen mobile phone has switched from the main screen to the secondary screen. Exemplarily, the screen switching state change information may also include, but is not limited to, the requested secondary screen display mode (such as the "rear selfie" display mode) and the secondary screen display position.
[0170] S604: The display management service instructs the window management service to add a mask to the main screen display (or main logical display, main logical display screen, etc.).
[0171] After receiving notification of the screen switching state change from the device status management service, the display management service determines that the interface display of the external foldable screen phone has switched from the primary screen to the secondary screen. When the display management service instructs the window management service to add a mask to the primary screen display, it can also notify the window management service of the secondary screen display mode and position requested by the application.
[0172] In this embodiment, the interface display is switched from the main screen to the secondary screen based on the offset of the main screen display. In this way, the application side will not perceive the change of the display screen (or the folding screen display area), and the application side does not need to redraw the application interface, thereby improving the efficiency of interface screen switching display (such as switching the application interface from display on the main screen to display on the secondary screen).
[0173] To prevent users from noticing the shift in the primary display and improve the screen switching experience, when the display management service determines that the application interface needs to be switched from the primary screen to the secondary screen, it instructs the window management service to add a mask to the primary display. As you can see, when the primary display shifts, the mask shifts synchronously with the primary display, making the shift imperceptible to the user.
[0174] S605: The window management service adds a mask to the main screen display.
[0175] The window management service adds a mask to the primary display according to the instruction of the display management service. The size of the mask is the same as the size of the primary display. Optionally, the mask is black.
[0176] In this step, the window management service can add a mask to the main screen display and submit the transaction corresponding to the new mask to SurfaceFlinger, which executes the corresponding transaction. At this time, the user cannot see the main screen display, but can see the mask on the main screen display.
[0177] As can be understood, since the main screen size is larger than the secondary screen size, when the main screen display is offset to the secondary screen for display, the main screen display will not only cover the secondary screen area 194-1, but also cover the display area 194-2. Adding a mask to the main screen display can prevent the user from perceiving that the main screen display covers the display area 194-2.
[0178] S606: The window management service calculates the primary screen display offset according to the secondary screen display mode and secondary screen display position requested by the application, and triggers the display management service to perform the primary screen display offset setting operation.
[0179] The window management service calculates the offset of the main screen display based on the current display position of the main screen display (that is, the display position on the main screen) and the secondary screen display position requested by the application. For example, the offset of the main screen display can refer to the offset of the upper left vertex of the main screen display. Figure 7b In the "rear selfie" application scenario, the offset of the main screen display is as shown in the figure.
[0180] S607: The display management service performs a main screen display offset setting operation.
[0181] After the display management service obtains the offset of the main screen display calculated by the window management service, it performs the main screen display offset setting operation according to the offset. It should be pointed out that after the display management service performs the main screen display offset setting operation, the main screen display does not start to offset, that is, the main screen display offset does not take effect. The display management service performs the main screen display offset setting operation, which can be understood as the display management service only sets the offset of the main screen display, and the offset of the main screen display does not actually take effect. It is necessary to wait for the window management service to submit the transaction corresponding to the main screen display offset to SurfaceFlinger, and then SurfaceFlinger will perform the main screen display offset operation to make the main screen display offset truly take effect.
[0182] S608: The display management service calculates the scaling ratio of the primary screen display according to the secondary screen size, and triggers the window management service to perform a scaling operation on the primary screen display.
[0183] The display management service calculates the scaling ratio of the primary display based on the secondary screen size and the primary display size. Since the scaled primary display can fill the entire secondary screen area in the width direction, the display management service calculates the scaling ratio of the primary display based on the secondary screen width and the primary display width, and sends the scaling ratio of the primary display to the window management service.
[0184] S609: The window management service performs a scaling operation on the main screen display according to the scaling ratio.
[0185] The window management service performs a proportional scaling operation on the main screen display according to the scaling ratio. It is understandable that when the main screen display is scaled, the mask added to the main screen display is scaled simultaneously with the main screen display.
[0186] S610: The window management service performs a mask removal setting operation.
[0187] After the window management service completes the scaling operation on the primary display, it can perform the mask removal setting operation on the primary display. It should be noted that after the window management service performs the mask removal setting operation, the mask is not actually removed, that is, the mask removal on the primary display does not take effect. The window management service performing the mask removal setting operation can be understood as the window management service setting the mask attribute on the primary display to remove.
[0188] S611: The window management service adds the main screen display offset and mask removal to the same transaction and submits the transaction to SurfaceFlinger.
[0189] The window management service collects the main screen display offset settings and the mask removal settings on the main screen display, adds them to a transaction and submits them to SurfaceFlinger.
[0190] At step S612, SurfaceFlinger simultaneously implements the main screen display offset and mask removal, and returns feedback information indicating that the screen switching is complete to the folding screen management service. The folding screen management service then feeds back feedback information indicating that the screen switching is successful to the camera application.
[0191] SurfaceFlinger receives the transaction submitted by the window management service and executes the transaction, so that the main screen display position update and the main screen display mask removal are executed simultaneously. That is, when the mask is removed on the main screen display, the main screen display position update is also completed according to the offset setting. There will be no situation where the main screen display position offset is not completed after the mask is removed, and the user will not perceive similar Figure 4a The screen splash problem shown in (2) and (3).
[0192] Figure 7c The following is a diagram showing how to solve the screen flickering problem in the "rear selfie" usage scenario. Figure 7c In the schematic diagram shown, in order to clarify the switching of the interface display area, the expanded display screen is used for illustration. Figure 3a In the example shown, before the user switches the shooting preview interface of the camera application to the secondary screen, such as before clicking the "switch to secondary screen" control 2011, the camera application interface 201 is displayed on the main screen 194-3, such as Figure 7c In response to the user clicking the "switch to secondary screen" control 2011, the camera application interface is proportionally reduced and offset, and the camera application interface 203 is displayed on the secondary screen 194-1. Since the camera application interface offset (i.e., the main screen display offset) and the mask removal on the main screen display are effective at the same time, before the camera application interface 203 is displayed on the secondary screen 194-1, the user will not see the situation where the interface is improperly displayed, such as due to Figure 4a The screen flickering problem caused by the display conditions shown in (2) and (3).
[0193] In the above process, the "rear selfie" scenario is taken as an example, and the "secondary screen card" scenario is also the same, so I will not go into details here. The difference is that in the "secondary screen card" scenario, in the secondary screen display request sent by the application to the folding screen management service, the requested secondary screen display mode is the "secondary screen card" display mode, and the secondary screen display position is as follows: Figure 4c The display position of the application interface shown in (3) can, for example, include the display offset of the application interface (such as the pixel offset from top to bottom of the application interface on the secondary screen).
[0194] Figure 7d The following is a diagram showing how to solve the screen flashing problem when using the "Second Screen Card" scenario. Figure 7d In the schematic diagram shown, in order to clarify the switching of the interface display area, the expanded display screen is used for illustration. Figure 3d In the example shown, before the user switches the navigation application interface to the secondary screen, such as before performing gesture 1, the navigation application interface 401 is displayed on the main screen 194-3, such as Figure 7d In response to the user performing gesture 1, the navigation application interface is proportionally reduced and offset, and the navigation application interface 403 is displayed on the secondary screen 194-1. Since the navigation application interface offset (i.e., the main screen display offset) and the mask removal on the main screen display are effective at the same time, before the navigation application interface 403 is displayed on the secondary screen 194-1, the user will not see the situation where the interface is improperly displayed, such as due to Figure 4c The screen flickering problem caused by the display conditions shown in (2) and (3).
[0195] In the aforementioned "rear selfie" usage scenario and "secondary screen card" usage scenario, when the display screen of the application interface switches from the main screen to the secondary screen, a guidance animation may be displayed on the main screen of the external folding screen mobile phone to guide the user to flip the screen so that the secondary screen faces the user. Alternatively, when the display screen of the application interface switches from the entire folding screen (including the main screen area 194-3, the display area 194-2, and the secondary screen area 194-1) to the secondary screen, a guidance animation may be displayed on the entire folding screen of the external folding screen mobile phone to guide the user to fold the phone so that the secondary screen faces the user.
[0196] The following uses the example of displaying a boot animation on the main screen of a foldable phone to explain the boot animation display process. The boot animation is displayed based on the logical display of a virtual display (hereinafter referred to as the virtual logical display). Figure 7e (1) shows an example of the process of creating a virtual logic Display during the startup phase of an external folding screen mobile phone. Figure 7e (2) exemplarily shows the process of adding a boot animation in the virtual logic Display to display the boot animation on the main screen.
[0197] like Figure 7e As shown in (1), the process of creating a virtual logic display during the startup phase of an external folding screen mobile phone may specifically include:
[0198] S001, in response to the user's power-on operation on the external folding screen mobile phone, the display management service is started.
[0199] S002: The display management service creates a virtual display.
[0200] Exemplarily, the size of the virtual display is the same as the size of the secondary screen. Exemplarily, the initial position of the virtual display is the position of the secondary screen.
[0201] S003: The display management service instructs the LogicalDisplayMapper to create a logical display for the virtual display.
[0202] S004, LogicalDisplayMapper creates a logical display for the virtual display.
[0203] For example, LogicalDisplayMapper can create a logical display of a virtual display through the createNewLogicalDisplayLocked method.
[0204] S005, LogicalDisplayMapper creates DisplayContent.
[0205] S006, DisplayContent mounts the layer of the virtual logic display on the main screen.
[0206] Reference Figure 7e In (2), the process of the display method provided in the embodiment of the present application may further include:
[0207] S613: In response to the user operation, the camera application obtains a virtual logical display.
[0208] For example, the user operation may be an operation that triggers the activation of the “rear selfie” function, for example Figure 3a The operation shown is to click the "switch to sub-screen" control 2011 in the camera application interface. In response to the user operation, the camera application obtains the virtual logical display created during the power-on phase of the external folding screen mobile phone.
[0209] S614: The camera application adds the boot animation to the virtual logic display.
[0210] The guidance animation can be preset. The guidance animation may be different when the external folding screen phone is in different postures. For example, when the display screen of the application interface switches from the main screen to the secondary screen, that is, when the external folding screen phone is in the folded state, the guidance animation is used to instruct the user to flip the screen so that the secondary screen faces the user. For another example, when the display screen of the application interface switches from the entire folding screen to the secondary screen, that is, when the external folding screen phone is in the unfolded state, the guidance animation is used to instruct the user to fold the phone and make the secondary screen face the user.
[0211] S615, the window management service determines whether there is content in the virtual logical display each time the window is refreshed, and notifies the display management service if there is content.
[0212] Each time the window management service refreshes its window, it determines whether content has been added to the virtual logical display. In this embodiment, it specifically determines whether a boot animation has been added to the virtual logical display. If a virtual animation has been added to the virtual logical display, the display management service is notified of the addition of the boot animation to the virtual logical display. The addition of the boot animation to the virtual logical display indicates that the virtual logical display needs to be displayed.
[0213] S616: The display management service performs a setting operation to make the display area full screen.
[0214] The full-screen display area refers to setting the display area of the external foldable screen phone to the entire foldable screen area, namely the main screen area 194-3, display area 194-2, and secondary screen area 194-1. It can be understood that when the external foldable screen phone is in the folded state and the camera application is displayed on the main screen area 194-3, the display area of the external foldable screen phone is the main screen area 194-3. In order to enable the display of the guide animation on the main screen and the application interface on the secondary screen at the same time, the display management service sets the display area to the entire foldable screen area.
[0215] S617: The display management service performs a virtual logic display offset setting operation.
[0216] Optionally, the display management service performs a virtual logical display offset setting operation and a scaling setting operation. The virtual logical display setting operation is used to set the offset of the virtual logical display so that the virtual logical display can be displayed in the main screen area. The virtual logical display scaling setting operation is used to set the scaling ratio of the virtual logical display so that the size of the virtual logical display matches the size of the main screen. The scaling can be proportional or non-proportional, which is not limited in this embodiment.
[0217] This embodiment does not limit the order of S616 and S617.
[0218] It should be noted that after the display management service performs the setting operation to make the display area fullscreen, the display area is not set to foldable fullscreen, that is, the full-screen display area does not take effect. The display management service performs the setting operation to make the display area fullscreen, which can be understood as the display management service setting the range attribute value of the display area to foldable fullscreen. The range adjustment of the display area has not actually taken effect. It is necessary to wait for the display management service to submit the transaction corresponding to the full-screen display area to SurfaceFlinger, and then SurfaceFlinger will perform the full-screen display area operation to make the range adjustment of the display area truly take effect.
[0219] Similarly, after the display management service performs the virtual logical display offset setting (and / or scaling setting) operation, the virtual logical display does not start to shift (and / or scale), that is, the virtual logical display offset (and / or scaling) does not take effect. The display management service performs the virtual logical display offset setting (and / or scaling setting) operation, which can be understood as the display management service only setting the offset of the virtual logical display (and / or setting the scaling ratio of the virtual logical display), and the offset (and / or scaling) of the virtual logical display does not actually take effect. It is necessary to wait for the display management service to submit the transaction corresponding to the virtual logical display offset (and / or scaling) to SurfaceFlinger, and then SurfaceFlinger will perform the virtual display offset (and / or scaling) operation to make the virtual logical display offset (and / or scaling) truly take effect.
[0220] S618: The display management service adds the full-screen display area and the virtual logical display offset to the same transaction and submits the transaction to SurfaceFlinger.
[0221] The display management service collects virtual display offset settings and display area range settings, adds them to the same transaction and submits them to SurfaceFlinger.
[0222] At S619, SurfaceFlinger simultaneously implements full-screen display area and virtual logical display offset.
[0223] SurfaceFlinger receives the transaction submitted by the display management service and executes it, which simultaneously updates the virtual logical display position and adjusts the display area range. That is, the display area is adjusted at the same time as the virtual logical display shifts. This prevents the display area from being adjusted after the virtual logical display shifts, and prevents the boot animation from failing to display due to a mismatch in the display area settings.
[0224] When the boot animation is finished, or when the boot animation reaches a preset duration (for example, 3 seconds), the virtual logic display can be offset back to the secondary screen position, and the display area of the external folding screen mobile phone can be reset to the secondary screen area.
[0225] Scene 2
[0226] This scenario explains the use of the "Variety Wallet" on the secondary screen in detail. After the main screen display of the folding screen phone is switched to the secondary screen, the interface of the Variety Wallet can be displayed on the secondary screen. The secondary screen display mode is the "Variety Wallet" mode. Figure 5c As shown in (2).
[0227] Unlike the "Rear Selfie" and "Secondary Screen Card" scenarios in Scenario 1, the Wallet app isn't launched until the main screen of the foldable phone switches to the secondary screen. The Wallet app launches after the main screen switches to the secondary screen, and the Wallet app interface is then displayed on the secondary screen.
[0228] like Figure 8a The following is a schematic diagram of the interaction between modules. Figure 8a The process of the display method provided in the embodiment of the present application specifically includes:
[0229] S701, in response to a user operation, the desktop application sends a secondary screen display request to the folding screen management service.
[0230] For example, the user operation may be an operation that triggers the activation of the "Various Wallet" function, for example Figure 3b The operation of clicking the versatile wallet card 3011 is shown. Figure 3c The operation of pressing the power key 190-1 is shown. In response to the user operation, the desktop application sends a secondary screen display request to the folding screen management service.
[0231] In this scenario, the parameters carried in the sub-screen display request may include but are not limited to the requested application package name (request Package Name), the requested sub-screen display mode (sub Mode), the sub-screen display position (subPosition), and the current display mode (display Mode).
[0232] In this process, Figure 3b or Figure 3c Taking the scenario shown in the figure as an example, in the secondary screen display request sent by the desktop application, the package name of the requested application is "the package name of the desktop application"; the secondary screen display mode requested is the "variable wallet" display mode; the secondary screen display position is as follows Figure 4b The application interface display position shown in (3) is as follows; the current display mode is the main screen state.
[0233] In this scenario, when the requested secondary screen display mode is the "Various Wallet" display mode, the parameters carried in the secondary screen display request may also include the package name of the application to be launched and the name of the application's activity. Figure 3b or Figure 3c In the scenario shown, the package name of the application to be launched is the package name of the "Baibian Wallet" application, as well as the corresponding Activity name of the "Baibian Wallet" application.
[0234] S702: The folding screen management service sends a screen switching request to the device status management service.
[0235] In this process, Figure 3b or Figure 3c Taking the scenario shown as an example, in the screen switching request sent by the folding screen management service: the device posture is folded; the requested secondary screen display mode is the "Various Wallet" display mode; the secondary screen display position is as follows Figure 4b The application interface shown in (3) is displayed at the location.
[0236] S703: The device state management service sends screen switching state change information to the display management service.
[0237] In this process, Figure 3b or Figure 3c Taking the scenario shown as an example, the screen switching state change information can be used to indicate that the interface display of the external folding screen mobile phone has switched from the main screen to the secondary screen. For example, the screen switching state change information may also include, but is not limited to, the requested secondary screen display mode (such as the "Various Wallet" display mode) and the secondary screen display position.
[0238] S704: The display management service instructs the window management service to add a mask to the main screen display.
[0239] S705: The window management service adds a mask to the main screen display.
[0240] The window management service adds a mask to the primary display according to the instruction of the display management service. The size of the mask is the same as the size of the primary display. Optionally, the mask is black.
[0241] In this step, the window management service can add a mask to the main screen display and submit the transaction corresponding to the new mask to SurfaceFlinger. SurfaceFlinger then handles the transaction. At this point, the user cannot see the main screen display, but can only see the mask on the main screen display.
[0242] As can be understood, since the main screen size is larger than the secondary screen size, when the main screen display is offset to the secondary screen for display, the main screen display will not only cover the secondary screen area 194-1, but also cover the display area 194-2. Adding a mask to the main screen display can prevent the user from perceiving that the main screen display covers the display area 194-2.
[0243] S706, the window management service calculates the main screen display offset according to the secondary screen display mode and secondary screen display position requested by the application, sets the main screen display size to be the same as the secondary screen size, and triggers the display management service to perform the main screen display offset setting operation.
[0244] S707: The display management service performs a main screen display offset setting operation.
[0245] Among them, the main screen display offset setting is used to set the display position of the main screen display to the secondary screen area.
[0246] S708, the window management service submits the main screen display offset transaction to SurfaceFlinger.
[0247] S709, SurfaceFlinger executes the main screen display offset transaction and returns feedback information of screen switching completion to the folding screen management service, and then the folding screen management service feeds back feedback information of screen switching success to the desktop application.
[0248] S710, the foldable screen management service launches the versatile wallet application.
[0249] After receiving the screen switching completion information from SurfaceFlinger, the Folding Screen Management Service determines that the main screen display has been switched from the main screen to the secondary screen. Then, the Folding Screen Management Service starts the Variety Wallet application.
[0250] S711, the folding screen management service instructs the View framework to draw the Activity of the Variety Wallet application.
[0251] The Activity of the Variety Wallet application mentioned here is the application Activity carried in the secondary screen display request in S701.
[0252] S712, after the View framework completes the Activity of the Variety Wallet application, it notifies the window management service.
[0253] S713: The window management service performs a mask removal setting operation and submits a mask removal transaction to SurfaceFlinger.
[0254] After receiving the notification that the Activity of the Wallet application has been drawn, the window management service removes the mask on the main screen display and submits the mask removal transaction to SurfaceFlinger.
[0255] S714, SurfaceFlinger performs the mask removal transaction.
[0256] SurfaceFlinger performs the mask removal transaction to remove the mask on the main screen display. The interface of the Variety Wallet application is displayed on the main screen display. You can refer to Figure 3b (3) or Figure 3c As shown in (2).
[0257] When SurfaceFlinger performs the mask removal transaction, the activity of the Variety Wallet application has been drawn. Then, after the mask on the main screen display is removed, the user can see the Variety Wallet interface displayed on the secondary screen, and there will be no problem of incomplete position offset of the main screen display after the mask is removed, and the user will not feel similar Figure 4b The screen splash problem shown in (2) and (3).
[0258] For details not explained in this process, please refer to Scenario 1 and will not be repeated here.
[0259] Figure 8b The following is a diagram showing how to solve the screen flashing problem when using the "Baibian Wallet". Figure 8b In the schematic diagram shown, in order to clarify the switching of the interface display area, the expanded display screen is used for illustration. Figure 3b or Figure 3cIn the example shown, before the user starts the Variety Wallet function, such as before clicking the Variety Wallet card 3011, or before pressing the power button 190-1, the desktop application interface (such as the interface 301 where the Variety Wallet card is located) is displayed on the main screen 194-3, as shown in FIG. Figure 7c In response to the user clicking the "switch to secondary screen" control 2011, the camera application interface is proportionally reduced and offset, and the camera application interface 203 is displayed on the secondary screen 194-1. Since the camera application interface offset (i.e., the main screen display offset) and the mask removal on the main screen display are effective at the same time, before the camera application interface 203 is displayed on the secondary screen 194-1, the user will not see the situation where the interface is improperly displayed, such as due to Figure 4a The screen flickering problem caused by the display conditions shown in (2) and (3).
[0260] In the "Various Wallet" usage scenario, when the display screen of the application interface switches from the main screen to the secondary screen, a guide animation may also be displayed on the main screen of the external folding screen mobile phone to guide the user to flip the screen so that the secondary screen faces the user. Alternatively, when the display screen of the application interface switches from the entire folding screen (including the main screen area 194-3, the display area 194-2 and the secondary screen area 194-1) to the secondary screen, a guide animation may also be displayed on the entire folding screen of the external folding screen mobile phone to guide the user to fold the phone so that the secondary screen faces the user. Similar to scenario one, the guide animation is also displayed based on the virtual logic display. For the process of creating a virtual logic display during the startup phase of an external folding screen mobile phone, and the process of adding a guide animation to the virtual logic display to display the guide animation on the main screen, please refer to Figure 7e and with Figure 7e The relevant explanations will not be repeated here.
[0261] Scenario 3
[0262] The three aforementioned secondary screen display modes (i.e., "Rear Selfie," "Secondary Screen Card," and "Various Wallet") may also switch between them. This embodiment does not limit the method for switching between any two secondary screen display modes. The following explanation uses the switching of the secondary screen display mode from "Rear Selfie" mode or "Secondary Screen Card" mode to "Various Wallet" mode as an example.
[0263] like Figure 9a The following is a schematic diagram of the interaction between modules. Figure 9a The process of the display method provided in the embodiment of the present application specifically includes:
[0264] S801, in response to a user operation, the desktop application sends a secondary screen display request to the folding screen management service.
[0265] For example, the external folding screen mobile phone is in the folded state, the secondary screen display mode is "secondary screen card" or "rear selfie", and the user presses the power button 190-1. In response to the user operation, the desktop application sends a secondary screen display request to the folding screen management service.
[0266] In this scenario, the parameters carried in the sub-screen display request may include but are not limited to the requested application package name (request Package Name), the requested sub-screen display mode (sub Mode), the sub-screen display position (subPosition), and the current display mode (display Mode).
[0267] In this process, in the secondary screen display request sent by the desktop application, the package name of the requested application is "the package name of the desktop application"; the requested secondary screen display mode is the "variable wallet" display mode; the secondary screen display position is as follows: Figure 4b The application interface display position shown in (3) is the main screen state. Since the requested secondary screen display mode is the "Baibian Wallet" display mode, the parameters carried by the secondary screen display request may also include the package name of the application to be launched (such as the package name of the "Baibian Wallet" application) and the application's Activity name (such as the Activity name of the "Baibian Wallet" application).
[0268] S802: The folding screen management service sends a screen switching request to the device status management service.
[0269] S803: The device state management service sends screen switching state change information to the display management service.
[0270] Different from scenarios one and two, the screen switching state change information in this case can be used to indicate a change in the secondary screen display mode of the outer folding screen, for example, from the "Secondary Screen Card" or "Rear Selfie" display mode to the "Various Wallet" display mode. Exemplarily, the screen switching state change information may also include, but is not limited to, the requested secondary screen display mode (such as the "Various Wallet" display mode) and the secondary screen display position.
[0271] S804: The display management service instructs the window management service to add a mask for the secondary screen.
[0272] In this scenario, when the desktop application requests to launch the "Baibian Wallet" app on the secondary screen, the Display Management Service learns from the screen switching state change information sent by the Device State Management Service that the foldable phone is currently in secondary display mode, which differs from the secondary display mode requested by the desktop application. At this point, the Display Management Service can instruct the Window Management Service to add a mask to the secondary screen area to prevent the user from perceiving the size change of the primary screen displayed on the secondary screen.
[0273] S805: The window management service adds a mask to the secondary screen area.
[0274] The window management service adds a mask to the secondary screen area according to the instruction of the display management service. The size of the mask is the same as the size of the secondary screen, and the color of the mask can be black.
[0275] In this step, the window management service can add a mask to the secondary screen area and submit the transaction corresponding to the new mask to SurfaceFlinger, which executes the corresponding transaction. At this time, the user cannot see the main screen display displayed in the secondary screen area, but can only see the mask on the secondary screen area.
[0276] S806: The window management service sets the size of the primary screen display to be the same as the size of the secondary screen.
[0277] When the secondary screen display mode requested by the application is different from the current secondary screen display mode of the external folding screen mobile phone, the window management service needs to adjust the size of the main screen display to match the requested secondary screen display mode.
[0278] In this scenario, the requested secondary screen display mode is "Baibian Wallet." Therefore, the window management service adjusts the primary screen's display size to match the secondary screen's, allowing the Baibian Wallet app interface to display full screen on the secondary screen. From the user's perspective, they only see the mask and are unaware of the screen flickering caused by the primary screen size change.
[0279] In this step, the window management service can submit the transaction related to setting the main screen display size to SurfaceFlinger, and SurfaceFlinger executes the corresponding transaction to complete the adjustment of the main screen display size. Then, SurfaceFlinger can return feedback information of screen switching completion to the folding screen management service, and the folding screen management service can return feedback information of successful screen switching to the desktop application.
[0280] S807, the foldable screen management service starts the versatile wallet application.
[0281] After receiving the screen switching completion information from SurfaceFlinger, the Folding Screen Management Service determines that the main screen display has been switched from the main screen to the secondary screen. Then, the Folding Screen Management Service starts the Variety Wallet application.
[0282] S808: The folding screen management service instructs the View framework to draw the Activity of the Variety Wallet application.
[0283] The Activity of the Variety Wallet application mentioned here is the application Activity carried in the secondary screen display request in S801.
[0284] S809, after the View framework completes the Activity of the Variety Wallet application, it notifies the window management service.
[0285] S810: The window management service performs a mask removal setting operation and submits a mask removal transaction to SurfaceFlinger.
[0286] After the window management service receives the notification that the activity of the Wallet application is drawn, it removes the mask on the secondary screen area (that is, the main screen display) and submits the mask removal transaction to SurfaceFlinger.
[0287] S811, SurfaceFlinger performs mask removal transaction.
[0288] SurfaceFlinger performs the mask removal transaction, removes the mask on the main screen display, and displays the interface of the Variety Wallet application in full screen area on the secondary screen. You can refer to Figure 3b (3) or Figure 3c As shown in (2).
[0289] When SurfaceFlinger performs the mask removal transaction, the activity of the Variety Wallet application has been drawn. Then, after the mask on the main screen display is removed, the user can see the Variety Wallet interface displayed in full screen on the secondary screen, and there will be no situation where the Variety Wallet interface is not displayed in full screen on the secondary screen, that is, there will be no similar Figure 5a Medium (2) or Figure 5b The problem of inappropriate display area shown in (2) is.
[0290] Figure 9b The example shows a schematic diagram of a scenario in which the secondary screen display mode switches from the "rear selfie" mode to the "variable wallet" mode. Figure 9c The example shows a schematic diagram of the scene where the secondary screen display mode switches from the "secondary screen card" mode to the "variable wallet" mode. Figure 5a and Figure 9b , and contrast Figure 5b and Figure 9c The method provided in this embodiment can flexibly switch between different secondary screen display modes without the problem of mutual exclusion between various secondary screen display modes.
[0291] This embodiment further provides a computer storage medium, in which computer instructions are stored. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the display method in the above-mentioned embodiment.
[0292] This embodiment further provides a computer program product. When the computer program product is run on a computer, it enables the computer to execute the above-mentioned related steps to implement the display method in the above-mentioned embodiment.
[0293] In addition, an embodiment of the present application also provides a device, which can specifically be a chip, component or module, and the device may include a connected processor and memory; wherein the memory is used to store computer-executable instructions, and when the device is running, the processor can execute the computer-executable instructions stored in the memory to enable the chip to execute the display method in the above-mentioned method embodiments.
[0294] Among them, the electronic devices (such as mobile phones, etc.), computer storage media, computer program products or chips provided in this embodiment are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.
[0295] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be distributed and completed by different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0296] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of modules or units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0297] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the above embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
Claims
1. A display method, characterized in that: Applied to an external folding screen device, the external folding screen device includes a flexible screen, the flexible screen is divided into a first screen and a second screen after being folded outward along a rotation axis, and the size of the first screen is larger than the size of the second screen; the method includes: The main logical display of the external folding screen device is located on the first screen, and the content of the main logical display is the first interface of the first application; In response to a first operation, the first application generates a first request, the first request including a target mode, the target mode being used to indicate a display position of the application interface on the second screen after switching from the first screen to the second screen; wherein the first operation is used to switch the display screen of the external folding screen device from the first screen to the second screen when the external folding screen device is in a folded state; In response to the first request, adding a mask on the main logic display; the mask is used to make the main logic display invisible; Setting an offset of the main logic display according to the target mode, and adjusting a size of the main logic display according to the target mode; wherein the offset is used to shift the main logic display from the first screen to the second screen; Adding offsetting the main logic display and removing the mask on the main logic display to the first transaction; The first transaction is executed, and the main logic display is displayed on the second screen according to the target mode. The content of the main logic display is the second interface of the first application.
2. The method according to claim 1, characterized in that The target modes include: The first mode is used to indicate that the application interface is scaled proportionally and displayed in the center of the second screen; The second mode is used to indicate that the application interface is scaled proportionally and displayed at the bottom of the second screen.
3. The method according to claim 1, characterized in that Also includes: In response to the first operation, the first application adds a first boot animation to a virtual logic display; wherein the virtual logic display is located on the second screen; When it is determined that there is content in the virtual logical display, setting an offset of the virtual logical display, wherein the offset is used to shift the virtual logical display from the second screen to the first screen; Adding the offset virtual logical display and the full-screen display area to the second transaction; The second transaction is executed, the virtual logic display is displayed on the first screen, and the first boot animation is played on the virtual logic display.
4. The method according to any one of claims 1 to 3, characterized in that Also includes: The main logic display of the external folding screen device is located on the first screen, and the content of the main logic display is the interface of the second application; In response to the second operation, the second application generates a second request, where the second request includes a third mode, an identifier of a target application, and an identifier of a target activity of the target application, where the third mode is used to indicate a display mode of the interface of the target application on the second screen; In response to the second request, adding a mask on the main logic display; setting the offset of the main logic display according to the third mode, and adjusting the size of the main logic display according to the third mode; Add the offset of the main logic display to the third transaction and execute the third transaction; Starting the target application, and when the target Activity of the target application is drawn, adding removing the mask on the main logic display to a fourth transaction; The fourth transaction is executed, and the main logic display is displayed on the second screen according to the third mode, and the content of the main logic display is the interface of the target application.
5. The method according to claim 4, characterized in that The third mode is used to instruct the application interface to be displayed in full screen on the second screen.
6. The method according to claim 4 or 5, characterized in that Also includes: In response to the second operation, the second application adds a second boot animation to a virtual logic display; wherein the virtual logic display is located on the second screen; When it is determined that there is content in the virtual logical display, setting an offset of the virtual logical display, wherein the offset is used to shift the virtual logical display from the second screen to the first screen; Adding the offset virtual logic display and the full-screen display area to the fifth transaction; The fifth transaction is executed, the virtual logic display is displayed on the first screen, and the second boot animation is played on the virtual logic display.
7. The method according to any one of claims 1 to 6, characterized in that Also includes: The main logic display of the external folding screen device is located on the second screen, and the content of the main logic display is the interface of the third application; The display mode of the interface of the third application on the second screen is the target mode; In response to the third operation, the fourth application generates a third request, wherein the third request includes a third mode, an identifier of a target application, and an identifier of a target activity of the target application, wherein the third mode is used to indicate a display mode of the interface of the target application on the second screen; In response to the third request, adding a mask on the second screen; adjusting the main logic display according to the third mode; Starting the target application, and when the target Activity of the target application is drawn, adding removing the second on-screen mask to a sixth transaction; The sixth transaction is executed, and the main logic display is displayed on the second screen according to the third mode, and the content of the main logic display is the interface of the target application.
8. The method according to claim 1, characterized in that The external folding screen device includes a camera disposed opposite to the flexible screen, and after the flexible screen is folded along the hinge, the second screen and the camera are located on the same side of the external folding screen device; The first application is a camera application, and the images in the first interface and the second interface are captured by the camera.
9. An external folding screen device, characterized in that: include: one or more processors; Memory; And one or more computer programs, wherein the one or more computer programs are stored on the memory, and when the computer programs are executed by the one or more processors, the external folding screen device performs the display method as described in any one of claims 1-8.
10. A computer-readable storage medium comprising a computer program, characterized in that When the computer program is executed on an electronic device, the electronic device is enabled to execute the display method according to any one of claims 1 to 8.
Citation Information
Patent Citations
Compensation method and electronic equipment
CN112825232A
Adaptive interface display method and terminal equipment
CN116680023A