Screen display method and electronic device
Through the collaborative function of the inner and outer screens, the service code or interface is displayed on the outer screen using the quick service window, which solves the problem of inconvenience in operating the folding screen device when displaying the screen, and improves the convenience of scanning codes and screen sharing and user experience.
Patent Information
- Application Number
- CN202111606004.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-25
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2041-12-25
AI Technical Summary
When folding screen devices need to display the screen, larger devices are inconvenient to operate, which affects the user experience, especially when scanning the code to pay or sharing the screen, resulting in cumbersome operation.
Provide a screen display method, which uses the collaborative function of the inner and outer screens to display the service code or interface to be displayed on the outer screen through the quick service window. Users can scan the code without turning over the device, and continue to use other services on the inner screen. application.
It improves the convenience and user experience of scanning codes, avoids the inconvenience caused by device flip, protects user privacy and simplifies the screen sharing process.
Smart Images

Figure CN116339568B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of electronic technology, and in particular to a screen display method and electronic equipment. Background Art
[0002] With the rapid development of electronic technology, the forms of terminal devices are becoming more and more diverse. Terminal devices with foldable screens, i.e. foldable screen devices, have the advantages of large screens and good display effects and are favored by many users.
[0003] In order to meet the needs of users in various usage scenarios, some folding screen devices are equipped with two screens, one of which is a foldable inner screen, that is, a folding screen. Users can unfold the inner screen for use when watching videos or playing games. When the user is not using the inner screen, the folding screen device can be folded for easy carrying, and the inner screen will be folded up. The other screen is the outer screen, which is usually smaller than the inner screen. When the user folds the folding screen device, the inner screen will be folded up, and the outer screen will be exposed to the outside, so that the user can directly operate the outer screen to use the folding screen device without unfolding the inner screen. For example, the user can operate the outer screen to answer or make calls, check messages, etc. Usually, when the user unfolds the inner screen of the folding screen device, the folding screen device will think that the user needs to use the inner screen at this time, so the outer screen will automatically turn off.
[0004] However, when the user needs to display the screen, such as displaying a payment code to make a payment, or sharing photos or videos with others, the folding screen device needs to be flipped so that the inner screen faces the display object. This is inconvenient to operate for larger folding screen devices and affects the user experience. Summary of the invention
[0005] The present application provides a screen display method, device, chip, electronic device, computer-readable storage medium and computer program product, which can improve portability of use.
[0006] In a first aspect, a screen display method is provided, which is applied to an electronic device, wherein the electronic device includes a first screen and a second screen, and the first screen and the second screen are respectively arranged on opposite sides of the electronic device, including: receiving a first operation performed by a user; in response to the first operation, displaying a first interface on the first screen, wherein the first interface includes a first control; receiving a second operation of the user on the first control; and in response to the second operation, displaying a second interface corresponding to the first control on the second screen.
[0007] For example, the first screen is the inner screen, the second screen is the outer screen, the first interface is the window of the quick service, and the first control is the service control in the window of the quick service. The user can perform the first operation on the inner screen, such as clicking the icon of the quick service on the desktop to open the window of the quick service. Optionally, the user can also perform the first operation on the outer screen, such as double-clicking the outer screen or tapping the outer screen with two fingers to open the window of the quick service. In response to the above first operation, the outer screen can display the following Figure 4 The window of the quick service shown in Figure d in the figure. Among them, the window of the quick service may include one or more service controls, each service control corresponds to an application (application, APP) or a setting page of an APP, for example, a payment service control may correspond to a payment APP, or may correspond to the payment code page of the payment APP. Optionally, the service control in the window of the quick service may include a control corresponding to the APP that the user needs to call quickly. Through the window of the quick service, the electronic device receives a second operation performed by the user, and the second operation is an operation of clicking the first control to be displayed from at least one service control in the window of the quick service. In some implementations, the operation permission of the external screen may be in a closed state to prevent privacy leakage or information loss caused by misoperation by others, and the user may perform the second operation on the inner screen. In some implementations, the operation permission of the external screen may be in an open state, and others may perform the second operation on the external screen to select the first control, so as to select the service code to be displayed as needed with the permission of the owner, so it is more convenient to use. In response to the second operation, the electronic device displays the service code corresponding to the first control on the external screen. For example, when the first control selected by the user is a control of a payment app, the corresponding service code may be a payment code; when the first control selected by the user is a control of a personal health app, the corresponding service code may also be a personal health code; when the first control selected by the user is a control of a ride app, the corresponding service code may be a ride code. It should be noted that the service code here may be in the form of a barcode, a QR code, etc., and this application does not limit the specific form of the service code.
[0008] In the above method, the electronic device can display the interface of the quick service on the external screen based on the user's first operation, and then display the service code corresponding to the first control selected by the user through the external screen when triggered by the second operation. This can avoid the inconvenience caused by the user flipping the electronic device to scan the code, making the scanning operation more convenient and quick.
[0009] In one possible implementation, receiving a first operation performed by a user includes: receiving the first operation when the first screen displays a third interface, and the third interface is one of the following interfaces: a lock screen interface, an always on display (AOD) interface, a desktop, and an interface of a first APP.
[0010] When the user is viewing the interface of the first APP displayed on the inner screen, for example, when the user is browsing the content of a novel displayed on the browser, if the user needs to scan the code to pay or scan the code to take a ride, the first operation can be performed to open the quick service window, and the second operation can be performed in the quick service window to make the external screen display the service code that needs to be displayed, so that the user can use the external screen to scan the code without turning over the electronic device. Since the external screen only displays the service code, there is no need to display the first interface of the first APP to other people or devices, which protects the user's information from being leaked. The user can also scan the code while using the first APP uninterruptedly, which protects the user's privacy and improves the user's scanning experience.
[0011] In a possible implementation, the first APP is any one of a browser APP, a video APP, a game APP, a conference APP, a document APP, and a video call APP. The user can display the service code to be displayed on the external screen by operating the electronic device without affecting the user's use of any of the above-mentioned browser APP, video APP, game APP, conference APP, document APP, and video call APP on the internal screen, thereby improving the user's code scanning experience.
[0012] In a possible implementation, the first operation is sliding down the first screen to start the drop-down taskbar and clicking the control of the quick service in the drop-down taskbar. When the user is using the inner screen, the user can slide down at the top of the inner screen to start the drop-down taskbar, and click the control of the quick service in the drop-down taskbar to open the quick service window. This method is more accurate and will not cause misoperation.
[0013] In a possible implementation, the first operation is a double-click operation on the second screen. The user can also perform a double-click operation on the external screen to light up the external screen and open the first interface (for example, a window of a quick service) on the external screen, so that the first interface can be opened by a quick operation such as double-clicking the external screen without precise operation of the inner screen, making the operation more flexible and convenient.
[0014] In a possible implementation, the first interface includes: at least one of a payment code control, a ride code control, and a personal health code control. Payment codes, ride codes, and personal health codes are service codes that are used frequently. By storing one or more of these service codes in the first interface (i.e., the quick service window), the number of times users manually open the APP to open the service code can be significantly reduced, thereby improving the user experience.
[0015] In one possible implementation, the first interface is a window for a quick service, and the method further includes: receiving a third operation performed by a user, the third operation being an operation of clicking a second control in the first interface; in response to the third operation, displaying an APP management list in the first screen, the APP management list including multiple icons of APPs supporting quick services and multiple status buttons, and the multiple icons of APPs supporting quick services correspond one-to-one to the multiple status buttons; receiving a fourth operation performed by a user, the fourth operation being an operation performed on a target status button, the target status button being any one of the status buttons; in response to the fourth operation, adding or deleting an icon of an APP supporting quick services corresponding to the target status button in the quick service window.
[0016] The second control may be a menu control or an edit control. The user may open the APP management list by operating the menu control in the quick service window, and then manage the service controls in the quick service window by operating the status button corresponding to the icon of the APP that supports the quick service in the APP management list. This method enables the user to manage the types of service controls in the quick service window by himself, so that the operation of calling the service code through the quick service window can meet the personalized needs of different users, thereby improving the user experience.
[0017] In a second aspect, a screen display method is provided, which is applied to an electronic device, wherein the electronic device includes a first screen and a second screen, and the first screen and the second screen are respectively arranged on opposite sides of the electronic device, including: displaying a third interface on the first screen, wherein the third interface is an interface of a first application APP; receiving a fifth operation performed by a user, wherein the fifth operation is an operation of opening a collaborative function of the first screen and the second screen; and in response to the fifth operation, displaying the interface of the first APP displayed on the first screen on the second screen.
[0018] Taking the first screen as the inner screen and the second screen as the outer screen as an example, when the user uses the first APP, the electronic device can display the third interface of the first APP on the inner screen. This application does not limit the type of the first APP, and may include but is not limited to any one of a browser APP, a video APP, a game APP, a conference APP, a document APP, and a video call APP. The first interface of the above-mentioned first APP can be an interface displayed by a game APP, a video playback interface displayed by a video APP, or an interface of document content displayed by a document APP, which is not limited here. When the user needs to scan the code, the fifth operation of opening the collaborative function of the first screen and the second screen (such as the collaborative function of the inner screen and the outer screen) can be performed, such as the user clicking the start button of the collaborative function on the desktop, or sliding down the taskbar from the inner screen and clicking the control of the external screen collaboration in the drop-down taskbar. At this time, the electronic device can display the first interface displayed on the inner screen on the outer screen under the triggering of the user's fifth operation. When the user continues to operate the first APP on the inner screen, the outer screen can continue to follow the inner screen to display the interface of the first APP displayed on the inner screen. For example, when the inner screen displays the first interface of thumbnails of pictures in the gallery, if the user performs the fifth operation, the outer screen displays thumbnails of pictures in the gallery displayed on the inner screen. At this time, if the user clicks on one of the pictures on the inner screen to display an enlarged picture of the picture, the outer screen synchronously displays the enlarged picture of the picture displayed on the inner screen.
[0019] In the above method, the electronic device can start the collaborative function of the first screen and the second screen when the user executes the fifth operation, that is, the outer screen displays the content displayed on the inner screen, so that the interface of the first APP can be displayed to other users for viewing without flipping the electronic device, avoiding the inconvenience caused by flipping the electronic device to share the screen, making screen sharing more convenient, and improving the user's screen sharing experience.
[0020] In one possible implementation, when the mode of the collaborative function is an asynchronous collaborative mode, the method also includes: receiving a sixth operation performed by the user, the sixth operation being an operation of opening the second APP on the first screen; in response to the sixth operation, displaying the interface of the second APP on the first screen, and displaying the interface of the first APP in the form of a floating window on the first screen.
[0021] When the user turns on the collaboration function, if the asynchronous collaboration mode is selected, the external screen may display content that is not exactly the same as the internal screen. That is, when the user starts the asynchronous collaboration mode when the internal screen displays the interface of the first APP, when the user operates the internal screen to open the second APP, that is, performs the sixth operation, the internal screen displays the interface of the second APP. At this time, the external screen still displays the interface of the first APP, and the interface of the first APP can be displayed in a floating window on the internal screen to prompt the user of the content displayed on the external screen. In this implementation method, after turning on the collaboration function of the asynchronous collaboration mode, the user can keep the external screen displaying the interface of the first APP, and can use the second APP on the internal screen. At the same time, the user can also monitor the demonstration of the first APP through the interface of the first APP displayed in the floating window of the inner screen, which makes the form of screen sharing richer, while enriching the functions of electronic devices, facilitating user use and improving user experience.
[0022] In a possible implementation, the fifth operation is sliding down in the first screen to start a drop-down taskbar and clicking a control for external screen collaboration in the drop-down taskbar, and selecting an asynchronous collaboration operation in a pop-up external screen collaboration selection window.
[0023] That is, when the user slides down on the top of the inner screen, a drop-down taskbar can be pulled out. The drop-down taskbar includes controls for external screen collaboration. When the user clicks on the external screen collaborative control or clicks on the menu button of the external screen collaborative control, the inner screen can pop up the external screen collaborative selection window. The external screen collaborative selection window may include asynchronous collaborative controls. When the user clicks on the asynchronous collaborative control, the electronic device starts the asynchronous collaborative mode of the collaborative function. Optionally, the external screen collaborative selection window may also include a mirror collaborative control. If the user clicks on the mirror collaborative control, the electronic device starts the mirror collaborative mode of the collaborative function. Users can select different collaborative function modes as needed to adapt to the current usage scenario.
[0024] In a possible implementation, the sixth operation is an operation of exiting the interface of the first APP and opening the second APP from the desktop on the first screen; or, an operation of calling the sidebar and clicking the icon of the second APP in the sidebar on the first screen.
[0025] In one possible implementation, when the mode of the collaborative function is a mirror collaborative mode, the method also includes: receiving a seventh operation performed by the user, the seventh operation being an operation of operating the first APP on the first screen; in response to the seventh operation, synchronously displaying the content indicated by the seventh operation on the first screen and the second screen.
[0026] When the user turns on the collaborative function, if the mirror collaborative mode is selected, the external screen can display the same content as the internal screen. In this method, after turning on the collaborative function of the mirror collaborative mode, the user can keep the external screen and the internal screen the same interface to achieve screen sharing, without the need to adjust the inconvenience of flipping the electronic device caused by multiple people watching the same screen. This method makes screen sharing more convenient and improves the user experience.
[0027] In a possible implementation, the fifth operation is sliding down in the first screen to start the drop-down taskbar and clicking the external screen collaboration control in the drop-down taskbar, and selecting the mirror collaboration operation in the pop-up external screen collaboration selection window.
[0028] In a possible implementation, the first APP is any one of a gallery APP, a video APP, and a document APP. The user can share the interface of the gallery APP, video APP, document APP, etc. to the external screen by turning on the collaborative function of the inner screen and the external screen, which facilitates the user to share pictures, videos, documents, etc.
[0029] In one possible implementation, when the first APP is a video APP, the second APP is a camera APP. When parents want to take pictures of their children but are afraid that their children's lack of concentration will affect the shooting effect, they can open the video APP and turn on the asynchronous collaboration mode to share the interface of the video APP to the external screen to attract the child's attention. Then the parents open the camera APP to shoot, which can ensure that the child's attention is directed to the electronic device being shot, making it convenient for users to shoot the child and ensuring the shooting effect.
[0030] In a third aspect, a screen display device is provided, comprising a unit composed of software and / or hardware, wherein the unit is used to execute any one of the methods in the technical solutions described in the first aspect or the second aspect.
[0031] In a fourth aspect, an electronic device is provided, comprising a first screen and a second screen, wherein the first screen and the second screen are respectively arranged on opposite sides of the electronic device, and further comprising: a processor, a memory and an interface; the processor, the memory and the interface cooperate with each other so that the electronic device executes any one of the methods in the technical solutions described in the first aspect or the second aspect.
[0032] In a fifth aspect, a chip is provided, comprising a processor; the processor is used to read and execute a computer program stored in a memory to execute any one of the methods in the technical solutions described in the first aspect or the second aspect.
[0033] Optionally, the chip also includes a memory, and the memory is connected to the processor via a circuit or wire.
[0034] Further optionally, the chip also includes a communication interface.
[0035] In a sixth aspect, a computer-readable storage medium is provided, in which a computer program is stored. When the computer program is executed by a processor, the processor executes any one of the methods in the technical solutions described in the first aspect or the second aspect.
[0036] In a seventh aspect, a computer program product is provided, the computer program product comprising: a computer program code, when the computer program code is run on an electronic device, the electronic device executes any one of the methods in the technical solutions described in the first aspect or the second aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0037] Figure 1 is a schematic diagram of the structure of a terminal device 100 provided in an embodiment of the present application;
[0038] Figure 2 is a software structure block diagram of the terminal device 100 provided in an embodiment of the present application;
[0039] Figure 3 This is a schematic diagram of a scenario in which an external screen is used to scan a code, provided in an embodiment of the present application;
[0040] Figure 4 is a schematic diagram of an interface displayed on an inner screen and an outer screen provided in an embodiment of the present application;
[0041] Figure 5 This is another example of a schematic diagram of an interface displayed on an inner screen and an outer screen provided in an embodiment of the present application;
[0042] Figure 6 This is another example of a schematic diagram of an interface displayed on an inner screen and an outer screen provided in an embodiment of the present application;
[0043] Figure 7 This is another example of a screen display method flow interactive diagram provided in an embodiment of the present application;
[0044] Figure 8 This is another example of a schematic diagram of an interface displayed on an inner screen and an outer screen provided in an embodiment of the present application;
[0045] Fig. 9 This is another example of a schematic diagram of an interface displayed on an inner screen and an outer screen provided in an embodiment of the present application;
[0046] Fig.10 is a flow chart of another screen display method provided in an embodiment of the present application;
[0047] Fig.11is a scene schematic diagram of another screen display method provided in an embodiment of the present application;
[0048] Fig.12 This is another example of a schematic diagram of an interface displayed on an inner screen and an outer screen provided in an embodiment of the present application;
[0049] Fig.13 This is another example of a schematic diagram of an interface displayed on an inner screen and an outer screen provided in an embodiment of the present application;
[0050] Fig.14 This is another example of a schematic diagram of an interface displayed on an inner screen and an outer screen provided in an embodiment of the present application;
[0051] Fig.15 This is another example of a schematic diagram of an interface displayed on an inner screen and an outer screen provided in an embodiment of the present application;
[0052] Fig.16 This is another example of a schematic diagram of an interface displayed on an inner screen and an outer screen provided in an embodiment of the present application;
[0053] Fig.17 is a flow chart of another screen display method provided in an embodiment of the present application;
[0054] Fig.18 is another example of an interface diagram displayed on an inner screen provided in an embodiment of the present application;
[0055] Fig.19 is a flowchart of another screen display method provided in an embodiment of the present application;
[0056] Fig. 20 is a flowchart of another screen display method provided in an embodiment of the present application;
[0057] Fig.21 is a structural schematic diagram of a screen display device provided in an embodiment of the present application;
[0058] Fig. 22 This is a structural schematic diagram of another screen display device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0059] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.
[0060] In the following, the terms "first", "second", and "third" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first", "second", and "third" may explicitly or implicitly include one or more of the features.
[0061] The screen display method of the electronic device provided in the embodiment of the present application can be applied to mobile phones, tablet computers, wearable devices, vehicle-mounted devices, augmented reality (AR) / virtual reality (VR) devices, laptop computers, ultra-mobile personal computers (UMPC), netbooks, personal digital assistants (PDA) and other terminal devices, which are terminal devices having a first screen and a second screen respectively arranged on opposite sides of the terminal device. The embodiment of the present application does not impose any restrictions on the specific type of the terminal device.
[0062] For example, Figure 1 1 is a schematic diagram of the structure of an example of a terminal device 100 provided in an embodiment of the present application. The terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0063] It is understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[0064] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0065] The controller may be the nerve center and command center of the terminal device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.
[0066] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0067] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0068] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example: the processor 110 may be coupled to the touch sensor 180K through the I2C interface, so that the processor 110 communicates with the touch sensor 180K through the I2C bus interface, thereby realizing the touch function of the terminal device 100.
[0069] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to achieve communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 via the I2S interface to achieve the function of answering a call through a Bluetooth headset.
[0070] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface to realize the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
[0071] The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 through the UART interface to implement the function of playing music through a Bluetooth headset.
[0072] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the shooting function of the terminal device 100. The processor 110 and the display screen 194 communicate via the DSI interface to implement the display function of the terminal device 100.
[0073] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.
[0074] The USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the terminal device 100, and can also be used to transmit data between the terminal device 100 and peripheral devices. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other terminal devices, such as AR devices, etc.
[0075] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.
[0076] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the terminal device 100. While the charging management module 140 is charging the battery 142, it may also power the terminal device through the power management module 141.
[0077] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.
[0078] The wireless communication function of the terminal device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
[0079] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Figure 1 The structures of antenna 1 and antenna 2 in the figure are only an example. Each antenna in the terminal device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.
[0080] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the terminal device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.
[0081] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be arranged in the same device as the mobile communication module 150 or other functional modules.
[0082] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the terminal device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0083] In some embodiments, the antenna 1 of the terminal device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the terminal device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-CDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).
[0084] The terminal device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.
[0085] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the terminal device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.
[0086] When the terminal device 100 is a folding screen device, the inner screen of the terminal device 100 can be set as a foldable display screen, referred to as a folding screen. The folding screen can be an integrally formed flexible display screen, or a spliced display screen composed of multiple flexible display screens and hinges between each two flexible display screens, or a spliced display screen composed of multiple rigid screens and hinges between each two rigid screens. This embodiment of the application does not limit this.
[0087] Exemplarily, the terminal device 100 may be a foldable screen mobile phone. Figure 2 The schematic diagram of the structure of a foldable screen mobile phone is shown as an example. Figure 2 The display screen of the foldable screen mobile phone includes a first screen and a second screen, wherein the first screen can be an inner screen, the second screen can be an outer screen, the inner screen is a foldable screen, and the size of the inner screen is larger than that of the outer screen. Figure 2 Figure a in the figure is a schematic diagram of the outer side of the folding screen mobile phone when the inner screen is unfolded. Figure 2 In Figure a, the first part 201 on the outside of the folding screen mobile phone can be set as the outer screen of the folding screen mobile phone, and the second part 202 can be set as the mobile phone shell. Among them, the first part 201 and the second part 202 on the outside of the folding screen mobile phone can both be provided with cameras. In other folding screen mobile phone examples, the first part 201 and the second part 202 on the outside of the folding screen mobile phone can both be set as the outer screen of the folding screen mobile phone, and the first part 201 and the second part 202 on the outside of the folding screen mobile phone can also both be set as the folding screen mobile phone shell. Figure 2 Figure b in the figure is a schematic diagram of the inner side of the folding screen mobile phone when the inner screen is unfolded. Figure 2As shown in Figure b, the inner screen (i.e., folding screen) of the folding screen mobile phone includes a first display unit 301 and a second display unit 302. The first display unit 301 and the second display unit 302 can display different display interfaces respectively, or can display a display interface together. The posture or form of the folding screen can be determined according to the angle between the first display unit 301 and the second display unit 302. When the angle between the first display unit 301 and the second display unit 302 is 0 degrees, the folding screen is in a fully folded state; when the angle between the first display unit 301 and the second display unit 302 is 180 degrees, the folding screen is in a fully unfolded state; when the angle between the first display unit 301 and the second display unit 302 is greater than 0 degrees and less than 180 degrees, the folding screen is in a semi-folded state. It should be pointed out that the folding screen in a semi-folded state can also be referred to as the folding screen mobile phone in a semi-folded state, and the same is true for the fully folded state and the fully unfolded state.
[0088] The terminal device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.
[0089] ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 193.
[0090] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the terminal device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
[0091] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the terminal device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.
[0092] Video codecs are used to compress or decompress digital videos. The terminal device 100 may support one or more video codecs. Thus, the terminal device 100 may play or record videos in various coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
[0093] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of the terminal device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.
[0094] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.
[0095] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the terminal device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the terminal device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0096] The terminal device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0097] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.
[0098] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The terminal device 100 can listen to music or listen to a hands-free call through the speaker 170A.
[0099] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals. When the terminal device 100 receives a call or voice message, the voice can be received by placing the receiver 170B close to the ear.
[0100] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 170C to input the sound signal into the microphone 170C. The terminal device 100 can be provided with at least one microphone 170C. In other embodiments, the terminal device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the terminal device 100 can also be provided with three, four or more microphones 170C to realize the collection of sound signals, noise reduction, identification of sound sources, realization of directional recording function, etc.
[0101] The earphone interface 170D is used to connect a wired earphone and can be a USB interface 130 or a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.
[0102] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The terminal device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the terminal device 100 detects the touch operation intensity according to the pressure sensor 180A. The terminal device 100 can also calculate the touch position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.
[0103] The gyroscope sensor 180B can be used to determine the motion posture of the terminal device 100. In some embodiments, the angular velocity of the terminal device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the terminal device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the terminal device 100 through reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and somatosensory game scenes.
[0104] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the terminal device 100 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.
[0105] The magnetic sensor 180D includes a Hall sensor. The terminal device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. In some embodiments, when the terminal device 100 is a flip phone, the terminal device 100 can detect the opening and closing of the flip cover according to the magnetic sensor 180D. Then, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, the flip cover automatic unlocking and other features are set.
[0106] The acceleration sensor 180E can detect the magnitude of the acceleration of the terminal device 100 in various directions (generally three axes). When the terminal device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the terminal device and applied to applications such as horizontal and vertical screen switching and pedometers.
[0107] The distance sensor 180F is used to measure the distance. The terminal device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the terminal device 100 can use the distance sensor 180F to measure the distance to achieve fast focusing.
[0108] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The terminal device 100 emits infrared light outward through the light emitting diode. The terminal device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the terminal device 100. When insufficient reflected light is detected, the terminal device 100 can determine that there is no object near the terminal device 100. The terminal device 100 can use the proximity light sensor 180G to detect that the user holds the terminal device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode, and pocket mode automatically unlocks and locks the screen.
[0109] The ambient light sensor 180L is used to sense the ambient light brightness. The terminal device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the terminal device 100 is in a pocket to prevent accidental touch.
[0110] The fingerprint sensor 180H is used to collect fingerprints. The terminal device 100 can use the collected fingerprint characteristics to achieve fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.
[0111] The temperature sensor 180J is used to detect temperature. In some embodiments, the terminal device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the terminal device 100 reduces the performance of the processor located near the temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the terminal device 100 heats the battery 142 to avoid abnormal shutdown of the terminal device 100 due to low temperature. In other embodiments, when the temperature is lower than another threshold, the terminal device 100 performs a boost on the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.
[0112] The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the terminal device 100, which is different from the position of the display screen 194.
[0113] The bone conduction sensor 180M can obtain a vibration signal. In some embodiments, the bone conduction sensor 180M can obtain a vibration signal of a vibrating bone block of the vocal part of the human body. The bone conduction sensor 180M can also contact the human pulse to receive a blood pressure beat signal. In some embodiments, the bone conduction sensor 180M can also be set in an earphone and combined into a bone conduction earphone. The audio module 170 can parse out a voice signal based on the vibration signal of the vibrating bone block of the vocal part obtained by the bone conduction sensor 180M to realize a voice function. The application processor can parse the heart rate information based on the blood pressure beat signal obtained by the bone conduction sensor 180M to realize a heart rate detection function.
[0114] The key 190 includes a power key, a volume key, etc. The key 190 may be a mechanical key or a touch key. The terminal device 100 may receive key input and generate key signal input related to user settings and function control of the terminal device 100.
[0115] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.
[0116] Indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, messages, missed calls, notifications, etc.
[0117] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to and separated from the terminal device 100 by inserting the SIM card interface 195 or pulling it out from the SIM card interface 195. The terminal device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The terminal device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the terminal device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the terminal device 100 and cannot be separated from the terminal device 100.
[0118] The software system of the terminal device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The present application embodiment takes the Android system of the layered architecture as an example to exemplify the software structure of the terminal device 100.
[0119] Figure 2 Figure c in is a software structure diagram of the terminal device 100 of the embodiment of the present application. The layered architecture divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely, the application layer, the application framework layer, the Android runtime (Android runtime) and the system library, and the kernel layer. The application layer can include a series of application packages.
[0120] like Figure 2 As shown in Figure c, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, system user interface (system UI) and other third-party applications (application, APP).
[0121] The system user interface is used to provide a quick service interface and display the drop-down taskbar.
[0122] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions. The API may include API1 and API2. API1 is an interface for adding window display, and API2 is an interface for registering collaborative services.
[0123] like Figure 2 As shown in Figure c, the application framework layer can include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, an input manager, and a display manager (i.e., a screen manager), etc.
[0124] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.
[0125] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.
[0126] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.
[0127] The phone manager is used to provide communication functions of the terminal device 100, such as management of call status (including connection, disconnection, etc.).
[0128] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.
[0129] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, the terminal device vibrates, the indicator light flashes, etc.
[0130] The input manager is used to handle user touch operations, such as single click, slide, double click, and so on.
[0131] The display manager is used to manage the inner screen and the outer screen, and control the display content to be displayed on the inner screen and / or the outer screen.
[0132] Android runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.
[0133] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.
[0134] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
[0135] The system library may include multiple functional modules, such as surface manager, media libraries, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.
[0136] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.
[0137] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0138] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0139] A 2D graphics engine is a drawing engine for 2D drawings.
[0140] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, sensor driver, internal screen driver and external screen driver.
[0141] The above-mentioned terminal device can be an electronic device with an inner screen and an outer screen, or it can be a folding screen device with an outer screen. Taking a folding screen device with an outer screen as an example, one of the screens is a foldable inner screen, that is, a folding screen, and the user can unfold the inner screen for use when watching videos or playing games. When the user does not use the inner screen, the folding screen device can be folded for easy carrying. The other screen is an outer screen, which is set on the side opposite to the inner screen. When the user folds the folding screen device, the inner screen will be folded up, and the outer screen will be exposed to the outside, so that the user can directly operate the outer screen to use the folding screen device without unfolding the inner screen. For example, the user can operate the outer screen to answer or make a call, or turn off the alarm clock, etc. Usually when the user unfolds the folding screen device, the inner screen will be unfolded, and the folding screen device will think that the user needs to use the inner screen at this time, and the outer screen will automatically turn off. However, when the user needs to scan a code to pay while using the inner screen, he or she needs to open the payment code on the inner screen and flip the folding screen device so that the inner screen faces the barcode scanner to scan the code. This is inconvenient to operate for larger folding screen devices and affects the user experience.
[0142] The technical solution of the present application is that when the user needs to show the screen to other people or other devices, for example, when showing the payment code for payment, the user can light up the external screen through a quick operation and project the payment code to be displayed onto the external screen of the electronic device 301 for display. Figure 3 As shown, when the user needs to scan the code to pay, there is no need to flip the electronic device 301 over to present the payment code to the barcode scanner 302 through the external screen to complete the scan code payment operation. This makes scanning the code more convenient, improves the portability of the electronic device 301 for scanning the code, and does not affect the user's viewing of the internal screen, thereby improving the user experience.
[0143] For ease of understanding, the following embodiments of the present application will be described in detail with Figure 1 and Figure 3 Taking the terminal device with the shown structure as an example, the screen display method of the electronic device provided in the embodiment of the present application is specifically explained in combination with the accompanying drawings and application scenarios.
[0144] When the user is using the inner screen, for example, when the user is reading a novel by viewing the inner screen, the inner screen may display the following Figure 4 The interface of the novel content shown in Figure a in the figure is off at this time. If the user needs to scan the code to pay for the purchased items at this time, the user can operate the inner screen to open the payment code and project the payment code to the outer screen for scanning. For example, when the user needs to show the payment code, the following can be performed on the inner screen: Figure 4 As shown in Figure a, pull down from the top of the inner screen to start the pull-down taskbar. The inner screen will display the following: Figure 4The drop-down task bar shown in Figure b in FIG. 4 includes an icon of "Quick Service". The user can operate as shown in Figure b in FIG. 4 and click the icon of "Quick Service" to open the Figure 4 The quick service window shown in Figure c in the figure. The quick service window may include at least one control, each control corresponds to an APP, and the user can open the corresponding page of the corresponding APP by clicking the control. Optionally, the quick service window can be as follows: Figure 4 As shown in Figure c, it is displayed in the form of a floating window on the inner screen, and the outer screen also displays the same Figure 4 The quick service window shown in Figure d. Figure 4 Figure d in FIG. 1 is a schematic diagram of the back of the electronic device when it is unfolded, including the outer screen and the back cover with a camera.
[0145] When the user Figure 5 As shown in Figure a, when you click the A payment code control, in response to the user's operation, the folding screen device switches the quick service window to Figure 5 At the same time, the quick service window on the external screen is also switched to the following: Figure 5 The A payment code is shown in Figure c. Users can point the external screen at the barcode scanner to scan and pay without turning the electronic device over to scan the code.
[0146] In other embodiments, the user can also double-click the back of the electronic device (for example, double-click the outer screen of the folding screen) to wake up the outer screen (ie, light up the outer screen), and display the following on the outer screen: Figure 4 Optionally, in response to a double-click operation on the back, the inner screen may also be opened as shown in FIG. Figure 4 As shown in Figure c, the window of quick service is displayed in the form of a floating window.
[0147] Optionally, in the unfolded state, the electronic device can turn off the operation permission of the outer screen. When the operation permission of the outer screen is turned off, the user cannot click on the outer screen to operate, and only the owner of the handheld electronic device can open the payment code by clicking the payment code control on the inner screen, which can avoid information leakage caused by other people opening the payment code from the outer screen. Optionally, in the folded state, the electronic device can turn on the operation permission of the outer screen. When the operation permission of the outer screen is turned on, the user can also open the payment code by clicking the payment code control in the quick service window of the outer screen to scan the code for payment.
[0148] Above Figure 4The example in the quick service window includes four controls: local health treasure, A payment code (payment code), B payment code and ride code. When the user clicks the control of the local health treasure in the quick service window, the external screen can display the health code with personal health information, which can identify the user's health status, making it convenient for the user to scan the code to pass or record personal health information. When the user clicks the control of the ride code in the quick service window, the external screen can display the ride code, making it convenient for the user to scan the code to board the bus or pass through the gate.
[0149] In some embodiments, the controls in the quick service window may include controls corresponding to several default APPs, and the user may edit the types of controls as needed, including adding controls or deleting controls. For example, the user may perform the following operations: Figure 6 As shown in Figure a, click the Settings button in the Quick Service window, and the Quick Service window can display the following Figure 6 The quick application setting interface shown in Figure b in the figure. The quick application setting interface includes a list of multiple apps that support quick services, and each entry in the list includes a control key for the app. The user can click the control key of the app to delete the app that has been added to the quick service from the quick service. For example, the user can Figure 6 Click the control key of A payment code in the quick application setting interface shown in Figure b, and the quick service function of A payment code will be closed. The quick service window can be opened as shown in Figure 6 As shown in Figure c, the control for payment code A no longer appears. Users can also add apps that do not have the quick service function enabled to the quick service by clicking the control key. For example, in Figure 6 In the quick application setting interface shown in Figure b, click the control key of application C, and the quick service function of application C will be enabled. The quick service window can be displayed as follows: Figure 6 As shown in Figure d, controls for application C are added. If there is no APP to be edited in the current quick application setting interface, users can also drag the list up and down to find the APP, or enter the name of the APP in the search bar to search, which makes it easier for users to edit the APP in the quick service and makes the use of quick services more flexible.
[0150] In the above embodiment, the user can operate the electronic device to display the code scanning interface that needs to be presented on the external screen, including the payment code, health code, and ride code, etc. Therefore, the user does not need to flip the electronic device to present the code scanning interface through the inner screen, and only needs to present the outer screen to scan the code, which facilitates the code scanning operation. At the same time, the code scanning operation can be performed without interrupting the user to watch the inner screen, which improves the user experience.
[0151] In some embodiments, during the installation process, the third-party APP can send registration information to the window manager through the application programming interface (API) 2 to register with the system. The registration information is used to characterize that the third-party APP can provide external screen collaborative services, such as the icon, service name, and callback method of the third-party APP. A third-party APP that is not registered in the system can be considered to be unable to provide external screen collaborative services. Optionally, the third-party APP can also send registration information to the window manager through API2 for the first time after the installation is completed to register with the system, or the third-party APP stores the registration information in a fixed path when it is installed, and the electronic device obtains the registration information according to the fixed path when it is turned on to obtain which APPs can provide external screen collaborative functions. Optionally, the electronic device can also preset the registration information of some third-party APPs in the system. For example, payment APPs and ride APPs are often APPs that people need to use on the external screen, so the electronic device can preset the registration information of these APPs. It should be noted that the above-mentioned API2 is an interface different from API1. API1 is an interface for the third-party APP to add windows for display, and API2 is an interface for the third-party APP to register with the window manager for collaboration.
[0152] Figure 7 Taking the scenario where a user opens the external screen to scan a code to pay while reading a novel through a browser as an example, the external screen display process of an electronic device is described in detail. This includes:
[0153] S701. The payment APP calls API2 to send the registration information of the payment APP to the window manager for registration.
[0154] S702: When the user operates the inner screen of the electronic device to open the browser to browse the novel content, the input manager in the electronic device recognizes the user's operation and sends the recognition result to the window manager.
[0155] S703. The window manager adds a window of the browser in response to the recognition result of the user operation, and sends an instruction of window adding completion to the browser through API1.
[0156] S704: In response to the window adding completion instruction sent by the window manager, the browser draws the corresponding page displaying the novel content, and after the drawing is completed, sends a message of drawing completion to the window manager through API1.
[0157] S705: In response to the drawing completion message received by the browser, the window manager sends a display message to the display manager, where the display message includes information about the page of the novel drawn by the internal screen display browser.
[0158] S706: The display manager controls the inner screen to display pages of the novel.
[0159] It should be noted that the above S701 is not necessarily executed before S702, and may also be executed after S702, S703, S704, S705 or S706, as long as it is executed before S707.
[0160] S707: When the user clicks on the external screen collaborative control or double-clicks on the external screen, the input processing module identifies the user's operation and sends the identification result to the window management module.
[0161] S708. The window management module adds a window of the shortcut service in response to the recognition result of the user operation, and sends an instruction of window adding completion to the system UI through API1.
[0162] S709: The system user interface draws the window of the shortcut service in response to the window adding completion instruction sent by the window manager, and sends a drawing completion message to the window manager through API1 after the drawing is completed.
[0163] S710: In response to a drawing completion message received from the system user interface, the window manager sends a display message to the display manager, where the display message includes information about windows of the shortcut service displayed on the inner screen and the outer screen.
[0164] S711. The display manager controls the inner screen and the outer screen to display windows of the quick service.
[0165] S712: When the user clicks on the payment APP control in the quick service window, the input manager identifies the user's operation and sends the identification result to the window manager through API1.
[0166] S713. The window manager adds a payment code window in response to the recognition result of the user operation, and sends an instruction to the payment APP through API1 indicating that the window has been added.
[0167] S714. The payment APP responds to the instruction sent by the window manager that the window has been added, draws the payment code page, and after the drawing is completed, sends a message to the window manager through API1 indicating that the drawing is completed.
[0168] S715. After the window manager responds to the message indicating that drawing of the payment APP receipt is completed, it sends a display message to the display manager. The display message includes information about the page displaying the payment code on the inner screen and the outer screen.
[0169] S716. The display manager controls the inner screen and the outer screen to display the payment code interface.
[0170] At this time, users can scan the code to pay through the external screen without turning over the electronic device, making scanning code payment more convenient.
[0171] If the user wants to share the screen with others, he can also turn on the external screen collaboration function to project the interface of the internal screen to the external screen for display. Others can then watch the interface the user wants to display through the external screen. The user does not need to reverse the electronic device to share the screen with other users, making screen sharing more convenient.
[0172] For example, when the user, as the owner of the device, shows pictures to others, the inner screen can display the following: Figure 8 The gallery interface shown in Figure a in FIG. includes multiple photos. The user can perform the following operations: Figure 8 As shown in Figure a, pull down from the top of the inner screen, and the top of the inner screen will display the following Figure 8 The drop-down task bar shown in Figure b in the figure. The drop-down task bar includes controls for screen projection. Figure 8 In the figure, the control for screen projection is shown as "external screen collaboration" as an example.
[0173] When the user executes Figure 8 When you click the "External Screen Collaboration" control in the drop-down taskbar as shown in Figure b, the external screen can be Figure 8 The interface of the gallery is shown in Figure c. If the user executes Figure 8 As shown in Figure b, click on one of the pictures, and the inner screen will expand to display the picture. At this time, the external screen is in the external screen collaboration mode, and the external screen can be Figure 8 As shown in Figure d, the picture selected by the user is expanded to display. Others can view the picture selected by the user through the external screen. When the user slides left and right on the inner screen to switch pictures, the external screen can synchronously display the content displayed on the inner screen, so that others can view the content that the user wants to share through the external screen.
[0174] In some embodiments, when the external screen collaboration function is turned on, the electronic device can turn off the operation permission of the external screen to prevent others from operating the external screen to switch the real content, resulting in the leakage of user privacy. In some embodiments, when the external screen collaboration function is turned on, the electronic device can also turn on the operation permission of the external screen, so that other users can operate the external screen while observing the external screen, such as sliding the external screen left and right to switch pictures, clicking the editing control in the external screen to edit the picture, clicking the collection control in the external screen to collect the picture, or clicking the sharing control in the external screen to share the picture to other applications. Enabling the operation permission of the external screen by the electronic device can improve the interactivity of the collaboration between the internal and external screens and enrich the collaborative function of the electronic device.
[0175] In some embodiments, when the user turns on the external screen collaboration function, he or she can also select the mirror collaboration or asynchronous collaboration mode as needed. Among them, the mirror collaboration mode is a mode in which the external screen and the internal screen display the same content; the asynchronous collaboration mode is a mode in which the content displayed on the external screen is different from or not completely the same as that on the internal screen, for example, the external screen displays the interface of APP1 and the internal screen displays the interface of APP2, or the external screen displays the interface of APP1, the internal screen displays the interface of APP2, and at the same time displays the interface of APP1 in the form of a floating window.
[0176] In the asynchronous collaboration mode, the electronic device can project the interface of the front-end running APP to the external screen for display, and the interfaces of other APPs can be displayed only on the internal screen. For example, when a user is viewing the content of a browser and calling a quick service, the electronic device defaults to the asynchronous collaboration mode, and the browser interface is displayed on the internal screen while the quick service window is displayed as a floating window, while the external screen only displays the quick service window without displaying the browser interface.
[0177] In some embodiments, when a user needs to show a picture to others, the following can be performed on the interface of the gallery displayed on the inner screen: Fig. 9 As shown in Figure a, pull down from the top of the inner screen to start the pull-down task bar, and the inner screen will display as follows: Fig. 9 The drop-down task bar is displayed as shown in Figure b. The user clicks the "External Screen Collaboration" control in the drop-down task bar, and the interface of the internal screen pops up as shown in Figure b. Fig. 9 The collaborative mode selection window shown in Figure c includes controls for mirror collaboration and asynchronous collaboration, and users can select a reasonable collaborative mode according to their needs.
[0178] When the user selects the mirroring collaboration mode, the external screen displays the same content as the internal screen. For example, the external screen displays Fig. 9 The interface of the gallery is shown in Figure d. When the user opens one of the pictures, the outer screen also expands to display this picture. When the user slides back and forth on the inner screen to switch pictures, the outer screen also switches pictures accordingly.
[0179] Optionally, the user can also click the "Cancel" control in the collaboration mode selection window to exit the startup of the external screen collaboration function. In some embodiments, some applications can be set to the default external screen collaboration mode, such as the above Figure 8 In the illustrated embodiment, when the user activates the external screen collaboration function of the gallery application, the gallery application may be set to the default mirror collaboration mode without the user making a selection.
[0180] In some embodiments, when the user needs to show the video to others, Fig. 9In the process of the embodiment shown, when the user starts the external screen collaboration function, the external screen displays the same video content as the internal screen, realizing video sharing. The user can also operate the video playback interface on the internal screen to control the video playback. For example, when the user clicks the start, pause, stop and other buttons on the video playback interface on the internal screen, the external screen can also display the interface of the video playback on the internal screen in response to the user operation.
[0181] Fig.10 Taking the scenario of a user sharing a picture as an example, the process of displaying a picture on the external screen of an electronic device is described in detail, including:
[0182] S1001. The gallery calls API2 to send gallery registration information to the window manager for registration.
[0183] S1002: When the user operates the inner screen of the electronic device to open the gallery, the input manager in the electronic device recognizes the user's operation and sends the recognition result to the window manager.
[0184] S1003. The window manager adds a window to the gallery in response to the recognition result of the user operation, and sends an instruction indicating that the window has been added to the gallery through API 1.
[0185] S1004: In response to the instruction sent by the window manager indicating that the window has been added, the gallery draws the page of the gallery, and after the drawing is completed, sends a message indicating that the drawing is completed to the window manager through API 1.
[0186] S1005. In response to the drawing completion message received from the gallery, the window manager sends a display message to the display manager. The display message includes information about the page of the gallery displayed on the inner screen.
[0187] S1006: The display manager controls the inner screen to display pages of the gallery.
[0188] It should be noted that the above S1001 is not necessarily executed before S1002, and can also be executed after S1002, S1003, S1004, S1005 or S1006, as long as it is executed before S1007.
[0189] S1007. When the user slides down from the top of the inner screen to start the drop-down taskbar, the input processing module identifies the user's operation and sends the identification result to the window management module.
[0190] S1008. The window management module adds a window to the drop-down taskbar in response to the recognition result of the user operation, and sends an instruction to the system user interface indicating that the window has been added.
[0191] S1009: The system user interface draws the window of the drop-down taskbar in response to the instruction sent by the window manager indicating that the window is added, and sends a message indicating that the drawing is completed to the window manager after the drawing is completed.
[0192] S1010. In response to a drawing completion message received from the system user interface, the window manager sends a display message to the display manager. The display message includes information about a window of the gallery displayed on the inner screen.
[0193] S1011. The display manager controls the inner screen to display the gallery window.
[0194] S1012: When the user operates the inner screen to open the outer screen collaboration, the input manager identifies the user's operation and sends the identification result to the window manager.
[0195] S1013. The window manager sends a display message to the display manager in response to the recognition result of the user operation. The display message includes information about the pages of the gallery displayed by the inner screen and the outer screen.
[0196] S1014: The display manager controls the inner screen and the outer screen to display pages of the gallery.
[0197] S1015. When the user operates the inner screen to open a picture, the input manager identifies the user's operation and sends the identification result to the window manager.
[0198] S1016. The window manager adds a window of the picture in response to the recognition result of the user operation, and sends an instruction of window adding completion to the picture library through API1.
[0199] S1017. In response to the instruction sent by the window manager indicating that the window has been added, the picture library draws the page of the picture, and after the drawing is completed, sends a message indicating that the drawing is completed to the window manager through API1.
[0200] S1018. In response to the drawing completion message received from the gallery, the window manager sends a display message to the display manager. The display message includes information about the pages on which the pictures are displayed on the inner screen and the outer screen.
[0201] S1019. The display manager controls the pages for displaying pictures on the inner screen and the outer screen.
[0202] At this time, the user can show the pictures to others through the external screen without turning the electronic device over, making picture sharing more convenient.
[0203] When parents want to use electronic devices to take photos of their children, Fig.11In the scenario shown, if you are worried that your child cannot concentrate and the shooting effect will be poor, you can use the external screen to play a cartoon to attract the child's attention, and then take the photo. At this time, the internal screen can display the photo preview interface, which will not affect the parents' shooting but can also attract the child's attention, improving the shooting effect and shooting speed.
[0204] Specifically, as a parent, the user can open a locally stored cartoon or open other video apps to play a video. At this time, the inner screen can be Fig.12 The video playback interface is shown in Figure a. Fig.12 When you pull down from the top of the inner screen as shown in Figure a, the inner screen will be as follows Fig.12 The drop-down task bar is displayed as shown in Figure b. The user performs the following Fig.12 The operation shown in Figure b is to click the "External Screen Collaboration" control in the drop-down task bar, and the interface of the internal screen will pop up as shown below. Fig.12 The collaborative mode selection window shown in Figure c in FIG. 1 includes controls for mirror collaboration and asynchronous collaboration. Fig.12 When you click the "Asynchronous Collaboration" control in the interface shown in Figure c, the external screen can display the following Fig.12 The video playback interface shown in Figure d.
[0205] Optionally, in order to allow the child to view a larger video interface, the electronic device can be held horizontally, that is, the external screen is in horizontal mode, and the external screen can be Fig.13 Figure a or Fig.13 Figure b shows the horizontal screen video playback interface.
[0206] At this time, the external screen permission of the electronic device can be turned off, and the child cannot operate the external screen, but only has the permission to watch, so as to prevent the child from accidentally operating and affecting the shooting. The user can operate the internal screen to control the video playback, such as clicking the play, pause, next episode and other controls to control the video playback.
[0207] When the child is watching cartoons on the external screen, the user can open the camera app to take photos or videos. Fig.14 As shown in Figure a, swipe from the side of the inner screen to the middle to exit the video playback interface. At this time, because the electronic device is in the state of external screen coordination, the video playback interface will not be closed, but will be Fig.14 As shown in Figure b, it is displayed in a corner of the inner screen in the form of a reduced floating window. Then the user can Fig.14 As shown in Figure b, click the camera icon on the desktop to open the camera and start shooting. While the user is shooting, the external screen can play cartoons to attract the child's attention, while the internal screen is Fig.14The shooting preview interface is shown in Figure c.
[0208] Optionally, the user can Fig.15 As shown in Figure a, slide from the side of the inner screen to the middle to exit the video playback interface. At this time, since the electronic device is in the state of external screen coordination, the video playback interface can be Fig.15 As shown in Figure b, it is displayed in a corner of the inner screen in the form of a reduced floating ball. Then the user can Fig.15 As shown in Figure b, click the camera icon on the desktop to open the camera and start shooting. While the user is shooting, the external screen can play cartoons to attract the child's attention, while the internal screen is Fig.15 The shooting preview interface is shown in Figure c.
[0209] Optionally, in asynchronous collaboration mode, users can Fig.16 As shown in Figure a, slide from the side of the inner screen to the middle and pause to open Fig.16 Click the camera icon in the sidebar to open the camera and take pictures. Fig.16 The preview interface of the shooting is shown in Figure c, and the video playback interface displayed on the external screen is displayed on the internal screen in the form of a floating ball. Users can also drag the floating window or floating ball on the internal screen to move the position to avoid the operation area. Users can operate the internal screen in the preview interface of the shooting to set the camera shooting parameters.
[0210] Fig.17 Taking the scenario where a user plays a video for a child through an external screen and takes a photo of the child at the same time as an example, the process of displaying a video on the external screen of an electronic device is described in detail, including:
[0211] S1701. The video player calls API2 to send registration information of the video player to the window manager for registration.
[0212] S1702: When the user operates the inner screen of the electronic device to open the video for playback, the input manager in the electronic device recognizes the user's operation and sends the recognition result to the window manager.
[0213] S1703. The window manager adds a window of the video player in response to the recognition result of the user operation, and sends an instruction of window addition completion to the video player through API1.
[0214] S1704: In response to the window adding completion instruction sent by the window manager, the video player draws the video page, and after the drawing is completed, sends a message of drawing completion to the window manager through API1.
[0215] S1705: In response to the drawing completion message received from the video player, the window manager sends a display message to the display manager, where the display message includes information about the page of the video player displayed on the inner screen.
[0216] S1706: The display manager controls the inner screen to display a page of the video player.
[0217] It should be noted that the above S1701 is not necessarily executed before S1702, and can also be executed after S1702, S1703, S1704, S1705 or S1706, as long as it is executed before S1707.
[0218] S1707: When the user operates the inner screen to open the outer screen collaboration, the input manager identifies the user's operation and sends the identification result to the window manager.
[0219] S1708. The window manager sends a display message to the display manager in response to the recognition result of the user operation. The display message includes information of the interface for displaying the video playback on the inner screen and the outer screen.
[0220] S1709: The display manager controls the inner screen and the outer screen to display the video playback interface.
[0221] S1710. When the user slides inward from the side of the inner screen, the input processing module recognizes the user's operation and sends the recognition result to the window management module.
[0222] S1711. The window management module adds a window of the desktop and a floating window of the video player in response to the recognition result of the user operation, and sends an instruction to the video player that the floating window has been added.
[0223] S1712: The video player draws the floating window of the video player in response to the instruction sent by the window manager indicating that the floating window has been added, and after the drawing is completed, sends a message indicating that the drawing is completed to the window manager through API1.
[0224] S1713. In response to the drawing completion message received from the video player, the window manager sends a display message to the display manager. The display message includes information about the desktop and the floating window of the video player displayed on the inner screen.
[0225] S1714. The display manager controls the inner screen to display the desktop and the floating window of the video player.
[0226] S1715: When the user operates the inner screen to open the camera, the input manager recognizes the user's operation and sends the recognition result to the window manager.
[0227] S1716. The window manager adds a camera window in response to the recognition result of the user operation, and sends an instruction to the camera through API1 indicating that the window has been added.
[0228] S1717: In response to the window adding completion instruction sent by the window manager, the camera draws the camera interface, and after the drawing is completed, sends a message of drawing completion to the window manager through API1.
[0229] S1718. In response to the drawing completion message received from the camera, the window manager sends a display message to the display manager. The display message includes information about the camera interface displayed on the internal screen.
[0230] S1719. The display manager controls the internal screen to display the camera page, and displays the video playback interface in the form of a floating window.
[0231] In this way, users can play videos to children through the external screen to attract their attention, and use the internal screen to preview the shooting interface to shoot. This will not affect the parents' shooting but can also attract the children's attention and make them cooperate with the shooting, thus improving the shooting effect and speed.
[0232] When the user opens the camera to take a picture of the child and finds that the child is not paying attention, the user can Fig.18 In the shooting preview interface shown in Figure a, slide from the side of the screen to the middle and pause to open the sidebar, then the inner screen can be Fig.18 The sidebar is shown in Figure b. Fig.18 Click the video player in the interface shown in Figure b to play the video. This is the interface of the video player. Fig.18 As shown in Figure c, it is displayed in the form of a floating window above the camera preview interface. At this time, the user can open the external screen coordination in the drop-down task bar and select asynchronous collaboration, and the internal screen can display the following Fig.14 The interface shown in Figure c in FIG. 1 or Figure c in FIG. 15 shows the camera preview interface and the floating window or floating ball of the reduced video player; the external screen can be as shown in FIG. Fig.12 Figure d in Fig.13 Figure a or Fig.13 As shown in Figure b, the interface of the video player is displayed.
[0233] When the user finishes the presentation, he can click the external screen collaboration control in the drop-down taskbar to stop the external screen collaboration. At this time, the external screen can be turned off or the desktop of the external screen can be displayed instead of the previously displayed interface.
[0234] Fig.19A flowchart of another screen display method provided in an embodiment of the present application, the method is applied to an electronic device including a first screen and a second screen, and the present embodiment is described by taking the first screen as an inner screen and the second screen as an outer screen as an example, wherein the outer screen and the inner screen are arranged on opposite sides of the electronic device, and the method includes:
[0235] S1901: Receive a first operation performed by a user.
[0236] Optionally, the user can perform the first operation on the inner screen, such as clicking the icon of the quick service on the desktop to open the quick service window. Optionally, the user can also perform the first operation on the outer screen, such as double-clicking the outer screen or tapping the outer screen with two fingers to open the quick service window.
[0237] S1902. In response to the first operation, display a first interface on the first screen, where the first interface includes a first control.
[0238] In response to the first operation, the external screen may display a first interface. In this embodiment, the first interface is a window of a quick service. Figure 4 The quick service window shown in Figure d in the figure. The quick service window may include one or more service controls, each of which corresponds to an APP or a setting page of an APP. For example, a payment service control may correspond to a payment APP or a payment code page of the payment APP. Optionally, the service controls in the quick service window may include a first control corresponding to the APP that the user needs to quickly call.
[0239] S1903: Receive a second operation on the first control by the user.
[0240] Through the shortcut service window, the electronic device receives a second operation of selecting a first control performed by the user. For example, the second operation is an operation of clicking a first control to be displayed from at least one service control in the shortcut service window.
[0241] In some embodiments, the operation permission of the external screen can be turned off to prevent privacy leakage or information loss caused by other people's misoperation, and the user can perform the second operation on the internal screen. In some embodiments, the operation permission of the external screen can be turned on, and other people can perform the second operation on the external screen to select the first control, so that the service code to be displayed can be selected as needed with the permission of the owner, which is more convenient to use.
[0242] S1904. In response to the second operation, display a second interface corresponding to the first control on the second screen.
[0243] In response to the above-mentioned second operation, the electronic device displays the second interface corresponding to the above-mentioned first control on the external screen, such as a service code. For example, when the first control selected by the user is a control of a payment APP, the corresponding service code may be a payment code; when the first control selected by the user is a control of a personal health APP, the corresponding service code may also be a personal health code; when the first control selected by the user is a control of a ride APP, the corresponding service code may be a ride code. It should be noted that the service code here may be in the form of a barcode, a QR code, etc., and the embodiments of the present application do not limit the specific form of the service code.
[0244] In the above embodiments, the electronic device can display a first interface on the external screen based on the user's first operation, such as a window for quick services, and then display a second interface corresponding to the first control selected by the user, such as an interface for a service code, through the external screen under the triggering of a second operation, which can avoid the inconvenience caused by the user flipping the electronic device to scan the code, making the code scanning operation more convenient and quick. When the electronic device itself is in a folded state, that is, the inner screen is in a folded state, the inner screen is off. The user can double-click the external screen to wake up the external screen, and the operation authority of the external screen is in the on state. The user can then perform a second operation on the external screen to open the corresponding second interface. In this way, the user can scan the code without unfolding the inner screen, which improves the convenience of the code scanning operation.
[0245] In some embodiments, a possible implementation of the above step S1901 may include: receiving the first operation when the first screen displays the third interface, and the third interface is one of the following interfaces: lock screen interface, AOD interface, desktop, and interface of the first APP. When the user views the interface of the first APP displayed on the inner screen, for example, when the user uses the content of the novel displayed by the browser, and the user needs to scan the code to pay or scan the code to take a ride, the first operation can be performed to open the window of the quick service (i.e., the first interface), and the second operation is performed in the window of the quick service so that the external screen displays the service code to be displayed (i.e., the second interface), so that the user can use the external screen to scan the code without turning over the electronic device. Since the external screen only displays the service code, there is no need to display the first interface of the first APP to other people or devices, which protects the user's information from being leaked. The user can also scan the code while using the first APP uninterruptedly, which protects the user's privacy and improves the user's scanning experience.
[0246] Optionally, the first APP may be any one of a browser APP, a video APP, a game APP, a conference APP, a document APP, and a video call APP. The user can display the service code to be displayed on the external screen by operating the electronic device without affecting the user's use of any one of the browser APP, video APP, game APP, conference APP, document APP, and video call APP on the internal screen, thereby improving the user's code scanning experience.
[0247] In some embodiments, the first operation is sliding down on the inner screen (i.e., the first screen) to activate the drop-down taskbar and click on the control of the quick service in the drop-down taskbar. When the user is using the inner screen, the user can slide down at the top of the inner screen to activate the drop-down taskbar, and click on the control of the quick service in the drop-down taskbar to open the quick service window. This method is more accurate and will not cause misoperation.
[0248] In some embodiments, the first operation is double-clicking the outer screen (i.e., the second screen). The user can also perform a double-click operation on the outer screen to light up the outer screen and open the quick service window on the outer screen, so that the quick service window can be opened by a quick operation such as double-clicking the outer screen without precise operation of the inner screen, making the operation more flexible and convenient.
[0249] In some embodiments, the first interface includes: at least one of a payment code control, a ride code control, and a personal health code control. The payment code, ride code, and personal health code are service codes that are used frequently. By storing one or more of these service codes in the quick service window, the number of times a user manually opens the service code by opening the APP can be significantly reduced, thereby improving the user experience.
[0250] In some embodiments, the user may also manage the service controls in the shortcut service window, such as adding or deleting them. Figure 4 The quick service window in the example includes: local health code, A payment code, B payment code and ride code. The user can perform a third operation, which can be seen in Figure 6 The operation of clicking the second control in the window of the quick service on the inner screen as shown in FIG. a. The second control may be a menu control. The electronic device receives the third operation and responds by displaying the following in the window of the quick service displayed on the inner screen: Figure 6The APP management list shown in Figure b in the figure, the APP management list includes multiple icons of APPs supporting quick services and multiple status buttons, and the multiple icons of APPs supporting quick services correspond to the multiple status buttons one by one, that is, each icon of the APP of the quick service corresponds to a status button representing its own status. Each status button can include two states: open and closed. Among them, the open state means that the window of the quick service contains the control of the APP of the quick service corresponding to this status button. If the user needs to delete the icon of the APP corresponding to this status button from the window of the quick service, the state button can be manually switched to the closed state; the closed state means that the window of the quick service does not contain the control of the corresponding APP. If the user needs to add the icon of the APP corresponding to this status button to the window of the quick service, the state button can be manually switched to the open state. When the electronic device receives the fourth operation performed by the user on the target status button, wherein the target status button is any one of the multiple status buttons, in response to the fourth operation, the electronic device can add or delete the icon of the APP supporting the quick service corresponding to the target status button in the window of the quick service. That is to say: if the target status button is in the closed state, when the user performs the fourth operation of clicking the target status button, the closed state can be switched to the open state, and the original quick service window does not contain the icon of the APP corresponding to the target status button. At this time, the icon of the APP corresponding to the target status button can be added to the quick service window; if the target status button is in the open state, when the user performs the fourth operation of clicking the target status button, the open state can be switched to the closed state, and the original quick service window contains the icon of the APP corresponding to the target status button. At this time, the icon of the APP corresponding to the target status button can be deleted from the quick service window. In this embodiment, the user can open the APP management list by operating the menu control in the quick service window, and then manage the service controls in the quick service window by operating the status button corresponding to the icon of the APP that supports the quick service in the APP management list. This method can enable users to manage the types of service controls in the quick service window by themselves, so that the operation of calling the service code through the quick service window can meet the personalized needs of different users, thereby improving the user experience.
[0251] Fig. 20 A flowchart of another screen display method provided in an embodiment of the present application, the method is applied to an electronic device, the electronic device includes a first screen and a second screen, and the present embodiment is described by taking the first screen as an inner screen and the second screen as an outer screen as an example, wherein the first screen and the second screen are respectively arranged on opposite sides of the electronic device, including:
[0252] S2001. Display a third interface on the first screen, where the third interface is an interface of a first APP.
[0253] When the user uses the first APP, the electronic device can display the third interface of the first APP on the inner screen. The embodiment of the present application does not limit the type of the first APP, and may include but is not limited to any one of a browser APP, a video APP, a game APP, a conference APP, a document APP, and a video call APP. The first interface of the above-mentioned first APP can be an interface displayed by a game APP, a video playback interface displayed by a video APP, or an interface of document content displayed by a document APP, and the embodiment of the present application does not limit this.
[0254] S2002. Receive a fifth operation performed by the user, where the fifth operation is an operation of opening a collaborative function between the first screen and the second screen (eg, a collaborative function between the inner screen and the outer screen).
[0255] When the user needs to scan the code, the fifth operation of turning on the collaborative function of the inner and outer screens can be performed, for example, the user clicks the start button of the collaborative function on the desktop, or slides down the taskbar from the inner screen and clicks the external screen collaboration control in the drop-down taskbar.
[0256] S2003. In response to the fifth operation, display the interface of the first APP displayed on the first screen on the second screen.
[0257] At this time, the electronic device can display the interface of the first APP displayed on the inner screen on the external screen under the trigger of the user's fifth operation. When the user continues to operate the first APP on the inner screen, the external screen can continue to follow the inner screen to display the interface of the first APP displayed on the inner screen. For example, when the inner screen displays the first interface of the picture thumbnails in the gallery, if the user performs the fifth operation, the external screen displays the picture thumbnails of the gallery displayed on the inner screen. At this time, if the user clicks on one of the pictures on the inner screen to display an enlarged image of this picture, the external screen synchronously displays the enlarged image of the picture displayed on the inner screen.
[0258] Above Fig. 20 In the illustrated embodiment, the electronic device can activate the collaborative function of the inner screen and the outer screen when the user performs the fifth operation, that is, the outer screen displays the content displayed on the inner screen, thereby allowing the interface of the first APP to be displayed to other users for viewing without flipping the electronic device, avoiding the inconvenience of flipping the electronic device to share the screen, making screen sharing more convenient, and improving the user experience of screen sharing.
[0259] In some embodiments, the fifth operation is to slide down in the first screen to start the drop-down taskbar and click the external screen collaborative control in the drop-down taskbar, and select the asynchronous collaborative operation in the pop-up external screen collaborative selection window. That is, when the user slides down at the top of the inner screen, the drop-down taskbar can be pulled out. The drop-down taskbar includes the external screen collaborative control. When the user clicks the external screen collaborative control or clicks the menu button of the external screen collaborative control, the inner screen can pop up the external screen collaborative selection window. The external screen collaborative selection window may include asynchronous collaborative controls. When the user clicks the asynchronous collaborative control, the electronic device starts the asynchronous collaborative mode of the collaborative function. Optionally, the fifth operation can also be to slide down in the first screen to start the drop-down taskbar and click the external screen collaborative control in the drop-down taskbar, and select the asynchronous collaborative operation in the pop-up external screen collaborative selection window. That is, when the user slides down at the top of the inner screen, the drop-down taskbar can be pulled out. The drop-down taskbar includes the external screen collaborative control. When the user clicks the external screen collaborative control or clicks the menu button of the external screen collaborative control, the inner screen can pop up the external screen collaborative selection window. The external screen collaboration selection window may also include a mirror collaboration control. If the user clicks the mirror collaboration control, the electronic device starts the mirror collaboration mode of the collaboration function. The user may select different collaboration function modes as needed to adapt to the current usage scenario.
[0260] In some embodiments, when the mode of the collaborative function is an asynchronous collaborative mode, the electronic device can also receive the sixth operation performed by the user to open the second APP on the inner screen. In response to the sixth operation, the electronic device displays the interface of the second APP on the inner screen, and displays the interface of the first APP in the inner screen in the form of a floating window. When the user turns on the collaborative function, if the asynchronous collaborative mode is selected, the external screen can display content that is not exactly the same as the internal screen. That is, the user starts the asynchronous collaborative mode when the interface of the first APP is displayed on the inner screen. When the user operates the inner screen to open the second APP, that is, the sixth operation is performed, the inner screen displays the interface of the second APP. At this time, the external screen still displays the interface of the first APP, and the interface of the first APP can be displayed in a floating window on the inner screen to prompt the user of the content displayed on the external screen. In this embodiment, after turning on the collaborative function of the asynchronous collaborative mode, the user can keep the external screen displaying the interface of the first APP, and can use the second APP on the inner screen. At the same time, the user can also monitor the demonstration of the first APP through the interface of the first APP displayed in the floating window of the inner screen, which makes the form of screen sharing richer, while enriching the functions of the electronic device, facilitating the use of users and improving the user experience.
[0261] The sixth operation of the above-mentioned user to open the second APP can be performed on the inner screen, first clicking the "Home" button to exit the interface of the first APP and return to the desktop, and then clicking the icon of the second APP from the desktop to open the operation of the second APP; it can also be in the interface of the first APP, sliding a distance from the side of the inner screen to the middle of the inner screen and pausing to open the sidebar, and then clicking the icon of the second APP in the sidebar to open the operation of the second APP.
[0262] In some embodiments, when the mode of the collaborative function is a mirror collaborative mode, the electronic device can also receive a seventh operation performed by the user to operate the first APP on the inner screen. In response to the seventh operation, the electronic device switches the interface of the first APP on the inner screen to display the content indicated by the seventh operation, and synchronously displays the content indicated by the seventh operation on the outer screen, so that the inner and outer screens display the same content. The seventh operation can be any operation of switching interfaces on the interface of the first APP. That is, when the user turns on the collaborative function, if the mirror collaborative mode is selected, the outer screen can display the same content as the inner screen. In this embodiment, after turning on the collaborative function of the mirror collaborative mode, the user can keep the same interface of the outer screen and the inner screen to realize screen sharing, without the need for multiple people to watch the same screen, which causes the inconvenience of adjusting and flipping the electronic device. This method makes screen sharing more convenient and improves the user experience.
[0263] In some embodiments, the first APP is any one of a gallery APP, a video APP, and a document APP. The user can share the interface of the gallery APP, video APP, document APP, etc. to the external screen by turning on the collaborative function of the inner screen and the external screen, which facilitates the user to share pictures, videos, documents, etc.
[0264] In some embodiments, when the first APP is a video APP, the second APP is a camera APP. When parents want to take pictures of their children, but are afraid that their children's lack of concentration will affect the shooting effect, they can open the video APP and turn on the asynchronous collaboration mode to share the interface of the video APP to the external screen to attract the child's attention. Then the parents open the camera APP to shoot, which can ensure that the child's attention is directed towards the electronic device being shot, making it convenient for users to shoot their children and ensuring the shooting effect.
[0265] The above describes in detail an example of the screen display method provided by the present application. It is understandable that, in order to implement the above functions, the corresponding device includes a hardware structure and / or software module corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present application.
[0266] The present application can divide the screen display device into functional modules according to the above method example. For example, each function can be divided into each functional module, or two or more functions can be integrated into one module. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.
[0267] Fig.21 The structure diagram of a screen display device provided by the present application is shown. The device 2100 is applied to an electronic device, the electronic device includes a first screen and a second screen, the first screen and the second screen are respectively arranged on opposite sides of the electronic device, for example, the electronic device includes an inner screen and an outer screen, including:
[0268] The first receiving module 2101 is used to receive a first operation performed by a user.
[0269] The first display module 2102 is used to display a first interface on the first screen in response to the first operation, where the first interface includes a first control.
[0270] The first receiving module 2101 is further configured to receive a second operation of the user on the first control.
[0271] The first display module 2102 is further configured to display a second interface corresponding to the first control on the second screen in response to the second operation.
[0272] In some embodiments, a second display module 2103 is further included, which is used to display a third interface on the first screen, and the third interface is the interface of the first APP.
[0273] The first receiving module 2101 is specifically configured to receive the first operation when the first screen displays the third interface.
[0274] In some embodiments, the first APP is any one of a browser APP, a video APP, a game APP, a conference APP, a document APP and a video call APP.
[0275] In some embodiments, the first operation is an operation of sliding down the first screen to start a drop-down taskbar and clicking a control of a quick service in the drop-down taskbar.
[0276] In some embodiments, the first operation is an operation of double-clicking the second screen.
[0277] In some embodiments, the first interface includes: at least one of a payment code control, a ride code control, and a personal health code control.
[0278] In some embodiments, the first interface is a window of a quick service, and the first receiving module 2101 is further used to receive a third operation performed by a user, where the third operation is an operation of clicking a menu control in the first interface.
[0279] The second display module 2103 is also used to display an APP management list in the first screen in response to the third operation, wherein the APP management list includes multiple icons of APPs supporting quick services and multiple status buttons, and the multiple icons of APPs supporting quick services and the multiple status buttons correspond one to one.
[0280] The first receiving module 2101 is further used to receive a fourth operation performed by the user, where the fourth operation is an operation performed on a target state button, and the target state button is any one of the state buttons.
[0281] The second display module 2103 is further configured to, in response to the fourth operation, add or delete an icon of an APP supporting the quick service corresponding to the target state button in the quick service window.
[0282] Fig. 22 The structure diagram of a screen display device provided by the present application is shown. The device 2200 is applied to an electronic device, the electronic device includes a first screen and a second screen, the first screen and the second screen are respectively arranged on opposite sides of the electronic device, for example, the electronic device includes an inner screen and an outer screen, including:
[0283] The third display module 2201 is used to display a first interface on a first screen, where the first interface is one of the following interfaces: a lock screen interface, an AOD interface, a desktop, and an interface of a first APP.
[0284] The second receiving module 2202 is used to receive a fifth operation performed by the user, where the fifth operation is an operation of turning on the collaborative function of the first screen and the external screen.
[0285] The fourth display module 2203 is used to display the interface of the first APP on the first screen in response to the fifth operation.
[0286] In some embodiments, when the mode of the collaborative function is an asynchronous collaborative mode, the second receiving module 2202 is further used to receive a sixth operation performed by the user, where the sixth operation is an operation of opening a second APP on the first screen.
[0287] The third display module 2201 is further used to display the interface of the second APP on the first screen in response to the sixth operation, and to display the interface of the first APP on the first screen in the form of a floating window.
[0288] In some embodiments, the fifth operation is sliding down in the first screen to start the drop-down taskbar and clicking the external screen collaboration control in the drop-down taskbar, and selecting the asynchronous collaboration operation in the pop-up external screen collaboration selection window.
[0289] In some embodiments, the sixth operation is an operation of exiting the interface of the first APP and opening the second APP from the desktop on the first screen; or, an operation of calling the sidebar and clicking the icon of the second APP in the sidebar on the first screen.
[0290] In some embodiments, when the mode of the collaborative function is a mirror collaboration mode, the second receiving module 2202 is further used to receive a seventh operation performed by the user, where the seventh operation is an operation of operating the first APP on the first screen.
[0291] The third display module 2201 is further configured to, in response to the seventh operation, display the content indicated by the seventh operation on the first screen.
[0292] The fourth display module 2203 is further configured to display the content indicated by the seventh operation on the second screen in response to the seventh operation.
[0293] In some embodiments, the fifth operation is sliding down in the first screen to start the drop-down taskbar and clicking the external screen collaboration control in the drop-down taskbar, and selecting the mirror collaboration operation in the pop-up external screen collaboration selection window.
[0294] In some embodiments, the first APP is any one of a gallery APP, a video APP, and a document APP.
[0295] In some embodiments, when the first APP is a video APP, the second APP is a camera APP.
[0296] The specific manner in which the device 2100 and the device 2200 execute the screen display method and the beneficial effects produced can be found in the relevant description of the method embodiment, which will not be repeated here.
[0297] The present application also provides an electronic device, including the above processor. The electronic device provided by this embodiment can be Figure 1 The terminal device 100 shown is used to execute the above-mentioned screen display method. In the case of an integrated unit, the terminal device may include a processing module, a storage module and a communication module. Among them, the processing module can be used to control and manage the actions of the terminal device, for example, it can be used to support the terminal device to execute the steps executed by the display unit, the detection unit and the processing unit. The storage module can be used to support the terminal device to execute the stored program code and data, etc. The communication module can be used to support the communication between the terminal device and other devices.
[0298] Among them, the processing module can be a processor or a controller. It can implement or execute various exemplary logic boxes, modules and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a digital signal processor (DSP) and a microprocessor, and so on. The storage module can be a memory. The communication module can specifically be a device that interacts with other terminal devices, such as a radio frequency circuit, a Bluetooth chip, a Wi-Fi chip, etc.
[0299] In one embodiment, when the processing module is a processor and the storage module is a memory, the terminal device involved in this embodiment may be a Figure 1 Device of the structure shown.
[0300] An embodiment of the present application further provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, the processor executes the screen display method described in any of the above embodiments.
[0301] The embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, the computer is caused to execute the above-mentioned related steps to implement the screen display method in the above-mentioned embodiment.
[0302] Among them, the electronic device, computer-readable storage medium, computer program product or chip provided in this embodiment are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above and will not be repeated here.
[0303] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, the replaced units may or may not be physically separated, and the components displayed as units may be one physical unit or multiple physical units, that is, they may be located in one place, or they may be distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the scheme of this embodiment.
[0304] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0305] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.
[0306] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A screen display method, applied to an electronic device, wherein the electronic device is a folding screen device, the electronic device comprises a first screen and a second screen, the first screen is an inner screen, and the second screen is an outer screen, It is characterized in that include: The payment APP sends registration information to the window manager through the second application program interface, where the registration information is used to indicate that the payment APP can provide an external screen collaboration service; When the electronic device is in the unfolded state and the first screen displays the third interface, the input manager recognizes a first operation input by the user and obtains a first recognition result, the third interface is: any one of a lock screen interface, an off-screen AOD interface, a desktop, and an interface of a first application APP, and the first operation is an operation of turning on external screen collaboration in the first screen; The window manager adds a window of the shortcut service in response to the first recognition result, and sends an instruction of completing the adding of the first window to the system user interface through a first application program interface, wherein the first application program interface is different from the second application program interface; The system user interface draws a window of the shortcut service in response to the instruction of the completion of adding the first window sent by the window manager, and sends a message of the completion of the first drawing to the window manager through the first application program interface after the drawing is completed; The window manager sends a first display message to the display manager in response to the first drawing completion message received by the system user interface, wherein the first display message includes information that the quick service window is displayed by the first screen and the second screen; In response to the first display message, the display manager controls the first screen to display a first interface in a display area of the third interface, and controls the second screen to display a window of the shortcut service, wherein the first interface is a window of the shortcut service, the first interface includes a first control, and the first control is one of a plurality of service controls in the window of the shortcut service; The input manager identifies a second operation of the user on the first control to obtain a second identification result; In response to the second recognition result, the window manager adds a payment window corresponding to the first control, and sends an instruction to the payment APP through the first application program interface indicating that the second window has been added; The payment APP draws the payment page in response to the instruction sent by the window manager indicating that the second window has been added, and after the drawing is completed, sends a message to the window manager indicating that the second window has been added through the first application program interface; In response to the second drawing completion message, the window manager sends a second display message to the display manager, wherein the second display message includes information that the first screen and the second screen display the payment page; In response to the second display message, the display manager controls the second screen to display a second interface corresponding to the first control, and controls the second interface to be displayed in suspension in the first screen, where the second interface is a payment interface of the payment APP.
2. The method according to claim 1, It is characterized in that The first application APP is any one of a browser APP, a video APP, a game APP, a conference APP, a document APP and a video call APP.
3. The method according to any one of claims 1 or 2, It is characterized in that The first operation is to slide down the first screen to start the drop-down taskbar and click a control of the quick service in the drop-down taskbar.
4. The method according to any one of claims 1 or 2, It is characterized in that The first interface includes: at least one of a payment code control, a ride code control, and a personal health code control.
5. The method according to any one of claims 1 or 2, It is characterized in that The method further comprises: Receiving a third operation performed by a user, where the third operation is an operation of clicking a second control in the first interface; In response to the third operation, displaying an APP management list on the first screen, the APP management list including a plurality of icons of APPs supporting quick services and a plurality of status buttons, and the plurality of icons of APPs supporting quick services and the plurality of status buttons correspond one to one; receiving a fourth operation performed by a user, wherein the fourth operation is an operation performed on a target state button, and the target state button is any one of the state buttons; In response to the fourth operation, an icon of an APP supporting the quick service corresponding to the target state button is added or deleted in the quick service window.
6. A screen display method, applied to an electronic device, wherein the electronic device is a folding screen device, the electronic device comprises a first screen and a second screen, the first screen is an inner screen, and the second screen is an outer screen, It is characterized in that include: The video player sends registration information to the window manager through the second application program interface, where the registration information is used to indicate that the video player can provide an external screen collaboration service; When the electronic device is in the unfolded state, a third interface is displayed on the first screen, and the third interface is one of the following interfaces: a lock screen interface, an AOD interface, a desktop, and an interface of a first application APP; The input manager recognizes a fifth operation performed by the user to obtain a third recognition result, wherein the fifth operation is an operation of opening a collaborative function between the first screen and the second screen; The window manager adds a window of the video player in response to the third recognition result, and sends an instruction to the video player through a first application program interface indicating that the third window has been added, wherein the first application program interface is different from the second application program interface; The video player draws the video page in response to the instruction sent by the window manager that the third window has been added, and after the drawing is completed, sends a message to the window manager through the first application program interface that the third drawing is completed; The window manager sends a third display message to the display manager in response to the third drawing completion message received by the video player, wherein the third display message includes information about a page of the video player displayed by the first screen; The display manager controls the first screen to display a page of the video player; When the mode of the collaborative function is an asynchronous collaborative mode, receiving a sixth operation performed by a user, wherein the sixth operation is an operation of opening a second APP on the first screen, and the second APP is a camera APP; In response to the sixth operation, the display manager controls the first screen to display the interface of the second APP, and the display manager controls the second screen to display the page of the video player in the form of a floating window.
7. The method according to claim 6, It is characterized in that The fifth operation is to slide down in the first screen to start the drop-down taskbar and click the external screen collaboration control in the drop-down taskbar, and select the asynchronous collaboration operation in the pop-up external screen collaboration selection window.
8. The method according to claim 6 or 7, It is characterized in that The sixth operation is an operation of exiting the interface of the first application APP and opening the second APP from the desktop on the first screen; or, an operation of calling the sidebar and clicking the icon of the second APP in the sidebar on the first screen.
9. The method according to claim 8, It is characterized in that When the mode of the collaborative function is a mirror collaboration mode, the method further includes: receiving a seventh operation performed by a user, wherein the seventh operation is an operation of operating the first application APP on the first screen; In response to the seventh operation, the content indicated by the seventh operation is synchronously displayed on the first screen and the second screen.
10. The method according to claim 9, It is characterized in that The fifth operation is to slide down in the first screen to start the drop-down taskbar and click the external screen collaboration control in the drop-down taskbar, and select the mirror collaboration operation in the pop-up external screen collaboration selection window.
11. An electronic device, comprising a first screen and a second screen, wherein the first screen is an inner screen and the second screen is an outer screen. It is characterized in that include: Processors, memory, and interfaces; The processor, the memory and the interface cooperate with each other so that the electronic device executes the method as claimed in any one of claims 1 to 10.
12. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor is caused to perform the method according to any one of claims 1 to 10.
13. A computer program product, It is characterized in that The computer program product comprises: a computer program code, and when the computer program code is run on an electronic device, the electronic device is enabled to perform the method according to any one of claims 1 to 10.
