Display method and electronic device

Abstract

The present application provides a display method and an electronic device. The display method is applied to a first device, and comprises: in response to a first operation of a user, displaying a medium-shot interface, the medium-shot interface being used for displaying windows of applications in an application set, and the application set comprising all of foreground applications and background applications of the first device and a second device; and, in response to a second operation of the user in respect of a control on an application interface on the medium-shot interface corresponding to a main window, refreshing the application interface corresponding to the main window. The technical solution provided in the embodiments of the present application can improve the collaboration efficiency of different devices.

Description

Display method and electronic device

[0001] The present application claims priority to the Chinese patent application No. 202411292294.X, filed on September 13, 2024, and entitled "Display method and electronic device", the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD

[0002] The present application relates to the field of electronic devices, and more particularly, to a display method and an electronic device. BACKGROUND

[0003] With the development of electronic devices and mobile Internet, the same user can often have multiple electronic devices at the same time, such as mobile phones, tablet computers, personal computers, smart home devices, etc.

[0004] Different devices have different capabilities, such as tablets, smart TVs, etc. have a larger display screen, and mobile phones have better camera capabilities. Through the cooperative work of multiple devices, the capabilities of different types of electronic devices can be fully called, the ability of devices to handle different tasks in different scenarios is improved, and the user's experience is improved.

[0005] However, how to improve the efficiency of cooperative task processing between multiple devices is a problem worth considering. SUMMARY

[0006] The present application provides a display method and an electronic device, which can improve the efficiency of cooperation of different devices.

[0007] In a first aspect, a display method is provided, which is applied to a first device, and includes: in response to a first operation of a user, displaying a mid-scene interface, the mid-scene interface being used to display a window of an application in an application set, the application set including all foreground applications and background applications of the first device and a second device; in response to a second operation of the user on a control on an application interface corresponding to a main window in the mid-scene interface, refreshing the application interface corresponding to the main window.

[0008] In combination with the first aspect, in some implementations of the first aspect, the main window is a window of a first application, and the first operation is an operation on a full-screen interface of the first application.

[0009] In combination with the first aspect, in some implementations of the first aspect, the method further includes: in response to a third operation of the user on the mid-scene interface, updating a window of a second application to the main window.

[0010] With reference to the first aspect, in some implementations of the first aspect, the third operation is a sliding operation of a user on the mid-scene interface, and the method further includes: in response to the third operation, the window of the first application moves out of a display screen area of the first device along a sliding direction, and the window of the second application moves into the display screen area of the first device along the sliding direction.

[0011] With reference to the first aspect, in some implementations of the first aspect, the second application is an application of the second device, and before updating the window of the second application as the main window, the method further includes: receiving first information, the first information being used to indicate interface information of the second application.

[0012] With reference to the first aspect, in some implementations of the first aspect, the method further includes: in response to the third operation, sending second information to the second device, the second information being used to instruct the second device to update the main window on a mid-scene interface of the second device.

[0013] With reference to the first aspect, in some implementations of the first aspect, a size of the main window is determined according to a size of a display screen of the first device.

[0014] With reference to the first aspect, in some implementations of the first aspect, the method further includes: in response to a fourth operation of a user on the mid-scene interface, displaying a mid-scene multi-task interface, the mid-scene multi-task interface being used to display cards corresponding to all applications in the application set, and the mid-scene multi-task interface including a plurality of application cards.

[0015] With reference to the first aspect, in some implementations of the first aspect, the method further includes: in response to a selection operation of a user on a card of a third application in the application set on the mid-scene multi-task interface, displaying the mid-scene interface, and the main window being updated as a window of the third application.

[0016] With reference to the first aspect, in some implementations of the first aspect, the mid-scene interface is used to display windows of applications in the application set in a first sequence, and the first sequence is related to an operation sequence of the user on the applications in the application set.

[0017] With reference to the first aspect, in some implementations of the first aspect, the method further includes: in response to the first operation, sending third information to the second device, the third information being used to instruct the second device to display a mid-scene interface.

[0018] With reference to the first aspect, in some implementations of the first aspect, the first operation is used to select the second device to perform mid-scene cooperation with the first device.

[0019] With reference to the first aspect, in some implementations of the first aspect, the first operation is configured to instruct the first device to display a mid-scene interface, and the method further includes: obtaining, by the first device, mid-scene capability information of a plurality of devices, and the second instruction is sent according to that the second device supports a mid-scene mode.

[0020] The second aspect provides a display method, which is applied to a second device, and the method includes: displaying a mid-scene interface in response to third information received from a first device, the mid-scene interface is used to display windows of applications in an application set, the application set includes all foreground applications and background applications of the first device and the second device, and the mid-scene interface includes a main window that can be interacted.

[0021] With reference to the second aspect, in some implementations of the second aspect, the second application is an application of the second device, and before the window of the second application is updated as the main window, the method further includes: receiving first information, the first information is used to indicate interface information of the second application.

[0022] With reference to the second aspect, in some implementations of the second aspect, the method further includes: receiving second information from the first device, the second information is used to instruct the second device to update the main window on the mid-scene interface of the second device.

[0023] The third aspect provides an electronic device, which is a first device, and includes: one or more processors; a memory, the memory including instructions; and when the instructions are executed by the one or more processors, the electronic device performs the following steps: in response to a first operation of a user, displaying a mid-scene interface, the mid-scene interface is used to display windows of applications in an application set, the application set includes all foreground applications and background applications of the first device and a second device; and in response to a second operation of the user on a control on an application interface of a main window in the mid-scene interface, refreshing the application interface of the main window.

[0024] With reference to the third aspect, in some implementations of the third aspect, the main window is a window of a first application, and the first operation is an operation on a full-screen interface of the first application.

[0025] With reference to the third aspect, in some implementations of the third aspect, when the instructions are executed by the one or more processors, the electronic device performs the following steps: in response to a third operation of the user on the mid-scene interface, updating a window of a second application as the main window.

[0026] With reference to the third aspect, in some implementations of the third aspect, the third operation is a sliding operation of a user on the mid-scene interface, and the instructions, when executed by the one or more processors, cause the electronic device to perform the following steps: in response to the third operation, the window of the first application moves out of a display screen area of the first device along a sliding direction, and the window of the second application moves into the display screen area of the first device along the sliding direction.

[0027] With reference to the third aspect, in some implementations of the third aspect, the second application is an application of the second device, and the instructions, when executed by the one or more processors, cause the electronic device to perform the following steps: before updating the window of the second application as the main window, receiving first information, the first information being used to indicate interface information of the second application.

[0028] With reference to the third aspect, in some implementations of the third aspect, the instructions, when executed by the one or more processors, cause the electronic device to perform the following steps: in response to the third operation, sending second information to the second device, the second information being used to instruct the second device to update the main window on a mid-scene interface of the second device.

[0029] With reference to the third aspect, in some implementations of the third aspect, a size of the main window is determined according to a size of a display screen of the first device.

[0030] With reference to the third aspect, in some implementations of the third aspect, the instructions, when executed by the one or more processors, cause the electronic device to perform the following steps: in response to a fourth operation of a user on the mid-scene interface, displaying a mid-scene multi-task interface, the mid-scene multi-task interface being used to display cards corresponding to all applications in the application set, and the mid-scene multi-task interface including a plurality of application cards.

[0031] With reference to the third aspect, in some implementations of the third aspect, the instructions, when executed by the one or more processors, cause the electronic device to perform the following steps: in response to a selection operation of a user on a card of a third application in the application set on the mid-scene multi-task interface, displaying the mid-scene interface, and the main window being updated as a window of the third application.

[0032] With reference to the third aspect, in some implementations of the third aspect, the mid-scene interface is used to display windows of applications in the application set in a first sequence, and the first sequence is related to an operation sequence of the user on the applications in the application set.

[0033] With reference to the third aspect, in some implementations of the third aspect, when the instructions are executed by the one or more processors, the electronic device performs the following steps: in response to the first operation, sending third information to the second device, the third information being used to instruct the second device to display a mid-scene interface.

[0034] With reference to the third aspect, in some implementations of the third aspect, the first operation is used to select the second device to perform mid-scene collaboration with the first device.

[0035] With reference to the third aspect, in some implementations of the third aspect, the first operation is used to instruct the first device to display a mid-scene interface, and the method further includes: the first device obtaining mid-scene capability information of a plurality of devices, and the second instruction being sent according to that the second device supports a mid-scene mode.

[0036] A fourth aspect provides an electronic device, which is a second device, including: one or more processors; a memory, the memory including instructions; when the instructions are executed by the one or more processors, the electronic device performs the following steps: in response to third information received from a first device, displaying a mid-scene interface, the mid-scene interface being used to display windows of applications in an application set, the application set including all foreground applications and background applications of the first device and the second device, and the mid-scene interface including a main window that is interactable.

[0037] With reference to the fourth aspect, in some implementations of the fourth aspect, the second application is an application of the second device, and when the instructions are executed by the one or more processors, the electronic device performs the following steps: before updating the window of the second application to the main window, receiving first information, the first information being used to instruct interface information of the second application.

[0038] With reference to the fourth aspect, in some implementations of the fourth aspect, the method further includes: receiving second information from the first device, the second information being used to instruct the second device to update the main window on the mid-scene interface of the second device.

[0039] A fifth aspect provides a computer-readable storage medium, the computer-readable storage medium including a computer program or instructions, when the computer program or instructions are run on a computer, causing the method of the first aspect and any implementation of the first aspect or the second aspect and any implementation of the second aspect to be executed.

[0040] In a sixth aspect, a computer program product is provided, which includes a computer program or instructions, when the computer program or instructions are run on a computer, cause the method of the first aspect and any implementation of the first aspect or the second aspect and any implementation of the second aspect to be performed.

[0041] In a seventh aspect, a computer program is provided, when it is run on a computer, causes the method of the first aspect and any implementation of the first aspect or the second aspect and any implementation of the second aspect to be performed. BRIEF DESCRIPTION OF DRAWINGS

[0042] FIG. 1 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application.

[0043] FIG. 2 is a schematic diagram of a software structure of an electronic device according to an embodiment of the present application.

[0044] FIG. 3 is a set of GUIs according to an embodiment of the present application.

[0045] FIG. 4 is a set of GUIs according to an embodiment of the present application.

[0046] FIG. 5 is a set of GUIs according to an embodiment of the present application.

[0047] FIG. 6 is a set of GUIs according to an embodiment of the present application.

[0048] FIG. 7 is a set of GUIs according to an embodiment of the present application.

[0049] FIG. 8 is a schematic flowchart of a display method according to an embodiment of the present application.

[0050] FIG. 9 is a schematic flowchart of a display method according to an embodiment of the present application. DETAILED DESCRIPTION

[0051] The technical solutions in the present application will be described below with reference to the accompanying drawings.

[0052] The technical solutions in the present application will be described below with reference to the accompanying drawings.

[0053] The terminology used in the following description merely to convey the particular embodiments and is not intended to limit the application. As used in this specification and the appended claims, the singular forms "a," "an," and "the" include plural referents unless the context clearly dictates otherwise. It should also be understood that the term "and / or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items. The term "or" as used herein is used to mean, in the alternative (either if or), both if yes and if no, and the like. The term "and / or," as used herein, refers to and encompasses any and all possible combinations of one or more of the associated listed items. The term "and / or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

[0054] Reference throughout this specification to "one embodiment", "some embodiments" or "an embodiment" means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the application. Thus, appearances of the phrases "in one embodiment", "in some embodiments", "in other embodiments", "in additional embodiments" and the like in various places throughout this specification are not necessarily referring to the same embodiment, unless otherwise expressly specified. The terms "including", "containing", "having" and variations thereof mean "including but not limited to", unless expressly specified otherwise.

[0055] The following introduces electronic devices, user interfaces for such electronic devices, and embodiments for using such electronic devices.

[0056] Exemplarily, FIG. 1 shows a structural schematic diagram of an electronic device 100. The electronic device 100 can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a loudspeaker 170A, a receiver 170B, a microphone 170C, a headset jack 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, and the like. The sensor module 180 can include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

[0057] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can include more or fewer components than shown, or combine certain components, or split certain components, or different arrangement of components. The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0058] The processor 110 can include one or more processing units, for example: the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), and the like. Different processing units can be independent devices, or can be integrated in one or more processors.

[0059] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to instruction operation codes and timing signals, and complete the control of fetching instructions and executing instructions.

[0060] The processor 110 can also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can hold instructions or data that the processor 110 has just used or is using in a loop. If the processor 110 needs to use the instructions or data again, it can be called directly from the memory. This avoids repeated access and reduces the latency of the processor 110, thus improving the efficiency of the system.

[0061] In some embodiments, the processor 110 can include one or more interfaces. The interfaces can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0062] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor, etc.

[0063] The antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example: the antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In some other embodiments, the antennas can be used in combination with a tuning switch.

[0064] The mobile communication module 150 can provide a solution for wireless communication including 2G / 3G / 4G / 5G, etc. applied to the electronic device 100. The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves by the antenna 1, and perform filtering, amplification, etc. on the received electromagnetic waves, and transfer the same to the modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor, and radiate the same as electromagnetic waves through the antenna 1. In some embodiments, at least part of the functional modules of the mobile communication module 150 can be disposed in the processor 110. In some embodiments, at least part of the functional modules of the mobile communication module 150 can be disposed in the same device as at least part of the modules of the processor 110.

[0065] The modem processor can include a modulator and a demodulator. The modulator is configured to modulate a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is configured to demodulate a received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal processed by the baseband processor is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the microphone 170B, etc.), or displays an image or a video through the display screen 194. In some embodiments, the modem processor can be a separate device. In other embodiments, the modem processor can be independent of the processor 110, and disposed in the same device as the mobile communication module 150 or other functional modules.

[0066] The wireless communication module 160 can provide a solution for wireless communication including wireless local area networks (WLAN) (e.g., wireless fidelity (Wi-Fi) network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, etc. applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives an electromagnetic wave via the antenna 2, frequency-modulates and filters the electromagnetic wave signal, and transmits the processed signal to the processor 110. The wireless communication module 160 can also receive a signal to be transmitted from the processor 110, frequency-modulate it, amplify it, and radiate it as an electromagnetic wave via the antenna 2.

[0067] In some embodiments, the antenna 1 and the mobile communication module 150 of the electronic device 100 are coupled, and the antenna 2 and the wireless communication module 160 are coupled, so that the electronic device 100 can communicate with a network and other devices through wireless communication technology. The wireless communication technology can include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-CDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS can include global positioning system (GPS), global navigation satellite system (GLONASS), beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS), and / or satellite based augmentation systems (SBAS).

[0068] The electronic device 100 implements a display function through a GPU, a display screen 194, and an application processor, etc. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs, which execute program instructions to generate or change display information.

[0069] The display screen 194 is configured to display images, videos, and the like. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flex light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-OLed, a quantum dot light emitting diodes (QLED), or the like. In some embodiments, the electronic device 100 can include one or N display screens 194, where N is a positive integer greater than 1.

[0070] The electronic device 100 can implement the photographing function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, and the application processor.

[0071] The ISP is configured to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing to convert it into an image visible to the naked eye. The ISP can also optimize the noise, brightness, and skin color of the image. The ISP can also optimize the exposure, color temperature, and other parameters of the shooting scene. In some embodiments, the ISP can be disposed in the camera 193.

[0072] The camera 193 is configured to capture still images or videos. An object generates an optical image through a lens and projects it onto a photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then transmitted to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. In some embodiments, the electronic device 100 can include one or N cameras 193, where N is a positive integer greater than 1.

[0073] The digital signal processor is used to process digital signals, in addition to being able to process digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.

[0074] The video codec is used to compress or decompress digital video. The electronic device 100 can support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple encoding formats, such as: moving picture experts group (MPEG) 1, MPEG 2, MPEG 3, MPEG 4, etc.

[0075] The NPU is a neural-network (NN) calculation processor, which can quickly process input information by drawing on the structure of a biological neural network, such as drawing on the transmission mode between human brain neurons, and can also constantly self-learn. Through the NPU, the electronic device 100 can realize intelligent cognition applications such as image recognition, face recognition, voice recognition, text understanding, etc.

[0076] The external memory interface 120 can be used to connect an external storage card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external storage card communicates with the processor 110 through the external memory interface 120 to realize data storage functions. For example, music, video, etc. Files are saved in the external storage card.

[0077] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various function applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 can include a program storage area and a data storage area. The program storage area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0078] The electronic device 100 can realize audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor, etc. For example, music playing, recording, etc.

[0079] The audio module 170 is used for converting digital audio information into an analog audio signal output, and for converting an analog audio input into a digital audio signal. The audio module 170 can also be used for encoding and decoding an audio signal. In some embodiments, the audio module 170 can be disposed in the processor 110, or some functional modules of the audio module 170 can be disposed in the processor 110.

[0080] The speaker 170A, also referred to as a "loudspeaker", is used for converting an audio electrical signal into a sound signal. The electronic device 100 can listen to music or listen to a hands-free call through the speaker 170A.

[0081] The receiver 170B, also referred to as a "earpiece", is used for converting an audio electrical signal into a sound signal. When the electronic device 100 receives a call or a voice message, the user can listen to the voice through the receiver 170B close to the ear.

[0082] The microphone 170C, also referred to as a "microphone", "transducer", is used for converting a sound signal into an electrical signal. When making a call or sending a voice message, the user can make a sound through the mouth close to the microphone 170C, and input the sound signal into the microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, in addition to collecting sound signals, noise reduction functions can also be realized. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C, in addition to collecting sound signals, noise reduction, and can also identify the source of the sound, realize the function of directional recording, etc.

[0083] The pressure sensor 180A is used for sensing a pressure signal, and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can include at least two parallel plates with conductive material. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change of the capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic device 100 can also calculate the position of the touch according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example, when a touch operation with a touch operation intensity greater than or equal to a first pressure threshold value acts on an alarm application icon, an instruction to create a new alarm is executed.

[0084] The fingerprint sensor 180H is used to collect a fingerprint. The electronic device 100 can implement fingerprint unlocking, access to an application lock, fingerprint photographing, fingerprint answering a call, and the like using a characteristic of the collected fingerprint. For example, when the mobile phone detects a touch operation of a user in a lock screen interface, the mobile phone can collect fingerprint information of the user through the fingerprint sensor 180H and match the collected fingerprint information with fingerprint information pre-stored in the mobile phone. If the matching is successful, the mobile phone can enter a non-lock screen interface from the lock screen interface.

[0085] The touch sensor 180K, also referred to as a "touch panel". The touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also referred to as a "touch screen". The touch sensor 180K is used to detect a touch operation acting on or near the touch sensor 180K. The touch sensor 180K can transmit the detected touch operation to the application processor to determine a touch event type. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100, which is different from the position where the display screen 194 is located.

[0086] FIG. 2 is a software structure block diagram of the electronic device 100 according to an embodiment of the present application. A layered architecture divides the software into several layers, each of which has a clear role and division of labor. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, the application layer, the application framework layer, the Android runtime and the system library, and the kernel layer. The application layer can include a series of application packages.

[0087] As shown in FIG. 2, the application layer can include a camera, a setting, a third-party application, and the like. Among them, the third-party application can include a gallery, a calendar, a call, a map, a navigation, a WLAN, a Bluetooth, music, a video, a short message, and the like.

[0088] The application framework layer provides an application programming interface (API) and a programming framework for the applications of the application layer. The application framework layer can include some pre-defined functions.

[0089] As shown in FIG. 2, the application framework layer can include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0090] The window manager is used to manage windows programs. The window manager can acquire the display screen size, determine whether there is a status bar, lock the screen, and capture the screen, etc. The content provider is used to store and acquire data, and make the data accessible to the application program. The data can include video, image, audio, dialed and received phone, browsing history and bookmark, phone book, etc.

[0091] The view system includes visual controls, such as a control for displaying text, a control for displaying pictures, etc., such as the indication information for prompting the virtual shutter key in the embodiment of the present application. The view system can be used to build an application program. The display interface can be composed of one or more views. For example, the display interface including the short message notification icon can include a view for displaying text and a view for displaying pictures.

[0092] The phone manager is used to provide the communication function of the electronic device 100. For example, the management of the call state (including call connection, call hang-up, etc.).

[0093] The resource manager provides various resources for the application program, such as localized strings, icons, pictures, layout files, video files, etc.

[0094] The notification manager makes the application program display the notification information in the status bar, which can be used to convey the message of the notification type, and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify the completion of the download, the message reminder, etc. The notification manager can also be the notification appearing in the top status bar of the system in the form of a chart or a scroll bar text, such as the notification of the application program running in the background, and can also be the notification appearing on the screen in the form of a dialogue window. For example, the text information is prompted in the status bar, a prompt sound is emitted, the electronic device is vibrated, the indicator light flashes, etc.

[0095] The Android runtime includes the core library and the virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.

[0096] The core library includes two parts: one part is the function function called by the java language, and the other part is the core library of Android.

[0097] The application program layer and the application program framework layer run in the virtual machine. The virtual machine executes the java file of the application program layer and the application program framework layer into a binary file. The virtual machine is used to perform the management of the object life cycle, the management of the stack, the management of the thread, the management of the security and exception, and the garbage collection, etc.

[0098] The system library can include a plurality of functional modules. For example, a surface manager, media libraries, a three-dimensional graphics processing library (e.g., OpenGL ES), a 2D graphics engine (e.g., SGL), and the like.

[0099] The surface manager is used to manage the display subsystem and provides a plurality of applications with fusion of 2D and 3D layers.

[0100] The media libraries support a plurality of commonly used audio, video format playback and recording, and static image files, and the like. The media libraries can support a plurality of audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, and the like.

[0101] The three-dimensional graphics processing library is used to implement three-dimensional graphics drawing, image rendering, synthesis, and layer processing, and the like.

[0102] The 2D graphics engine is a drawing engine for 2D drawing.

[0103] In addition, the system library can also include a state monitoring service module, such as a physical state identification module, used to analyze and identify user gestures; a sensor service module, used to monitor sensor data uploaded by various sensors of the hardware layer to determine the physical state of the electronic device 100.

[0104] The kernel layer is a layer between hardware and software. The kernel layer at least includes display drivers, camera drivers, audio drivers, and sensor drivers.

[0105] The hardware layer can include various sensors, such as the various sensors introduced in FIG. 1, the acceleration sensor, the gyroscope sensor, the touch sensor, and the like involved in the embodiments of the present application.

[0106] Through the collaborative work of a plurality of devices, the capabilities of different types of electronic devices can be fully called, the ability of the devices to handle different tasks in different scenarios can be improved, and the user experience can be improved. However, the existing collaboration mechanism is not efficient. Based on this, the embodiments of the present application provide a display method that can improve the efficiency of collaboration. The following first introduces the display method provided by the embodiments of the present application in combination with the graphical user interfaces (GUIs) shown in FIGS. 3-7.

[0107] FIG. 3 is a group of GUIs provided by the embodiments of the present application.

[0108] As shown in (a) of FIG. 3, the mobile phone displays an interface 310 of a video application. The user can trigger the mobile phone to display a medium shot interface 320 as shown in (b) of FIG. 3 by, for example, a three-finger up swipe operation at any position on the interface 310.

[0109] Before displaying the mid-scene interface on the phone, the device that cooperates with the phone in the mid-scene needs to be determined. The device that cooperates with the phone in the mid-scene can be one or more devices.

[0110] In an embodiment of the present application, the device that cooperates with the phone in the mid-scene can be selected by the user. For example, when the user performs a three-finger up swipe on the interface 310, as shown in (c) of FIG. 3, an option box 311 can be popped up on the interface 310 to prompt the user to select the device that needs to cooperate with the phone in the mid-scene. After the user selects one or more appropriate devices and clicks the "Confirm" on the option box 311, the phone displays the mid-scene interface 320.

[0111] The device that can be selected by the user in the option box 311 can be a device that logs in the same account as the phone and supports the mid-scene mode, or a device that is in the same wireless network as the phone and supports the mid-scene mode, or a device that logs in the same account as the phone, is less than a threshold distance away, and supports the mid-scene mode, or a device that has been connected to the phone through, for example, a super terminal, and supports the mid-scene mode.

[0112] In another embodiment of the present application, the device that cooperates with the phone in the mid-scene can be determined by a preset rule. For example, when the user performs a three-finger up swipe on the interface 310, the phone can search for a device that logs in the same account as the phone and supports the mid-scene mode, or a device that is in the same wireless network as the phone and supports the mid-scene mode, or a device that logs in the same account as the phone, is less than a threshold distance away, and supports the mid-scene mode, or a device that has been connected to the phone through, for example, a super terminal, and supports the mid-scene mode. After the devices are determined, if the phone and the devices have not been connected, the phone can trigger the connection to the devices through various ways.

[0113] In an embodiment of the present application, whether a device supports the mid-scene mode can be determined by the model, version number, or specific interface of the device. For example, whether a device supports the mid-scene mode can be determined by the interface isSupportMidScene.

[0114] As shown in (b) of FIG. 3, the mid-scene interface 320 can include a main window corresponding to the application 1. The user can switch the main window on the mid-scene interface through different operation modes, so that the mid-scene interface can display the windows of the foreground and background applications of the phone and all the devices that cooperate with the phone in the mid-scene (hereinafter referred to as the application set). In order to facilitate the description, the technical solutions of the embodiments of the present application are introduced by taking the tablet and the phone cooperating in the mid-scene as an example.

[0115] In the embodiments of the present application, the application corresponding to the main window on the medium-scene interface 320 can be the foreground application of the mobile phone when the user triggers the display of the medium-scene interface. In (a) of FIG. 3, the user performs three-finger up sliding on the interface of the video application to trigger the medium-scene mode, and thus the application corresponding to the main window of the medium-scene interface 320 in (b) of FIG. 3 is the video application.

[0116] In some embodiments, as shown in (d) of FIG. 3, the user can trigger the medium-scene mode on the desktop of the mobile phone, for example, the user can perform three-finger up sliding on the desktop 330 to trigger the mobile phone to display the medium-scene interface. Similarly, the desktop can pop up an option box to prompt the user to select the device to be cooperated with the mobile phone in the medium-scene mode, or the mobile phone can display the medium-scene interface 320 as shown in (b) of FIG. 3 after determining the device to be cooperated with the mobile phone in the medium-scene mode according to preset conditions. At this time, the application corresponding to the main window on the medium-scene interface 320 can be the background application that the user has recently operated on the mobile phone.

[0117] In the embodiments of the present application, the user can switch the main window on the medium-scene interface 320 by left and right sliding. For example, as shown in (e) and (f) of FIG. 3, when the user performs two-finger sliding on the medium-scene interface 320, the main window can be switched from the window corresponding to the application 1 to the window corresponding to the application 2.

[0118] In the embodiments of the present application, in order to enhance the experience of the user, when the sliding mode is used to switch the main window on the medium-scene interface, the animation of the window switching can be set. For example, on the medium-scene interface 320, in addition to the main window, the two sides can also include the partial side edge regions of the adjacent windows. As shown in (e) of FIG. 3, the partial side edge region of the window corresponding to the application 2 and the partial side edge region of the window corresponding to the application 5 are on the two sides of the display screen of the mobile phone (shown by solid lines), and the dashed lines schematically show the possible regions of the windows that are not displayed on the display screen.

[0119] When the user slides rightward on the medium-scene interface 320, the main window corresponding to the application 1 can move rightward along with the sliding of the user, move out of the display screen from the right side of the display screen, and the window corresponding to the application 2 can slide rightward to move into the display screen until completely entering the display screen and becoming the main window of the medium-scene interface 320. Of course, if the user slides leftward on the medium-scene interface 320, the window corresponding to the application 1 slides leftward out of the display screen, and the window corresponding to the application 5 slides leftward into the display screen. When the user keeps sliding in one direction, the windows of the applications in the application set can be displayed on the medium-scene interface in a certain order in a cycle. In addition, the regions of the adjacent windows on the two sides of the main window on the medium-scene interface can be distorted (as shown in (e) and (f) of FIG. 5) so as to present the effect that the windows slide in or out of the display screen in a three-dimensional manner.

[0120] The background of the whole mid-scene interface can be, for example, a desktop background, except for the part of the side area of the main window and the adjacent window. The top end can include a status bar for displaying icons of time, power, mode, etc.

[0121] Of course, in addition to sliding, the main window on the mid-scene interface can also be switched by other ways, such as knuckle tapping, etc. The application does not limit the way in which the user switches the main window on the mid-scene interface 320.

[0122] In the embodiments of the application, the device that triggers the display of the mid-scene interface by the user can be referred to as a main device (for example, a mobile phone in FIG. 3 that triggers the display of the mid-scene interface by the user performing a three-finger upward sliding), and other devices that cooperate with the main device in the mid-scene can be referred to as cooperative devices. The main device can trigger the cooperative devices to display the mid-scene interface, for example, the main device can call a remote procedure call (RPC) interface for multicasting, so that the cooperative devices enter the mid-scene mode and display the mid-scene interface.

[0123] The application corresponding to the main window on the mid-scene interface of each device can be the foreground application or the recently operated application of the device. The mid-scene interfaces displayed by different devices in the mid-scene cooperation can be different. When the user switches the main window on one device, the main window on the mid-scene interface of the other device can also change, that is, the interface of the application in the application set can flow on the display screens of the multiple devices.

[0124] For example, when it is determined that the tablet cooperates with the mobile phone in the mid-scene (selected by the user or determined according to a preset condition), the mobile phone can send indication information to the tablet, instructing the tablet to also enter the mid-scene interface.

[0125] FIG. 4 shows a schematic diagram of application flow provided by an embodiment of the application. As shown in FIG. 4, application 1, application 2 and application 3 can be applications on the mobile phone, and application 4 and application 5 can be applications on the tablet. Application 1 and application 4 are respectively the foreground application or the recently operated application of the mobile phone and the tablet. Therefore, when the mid-scene interface is displayed, the windows of application 1 and application 4 become the main windows of the mobile phone and the tablet respectively.

[0126] When the user slides to the right on the mobile phone, the window corresponding to application 2 becomes the main window of the mid-scene interface on the mobile phone, and at the same time, the window corresponding to application 5 becomes the main window of the mid-scene interface on the tablet. As described above, (e) and (f) of FIG. 3 are schematic diagrams of the interface before and after the user slides on the mid-scene interface 320 of the mobile phone, and (a) and (b) of FIG. 5 are schematic diagrams of the interface on the tablet. That is, when the user operates to switch the main window of the mid-scene interface on the mobile phone, the main window of the mid-scene interface on the tablet also switches accordingly.

[0127] It should be understood that when the user slides the window of the mid-scene interface on the mobile phone, the mobile phone can send information to other mid-scene collaborative devices to indicate that the other devices synchronously switch the main window of the mid-scene interface.

[0128] In the embodiments of the present application, the display order of the windows of the applications on the mid-scene interface can be determined according to the operation time of the applications.

[0129] For example, as shown in FIG. 4, for the applications 1, 2 and 3 of the mobile phone, the application 1 is the last application operated by the user on the mobile phone, and the application 3 is the first application operated. For the applications 4 and 5 of the tablet, the application 4 is the last application operated. For any device, the windows of the applications are arranged from left to right according to the operation time from early to late. Then, the windows of the five applications of the mobile phone and the tablet can be arranged in the order shown in FIG. 4, and then circulated on the display screens of the mobile phone and the tablet. It should be understood that the window A on the left of the window B in the embodiments of the present application can be understood as: when the window B is the main window and the user slides the screen to the right, the window A will become the main window; the window A on the right of the window B can be understood as: when the window B is the main window and the user slides the screen to the left, the window A will become the main window.

[0130] In some embodiments, for a single device, the windows of the applications can also be arranged from left to right according to the operation time from late to early. Then, the arrangement order of the windows of the applications from left to right can be: application 1, application 2, application 3, application 4 and application 5.

[0131] When there are only two devices, the arrangement order of the windows of the applications belonging to different devices does not affect the display order of the windows of the applications on the mid-scene interface of any device. For example, for the embodiment of FIG. 4, when the window of the application 3 becomes the main window of the mid-scene interface of the mobile phone, if the screen is continuously slid to the right on the mobile phone interface, the window of the application 4 will become the main window of the mid-scene interface of the mobile phone, and the windows of the five applications are circulated.

[0132] When there are three or more devices for mid-scene collaboration, the arrangement order of the windows of the applications of different devices can be related to factors such as the nature of the devices, the operation sequence of the user on different devices, etc. For example, assuming that there are three devices, the windows of the applications can be arranged from left to right according to the operation time from early to late; for another example, the windows of the applications can be arranged according to the types of the devices, for example, arranged from left to right according to the order of mobile phone, tablet, notebook computer and television.

[0133] Of course, the order of the windows of the applications can also be referred to other factors, which are not limited in the present application.

[0134] In the embodiments of the present application, the size of the main window on the device is related to the size of the display screen of the device. For example, for the same application, when the application is the main window on the mobile phone and the tablet, the window size is different.

[0135] FIG. 6 shows a schematic diagram of a video application corresponding window on the mid-scene interface of a mobile phone and a tablet. The video application can be an application on the mobile phone as described above. When the window of the video application is transferred to the tablet for display, the window of the application can be adjusted according to the size of the display screen of the tablet. For example, the size of the video application interface to be displayed can be adjusted by the tablet according to the size of the display screen (ScreenProperty) of the tablet so as to adapt the playing and display of the video application interface.

[0136] In the embodiments of the present application, in order to display the window of the application on the tablet on the mobile phone, the window information (which can also be referred to as interface information of the application) of the corresponding application can be actively requested by the tablet or the mobile phone to the tablet when the main window of the mid-scene interface of the mobile phone is the application on the tablet. For example, the window information can be encapsulated by the tablet as a sceneInfo object, and the application, window type and want (i.e. basic communication component of the system) information contained in the object can be recognized by the mobile phone, so that the mobile phone can display the window of the application on the tablet on the display screen of the mobile phone according to the information. Moreover, the tablet can send the required window information to the mobile phone according to the refresh rate of the mobile phone, so that the interface of the application can be displayed according to the display screen parameters of the mobile phone.

[0137] When the number of devices in the mid-scene cooperation is larger, the window information of the application of each device can be shared among the devices according to the refresh rate of each device, and the window information can use a format recognizable by each device, so as to adapt the transfer of the window of different applications on different devices.

[0138] It should be understood that the refresh rates of different devices can be different, and in the process of switching the main window by the user through sliding, the window of the application can be moved from one device to the display screen of another device. During the movement of the window, the state preview, state snapshot or other methods of the window can be used to form an animation of the movement process, and after the movement is completed, the corresponding window information can be shared according to the normal refresh rate, so as to avoid the feeling of picture fragmentation caused by the different refresh rates of the devices.

[0139] When the number of applications in the mid-scene cooperation is larger, in order to enable the user to quickly transfer a specific application to a specific device, for example, to quickly transfer a video playing application to a tablet with a large screen, the mid-scene multi-task interface can be used to assist the user to transfer the window of the application.

[0140] For example, the user can trigger the display of the mid-scene multi-task interface by operation on the mid-scene interface. The mid-scene multi-task interface can display a card of all applications in the application set. The user can select the card, and the window of the application corresponding to the card can be set as the main window of the mid-scene interface.

[0141] As shown in (a)-(c) of FIG. 7, when the user performs the five-finger pinch-in operation on the mid-scene interface 710, the mid-scene multitasking interface 720 is displayed, which is used to display the cards of the applications corresponding to all the windows in the mid-scene collaboration, and the size of the card can be smaller than the size of the main window on the mid-scene interface. The card on the mid-scene multitasking interface 720 can be similar to the card on the general multitasking interface, which can be a preview or a state snapshot of the application interface.

[0142] More than one card can be displayed on the mid-scene multitasking interface, for example, the cards on the mid-scene multitasking interface in (b) of FIG. 7 can be arranged in two rows. When the number of the application set is small, the cards can be completely displayed on the display screen, and when the number of the application set is large, the display screen can not be able to display all the cards, in which case the user can display the cards not displayed on the interface on the display screen by sliding the mid-scene multitasking interface, so as to quickly locate the card of the target application. When the user clicks the card corresponding to the application 2 on the interface 720, the mobile phone displays the mid-scene interface 730, and the main window is the window corresponding to the application 2.

[0143] In this way, the user can quickly display the window of the target application on the mid-scene interface of the specific device, reduce the operation complexity, and improve the user experience.

[0144] In some embodiments, when the primary device initiates the mid-scene collaboration, the other devices can also enter the mid-scene mode without directly displaying the mid-scene interface on the display screen, and when the user performs the three-finger up sliding operation on the device, the mid-scene interface is displayed on the device, and the details of the mid-scene interface of the device can refer to the foregoing description and will not be described herein again.

[0145] The user can exit the mid-scene interface by performing the three-finger sliding operation again on the mid-scene interface. Before exiting, the main window on the mid-scene interface can become the full-screen application window of the device, or can directly exit to the desktop interface.

[0146] It should be understood that in some embodiments, the user can also perform the three-finger up sliding operation on the interface including the floating window or the split-screen interface, so as to enter the mid-scene interface, in which case the main window of the mid-scene interface can be the window (that is, the focus window) last operated by the user. When the user exits the mid-scene window, the main window on the mid-scene interface can be displayed in full screen.

[0147] It can be understood that the manner in which the user triggers the display of the mid-scene interface and the mid-scene multitasking interface can also be other operation manners, for example, the double-finger / three-finger pinch-in operation, the knuckle tapping, and the like.

[0148] In addition, in the mid-scene collaboration process of different devices in the embodiments of the present application, the transmission of the window information and various types of indication information can be based on the super terminal.

[0149] FIG. 8 is a schematic flowchart of a display method according to an embodiment of the present application. The method comprises:

[0150] S310, in response to a first operation of the user, displaying a mid-scene interface, the mid-scene interface being used to display a window of an application in an application set, the application set comprising all foreground and background applications of the first device and the second device.

[0151] S320, in response to a second operation of the user on a control on the application interface corresponding to the main window in the mid-scene interface, refreshing the application interface corresponding to the main window.

[0152] In the embodiments of the present application, the mid-scene interface can be understood as an interface between the full screen and the multi-task interface. On the one hand, the mid-scene interface can switch the window displayed on the interface by simple sliding and other operations, like the multi-task interface. On the other hand, unlike the multi-task interface which only displays the cards of the applications, the mid-scene interface displays the window of the application, and the user can click the control in the window to achieve the operation experience similar to the full-screen application window. The user can efficiently operate the window of the application of different devices on one device through the mid-scene interface, and has a good experience.

[0153] The first operation can be, for example, a three-finger up sliding operation, a two-finger up sliding operation, a knuckle tapping operation, etc.

[0154] Through the technical solutions provided in the embodiments of the present application, the serial ports of the applications belonging to multiple devices can be conveniently operated and switched on one device, and the user experience is improved.

[0155] In some embodiments, the main window is a window of a first application, and the first operation is an operation on a full-screen interface of the first application.

[0156] That is, when the user triggers the display of the mid-scene interface on the full-screen interface of an application, the window of the application becomes the main window on the mid-scene interface.

[0157] In some embodiments, the method further comprises: in response to a third operation of the user on the mid-scene interface, updating a window of a second application as the main window.

[0158] In this embodiment, the third operation can be used to switch the main window on the mid-scene interface, for example, can be a sliding operation, a knuckle tapping operation, etc.

[0159] It should be understood that, in order to avoid the operation of switching the main window on the mid-scene interface from conflicting with the operation inside the main window, different sliding modes can be set to switch the main window, for example, double-finger sliding, three-finger sliding, etc. The position of the sliding can also be distinguished, for example, when switching the main window on the mid-scene interface, the position of the sliding can be the boundary position of the main window, etc.

[0160] In this embodiment, the operation mode of switching the main window of the mid-scene interface can be set by the user, so as to adapt to the operation habits of different users.

[0161] In some embodiments, the third operation is a sliding operation of the user on the mid-scene interface, and the method further includes: in response to the third operation, the window of the first application moves out of the display screen area of the first device along a sliding direction, and the window of the second application moves into the display screen area of the first device along the sliding direction.

[0162] In order to enhance the interest of the interface, an animation of sliding the window into or out of the display screen can be set when the window slides, and the boundary area of the two adjacent windows of the main window can be displayed on the mid-scene interface, so that the switching effect of the window is relatively smooth, and the user experience is better.

[0163] In some embodiments, the second application is an application of the second device, and before updating the window of the second application as the main window, the method further includes: receiving first information, the first information being used to indicate interface information of the second application. Correspondingly, the second device sends the first information.

[0164] In the process of mid-scene cooperation in different devices, when one device (which can be referred to as a target device) displays the window of the application of the other device (which can be referred to as a source device), the interface information of the application can be sent by the other device to the device, the interface information can include the position of the control on the interface, the basic component information, etc., and the interface information can use a unified format, so that the device information can be recognized by different devices.

[0165] The interface information can be sent by the source device to the target device according to the refresh rate of the source device.

[0166] In some embodiments, the method further includes: in response to the third operation, sending second information to the second device, the second information being used to instruct the second device to update the main window on the mid-scene interface of the second device. Correspondingly, the second device receives the second information.

[0167] In this embodiment, when updating the main window, the main device of the user triggering the display of the mid-scene interface can instruct the cooperative device to also update the main window of the corresponding mid-scene interface, so that all foreground and background applications of all devices participating in the mid-scene cooperation can produce the effect of being displayed on the virtual large display screen formed by the display screens of all devices, and the user can push the windows of different applications to other devices for display by operating on one device, thereby improving the convenience and experience of user operation.

[0168] In some embodiments, the size of the main window is determined according to the size of the display screen of the first device.

[0169] The size of the main window is adjusted according to the size of the display screen of the device, so that the same application can be adaptively displayed on different devices. For example, a user can push a video application to a large-screen device to obtain a large-screen display effect, or push a chat application to a small-screen device such as a mobile phone to obtain operation convenience and portability.

[0170] In some embodiments, the method further includes: in response to a fourth operation of a user on the mid-scene interface, displaying a mid-scene multitasking interface, the mid-scene multitasking interface being used to display cards corresponding to all applications in the application set, the mid-scene multitasking interface including a plurality of application cards.

[0171] When there are many applications to be displayed on the mid-scene interface, it may take a long time for the user to push the interface of a specific application to a specific device for display by switching one by one. Through the mid-scene multitasking interface, the user can quickly locate the card of a specific application and display the window of the application on the mid-scene interface, improving the operation convenience of the user.

[0172] In some embodiments, the method further includes: in response to a selection operation of a user on the card of a third application in the application set on the mid-scene multitasking interface, displaying the mid-scene interface, and the main window is updated to the window of the third application.

[0173] In some embodiments, the mid-scene interface is used to display the windows of the applications in the application set in a first sequence, and the first sequence is related to the operation sequence of the user on the applications.

[0174] The operation sequence of the application can be the time when the user last operated the device. Optionally, the first sequence can also be determined by referring to factors such as the operation time of the user on each application.

[0175] In some embodiments, the method further includes: in response to the first operation, sending third information to the second device, the third information being used to instruct the second device to display a mid-scene interface. Correspondingly, the second device receives the third information.

[0176] When the main device displays the mid-scene interface, the main device can also send information to the collaborative device to instruct the collaborative device to enter the mid-scene mode. The main device can notify these devices to display the mid-scene interface by unicast or multicast.

[0177] In some embodiments, the first operation is used to select the second device to perform mid-scene collaboration with the first device.

[0178] The user experience can be improved by allowing the user to select the device for mid-scene collaboration.

[0179] In some embodiments, the first operation is used to instruct the first device to display a mid-scene interface, and the method further includes: the first device obtaining mid-scene capability information of a plurality of devices, and the second instruction being sent according to the second device supporting the mid-scene mode.

[0180] The device for mid-scene collaboration is not selected by the user, but is screened by the master device according to conditions. Illustratively, the master device can select the devices supporting the mid-scene mode from the devices connected to the master device through, for example, a super terminal, and cause these devices to display a mid-scene interface.

[0181] FIG. 9 shows a schematic flowchart of a display method according to an embodiment of the present application, which includes:

[0182] S902, a plurality of devices are connected.

[0183] The plurality of devices can be connected, for example, through a super terminal.

[0184] S904, the master device displays a mid-scene interface.

[0185] S906, the master device instructs the devices supporting the mid-scene mode among the plurality of devices to display a mid-scene interface.

[0186] The master device can identify in sequence whether the other devices connected to the master device support the mid-scene mode, and when supporting the mid-scene mode, instruct the device to display a mid-scene interface.

[0187] S908, the user performs a double-finger sliding on the master device, and a window is transferred from a collaborative device to the master device.

[0188] The sliding direction is different, and the sequence of the window transfer of the application is also different.

[0189] S910, the window is laid out on the master device according to the screen size of the master device.

[0190] When the window of the application is transferred between different devices, the window of the application can be re-laid out according to the size of the device.

[0191] S912, the user performs a five-finger gathering on the mid-scene interface to display a mid-scene multitasking interface.

[0192] The mid-scene multitasking interface can be used to display the cards corresponding to the foreground and background applications of all the devices for mid-scene collaboration.

[0193] S914, the user clicks a card of the mid-scene multitasking interface.

[0194] S916, the application corresponding to the card is updated to the application of the main window.

[0195] The mid-scene multi-task interface helps the user to quickly locate the card of a specific application and display the application as the main window of the mid-scene interface, thereby improving the user operation convenience.

[0196] S918, the plurality of devices are disconnected.

[0197] Those skilled in the art can appreciate that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be implemented in electronic hardware or a combination of computer software and electronic hardware. Whether the functions are implemented in hardware or software depends on the specific application and design constraints of the technical solutions. A person skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0198] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described system, device and unit can refer to the corresponding processes in the foregoing method embodiments, which will not be repeated here.

[0199] In several embodiments provided in the present application, it should be understood that the disclosed system, device and method can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division, and actual implementation can have another division manner. For example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some interface, device or unit, and can be electrical, mechanical or other forms.

[0200] The units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, i.e. can be located in one place or distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.

[0201] In addition, each functional unit in each embodiment of the present application can be integrated in one processing unit, or each unit can exist physically, or two or more units can be integrated in one unit.

[0202] If the functions are implemented in the form of software function units and sold or used as independent products, they can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application essentially or the parts that contribute to the prior art or parts of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (Read-Only Memory, ROM), a random access memory (Random Access Memory, RAM), a magnetic disk or an optical disk, and various media that can store program codes.

[0203] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or replacements within the technical scope disclosed in the present application, which should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A display method characterized by comprising: The display method is applied to a first device, and the method comprises: in response to a first operation of a user, displaying a mid-scene interface, the mid-scene interface being used to display windows of applications in an application set, the application set comprising all foreground applications and background applications of the first device and a second device; in response to a second operation of the user on a control on an application interface corresponding to a main window in the mid-scene interface, refreshing the application interface corresponding to the main window.

2. The method of claim 1, wherein, The main window is a window of a first application, and the first operation is an operation on a full-screen interface of the first application.

3. The method of claim 2, wherein, The method further comprises: in response to a third operation of the user on the mid-scene interface, updating a window of a second application as the main window.

4. The method of claim 3, wherein, The third operation is a sliding operation of the user on the mid-scene interface, and the method further comprises: in response to the third operation, the window of the first application moving out of a display screen area of the first device along a sliding direction, and the window of the second application moving into the display screen area of the first device along the sliding direction.

5. The method according to claim 3 or 4, characterized in that, The second application is an application of the second device, and before updating the window of the second application as the main window, the method further comprises: receiving first information, the first information being used to indicate interface information of the second application.

6. The method according to any one of claims 3 to 5, characterized in that, The method further comprises: in response to the third operation, sending second information to the second device, the second information being used to instruct the second device to update a main window on a mid-scene interface of the second device.

7. The method according to any one of claims 1 to 6, characterized in that, The size of the main window is determined according to the size of the display screen of the first device.

8. The method according to any one of claims 1 to 7, characterized in that, The method further comprises: in response to a fourth operation of the user on the mid-scene interface, displaying a mid-scene multitasking interface, the mid-scene multitasking interface being used to display cards corresponding to all applications in the application set, the mid-scene multitasking interface comprising a plurality of application cards.

9. The method of claim 8, wherein, The method further comprises: in response to a selection operation of the user on a card of a third application in the application set on the mid-scene multitasking interface, displaying the mid-scene interface, and updating the main window as a window of the third application.

10. The method according to any one of claims 1 to 9, characterized in that, The mid-scene interface is used to display windows of applications in the application set in a first sequence, the first sequence being related to an operation sequence of the user on the applications in the application set.

11. The method according to any one of claims 1 to 10, characterized in that, The method further comprises: in response to the first operation, sending third information to the second device, the third information being used to instruct the second device to display a mid-scene interface.

12. The method of any one of claims 1 to 11, wherein the first operation is used to select the second device to perform mid-scene cooperation with the first device.

13. The method of claim 11, wherein the first operation is used to instruct the first device to display a mid-scene interface, and the method further comprises: the first device acquiring mid-scene capability information of a plurality of devices, and the third information being sent according to that the second device supports a mid-scene mode.

14. An electronic device, comprising: comprise: one or more memories; one or more processors; The one or more memories are coupled with the one or more processors and configured to store computer program codes, the computer program codes comprising computer instructions that, when executed by the one or more processors, cause the electronic device to perform the method of any one of claims 1-13.

15. A chip, characterized by The chip comprises a processor and a communication interface, the communication interface is configured to receive a signal and transmit the signal to the processor, and the processor processes the signal, so that the method of any one of claims 1-13 is executed.

16. A computer readable storage medium characterized by: The computer readable storage medium stores computer instructions, when the computer instructions run on an electronic device, the method of any one of claims 1-13 is executed.

Images