Human-computer interaction-based display method, and apparatus

Abstract

A human-computer interaction-based display method and an apparatus, relating to the technical field of computers. The method is applied to an electronic device, and a display screen of the electronic device comprises a first sub-screen and a second sub-screen. The method comprises: displaying a first user interface on the first sub-screen, and displaying a second user interface on the second sub-screen, the first user interface containing a first object, the second user interface containing an entry to first information, the first user interface belonging to a first application program, and the second user interface belonging to a second application program; in response to a user operation of dragging the first object to the entry to the first information and hovering, displaying the first information on the second sub-screen; and, in response to a user operation of dragging the first object to the first information, adding the first object to the first information, or sending the first object to an electronic device of a user associated with the first information.

Description

A display method and device based on human-computer interaction

[0001] Cross-reference to related applications

[0002] This application claims the priority of a Chinese patent application with the application number 202510033977.1, titled "A Display Method and Device Based on Human-Computer Interaction", filed with the State Intellectual Property Office of the People's Republic of China on January 7, 2025, and a Chinese patent application with the application number 202510311955.7, titled "A Display Method and Device Based on Human-Computer Interaction", filed with the State Intellectual Property Office of the People's Republic of China on March 14, 2025. The entire contents of both are incorporated herein by reference. Technical field

[0003] This application relates to the field of computer technology, and particularly to a display method and device based on human-computer interaction. Background technique

[0004] Intelligent electronic devices (such as smartphones, tablets, etc.) are being used more and more widely because they can provide rich and intelligent services. With the popularization of intelligent electronic devices, users' requirements for human-computer interaction are also increasing. Therefore, how to improve the convenience of human-computer interaction and thus improve the user experience is a problem that needs to be solved currently. Summary of the invention

[0005] Embodiments of this application provide a display method and device based on human-computer interaction to improve the convenience of human-computer interaction.

[0006] In a first aspect, a display method based on interaction is provided. This method can be applied to an electronic device, and the display screen of the electronic device includes a first sub-screen and a second sub-screen. The method includes: displaying a first user interface on the first sub-screen and a second user interface on the second sub-screen. The first user interface includes a first object, and the second user interface includes an entry for first information. The first user interface belongs to a first application program, and the second user interface belongs to a second application program; in response to a user operation of dragging the first object to the entry for the first information and hovering, displaying the first information on the second sub-screen; in response to a user operation of dragging the first object to the first information, adding the first object to the first information, or sending the first object to the electronic device where the user associated with the first information is located.

[0007] In the above implementation method, when different application programs are displayed on different sub-screens of an electronic device, an object in the application program user interface on the first sub-screen can be dragged to the application program on the second sub-screen through a dragging operation, and the multi-level information in the application program on the second sub-screen can be triggered to be expanded layer by layer, reducing the extra user operations performed by the user to expand the information layer by layer, thereby improving the convenience of human-computer interaction and the user experience.

[0008] In a possible implementation method, the entry of the first information is the first-level entry of the first information; the displaying the first information on the second sub-screen in response to a user operation of dragging the first object to the entry of the first information and hovering includes: displaying the second-level entry of the first information on the second sub-screen in response to a user operation of dragging the first object to the first-level entry of the first information and hovering; and displaying the first information on the second sub-screen in response to a user operation of dragging the first object to the second-level entry of the first information and hovering.

[0009] In a possible implementation method, the method further includes: in response to a user operation of dragging the first object to the entry of the first information, the entry of the first information is highlighted, and / or, the display area where the entry of the first information is located is highlighted.

[0010] In a possible implementation method, the adding the first object to the first information includes: adding the first object to the position where the cursor is located in the first information according to the position of the cursor in the first information when the user operation of dragging the first object to the first information ends.

[0011] In a possible implementation method, the first object is a media object, and the first information is a document or a contact conversation window.

[0012] Optionally, the media object includes one or more of the following: picture, video, audio, document, compressed package.

[0013] Optionally, the document includes one of the following: memorandum record, diary record, etc.

[0014] Secondly, an interactive display method is provided, which can be applied to an electronic device, the display screen of which includes a first sub-screen and a second sub-screen. The method includes: displaying a first user interface of a first application on the first sub-screen, the first user interface including an entry point for first information and an entry point for second information; displaying the first information on the second sub-screen, the first information including a first object; responding to a user operation of dragging the first object to the entry point of the second information, displaying the second information on the second sub-screen, and sending the first object to the electronic device of the user associated with the second information.

[0015] In the above implementation, when the same application is displayed on different sub-screens of an electronic device, the object in the second sub-screen can be dragged to the entry point of the second information in the first sub-screen by dragging, and the second information can be displayed in the second sub-screen. This reduces the additional user operations that the user has to perform to expand the information layer by layer, thereby improving the convenience of human-computer interaction and enhancing the user experience.

[0016] In one possible implementation, the step of displaying the second information on the second sub-screen and sending the first object to the electronic device associated with the user of the second information in response to a user operation of dragging the first object to the entry point of the second information includes: displaying the second information on the second sub-screen in response to a user operation of dragging the first object to the entry point of the second information and hovering it; and sending the first object to the electronic device associated with the user of the second information in response to a user operation of ending the dragging.

[0017] Optionally, sending the first object to the electronic device of the user associated with the second information in response to the user's action of ending the dragging operation includes: sending the first object to the electronic device of the user associated with the second information in response to the user's action of ending the dragging operation at the entry point of the second information.

[0018] In one possible implementation, the method further includes: in response to a user action of dragging the first object to the entry point of the second information and hovering it, the entry point of the second information is highlighted, and / or the display area where the entry point of the second information is located is highlighted.

[0019] In one possible implementation, the first application is a social application, and the first information and the second information are a contact chat window; or, the first application is a note-taking application, and the first information and the second information are documents.

[0020] Optionally, the first object is a media object. Optionally, the media object includes one or more of the following: image, video, audio, document, compressed file.

[0021] Optionally, the document may include one of the following: memos, diaries, etc.

[0022] Thirdly, an interactive display method is provided, which can be applied to an electronic device. The method includes: displaying a first user interface of a first application, the first user interface including a first object; in response to a user operation of dragging the first object, performing the following operations: displaying an entry point of at least one application on the screen where the first user interface is located, the at least one application including a second application; when the first object is dragged to the entry point of the second application and hovered, displaying a second user interface on the screen where the first user interface is located, or displaying the second user interface and the first user interface in a split-screen manner, the second user interface belonging to the second application; when the first object is dragged into the second user interface, applying the first object in the second application.

[0023] The above implementation allows you to quickly drag and drop objects from one application to another.

[0024] In one possible implementation, when the second user interface is displayed on the screen where the first user interface is located, the size of the second user interface is smaller than the size of the display area of ​​the display screen; the method further includes: displaying the first user interface on the lower layer of the second user interface, and a portion of the first user interface is not obscured by the second user interface; or, displaying a portion of the first user interface in the display area not occupied by the second user interface on the display screen.

[0025] In one possible implementation, the transparency of the first user interface is greater than 0 and less than 100%.

[0026] One possible implementation further includes: in response to a user operation triggered by the first user interface, displaying the first user interface and displaying the second user interface below the first user interface, wherein a portion of the second user interface is not obscured by the first user interface; or, in response to a user operation triggered by the first user interface, displaying the first user interface and displaying a portion of the second user interface in a display area not occupied by the first user interface on the display screen.

[0027] In one possible implementation, the second application matches the type of the first object.

[0028] One possible implementation further includes: obtaining the type of the first object; determining at least one application based on a pre-configured application that matches the type, wherein the at least one application matches the type of the first object.

[0029] In one possible implementation, the second application is a social application, and the second user interface includes an entry point for a first chat window; the step of applying the first object in the second application when the first object is dragged into the second user interface includes: when the first object is dragged into the entry point of the first chat window in the second user interface, displaying the first chat window and sending the first object to the electronic device of the user associated with the first chat window.

[0030] In one possible implementation, the second application is a note-taking application, and the second user interface includes an entry point for a first record; the step of applying the first object in the second application when the first object is dragged into the second user interface includes: when the first object is dragged into the entry point of the first record in the second user interface, displaying the first record and adding the first object to the first record.

[0031] In one possible implementation, the second application is a gallery application, and the second user interface includes a first image list; the step of applying the first object in the second application when the first object is dragged into the second user interface includes: when the first object is dragged into the area of ​​the first image list in the second user interface, adding the first object to the first image list.

[0032] In one possible implementation, the second application is a search application, and the second application interface includes a search box; the step of applying the first object in the second application when the first object is dragged into the second user interface includes: when the first object is dragged into the search box in the second user interface, performing an information search based on the first object.

[0033] In one possible implementation, the second user interface is an editing interface (e.g., an image editing interface, a document editing interface, a video editing interface, etc.), and the editing interface includes an editing area; the step of applying the first object in the second application when the first object is dragged into the second user interface includes: adding the first object to the editing area when the first object is dragged into the editing area of ​​the editing interface.

[0034] Fourthly, an interactive display method is provided, which can be applied to a first electronic device. The method includes: displaying a first user interface of a first application, the first user interface including a first object; in response to a user operation of dragging the first object, performing the following operations: displaying an entry point of at least one application on the screen where the first user interface is located, the at least one application including a second application; and after the first object is dragged to the entry point of the second application and the user operation ends, sending the first object to a second electronic device, the second electronic device being interconnected with the first electronic device.

[0035] The above implementation allows you to quickly drag and drop objects from a first application on one electronic device to a second application on another electronic device.

[0036] In one possible implementation, before the screen displays the entry point for at least one application, the method further includes: determining the at least one application based on the type of the first object and the application currently running on the second electronic device, wherein the at least one application includes a second application currently running on the second electronic device.

[0037] In one possible implementation, sending the first object to the second electronic device includes: sending the first object and indication information to the second electronic device, the indication information being used to instruct the first object to be applied to the second application.

[0038] Fifthly, an interactive display method is provided, which can be applied to an electronic device. The method includes: displaying a first user interface, the first user interface including an entry point for a first object; in response to a user operation of dragging the first object to a first area of ​​the first user interface, displaying a second user interface on the screen where the first user interface is located, or displaying the first user interface and the second user interface in a split-screen manner, the second user interface including the first object.

[0039] In the above implementation, when the displayable objects of the application are displayed on the screen of the electronic device, the displayable objects can be quickly dragged to display in a new window, which improves the convenience of user operation and thus enhances the user experience.

[0040] Optionally, the first object includes one of the following: image, video, audio, or document.

[0041] In a possible implementation, the first user interface belongs to a first application; displaying the second user interface includes: starting the second application, where the second application supports processing of the first object; and displaying the second user interface, where the second user interface belongs to the second application.

[0042] In a possible implementation, the size of the second user interface is smaller than the size of the display area of the display screen of the electronic device; the method further includes: displaying the first user interface below the second user interface, and a partial area of the first user interface is not blocked by the second user interface; or displaying a partial area of the first user interface in the display area of the display screen that is not occupied by the second user interface.

[0043] In a possible implementation, it further includes: in response to a user operation that triggers the first user interface, displaying the first user interface, and displaying the second user interface below the first user interface, and a partial area of the second user interface is not blocked by the first user interface; or in response to a user operation that triggers the first user interface, displaying the first user interface, and displaying a partial area of the second user interface in the display area of the display screen that is not occupied by the first user interface.

[0044] In a possible implementation, the first area is an edge area of the first user interface.

[0045] In a sixth aspect, there is provided an electronic device, including units or modules configured to execute the method according to any one of the first to fifth aspects described above.

[0046] In a seventh aspect, there is provided an electronic device, including: one or more processors configured to execute the method according to any one of the first to fifth aspects described above.

[0047] In an eighth aspect, there is provided a readable storage medium storing a program or instructions, and when the program or instructions run on a device, the device is caused to execute the method according to any one of the first to fifth aspects described above.

[0048] In a ninth aspect, there is provided a chip system including a processor for supporting a computer device to implement the method according to any one of the first to fifth aspects described above.

[0049] In a tenth aspect, there is provided a computer program product containing a program; when the computer program runs on a computer, the computer is caused to execute the method according to any one of the first to fifth aspects described above. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] Figure 1 is a schematic diagram of the form of the electronic device in the embodiment of this application;

[0051] Figure 2 is a schematic diagram of the hardware structure of the electronic device in the embodiment of this application;

[0052] Figure 3 is a schematic diagram of the software structure of the electronic device in the embodiment of this application;

[0053] Figure 4 is a flowchart illustrating an interactive display method provided in an embodiment of this application;

[0054] Figure 5 is a schematic diagram of the process shown in Figure 4 in a specific application scenario;

[0055] Figure 6 is a schematic diagram of the process shown in Figure 4 in another specific application scenario;

[0056] Figure 7 is a flowchart illustrating another interactive display method provided in an embodiment of this application;

[0057] Figure 8 is a schematic diagram of the process shown in Figure 7 in a specific application scenario;

[0058] Figure 9 is a flowchart illustrating another interactive display method provided in an embodiment of this application;

[0059] Figure 10 is a schematic diagram of the process shown in Figure 9 in a specific application scenario;

[0060] Figure 11 is a flowchart illustrating another interactive display method provided in an embodiment of this application;

[0061] Figure 12 is a schematic diagram of the process shown in Figure 11 in a specific application scenario;

[0062] Figure 13 is a flowchart illustrating another interactive display method provided in an embodiment of this application;

[0063] Figure 14 is a schematic diagram of the process shown in Figure 13 in a specific application scenario;

[0064] Figure 15 is a flowchart illustrating the interactive display method in an embodiment of this application;

[0065] Figure 16 is a schematic diagram of the structure of the electronic device provided in the embodiment of this application. Detailed Implementation

[0066] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the embodiments of this application will be further described in detail below with reference to the accompanying drawings. In the description of the embodiments of this application, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, a feature defined with "first" and "second" may explicitly or implicitly include one or more of that feature.

[0067] It should be understood that in the embodiments of this application, "at least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c can be single or multiple.

[0068] The method provided in this application can be applied to electronic devices. These electronic devices can enable human-computer interaction. For example, the electronic device can specifically be a non-foldable screen phone, a foldable screen phone, a wearable device (such as a smartwatch, smart bracelet, etc.), a tablet computer, a laptop computer, a smart screen, an in-vehicle terminal, a computer, a personal computer (PC), an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a virtual reality (VR) device / augmented reality (AR) device, an artificial intelligence (AI) device, or other terminal devices with display functions. The operating system installed on the aforementioned electronic devices includes, but is not limited to, those described above. Alternatively, other operating systems may be used. This application does not limit the specific type of the aforementioned electronic device or the operating system installed on it.

[0069] Referring to Figure 1, Figure 1 illustrates an exemplary usage pattern of foldable screen phones and tablets.

[0070] As shown in Figure 1(a), a foldable phone has a foldable display screen, which refers to a screen whose shape can be changed by external force. It includes at least two sub-screens; the figure only uses two sub-screens (the first and second sub-screens in the figure) as an example. A sub-screen of a foldable display screen can be an independent, complete screen (or an independent display unit, such as one that can be controlled by a processor), or it can refer to a portion of a display area within a complete screen. The electronic device can control the display state of different sub-screens separately. Foldable displays typically have two physical states: an unfolded state and a folded state. During the state change process of switching the foldable display screen from one physical state to another (hereinafter referred to as the state change process), the foldable display screen will also exhibit a semi-folded intermediate state.

[0071] It should be understood that Figure 1(a) is only described using a two-fold screen phone as an example. This application can also be applied to three-fold screen phones or similar foldable screen electronic devices, without limitation.

[0072] As shown in Figure 1(b), the tablet computer has a display screen. The tablet computer can operate in non-split-screen mode and split-screen mode. In split-screen mode, the tablet computer's display screen is divided into a first sub-screen and a second sub-screen, and the tablet computer can control the display status of each sub-screen separately.

[0073] The display screen of an electronic device can show the user interface (UI). The UI is the medium for interaction and information exchange between the electronic device and the user; it converts information from the device's internal data form to the user's visual form. The specific form of the interface can be an image or a window. When the displayed interface is an image, the user usually cannot edit the image, but can exit the interface through certain operations. Windows are responsible for displaying and processing information, and users can perform operations within the window. Taking a mobile phone as an example, windows include: the main interface window (such as the launcher window), application windows, and windows in the lock screen state.

[0074] Referring to Figure 2, an exemplary schematic diagram of the internal hardware structure of an electronic device provided in an embodiment of this application is shown. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0075] Processor 110 may include one or more processing units. For example, processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, a display processing unit (DPU), and / or a neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors. In some embodiments, electronic device 100 may also include one or more processors 110. The processor is the nerve center and command center of electronic device 100. The processor can generate operation control signals according to instruction opcodes and timing signals to control instruction fetching and execution. Processor 110 may also include memory for storing instructions and data.

[0076] In some embodiments, the processor 110 may include one or more interfaces. These interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a SIM card interface, and / or a USB interface, etc. The USB interface 130 is a USB standard-compliant interface, specifically a Mini USB interface, a Micro USB interface, a USB Type-C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used for data transfer between the electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback.

[0077] The sensor module 180 may include one or more of the following: a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, and a bone conduction sensor 180M. Optionally, in this embodiment, the sensors can detect the unfolding angle of the folding display screen.

[0078] The charging management module 140 receives charging input from the charger. The power management module 141 connects to the battery 142, and the charging management module 140 connects to the processor 110. The wireless communication function of the electronic device 100 can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor, and baseband processor, etc.

[0079] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with a tuning switch.

[0080] The mobile communication module 150 can provide wireless communication solutions, including 2G / 3G / 4G / 5G or future communication systems, for use on the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110.

[0081] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.

[0082] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLAN) (such as Wi-Fi), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR). The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signal, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0083] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 100 to communicate with networks and other devices via wireless communication technology. Electronic device 100 can implement shooting functions through ISP, camera 193, video codec, GPU, display screen 194, and application processor, etc.

[0084] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.

[0085] The electronic device 100 can realize display functions through a GPU, a display screen 194, and an application processor (AP). The display screen 194 is used to display images, videos, etc. In this embodiment, the display screen 194 can be a foldable display screen, and related details can be found in the screen shown in Figure 1.

[0086] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0087] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0088] The software system of an electronic device can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application's embodiments use a layered architecture software system (such as Android). Taking a system as an example, the software structure of an electronic device is illustrated.

[0089] Referring to Figure 3, this is a schematic diagram of the layered software structure of the electronic device provided in an embodiment of this application. The layered architecture divides the software system of the electronic device into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces.

[0090] In some embodiments, the Android system can be divided into four layers: applications, application framework, Android runtime, system libraries, and kernel. This application embodiment does not limit the layering of the electronic device's software structure. The Android runtime, system libraries, and kernel can be considered as one layer, referred to as the system layer. It should be understood that Figure 3 adds a hardware layer to the Android system.

[0091] It should be understood that the modules included in each layer shown in Figure 3 are the modules involved in the embodiments of this application. The modules included in each layer below do not constitute a limitation on the structure of the electronic device and the hierarchy of module deployment (illustrative example). In one embodiment, the modules shown in Figure 3 can be deployed individually, or several modules can be deployed together. The division of modules in Figure 3 is an example. In one embodiment, the names of the modules shown in Figure 3 are illustrative examples.

[0092] The application layer can include a series of application packages. Applications may include: camera, gallery, calendar, call, map, navigation, Bluetooth, music, video, SMS, etc. Applications can include system applications and third-party applications. Figure 3 uses system applications, including desktop applications and wallpaper applications, as an example.

[0093] The application framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The application framework layer can include some predefined functions. Referring to Figure 3, the application framework layer can include: a system service module, a window manager service (WMS), a drawing module, a rendering module, as well as a Surface Flinger (SF) layer compositer, an event manager, a screen management module, etc.

[0094] The system service module provides monitoring services for the application, such as monitoring changes in the physical state of the foldable display. The window management service manages the user interface. The drawing module draws the user interface. The rendering module renders the user interface drawn by the drawing module. The layer compositor combines the rendered layers to obtain the user interface to be displayed.

[0095] Because this embodiment considers the Android runtime, system libraries, and kernel layer as a single layer, the system layer can include the Android runtime, system libraries, and functional modules from the kernel layer. Referring to Figure 3, the system layer can include multiple functional modules, such as: a state monitoring service, a surface manager, media libraries, a 3D graphics processing library (e.g., OpenGL ES), and a 2D graphics engine (e.g., SGL). The state monitoring service is used to determine the orientation of the electronic device and the physical state of the foldable display screen based on monitoring data reported by the kernel layer. It should be understood that Figure 3 illustrates the system layer including the state monitoring service as an example. The system layer also includes a hinge detection module, used to acquire the hinge angle and report it to the state monitoring service, so that the state monitoring service can determine the physical state and unfolding angle of the foldable display screen based on the hinge angle.

[0096] In addition, the system layer also includes hardware drivers for driving hardware operation. These drivers may include sensor drivers, display drivers, graphics processing unit (GPU) drivers, etc., and this application embodiment does not limit this. It should be understood that Figure 3 illustrates the display driver involved in this application embodiment, which is used to drive the foldable display screen to display the user interface.

[0097] The hardware layer includes the hardware in the electronic device. It should be understood that the hardware layer in Figure 3 illustrates the hinges and display screen, etc., used to support the opening and closing of the foldable display screen in the embodiments described below.

[0098] In some embodiments of this application, when different application user interfaces are displayed on different sub-screens of an electronic device, objects in the user interface of the first sub-screen can be dragged to the second sub-screen based on human-computer interaction, and the multi-level display content of the user interface on the second sub-screen can be automatically expanded. This will be described below with reference to Figures 4, 5, and 6.

[0099] Referring to Figure 4, a flowchart illustrating a human-computer interaction-based display method provided in an embodiment of this application is shown. This process can be applied to the electronic devices shown in Figures 1, 2, and 3 above. For example, the electronic device can be a foldable screen phone or a tablet computer operating in split-screen mode, wherein the electronic device can control the display of the first sub-screen and the second sub-screen respectively.

[0100] As shown in Figure 4, the process may include the following steps:

[0101] Step 401: Display the first user interface on the first sub-screen, and display the second user interface on the second sub-screen.

[0102] In this setup, the first user interface belongs to the first application, and the second user interface belongs to the second application. In other words, the two sub-screens of the electronic device run different applications.

[0103] The first user interface includes a first object. Optionally, the first object may be a media object. The media object may be, for example, an image, video, audio, document, compressed file, etc., and this application is not limited thereto.

[0104] The second user interface includes an entry point for the first piece of information. Optionally, the first piece of information can be a document, such as a memo or diary entry. Taking a memo as an example, a memo can also be called a memo document, and it can contain text, images, audio, video, and other types of content. Optionally, the first piece of information can also be a contact chat window in a social application, such as a friend chat window or a group chat window. This application does not limit the type of first piece of information.

[0105] Taking memos as an example, since there can be many memos, note-taking applications typically use multi-level windows to display the content of multiple levels of memos. For example, for a two-level memo, the first level is the entry point to the memo, and the second level is the content of the memo. Accordingly, a user interface of the note-taking application includes a first-level window that displays multiple entry points to the memos. When one of the memo entry points is triggered, a second-level window is displayed, showing the content of that memo. As another example, for a three-level memo, the first level is the first-level entry point to the memo, the second level is the second-level entry point to the memo, and the third level is the content of the memo. Similarly, a user interface of the note-taking application includes a first-level window that displays the first-level entry point to the memo. When the first-level entry point is triggered, a second-level window is displayed, showing the second-level entry point to the memo. When the second-level entry point is triggered, a third-level window is displayed, showing the content of the memo. Similarly, this application does not limit the number of levels in the memorandum record.

[0106] Taking memos as an example, the entry point for a memo can be implemented using a visual control. When this control is triggered, it expands hierarchically, displaying the next-level window. Optionally, the visual control can display information such as the memo's title, summary, and creation time for user selection. The entry point for a memo can also be implemented using a link. When this link is triggered, it expands hierarchically, displaying the next-level window. Optionally, the text content of the link can include information such as the memo's title, summary, and creation time for user selection. This application does not limit the implementation method of the memo entry point.

[0107] In this embodiment, a user is allowed to drag a first object from a first sub-screen to a second sub-screen. The "drag" operation typically includes the following actions: pressing, holding the pressed state while moving, and releasing. Correspondingly, the drag operation can include the following events: drag start event (also called down event), move event, and drag end event (also called up event). During the movement, the object can pause briefly at a certain position; this state can be called hovering. The drag start event, move event, drag end event, and hover event may all trigger the electronic device or application to perform corresponding processing.

[0108] It should be understood that the "drag" operation in the embodiments of this application may be a single-finger drag operation or a multi-finger drag operation, or it may be a drag operation implemented by a stylus, or it may be a drag operation implemented by a contactless user gesture. This application does not limit it.

[0109] When a user drags the first object to the second sub-screen, the electronic device performs the following steps in response to the user's action:

[0110] Step 402: In response to a user action of dragging the first object to the entry point of the first information and hovering it, display the first information on the second sub-screen.

[0111] In one possible implementation scenario, the second user interface includes multiple entry points for different second objects. For clarity, the entry point for a memo record is used as an example below. After the user drags the first object to the second sub-screen, they can drag the first object to move multiple memo record entry points in the second user interface. When moving to a memo record entry point, to facilitate user selection, the memo record entry point can be highlighted, and / or the display area where the memo record entry point is located can be highlighted. For example, the title font of the memo record displayed at the memo record entry point can be bolded, its font color changed, or other highlighting methods can be used. As another example, the background color of the display area where the memo record entry point is located can be changed, or other highlighting methods can be used. This application embodiment does not limit the implementation method of highlighting. Correspondingly, when the first object is dragged away from the memo record entry point, the display mode of the memo record entry point can be restored.

[0112] During the user's dragging of the first object, when the first object is moved to the entry point of the first information and remains there for a certain duration, the electronic device can respond to this hover event and display a next-level window, which includes the first information. Taking a memo record as an example, when the first object is moved to the title position of the memo record and remains there for the first duration, the electronic device responds to this event and opens a new window containing the content of the memo record. Optionally, this new window can be nested within a second user interface, such as below the entry point of the memo record, or it can be overlaid on top of the second user interface; this application does not impose any limitations on this.

[0113] Optionally, the initial duration can be set by the system, for example, the initial duration is 5 seconds, which is not limited in this application.

[0114] When the entry point for the first information includes multiple levels, the process of unfolding layer by layer based on user operation is similar to the above. Here, we describe an example where the first information entry point includes a first-level entry point and a second-level entry point. When the first object is dragged to the first-level entry point of the first information and remains there for a certain duration, the second-level entry point of the first information is displayed on the second sub-screen; when the first object is dragged to the second-level entry point of the first information and remains there for a certain duration, the first information is displayed on the second sub-screen.

[0115] Step 403: In response to a user action of dragging the first object to the first information, add the first object to the first information, or send the first object to the electronic device of the user associated with the first information.

[0116] Taking a memo record as an example, when the user drags the first object into the content of the memo record and ends the dragging operation (e.g., lifts their finger), the second application adds the first object to the content of the memo record in response. Specifically, the second application can add (or insert) the first object to the cursor position based on the cursor's position in the content of the memo record when the dragging operation ends.

[0117] Taking the first information as an example of a contact chat window in a social application, the user associated with the first information refers to the user associated with that contact chat window. It can be understood that if the contact chat window is a one-to-one chat window (such as a friend chat window), then in this embodiment, the user associated with the chat window includes other users besides the current user, i.e., friend users; if the contact chat window is a many-to-one chat window (such as a group chat window), then in this embodiment, the user associated with the chat window includes group member users besides the current user. When the user drags the first object to a friend chat window and ends the dragging operation, in response, the social application sends the first object to the corresponding friend's electronic device based on that chat window.

[0118] Based on the process shown in Figure 4 above, when different applications are displayed on different sub-screens of an electronic device, objects in the user interface of the application in the first sub-screen can be dragged to the application in the second sub-screen by dragging. This can trigger the multi-level information in the application in the second sub-screen to expand layer by layer, reducing the additional user operations performed by the user to expand the information layer by layer. This can improve the convenience of human-computer interaction and enhance the user experience.

[0119] Referring to Figure 5, an example of the process shown in Figure 4 is presented in a specific application scenario. This example uses a foldable phone. When the phone is unfolded, the user interface 510 of the Gallery application is displayed on the first sub-screen, and the user interface 520 of the Notes application is displayed on the second sub-screen. User interface 510 displays a list of media objects, which can include images (such as photos) and / or videos. This list is displayed as a table of thumbnails of the media objects. The media object list is currently in edit mode. In edit mode, each thumbnail in the media object list has a checkbox control (shown as a small square in the figure). The user can select a media object using the checkbox control. User interface 520 is the first-level interface of the Notes application. This first-level interface displays summary information for multiple memo records. For example, the summary information for a memo record may include the title of the memo record, the update time, and also the thumbnails of the media objects included in the memo record, their status (such as locked or unlocked), and the content length (such as the length of a video included in the memo record).

[0120] As shown in Figure 5, in the first sub-screen, after the user selects media objects (511, 512) from the gallery using checkboxes, they drag the selected media objects towards the second sub-screen. It should be understood that this example is described with the user selecting two media objects as an example; in actual implementation, the user may select more or fewer media objects, and this application does not impose any limitations.

[0121] Optionally, when a user selects a media object (511, 512) and long-presses it, a floating window for that media object can be displayed. This floating window is small and can move with the user's dragging action. Optionally, the floating window can display a thumbnail of the media object and / or the number of media objects.

[0122] Users can drag the selected media object to the display area of ​​any memo record's summary information displayed in the user interface 520, such as moving it up or down within the display area of ​​the user interface 520 to select a note. After the user drags the selected media object and stays it in the area of ​​the summary information of the memo record 521 for a first duration, the memo record 521 is expanded, and its content is displayed on a second sub-screen. Users can drag the media objects (511, 512) within the content of the memo record 521, and the cursor position moves accordingly within the content of the memo record 521. When the cursor moves to the user's desired target position, the user lifts their finger to end the drag operation, and in response, the media objects (511, 512) are inserted at the current cursor position.

[0123] Optionally, when the user begins to drag the selected media object towards the second sub-screen, the display state of the user interface 510 in the first sub-screen changes, such as darkening the color of the user interface 510 or increasing its transparency; this application does not impose restrictions on this. Optionally, when the user ends the dragging operation, the user interface 510 in the first sub-screen can return to its normal display state. This approach can improve the user experience.

[0124] Optionally, when the user drags the selected media object up or down within the display area of ​​the user interface 520, whenever it is dragged to a display area where summary information of a memo is located, the display state of the summary information of the memo and / or the background of the display area changes. For example, the font color of the summary information changes, or the background color of the display area changes. This application does not limit this. When the user drags the selected media object away from the display area, the display state of the summary information of the memo and / or the background of the display area returns to the normal display state.

[0125] Referring to Figure 6, which illustrates the process shown in Figure 4 in another specific application scenario, the second sub-screen displays the user interface of a social networking application, unlike the example shown in Figure 5. This example uses a foldable phone. When the phone is unfolded, the user interface 510 of the Gallery application is displayed on the first sub-screen, and the user interface 540 of the Notes application is displayed on the second sub-screen. User interface 510 displays a list of media objects, presented as a table of thumbnail images of the media objects. User interface 540 is the first-level interface of the social networking application, displaying multiple entry points to contact conversation windows. For example, an entry point to a contact conversation window may include the contact's avatar and nickname.

[0126] As shown in Figure 6, on the first sub-screen, after the user selects media objects (511, 512) in the gallery using checkboxes, the selected media object is dragged toward the second sub-screen.

[0127] When the user drags the selected media object and holds it in the contact dialog window entry 541 for a first duration, the dialog window 542 is opened and displayed on the second sub-screen. At this time, the user lifts their finger to end the drag operation. In response, the media object (511, 512) is sent to the contact, and a new dialog record is added to the dialog window entry 541.

[0128] In other embodiments of this application, when different levels of user interfaces of the same application are displayed on different sub-screens of an electronic device, objects in the user interface of the first sub-screen can be dragged to the second sub-screen based on human-computer interaction, and the multi-level display content of the user interface on the second sub-screen can be automatically expanded. This will be described below with reference to Figures 7 and 8.

[0129] Referring to Figure 7, a flowchart illustrating a human-computer interaction-based display method provided in an embodiment of this application is shown. This process can be applied to the electronic devices shown in Figures 1, 2, and 3 above. For example, the electronic device can be a foldable screen phone or a tablet computer operating in split-screen mode, wherein the electronic device can control the display of the first sub-screen and the second sub-screen respectively.

[0130] As shown in Figure 7, the process may include the following steps:

[0131] Step 701: Display the first user interface of the first application on the first sub-screen. The first user interface includes an entry point for first information and an entry point for second information. Display the first information on the second sub-screen. The first information includes a first object.

[0132] Both the first user interface and the second user interface belong to the first application, with the first user interface being at a higher level than the second user interface.

[0133] Optionally, the first object can be a media object. The media object can be, for example, an image, video, audio, document, compressed file, etc., and this application does not impose any restrictions.

[0134] Optionally, the first piece of information can be a contact chat window in a social application, such as a friend chat window or a group chat window. The first piece of information can also be a document, such as a memo or diary entry. Taking a memo as an example, a memo can also be called a memo document, and it can contain text, images, audio, video, and other types of content. This application does not limit the type of first piece of information.

[0135] Once the entry point for the first piece of information is triggered, the first piece of information can be displayed. Taking a contact chat window in a social application as an example, the entry point for the contact chat window can be implemented using a visual control. When this control is triggered, it will expand hierarchically, displaying the next level window, i.e., the chat window. Optionally, the visual control can display information such as the contact's avatar and nickname to facilitate user selection. This application embodiment does not limit the implementation method of the entry point for the contact chat window.

[0136] In this embodiment, a user is allowed to drag a first object from a first sub-screen to a second sub-screen. When the user drags the first object to the second sub-screen, the electronic device performs the following steps in response to the user's operation:

[0137] Step 702: In response to a user action of dragging the first object to the entry point of the second information and hovering it, display the second information on the second sub-screen.

[0138] In this embodiment of the application, the description of the "drag" operation can be found in the relevant content of the flowchart shown in Figure 4.

[0139] In one possible implementation scenario, the first user interface includes multiple different entry points for first information. For clarity, the following description uses the entry point of a contact chat window in a social application as an example. After the user drags the first object from the chat window in the second sub-screen to the first sub-screen, they can drag the first object to move multiple entry points of contact chat windows in the first user interface. When moving to the entry point of a certain contact chat window, to facilitate user selection, the entry point of the chat window can be highlighted, and / or the display area where the entry point of the chat window is located can be highlighted. For example, the title font of the contact nickname displayed at the entry point of the chat window can be bolded, the font color can be changed, or other highlighting methods can be used. As another example, the background color of the display area where the entry point of the chat window is located can be changed, or other highlighting methods can be used. This application embodiment does not limit the implementation method of highlighting. Correspondingly, when the first object is dragged away from the entry point of the chat window, the display mode of the entry point of the chat window can be restored.

[0140] During the user's dragging of the first object, when the first object is moved to the entry point of the first information and remains there for a certain duration, the electronic device can respond to the hover event and display a next-level window on the second sub-screen. Taking the first information as a contact dialog window as an example, when the first object is moved to the position of a contact's avatar and nickname and remains there for a certain duration, the electronic device responds to the event and opens the contact dialog window on the second sub-screen. Optionally, the new window can be overlaid on the original contact dialog window; this application is not limited to this. Taking the first information as a memo record as another example, when the first object is moved to the title position of the memo record and remains there for a certain duration, the electronic device responds to the event and opens a new window containing the content of the memo record. Optionally, the new window can be nested in the second user interface, such as below the entry point of the memo record; the new window can also be overlaid on the second user interface; this application is not limited to this.

[0141] Optionally, the initial duration can be set by the system, for example, the initial duration is 5 seconds, which is not limited in this application.

[0142] When the entry point for the first information includes multiple levels, the process of unfolding layer by layer based on user operation is similar to the above. Here, we describe an example where the first information entry point includes a first-level entry point and a second-level entry point. When the first object is dragged to the first-level entry point of the first information and remains there for a certain duration, the second-level entry point of the first information is displayed on the first sub-screen; when the first object is dragged to the second-level entry point of the first information and remains there for a certain duration, the first information is displayed on the second sub-screen.

[0143] Step 703: In response to the user's action of ending the drag, send the first object to the electronic device of the user associated with the second information, or add the first object to the second information.

[0144] Taking a contact chat window from a social networking application as an example, when a user drags a first object to the entry point of a second contact chat window and hovers it for a period of time before ending the dragging operation, the social networking application sends the first object to the corresponding user's electronic device based on that chat window. For an explanation of the users associated with the contact chat window, please refer to the relevant content in the process shown in Figure 4.

[0145] Taking a memo record as the first example, when the user drags the first object into the content of the memo record and ends the dragging operation (e.g., lifts their finger), the memo application adds the first object to the content of the memo record in response. Specifically, the memo application can add (or insert) the first object to the cursor position based on the cursor's position in the content of the memo record when the dragging operation ends.

[0146] In another possible implementation, when a user drags the first object to the entry point of the second information and ends the dragging, in response to the user's operation, the electronic device can display the second information on the second sub-screen and send the first object to the electronic device of the user associated with the second information.

[0147] Based on the process shown in Figure 7 above, when the same application is displayed on different sub-screens of an electronic device, the object in the second sub-screen can be dragged to the entry point of the second information in the first sub-screen by dragging, and the second information can be displayed in the second sub-screen. This reduces the additional user operations that the user has to perform to expand the information layer by layer, thereby improving the convenience of human-computer interaction and enhancing the user experience.

[0148] Referring to Figure 8, an example of the process shown in Figure 7 is presented in a specific application scenario. This example uses a foldable phone. When the phone is unfolded, the user interface 810 of the social application is displayed on the first sub-screen, and the user interface 820 of the social application is displayed on the second sub-screen. User interface 810 is the first-level user interface of the social application, displaying a contact list. This contact list includes information such as friends and groups, and may also include information such as public platforms for information dissemination; this application does not impose any limitations. For example, user interface 810 displays the nickname and avatar of friend 1 and friend 2. User interface 820 is the second-level user interface of the social application, and may be, for example, a chat window for a friend or group, used to display the user's chat history with that friend, or the chat history between members of that group. In Figure 8, user interface 820 includes a chat window between the user and friend 1, which can be opened by the user clicking on friend 1's nickname or avatar in user interface 810, at which point the chat window between the user and friend 1 can be displayed on the second sub-screen.

[0149] As shown in Figure 8, in the chat window of Friend 1 displayed on the second sub-screen, the user selects an image from the chat history (i.e., the first object 811 in the figure) and drags the first object 811 towards the first sub-screen. It should be understood that this example is described using the user selecting an image as an example. In actual implementation, the user may select other types of media objects, such as video files, audio files, document files, or folders, etc., which are not limited in this application.

[0150] Users can drag the first object 811 to the display area of ​​any contact's name or avatar in the user interface 810, such as moving it up or down within the contact list display area of ​​the user interface 810 to select different contacts. In one possible implementation, when the user lifts their finger after dragging the first object 811 in the display area of ​​friend 2's nickname or avatar, the dragging operation ends. In response, a chat window with friend 2 is displayed in the second sub-screen, and the first object 811 is sent to friend 2. Correspondingly, a new chat record is added to the chat window, showing that the first object was sent to friend 2. In another possible implementation, after the user hovers the first object 811 in the display area of ​​friend 2's nickname or avatar for a certain duration, a chat window 821 with friend 2 opens in the second sub-screen. When the user ends the dragging at this position, in response, the first object 811 is sent to friend 2, and a new chat record is added to the chat window.

[0151] Optionally, when a user begins dragging the first object towards the first sub-screen, a floating window can be generated. This floating window can display information such as a thumbnail of the first object, and it can move with the user's dragging action. When the user lifts their finger after dragging the first object in the nickname or avatar display area of ​​Friend 2, the first object returns to its normal display in the newly added chat history; that is, the display size of the image in Friend 2's chat window is the same as its display size in Friend 1's chat window. This method improves the user experience.

[0152] Optionally, when the user drags the first object up or down within the display area of ​​the contact list in the user interface 810, the display status of the contact's information and / or the background of that display area changes each time it is dragged to a display area containing a contact's name / avatar. For example, the font color of the contact's name changes, or the background color of the display area changes; this application is not limited to this. When the user drags the first object away from the display area, the display status of the contact's information and / or the background of that display area returns to its normal display state. This method can prompt the user about the currently selected contact, improving the user experience.

[0153] In other embodiments of this application, when an object displayed on the screen of an electronic device is dragged to a certain screen position, the object can be displayed in a new window. This will be described below with reference to Figures 9 and 10.

[0154] Referring to Figure 9, it is a flowchart illustrating a display method based on human-computer interaction provided in an embodiment of this application. This process can be applied to the electronic devices shown in Figures 1, 2, and 3 above.

[0155] As shown in Figure 9, the process may include the following steps:

[0156] Step 901: Display the first user interface, which includes the entry point for the first object.

[0157] Optionally, the first object can be a media object. The media object can be, for example, an image, video, audio, document, compressed file, etc., and this application does not impose any restrictions.

[0158] Optionally, the entry point for the first object can be implemented using a visual control. When this control is triggered, the content of the first object will be displayed, such as the corresponding document. Optionally, taking a media object as an example, the visual control can display information such as the title, summary, and creation time of the media object to facilitate user selection. The entry point for the first object can also be implemented using a link. When this link is triggered, the content of the first object will be displayed. Optionally, the text content of the link can include information such as the title, summary, and creation time of the first object to facilitate user selection. This application embodiment does not limit the implementation method of the entry point for the first object.

[0159] For example, taking a document management application as the first user interface, the interface displays a list of media files. This list includes the name, summary, creation time, etc., of one or more media files. Media files may include, for example, documents (such as portable document format (PDF) files), image files, audio files, video files, etc. Users can select media files from this list.

[0160] In one possible implementation, when the electronic device has a foldable display screen, the first sub-screen and the second sub-screen in the display screen are controlled by the electronic device as a whole; in the case where the electronic device supports split-screen functionality, in this embodiment, the electronic device is currently in non-split-screen mode.

[0161] In this embodiment, a user is allowed to drag a first object. When the user drags the first object, in response to the user's operation, the electronic device performs the following steps:

[0162] Step 902: In response to a user operation of dragging a first object to a first area of ​​a first user interface, display a second user interface on the screen where the first user interface is located, or display the first user interface and the second user interface in a split-screen manner, wherein the second user interface includes the first object.

[0163] The first region can be an edge area of ​​the first user interface, such as the right edge area. That is, when the first object is dragged to the right edge area of ​​the user interface, the electronic device can be triggered to display a second user interface, and the content of the first object can be displayed in the second user interface. In other instances, the first region can also be other edge areas of the first user interface, which is not limited in this application.

[0164] In one possible implementation, the application to which the second user interface belongs is different from the application to which the first user interface belongs. For example, if the first user interface belongs to a first application and the second user interface belongs to a second application, the second application supports processing of the first object. For instance, if the first object is an image file, the second application could be an image editing application; or, for example, if the first object is a spreadsheet file, the second application could be a spreadsheet processing application. In other words, the electronic device can determine the application that can display or edit the first object based on its media type.

[0165] For example, the electronic device can launch a second application based on the type of the first object, and the second application can support processing the first object; the electronic device displays the content of the first object in the user interface of the second application. Optionally, if the second application has already been launched, the electronic device creates a new window in the user interface of the second application, and displays the content of the first object in the new window.

[0166] Optionally, if the electronic device has multiple applications that support processing the first object, the electronic device may select an application from them based on the default settings, or select the optimal application, or select the application used when the first object was last displayed or edited, without limitation in this application.

[0167] In one possible implementation, the second user interface is overlaid on the first user interface. That is, the user interface of the second application is the currently active interface and can respond to the user's operation, thereby enabling the processing of the first object.

[0168] Optionally, the size of the second user interface is smaller than the display area of ​​the electronic device's screen, and a portion of the first user interface below it is not obscured by the second user interface. For example, the first user interface and the second user interface can be stacked and staggered, which makes it easier for the user to switch user interfaces by triggering the unobscured part of the first user interface. For example, the user can switch from the second user interface to the first user interface by clicking on the unobscured part of the first user interface, that is, the first user interface can be placed on top of the second user interface.

[0169] In another similar implementation, when the electronic device displays a second user interface, a portion of the first user interface can be displayed in an area of ​​the display area that is not occupied by the second user interface. When the user triggers this portion of the display area, the user interface can be switched.

[0170] To improve aesthetics and user experience, when the first user interface is placed below the second user interface, or when a portion of the first user interface is displayed in an area not occupied by the second user interface within the display area, the first user interface can be displayed in a "side-view" manner. For example, one visual effect of a "side-view" is that the left edge of the first user interface coincides with the left edge of the screen display area, and the entire interface rotates counter-clockwise around the left edge of the first user interface, creating a perspective effect where objects appear larger in the foreground and smaller in the background. This creates the visual effect of the first user interface turning sideways to make room for it.

[0171] Similarly, a similar display effect can be achieved when switching from the second user interface to the first user interface.

[0172] In one possible implementation, the first user interface and the second user interface can be displayed in a split-screen manner. When the first object is dragged to the first area of ​​the first user interface, the electronic device can activate the split-screen mode, and the entire screen of the electronic device is divided into a first sub-screen and a second sub-screen. The first user interface is displayed on the first sub-screen, and the second user interface is displayed on the second sub-screen.

[0173] Figure 10 illustrates an example of triggering the opening of a new window by dragging an object to the right edge of the user interface 1010. In other embodiments, it is also possible to trigger the opening of a new window by dragging an object to the left edge, top edge, or bottom edge of the user interface 1010, or by dragging an object to a specified area in the user interface 1010. This application does not impose any limitations on this.

[0174] Based on the process shown in Figure 9 above, when the displayable objects of the application are displayed on the screen of the electronic device, the displayable objects can be quickly dragged to display in a new window, which improves the convenience of user operation and thus enhances the user experience.

[0175] Referring to Figure 10, an example of the process shown in Figure 9 is presented in a specific application scenario. This example uses a foldable phone. In its unfolded state, the first and second sub-screens, as a whole, display the user interface 1010 of a first application (e.g., a social media application or a file management application). This user interface 1010 displays a document list, which includes multiple documents. For example, the user interface 1010 displays the icons, names, update times, and sources of the documents in the document list; this application does not impose limitations on this.

[0176] When a user selects document 1001, for example, by pressing their finger on the display area of ​​document 1001's document name, they can drag it towards the edge of user interface 1010, such as the right edge. During this dragging process, a floating window displaying relevant information about document 1001 (such as its icon, name, update time, and source) can be generated. This floating window moves with the user's finger. When document 1001 is dragged to the right edge of user interface 1010, the user lifts their finger, ending the dragging operation. In response, as shown in Figure 10, user interface 1020 opens, and document 1001 is displayed in user interface 1020.

[0177] Based on the document type 1001, the foldable phone can open a window of the corresponding type of application to display document 1001. For example, if document 1001 is a text file, the foldable phone can launch an application that can edit text files and display document 1001 in that application's window. As another example, if document 1001 is a spreadsheet file, the foldable phone can launch an application that can edit spreadsheet files and display document 1001 in that application's window. And as yet another example, if document 1001 is an image file, the foldable phone can launch an application that can edit image files and display document 1001 in that application's window.

[0178] Optionally, the size of the user interface 1020 can be smaller than the display area of ​​the screen. The user interface 1010 can be displayed below the user interface 1020, and a portion of the user interface 1010 is not obscured by the user interface 1020, or a portion of the user interface 1010 is displayed in an area of ​​the screen not occupied by the user interface 1020. The user can switch to the user interface 1010 by clicking on that portion of the user interface 1010. Similarly, after switching to the user interface 1010, the user interface 1020 can be displayed below the user interface 1010, and a portion of the user interface 1020 is not obscured by the user interface 1010, or a portion of the user interface 1020 is displayed in an area of ​​the screen not occupied by the user interface 1010. The user can switch to the user interface 1020 by clicking on that portion of the user interface 1020.

[0179] Optionally, to improve aesthetics and enhance user experience, as shown in Figure 10, the user interface 1010 can be displayed in a "side-view" manner below or next to the user interface 1020.

[0180] In some embodiments of this application, objects from one application can be applied to another application via a quick drag-and-drop method. This will be described below with reference to Figures 11 and 12.

[0181] Referring to Figure 11, it is a flowchart illustrating a display method based on human-computer interaction provided in an embodiment of this application. This process can be applied to the electronic devices shown in Figures 1, 2, and 3 above.

[0182] As shown in Figure 11, the process may include the following steps:

[0183] Step 1101: Display the first user interface of the first application, which includes the first object.

[0184] Optionally, the first application can be a social application, a note-taking application, etc., and this application does not impose any restrictions.

[0185] Optionally, the first object can be a media object. The media object can be, for example, an image, video, audio, document, compressed file, etc., and this application does not impose any restrictions.

[0186] For example, the first application is a social application, and the first object is a media object in a contact chat window; for another example, the first application is a note-taking application, and the first object is a media object in a recorded content.

[0187] In one possible implementation, when the electronic device has a foldable display screen, the first sub-screen and the second sub-screen in the display screen are controlled by the electronic device as a whole; in the case where the electronic device supports split-screen functionality, in this embodiment, the electronic device is currently in non-split-screen mode.

[0188] In this embodiment, a user is allowed to drag a first object. When the user drags the first object, in response to the user's operation, the electronic device performs the following steps:

[0189] Step 1102: In response to a user action of dragging the first object, display an entry point for at least one application on the screen where the first user interface is located.

[0190] In this embodiment, the first object can be applied to the at least one application. That is, the icon of an application that cannot apply the first object will not appear on the screen.

[0191] Specifically, an electronic device can determine which applications can apply the first object based on its type. For example, if the first object is an image, then the image can be applied to some social networking applications or some note-taking applications. For instance, an electronic device can set a mapping between media object types and applications, and based on this mapping and the media object being dragged by the user, the electronic device can determine which application(s) icons to display on the screen.

[0192] In this embodiment, the application entry point is used to launch the application; that is, the application can be launched by triggering the application entry point. Optionally, the application entry point can be implemented as a visual control. When the control is triggered, the corresponding application will be launched. The control can display an application icon for easy user selection.

[0193] In one possible implementation, the size of the first user interface is smaller than the size of the display area of ​​the screen where the first user interface is located. Accordingly, the entry point of at least one application can be displayed in an area outside the first user interface in the display area of ​​the screen, such as below or on the right edge of the first user interface. This application does not impose any restrictions.

[0194] Step 1103: When the first object is dragged to the entry point of the second application and hovered, the second user interface is displayed on the screen where the first user interface is located, or the second user interface and the first user interface are displayed in a split-screen manner. The second user interface belongs to the second application.

[0195] In this process, the entry point of at least one application displayed on the screen includes the entry point of a second application. The second application matches the type of the first object, meaning the first object can be applied to the second application.

[0196] During the process of the user dragging the first object, when the first object is moved to the entry point of the second application and stays there for a certain duration, the electronic device can respond to the hover event by displaying the second user interface on the screen where the first user interface is located, or by displaying the second user interface and the first user interface in a split-screen manner.

[0197] Optionally, the initial duration can be set by the system, for example, the initial duration is 5 seconds, which is not limited in this application.

[0198] In one possible implementation, when the first object is dragged to the entry point of the second application, the icon of the second application can be animated, such as jumping up and down once or multiple times, to indicate to the user which application is currently selected. This application does not limit the animation effect.

[0199] In one possible implementation, the second user interface overlays the first user interface; that is, the user interface of the second application is the currently active interface and can respond to user actions, thereby applying the first object to the second application.

[0200] Optionally, the size of the second user interface is smaller than the display area of ​​the electronic device's screen, and a portion of the first user interface beneath it is not obscured by the second user interface. For example, the first and second user interfaces can be stacked and staggered, which makes it easier for the user to switch user interfaces by triggering the unobscured portion of the first user interface.

[0201] In another similar implementation, when the electronic device displays a second user interface, a portion of the first user interface can be displayed in an area of ​​the display area that is not occupied by the second user interface. When the user triggers this portion of the display area, the user interface can be switched.

[0202] To improve aesthetics and user experience, when the first user interface is placed below the second user interface, or when a portion of the first user interface is displayed in an area not occupied by the second user interface within the display area, the first user interface can be displayed in a "side-view" manner.

[0203] Similarly, a similar display effect can be achieved when switching from the second user interface to the first user interface.

[0204] In one possible implementation, the first user interface and the second user interface can be displayed in a split-screen manner. When the first object is dragged to the first area of ​​the first user interface, the electronic device can activate the split-screen mode, and the entire screen of the electronic device is divided into a first sub-screen and a second sub-screen. The first user interface is displayed on the first sub-screen, and the second user interface is displayed on the second sub-screen.

[0205] Step 1104: When the first object is dragged into the second user interface, apply the first object in the second application.

[0206] Taking a social application as an example, the second user interface includes an entry point to the first chat window. When the first object is dragged to the entry point of the first chat window in the second user interface, the first chat window is displayed, and the first object is sent to the electronic device of the user associated with the first chat window, and a new chat record is added to the chat window.

[0207] Taking a note-taking application as an example, the second user interface includes an entry point for the first record. When the first object is dragged to the entry point of the first record in the second user interface, the content of the first record is displayed, and the first object is added to the first record. For example, the first object is added to the position where the cursor was when the user finished dragging.

[0208] Taking a gallery-type application as an example, the second user interface includes a first image list. When a first object is dragged to the area of ​​the first image list in the second user interface, the first object is added to that first image list.

[0209] Taking the second application as a search application as an example, the second application interface includes a search box. When the first object is dragged into the search box in the second user interface, information is searched based on the first object.

[0210] Taking a second user interface as an editing interface (such as an image editing interface, document editing interface, video editing interface, etc.) as an example, this editing interface includes an editing area. When a first object is dragged into the editing area of ​​this editing interface, the first object is added to the editing area so that it can be edited, or the object can be added to the document.

[0211] The above are merely exemplary examples of several types of second applications and ways of applying the first object in the second application; this application does not limit these possibilities.

[0212] Based on the process shown in Figure 11 above, objects from one application can be applied to another application using a quick drag-and-drop method.

[0213] Referring to Figure 12, an example of the process shown in Figure 11 is presented in a specific application scenario. This example uses a foldable phone. When the foldable phone is unfolded, the first and second sub-screens, as a whole, display the user interface 1210 of a first social application. This user interface 1210 displays information posted by the user and comments from friends. The information posted by the user includes text and images. For example, user interface 1210 displays an image 1201, text content 1202, and comment information 1203.

[0214] When a user selects image 1201, for example, by pressing and dragging their finger on the display area of ​​image 1201, one or more application icons appear below the user interface 1210 in response. For example, in Figure 12, multiple application icons appear below the user interface 1210, which may include an icon 1204 for a browser application, an icon 1205 for a slideshow application, an icon 1206 for a photo gallery application, an icon 1207 for a second social application, and an icon 1208 for a memo application.

[0215] As the user drags image 1201, a floating window displaying relevant information about the object (such as icons, thumbnails, etc.) can be generated. This floating window moves with the user's finger. Optionally, taking an image 1201 containing a human figure as an example, when the user selects image 1201, the foldable phone can perform image recognition on the image 1201 to obtain the human figure area. When the user starts dragging image 1201, the foldable phone can generate a human figure image based on the image in that human figure area, and this human figure image can be displayed in the aforementioned floating window.

[0216] When the user drags the image 1201 to the display area of ​​the second application's icon 1207 and hovers it in that area for a first period of time, the second application's window 1220 is displayed on the current screen. The window 1220 displays a contact list, which includes information such as friends and groups; this application does not impose any limitations on this. For example, as shown in Figure 12, the window 1220 can display multiple contact lists, such as a recently forwarded contact list (where the user has recently forwarded messages to contacts in this list) and a recently chatted contact list (where the user has recently interacted with contacts in this list).

[0217] When the user drags image 1201 to the display area where the avatar or nickname of friend A in the contact list is located, and then lifts their finger, the drag operation ends. In response, the chat window 1230 with friend A is displayed on the screen, and image 1201 is sent to friend A. Accordingly, a new chat record is added to the chat window 1230.

[0218] Optionally, icons of one or more applications may be displayed below the user interface 1210 according to a pre-set animation effect. For example, the icons of the multiple applications may move in sequentially from the left side of the screen, which is not limited in this application.

[0219] Optionally, when the user drags the image 1201 to the display area of ​​the icon 1207 of the second application, the icon 1207 of the second application can display an animation effect, such as the icon jumping up and down once or multiple times, to indicate to the user which application is currently selected. This application does not limit the animation effect.

[0220] Optionally, the size of window 1220 can be smaller than the display area of ​​the screen. User interface 1210 can be displayed below window 1220, and a portion of user interface 1210 is not obscured by window 1220, or a portion of user interface 1210 is displayed in an area of ​​the screen not occupied by window 1220. The user can switch to user interface 1210 by clicking on that portion of user interface 1210. Similarly, when switching to user interface 1210, window 1220 can be displayed below user interface 1210, and a portion of window 1220 is not obscured by user interface 1210, or a portion of window 1220 is displayed in an area of ​​the screen not occupied by user interface 1210. The user can switch to window 1220 by clicking on that portion of window 1220.

[0221] Optionally, to improve aesthetics and enhance user experience, as shown in Figure 12, the user interface 1210 can be displayed in a "side-view" manner below or next to the window 1220.

[0222] In some embodiments of this application, an object from one application on one electronic device can be applied to another application on another electronic device using a quick drag-and-drop method. This will be described below with reference to Figures 13 and 14.

[0223] Referring to Figure 13, this is a flowchart illustrating a human-computer interaction-based display method provided in an embodiment of this application. This process can be applied to the electronic devices shown in Figures 1, 2, and 3 above. In the process shown in this embodiment, the first electronic device and the second electronic device are interconnected and can exchange information. Optionally, the first electronic device and the second electronic device share the same user account, that is, they log in using the same user account to facilitate data synchronization and sharing.

[0224] As shown in Figure 13, the process may include the following steps:

[0225] Step 1301: Display a first user interface of a first application on a first electronic device, the first user interface including a first object.

[0226] Optionally, the first application can be a social networking application, a memo application, or a photo gallery application, etc., and this application does not limit it.

[0227] Optionally, the first object can be a media object. The media object can be, for example, an image, video, audio, document, compressed file, etc., and this application does not impose any restrictions.

[0228] In one possible implementation, when the electronic device has a foldable display screen, the first sub-screen and the second sub-screen in the display screen are controlled by the electronic device as a whole; in the case where the electronic device supports split-screen functionality, in this embodiment, the electronic device is currently in non-split-screen mode.

[0229] In this embodiment, a user is allowed to drag a first object. When the user drags the first object, in response to the user's operation, the electronic device performs the following steps:

[0230] Step 1302: In response to a user action of dragging a first object, the first electronic device displays an entry point for at least one application on the screen where the first user interface is located, the at least one application including a second application running on the second electronic device.

[0231] In one possible implementation, the first electronic device can determine which applications can apply the first object based on its type. For example, if the first object is an image, the image can be applied to some social networking applications or some note-taking applications. Exemplarily, the electronic device can set a mapping between media object types and applications, and based on this mapping and the media object being dragged by the user, the electronic device can determine which application(s) icons to display on the screen.

[0232] Optionally, the at least one application may include an application currently running on the second electronic device. For example, the first electronic device may determine at least one application based on the type of the first object and the application currently running on the second electronic device, and this at least one application may include a second application currently running on the second electronic device. Since the first and second electronic devices are interconnected, the first electronic device can obtain the application currently running on the second electronic device.

[0233] In one possible implementation, the size of the first user interface is smaller than the size of the display area of ​​the screen where the first user interface is located. Accordingly, the entry point of at least one application can be displayed in an area outside the first user interface in the display area of ​​the screen, such as below or on the right edge of the first user interface. This application does not impose any restrictions.

[0234] Step 1303: After the first object is dragged to the entry point of the second application and the user operation ends, the first object is sent to the second electronic device so that the first object is applied to the second application.

[0235] In one possible implementation, the first electronic device may send a first object and instruction information to the second electronic device, the instruction information being used to instruct the first object to be applied to the second application.

[0236] In one possible implementation, a second application running on the second electronic device has editing capabilities, such as an image editing application, a slideshow application, or a note-taking application, etc., which are not limited in this application. The user interface of the second application includes an editing area. When the second electronic device receives a first object, the first object is added to the editing area, for example, the first object is added to the currently edited slideshow document, or the first object is added to the currently edited memo content.

[0237] In another possible implementation, the second application running on the second electronic device is a social networking application, and the current user interface of the second application is a contact chat window. When the second electronic device receives the first object, the first object is sent to the electronic device of the user associated with the contact chat window, and a new chat record is added to the chat window.

[0238] If the first object is dragged to the entry point of another application in at least one of the above applications, and that application is not running on the second electronic device, then the first electronic device can launch the application and apply the first object to that application, as shown in Figure 11.

[0239] Based on the process shown in Figure 13 above, an object from the first application of one electronic device can be applied to the second application of another electronic device by dragging and dropping.

[0240] Referring to Figure 14, an example of the process shown in Figure 13 is presented in a specific application scenario. This example uses a foldable phone and a tablet computer, which are interconnected and logged into the same user account. When the foldable phone is unfolded, the first and second sub-screens together display a gallery application window 1410. This window 1410 displays a list of media objects, which can include images (such as photos) and / or videos. The list of media objects is displayed as a table of thumbnails. The media object list is currently in edit mode. In edit mode, each thumbnail in the media object list has a checkbox control (shown as a small square in the figure). The user can select a media object using the checkbox control. The tablet computer runs a slideshow application, and its screen displays the application's window 1420, which displays a slideshow file.

[0241] As shown in Figure 14, on the screen of the foldable phone, after the user selects media object 1411 from the gallery via a checkbox, they begin to drag it down the screen. It should be understood that this example is described with the user selecting two media objects; in actual implementation, the user may select more or fewer media objects, and this application does not impose any limitations. In response, icons for several applications appear below window 1410, including the icon 1402 of a slideshow application.

[0242] Optionally, when the user drags the first object, a floating window can be generated, which can display information such as a thumbnail of the first object. This floating window can move with the user's dragging operation. When the user drags the media object 1411 to the display area of ​​the slideshow application icon 802 and lifts their finger to end the dragging operation, in response, the media object 1411 is added to the window 1420 of the slideshow application displayed on the tablet screen, that is, added to the currently running slideshow file. For example, the media object 1411 is added to the current cursor position in the slideshow file.

[0243] Optionally, icons of one or more applications may be displayed below window 1410 according to pre-set animation effects. For example, the icons of the multiple applications may move in sequentially from the left side of the screen, which is not limited in this application.

[0244] Optionally, when a user drags the media object 1411 to the display area of ​​the slide application icon, the slide application icon may display an animation effect, such as the icon jumping up and down once or multiple times, to indicate to the user which application is currently selected. This application does not limit the animation effect.

[0245] Based on the system architecture shown in Figure 3, the processes shown in Figures 4, 7, 9, 11 and 13 can be implemented through functional modules such as the window manager and event manager. For details, please refer to Figure 15.

[0246] As shown in Figure 15, at 1510, when the user begins to drag the first object, the event manager can obtain the drag start (down) event and send the relevant information of the event to the window manager. The window manager can then respond to this event and perform corresponding processing operations.

[0247] In version 1520, when the user drags the first object to move it, the event manager can obtain the move event and send the relevant information of the event to the window manager. The window manager can then respond to the event and handle it accordingly.

[0248] In version 1530, when the user ends a drag operation, the event manager can obtain the end (up) event and pass the relevant information of the event to the window manager. The window manager can then respond to the event and handle it accordingly.

[0249] The specific way the window manager responds to the down, move, and up events can be seen in the processes shown in Figures 4, 7, 9, 11, and 13, and will not be repeated here.

[0250] It is understood that, in order to implement the functions of the electronic device in the above embodiments, the electronic device includes hardware and / or software structures corresponding to the execution of each function. Those skilled in the art should readily recognize that, based on the units and method steps of the various examples described in conjunction with the embodiments disclosed in this application, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed by hardware or by computer software driving hardware depends on the specific application scenario and design constraints of the technical solution.

[0251] Figure 16 is a schematic diagram of an electronic device provided in an embodiment of this application. Referring to Figure 16, the electronic device may include a processing unit 1610 and a display unit 1620. This electronic device can be used to implement the methods executed by the electronic device in the above embodiments. The electronic device may be the electronic device itself, or it may be a chip or chipset within the electronic device, or a part of a chip used to execute related methods.

[0252] When the electronic device 1600 is used to implement the process shown in FIG4: the display unit 1620 is used to display a first user interface on a first sub-screen and a second user interface on a second sub-screen. The first user interface includes a first object, and the second user interface includes an entry point for first information. The first user interface belongs to a first application, and the second user interface belongs to a second application. The processing unit 1610 responds to a user operation of dragging the first object to the entry point of the first information and hovering it with voice, and displays the first information on the second sub-screen. The processing unit 1610 is also used to respond to a user operation of dragging the first object to the first information, add the first object to the first information, or send the first object to the electronic device of the user associated with the first information.

[0253] When the electronic device 1600 is used to implement the process shown in FIG7: the display unit 1620 is used to display the first user interface of the first application on the first sub-screen, the first user interface including the entry of the first information and the entry of the second information, and to display the first information on the second sub-screen, the first information including the first object; the processing unit 1610 is used to respond to the user operation of dragging the first object to the entry of the second information, to display the second information on the second sub-screen, and to send the first object to the electronic device of the user associated with the second information.

[0254] When the electronic device 1600 is used to implement the process shown in FIG9: the display unit 1620 is used to display a first user interface, the first user interface including an entry point for a first object; the processing unit 1610 is used to display a second user interface on the screen where the first user interface is located in response to a user operation of dragging the first object to a first area of ​​the first user interface, or to display the first user interface and the second user interface in a split-screen manner, the second user interface including the first object.

[0255] When the electronic device 1600 is used to implement the process shown in FIG11: the display unit 1620 displays the first user interface of the first application by voice, the first user interface including a first object; the processing unit 1610 is used to perform the following operations in response to a user operation of dragging the first object: displaying the entry of at least one application on the screen where the first user interface is located, the at least one application including a second application; when the first object is dragged to the entry of the second application and hovered, displaying the second user interface on the screen where the first user interface is located, or displaying the second user interface and the first user interface in a split-screen manner, the second user interface belonging to the second application; when the first object is dragged into the second user interface, applying the first object in the second application.

[0256] When the electronic device 1600 is used to implement the process shown in FIG13: the display unit 1620 is used to display a first user interface of a first application, the first user interface including a first object; the processing unit 1610 is used to perform the following operations in response to a user operation of dragging the first object: displaying the entry of at least one application on the screen where the first user interface is located, the at least one application including a second application; when the first object is dragged to the entry of the second application and the user operation ends, the first object is sent to a second electronic device, the second electronic device being interconnected with the first electronic device.

[0257] A more detailed description of the processing unit 1610 and the display unit 1620 can be obtained directly from the relevant descriptions in the method embodiments shown in Figures 4, 7, 9, 11 and 13, and will not be repeated here.

[0258] It should be noted that the processing unit 1610 can be implemented in software or in hardware. For example, the following describes possible implementation methods of the processing unit.

[0259] As an example of a software functional unit, a processing unit may include code running on a computing instance. The computing instance may include at least one of a physical host (computing device), a virtual machine, or a container. Furthermore, the aforementioned computing instance may be one or more. For example, a processing unit may include code running on multiple hosts / virtual machines / containers.

[0260] As an example of a hardware functional unit, a processing unit may include at least one computing device, such as a server. Alternatively, the processing unit may also be a device implemented using an application-specific integrated circuit (ASIC) or a programmable logic device (PLD). The PLD may be implemented using a complex programmable logical device (CPLD), a field-programmable gate array (FPGA), generic array logic (GAL), or any combination thereof.

[0261] It should be noted that in other embodiments, the electronic device may include more or fewer modules, any module being used to perform any step in the backup and disaster recovery method, and the steps implemented by any module in the electronic device may be specified as needed, which is not limited in this application embodiment.

[0262] Based on the above embodiments, this application also provides a computer program product containing instructions, which, when run on a computer, causes the computer to perform the methods described in the embodiments of this application.

[0263] Based on the above embodiments, this application also provides a computer-readable storage medium storing a computer program, which, when executed by a computer, causes the computer to perform the methods described in the embodiments of this application.

[0264] Based on the above embodiments, this application also provides a chip for reading computer programs stored in a memory to implement the methods described in the embodiments of this application.

[0265] Based on the above embodiments, this application provides a chip system including a processor for supporting a computer device in implementing the methods described in the embodiments of this application. In one possible design, the chip system further includes a memory for storing necessary programs and data of the computer device. This chip system may be composed of chips or may include chips and other discrete devices.

[0266] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0267] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in one or more blocks of the flowchart illustrations and / or one or more blocks of the block diagrams.

[0268] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means that implement the functions specified in one or more flowcharts and / or one or more block diagrams.

[0269] These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process, such that the instructions, which execute on the computer or other programmable apparatus, provide steps for implementing the functions specified in one or more flowcharts and / or one or more block diagrams.

[0270] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the scope of protection of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.

Claims

1. An interactive display method, characterized in that, Applied to an electronic device, the display screen of the electronic device includes a first sub-screen and a second sub-screen; A first user interface is displayed on the first sub-screen, and a second user interface is displayed on the second sub-screen. The first user interface includes a first object, and the second user interface includes an entry point for first information. The first user interface belongs to a first application, and the second user interface belongs to a second application. In response to a user action of dragging the first object to the entry point of the first information and hovering it, the first information is displayed on the second sub-screen; In response to a user action of dragging the first object to the first information, the first object is added to the first information, or the first object is sent to the electronic device of the user associated with the first information.

2. The method as described in claim 1, characterized in that, The entry point for the first information is the first-level entry point for the first information; The step of displaying the first information on the second sub-screen in response to a user action of dragging the first object to the entry point of the first information and hovering over it includes: In response to a user action of dragging the first object to the first-level entry of the first information and hovering it, the second-level entry of the first information is displayed in the second sub-screen; In response to a user action of dragging the first object to the second-level entry point of the first information and hovering over it, the first information is displayed in the second sub-screen.

3. The method according to any one of claims 1-2, characterized in that, The method further includes: In response to a user action of dragging the first object to the entry point of the first information, the entry point of the first information is highlighted, and / or the display area where the entry point of the first information is located is highlighted.

4. The method according to any one of claims 1-3, characterized in that, Adding the first object to the first information includes: Based on the position of the cursor in the first information when the user operation of dragging the first object to the first information ends, the first object is added to the position of the cursor in the first information.

5. The method according to any one of claims 1-4, characterized in that, The first object is a media object, and the first information is a document or a contact dialog window.

6. An interactive display method, characterized in that, Applied to an electronic device, the display screen of the electronic device includes a first sub-screen and a second sub-screen; The first user interface of the first application is displayed on the first sub-screen. The first user interface includes an entry point for first information and an entry point for second information. The first information is displayed on the second sub-screen. The first information includes a first object. In response to a user action of dragging the first object to the entry point of the second information, the second information is displayed on the second sub-screen, and the first object is sent to the electronic device of the user associated with the second information.

7. The method as described in claim 6, characterized in that, The step of responding to a user operation that drags the first object to the entry point of the second information, displaying the second information on the second sub-screen, and sending the first object to the electronic device of the user associated with the second information includes: In response to a user action of dragging the first object to the entry point of the second information and hovering it, the second information is displayed on the second sub-screen; In response to the user's action of ending the drag, the first object is sent to the electronic device of the user associated with the second information.

8. The method as described in claim 6 or 7, characterized in that, The method further includes: In response to a user action of dragging the first object to the entry point of the second information and hovering it, the entry point of the second information is highlighted, and / or the display area where the entry point of the second information is located is highlighted.

9. The method according to any one of claims 6-8, characterized in that, The first application is a social networking application, and the first and second information are a contact chat window; or, The first application is a note-taking application, and the first and second information are documents.

10. An interactive display method, characterized in that, Applied to electronic devices, the method includes: Displaying a first user interface of a first application, the first user interface including a first object; In response to a user action of dragging the first object, perform the following operations: The screen containing the first user interface displays an entry point for at least one application, including a second application. When the first object is dragged to the entry point of the second application and hovered, the second user interface is displayed on the screen where the first user interface is located, or the second user interface and the first user interface are displayed in a split-screen manner, and the second user interface belongs to the second application; When the first object is dragged into the second user interface, the first object is applied in the second application.

11. The method as described in claim 10, characterized in that, When the second user interface is displayed on the screen where the first user interface is located, the size of the second user interface is smaller than the size of the display area of ​​the screen. The method further includes: The first user interface is displayed below the second user interface, and a portion of the first user interface is not obscured by the second user interface; or, A portion of the first user interface is displayed in the display area not occupied by the second user interface.

12. The method as described in claim 11, characterized in that, Also includes: In response to a user operation triggered by the first user interface, the first user interface is displayed, and the second user interface is displayed below the first user interface, with a portion of the second user interface not obscured by the first user interface; or, In response to a user action triggered by the first user interface, the first user interface is displayed, and a portion of the second user interface is displayed in the display area not occupied by the first user interface.

13. The method according to any one of claims 10-12, characterized in that, The second application matches the type of the first object.

14. The method according to any one of claims 10-13, characterized in that, The second application is a social application, and the second user interface includes an entry point for the first chat window; When the first object is dragged to the second user interface, applying the first object in the second application includes: When the first object is dragged to the entry point of the first dialog window in the second user interface, the first dialog window is displayed, and the first object is sent to the electronic device of the user associated with the first dialog window.

15. The method according to any one of claims 10-13, characterized in that, The second application is a note-taking application, and the second user interface includes an entry point for the first record; When the first object is dragged to the second user interface, applying the first object in the second application includes: When the first object is dragged to the entry point of the first record in the second user interface, the first record is displayed, and the first object is added to the first record.

16. An interactive display method, characterized in that, Applied to a first electronic device, the method includes: Displaying a first user interface of a first application, the first user interface including a first object; In response to a user action of dragging the first object, perform the following operations: The screen containing the first user interface displays an entry point for at least one application, including a second application. When the first object is dragged to the entry point of the second application and the user operation ends, the first object is sent to the second electronic device, which is interconnected with the first electronic device.

17. The method as described in claim 16, characterized in that, Before the screen displays an entry point for at least one application, it also includes: The at least one application is determined based on the type of the first object and the application currently running on the second electronic device, wherein the at least one application includes a second application currently running on the second electronic device.

18. The method as described in claim 16 or 17, characterized in that, Sending the first object to the second electronic device includes: The first object and instruction information are sent to the second electronic device, the instruction information being used to instruct the first object to be applied to the second application.

19. An electronic device, characterized in that, It includes units or modules for performing the method as described in any one of claims 1-5, or for performing the method as described in any one of claims 6-9, or for performing the method as described in any one of claims 10-15, or for performing the method as described in any one of claims 16-18.

20. An electronic device, characterized in that, include: One or more processors are configured to perform the method as claimed in any one of claims 1-5, or to perform the method as claimed in any one of claims 6-9, or to perform the method as claimed in any one of claims 10-15, or to perform the method as claimed in any one of claims 16-18.

21. A readable storage medium, characterized in that, The readable storage medium stores a program or instructions that, when executed on the device, cause the device to perform the method as described in any one of claims 1-5, or the method as described in any one of claims 6-9, or the method as described in any one of claims 10-15, or the method as described in any one of claims 16-18.

22. A chip system, characterized in that, Includes a processor for supporting a computer device in implementing the method as described in any one of claims 1-5, or the method as described in any one of claims 6-9, or the method as described in any one of claims 10-15, or the method as described in any one of claims 16-18.

23. A computer program product, characterized in that, The computer program product includes a program; when the computer program is run on a computer, it causes the computer to perform the method as described in any one of claims 1-5, or the method as described in any one of claims 6-9, or the method as described in any one of claims 10-15, or the method as described in any one of claims 16-18.

Images