Interface display method and electronic device

Abstract

The present application relates to the field of electronic technology, and discloses an interface display method and an electronic device. The screen of the electronic device involved in the present application displays a first window and a second window. Furthermore, the electronic device receives a drag instruction to drag a first object in the first window to the second window. When the application corresponding to the second window supports the file type of the first object, the electronic device displays a first snapshot of the first object. When the application corresponding to the second window supports the file type of the first object, the electronic device displays a second snapshot of the first object. The first snapshot is different from the second snapshot. In this way, the electronic device can present to the user whether the target window receives the display effect of the object during the process of the user dragging the first object, thereby improving the user's experience.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of terminal technology, and in particular to an interface display method and an electronic device. Background Art

[0002] As the display screens of electronic devices become larger and larger, the number of application (APP) windows that can be displayed simultaneously on the display screen is also increasing. Further, the technology of content interaction between APP windows has been derived. Figure 1 In the interface shown, the display screen of the electronic device displays a window 01 of the first APP and a window 02 of the second APP, and the window 01 contains an image 1. The user can drag the image 1 in the window 01 to the window 02. Usually, when the user drags the image 1 to the window 02, the electronic device has no feedback of the dragging effect, so that the user's operation experience is not good. Summary of the invention

[0003] The embodiments of the present application provide an interface display method and an electronic device, which can provide timely feedback to the user when the user performs a drag operation.

[0004] In a first aspect, an embodiment of the present application provides an interface display method, which is applied to an electronic device, wherein the screen of the electronic device displays a first window and a second window, comprising: receiving a drag instruction input by a user, wherein the drag instruction is used to instruct the electronic device to drag a first object in the first window to the second window; if the application corresponding to the second window supports the file type of the first object, displaying a first snapshot of the first object; if the application corresponding to the second window does not support the file type of the first object, displaying a second snapshot of the first object, wherein the second snapshot includes a first identifier, and the first identifier is used to indicate that the second window does not accept the first object.

[0005] Among them, the electronic device involved in the embodiment of the present application supports the display of multiple windows. The aforementioned first window may be a window of the first APP, and the second window may be a window of the second APP. Furthermore, when the user drags the first object in the first window to the second window, it actually triggers the electronic device to copy the first object running by the first APP to the second APP. The "user drags the first object in the first window to the second window" involved in the embodiment of the present application means that the user's finger enters the second window at the touch position of the screen. Based on this, when the second APP supports the file type of the first object, the second window can receive the first object. When the second APP does not support the file type of the first object, the second window cannot receive the first object. In the embodiment of the present application, before the user lets go, the electronic device can inform the user of the reception of the first object by the second window by displaying different snapshots.

[0006] It can be seen that, by adopting this implementation, the electronic device can display the first object differently according to whether the application corresponding to the second window supports the file type of the first object, thereby providing timely and accurate feedback to the user during the dragging process.

[0007] In a possible design, displaying the second snapshot of the first object includes: adding a layer to the third snapshot of the first object to obtain the second snapshot, wherein the third snapshot is generated after the electronic device receives the drag instruction and before determining the position triggered by the user to enter the second window. The layer is used to present to the user the display effect that the second window cannot receive the first object. In some embodiments, the layer can be gray or dark. In this way, the drag effect can be fed back to the user in a timely manner during the process of the user dragging the first object.

[0008] In a possible design, displaying the second snapshot of the first object includes: adding a first mark to a third snapshot of the first object to obtain the second snapshot, wherein the third snapshot is generated after the electronic device receives the drag instruction and before determining the position triggered by the user to enter the second window. The mark is used to present to the user the display effect that the second window cannot receive the first object. In this way, the drag effect can be fed back to the user in a timely manner during the process of the user dragging the first object.

[0009] In one possible design, the first mark is a graphic mark or a label, the first object includes at least one object, and the label is used to indicate the total number of first objects that the second window does not receive. In some embodiments, the first mark may be some specific symbols. In other embodiments, the first mark may be a quantity symbol. The quantity symbol is used to indicate the total number of first objects that the second window does not receive. In this embodiment, the first mark may be gray or dark. With this implementation, the electronic device can present more detailed drag effect information to the user in the process of feedback of the drag effect, thereby further enhancing the user's operating experience.

[0010] In a possible design, displaying the first snapshot of the first object includes: after determining that the third snapshot of the first object enters the second window, obtaining the first size of the third snapshot and the size of the second window, the third snapshot is generated after the electronic device receives the drag instruction and before determining that the position triggered by the user enters the second window; adjusting the third snapshot from the first size to the second size to obtain the first snapshot, the ratio of the second size to the size of the second window is greater than or equal to a first threshold and less than or equal to a second threshold, and the first threshold and the second threshold are both greater than 0 and less than 1. Among them, the electronic device can adjust the size of the first snapshot based on the size of the second window to optimize the visual effect of the snapshot in the second window. With this implementation, the electronic device can allow the user to preview the size of the received first object during the user dragging process, thereby further improving the user's operating experience.

[0011] In a possible design, adjusting the third snapshot from the first size to the second size to obtain the first snapshot includes: reducing the third snapshot from the first size to the second size to obtain the first snapshot; or enlarging the third snapshot from the first size to the second size to obtain the first snapshot. With this implementation, the electronic device can adaptively adjust the size of the snapshot according to the size of the receiving window during the user dragging process, so that the user can preview the size of the received object, thereby further improving the user's operating experience.

[0012] In a possible design, the second window includes an icon of a second object, and the displaying of the first snapshot corresponding to the first object includes: after determining that the third snapshot of the first object enters the second window, obtaining the first size of the third snapshot, the size of the second window, and the third size of the icon; adjusting the third snapshot from the first size to a fourth size to obtain the first snapshot, and adjusting the icon from the third size to the fourth size, wherein the ratio of twice the fourth size to the size of the second window is greater than or equal to a first threshold and less than or equal to a second threshold, and the first threshold and the second threshold are both greater than 0 and less than 1; arranging the first snapshot and the resized icon according to the position triggered by the user. When the second window already contains other objects, the electronic device can adaptively adjust the size and arrangement order of each icon according to the size of the second window and the number of objects in the second window, so as to present a preview display effect to the user, so that the user can see the display effect of the size and arrangement order of the received object in advance, thereby further improving the user's operation experience.

[0013] In a possible design, the first object includes at least one object, and displaying the first snapshot corresponding to the first object further includes: adding a second identifier to the third snapshot to obtain the first snapshot, and the second identifier is used to indicate the total number of first objects that the second window can receive. With this implementation, the electronic device can present more detailed drag effect information to the user during the process of feedback of the drag effect, thereby further improving the user's operating experience.

[0014] In a possible design, after receiving the drag command input by the user and before displaying the first snapshot or the second snapshot, it also includes: generating a third snapshot of the first object, the first object including at least one object; adding a third identifier to the third snapshot, the third identifier being used to indicate the total number of the first objects. In an embodiment of the present application, the electronic device also supports the user to drag at least two objects at a time, and accordingly, during the user's dragging process, the electronic device can identify the total number of objects dragged by the user. With this implementation, the electronic device can present more detailed drag effect information to the user during the process of feedback on the drag effect, thereby further improving the user's operating experience.

[0015] In a second aspect, an embodiment of the present application provides an electronic device having a function of implementing the behavior of the electronic device in the above method. The function can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions. In a possible design, the structure of the above electronic device includes a processor, a receiver and a display, and the processor is configured to process the electronic device to perform the corresponding functions in the above method. The receiver is used to implement the above electronic device to receive various instructions input by the user. The display is used to implement the display of snapshots by the above electronic device. The electronic device may also include a memory, which is used to couple with the processor and store the necessary program instructions and data for the electronic device.

[0016] In a third aspect, the present application provides a computer storage medium storing instructions, which, when executed on a computer, enables the computer to execute part or all of the steps of the interface display method in the first aspect and various possible implementations of the first aspect.

[0017] In a fourth aspect, the present application provides a computer program product, which, when running on a computer, enables the computer to execute part or all of the steps of the interface display method in the first aspect and various possible implementations of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0019] Figure 1 A schematic diagram of an interface of a dragging scenario provided in an embodiment of the present application;

[0020] Figure 2A A schematic diagram of an exemplary hardware structure of an electronic device 100 provided in an embodiment of the present application;

[0021] Figure 2B A schematic diagram of an exemplary software architecture of an electronic device 100 provided in an embodiment of the present application;

[0022] Figure 3 A schematic diagram of an exemplary signal interaction within the Android operating system provided in an embodiment of the present application;

[0023] Figure 4 A method flow chart of the interface display method provided in an embodiment of the present application;

[0024] Figure 5 A schematic diagram of an interface of a first exemplary dragging scenario provided in an embodiment of the present application;

[0025] Figure 6 Provided for the embodiments of this application Figure 5 Schematic diagram of the interface after the user releases the hand in the dragging scenario;

[0026] Figure 7 A schematic diagram of an interface of a second exemplary dragging scenario provided in an embodiment of the present application;

[0027] Figure 8 A schematic diagram of an interface of a third exemplary dragging scenario provided in an embodiment of the present application;

[0028] Fig. 9 A schematic diagram of an interface of a fourth exemplary dragging scenario provided in an embodiment of the present application;

[0029] Fig.10 A schematic diagram of an interface of a fifth exemplary dragging scenario provided in an embodiment of the present application;

[0030] Fig.11 A schematic diagram of an interface of a sixth exemplary dragging scenario provided in an embodiment of the present application;

[0031] Fig.12 An exemplary interface diagram of a collaborative office scenario provided in an embodiment of the present application;

[0032] Fig.13 Based on the embodiments of the present application Fig.12 An interface diagram of an exemplary dragging scenario;

[0033] Fig.14A A schematic diagram of an exemplary composition of an electronic device 140 provided in an embodiment of the present application;

[0034] Fig. 14B This is a schematic diagram of an exemplary structure of an electronic device 141 provided in an embodiment of the present application. DETAILED DESCRIPTION

[0035] The technical solution of the embodiment of the present application will be clearly described below in conjunction with the drawings in the embodiment of the present application.

[0036] The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to be used as limitations on the embodiments of the present application. As used in the specification and the attached claims of the embodiments of the present application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to also include plural expressions, unless there is a clear contrary indication in the context. It should also be understood that although the terms first, second, etc. may be used to describe a certain class of objects in the following embodiments, the objects should not be limited to these terms. These terms are only used to distinguish the specific objects of the class of objects. For example, the terms first, second, etc. may be used to describe windows in the following embodiments, but windows should not be limited to these terms. These terms are only used to distinguish different windows displayed by the display screen. The same is true for other classes of objects that may be described by the terms first, second, etc. in the following embodiments, which will not be repeated here. In addition, the term "and / or" is used to describe the association relationship of associated objects, indicating that three relationships can exist; for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character “ / ” generally indicates that the previous and next associated objects are in an “or” relationship.

[0037] An embodiment of the present application provides an interface display method. When a first window and a second window are displayed on the screen of an electronic device at the same time, a user can drag a first object in the first window to the second window, and display the first object differently according to whether an application corresponding to the second window supports the file type of the first object, thereby providing timely and accurate feedback for the user's dragging process.

[0038] For example, if a document in the first window is dragged to the second window, if the application corresponding to the second window supports the file type of the document, the document is highlighted in the second window. If the application corresponding to the second window does not support the file type of the document, the document is grayed out in the second window.

[0039] The following describes electronic devices, user interfaces for such electronic devices, and embodiments for using such electronic devices.

[0040] In some embodiments, the electronic device may be a portable electronic device that also includes other functions such as a personal digital assistant and / or a music player function, such as a mobile phone, a tablet computer, a wearable electronic device with a wireless communication function (such as a smart watch), etc. Exemplary embodiments of portable electronic devices include but are not limited to portable electronic devices equipped with or other operating systems. The above-mentioned portable electronic device may also be other portable electronic devices, such as a laptop computer (Laptop), etc. It should also be understood that in some other embodiments, the above-mentioned electronic device may not be a portable electronic device, but a desktop computer.

[0041] Figure 2A A schematic structural diagram of an electronic device 100 is shown.

[0042] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, an antenna, a wireless communication module 140, an audio module 150, a sensor module 160, a motor 170, and a display screen 180, etc.

[0043] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0044] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated into one or more processors. In some embodiments, the electronic device 100 may also include one or more processors 110.

[0045] Among them, the controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and execution.

[0046] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or circulated. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the electronic device 100.

[0047] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0048] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be coupled to the touch sensor 160B and the like through different I2C bus interfaces. For example, the processor 110 may be coupled to the touch sensor 160B through the I2C interface, so that the processor 110 communicates with the touch sensor 160B through the I2C bus interface, thereby realizing the touch function and drag function of the electronic device 100.

[0049] The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 140. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 140 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 150 can transmit an audio signal to the wireless communication module 140 through the UART interface to implement the function of playing music through a Bluetooth headset.

[0050] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 180. The MIPI interface includes a display serial interface (DSI) of the display screen 180, etc. In some embodiments, the processor 110 and the display screen 180 communicate through the DSI interface to implement the display function of the electronic device 100 to present a drag display effect to the user.

[0051] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 183, the display screen 180, the wireless communication module 140, the audio module 150, the sensor module 160, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0052] The USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and a peripheral device. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices, etc.

[0053] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0054] The wireless communication function of the electronic device 100 can be implemented through an antenna, a wireless communication module 140, and a baseband processor.

[0055] The antenna is used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antenna. For example, it can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0056] The wireless communication module 140 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 140 can be one or more devices integrating at least one communication processing module. The wireless communication module 140 receives electromagnetic waves via an antenna, modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 150 can also receive the signal to be sent from the processor 110, modulate the frequency, amplify it, and convert it into electromagnetic waves for radiation through the antenna.

[0057] In some embodiments, the antenna of the electronic device 100 is coupled to the wireless communication module 140, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS) and / or satellite based augmentation system (SBAS).

[0058] In some embodiments, the WLAN wireless communication solution provided by the wireless communication module 140 may also enable the electronic device to communicate with devices in the network (such as devices cooperating with the electronic device 100). In this way, the electronic device can perform data transmission with the cooperating devices.

[0059] The electronic device 100 implements the display function through a GPU, a display screen 180, and an application processor. The GPU is a microprocessor for image processing, which is connected to the display screen 180 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change the interface display effect. In an embodiment of the present application, the display screen 180 may include a display and a touch device. The display is used to output display content to the user, for example, the first snapshot and the second snapshot involved in the embodiment of the present application, the first identifier contained in the second snapshot, and the display effect previewed before the user leaves the hand. The touch device is used to receive a drag operation input by the user on the display screen 180.

[0060] The display screen 180 is used to display the user interface (UI) involved in the embodiment of the present application. The display screen 180 includes a display panel, and the display panel can be a liquid crystal display 180 (liquid crystal display, LCD), an organic light-emitting diode (organic light-emitting diode, OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diodes (quantum dot light emitting diodes, QLED), etc.

[0061] In some embodiments of the present application, when the display panel is made of materials such as OLED, AMOLED, FLED, etc., the display screen 180 can be bent. Here, the display screen 180 can be bent, which means that the display screen 180 can be bent to any angle at any position and can be maintained at the angle. For example, the display screen 180 can be folded in half from the middle to the left or right. It can also be folded in half from the middle to the top or bottom.

[0062] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, data such as music, photos, and videos can be stored in the external memory card.

[0063] The internal memory 121 can be used to store one or more computer programs, which include instructions. The processor 110 can run the above instructions stored in the internal memory 121, so that the electronic device 100 executes the interface display method provided in some embodiments of the present application, as well as various functional applications and data processing. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system; the program storage area can also store one or more applications (such as a gallery, contacts, etc.). The data storage area can store data created during the use of the electronic device 100 (such as the number of objects dragged by the user, etc.). In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0064] The audio module 150 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal. The audio module 150 can also be used to encode and decode audio signals. In some embodiments, the audio module 150 can be arranged in the processor 110, or some functional modules of the audio module 150 can be arranged in the processor 110. The audio module 150 can include a speaker, a microphone, and a headphone interface.

[0065] The sensor module 160 may include a pressure sensor 160A and a touch sensor 160B.

[0066] The pressure sensor 160A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 160A can be arranged on the display screen 180. There are many types of pressure sensors 160A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. A capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 160A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure based on the change in capacitance. When a touch operation acts on the display screen 180, the electronic device 100 detects the intensity of the touch operation based on the pressure sensor 160A. The electronic device 100 can also calculate the position of the touch based on the detection signal of the pressure sensor 160A.

[0067] The touch sensor 160B may also be referred to as a touch panel or a touch-sensitive surface. The touch sensor 160B may be provided on the display screen 180, and the touch sensor 160B and the display screen 180 form a touch screen, also referred to as a "touch screen". The touch sensor 160B is used to detect touch operations and hand-off operations acting on or near it. The touch sensor 160B may transmit the detected touch operations to the processor 110 to determine the type of touch event. The electronic device 100 may calculate the position of the user's touch and the position of the user's hand-off based on the detection signal of the touch sensor 160B, and may also determine and identify the user's drag operation based on the continuous change of the user's touch position. Furthermore, the electronic device 100 may provide visual outputs related to the aforementioned related operations (touch operations, hand-off operations, and drag operations) through the display screen 180.

[0068] The sensor module 160 may also include a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, an ambient light sensor, a bone conduction sensor, and the like.

[0069] Motor 170 can generate vibration prompts. Motor 170 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 180, motor 170 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0070] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The present application embodiment takes the Android system of the layered architecture as an example to exemplify the software structure of the electronic device 100.

[0071] Figure 2B It is a software structure block diagram of the electronic device 100 according to an embodiment of the present application.

[0072] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.

[0073] The application layer can include a series of application packages.

[0074] like Figure 2BAs shown, the application package may include applications (APPs) such as camera, gallery, mailbox, Bluetooth, memo, music, video, and file management.

[0075] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0076] like Figure 2B As shown, the application framework layer may include a window manager, a view system, a drag manager, a content provider, a resource manager, a notification manager, etc. Among them, the functional modules of the application framework layer can be integrated into Figure 2A In the illustrated processor 110, the functions of the application framework layer in this embodiment can be Figure 2A Illustrated hardware processor 110 implementation.

[0077] The window manager is used to manage window programs. For example, the window manager can obtain the size of the display screen 184, determine whether there is a status bar, lock the screen, capture the screen, etc. The window manager can also manage the distribution of each APP in the application layer and the window layout of each APP to achieve the function of displaying two APP windows on the display screen 184. In addition, the window manager has the function of identifying the file types supported by the APP, so that the window manager can determine whether the APP can support the file type of the object dragged by the user.

[0078] The view system includes visual interface elements, such as interface elements for displaying text, interface elements for displaying images, etc. The view system can be used to construct the display interface of the APP. The display interface can be composed of one or more views. For example, it includes the display interface of various APP icons, etc. The view system can also construct a snapshot of the dragged object. The snapshot includes, for example, the size and logo of the snapshot, and the logo can include layers and logos, etc.

[0079] The drag manager can determine the position touched by the user and the snapshot of the corresponding object based on the detection signal reported by the touch sensor 160B. Furthermore, the drag manager can control the corresponding snapshot to move on the display screen 180 along with the position touched by the user to implement the drag function.

[0080] For example, Figure 2B Similarly, Figure 3The signal interaction diagram inside the Android operating system is illustrated. Among them, the window manager can respond to the user's operation instructions to control the display of the window of the first APP and the window of the second APP on the display screen 180. After obtaining the touch signal reported by the touch sensor 160B and the movement instruction of the user's gesture, the view system draws a snapshot of the object corresponding to the touch signal. In addition, the drag manager controls the corresponding snapshot to move along the user's gesture trajectory. The window manager can detect the position of the snapshot on the display screen 180. After detecting that the aforementioned snapshot is within the window range of the second APP, the window manager can determine whether the second APP supports the file type corresponding to the snapshot. After that, the window manager transmits the judgment result to the view system. Furthermore, the view system adds a layer to the aforementioned snapshot based on the judgment result to feedback the display effect of the second APP receiving the corresponding object to the user through the color and brightness of the layer. In some other embodiments, the view system can also add an icon to the aforementioned snapshot to indicate the number of objects dragged by the user. In some other embodiments, the view system can also draw the size of the snapshot allowed to be received by the second APP according to the size of the second APP window, so that the size of the corresponding snapshot is adapted to the size of the second APP window.

[0081] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0082] The resource manager provides various resources for the application, such as localized strings, icons, images, layout files, video files, and so on.

[0083] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0084] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0085] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0086] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0087] The system library may include multiple functional modules, such as surface manager, media libraries, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0088] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0089] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0090] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0091] A 2D graphics engine is a drawing engine for 2D drawings.

[0092] The kernel layer is a layer between hardware and software. The kernel layer at least includes display driver, camera driver, audio driver, sensor driver, etc., and the present application embodiment does not impose any restrictions on this.

[0093] For ease of understanding, the following embodiments of the present application will be described in detail with Figure 2A and Figure 2B Taking the electronic device 100 of the structure shown as an example, the interface display method provided in the embodiment of the present application is specifically described in conjunction with the accompanying drawings.

[0094] In the embodiment of the present application, the electronic device 100 can display the first window and the second window through the display screen 180. Based on this, Figure 4As shown, the electronic device 100 receives a drag command input by a user, and the drag command is used to instruct to drag the first object in the first window to the second window. If the application corresponding to the second window supports the file type of the first object, the electronic device 100 displays a first snapshot of the first object. If the application corresponding to the second window does not support the file type of the first object, the electronic device 100 displays a second snapshot of the first object, and the second snapshot includes a first identifier, and the first identifier is used to indicate that the second window does not accept the first object. In this way, the electronic device 100 can provide feedback to the user on the drag effect during the process of the user dragging the object, thereby improving the user's operating experience.

[0095] Among them, the first window displayed by the electronic device 100 may be a window of the first APP, and the second window may be a window of the second APP. The above-mentioned first object may include text, images, audio files, etc. During the user's dragging process, the dragged element displayed by the electronic device 100 may be a snapshot of the dragged object. Exemplarily, after receiving the drag instruction, the electronic device 100 generates a third snapshot of the first object, and the third snapshot moves with the user's dragging trajectory. After the third snapshot is dragged into the second window and before the user lets go, the electronic device 100 can process the third snapshot to obtain the first snapshot or the second snapshot.

[0096] The snapshot may be a layer of the interface icon of the dragged object, and the content of the snapshot is the same as the interface icon of the dragged object. In some embodiments, the size and aspect ratio of the snapshot may be the same as the size and aspect ratio of the interface icon of the corresponding object, such as Figure 5 The size and aspect ratio of the image 13 in the image 13 are the same as the size and aspect ratio of the snapshot 131. In other embodiments, the size and aspect ratio of the snapshot may be different from the size and aspect ratio of the interface icon of the corresponding object, for example, Figure 7 The size and aspect ratio of the image 23 in FIG. 2 are different from the size and aspect ratio of the snapshot 231 .

[0097] In some embodiments, the first identification includes a layer. In other embodiments, the first identification includes a logo. In other embodiments, the first identification includes a layer and a logo. The layer may be gray or dark, and the logo may be some specific symbols, so as to remind the application corresponding to the second window that it cannot receive the first object by displaying the layer and / or logo.

[0098] In an embodiment of the present application, the first object in the first APP window is dragged into the window of the second APP, which essentially triggers the electronic device 100 to copy the first object in the first APP to the second APP. Based on this, if the second APP supports the file type of the first object, or the corresponding window interface of the second APP can receive the first object, then the electronic device 100 can copy the first object to the second APP. If the second APP does not support the file type of the first object, or the corresponding window interface of the second APP cannot receive the first object, then the electronic device 100 does not need to copy the first object to the second APP. In response to the user's hand-off (up) operation instruction, the electronic device 100 can control the snapshot of the first object to return to the window of the first APP, and hide the corresponding snapshot.

[0099] It should be noted that whether the same object can be received may differ in different interfaces or different windows of the same APP. For example, the first object is an image, and the second APP is a mailbox APP. The electronic device displays the sending address window and the mailbox content window of the mailbox APP, wherein the sending address window cannot receive the first object, but the mailbox content window can receive the first object. For another example, the first object is a video, and the second APP is an instant messaging APP. When the electronic device displays the address book interface of the instant messaging APP, the address book interface cannot receive the first object. When the electronic device switches to displaying the conversation interface of the instant messaging APP with a contact, the conversation interface can receive the first object.

[0100] In addition, it should be pointed out that the scenarios involved in the embodiments of the present application are all implementation scenarios before the user leaves the hand, which can also be described as a scenario in which the user's finger touches the screen of the electronic device. Among them, the user's finger touching the screen of the electronic device can be the user's finger touching the screen of the mobile phone 10, or, when the distance between the user's finger and the screen of the electronic device is less than 0.5 millimeters (mm), it can also be called the user's finger touching the screen of the electronic device. In actual implementation, when the user's finger touches the screen of the electronic device, the distance between the finger and the screen can be determined by the touch sensitivity of the mobile phone. The user's finger leaving the screen of the electronic device can be regarded as the user leaving the hand (up).

[0101] The following describes various embodiments of the present application in conjunction with the user interface (UI) of the electronic device 100 .

[0102] The UI involved in the embodiments of the present application is a media interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The user interface of an application is a source code written in a specific computer language such as Java and extensible markup language (XML). The interface source code is parsed and rendered on the terminal device, and finally presented as content that the user can recognize, such as images, text, audio and video files, controls, and other interface elements. A control, also called a widget, is a basic element of the user interface. Typical controls include toolbars, menu bars, text boxes, buttons, scroll bars, etc. The attributes and contents of the above-mentioned interface elements are defined by tags or nodes, such as XML through <textview> 、 <imgview> 、 <videoview>Nodes such as CSS and HTML are used to specify the text type of interface elements. A node corresponds to an interface element or attribute in the interface. After parsing and rendering, the node is presented as user-visible content. In addition, many applications, such as hybrid applications, usually also contain web pages in their interfaces. A web page, also known as a page, can be understood as a special control embedded in the application interface. A web page is source code written in a specific computer language, such as hypertext markup language (HTML), cascading style sheets (CSS), JavaScript (JS), etc. The web page source code can be loaded and displayed as user-recognizable content by a browser or a web page display component with similar functions to a browser. The specific content contained in a web page is also defined by tags or nodes in the web page source code. For example, HTML is defined by tags or nodes in the web page source code. 、 、 <video> 、 <canvas>To define the elements and attributes of a web page.

[0103] A common form of user interface is a graphical user interface (GUI), which refers to a user interface related to computer operation that is displayed in a graphical manner. It can be an interface element such as an icon, window, or control displayed on the display screen 180 of an electronic device, where a control can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0104] Scenario 1:

[0105] In scenario 1, when the user drags an object in the first APP window to the second APP window, the electronic device 100 presents different display effects according to the different reception conditions of the corresponding object by the second APP. The "drag process" described in the embodiment of the present application refers to the operation process from the time when the user touches the object in the first APP window to the time when the user lets go. Figure 5 Taking the mobile phone 10 as an example, a set of GUIs is used to illustrate the user's dragging process and interface display effects.

[0106] like Figure 5 The GUI shown in (a) is the display interface when the user performs a drag operation. Figure 5 As shown in (a) of FIG. 1 , the screen of the mobile phone 10 displays a first window 11 and a second window 12. The first window 11 includes an image 13. When the user's finger touches the image 13 and begins to move on the screen, the view system of the mobile phone 10 draws a snapshot of the image 13, and obtains Figure 5 Snapshot 131 is shown in (a) in FIG. In this embodiment, snapshot 131 is an exemplary implementation of the third snapshot. When the user's finger touches snapshot 131 and continues to move, the touch sensor of the mobile phone 10 continues to detect signals. Accordingly, the drag manager of the mobile phone 10 can control snapshot 131 to move along the user's moving trajectory based on the signal detected by the touch sensor to implement the drag function.

[0107] It should be noted that, in the present embodiment, the mobile phone 10 can receive a split-screen operation input by the user, and in response to the split-screen operation, divide the screen into two areas. Afterwards, the mobile phone 10 displays a first window 11 of the first APP in one of the two areas in response to the operation of opening the APP input by the user, and displays a second window 12 of the second APP in the other area of ​​the two areas. It is not described in detail here. Among them, the first APP and the second APP can be any APP installed on the mobile phone 10. The first APP is, for example, a gallery, and accordingly, the first window 11 is a window of the gallery, and the second APP is, for example, a memo, and accordingly, the second window 12 is a window of the memo. There is no restriction here.

[0108] After the user drags snapshot 131 to the second window 12 and before the user lets go, the window manager of the mobile phone 10 can determine that snapshot 131 has entered the second window 12 based on the position detected by the touch sensor. Afterwards, the window manager can obtain the file type (i.e., image type) of image 13 based on the information of the object corresponding to snapshot 131 (i.e., image 13). Furthermore, the window manager detects whether the file types supported by the second APP (i.e., the APP corresponding to the second window 12) contain images. If the file types supported by the second APP contain images, the window manager can transmit the judgment result of "contains" to the view system. The view system can do nothing with snapshot 131. Figure 5 The GUI shown in (a) is updated to Figure 5 1. After the user releases the mobile phone 10, the processor of the mobile phone 10 may copy the image 13 to the second window 12, and the view system may draw the copy of the image 13 in the second window 12. If the file types supported by the second APP do not contain images, the window manager may transmit the judgment result of "not containing" to the view system. The view system adds interface elements to the snapshot 131 to obtain the snapshot 132. Figure 5 The GUI shown in (a) is updated to Figure 5 GUI shown in (c) in FIG.

[0109] It is understandable that the mobile phone 10 usually determines the position of the user dragging the snapshot by detecting the touch position of the user's finger on the screen. Based on this, in the above embodiment, in the scenario where the position determined by the detection signal of the touch sensor enters the second window 12, the window manager determines that the snapshot 131 is located in the second window 12.

[0110] It is understandable that the "file types supported" by the second APP can refer to the types that can be displayed normally, run normally, and respond to operation instructions to implement corresponding functions based on the software framework of the second APP. Among them, "responding to operation instructions to implement corresponding functions" means that after an object is dragged to the window of the second APP, the second APP can perform corresponding functional operations on the object based on its own functional attributes. For example, Figure 6 In the illustrated GUI, the second window 12 is a chat window of a social APP, which supports the file type of the image 13, for example. Figure 6 In the chat window in the chat window, and after detecting that the user has left the hand, the social APP can send a copy of image 13 to the contact corresponding to the chat window. For another example, if the second APP is an email APP, the second window is a window of the email content. After image 13 is dragged to the second window, the email APP can insert a copy of image 13 as an attachment to the email. This is not described in detail here. The above-mentioned "unsupported file type" of the second APP may refer to a type that cannot be displayed normally, cannot run normally, or has limited execution of corresponding functions based on the software framework of the second APP. .

[0111] In addition, the aforementioned interface elements may include layer symbols, label symbols and other symbols.

[0112] like Figure 5 The GUI shown in (b) is a display interface when the second APP supports images. Figure 5 As shown in (b) in FIG. 1 , before the user releases the hand, the view system does not perform any operation on the snapshot 131. The snapshot 131 is normally displayed in the second window 12, so that the user can receive the image 13 through visual perception of the second APP. Among them, the first snapshot of the image 13 is implemented as the snapshot 131 in this embodiment.

[0113] like Figure 5 The GUI shown in (c) is the display interface when the second APP does not support images. In this scenario, before the user lets go, the view system can add a gray layer and a mark 14 on the snapshot 131 to update the snapshot 131 to the snapshot 132. Figure 5 As shown in (c), snapshot 132 is dark or gray compared to the bright or colorful snapshot 131, and the upper right corner of snapshot 132 includes an indicator mark 14, so that the user can visually perceive that the second APP does not receive image 13. The second snapshot of image 13 is implemented as snapshot 132 in this embodiment, and accordingly, the gray layer and mark 14 are the first identification of the second snapshot.

[0114] In some other embodiments, the mobile phone 10 presents Figure 5 In the GUI process shown in (c), a sound can also be output to inform the user that the second APP does not support objects with file types of images.

[0115] In some other embodiments, the mobile phone 10 presents Figure 5 During the GUI process shown in (c), the user may also be notified through vibration that the second APP does not support objects whose file type is an image.

[0116] It can be seen that, with this implementation, when the user drags an object, the mobile phone 10 can present different interface display effects to the user based on the receiving APP's support for the file type of the dragged object. In this way, the mobile phone 10 can provide feedback on the drag effect to the user during the user's dragging of the object, thereby improving the user's operating experience.

[0117] Scenario 2:

[0118] Scene 2 illustrates the interface display method of the electronic device 100 when the user drags at least two objects at a time. Figure 7 Still taking the mobile phone 10 as an example, a set of GUIs is used to indicate the interface display effect of a user dragging at least two objects.

[0119] like Figure 7 The GUI shown in (a) is a display interface when a user selects an object to be dragged. Figure 7 As shown in (a) in the figure, the screen of the mobile phone 10 displays a first window 21 and a second window 22. The first window 21 includes an image 23 and a text 24. Exemplarily, in response to a user long pressing the image 23 or the text 24, the mobile phone 10 may, for example, display a check box 230 in the lower right corner of the image 23 and a check box 240 in the lower right corner of the text 24. In response to the user clicking on the check box 230 and the check box 240, the mobile phone 10 receives a selection instruction, which associates the image 23 and the text 24, and then the mobile phone 10 selects the image 23 and the text 24. Afterwards, after receiving the drag instruction input by the user, the mobile phone 10 executes the drag function, Figure 7 The GUI shown in (a) is updated to Figure 7 GUI shown in (b) in .

[0120] It should be noted that when the user touches any object in the image 23 and the text 24 to move, the mobile phone 10 can recognize the corresponding instruction as the aforementioned drag instruction.

[0121] Signs such as Figure 7 The GUI shown in (b) is the display interface when the user performs a drag operation. Figure 7 As shown in (b), when the user's finger starts to move, the view system of the mobile phone 10 generates a snapshot 231 of the image 23, a snapshot 241 of the text 24, and a mark 25. The content of the mark 25 can be the total number of objects dragged by the user. In this example, the content of the mark 25 is 2. Then, the view system displays the two snapshots in a stack, and highlights the mark 25 in the upper right corner of the stacked snapshots. In addition, when the user's finger starts to move, the drag manager of the mobile phone 10 can control the snapshots 231, snapshot 241 and mark 25 to move along the user's movement trajectory to achieve the drag function. Further, after detecting that the user drags snapshots 231 and snapshot 241 to the second window 22, the window manager detects whether the APP corresponding to the second window 22 supports objects with a file type of image, and whether the APP corresponding to the second window 22 supports objects with a file type of text. Afterwards, the view system adds interface elements to snapshots 231 and snapshot 241 based on the detection results of the window manager. Correspondingly, as shown Figure 7 The GUI shown in (b) is updated as follows Figure 7 GUI shown in (c) in FIG.

[0122] In other embodiments, if the user drags at least two objects at a time, the viewing system may only draw snapshots of the corresponding at least two objects, and stack and display the snapshots of the corresponding at least two objects without adding a mark indicating the total number of objects.

[0123] It should be noted that, in order to optimize the display effect, after the view system generates the snapshot of the image 23 and the snapshot of the text 24, the two snapshots may be scaled so that the sizes of the two snapshots are the same (eg, Figure 7 In some other embodiments, the view system may generate a snapshot of the same size as the image 23 itself, and generate a snapshot of the same size as the text 24 itself, and then directly stack the two snapshots without scaling them. This is not limited here.

[0124] like Figure 7 The GUI shown in (c) is a display interface for the user to drag snapshot 231 and snapshot 241 into the second window 22. In this embodiment, the APP corresponding to the second window 22, for example, supports objects with the file type of image, but does not support objects with the file type of text. Furthermore, the view system sets a mark 26 in the area in the upper right corner of snapshot 231 to obtain snapshot 232, and adds a gray layer on the interface of snapshot 241, and sets a mark 27 in the area in the upper right corner of snapshot 241 to obtain snapshot 242. Mark 26 is highlighted, and the content of mark 26 is, for example, the total number of objects that the APP corresponding to the second window 22 can receive. Mark 27 is gray, and the content of mark 27 is, for example, the total number of objects that the APP corresponding to the second window 22 cannot receive. As shown in FIG. Figure 7 As shown in (c) in the figure, the view system controls Figure 7 In (b), the stacked snapshots 231 and 241 are changed into the snapshots 232 and 242 which are tiled on the interface, so as to show the entire interface of the snapshot 232 and the entire interface of the snapshot 242 to the user. The upper right corner area of ​​the snapshot 232 includes a highlighted mark 26, whose content is "1", indicating that the second window 22 can receive one of the above two objects. The snapshot 242 is dark or gray, and the upper right corner area of ​​the snapshot 242 includes a dark or gray mark 27, whose content is "1", indicating that the second window 22 does not receive one of the above two objects.

[0125] In some other embodiments, after the user drags snapshot 231 and snapshot 241 into second window 22, the view system may only add a gray layer and a mark 27 on snapshot 241, and do not perform any processing on snapshot 231. The view system may also display snapshot 231 and snapshot 242 after adding the gray layer and mark 27 flat on the interface. Figure 6 The snapshot 242 shown in (c) in FIG. 1 shows a similar effect, which will not be described in detail here.

[0126] In some other embodiments, if the user drags at least three objects at a time, after dragging the snapshots of the at least three objects into the second window, the view system can control the snapshots of the at least three objects to be displayed in two groups, wherein the snapshots of the objects that the second APP can receive form one group, at least one snapshot in the group is displayed in a stacked manner, and the total number of objects that the second APP can receive is displayed. The snapshots of the objects that the second APP cannot receive form another group, at least one snapshot in the group can be displayed in a stacked manner, and the total number of objects that the second APP cannot receive is displayed.

[0127] For example, Figure 8 The GUI shown in FIG. 1 is a display interface for a user to drag four objects. Figure 8 As shown, in response to the user's dragging operation in the first window 31, the view system controls the snapshot stacking display of the four objects, and sets a mark with the number 4 as the highlighted content in the upper right corner of the stacked snapshot (not shown in the figure). In response to the user's touch position entering the second window 32 (i.e., the four objects are dragged into the second window 32), the window manager determines, for example, that the second window 32 can receive two of the objects but cannot receive the other two objects. Figure 8 As shown, the view system controls the stacking display of the two snapshots that the second window 32 can receive, and marks the upper right corner area of ​​the two snapshot stacking interfaces with a highlighted mark 33, and the number indicated by the mark 33 is "2". In addition, the view system adds a gray layer to the two snapshots that the second window 32 does not receive, and then controls the stacking display of the two snapshots after the gray layer is added, and marks the upper right corner area of ​​the two snapshot stacking interfaces with a gray mark 34, and the number indicated by the mark 34 is "2".

[0128] In some other embodiments, if the user drags at least three objects at a time, after dragging the snapshots of the at least three objects into the second window, the view system can control the snapshots of the at least three objects to be displayed in two groups, wherein the snapshots of the objects that the second APP can receive form one group, at least one snapshot in the group is displayed in a tiled manner, and the upper right corner area of ​​each snapshot displays the sequence number of the snapshot. The snapshots of the objects that the second APP cannot receive form another group, at least one snapshot in the group can be displayed in a tiled manner, and the upper right corner area of ​​each snapshot displays the sequence number of the snapshot.

[0129] For example, Fig. 9 The GUI shown in FIG. 1 is another display interface for a user to drag four objects. Fig. 9 As shown, in response to the user's dragging operation in the first window 41, the view system controls the snapshots of the four objects to be displayed in a stack, and highlights a mark with the number 4 in the upper right corner of the stacked snapshots (not shown in the figure). In response to the user's touch position entering the second window 42, the window manager determines, for example, that the second window 42 can receive two of the objects but cannot receive the other two objects. Fig. 9 As shown, the view system controls the two snapshots that the second window 32 can receive to be tiled in the horizontal direction of the user's perspective. Among them, the upper right corner area of ​​the snapshot arranged on the left highlights the mark 43 containing the number 1, and the upper right corner area of ​​the snapshot arranged on the right highlights the mark 44 containing the number 2. In addition, the view system adds a gray layer to the two snapshots that the second window 32 does not receive, and controls the two snapshots after adding the gray layer to be tiled in the horizontal direction of the user's perspective below the two snapshots that the second window 32 can receive. Among them, the mark 45 containing the number 1 in the upper right corner area of ​​the snapshot arranged on the left is gray, and the mark 46 containing the number 2 in the upper right corner area of ​​the snapshot arranged on the right is gray.

[0130] Understandably, Figures 7 to 9 This is only a schematic description and does not limit the embodiments of the present application. In other embodiments, the user can also drag more or fewer objects. In addition, after the snapshot of the object is dragged to the window of the second APP, it can also be presented as other display effects. For example, the logo containing numbers in the above embodiment can be set in the lower right corner area of ​​the snapshot, etc. The embodiments of the present application are not limited to this.

[0131] By adopting this implementation method, the mobile phone 10 can present more detailed drag effect information to the user during the process of feedback of the drag effect, thereby further improving the user's operating experience.

[0132] Scenario 3:

[0133] In the embodiment of the present application, the size of the snapshot of the dragged object drawn by the view system is, for example, the first size. In scenario three, if the second APP can receive the dragged object, after detecting that the snapshot of the object enters the window of the second APP (the second window), the electronic device 100 can adaptively adjust the snapshot from the first size to the second size according to the size of the second window, so that the snapshot can be completely within the window, and the size ratio of the snapshot to the window achieves the best visual effect.

[0134] In actual implementation, in some embodiments, the electronic device 100 may reduce the snapshot from the first size to the second size. Fig.10 In some other embodiments, the electronic device 100 may enlarge the snapshot from the first size to the second size. For example, Fig.10 This is shown in the scenario shown in (b).

[0135] In some embodiments, if the snapshot entering the second window is a snapshot of the first object received by the second APP, the electronic device 100 can adjust the size of the snapshot so that the proportion of the size of the snapshot to the size of the window is greater than or equal to the first threshold and less than or equal to the second threshold, so as to achieve the best visual effect of the snapshot in the second window. The first threshold and the second threshold are both greater than 0 and less than 1. The first threshold is, for example, 50%, and the second threshold is, for example, 70%. This is not limited here. The following takes the mobile phone 10 as an example, combined with Fig.10 A set of GUIs are shown to describe the interface display method of scenario three.

[0136] It should be noted that the above "size" may include two parameters: pixels in the x-axis direction (px) and pixels in the y-axis direction. In the embodiment of the present application, the pixels in the x-axis direction of the snapshot are referred to as the "width" of the snapshot, and the pixels in the y-axis direction of the snapshot are referred to as the "height" of the snapshot.

[0137] like Fig.10 The GUI shown in (a) is a display interface of the mobile phone 10 when the snapshot size is reduced. Fig.10 As shown in (a), in response to the user's operation of dragging image 50, the view system of mobile phone 10 draws a snapshot of image 50 to obtain snapshot 51. Snapshot 51 is, for example, 1080px wide and 500px high. In this embodiment, the second APP includes, for example, window 52 and window 53, and the user drags snapshot 51 into window 52. Window 52 is, for example, 1500px wide and 400px high. After detecting that the user drags snapshot 51 to window 52 of the second APP, and determining that the second APP supports objects with file types of images, the view system of mobile phone 10 adjusts the width of snapshot 51 to, for example, 1000px, and adjusts the height of snapshot 51 to, for example, 380px, to obtain snapshot 54, so that the area of ​​snapshot 54 accounts for 63% of the area of ​​window 52. In this way, in response to the user's hand-off operation, mobile phone 10 can generate a new image according to the width and height of snapshot 54. The first snapshot of image 50 is implemented as snapshot 54 in this embodiment.

[0138] like Fig.10 The GUI shown in (b) is a display interface of the mobile phone 10 for enlarging the size of the snapshot. In this embodiment, the user drags the snapshot 51 into the window 53. The window 53 is, for example, 1500px wide and 1200px high. Fig.10 As shown in (b), after detecting that the user drags snapshot 51 to the window 53 of the second APP, the view system of the mobile phone 10 adjusts the width of snapshot 51 to 1200px, and the height of snapshot 51 to 900px, for example, to obtain snapshot 55, so that the area of ​​snapshot 55 accounts for 60% of the area of ​​window 53. In this way, in response to the user's hand-off operation, the mobile phone 10 can generate a new image according to the width and height of snapshot 55. The first snapshot of image 50 is implemented as snapshot 55 in this embodiment.

[0139] In some other implementations, the view system may also add a highlight mark to snapshot 54 and snapshot 55 , where the mark has a content of 1, for example.

[0140] Understandably, Fig.10 This is just a schematic description. Fig.10 (a) and Fig.10 The size shown in (b) does not constitute a limitation on the embodiments of the present application. In other embodiments, if the electronic device 100 is implemented as a device with a larger screen, such as a foldable screen mobile phone, the size of the above window and the size of the snapshot can be larger. This is not described in detail here.

[0141] By adopting this implementation, the mobile phone 10 can adaptively adjust the size of the snapshot according to the size of the receiving window during the user dragging process, so that the user can preview the size of the received object, thereby further improving the user's operating experience.

[0142] Scenario 4:

[0143] Scenario 3 is the interface display method of the electronic device 100 in the scenario where the second APP receives the first object. If the second APP continues to receive the second object and more objects, the electronic device 100 can display the preview effect of each object according to the size of the window and the number of objects received. The electronic device 100 can also display a snapshot of the second object and a preview effect of the relative position of the icon of the first object according to the position triggered during the user's dragging process.

[0144] Exemplarily, the electronic device 100 can adjust the size of each object interface element in the window under the condition that the sum of the sizes of all object icons in the window accounts for a proportion of the window size greater than or equal to the first threshold and less than or equal to the second threshold, so as to display to the user a preview interface after the user releases the hand. The first threshold and the second threshold are as described in the above embodiment and are not repeated here.

[0145] Scenario 4: Taking mobile phone 10 as an example, combined with Fig.11 A set of GUIs are shown to describe the interface display method of the electronic device 100 through implementation scenarios of dragging two objects respectively.

[0146] like Fig.11 The GUI shown in (a) is an exemplary display interface of the mobile phone 10. Fig.11 As shown in (a), the second APP has received the first object 61, and the icon of the first object 61 is shown in the second window 60. In this embodiment, the second window 60 is, for example, 1500px wide and 1300px high. The icon of the first object 61 is, for example, 1200px wide and 1100px high. After detecting that the user drags the snapshot 62 into the second window 60 and the second APP supports the file type corresponding to the snapshot 62, before the user lets go, Fig.11 The GUI shown in (a) is updated to Fig.11 GUI shown in (b) in .

[0147] like Fig.11 The GUI shown in (b) is an exemplary preview display interface of the mobile phone 10 during the process of the user dragging the second object to the second APP. Fig.11 As shown in (b) in the figure, the window manager of the mobile phone 10 detects that the position touched by the user is on the right side of the first object 61. Then, the view system of the mobile phone 10 can reduce the width of the icon of the first object 61 to 720px, and keep the height unchanged, to obtain snapshot 63. The view system also adjusts the width of snapshot 62 to 720px and the height to 1300px, to obtain snapshot 64, and sets snapshot 64 to the right of snapshot 63, presenting a preview interface of the first object 61 and the second object, so as to show the display effect to the user in advance. Then, after detecting that the user has lifted his hand, the view system adjusts the width of snapshot 62 to 720px and the height to 1300px, to obtain snapshot 64, and sets snapshot 64 to the right side of snapshot 63, presenting a preview interface of the first object 61 and the second object, so as to show the display effect to the user in advance. Fig.11 The preview display effect shown in (b) in FIG. 1 is that the copied content of the second object is arranged on the right side of the first object and displayed, and the size of the second object icon and the size of the first object icon are the same as described above.

[0148] In other embodiments, Fig.11 The GUI shown in (c) is another exemplary preview display interface of the mobile phone 10 during the process of the user dragging the second object to the second APP. Fig.11 As shown in (c) in FIG. 1 , the window manager of the mobile phone 10 detects that the position touched by the user is on the left side of the first object 61, and the view system sets the snapshot 64 to the left side of the snapshot 63, and Fig.11 The size of the icon of the first object 61 and the size of the snapshot 63 are adjusted to present another preview display interface of the first object 61 and the second object. Fig.11 The preview display effect shown in (c) is that the copied content of the second object is arranged on the left side of the first object and displayed, and the size of the second object icon and the size of the first object icon are the same as described above.

[0149] Understandably, Fig.11 This is only a schematic description and does not constitute a limitation on the embodiments of the present application. In other embodiments, the icons or snapshots of the two objects may also be arranged in a vertical positional relationship, which is not limited here.

[0150] In addition, in some other embodiments, if the user continues to drag the third or more objects to the second window 60, the mobile phone 10 can adaptively adjust the size of the icons of the received objects and the size of the snapshot to be released according to the total number of objects received by the second APP. And the mobile phone 10 can adjust the arrangement order of each icon in response to the position touched by the user's finger. This will not be described in detail here.

[0151] By adopting this implementation method, the mobile phone 10 can adaptively adjust the size and arrangement order of each icon according to the size of the receiving window and the number of objects already received during the user dragging process, so that the user can preview the size and arrangement order of the received objects, thereby further improving the user's operating experience.

[0152] In addition, although any of the above scenarios 1 to 4 are described using a non-flexible screen mobile phone as an example, the embodiments illustrated in the above scenarios are also applicable to flexible screen mobile phones, which will not be described in detail here.

[0153] Understandably, Figures 5 to 11 This is only a schematic description and does not limit the embodiments of the present application. In some other embodiments, if the electronic device 100 is implemented as other devices, the electronic device 100 can also determine the user's drag operation based on the instructions typed by the user through the touchpad or mouse. In addition, in the scenario where the second window does not receive the object (that is, the second APP does not support the corresponding file type), the electronic device 100 can also notify the user through other interface display effects. For example, in scenario one, if the second window does not receive image 13, the mobile phone 10 can also display a dialog box, and the content of the dialog box can be, for example, a reminder message of "x cannot receive image 13", where "x" is the name of the second APP. There is no restriction here.

[0154] The above is a description based on an electronic device presenting two APP windows through split screen as an example. In other embodiments, in a scenario where at least two devices work together, the interface display method of the embodiment of the present application is also applicable.

[0155] like Fig.12 In a collaborative office scenario shown, a first device can be wirelessly connected to a second device, and then, in response to collaborative office settings input by a user, a collaborative window of the second device can be displayed on the interface of the first device, for example. Furthermore, the first device can localize the application of the second device, so that the user can operate the second device on the first device.

[0156] For example, taking the first device as a laptop computer and the second device as a mobile phone, after the two establish a connection for collaborative office work, the operation interface of the laptop computer 30 is as follows: Fig.13 A schematic GUI is shown below.

[0157] like Fig.13 The GUI shown in (a) is the display interface of the laptop after the laptop and the mobile phone establish a collaborative office connection. Fig.13 As shown in (a) in the figure, the screen of the laptop computer 30 displays the application programs of the laptop computer 30 and the collaborative interface 71 of the mobile phone. The collaborative interface of the mobile phone includes, for example, interface elements such as the APP icon contained in the main interface of the mobile phone. When the laptop computer receives an instruction from the user to click on an application in the laptop computer, the window of the corresponding application can be displayed on the screen of the laptop computer. When the laptop computer receives an instruction from the user to click on an APP in the collaborative interface 71, the window of the corresponding APP can be displayed in the collaborative interface 71. For example, in response to an instruction from the user to click on the mailbox in the laptop computer and an instruction from the user to click on the gallery in the collaborative interface 71, Fig.13 The GUI shown in (a) is updated to Fig.13 GUI shown in (b) in .

[0158] like Fig.13 The GUI shown in (b) is a display interface of a laptop computer displaying two windows. Fig.13 As shown in (b) of the figure, the screen of the laptop displays a mailbox window 72 and a gallery window 73, wherein the window 73 is displayed in the collaborative interface 71, and at least one image is displayed in the window 73. In response to the user's operation instruction of dragging any image from window 73 to window 72, the laptop can execute an embodiment illustrated in any of scenes 1 to 4. Similarly, the laptop can also respond to the user's operation instruction of dragging any object from window 72 to window 73 to execute an embodiment illustrated in any of scenes 1 to 4. No further description is given here.

[0159] Understandably, Figure 12 to Figure 13 This is only a schematic description and does not limit the embodiments of the present application. In other embodiments, in response to the user clicking to open other applications, the laptop can also display windows of other applications. In addition, if the collaborative office device is other devices, the display interface may be different from the above embodiments. For example, the collaborative office interface can display more windows. This is not limited here.

[0160] In summary, by adopting the implementation method of the embodiment of the present application, the electronic device can process the snapshot of the object and present different display effects according to whether the target APP supports the file type of the object and the size of the target APP window, etc., during the process of the user dragging the object. In this way, the electronic device can present to the user the display effect of whether the target APP receives the object during the user dragging process, thereby improving the user's experience.

[0161] The above embodiments introduce the various schemes of the interface display method provided by the present application from the perspective of the hardware structure of the electronic device and the actions performed by the software and hardware. Those skilled in the art should easily realize that, in combination with the processing steps described in the embodiments disclosed herein, such as receiving drag instructions, detecting whether the APP corresponding to the second window supports the file type of the dragged object, and displaying different snapshots, the present application can be implemented not only in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the embodiments of the present application.

[0162] For example, the electronic device 100 may implement the above corresponding functions in the form of functional modules. In some embodiments, the electronic device may include a receiving module, a processing module and a display module. The receiving module may be used to perform the above Figures 4 to 13 The receiving of instructions and information in any of the illustrated embodiments. The display module can be used to execute the above Figures 4 to 13 The processing module can be used to perform the above-mentioned window and snapshot display in any embodiment of the present invention. Figures 4 to 13 Operations other than the receipt of instructions and information and the display of windows and snapshots in any of the illustrated embodiments.

[0163] It is understandable that the division of the above modules is only a division of logical functions. In actual implementation, the function of the receiving module can be integrated into the receiver, the function of the processing module can be integrated into the processor, and the function of the display module can be integrated into the display. Fig.14A As shown, the electronic device 140 includes a receiver 1401, a processor 1402 and a display 1403. The receiver 1401 can perform the above Figures 4 to 13 The display 1403 can be used to perform the above Figures 4 to 13 The processor 1402 may be used to execute the above Figures 4 to 13 Operations other than the receipt of instructions and information and the display of windows and snapshots in any of the illustrated embodiments.

[0164] For example, the display 1403 displays a first window and a second window. Based on this, the receiver 1401 can be used to receive a drag instruction input by a user, and the drag instruction is used to instruct the electronic device to drag the first object in the first window to the second window. The processor 1402 can be used to control the display to display a first snapshot of the first object when the application corresponding to the second window supports the file type of the first object. The processor 1402 can also be used to control the display to display a second snapshot of the first object when the application corresponding to the second window does not support the file type of the first object, and the second snapshot includes a first identifier, and the first identifier is used to indicate that the second window does not accept the first object.

[0165] Fig.14A The electronic device of the present application is described from the perspective of independent functional entities. In another implementation scenario, each independently running functional entity can be integrated into a hardware entity. Fig. 14B As shown, in this implementation scenario, the electronic device 141 may include a processor 1411 , a transceiver 1412 , and a memory 1413 .

[0166] It should be understood that the electronic device 141 of the embodiment of the present application may correspond to Figure 4 The electronic equipment involved, Figures 5 to 11 The mobile phone 10 in the illustrated method, and Fig.12 and Fig.13 The laptop computer in the illustrated embodiment. The transceiver 1412 is used to execute Figures 4 to 13 The memory 1413 may be used to store the code, and the processor 1411 is used to execute the code stored in the memory 1413, so as to realize Figures 4 to 13 The other processing performed by the electronic device described in the foregoing, except for receiving instructions and displaying snapshots, will not be repeated here.

[0167] For specific content, please refer to Figures 4 to 13 The relevant description of the corresponding embodiments will not be repeated here.

[0168] In a specific implementation, the embodiment of the present application also provides a computer storage medium corresponding to the electronic device, wherein the computer storage medium set in the electronic device can store a program, and when the program is executed, it can implement the following Figures 4 to 13 Some or all of the steps in each embodiment of the interface display method provided. The storage medium in any device can be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM).

[0169] One or more of the above modules or units can be implemented by software, hardware or a combination of the two. When any of the above modules or units is implemented by software, the software exists in the form of computer program instructions and is stored in a memory, and the processor can be used to execute the program instructions and implement the above method flow. The processor may include but is not limited to at least one of the following: a central processing unit (CPU), a microprocessor, a digital signal processor (DSP), a microcontroller unit (MCU), or an artificial intelligence processor and other types of computing devices that run software, each of which may include one or more cores for executing software instructions to perform operations or processing. The processor may be built into an SoC (system on chip) or an application specific integrated circuit (ASIC), or it may be an independent semiconductor chip. In addition to the core used to execute software instructions for operations or processing in the processor, it may further include necessary hardware accelerators, such as field programmable gate arrays (FPGA), PLDs (programmable logic devices), or logic circuits that implement dedicated logic operations.

[0170] When the above modules or units are implemented in hardware, the hardware can be any one or any combination of a CPU, a microprocessor, a DSP, an MCU, an artificial intelligence processor, an ASIC, a SoC, an FPGA, a PLD, a dedicated digital circuit, a hardware accelerator or a non-integrated discrete device, which can run the necessary software or not rely on the software to execute the above method flow.

[0171] When the above modules or units are implemented using software, they can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present invention is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integration. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk Solid State Disk (SSD)), etc.

[0172] It should be understood that in various embodiments of the present application, the size of the serial number of each process does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment.

[0173] Each part of this specification is described in a progressive manner, and the same or similar parts between the various embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device and system embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment part.

[0174] The specific implementation methods described above further illustrate the objectives, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above description is only a specific implementation method of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc. made on the basis of the technical solution of the present invention should be included in the scope of protection of the present invention.< / canvas> < / video> < / videoview> < / imgview> < / textview>

Claims

1. An interface display method, characterized in that: Applied to an electronic device, the screen of the electronic device displays a first window and a second window, and the method includes: receiving a drag instruction input by a user, wherein the drag instruction is used to instruct the electronic device to drag the first object in the first window into the second window; If the application corresponding to the second window supports the file type of the first object, displaying a first snapshot of the first object, where the first snapshot is obtained by processing a third snapshot of the first object, and the third snapshot is generated after the electronic device receives the drag instruction and before determining that the position triggered by the user enters the second window; If the application corresponding to the second window does not support the file type of the first object, display a second snapshot of the first object, where the second snapshot is obtained by processing the third snapshot of the first object and includes a first identifier, where the first identifier is used to indicate that the second window does not accept the first object; In the case where the first object includes a first object of a file type supported by the application and a first object of a file type not supported by the application, the method further includes: stacking and displaying a first snapshot of the first object of the file type supported by the application, and stacking and displaying a second snapshot of the first object of the file type not supported by the application.

2. The method according to claim 1, characterized in that Displaying a second snapshot of the first object includes: A layer is added to a third snapshot of the first object to obtain the second snapshot, wherein the third snapshot is generated after the electronic device receives the drag instruction and before determining that a position triggered by a user enters the second window.

3. The method according to claim 1 or 2, characterized in that Displaying a second snapshot of the first object includes: A first mark is added to a third snapshot of the first object to obtain the second snapshot, wherein the third snapshot is generated after the electronic device receives the drag instruction and before determining that a position triggered by a user enters the second window.

4. The method according to claim 3, characterized in that The first mark is a graphic mark or a number, the first object includes at least one object, and the number is used to indicate the total number of first objects that the second window does not receive.

5. The method according to claim 1, characterized in that Displaying a first snapshot of the first object includes: After determining that a third snapshot of the first object enters the second window, acquiring a first size of the third snapshot and a size of the second window, the third snapshot being generated after the electronic device receives the drag instruction and before determining that a position triggered by a user enters the second window; The third snapshot is adjusted from the first size to a second size to obtain the first snapshot, wherein a ratio of the second size to a size of the second window is greater than or equal to a first threshold and less than or equal to a second threshold, and both the first threshold and the second threshold are greater than 0 and less than 1.

6. The method according to claim 5, characterized in that The step of adjusting the third snapshot from the first size to a second size to obtain the first snapshot includes: reducing the third snapshot from the first size to the second size to obtain the first snapshot; or, The third snapshot is enlarged from the first size to the second size to obtain the first snapshot.

7. The method according to claim 1, characterized in that The second window includes an icon of a second object, and the displaying a first snapshot corresponding to the first object includes: After determining that the third snapshot of the first object enters the second window, acquiring a first size of the third snapshot, a size of the second window, and a third size of the icon; The third snapshot is adjusted from the first size to a fourth size to obtain the first snapshot, and the icon is adjusted from the third size to the fourth size, wherein a ratio of twice the fourth size to a size of the second window is greater than or equal to a first threshold and less than or equal to a second threshold, and both the first threshold and the second threshold are greater than 0 and less than 1; The first snapshots and the icons after resizing are arranged according to a position triggered by a user.

8. The method according to any one of claims 5 to 7, characterized in that The first object includes at least one object, and displaying a first snapshot corresponding to the first object further includes: A second identifier is added to the third snapshot to obtain the first snapshot, where the second identifier is used to indicate the total number of first objects that can be received by the second window.

9. The method according to any one of claims 1 to 8, characterized in that After receiving the drag instruction input by the user and before displaying the first snapshot or the second snapshot, the method further includes: generating a third snapshot of the first object, the first object comprising at least one object; A third identifier is added to the third snapshot, where the third identifier is used to indicate the total number of the first objects.

10. An electronic device, characterized in that: comprising a processor, a receiver and a display, wherein the display displays a first window and a second window, The receiver is used to receive a drag instruction input by a user, where the drag instruction is used to instruct the electronic device to drag the first object in the first window into the second window; The processor is configured to, when an application corresponding to the second window supports a file type of the first object, control the display to display a first snapshot of the first object, the first snapshot being obtained by processing a third snapshot of the first object, the third snapshot being generated after the electronic device receives the drag instruction and before determining that a position triggered by a user enters the second window; and is further configured to, when an application corresponding to the second window does not support the file type of the first object, control the display to display a second snapshot of the first object, the second snapshot being obtained by processing the third snapshot of the first object and including a first identifier, the first identifier being used to indicate that the second window does not accept the first object; In a case where the first object includes a first object of a file type supported by the application and a first object of a file type not supported by the application, the processor is further configured to display a first snapshot of the first object of the file type supported by the application in a stacked manner, and display a second snapshot of the first object of the file type not supported by the application in a stacked manner.

11. The electronic device according to claim 10, characterized in that: The processor is further used to add a layer to a third snapshot of the first object to obtain the second snapshot, wherein the third snapshot is generated after the electronic device receives the drag instruction and before determining that the position triggered by the user enters the second window.

12. The electronic device according to claim 10 or 11, characterized in that: The processor is further configured to add a first mark to a third snapshot of the first object to obtain the second snapshot, wherein the third snapshot is generated after the electronic device receives the drag instruction and before determining that a user-triggered position enters the second window.

13. The electronic device according to claim 12, characterized in that: The first mark is a graphic mark or a number, the first object includes at least one object, and the number is used to indicate the total number of first objects that the second window does not receive.

14. The electronic device according to claim 10, characterized in that: The processor is further configured to obtain a first size of the third snapshot and a size of the second window after determining that the third snapshot of the first object enters the second window, wherein the third snapshot is generated after the electronic device receives the drag instruction and before determining that a position triggered by a user enters the second window; The processor is further configured to adjust the third snapshot from the first size to a second size to obtain the first snapshot, wherein a ratio of the second size to a size of the second window is greater than or equal to a first threshold and less than or equal to a second threshold, and both the first threshold and the second threshold are greater than 0 and less than 1.

15. The electronic device according to claim 14, characterized in that: The processor is further configured to reduce the third snapshot from the first size to the second size to obtain the first snapshot; or The third snapshot is enlarged from the first size to the second size to obtain the first snapshot.

16. The electronic device according to claim 10, characterized in that: The processor is further configured to, after determining that the third snapshot of the first object enters the second window, obtain a first size of the third snapshot, a size of the second window, and a third size of the icon; The processor is further configured to adjust the third snapshot from the first size to a fourth size to obtain the first snapshot, and adjust the icon from the third size to the fourth size, wherein a ratio of twice the fourth size to a size of the second window is greater than or equal to a first threshold and less than or equal to a second threshold, and both the first threshold and the second threshold are greater than 0 and less than 1; The processor is further configured to arrange the first snapshot and the resized icon according to a position triggered by a user.

17. The electronic device according to any one of claims 14 to 16, The processor is further configured to add a second identifier to the third snapshot to obtain the first snapshot, wherein the first object includes at least one object, and the second identifier is used to indicate a total number of first objects that the second window can receive.

18. The electronic device according to any one of claims 10 to 17, characterized in that: The processor is further configured to generate a third snapshot of the first object, the first object comprising at least one object; The processor is further configured to add a third identifier to the third snapshot, where the third identifier is used to indicate the total number of the first objects.

19. A computer-readable storage medium, characterized in that: The invention comprises a computer program, which, when being run on a computer, causes the computer to execute the method according to any one of claims 1 to 9.

Images