A data transmission method, system and related devices

Abstract

The application discloses a data transmission method, system and related device. An electronic device detects a first operation on a first control, creates a first drag object through a view module, the first drag object is used to carry drag data of the first control, and the drag data includes one or more of an image, text and a hyperlink. The electronic device transmits the first drag object to a transfer station through a drag framework and transmits the first drag object to a second application through the transfer station. The electronic device displays the first control on a second interface based on the first drag object through the second application. In this way, cross-application transmission of data can be realized, operation is simple, and the application does not need to be adapted.

Description

[0001] This application is a divisional application, the original application number is 202310577009.8, the original application date is May 19, 2023, and the entire contents of the original application are incorporated herein by reference. TECHNICAL FIELD

[0002] The present application relates to the field of communication technology, in particular to a data transmission method, system and related device. BACKGROUND

[0003] With the development of communication technology, electronic devices are increasingly closely related to life. In the process of using electronic devices, users often need to share data such as pictures or text in one application to another application.

[0004] The electronic device needs to receive and respond to multiple operations of the user to transmit the data of one application to another application. For example, in the picture transmission scenario, the electronic device can save the picture in application 1 to the local album, and then open the album application to transmit the picture to application 2 through the sharing function of the album application. For example, in the text transmission scenario, the electronic device can copy the text in application 1 to the clipboard, and after closing application 1 and opening application 2, the electronic device can paste the text in the clipboard to application 2.

[0005] This can realize the cross-process transmission of data such as pictures and text, but the operation steps are tedious and inefficient. SUMMARY

[0006] The present application provides a data transmission method, system and related device, which realizes the cross-process, cross-application and even cross-device transmission of data.

[0007] In a first aspect, the present application provides a data transmission method applied to a first electronic device, comprising: displaying a first interface of a first application, the first interface comprising a first control; receiving a first operation of the user on the first control; in response to the first operation, creating a first drag object by a view module, the first drag object being used to carry drag data of the first control, the drag data comprising any one or more of text, pictures and hyperlinks; drawing a first drag layer of the first control based on the first drag object by a drag framework, the display content of the first drag layer being the same as the display content of the first control; displaying a transfer station icon and the first drag layer; when the first drag layer moves to the transfer station icon, storing the first drag object by the transfer station; displaying a first thumbnail of the first control in the transfer station icon; displaying a second interface of a second application, the second interface displaying a transfer station sidebar, the transfer station sidebar displaying the first thumbnail; receiving a second operation of the user dragging the first thumbnail to the second interface; in response to the second operation, sending the first drag object to the second application by the transfer station; and displaying the first control in the second interface based on the first drag object by the second application.

[0008] In this way, the first electronic device can obtain the first drag object of the first control through the view module and other modules in the framework layer, and realize cross-process transmission of the first drag object through the transfer station, which is simple and does not require application adaptation.

[0009] In a possible implementation, the first drag object is created by the view module, specifically comprising: obtaining the type of the first control by the view module; obtaining the drag data of the first control based on the type of the first control by the view module; and generating the first drag object based on the type of the first control and the drag data of the first control by the view module, the type of the first drag object being the same as the type of the first control.

[0010] In a possible implementation, the view module comprises a first module and a second module; the first drag object is generated based on the type of the first control and the drag data of the first control by the view module, specifically comprising: when the type of the first control is a first type, the first drag object is generated based on the first type and the drag data of the first control by the first module; and when the type of the first control is a second type, the first drag object is generated based on the second type and the drag data of the first control by the second module.

[0011] In this way, when the type of the first control is a picture type, the first electronic device can generate the first drag object by a picture view module; when the type of the first control is a text type, the first electronic device can generate the first drag object by a text view module; when the type of the first control is a webview type, the first electronic device can generate the first drag object by a webview module, etc.

[0012] In a possible implementation, the drag data of the first control is acquired by the view module, and specifically includes: when the type of the first control is a first type, the drag data of the first control is acquired by a first module; and when the type of the first control is a second type, the drag data of the first control is acquired by a second module.

[0013] In this way, when the type of the first control is a picture type, the first electronic device can acquire the drag data of the first control by a picture view module; when the type of the first control is a text type, the first electronic device can acquire the drag data of the first control by a text view module; when the type of the first control is a webview type, the first electronic device can acquire the drag data of the first control by a webview module, and so on.

[0014] In a possible implementation, the first operation is a combination operation, and the first operation includes a third operation and a fourth operation; and in response to the first operation, the first drag object is created by the view module, and specifically includes: in response to the third operation, the type of the first control is acquired by the view module; an empty drag object is created by the view module based on the type of the first control, and the type of the empty drag object is the same as the type of the first control; in response to the fourth operation, the drag data of the first control is acquired by the view module; and the drag data of the first control is filled into the empty drag object to obtain the first drag object by the view module.

[0015] In a possible implementation, the first control is a webview control; before displaying the second interface of the second application, the method further includes: receiving a fifth operation of the user on the first control; and in response to the fifth operation, displaying a third interface; and after the first control is displayed in the second interface by the second application based on the first drag object, the method further includes: receiving a sixth operation of the user on the first control.

[0016] In response to the sixth operation, the third interface is displayed, and the fifth operation is the same as the sixth operation.

[0017] In a possible implementation, the first drag object is stored by the transfer station, and specifically includes: the first drag object is stored by the transfer station based on the correspondence between the first drag object and the first thumbnail.

[0018] In a possible implementation, the type of the first control is a third type; the type of the first drag object is the third type, and the first drag object is empty; the method further includes: in response to the first operation, obtaining, by the view module, a picture of the first control; and drawing, by the drag framework, a first drag layer of the first control based on the first drag object, specifically including: drawing, by the drag framework, the first drag layer of the first control based on the first drag object and the picture of the first control; after displaying the transit station icon and the first drag layer, the method further includes: obtaining, by the transit station, text of the first control based on the image of the first control; and storing, by the transit station, the first drag object, specifically including: storing, by the transit station, the text of the first control and the first drag object based on a relationship between the first thumbnail and the text of the first control.

[0019] In a second aspect, the present application provides a data transmission system, including: a first electronic device, a server, and a second electronic device; wherein the first electronic device is configured to display a first interface of a first application, the first interface including a first control; the first electronic device is configured to receive a first operation of a user on the first control; the first electronic device is configured to create, in response to the first operation, a first drag object by a view module, the first drag object being configured to carry drag data of the first control, the drag data including any one or more of text, a picture, and a hyperlink; the first electronic device is configured to draw, by a drag framework, a first drag layer of the first control based on the first drag object, the display content of the first drag layer being the same as the display content of the first control; the first electronic device is configured to display a transit station icon and the first drag layer; when the first drag layer moves to the transit station icon, the first electronic device is configured to store the first drag object by a transit station; the first electronic device is configured to display a first thumbnail of the first control in the transit station icon; after storing the first drag object by the transit station, the first electronic device is configured to send, by the transit station, the first drag object to the server; the second electronic device is configured to obtain, by a transit station of the second electronic device, the first drag object from the server; the second electronic device is configured to display a fourth interface of a third application, the fourth interface displaying a transit station sidebar, the transit station sidebar displaying the first thumbnail; the second electronic device is configured to receive a seventh operation of the user dragging the first thumbnail to the fourth interface; the second electronic device is configured to send, in response to the seventh operation, the first drag object to the third application by the transit station of the second electronic device; and the second electronic device is configured to display the first control in the second interface based on the first drag object by the third application.

[0020] In this way, the first electronic device can realize cross-device transmission of data through the transit station and the server, without the need to adapt the application, and the operation is simple.

[0021] In a third aspect, the present application provides an electronic device, which is a first electronic device, comprising one or more processors and one or more memories. The one or more memories are coupled to the one or more processors, and the one or more memories are configured to store computer program codes, the computer program codes comprising computer instructions, which, when executed by the one or more processors, cause the communication device to perform the data transmission method in any possible implementation manner of any of the above aspects.

[0022] In a fourth aspect, the embodiments of the present application provide a computer storage medium, which comprises computer instructions, which, when executed on a first electronic device, cause the first electronic device to perform the data transmission method in any possible implementation manner of any of the above aspects.

[0023] In a fifth aspect, the embodiments of the present application provide a computer program product, which, when executed on a first electronic device, causes the first electronic device to perform the data transmission method in any possible implementation manner of any of the above aspects.

[0024] The beneficial effects of the third aspect to the fifth aspect can refer to the beneficial effects of the first aspect. BRIEF DESCRIPTION OF DRAWINGS

[0025] Figure 1A A hardware structure schematic diagram of an electronic device 100 provided by the embodiments of the present application;

[0026] Figure 1B A hardware structure schematic diagram of a server 3000 provided by the embodiments of the present application;

[0027] Figures 2A-2M A group of interface schematic diagrams of cross-application transmission of pictures provided by the embodiments of the present application;

[0028] Figures 3A-3L A group of interface schematic diagrams of cross-application transmission of texts provided by the embodiments of the present application;

[0029] Figures 4A-4L A group of interface schematic diagrams of cross-application transmission of web view controls provided by the embodiments of the present application;

[0030] Figures 5A-5H A group of interface schematic diagrams of simultaneously dragging multiple controls to a transfer station provided by the embodiments of the present application;

[0031] Figures 6A-6L A group of interface schematic diagrams of dragging an interface element comprising multiple text controls to a transfer station provided by the embodiments of the present application;

[0032] Figures 7A-7M A group of interface schematic diagrams of dragging an interface element comprising multiple picture controls to a transfer station provided by the embodiments of the present application;

[0033] Figure 8 A module interaction flow diagram for transmitting data in application 1 to a transit station is provided for the embodiments of the present application;

[0034] Figures 9A-9C Three module interaction flow diagrams for generating a drag object of a control based on the type of the control are provided for the embodiments of the present application;

[0035] Figure 10 A diagram for determining execution logic based on user drag operation of a top view is provided for the embodiments of the present application;

[0036] Figure 11 A module interaction flow diagram for transmitting a custom text control in application 1 to a transit station is provided for the embodiments of the present application;

[0037] Figure 12 A module interaction flow diagram for transmitting data in a transit station to application 2 is provided for the embodiments of the present application;

[0038] Figure 13 A flow diagram for simultaneously dragging multiple controls using a data transmission method is provided for the embodiments of the present application;

[0039] Figure 14 A flow diagram for dragging an interface element including multiple controls using a data transmission method is provided for the embodiments of the present application;

[0040] Figure 15A A software architecture diagram of an electronic device 100 is provided for the embodiments of the present application;

[0041] Figure 15B A structure diagram of a top view is provided for the embodiments of the present application;

[0042] Figure 16 A structure diagram of a data transmission system 10 is provided for the embodiments of the present application;

[0043] Figure 17 A flow diagram of a data transmission method is provided for the embodiments of the present application. DETAILED DESCRIPTION

[0044] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " represents the meaning of or, for example, A / B can represent A or B; the "and / or" in the text only describes the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B, which means that there are three cases of A alone, A and B together, and B alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0045] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and cannot be understood as implying or suggesting relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined with "first" and "second" can explicitly or implicitly include one or more of the features, and in the description of the embodiments of the present application, unless otherwise specified, the meaning of "multiple" is two or more than two.

[0046] In the following embodiments of the present application, the term "user interface (UI)" is a medium interface for interaction and information exchange between an application or an operating system and a user, which realizes the conversion between the internal form of information and the form that the user can accept. The user interface is source code written in a specific computer language such as Java, extensible markup language (XML), etc. The interface source code is parsed, rendered, and finally presented as content that can be recognized by the user on the electronic device. The commonly used form of user interface is graphic user interface (GUI), which refers to a user interface that displays information in a graphical manner. It can be a visual interface element such as text, icon, button, menu, tab, text box, dialog box, status bar, navigation bar, Widget, etc. displayed in the display screen of the electronic device.

[0047] The following describes a way of cross-process transmission of pictures provided in the embodiments of the present application.

[0048] In the case of displaying the picture control of the application 1, the application 1 can receive and respond to the long press drag operation of the user on the picture control, obtain the picture of the picture control, and transmit the picture to the transfer station through the drag framework. The transfer station can receive and respond to the operation of the user to transmit the picture to the application 2. In this way, cross-process transmission of pictures can be achieved.

[0049] However, since the application needs to respond to the long press and drag operation of the user, the three-party application needs to be adapted when transmitting the picture across processes in the above manner. Moreover, the data (e.g., parameters of the picture) transmitted by the application 1 through the drag framework may not be consistent with the data that the user actually wants to transmit, which affects the user experience.

[0050] The present application provides a data transmission method. The electronic device can include a view, a drag framework, and a transfer station. When displaying the interface 1 (including the control 1) of the application 1, the view can obtain the type and the drag data of the control 1 after detecting the operation 1 (e.g., a long press and drag operation) of the user on the control 1, create a drag object of the control 1 based on the type and the drag data of the control 1, and transmit the drag object of the control 1 to the transfer station through the drag framework. The drag data includes one or more of a picture, text, and a hyperlink. The transfer station can display a thumbnail 1 of the control 1 based on the drag data and / or the type of the control 1. When displaying the interface of the application 2 and the transfer station displays the thumbnail 1 on the interface, the transfer station can transmit the drag object of the control 1 to the application 2 through the drag framework and display the control 1 in the application 2 after detecting the operation 2 (e.g., a long press and drag operation) of the user on the thumbnail 1. In the embodiments of the present application, the thumbnail of the control refers to a picture whose display content is the same as that of the control and whose display size is less than or equal to that of the control. The display content of the control can include a picture and / or text.

[0051] In this way, the data such as the picture control, the text control, and the web view control can be transmitted from the application 1 to the application 2, realizing the cross-process transmission of the data, which is convenient and efficient. Moreover, the view can obtain the type and the drag data of the control 1 when detecting the operation 1 of the user on the control 1 by using the data transmission method provided by the present application, so the application 1 does not need to transmit the drag data and the type of the control 1, and thus the application 1 does not need to be adapted.

[0052] Figure 1A A structural schematic diagram of the electronic device 100 is shown.

[0053] The electronic device 100 can be a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, and a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a wearable device, an in-vehicle device, a smart home device, and / or a smart city device, and the specific type of the electronic device is not specially limited in the embodiments of the present application.

[0054] The electronic device 100 can include a processor 110, an external memory interface 120, an internal memory 121, a charging management module 140, a power management module 141, a battery 142, a sensor module 180, a display screen 194, etc. Among them, the sensor module 180 can include a touch sensor 180K, and optionally, one or more of the following sensors: a pressure sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, an ambient light sensor, a bone conduction sensor, etc. In some embodiments, the electronic device 100 can also include the following communication modules, such as: antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, etc., for realizing wireless communication.

[0055] It can be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can include more or fewer components than illustrated, or combine certain components, or split certain components, or different component arrangements. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.

[0056] The processor 110 can include one or more processing units, for example: the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units can be independent devices or integrated in one or more processors.

[0057] The controller can generate operation control signals according to the instruction operation code and the timing signal, and complete the control of fetching and executing instructions.

[0058] The processor 110 can also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can save instructions or data that have just been used or are used repeatedly by the processor 110. If the processor 110 needs to use the instructions or data again, it can directly call from the memory. This avoids repeated access and reduces the waiting time of the processor 110, thereby improving the efficiency of the system.

[0059] In some embodiments, the processor 110 can include one or more interfaces. The interfaces can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0060] The charging management module 140 is configured to receive charging input from a charger. The charger can be a wireless charger or a wired charger. In some embodiments of wired charging, the charging management module 140 can receive charging input from a wired charger through a USB interface. In some embodiments of wireless charging, the charging management module 140 can receive wireless charging input through a wireless charging coil of the electronic device 100. The charging management module 140 can supply power to the electronic device 100 while charging the battery 142.

[0061] The power management module 141 is configured to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to supply power to the processor 110, the internal memory 121, the display 194, and the wireless communication module 160. The power management module 141 can also be configured to monitor parameters such as battery capacity, battery cycle count, battery health status (leakage, impedance), and the like. In some other embodiments, the power management module 141 can also be disposed in the processor 110. In some other embodiments, the power management module 141 and the charging management module 140 can also be disposed in the same device.

[0062] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, and a baseband processor, and the like. The antenna 1 and the antenna 2 are configured to transmit and receive electromagnetic wave signals. The mobile communication module 150 can provide a solution for wireless communication including 2G / 3G / 4G / 5G and the like applied to the electronic device 100. The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), and the like. The mobile communication module 150 can receive electromagnetic waves through the antenna 1, filter, amplify, and the like the received electromagnetic waves, and transmit the processed signals to the modem processor for demodulation. The mobile communication module 150 can also amplify signals modulated by the modem processor and radiate the signals as electromagnetic waves through the antenna 1. In some embodiments, at least part of the function modules of the mobile communication module 150 can be disposed in the processor 110. In some embodiments, at least part of the function modules of the mobile communication module 150 and at least part of the modules of the processor 110 can be disposed in the same device.

[0063] The wireless communication module 160 can provide solutions for wireless communication including wireless local area networks (WLAN) (e.g., wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, etc. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, demodulates and filters the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 can also receive signals to be transmitted from the processor 110, frequency-modulate them, amplify them, and radiate them as electromagnetic waves via the antenna 2. In some embodiments, the antenna 1 and the mobile communication module 150 of the electronic device 100 are coupled, and the antenna 2 and the wireless communication module 160 are coupled, so that the electronic device 100 can communicate with a network and other devices through wireless communication technology.

[0064] The electronic device 100 implements a display function through a GPU, a display screen 194, and an application processor, etc. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs that execute program instructions to generate or change display information.

[0065] The display screen 194 is configured to display images, videos, and the like. The display screen 194 includes a display panel. The display panel can be made of a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light emitting diodes (QLED), or the like. In some embodiments, the electronic device 100 can include one or N display screens 194, where N is a positive integer greater than 1.

[0066] The internal memory 121 can include one or more random access memories (RAM) and one or more non-volatile memories (NVM). The random access memory can be directly read and written by the processor 110, and can be used to store executable programs (e.g., machine instructions) of an operating system or other programs that are currently running, and can also be used to store data of users and application programs, and the like. The non-volatile memory can also store executable programs and store data of users and application programs, and can be loaded into the random access memory in advance for direct reading and writing by the processor 110.

[0067] The external memory interface 120 can be configured to connect an external non-volatile memory, and to expand the storage capacity of the electronic device 100. The external non-volatile memory communicates with the processor 110 via the external memory interface 120, and implements data storage functions. For example, files such as music, videos, and the like can be saved in the external non-volatile memory.

[0068] The touch sensor 180K, also referred to as a “touch device”. The touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also referred to as a “touch screen”. The touch sensor 180K is configured to detect a touch operation acting on or near the touch sensor 180K. The touch sensor 180K can transmit the detected touch operation to the application processor to determine the type of touch event. The display screen 194 can provide visual output related to the touch operation. In other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100, and can be disposed at a position different from the position of the display screen 194.

[0069] Figure 1B A hardware structure diagram of a server 3000 is shown.

[0070] As shown in Figure 1B The server 3000 can include one or more network device processors 3001, a memory 3002, a communication interface 3003, a transmitter 3005, a receiver 3006, a coupler 3007, and an antenna 3008. These components can be connected through a bus 3004 or other means, Figure 1B For example, by bus connection. Among them:

[0071] The communication interface 3003 can be used for the server 3000 to communicate with other communication devices, for example, to communicate with electronic devices used by consumers of the project. Specifically, the communication interface 3003 can be a 3G communication interface, a long-term evolution (LTE) (4G) communication interface, a 5G communication interface, a WLAN communication interface, a WAN communication interface, etc. Not limited to wireless communication interfaces, the server 3000 can also be configured with a wired communication interface 3003 to support wired communication.

[0072] In some embodiments of the present application, the transmitter 3005 and the receiver 3006 can be regarded as a wireless modem. The transmitter 3005 can be used for transmitting processing of signals output by the network device processor 3001. The receiver 3006 can be used for receiving signals. In the server 3000, the number of transmitters 3005 and receivers 3006 can be one or more. The antenna 3008 can be used to convert electromagnetic energy in the transmission line into electromagnetic waves in free space, or convert electromagnetic waves in free space into electromagnetic energy in the transmission line. The coupler 3007 can be used to divide the mobile communication signal into multiple paths and distribute it to multiple receivers 3006. It can be understood that the antenna 3008 of the network device can be implemented as a large-scale antenna array.

[0073] The memory 3002 is coupled with the network device processor 3001, and is used to store various software programs and / or groups of instructions. Specifically, the memory 3002 can include high-speed random access memory, and can also include non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state storage devices.

[0074] The memory 3002 can store an operating system (hereinafter referred to as system), such as uCOS, VxWorks, RTLinux, etc. Embedded operating system. The memory 3002 can also store a network communication program, which can be used for communication with other communication devices.

[0075] In the embodiments of the present application, the memory 3002 can store an implementation program of the data transmission method provided in the embodiments of the present application, and the like.

[0076] In the embodiments of the present application, the network device processor 3001 can be used to read and execute computer readable instructions. Specifically, the network device processor 3001 can be used to call a program stored in the memory 3002, for example, an implementation program of the data transmission method provided in one or more embodiments of the present application, and execute the instructions contained in the program.

[0077] It should be noted that, Figure 1B The server 3000 shown is only one implementation manner of the embodiments of the present application, and in actual applications, the server 3000 can further include more or fewer components, which is not limited here.

[0078] The data transmission method provided in the embodiments of the present application will be introduced below in combination with application scenarios.

[0079] In some application scenarios, the electronic device 100 displays an interface 1 of an application 1 (for example, a chat application), and the interface 1 can include a control 1, which is a picture control. The electronic device 100 can receive and respond to an operation 1 (for example, a long press and drag operation) of a user on the control 1, display a transit station icon and a drag layer of the control 1 on the interface 1, and the drag layer moves along the track of the operation 1. After detecting a release operation of the user in the area where the transit station icon is located, the electronic device 100 can close the display of the drag layer and display a thumbnail of the control 1 in the transit station icon. The thumbnail of the control is a picture whose display content is the same as that of the control and whose display size is less than or equal to that of the control.

[0080] In this way, the electronic device 100 can drag the picture control in the application 1 to the transit station through dragging and the like, and facilitate subsequent transmission of the picture control to other processes (for example, other applications) through the transit station.

[0081] For example, Figure 2AAs shown, the electronic device 100 displays a desktop 200. The desktop 200 displays a page with application icons, including multiple application icons (e.g., reading application icon, settings application icon, browser application icon, chat application icon 204, social application icon 205, document application icon 206, gallery application icon 207, photo editing application icon 208, etc.). Optionally, a page indicator 202 is displayed below the page with application icons to indicate the total number of pages on the desktop and the positional relationship between the currently displayed page and other pages. For example, the desktop 200 may include three pages; the white dot in the page indicator, located third from the left, indicates that the currently displayed page is the third page from the left. Optionally, a status bar 201 is displayed above the page with application icons, which may include information such as a communication signal strength indicator, battery level, and time. Alternatively, a tray area 203 may be provided below the page indicator, which may include one or more tray icons (e.g., dialer app icon, messaging app icon, contacts app icon, camera app icon, etc.) that may remain visible during page transitions.

[0082] Electronic device 100 can receive and respond to a user's click on the chat application icon 204, displaying, for example... Figure 2B The chat application interface 210 shown can be used to display one or more chat entries.

[0083] like Figure 2B As shown, the chat application interface 210 may include one or more chat entries and one or more auxiliary controls, such as chat controls, discovery controls, contact controls, search controls, etc. The one or more chat entries may include group chat entries 211, private chat entries 212, etc. Each chat entry can be used to trigger the electronic device 100 to display the chat interface corresponding to that chat entry.

[0084] Electronic device 100 can receive and respond to user clicks on group chat item 211, displaying, for example... Figure 2C The group chat interface 220 shown can be used to display one or more group chat contents.

[0085] like Figure 2CAs shown, the group chat interface 220 can include one or more group chat contents, which can be pictures (including stickers), texts, audios, videos, etc. contents sent by members of the group chat. The one or more group chat contents can include a picture control 221, a picture control 222, a text control 223, etc. The avatar and name of the group chat member sending the group chat content can also be displayed next to each group chat content, to prompt that the group chat content is sent by the group chat member corresponding to the avatar and name.

[0086] The electronic device 100 can receive and respond to a long press and drag operation (including a long press operation and a drag operation) of the user on the picture control 221, as shown in Figure 2D As shown, the transit station icon 224 and the drag layer 225 of the picture control 221 are displayed on the group chat interface 220.

[0087] As shown, the transit station icon 224 and the drag layer 225 of the picture control 221 are displayed on the group chat interface 220. Figure 2D As shown, the transit station icon 224 and the drag layer 225 of the picture control 221 are displayed on the group chat interface 220.

[0088] The electronic device 100 can receive and respond to a long press and drag operation (including a long press operation and a drag operation) of the user on the picture control 221, as shown in Figure 2E As shown, the transit station icon 224 and the drag layer 225 of the picture control 221 are displayed on the group chat interface 220.

[0089] As shown, the transit station icon 224 and the drag layer 225 of the picture control 221 are displayed on the group chat interface 220. Figure 2E As shown, the transit station icon 224 and the drag layer 225 of the picture control 221 are displayed on the group chat interface 220.

[0090] In some embodiments, the electronic device 100 can also sequentially drag the plurality of picture controls into the transit station.

[0091] As shown in Figure 2E As shown in Figure 2F The electronic device 100 can display a drag layer 227 of the picture control 222.

[0092] As shown in Figure 2F The display content of the drag layer 227 is the same as that of the picture control 222. The drag layer 227 can move following the trajectory of the user’s drag operation. Other content of the drag layer 227 can refer to the description of the drag layer 225 as shown in Figure 2D As shown in

[0093] The electronic device 100 can receive and respond to a user’s drag operation on the drag layer 227, so that the drag layer 227 moves to the transit station icon 224 following the trajectory of the drag operation. Upon receiving a user’s release operation in the area where the transit station icon 224 is located, the electronic device 100 can close the display of the drag layer 227 and display the thumbnail 228 in the transit station icon 224. Figure 2G

[0094] As shown in Figure 2G The display content of the thumbnail 228 is the same as that of the picture control 222. Since the display size of the picture control 222 is smaller than that of the transit station icon 224, the display size of the thumbnail 228 can be the same as that of the picture control 222. In some embodiments, the thumbnail 228 can be displayed on top of the thumbnail 226; in other embodiments, the electronic device 100 can also close the display of the thumbnail 226 and display the thumbnail 228 on the transit station icon 224. Optionally, a numerical identifier, such as “2”, can also be displayed on the thumbnail 228 (e.g., at the top right corner or the top left corner of the thumbnail 228), which can be used to prompt the user of the number of controls that have been dragged into the transit station.

[0095] After the electronic device 100 drags the picture control into the transit station, the electronic device 100 can store the picture control in the transit station. When the electronic device 100 displays interface 2 of application 2 and the transit station icon on the interface 2, the electronic device 100 can receive and respond to a user’s operation 2 (e.g., a long press drag operation) on the transit station icon to display all the controls in the transit station on the interface 2.

[0096] As shown in Figure 2G ​In the case of the group chat interface 220 shown, the electronic device 100 can receive and respond to the user's swipe-up operation from the bottom edge of the display screen, close the group chat interface 220, and display as shown Figure 2H Desktop 200 is shown.

[0097] like Figure 2H As shown, social application icons 205 can be displayed on desktop 200. For further details regarding desktop 200, please refer to the above. Figure 2A The relevant content shown will not be repeated here.

[0098] Electronic device 100 can receive and respond to a user's click on the social application icon 205, displaying, for example... Figure 2I The social application interface shown is 230.

[0099] like Figure 2I As shown, the social application interface 230 may include a bottom control area 231, a top control area 233, and one or more web view controls. The bottom control area 231 may include one or more controls (or options), such as a new image / text control 232, a message option, a homepage option, etc., which can be used to trigger the electronic device 100 to display the corresponding interface. For example, the new image / text control 232 can be used to trigger the electronic device 100 to display an image / text editing interface. The top control area 233 may include one or more controls (or options), such as a search control, a discovery option, a following option, a nearby option, etc. These one or more controls (or options) are used to trigger the electronic device 100 to change one or more web view controls displayed in the social application interface 230. These one or more web view controls may include a web view control 234, which can be used to trigger the electronic device 100 to display the corresponding web view interface. The webpage view control 234 may include an image control 234a and a text control 234b. Either the image control 234a or the text control 234b can trigger the electronic device 100 to display the webpage view interface corresponding to the webpage view control 234. In some embodiments, auxiliary controls such as a publisher control 235 and a "like" control may also be displayed next to the webpage view control 234. The publisher control 235 can be used to trigger the electronic device 100 to display the publisher's information or data on the webpage view interface.

[0100] Electronic device 100 can receive and respond to user clicks on newly created graphic control 232, displaying, for example... Figure 2J The image and text editing interface shown is 240.

[0101] like Figure 2JAs shown, the graphic editing interface 240 may include one or more options, such as a publishing option, a graphic template option, and a video template option. The publishing option can be used to trigger the electronic device 100 to publish the graphic content of the graphic editing interface 240. The graphic template option can be used to trigger the electronic device 100 to display one or more graphic templates. The video template option can be used to trigger the electronic device 100 to display one or more video templates.

[0102] Electronic device 100 can receive and respond to a user's swipe operation from the right edge of the display screen to the left (or from the left edge of the display screen to the right), such as Figure 2K As shown, the transit station icon 241 is displayed on the graphic editing interface 240.

[0103] like Figure 2K As shown, the transit station icon 241 can display a thumbnail 242, which can be the aforementioned Figure 2G Thumbnail 228 in the illustrated embodiment. Furthermore, the upper right corner of thumbnail 242 may display the number "2", indicating that the number of controls currently stored in the transfer station is two.

[0104] Electronic device 100 can receive and respond to a user's long-press and drag operation on the transit station icon 241, such as Figure 2L As shown, this causes the transfer station icon 241 to move along the trajectory of the user's drag operation.

[0105] When the electronic device 100 detects a user's release operation, it responds to the release operation as follows: Figure 2M As shown, the electronic device 100 can display all the controls in the transfer station in the graphic editing interface 240 and redisplay the transfer station icon 241 in the position before dragging.

[0106] like Figure 2M As shown, the controls that have been dragged into the transfer station include the above-mentioned... Figure 2C In the case of image controls 221 and 222 shown, electronic device 100 can display image controls 243 and 244 in the image editing interface 240, and redisplay the transfer station icon 241 in its original position before dragging, with the thumbnail 242 still displayed on the transfer station icon 241. Among these, image control 243 is similar to the one described above. Figure 2C The image control 221 shown is the same as the one described above, and the image control 244 is the same as the one described above. Figure 2CThe picture control 222 is the same as shown. In some embodiments, the display positions of the picture control 243 and the picture control 244 can be related to the position where the user releases the operation, for example, the electronic device 100 can display the picture control 243 and the picture control 244 in the center of the position where the user releases the operation. It can be understood that the relationship between the display positions of the picture control 243 and the picture control 244 and the position where the user releases the operation can also be other relationships, which are not limited herein.

[0107] In some embodiments, after the electronic device 100 displays the transit station icon on the interface 2 of the application 2, the electronic device 100 can also receive and respond to a click operation of the user on the transit station icon to display a transit station sidebar, and the transit station sidebar displays one or more thumbnails. The electronic device 100 can receive and respond to a long press and drag operation of the user on one of the thumbnails to display a picture control (or other type of control) corresponding to the thumbnail in the interface 2. For specific operation steps, reference can be made to related content in the following embodiments, which are not described in detail herein.

[0108] It can be understood that the above Figures 2A-2M The illustrated embodiment is only an example. In the embodiments of the present application, the application 1 and the application 2 can also be different applications from the above-mentioned embodiments, and the user can also drag more or fewer picture controls to the transit station than in the above-mentioned embodiments, which are not limited herein. In some embodiments, the transit station icon can also be displayed in the form of a floating ball or a top floating bar, which is not limited herein.

[0109] In some application scenarios, the electronic device 100 displays an interface 1 of an application 1 (for example, a chat application), and the interface 1 can include a control 1 which is a text control. The electronic device 100 can receive and respond to an operation 1 (for example, a long press and drag operation) of the user on the control 1 to display a transit station icon and a drag layer of the control 1 on the interface 1, and the drag layer moves along the trajectory of the drag operation. After detecting a release operation of the user in the area where the transit station icon is located, the electronic device 100 can close the display of the drag layer and display a thumbnail of the control 1 in the transit station icon. It should be noted that the control 1 is a text control, and the thumbnail of the text control can be a picture that displays the same content as the display content of the text control and has a display size less than or equal to the text control. In some embodiments, the thumbnail of the text control can also be a preset document pattern, which can be used to prompt that the control dragged into the transit station is a text control.

[0110] In this way, the electronic device 100 can drag the text control in the application 1 to the transit station through dragging and the like, which facilitates subsequent transmission of the text control to other processes (for example, other applications) through the transit station.

[0111] For example, the electronic device 100 can display a group chat interface 220 as shown in FIG. 2A. The group chat interface 220 can include a picture control 221, a picture control 222, a text control 223, and a transit station icon 224. The transit station icon 224 can also display a thumbnail 228, which can be the same picture as the display content of the picture control 222. The transit station icon 224 can be used to prompt the user that the electronic device 100 has started the transit station and that there are controls dragged into the transit station. Other contents of the group chat interface 220 can refer to the related descriptions in the above-described embodiments, which will not be repeated here. Figure 3A Figure 2M For example, the electronic device 100 can display a group chat interface 220 as shown in FIG. 2A. The group chat interface 220 can include a picture control 221, a picture control 222, a text control 223, and a transit station icon 224. The transit station icon 224 can also display a thumbnail 228, which can be the same picture as the display content of the picture control 222. The transit station icon 224 can be used to prompt the user that the electronic device 100 has started the transit station and that there are controls dragged into the transit station. Other contents of the group chat interface 220 can refer to the related descriptions in the above-described embodiments, which will not be repeated here.

[0112] The electronic device 100 can receive and respond to a long press drag operation of the user on the text control 223, and display a drag layer 229 in the group chat interface 220 as shown in FIG. 2B. Figure 3B

[0113] As shown in FIG. 2B, the display content of the drag layer 229 can be the same as that of the text control 223, and the display size can also be the same or different. The drag layer 229 can move along the trajectory of the user's drag operation. Figure 3B The electronic device 100 can receive and respond to a drag operation of the user on the drag layer 229, so that the drag layer 229 moves along the trajectory of the drag operation to the transit station icon 224. When detecting a release operation of the user in the area where the transit station icon 224 is located, the electronic device 100 can close the display of the drag layer 229, and display a text thumbnail 223a in the transit station icon 224 as shown in FIG. 2C.

[0114] Figure 3C As shown in FIG. 2C, the text thumbnail 223a can be a document pattern, which can be used to prompt the user that the control just dragged into the transit station is a text control. In addition, the upper right corner (or the upper left corner) of the text thumbnail 223a can also display a numerical identifier, such as "3", to prompt the user that the number of controls dragged into the transit station is 3. In other embodiments, the text thumbnail 223a can also be a picture with the same display content as the text control 223 and a display size smaller than that of the transit station icon 224, which will not be limited herein.

[0115] As shown in FIG. 2C, the text thumbnail 223a can be a document pattern, which can be used to prompt the user that the control just dragged into the transit station is a text control. In addition, the upper right corner (or the upper left corner) of the text thumbnail 223a can also display a numerical identifier, such as "3", to prompt the user that the number of controls dragged into the transit station is 3. In other embodiments, the text thumbnail 223a can also be a picture with the same display content as the text control 223 and a display size smaller than that of the transit station icon 224, which will not be limited herein. Figure 3C In this way, the electronic device 100 can drag the text control in the application 1 into the transit station.

[0116]

[0117] ​​​​After the electronic device 100 drags the control 1 (the control 1 is a text control) to the transit station, the electronic device 100 can store the text of the control 1 in the transit station. When the electronic device 100 displays the interface 2 of the application 2, and the interface 2 displays the transit station sidebar, and the transit station sidebar displays the thumbnail of the control 1, the electronic device 100 can receive and respond to the operation 2 (for example, a long press drag operation) of the user on the thumbnail to display the control 1 (or the text of the control 1) in the interface 2.

[0118] For example, when the electronic device 100 displays the group chat interface 220 as shown in Figure 3C , the electronic device 100 can receive and respond to the operation of the user sliding up from the lower edge of the display screen to close the group chat interface 220 and display the desktop 200 as shown in Figure 3D . The specific content of the desktop 200 can refer to the related description in the above Figure 2A embodiment.

[0119] The electronic device 100 can receive and respond to the click operation of the user on the document application icon 206 in the desktop 200 to display the document application interface 300 as shown in Figure 3E .

[0120] As shown in Figure 3E , the document application interface 300 can include one or more controls, such as an open control 301 and a new file control 302. The open control 301 can be used to trigger the electronic device 100 to display a list of files stored by the electronic device 100. The new file control 302 can be used to trigger the electronic device 100 to create a new file. The document application interface 300 can also display a file list including one or more stored files, which can be used to trigger the electronic device 100 to open the corresponding file and display the specific content of the file.

[0121] The electronic device 100 can receive and respond to the click operation of the user on the new file control 302 to display the type selection window 303 in the document application interface 300 as shown in Figure 3F .

[0122] As shown in Figure 3F , the type selection window 303 can display one or more type options, such as a document option 304, a table option, a note option, a presentation option, etc. Any type option can be used to trigger the electronic device 100 to create a file of the corresponding type.

[0123] The electronic device 100 can receive and respond to the click operation of the user on the document option 304 to display the document editing interface 310 as shown in Figure 3G .

[0124] AsFigure 3G As shown, the document editing interface 310 may include an auxiliary control area 311, a status control area 312, and a document editing area 313. The auxiliary control area 311 may display one or more auxiliary controls, such as image controls, formatting controls, and text controls, which can be used to assist in document editing. The status control area 312 may display one or more status controls, such as completion controls, save controls, and close controls, which can be used to trigger the electronic device 100 to end the document editing state, save the document, or close the document editing interface 310. The document editing area 313 can be used to display the document content, and the user can edit the content displayed in the document editing area 313 through the auxiliary controls in the auxiliary control area 311.

[0125] Electronic device 100 can receive and respond to a user's swipe operation from the right edge of the display screen to the left (or from the left edge of the display screen to the right, etc.), such as Figure 3H As shown, the transit station icon 314 is displayed in the document editing interface 310.

[0126] like Figure 3H As shown, the transit station icon 314 can display a text thumbnail 314a. The specific content of the text thumbnail 314a can be found above. Figure 3C The text thumbnail 223a in the illustrated embodiment is described below. Text thumbnail 314a can be used to indicate to the user that the last dragged-in control in the transfer station is a text control.

[0127] Electronic device 100 can receive and respond to a user's click operation on the transfer station icon 314, turn off the display of the transfer station icon, and display it in the document editing interface 310 as follows: Figure 3I The sidebar of the transfer station shown is 320.

[0128] like Figure 3I As shown, the transfer station sidebar 320 can display one or more thumbnails. In the transfer station, each thumbnail corresponds to an image and / or text control. For example, the transfer station sidebar 320 can display thumbnails 321, 322, and 323, where thumbnail 321 can be one of the aforementioned thumbnails. Figure 3A The thumbnail of the text control 223 in the illustrated embodiment, thumbnail 322 can be the one described above. Figure 3A The thumbnail of the image control 222, and the thumbnail 323 can be the one described above. Figure 3AThe thumbnail of the middle picture control 221. The thumbnail of the control displayed in the transit sidebar 320 is also a picture with the same display content as the display content of the control, and the display size is less than or equal to the display size of the control. It should be noted that the display size of the thumbnail displayed in the transit sidebar 320 can be greater than or equal to the display size of the thumbnail displayed in the transit icon in the foregoing embodiments. For example, the thumbnail 322 can be the same as the thumbnail 242 shown in FIG. 2B, and the display size of the thumbnail 323 can be greater than or equal to the display size of the thumbnail 226 shown in FIG. 2A. In some embodiments, the transit sidebar 320 can also display a menu control 324, which can be used to trigger the electronic device 100 to display a transit menu, and the transit menu can be used to assist the user in adding or deleting pictures or text stored in the transit, and can also be used to adjust the arrangement order of the thumbnails in the transit, etc. Figure 2K Figure 2F The display size of the thumbnail 226 shown in FIG. 2A. In some embodiments, the transit sidebar 320 can also display a menu control 324, which can be used to trigger the electronic device 100 to display a transit menu, and the transit menu can be used to assist the user in adding or deleting pictures or text stored in the transit, and can also be used to adjust the arrangement order of the thumbnails in the transit, etc.

[0129] The electronic device 100 can receive and respond to a long press drag operation of the user on the thumbnail 321, so that the thumbnail 321 moves along the trajectory of the user's drag operation, as shown in FIG. 3B. Figure 3J

[0130] The thumbnail 321 can move along the trajectory of the user's drag operation, as shown in FIG. 3B. During the process of the user dragging the thumbnail 321, the electronic device 100 can temporarily close the display of the transit sidebar 320. Figure 3J The electronic device 100 can receive and respond to a long press drag operation of the user on the thumbnail 321, so that the thumbnail 321 moves along the trajectory of the user's drag operation, as shown in FIG. 3B.

[0131] Figure 3K The electronic device 100 can receive and respond to a long press drag operation of the user on the thumbnail 321, so that the thumbnail 321 moves along the trajectory of the user's drag operation, as shown in FIG. 3B.

[0132] The electronic device 100 can receive and respond to a long press drag operation of the user on the thumbnail 321, so that the thumbnail 321 moves along the trajectory of the user's drag operation, as shown in FIG. 3B. Figure 3K The electronic device 100 can receive and respond to a long press drag operation of the user on the thumbnail 321, so that the thumbnail 321 moves along the trajectory of the user's drag operation, as shown in FIG. 3B. Figure 3A The display size of the thumbnail 226 shown in FIG. 2A. In some embodiments, the transit sidebar 320 can also display a menu control 324, which can be used to trigger the electronic device 100 to display a transit menu, and the transit menu can be used to assist the user in adding or deleting pictures or text stored in the transit, and can also be used to adjust the arrangement order of the thumbnails in the transit, etc. Figure 3A ​​​The displayed text control 223 is the same. After displaying the text control 315, the electronic device 100 can redisplay the transit sidebar 320 in the document editing interface 310, and the displayed one or more thumbnails in the transit sidebar 320 are the same as the one or more thumbnails displayed before the drag operation. In some embodiments, the position of the text control 315 in the document editing interface 310 can also be related to the position of the user release operation, for example, the text control 315 is displayed with the user release position as the center, or the text control 315 is displayed with the user release position as the top-left corner of the text control 315, and the like, which are not limited in this application.

[0133] The electronic device 100 can receive and respond to a user click operation on the blank area in the document editing interface 310, as shown in FIG. 3I. Figure 3L As shown, the electronic device 100 can close the display of the transit sidebar 320 and redisplay the transit icon 314. The transit icon 314 is the same as the above-mentioned Figure 3H As shown, the transit icon 314 is the same as the above-mentioned

[0134] It can be understood that the above-mentioned Figures 3A-3L The above-mentioned embodiments are only examples, and in the embodiments of the present application, the application 1 and the application 2 can also be different applications from the above-mentioned embodiments, and the user can also drag more or different text controls to the transit than the above-mentioned embodiments, or drag other types of controls to the transit, which are not limited in this application. In some embodiments, the transit icon can also be displayed in the form of a floating ball, or in the form of a top floating bar, which are not limited in this application.

[0135] In some application scenarios, the electronic device 100 displays an interface 1 of an application 1 (for example, a social application), and the interface 1 can include a control 1 which is a webview control. The electronic device 100 can receive and respond to an operation 1 (for example, a long-press drag operation) of the user on the control 1, display a transit icon on the interface 1, and display a drag layer of the control 1, and the display content of the drag layer is the same as the display content of the control 1. The electronic device 100 can move the drag layer along the trajectory of the operation 1 based on the operation 1 of the user. After detecting a release operation of the user in the area where the transit icon is located, the electronic device 100 can close the display of the drag layer and display a thumbnail of the control 1 in the transit icon. The display content of the thumbnail of the control 1 is the same as the display content of the control 1, and the display size is less than or equal to the display size of the control 1.

[0136] In this way, the electronic device 100 can drag the webview control in the application 1 to the transit through dragging and the like, and facilitate subsequent transmission of the webview control to other processes (for example, other applications) through the transit.

[0137] As shown in Figure 4A , the electronic device 100 displays a desktop 200. The electronic device 100 can receive and respond to a click operation of a user on the social application icon 205 to display a social application interface 230 as shown in Figure 4B . The specific description of the social application interface 230 can refer to the related description in the above-mentioned Figure 2I embodiment, which will not be repeated here.

[0138] The electronic device 100 can receive and respond to a long press and drag operation of a user on the web view control 234 to display a drag layer 237 and a transit station icon 236 as shown in Figure 4C .

[0139] As shown in Figure 4C , the specific description of the transit station icon 236 can refer to the related description in the above-mentioned Figure 2D embodiment. The display content of the drag layer 237 can be the same as that of the web view control 234, or the same as that of the picture control 234a in the web view control 234. The drag layer 237 can move along the trajectory of the user's drag operation.

[0140] The electronic device 100 can receive and respond to a drag operation of a user on the drag layer 237 so that the drag layer 237 moves along the trajectory of the drag operation to the transit station icon 236. When detecting a release operation of the user in the area where the transit station icon 236 is located, the electronic device 100 can close the display of the drag layer 237 and display a thumbnail 238 in the transit station icon 236 as shown in Figure 3C .

[0141] As shown in Figure 4D , the thumbnail 238 can be a thumbnail of the web view control 234. The display content of the thumbnail 238 is the same as that of the picture control 234a in the web view control 234. In some embodiments, the display content of the thumbnail 238 can also be the same as that of the web view control 234. The display size of the thumbnail 238 is less than or equal to the display size of the web view control 234, and is less than the display size of the transit station icon 236.

[0142] In this way, the electronic device 100 can drag the web view control in the application 1 into the transit station.

[0143] The electronic device 100 can store the drag data of the webpage view control in the transit station after dragging the webpage view control to the transit station, including the picture and the hyperlink, and optionally, if the webpage view control further includes text, the drag data can further include the text of the webpage view control. The electronic device 100 displays the interface 2 of the application 2, and the interface 2 displays the transit station sidebar, and the transit station sidebar displays one or more thumbnails, and one of the thumbnails is the thumbnail of the webpage view control. The electronic device 100 can receive and respond to the operation 2 (e.g., a long-press drag operation) of the user on the thumbnail to display the webpage view control in the interface 2.

[0144] For example, the electronic device 100 displays the social application interface 230 as shown in Figure 4D , receives and responds to the operation of the user sliding up from the lower edge of the display screen to close the social application interface 230 and display the desktop 200 as shown in Figure 4E . The specific description of the desktop 200 can refer to the above-described Figure 2A embodiment.

[0145] The electronic device 100 can receive and respond to the click operation of the user on the chat application icon 204 in the desktop 200 to display the chat application interface 400 as shown in Figure 4F .

[0146] As shown in Figure 4F , the chat application interface 400 can include one or more chat entries, such as the chat entry 401, and each chat entry can be used to trigger the electronic device 100 to display a corresponding chat interface. The content of the chat application interface 400 can refer to the above-described related description of the chat application interface 210, which will not be described here. Figure 2B

[0147] The electronic device 100 can receive and respond to the click operation of the user on the chat entry 401 to display the chat interface 410 as shown in Figure 4G .

[0148] As shown in Figure 4G , the chat interface 410 can include one or more chat records, such as the text control 412, and the chat interface 410 can further include the control area 411, which displays one or more chat controls. The chat controls can be used to assist the user in editing or sending messages such as text, pictures, voice, and expressions.

[0149] The electronic device 100 can receive and respond to the operation of the user sliding left from the right edge of the display screen, and display the transit station icon 413 in the chat interface 410 as shown in Figure 4H .

[0150] As​Figure 4H As shown, the transfer station icon 413 can display a thumbnail 413a, which can be compared with the above-mentioned Figure 4D The thumbnail shown is the same as 238, and the control used to prompt the user to finally drag the device into the transfer station is as described above. Figure 4D The webpage view control shown is 234.

[0151] Electronic device 100 can receive and respond to user clicks on the transfer station icon 413, such as... Figure 4I As shown, the transfer station sidebar 420 is displayed.

[0152] like Figure 4I As shown, the transfer station sidebar 420 may include one or more thumbnails, such as thumbnail 421, which may be related to the above. Figure 4H The thumbnail shown is the same as 413a, and the controls used to prompt the user to drag and drop into the transfer station include those described above. Figure 4D The webpage view control 234 is shown. Other related content regarding the transfer station sidebar 420 can be found above. Figure 3I The relevant descriptions in the illustrated embodiments.

[0153] Electronic device 100 can receive and respond to user drag-and-drop operations on thumbnail 421, such as Figure 4J As shown, this causes the thumbnail 421 to move along the trajectory of the user's drag operation. While the user is dragging the thumbnail 421, the electronic device 100 can temporarily turn off the display of the transfer station sidebar 420.

[0154] Electronic device 100 can receive and respond to the user's release operation, sending drag data (including images and hyperlinks) corresponding to thumbnail 421 to the chat object (i.e., the electronic device used by Xiaohong) in the chat interface 410, and displaying it in the chat interface 410 based on the drag data. Figure 4K The webpage view control shown is 414.

[0155] like Figure 4K As shown, the webpage view control 414 is similar to the above. Figure 4D The webpage view control 234 shown is the same.

[0156] Electronic device 100 can receive and respond to user clicks on webpage view control 414, displaying, for example... Figure 4L The webpage view interface shown is 430.

[0157] like Figure 4L As shown, the webpage view interface 430 can display graphic and text content, including one or more images and text. This graphic and text content is used to provide a detailed description of the images or text displayed in the webpage view control 414. It should be noted that the above... Figure 4DThe webpage view control 234 shown in the webpage view interface 430 can also be used to trigger the electronic device 100 to display the webpage view interface 430.

[0158] It should be noted that if the chat object (i.e., the electronic device used by Xiao Hong) is the electronic device 200, the electronic device 200 can also receive and respond to the click operation of the user on the webpage view control 414 sent by the electronic device 100 to display the webpage view interface 430 shown in FIG. 4B. Figure 4L The webpage view interface 430 shown in FIG. 4B.

[0159] It can be understood that the above-mentioned Figures 4A-4K The embodiment shown is only an example, and in the embodiments of the present application, the application 1 and the application 2 can also be different applications from the above-mentioned embodiments, and the cross-process transmission implemented by the relay station can also include more or fewer controls.

[0160] In this way, the webpage view control can be transmitted to another application by the data transmission method provided in the embodiments of the present application.

[0161] In some embodiments, by using the data transmission method provided in the embodiments of the present application, the picture or text in the webpage view control can also be transmitted to the relay station, and then the picture or text is transmitted to another application through the relay station, and the corresponding picture control or text control is displayed in the other application. The picture control or text control cannot trigger the display of the webpage interface corresponding to the webpage view control. The specific interface schematic diagram can be referred to the above-mentioned embodiments, which will not be described in detail herein.

[0162] The data transmission method provided in the embodiments of the present application can also be used to simultaneously drag multiple controls (picture controls, text controls, webpage view controls, etc.) to the relay station.

[0163] In some application scenarios, electronic device 100 displays an interface 1 of application 1 (e.g., a chat application). Interface 1 may include control 1 and control 2. The types of control 1 and control 2 can be any one or more of the following: image control, text control, web page view control. Electronic device 100 can receive and respond to the user's operation 3 of initiating drag mode (e.g., a swipe operation with an L-shaped trajectory starting from the edge of the display screen, a swipe operation to the left or up from the edge of the display screen, and a long press operation after a swipe operation), and display the drag mode interface. The drag mode interface displays a transfer station icon and all draggable controls (including control 1 and control 2) in interface 1. Electronic device 100 can sequentially receive and respond to the user's operation 4 (e.g., a click operation) on control 1 and control 2 respectively, and the user's operation 5 (e.g., a long press drag operation) on the drag mode interface, and display a drag layer on the drag mode interface, so that the drag layer moves along the trajectory of the user's drag operation. The content displayed on the drag layer can be the content displayed on control 1 (or control 2). After detecting a user's release operation in the area where the transfer station icon is located, the electronic device 100 can close the display of the drag layer and display a thumbnail of control 1 (or control 2) in the transfer station icon, the display size of the thumbnail being smaller than the display size of the transfer station icon.

[0164] In this way, multiple controls can be dragged to the transfer station in a single drag-and-drop operation, which is convenient and improves the efficiency of data transmission.

[0165] For example, such as Figure 5A As shown, the electronic device 100 displays a group chat interface 220. A detailed description of the group chat interface 220 can be found above. Figure 2C The illustrated embodiment.

[0166] Electronic device 100 can receive and respond to a user's sliding operation on the display screen in an L-shaped trajectory starting from the right edge of the display screen, activating drag mode and displaying as shown. Figure 5B The drag-and-drop interface shown is 500.

[0167] like Figure 5B As shown, the drag-and-drop interface 500 may include a transfer station icon 501, and may also include one or more draggable controls, which are draggable controls in the group chat interface 220, such as image controls 221, 222, and text controls 223. The one or more draggable controls may also display a selection indicator 502 to indicate whether the control is selected. Figure 5B In the illustrated embodiment, no control is selected. It should be noted that, in this embodiment, selection identifier 502 can be... Figure 5BThe circular mark shown can also be a square or other shape mark, which is not limited in the present application.

[0168] The electronic device 100 can receive and respond to the user's click operation on the picture control 221, the picture control 222 and the text control 223 in turn, as shown in FIG. 5B. Figure 5C As shown, the selected mark is displayed in the selection mark 502 on the above three controls.

[0169] As shown in FIG. 5C, the selected mark is displayed on the picture control 221, the picture control 222 and the text control 223. It should be noted that the selected mark can be displayed in the selection mark. In other embodiments, it can also be indicated by highlighting, color display, bold display and other ways to show whether the control is selected. At this time, the selection mark and the selected mark can not be displayed, which can be referred to the contents in the embodiments shown in FIG. 5D and FIG. 5E. Figure 5C Figure 5G Figure 5H

[0170] The electronic device 100 can receive and respond to the user's long press and drag operation on the drag mode interface 500, as shown in FIG. 5F. Figure 5D As shown, the drag layer 503 is displayed on the drag mode interface 500.

[0171] As shown in FIG. 5G, the display content of the drag layer 503 can be the same as the display content of the picture control 221. In some embodiments, the display content of the drag layer 503 can also be the same as the display content of the picture control 222 or the text control 223. The drag layer 503 can also display a number mark, such as the number "3", which can be used to prompt the user that there are three controls to be dragged. The drag layer 503 can move along with the user's drag trajectory. Figure 5D As shown in FIG. 5H, when the user drags the drag layer 503 to the area where the transit station icon 501 is located, and detects the user's release operation in the area, the electronic device 100 can close the display of the drag layer 503, and display the thumbnail 504 in the transit station icon 501.

[0172] Figure 5E As shown in FIG. 5H, when the user drags the drag layer 503 to the area where the transit station icon 501 is located, and detects the user's release operation in the area, the electronic device 100 can close the display of the drag layer 503, and display the thumbnail 504 in the transit station icon 501.

[0173] As shown in FIG. 5H, when the user drags the drag layer 503 to the area where the transit station icon 501 is located, and detects the user's release operation in the area, the electronic device 100 can close the display of the drag layer 503, and display the thumbnail 504 in the transit station icon 501. Figure 5E As shown in FIG. 5H, when the user drags the drag layer 503 to the area where the transit station icon 501 is located, and detects the user's release operation in the area, the electronic device 100 can close the display of the drag layer 503, and display the thumbnail 504 in the transit station icon 501.

[0174] The electronic device 100 can receive and respond to the user's operation of closing the drag mode (such as double-click operation on the drag mode interface 500, specific gesture operation, etc.), close the drag mode, and re-display the interface as shown in FIG. 5B.​​​​Figure 5A The group chat interface 220 shown in FIG. 6B.

[0175] In some embodiments, the electronic device 100 can also close the drag mode and display the group chat interface 220 shown in FIG. 6B when detecting the release operation of the user in the area where the transit station icon 501 is located. Figure 5F The group chat interface 220 shown in FIG. 6B, which displays the transit station icon 501 and the thumbnail 504. The specific description of the thumbnail 504 can be referred to the above Figure 5E The embodiment shown in FIG. 6B, which will not be described here.

[0176] In this way, in the drag mode, multiple controls can be dragged into the transit station at the same time, which can reduce the operation steps and improve the efficiency. After the multiple controls are dragged into the transit station, the electronic device 100 can also receive and respond to the operation of the user dragging the control in the transit station into the application 2, and display one or more controls in the transit station in the interface of the application 2. The specific steps can be referred to the related description in the above embodiments, which will not be described here.

[0177] In some embodiments, the drag mode interface can also indicate whether the control is selected by highlighting (for example, highlighting, displaying in different colors, displaying in bold, etc.). At this time, the selection identifier and the selected mark can not be displayed.

[0178] For example, as shown in FIG. 7A, the electronic device 100 displays the drag mode interface 510, which can include the picture control 511, the picture control 512, the text control 513, and the transit station icon 514. Figure 5G Different from the drag mode interface 500 shown in FIG. 6A, the picture control and the text control do not display the selection identifier. Figure 5B

[0179] The electronic device 100 can receive and respond to the click operation of the user on the picture control 511, the picture control 512, and the text control 513 in sequence, as shown in FIG. 7B, and highlight the picture control 511, the picture control 512, and the text control 513. Figure 5H

[0180] In this way, the user can also determine whether the control is selected by observing whether the control in the drag mode interface is highlighted.

[0181] The data transmission method provided in the embodiments of the present application can also be used for cross-process transmission of interface elements including multiple controls, and the types of the multiple controls can include any one or more of the following: picture controls, text controls, webview controls, etc.

[0182] ​​In some application scenarios, electronic device 100 displays interface 1 of application 1. Interface 1 may include interface element 1, which may include control 1 and control 2. The types of control 1 and control 2 may include any one or more of the following: image control, text control, and webpage view control. Electronic device 100 can receive and respond to user operation 3 initiating drag mode (e.g., a sliding operation with an L-shaped trajectory starting from the edge of the display screen, a sliding operation to the left or up from the edge of the display screen, and a long press operation after a sliding operation), and display drag mode interface. The drag mode interface displays a transfer station icon and interface element 1. Optionally, if interface 1 also includes other draggable controls, the drag mode interface may also include one or more of these draggable controls. Electronic device 100 can sequentially receive and respond to user operation 4 (e.g., a click operation) on interface element 1 (e.g., on any point of control 1 or control 2), and display a selection mark on interface element 1. Electronic device 100 receives and responds to user operation 5 (e.g., long press drag operation) on the drag mode interface, displays a drag layer on the drag mode interface, and moves the drag layer along the trajectory of the user's drag operation. The content displayed on the drag layer can be the content displayed on interface element 1. After detecting the user's release operation in the area where the transfer station icon is located, electronic device 100 can turn off the display of the drag layer and display a thumbnail of interface element 1 in the transfer station icon. The display size of the thumbnail is smaller than the display size of the transfer station icon.

[0183] In this way, multiple UI elements, including controls, can be dragged to the transfer station in a single drag-and-drop operation, which is convenient and improves the efficiency of data transmission.

[0184] In some embodiments, if the interface element includes multiple text controls, the electronic device 100 may also use the data transmission method provided in the embodiments of this application to transmit the interface element from application 1 (e.g., gallery application) to application 2 (e.g., document application).

[0185] For example, such as Figure 6A As shown, the electronic device 100 displays a desktop 200. A detailed description of the desktop 200 can be found above. Figure 2A The content shown in the embodiment. The electronic device 100 can receive and respond to a user's click on the gallery application icon 207, displaying, as shown... Figure 6B The album interface shown is 600.

[0186] like Figure 6B As shown, the album interface 600 can display one or more album icons, such as the camera album icon, the screenshot album icon 601, and the video album icon, etc.

[0187] The electronic device 100 can receive and respond to a click operation of the user on the screenshot album icon 601 to display a screenshot album interface 610 as shown in Figure 6C

[0188] As shown in Figure 6C , one or more thumbnails of pictures, such as thumbnail 611, can be displayed in the screenshot album interface 610. Each thumbnail can be used to trigger the electronic device 100 to display the picture corresponding to the thumbnail in full screen in the display screen.

[0189] The electronic device 100 can receive and respond to a click operation of the user on the thumbnail 611 to display a picture browsing interface 620 as shown in Figure 6D

[0190] As shown in Figure 6D , the picture browsing interface 620 can display the picture 622 corresponding to the thumbnail 611, and the picture 622 can display text content, such as “ABB”, “?!*”, “CDD”, etc. In the picture browsing interface 620, the picture 622 is displayed in full screen, i.e., the display area of the picture is the entire area of the display screen. The picture browsing interface 620 can also display a text extraction control 621, which can be used to trigger the electronic device 100 to extract the text content in the picture 622.

[0191] The electronic device 100 can receive and respond to a click operation of the user on the text extraction control 621 to display a smart screen recognition interface 630 as shown in Figure 6E

[0192] As shown in Figure 6E , the smart screen recognition interface 630 can include a picture 631 and an extraction result display area 632. The picture 631 can be displayed in the upper part of the display screen, and the picture 631 is the same as the picture 622 in the above Figure 6D embodiment. The extraction result display area 632 can be displayed in the lower part of the display screen, and the extraction result display area 632 can include interface elements 633 for prompting the user that the electronic device 100 has extracted text content from the picture 622. The interface elements 633 can include a plurality of text controls, each of which includes a text, such as “A”, “B”, “B”, etc. The texts in all text controls in the interface elements 633 can be combined into text content according to the arrangement order of the corresponding text controls in the smart screen recognition interface 630, and the text content is Figure 6D ​​​the text content in the picture 622. In addition, one or more auxiliary controls, such as a select-all control, a search control, a copy-text control, a translation control, a share control, etc., can also be displayed in the extraction result display area 632, and the one or more auxiliary controls can be used to assist the user in performing select-all, search, copy, translation, sharing, etc. operations on the extracted text content.

[0193] The electronic device 100 can receive and respond to a sliding operation on the display screen in an L-shaped trajectory starting from the right edge of the display screen, to open the drag mode, and display the drag mode interface 640 as shown in Figure 6F .

[0194] As shown in Figure 6F , the drag mode interface 640 can include the interface element 633 and the transit station icon 641, and the specific content of the transit station icon 641 can be referred to the related description in the above embodiments, and the specific description of the interface element 633 can be referred to the related description in the above Figure 6E embodiments. In some embodiments, all the controls in the extraction result display area 632 (including the interface element 633 and the auxiliary controls, etc.) can also be included in the drag mode interface 640.

[0195] The electronic device 100 can receive and respond to a click operation of the user on any one of the text controls (or on the select-all control) in the interface element 633, and display a selected mark on the interface element 633 as shown in Figure 6G .

[0196] As shown in Figure 6G , the electronic device 100 displays a selected mark on the interface element 633, which can be that the electronic device 100 changes the display color of all the text controls in the interface element 633 to another color, such as changing the display color of the text controls from white to black or other colors, and changing the font color in the text controls from black to white, or to other colors, etc., which are not limited in the present application. The electronic device 100 can prompt the user that the interface element 633 is in a selected state through different display colors. It can be understood that only one kind of selected mark is exemplarily provided here, and the electronic device 100 can also use other selected marks in the embodiments of the present application, such as the selected marks described in the above Figure 5C or Figure 5H embodiments, which are not limited in the present application.

[0197] The electronic device 100 receives and responds to a long press and drag operation of the user on any point on the drag mode interface 640, and displays a drag layer 642 in the drag mode interface 640 as shown in Figure 6H .

[0198] AsFigure 6H As shown, the drag layer 642 can be a picture with the same display content as the interface element 633, and the display size can be the same or different. The drag layer 642 can move along with the user's dragging trajectory in the drag mode interface 640. When the user drags the drag layer 642 to the position where the transit icon 641 is located, and the electronic device 100 detects the user's release operation, as shown in FIG. 6J, the electronic device 100 can close the display of the drag layer 642, and display the text thumbnail 643 in the transit icon 641. Figure 6I As shown, the electronic device 100 can close the display of the drag layer 642, and display the text thumbnail 643 in the transit icon 641.

[0199] As shown in FIG. 6K, the text thumbnail 643 can be a document pattern, and the text thumbnail 643 can be used to prompt the user that the control just dragged into the transit station is a text control. Figure 6I In this way, the electronic device 100 can drag the interface element including multiple controls in the interface 1 into the transit station.

[0200] After the interface element 633 is dragged into the transit station, the electronic device 100 can also receive and respond to the user's click operation and long press dragging operation on the control in the drag mode interface 640, and drag the control into the transit station. The specific manner can refer to the related description in the above embodiments, and will not be described here. In addition, the electronic device 100 can also receive and respond to the user's click operation on the drag mode interface 640, as shown in FIG. 6L.

[0201] As shown, the display of the drag mode interface 640 is closed, and the smart screen interface 630 is displayed again. Figure 6J As shown in FIG. 6M, the electronic device 100 displays the smart screen interface 630. The specific description of the smart screen interface 630 can refer to the related description in the above

[0202] As shown, the electronic device 100 displays the smart screen interface 630. The specific description of the smart screen interface 630 can refer to the related description in the above Figure 6J As shown, the electronic device 100 displays the smart screen interface 630. The specific description of the smart screen interface 630 can refer to the related description in the above Figure 6E As shown, the electronic device 100 displays the smart screen interface 630. The specific description of the smart screen interface 630 can refer to the related description in the above

[0203] In this way, the drag mode can be exited, and the previous interface can be returned.

[0204] After the electronic device 100 drags the interface element including multiple controls to the transit station, the electronic device 100 can store data of the interface element (for example, the number and arrangement layout of the controls included in the interface element, the picture, text, hyperlink, etc. of each control) in the transit station. If the interface element only includes text controls, the electronic device 100 displays interface 2 of application 2, and a transit station sidebar is displayed on interface 2, and a thumbnail of the interface element is displayed in the transit station sidebar. In this case, the electronic device 100 can receive and respond to a long press drag operation of the user on the thumbnail to display the interface element in interface 2, or display the text content in the interface element. The text content in the interface element refers to the text content obtained by splicing the text in all text controls in the interface element based on the arrangement layout of the text controls in the interface element.

[0205] For example, as shown in FIG. 6A, the electronic device 100 displays a document editing interface 650. The opening manner of the document editing interface 650 can refer to the related description in the above-mentioned Figure 6K embodiment, and the specific content of the document editing interface 650 can refer to the related description of the above-mentioned Figures 3D-3G document editing interface 310. In addition, the document editing interface 650 also displays a transit station sidebar 651, and a thumbnail 652 is displayed in the transit station sidebar 651. The thumbnail 652 is the thumbnail corresponding to the interface element 633. In some embodiments, the thumbnail 652 can display part of the text content of the interface element 633, and in other embodiments, the thumbnail 652 can also be a picture with the same display content as the interface element 633 and different display size. Figure 3G The electronic device 100 can receive and respond to a long press drag operation of the user on the thumbnail 652 to display a drag layer of the thumbnail 652 and drag the drag layer to an area outside the transit station sidebar 651. When detecting a release operation of the user, as shown in FIG. 6B, the electronic device 100 can display a text control 653 in the document editing interface 650. The text content in the text control 653 is the same as the text content in the above-mentioned

[0206] Figure 6L interface element 633. In addition, the document editing interface 650 can also display a transit station icon 654, and the transit station icon 654 can display a text thumbnail. Figure 6E In this way, the interface element including multiple controls can be transmitted to another application through the transit station.

[0207] It can be understood that,

[0208] Figures 6A-6L ​​The illustrated embodiment is only an example. In the embodiments of the present application, the application 1 can also be an application other than a photo album application (including self-developed applications and third-party applications), the application 2 can also be an application other than a document application, and the interface element can include more or fewer controls, which are not limited herein.

[0209] In some embodiments, if the interface element includes multiple picture controls, the electronic device 100 can also use the data transmission method provided in the embodiments of the present application to transmit the interface element from the application 1 (for example, a photo album application) to the application 2 (for example, a document application).

[0210] For example, as Figure 7A illustrated, the electronic device 100 displays a desktop 200. The specific description of the desktop 200 can refer to the content in the above Figure 2A illustrated embodiment. The electronic device 100 can receive and respond to a user's click operation on the photo album application icon 208 to display a photo album application interface 700 as Figure 7B illustrated.

[0211] As Figure 7B illustrated, one or more editing controls can be displayed in the photo album application interface 700, such as a picture editing control, a camera control, a puzzle control 701, a video editing control, an artificial intelligence (AI) control, a portrait control, and the like. Each of the one or more editing controls can be used to trigger the electronic device 100 to perform a corresponding editing operation on a selected video or picture.

[0212] The electronic device 100 can receive and respond to a user's click operation on the puzzle control 701 to display a picture selection interface 710 as Figure 7C illustrated.

[0213] As Figure 7C illustrated, one or more pictures can be displayed in the picture selection interface 710, such as a thumbnail 711 and a thumbnail 712. A selection identifier can also be displayed on each thumbnail to prompt the user whether the thumbnail is selected.

[0214] The electronic device 100 can receive and respond to a user's click operation on the thumbnail 711 and on the thumbnail 712 in turn, as Figure 7D illustrated, a selected mark is displayed in the selection identifier on the thumbnail 711 and the thumbnail 712.

[0215] As Figure 7DAs shown, a check mark is displayed in the selection mark on the thumbnail 711 and the thumbnail 712, to prompt the user that the thumbnail 711 and the thumbnail 712 are in the selected state. In addition, after detecting that there is a selected thumbnail, the electronic device 100 can display a start puzzle control 713 in the picture selection interface 710, the start puzzle control 713 being used to trigger the electronic device 100 to display a puzzle interface 720.

[0216] The electronic device 100 can receive and respond to a click operation of the user on the start puzzle control 713, and display the puzzle interface 720 as shown in Figure 7E

[0217] As shown in Figure 7E The puzzle interface 720 can include interface elements 721, a save control, a return control, and a mode setting area 722, and one or more mode options can be displayed in the mode setting area 722. The interface elements 721 can include a plurality of picture controls, such as a picture control 723 and a picture control 724. The mode options in the mode setting area 722 can be used to trigger the electronic device 100 to change the positional relationship of the two picture controls in the interface elements 721 or change the display size of the interface elements 721.

[0218] The electronic device 100 can receive and respond to a sliding operation of the user on the display screen in an L-shaped track starting from the right edge of the display screen, to open a drag mode, and display a drag mode interface 730 as shown in Figure 7F

[0219] As shown in Figure 7F The drag mode interface 730 can include the interface elements 721 and a transit station icon 731, and the specific content of the transit station icon 731 can be referred to the related description in the above embodiments, and the specific description of the interface elements 721 can be referred to the related description in the above Figure 7E embodiments.

[0220] The electronic device 100 can receive and respond to a click operation of the user on the interface elements 721, and display a check mark on the interface elements 721 as shown in Figure 7G

[0221] As shown in Figure 7G The electronic device 100 displays a check mark on the interface elements 721, which can be that the electronic device 100 highlights the interface elements 721. In some embodiments, the electronic device 100 can also prompt the user that the interface elements 721 are in the selected state by different display colors or different display brightness. It can be understood that only one kind of check mark is exemplarily provided here, and the electronic device 100 can also use other check marks in the embodiments of the present application, such as the above Figure 5C or​​​Figure 5H The selected mark described in the embodiments is not limited herein.

[0222] The electronic device 100 receives and responds to a long press drag operation of the user on any point on the drag mode interface 730, as shown in Figure 7H The drag layer 732 is displayed in the drag mode interface 640, as shown.

[0223] As shown in Figure 7H The drag layer 732 can be a picture with the same display content as the interface element 721 and the same or different display size. The drag layer 732 can move following the user's drag trajectory in the drag mode interface 730. When the user drags the drag layer 7322 to the position where the transit station icon 7311 is located, and the electronic device 100 detects the user's release operation, as shown in Figure 7I The electronic device 100 can close the display of the drag layer 732 and display the thumbnail 733 of the interface element 721 in the transit station icon 731.

[0224] As shown in Figure 7I The thumbnail 733 can be a picture with the same display content as the interface element 721 and the display size smaller than that of the transit station icon 731.

[0225] In this way, the electronic device 100 can drag the interface element including multiple picture controls in the interface 1 into the transit station.

[0226] After the interface element 721 is dragged into the transit station, the electronic device 100 can also receive and respond to a click operation of the user on the drag mode interface 730, as shown in Figure 7J The display of the drag mode interface 730 is closed, and the jigsaw puzzle interface 720 is displayed again.

[0227] As shown in Figure 7J The electronic device 100 displays the jigsaw puzzle interface 720, and the specific description of the jigsaw puzzle interface 720 can refer to the related description in the above Figure 7E embodiments. In addition, the transit station icon 731 can be displayed in the jigsaw puzzle interface 720, and the thumbnail 733 can also be displayed in the transit station icon 731.

[0228] In this way, the drag mode can be exited, and the previous interface can be returned.

[0229] After the electronic device 100 drags the interface element including multiple controls to the transit station, the electronic device 100 can store data of the interface element (e.g., the number and arrangement of the controls included in the interface element, the picture, text, hyperlink, etc. of each control) in the transit station. If the interface element only includes picture controls, the electronic device 100 displays interface 2 of application 2, and a transit station sidebar is displayed on interface 2, and a thumbnail of the interface element is displayed in the transit station sidebar. In this case, the electronic device 100 can receive and respond to a long press drag operation of the user on the thumbnail to display the interface element in interface 2.

[0230] As shown in FIG. 7A, the electronic device 100 displays a document editing interface 740. The opening of the document editing interface 740 can refer to the related description in the above-mentioned embodiment of FIG. 3A, and the specific content of the document editing interface 740 can refer to the related description of the document editing interface 310 in the above-mentioned embodiment of FIG. 3A. Figure 7K As shown in FIG. 7A, the electronic device 100 displays a document editing interface 740. The opening of the document editing interface 740 can refer to the related description in the above-mentioned embodiment of FIG. 3A, and the specific content of the document editing interface 740 can refer to the related description of the document editing interface 310 in the above-mentioned embodiment of FIG. 3A. Figures 3D-3G As shown in FIG. 7A, the electronic device 100 displays a document editing interface 740. The opening of the document editing interface 740 can refer to the related description in the above-mentioned embodiment of FIG. 3A, and the specific content of the document editing interface 740 can refer to the related description of the document editing interface 310 in the above-mentioned embodiment of FIG. 3A. Figure 3G As shown in FIG. 7A, the electronic device 100 displays a document editing interface 740. The opening of the document editing interface 740 can refer to the related description in the above-mentioned embodiment of FIG. 3A, and the specific content of the document editing interface 740 can refer to the related description of the document editing interface 310 in the above-mentioned embodiment of FIG. 3A.

[0231] As shown in FIG. 7A, the electronic device 100 displays a document editing interface 740. The opening of the document editing interface 740 can refer to the related description in the above-mentioned embodiment of FIG. 3A, and the specific content of the document editing interface 740 can refer to the related description of the document editing interface 310 in the above-mentioned embodiment of FIG. 3A. Figure 7L As shown in FIG. 7A, the electronic device 100 displays a document editing interface 740. The opening of the document editing interface 740 can refer to the related description in the above-mentioned embodiment of FIG. 3A, and the specific content of the document editing interface 740 can refer to the related description of the document editing interface 310 in the above-mentioned embodiment of FIG. 3A.

[0232] As shown in FIG. 7A, the electronic device 100 displays a document editing interface 740. The opening of the document editing interface 740 can refer to the related description in the above-mentioned embodiment of FIG. 3A, and the specific content of the document editing interface 740 can refer to the related description of the document editing interface 310 in the above-mentioned embodiment of FIG. 3A. Figure 7L As shown in FIG. 7A, the electronic device 100 displays a document editing interface 740. The opening of the document editing interface 740 can refer to the related description in the above-mentioned embodiment of FIG. 3A, and the specific content of the document editing interface 740 can refer to the related description of the document editing interface 310 in the above-mentioned embodiment of FIG. 3A.

[0233] As shown in FIG. 7A, the electronic device 100 displays a document editing interface 740. The opening of the document editing interface 740 can refer to the related description in the above-mentioned embodiment of FIG. 3A, and the specific content of the document editing interface 740 can refer to the related description of the document editing interface 310 in the above-mentioned embodiment of FIG. 3A. Figure 7M As shown in FIG. 7A, the electronic device 100 displays a document editing interface 740. The opening of the document editing interface 740 can refer to the related description in the above-mentioned embodiment of FIG. 3A, and the specific content of the document editing interface 740 can refer to the related description of the document editing interface 310 in the above-mentioned embodiment of FIG. 3A. Figure 7E As shown in FIG. 7A, the electronic device 100 displays a document editing interface 740. The opening of the document editing interface 740 can refer to the related description in the above-mentioned embodiment of FIG. 3A, and the specific content of the document editing interface 740 can refer to the related description of the document editing interface 310 in the above-mentioned embodiment of FIG. 3A.

[0234] As shown in FIG. 7A, the electronic device 100 displays a document editing interface 740. The opening of the document editing interface 740 can refer to the related description in the above-mentioned embodiment of FIG. 3A, and the specific content of the document editing interface 740 can refer to the related description of the document editing interface 310 in the above-mentioned embodiment of FIG. 3A. Figures 7A-7MThe embodiment shown is only an example. In the embodiment of the present application, the application 1 can also be an application other than a Meitu application (including a self-developed application and a third-party application), the application 2 can also be an application other than a document application, and the interface element can include more or fewer controls, which are not limited herein.

[0235] The specific flow of the data transmission method provided by the embodiment of the present application is introduced below.

[0236] Figure 8 A module interaction flow diagram for transmitting data in the application 1 to the transfer station is shown.

[0237] As Figure 8 shown, the electronic device 100 can include a view 11, a drag framework 12, and a transfer station 13. The specific flow of transmitting data in the application 1 to the transfer station can include the following steps:

[0238] S801, when Figure 11 a long press operation of a user on a control 1 in an application 1 is detected, the type of the control 1 is determined, and the type of the control includes a picture control, a text control, a web view control, and the like.

[0239] In the case where the interface 1 of the application 1 is displayed and the interface 1 includes the control 1, the Figure 11 long press operation of the user on the control 1 can be received and responded to. After determining that the operation object of the long press operation is the control 1, the type of the control 1 can be determined based on the code of the control 1. The type of the control can include a picture control, a text control, a web view control, and the like.

[0240] For example, the long press operation on the control 1 can be the long press operation on the picture control 221 shown in the above Figure 2C embodiment, the long press operation on the picture control 222 shown in the above Figure 2E embodiment, the long press operation on the text control 223 shown in the above Figure 3A embodiment, or the long press operation on the web view control 234 shown in the above Figure 5A embodiment, and the like.

[0241] S802, when Figure 11 the type of the control 1 is determined, an empty drag object is created based on the type of the control 1, and the type of the drag object is the same as the type of the control 1.

[0242] When Figure 11 the type of the control 1 is determined, an empty drag object is created based on the type of the control 1, and the type of the drag object is the same as the type of the control 1. Figures 9A-9C the specific content of creating the empty drag object can be referred to the related steps in the above

[0243] S803, whenFigure 11 detecting the drag operation of the user on the control 1, obtaining the drag data of the control 1 based on the type of the control 1, the drag data comprising one or more of the picture, the text, the hyperlink.

[0244] Upon detecting the drag operation of the user on the control 1, the system Figure 11 The drag data of the control 1 can be obtained based on the type of the control 1. The type of the control can comprise one or more of the following: a picture control, a text control, a web view control, etc. In some embodiments, the system Figure 11 The drag data of the control 1 can also be obtained in response to the long press operation on the control 1 in step S801.

[0245] The drag data comprises one or more of the picture, the text, the hyperlink. In some embodiments, when the type of the control 1 is a picture control, the drag data of the control 1 can comprise the picture of the control 1; when the type of the control 1 is a text control, the drag data of the control 1 can comprise the text of the control 1; when the type of the control 1 is a web view control, the drag data of the control 1 can comprise the picture of the control 1, the hyperlink, and the text of the text control if the web view control comprises the text control.

[0246] In some embodiments, the drag data of the control 1 can further comprise a drag permission of the control 1, the drag permission being used to indicate that the control 1 is a draggable control. For example, when the system Figure 11 When it is determined that the drag data of the control 1 comprises the drag permission, it is determined that the control 1 is a draggable control, and the following steps can be performed; when it is determined that the drag data of the control 1 does not comprise the drag permission, it is determined that the control 1 is a non-draggable control, and a prompt can be outputted to indicate that the control 1 cannot be dragged to the transit station. Figure 11 When it is determined that the drag data of the control 1 does not comprise the drag permission, it is determined that the control 1 is a non-draggable control, and a prompt can be outputted to indicate that the control 1 cannot be dragged to the transit station. Figure 11 The validity of the drag permission can also be checked, i.e. it is determined whether the drag permission is valid based on the drag permission (e.g. checking the validity period of the drag permission, checking the permission party of the drag permission, etc.), and the checking result is used to indicate whether the drag permission is valid. For example, when the system Figure 11 When it is determined that the drag permission of the control 1 is valid, it is determined that the control 1 is a draggable control, and the following steps can be performed; when it is determined that the drag permission of the control 1 is invalid, it is determined that the control 1 is a non-draggable control, and a prompt can be outputted to indicate that the control 1 cannot be dragged to the transit station. Figure 11 When it is determined that the drag permission of the control 1 is valid, it is determined that the control 1 is a draggable control, and the following steps can be performed; when it is determined that the drag permission of the control 1 is invalid, it is determined that the control 1 is a non-draggable control, and a prompt can be outputted to indicate that the control 1 cannot be dragged to the transit station.

[0247] The system Figure 11The drag data of the control 1 can be obtained from a view module corresponding to the type of the control 1 based on the type of the control 1. The view module can include an image view, a text view, a web view, etc. Figure 11 The specific process of obtaining the drag data based on the type of the control 1 and the specific process of generating the drag object of the control 1 in the subsequent step S804 can refer to the following Figures 9A-9C The details of the content in the embodiments are not described here.

[0248] S804, the view Figure 11 The drag data of the control 1 is filled into the empty drag object to generate the drag object of the control 1.

[0249] After obtaining the drag data of the control 1, the view Figure 11 The drag data of the control 1 can be filled into the empty drag object to generate the drag object of the control 1. The specific process can refer to the following Figures 9A-9C Embodiments.

[0250] S805, the view Figure 11 The drag instruction including the drag object of the control 1 is sent to the drag framework 12.

[0251] After generating the drag object of the control 1, the view Figure 11 The drag instruction including the drag object of the control 1 can be sent to the drag framework 12. The drag instruction is used to instruct the drag framework 12 to initiate the drag.

[0252] S806, the drag framework 12 sends a start instruction to the transfer station 13 to instruct to start the transfer station.

[0253] Step S806 is an optional step.

[0254] In some embodiments, in response to the drag instruction, when it is detected that the transfer station 13 has not been started, the drag framework 12 can send a start instruction to the transfer station 13, and the start instruction is used to instruct to start the transfer station.

[0255] In another embodiment, in response to the drag instruction, when it is detected that the transfer station 13 has been started, the drag framework 12 can perform the following step S809 and the subsequent steps.

[0256] S807, the transfer station 13 starts the transfer station and displays the transfer station icon.

[0257] The transfer station 13 receives and responds to the start instruction of the drag framework 12, starts the transfer station, and draws and displays the transfer station icon.

[0258] For example, the transfer station icon can be the above-mentionedFigure 2D The transit station icon 224 is shown.

[0259] S808, the drag framework 12 displays the drag layer of the control 1 and the drag track based on the drag object of the control 1.

[0260] After receiving the drag object of the control 1, the drag framework 12 can draw and display the drag layer of the control 1 and the drag track based on the drag data in the drag object of the control 1.

[0261] The drag layer of the control 1 can be a picture same as the display content of the control 1, and the display size of the drag layer can be same as or different from the display size of the control 1. For example, if the control 1 is the picture control 221 in the above Figure 2C , the drag layer of the control 1 can be the drag layer 225 shown in Figure 2D ; if the control 1 is the picture control 234a in the web view control 234 shown in the above Figure 4B , the drag layer of the control 1 can be the drag layer 237 shown in Figure 4C ; if the control 1 is the text control 223 shown in the above Figure 3A , the drag layer of the control 1 can be the drag layer 229 shown in Figure 3B .

[0262] The drag track can be drawn and displayed based on the track of the user operation 1. It should be noted that in the above step S801, the action object of the user operation 1 is the control 1, but the drag layer of the control 1 moves along the track of the operation 1, and the control 1 is still displayed at the original position.

[0263] S809, when the drag layer is dragged to the area where the transit station icon is located and the release operation of the user in the area is detected, the drag framework 12 sends the drag object of the control 1 to the transit station 13.

[0264] After the transit station 13 is started, when the drag layer is dragged to the area where the transit station icon is located and the release operation of the user in the area is detected, the drag framework 12 can send the drag object of the control 1 to the transit station 13.

[0265] S810, the transit station 13 displays the thumbnail of the control 1 on the transit station icon based on the drag object of the control 1.

[0266] After receiving the drag object of the control 1, the transit station 13 can generate the thumbnail of the control 1 based on the drag data in the drag object, or based on the type of the drag object. The thumbnail of the control 1 can be a picture which displays the same content as the control 1 and has a display size smaller than or equal to the display size of the control 1. It is to be noted that the display size of the thumbnail displayed on the transit station icon is smaller than the display size of the transit station icon.

[0267] When the control 1 is a picture control or a web view control, the transit station 13 can obtain the picture of the control 1 based on the drag object of the control 1, and generate the thumbnail of the control 1. For example, if the control 1 is the picture control 221 as shown in FIG. 2A, the thumbnail of the control 1 can be the thumbnail 226 as shown in FIG. 2A; for another example, if the control 1 is the picture control 234a in the web view control 234 as shown in FIG. 2B, the thumbnail of the control 1 can be the thumbnail 238 as shown in FIG. 2B. Figure 2C Figure 2E Figure 4B Figure 4D

[0268] When the control 1 is a text control, the transit station 13 can obtain the text of the control 1 from the drag object, and generate the thumbnail of the control 1 based on the text. In some embodiments, the transit station 13 can also determine that the control 1 is a text control based on the drag object, and generate a text thumbnail based on the type of the control 1, where the text thumbnail is used to indicate the type of the control 1. For example, the text thumbnail can be the text thumbnail 223a as shown in FIG. 2A. Figure 3A

[0269] After generating the thumbnail of the control 1, the transit station 13 can display the thumbnail of the control 1 on the transit station icon.

[0270] S811, the transit station 13 stores the drag object and the thumbnail of the control 1.

[0271] After generating the thumbnail of the control 1, the transit station 13 can store the thumbnail of the control 1 and the drag object in a corresponding relationship.

[0272] For example, Table 1 shows a corresponding relationship between the drag object and the thumbnail stored in the transit station 13.

[0273] Table 1

[0274]

[0275]

[0276] ​​​​​As shown in Table 1, the transit station 13 can store one or more thumbnails corresponding to the controls and the drag object. The thumbnails of the same control correspond to the drag object. According to Table 1, the thumbnail corresponding to the drag object a is picture a, and the thumbnail corresponding to the drag object b is picture b.

[0277] It can be understood that the embodiment shown in Table 1 is only an example. In the embodiments of the present application, the transit station 13 can also store more or less data, or store different content from the embodiment shown in Table 1, which is not limited in the present application.

[0278] In some embodiments, the transit station 13 can obtain the type of the control 1 and the drag data from the drag object. After generating the thumbnail of the control 1, the transit station 13 can store the type of the control 1, the thumbnail, and the drag data according to the correspondence.

[0279] For example, Table 2 shows the correspondence between the control type, the drag data, and the thumbnail stored in the transit station 13.

[0280] Table 2

[0281] Thumbnail Type Dragged data Picture a Picture control Picture d Picture b Text control Text a Picture c Web view control Picture e, hyperlink c

[0282] As shown in Table 2, the transit station 13 can store one or more types, thumbnails, and drag data corresponding to the controls. The thumbnails, types, and drag data of the same control correspond to each other. According to Table 2, the drag data of a picture control includes picture d, and the thumbnail of the picture control is picture a; the drag data of a text control includes text a, and the thumbnail corresponding to the text control is picture b; the drag data of a web view control includes picture e and hyperlink c, and the thumbnail of the web view control is picture c.

[0283] It can be understood that the embodiment shown in Table 2 is only an example. In the embodiments of the present application, the transit station 13 can also store more or less data, or store different content from the embodiment shown in Table 2, which is not limited in the present application.

[0284] By using the data transmission method provided in the embodiments of the present application, cross-process transmission of data can be achieved. Not only is the operation simple, but also in the case where the three-party application is not adapted, the controls such as picture, text, and web view control in the three-party application can also be transmitted to the transit station.

[0285] The following describes the view Figure 11 The flowchart of obtaining the drag data of the control 1 based on the type of the control 1 and generating the drag object is shown.

[0286] Figure 9AThe embodiment of the present application provides a specific process of acquiring drag data of a picture control and generating a drag object of the picture control.

[0287] As shown in Figure 9A In the case that the control 1 is a picture control, the view Figure 11 may include a top view (decorview) 1101 and an image view (imageview) 1102, wherein the top view 1101 can include an image drag (imagedragEx) module 1101a. The view Figure 11 The specific process of acquiring drag data of a picture control and generating a drag object of the picture control can include the following steps:

[0288] S901a, when the view Figure 11 When it is determined that the type of the control 1 is a picture control, the image drag module 1101a creates an empty drag object, and the type of the drag object is a picture control.

[0289] In the case that the control 1 is a picture control, the image drag module 1101a can create an empty drag object based on the type of the control 1, and the type of the drag object is a picture control.

[0290] S902a, the image drag module 1101a acquires the drag data of the control 1 from the image view 1102, including the picture of the control 1.

[0291] S903a, the image drag module 1101a fills the drag data of the control 1 into the empty drag object, and generates the drag object of the control 1.

[0292] In this way, when the long press drag operation of the user on the picture control is detected, the drag response of the image view (imageview) 1102 can be called to acquire the picture of the picture control and generate the drag object of the picture control.

[0293] Figure 9B The embodiment of the present application provides a specific process of acquiring drag data of a text control and generating a drag object of the text control.

[0294] As shown in Figure 9B In the case that the control 1 is a text control, the view Figure 11 may include a top view (decorview) 1101 and a text view (textview) 1103, wherein the top view 1101 can include a text drag module (textdragEx) 1101b. The view Figure 11 The specific process of acquiring drag data of a text control and generating a drag object of the text control can include the following steps:

[0295] S901b, when the view Figure 11 When the type of the control 1 is determined as a text control, the text drag module 1101b creates an empty drag object, and the type of the drag object is a text control.

[0296] When the control 1 is determined as a text control, the text drag module 1101b can create an empty drag object based on the type of the control 1, and the type of the drag object is a text control.

[0297] S902b, the text drag module 1101b obtains the drag data of the control 1 from the text view 1103, including the text of the control 1.

[0298] S903b, the text drag module 1101b fills the drag data of the control 1 into the empty drag object, and generates the drag object of the control 1.

[0299] In this way, when the long press drag operation of the user on the text control is detected, the drag response of the text view 1103 can be called to obtain the text of the text control and generate the drag object of the text control.

[0300] Figure 9C A specific process of obtaining the drag data of a web view control and generating the drag object of the web view control is shown.

[0301] As Figure 9C shown, when the control 1 is a web view control, the view Figure 11 may include a top view (decor view) 1101 and a web view (web view) 1104, wherein the top view 1101 can include a web drag module (webdragEx) 1101c. The view Figure 11 The specific process of obtaining the drag data of the web view control and generating the drag object of the web view control can include the following steps:

[0302] S901c, when the view Figure 11 When the type of the control 1 is determined as a web view control, the web drag module 1101c creates an empty drag object, and the type of the drag object is a web view control.

[0303] When the control 1 is determined as a web view control, the web drag module 1101c can create an empty drag object based on the type of the control 1, and the type of the drag object is a web view control.

[0304] S902c, the web drag module 1101c obtains the drag data of the control 1 from the web view 1104, including the picture and hyperlink of the control 1.

[0305] In some embodiments, the drag data of the control 1 can also include the text in the control 1.

[0306] In some other embodiments, the drag data of the control 1 can also only include the picture of the control 1, i.e., the web view control is transmitted as a picture.

[0307] S903c, the web page drag module 1101c fills the drag data of the control 1 into the empty drag object to generate the drag object of the control 1.

[0308] In this way, when detecting the long press drag operation of the user on the web view control, the drag response of the web view 1104 can be invoked to obtain the drag data of the web view control and generate the drag object of the web view control.

[0309] In a possible implementation, the view Figure 11 When detecting the operation 1 of the user on the control 1, the type and the drag data of the control 1 can be obtained, and the drag object of the control 1 can be generated based on the type and the drag data of the control 1. In some embodiments, the operation 1 can be one operation, such as a long press drag operation. In some other embodiments, the operation 1 can also be a combined operation, including a long press operation and a drag operation.

[0310] In some embodiments, in the case that there is native logic of the user on the control 1, the top view 1101 can determine the execution logic of the next step by detecting whether there is a drag operation on the control 1. The native logic of the control 1 refers to the event response performed by the electronic device 100 in response to the long press operation of the user on the control 1 in the case that the method of the present application is not implemented.

[0311] Figure 10 A schematic diagram of the top view 1101 determining the execution logic based on the drag operation of the user in the embodiments of the present application is shown.

[0312] As Figure 10 As shown, when receiving the touch or long press operation of the user on the control 1, the top view 1101 can trigger the drag behavior detection to detect whether there is a drag operation of the user on the control 1 after the touch or long press operation.

[0313] If the drag operation of the user on the control 1 is detected, the top view 1101 can invoke the drag response of the corresponding view module (such as a graphic view, a text view, a web view, a custom control view, etc.) to perform the data transmission method provided by the embodiments of the present application to transmit the drag data of the control 1 to the transfer station.

[0314] If no drag operation by the user on control 1 is detected, the top-level view 1101 can trigger the event dispatch process, and call the corresponding view module to execute the original event response based on the native logic of control 1, such as displaying the web page view corresponding to control 1.

[0315] The top-level view 1101 can set the time period for drag behavior detection, that is, within a preset time period, it determines whether to execute the data transmission method provided in this application based on whether the user's drag operation on control 1 is detected.

[0316] In some embodiments, the top-level view 1101 can also determine whether to trigger drag behavior detection by detecting the duration of the long press operation. For example, if the duration of the long press operation reaches a preset time (e.g., 1.5 seconds), drag behavior detection is triggered. If the duration of the long press operation does not reach the preset time, an event dispatch process is triggered.

[0317] In some embodiments, control 1 can also be a developer-defined control (also called a custom control), such as a custom text control. The transit station 13 may also include accessibility services. When control 1 is a custom text control, it is considered... Figure 11 Unable to retrieve the text of control 1 from textview 1103. In this case, transfer station 13 can activate the accessibility service to retrieve the text of control 1.

[0318] Figure 11 This paper illustrates a specific process for transmitting data of control 1 in application 1 to relay station 13 when control 1 is a custom text control.

[0319] like Figure 11 As shown, the electronic device 100 may include a view 11, a drag-and-drop frame 12, and a transfer station 13. The transfer station 13 may include an accessibility service 1301. When control 1 is a custom text control, a specific process for transferring data of control 1 in application 1 to the transfer station 13, as provided in this embodiment, may include the following steps:

[0320] S1101, View Figure 11 The user's action 1 on control 1 in application 1 was detected, and the type of control 1 was determined to be a custom text type.

[0321] When the interface of application 1 is displayed, and the interface includes control 1, the view Figure 11 The system can detect user action 1 on control 1 in application 1 and determine the type of control 1. Action 1 can be a single action, such as a long press and drag operation, or a combination of actions, such as including both a long press and a drag operation. If action 1 includes both a long press and a drag operation, then...Figure 11 The type of the control 1 can also be determined in response to the long-press operation, and the following step S1102 can be performed, and the following step S1103 and subsequent steps can be performed when the drag operation is detected.

[0322] The type of the control 1 can be determined according to the visual effect of the control 1. Figure 11 One or more custom text types, such as type A, type B, type C, and the like, can be stored in the visual effect. Figure 11 When the type of the control 1 is determined to be the same as one of the custom text types stored in the visual effect, the type of the control 1 can be determined to be the custom text type. Figure 11

[0323] S1102, the empty drag object can be created, and the type of the drag object can be the custom text control. Figure 11 The type of the control 1 can be indicated by the empty drag object.

[0324] The type of the control 1 can be indicated by the empty drag object.

[0325] S1103, the image of the control 1 can be obtained. Figure 11 The image of the control 1 refers to the image displayed by the control 1 on the interface.

[0326] The image of the control 1 refers to the image displayed by the control 1 on the interface.

[0327] S1104, the drag instruction can be sent to the drag framework 12, and the drag instruction can include the empty drag object and the image of the control 1. Figure 11 The type of the control 1 can be indicated by the empty drag object, and the drag framework 12 can be instructed to send the accessibility service start instruction to the relay station 13.

[0328] In some embodiments, the empty drag object in the drag instruction can also be replaced by the type of the control 1, i.e., the custom text type, to instruct the drag framework 12 to send the accessibility service start instruction to the relay station 13.

[0329] In some embodiments, the empty drag object in the drag instruction can also be replaced by the type of the control 1, i.e., the custom text type, to instruct the drag framework 12 to send the accessibility service start instruction to the relay station 13.

[0330] S1105, the drag framework 12 can send the accessibility service start instruction to the relay station 13 to instruct the relay station to start the accessibility service.

[0331] Step S1105 is an optional step. After receiving the drag instruction, the drag framework 12 can detect whether the accessibility service is started. If the accessibility service is not started, the accessibility service start instruction is sent to the relay station 13; if the accessibility service is already started, the following step S1110 and subsequent steps can be performed.

[0332] ​In some embodiments, if the drag framework 12 detects that the relay station 13 is not started, the drag framework 12 can pull up the relay station, and details can be referred to steps S806 to S807 described above, which will not be repeated here.

[0333] S1106, the relay station 13 sends an opening instruction to the barrier-free service 1301, which is used to instruct to open the barrier-free service.

[0334] The opening instruction can include operation 1, such as a long press drag operation. The opening instruction can be used to instruct the barrier-free service 1301 to register a monitoring event, and the event is a long press operation or a long press drag operation of the user on the electronic device 100.

[0335] S1107, the barrier-free service 1301 registers the monitoring event.

[0336] After the barrier-free service 1301 is started, the monitoring event can be registered to monitor operation 1 of the user on the electronic device 100, such as a long press drag operation, or a long press operation. After registering the monitoring event, when the view Figure 11 When operation 1 on the control 1 is detected, the barrier-free service 1301 can send a drag instruction to the drag framework 12 through the view Figure 11 The image of the control 1 is obtained, and the text of the control 1 is analyzed based on the image of the control 1.

[0337] S1108, the view Figure 8 When operation 1 of the user on the control 1 is detected, a drag instruction is sent to the drag framework 12.

[0338] The drag instruction includes an empty drag object and an image of the control 1.

[0339] S1109, the drag framework 12 draws and displays a drag layer of the control 1 and a drag track based on the image of the control 1.

[0340] S1110, the drag framework 12 sends a text acquisition instruction to the relay station 13, and the text acquisition instruction includes an empty drag object and an image of the control 1.

[0341] The empty drag object is used to prompt that the type of the control 1 is a custom text type, and can also be used to instruct the relay station 13 to acquire the text of the control 1 based on the image of the control 1. In some embodiments, the empty drag object in the text acquisition instruction can also be replaced by the type of the control 1, that is, the custom text type, to instruct the relay station 13 to acquire the text of the control 1 based on the image of the control 1.

[0342] S1111, the relay station 13 sends a text acquisition request to the barrier-free service 1301, which is used to request to acquire the text of the control 1.

[0343] The text acquisition request can include the image of the control 1.

[0344] S1112, the accessibility service 1301 sends the text of the control 1 to the relay station 13.

[0345] The accessibility service 1301 can call the accessibility framework to analyze the text of the control 1 based on the image of the control 1, and send the text of the control 1 to the relay station 13.

[0346] S1113, the relay station 13 generates the thumbnail of the control 1 based on the text of the control 1.

[0347] The relay station 13 can generate the thumbnail based on the text of the control 1, and in some embodiments, the relay station 13 can also generate the text thumbnail based on the type of the control 1, etc.

[0348] After the relay station 13 generates the thumbnail based on the text of the control 1, the relay station 13 can also store the correspondence between the thumbnail, the text content and the type of the control (custom text control). The specific storage manner can refer to the related content in the above step S811, which will not be described here. In other embodiments, the relay station 13 can also generate the drag object of the control 1 based on the text of the control 1 and the empty drag object, and store the correspondence between the thumbnail of the control 1 and the drag object. Figure 12

[0349] S1114, when the user drags the drag layer to the area where the relay station icon is located, and detects the release operation of the user in the area, displaying the thumbnail of the control 1 on the relay station icon.

[0350] S1115, when the relay station 13 detects that the closing condition is met, sending a closing instruction to the accessibility service 1301, for instructing to close the accessibility service.

[0351] Steps S1115 and S1116 are optional steps.

[0352] The closing condition can include any one or more of the following: detecting that the accessibility service is not used within a preset time period, receiving an operation of the user to close the accessibility service, etc.

[0353] In some embodiments, the accessibility service can also not be closed.

[0354] S1116, the accessibility service 1301 ends the monitoring event.

[0355] After receiving the closing instruction, the accessibility service 1301 can end the monitoring event and stop monitoring the operation 1.

[0356] By using the data transmission method provided in the embodiments of the present application, the text of the custom text control can be obtained by the accessibility service, and the text of the custom text control can be transmitted to the relay station.​

[0357] In some embodiments, the data in the transfer station 13 can also be transmitted to other applications.

[0358] Figure 12 A specific process of transmitting the data in the transfer station 13 to the application 2 is shown.

[0359] As shown in Figure 8 , the electronic device 100 can include the application 2, the drag framework 12, and the transfer station 13. The specific process of transmitting the data in the transfer station 13 to the application 2 can include the following steps:

[0360] S1201, the transfer station 13 displays one or more thumbnails on the interface of the application 2, including the thumbnail 1.

[0361] According to the above Figure 3I , after the control 1 of the application 1 is dragged into the transfer station 13, the transfer station 13 stores one or more thumbnails of the controls and the corresponding drag objects.

[0362] In the case that the electronic device 100 displays the interface of the application 2, the transfer station 13 can display the one or more thumbnails in the interface of the application 2. The one or more thumbnails can include the thumbnail 1.

[0363] For example, the interface of the application 2 can be the document editing interface 310 shown in the above Figure 3I , and the one or more thumbnails can be one or more thumbnails displayed in the transfer station sidebar 320, i.e., the thumbnail 321, the thumbnail 322, and the thumbnail 323, and the thumbnail 1 can be the thumbnail 321. Figure 2K

[0364] For another example, the interface of the application 2 can also be the image-text editing interface 240 shown in the above Figure 2K , and the thumbnail 1 can be the thumbnail 242 shown in the above Figure 3I .

[0365] It should be noted that the display size of the thumbnail displayed in step S1201 can be the same as the display size of the thumbnail in step S810, or can be different.

[0366] S1202, the transfer station 13 receives and responds to the operation 2 of the user on the thumbnail 1 to determine the drag object 1 corresponding to the thumbnail 1.

[0367] The operation 2 can be a long press drag operation.

[0368] The operation 2 of the user on the thumbnail 1 can be the operation 2 of the user on the thumbnail 1 shown in the above Figure 2K .The long press and drag operation of the user on the thumbnail 321 in the illustrated embodiment can also be the long press and drag operation of the user on the thumbnail 321 in the above Figure 3I The long press and drag operation of the user on the transit station icon 241 (the thumbnail 242 is displayed in the transit station icon 241) in the illustrated embodiment.

[0369] When the object of the operation 2 is determined to include the thumbnail 1, the transit station 13 can determine, based on the stored relationship between the thumbnail and the drag object, that the thumbnail 1 corresponds to the drag object 1.

[0370] S1203, the transit station 13 sends a drag instruction to the drag framework 12, including the drag object 1.

[0371] The drag instruction is used to initiate the drag to the drag framework 12.

[0372] S1204, the drag framework 12 displays a drag layer and a drag track on the interface of the application 2 based on the drag object 1.

[0373] After receiving the drag object 1, the drag framework 12 can draw and display the drag layer and the drag track based on the drag object 1.

[0374] In some embodiments, the display content of the drag layer can be the same as the display content of the thumbnail 1. For example, if the thumbnail 1 is the thumbnail 321 shown in the above Figure 3J , the drag layer can be the thumbnail 321 shown in the above Figure 4I . If the thumbnail 1 is the thumbnail 421 shown in the above Figure 4J , the drag layer can be the thumbnail 421 shown in the above ​ .

[0375] In other embodiments, if the object of the long press and drag operation of the user is a transit station icon, the drag layer can be the transit station icon. For example, if the thumbnail 1 is the thumbnail 242 in the transit station icon 241 shown in the above Figure 2K , the drag layer can be the transit station icon 241 shown in the above Figure 2L .

[0376] The drag track can be drawn and displayed based on the track of the user's drag operation.

[0377] S1205, the drag framework 12 sends the drag object 1 to the application 2 in response to the release operation of the user.

[0378] S1206, the application 2 displays a control on the interface of the application 2 based on the drag object 1.

[0379] After receiving the drag object 1, the application 2 can draw and display a control on the interface of the application 2 based on the drag object 1. If the drag object 1 is of a picture type, the control can be a picture control, and the picture of the picture control is the picture in the drag object 1; if the drag object 1 is of a text type, the control can be a text control, and the text of the text control is the text in the drag object 1; if the drag object 1 is of a web view control type, the control can be a web view control, and the web view control can include the picture and the hyperlink in the drag object 1.

[0380] For example, the interface of the application 2 can be the picture-text editing interface 240 shown in FIG. 2B, the control displayed based on the drag object 1 can include the picture control 243 and the picture control 244; the interface of the application 2 can be the document editing interface 310, the control displayed based on the drag object 1 can be the text control 315; the interface of the application 2 can be the chat interface 410 shown in FIG. 4A, the control displayed based on the drag object 1 can be the web view control 414 shown in FIG. 4B. Figure 2M Figure 4K Figure 4K

[0381] By using the data transmission method provided in the embodiments of the present application, the data in the transit station can be transmitted to other applications. In this way, the data in one application can be transmitted to another application through the transit station, and the operation steps are simple and efficient, and the three-party application adaptation is not needed.

[0382] In some embodiments, the electronic device 100 can also have a drag mode, in which the electronic device 100 can use the data transmission method provided in the embodiments of the present application to simultaneously transmit multiple controls in the application 1 to the application 2 through the transit station.

[0383] Figure 13 FIG. 6 shows a flowchart of a method for simultaneously dragging multiple controls by using a data transmission method according to an embodiment of the present application.

[0384] As shown in FIG. 6, the electronic device 100 can include an application 1, an application 2, a drag framework 12, a window management service 14, and a system UI 15. In a case where the electronic device 100 displays an interface 1 of the application 1, the specific flow of the method for simultaneously dragging multiple controls by using a data transmission method can include the following steps. Figure 13 S1301, the window management service 14 sends drag data of all draggable controls in the interface 1 to the system UI 15, the drag data including any one or more of a picture, a text, and a hyperlink.

[0385]

[0386] ​​​​The dragable controls in interface 1 can include any one or more of a picture control, a text control, and a webview control. The drag data of each control can include any one or more of a picture, a text, and a hyperlink. For example, the drag data of a picture control can include the picture of the picture control, the drag data of a text control can include the text of the text control, and the drag data of a webview control can include the hyperlink and the picture of the webview control, and optionally, the text in the webview control. For example, interface 1 can be the group chat interface 220 shown in FIG. 2A, in which case the dragable controls in interface 1 can include the picture control 221, the picture control 222, and the text control 223 shown in FIG. 2A. Figure 5A Figure 5A

[0387] When sending the drag data of a control to the system interface 15, the identifier of the control is also carried, which is used to identify the control and also to identify the drag data belonging to the same control. The identifier of the control can include any one or more of an identifier (id), a name (name), a link text (LinkText), a class (class), CSS information, Xpath information, and the like.

[0388] In S1302, the system interface 15 receives and stores the drag data of all the dragable controls in interface 1.

[0389] After receiving the drag data of all the dragable controls in interface 1, the system interface 15 can store the correspondence between the identifier of each control and the drag data of the control in interface 1. For example, Table 3 shows the correspondence between the identifier of a control and the drag data of the control stored in the system interface 15.

[0390] Table 3

[0391] Identity of control Type Drag data Control 1 Picture control Picture f Control 2 Text control Text b Control 3 Web view control Picture g, hyperlink d

[0392] As shown in Table 3, the system interface 15 can store the correspondence between the identifier of one or more controls and the drag data of the control, and optionally, the correspondence between the identifier of the one or more controls and the type of the control. According to Table 3, the control with identifier 1 is a picture control, and the drag data is a picture f; the control with identifier 2 is a text control, and the drag data is a text b; and the control with identifier 3 is a webview control, and the drag data is a picture g and a hyperlink d.

[0393] It can be understood that the embodiment shown in Table 3 is only an example, and in the embodiments of the present application, the system interface 15 can also store more or less data, or store different content from the embodiment shown in Table 3, which is not limited in the present application. ​​

[0394] S1303, the system interface 15 receives and responds to the operation 3 of the user, and displays a drag mode interface, the drag mode interface including all the draggable controls in the interface 1.

[0395] The operation 3 is used to trigger the start of the drag mode. The operation 3 can be a sliding operation in an L-shaped track on the display screen starting from the edge of the display screen, or a sliding operation in a left or upward direction from the edge of the display screen and a long press operation after the sliding operation, or other custom operation gestures, which are not limited herein.

[0396] The drag mode interface can include all the draggable controls in the interface 1. The system interface 15 can display the drag mode interface based on the drag data of all the draggable controls in the interface 1 obtained in step S1301. For example, the drag interface can be the drag mode interface 500 shown in the above Figure 5B

[0397] S1304, the application 1 receives and responds to the operation 4 of the user on the drag mode interface, and determines a coordinate 1 of the position of the operation 4 in the drag mode interface.

[0398] The operation 4 can be a click operation of the user on any point on the drag mode interface, such as the click operation of the user on the picture control 221 in the above Figure 5B

[0399] The coordinate 1 is used to indicate the position of the operation 4 in the drag mode interface.

[0400] S1305, the application 1 sends the coordinate 1 to the drag framework 12.

[0401] After determining the coordinate 1, the application 1 can send the coordinate 1 to the drag framework 12.

[0402] S1306, the drag framework 12 judges whether there is a draggable control displayed at the position indicated by the coordinate 1.

[0403] After receiving the coordinate 1, the drag framework can judge whether there is a draggable control displayed at the position in the drag mode interface indicated by the coordinate 1.

[0404] If there is a draggable control displayed at the position indicated by the coordinate 1, the drag framework 12 executes the following step S1307 to mark the control.

[0405] If there is no draggable control displayed at the position indicated by the coordinate 1, the drag framework 12 executes the following step S1308 to determine that the operation object of this operation 4 is empty. ​​

[0406] S1307, the drag framework 12 marks the control.

[0407] If the position indicated by the coordinate 1 displays a draggable control, the drag framework 12 determines that the operation object of the operation 4 is the draggable control, and then the drag framework 12 can mark the control.

[0408] In some embodiments, the drag framework 12 can also display a selected mark on the control in the drag mode interface. The selected mark can be the mark in the selection identifier 502 as shown in the above embodiment, or other shapes of patterns. In addition, in some embodiments, the selected mark can also be that the control adopts different display colors, different display brightness, etc. For example, the above embodiment, which will not be limited herein by the application. Figure 5C Figure 5H

[0409] S1308, the drag framework 12 determines that the operation object is empty.

[0410] It should be noted that in the embodiments of the application, the steps S1304 to S1308 are repeatable steps, and the number of repeated times is the same as the number of operations 4 of the user to the drag mode interface.

[0411] S1309, the application 1 receives and responds to the operation 5 of the user to the drag mode interface, and sends a drag instruction to the drag framework 12.

[0412] The operation 5 can be a long press drag operation of the user to any point on the drag mode interface.

[0413] The drag instruction can be used to instruct the drag framework 12 to drag all the marked controls.

[0414] S1310, the drag framework 12 sends an acquisition request to the system interface 15, to request to acquire the drag data of the marked control.

[0415] The acquisition request can include the identifier of the marked control. The marked control can include one or more controls, and the identifier of the marked control can include the identifier of the one or more controls.

[0416] S1311, the system interface 15 sends the drag data of the marked control to the drag framework 12.

[0417] After receiving the acquisition request, the system interface 15 can determine the drag data of the marked control from the stored drag data of the plurality of draggable controls based on the identifier of the marked control in the acquisition request, and send the drag data of the marked control to the drag framework 12.

[0418] ​​S1312, the drag framework 12 receives and stores the drag data of the marked controls.

[0419] After receiving the drag data of the marked controls, the drag framework 12 can store the correspondence between the identification of each control in the marked controls and the drag data. The specific storage manner can refer to the content in the embodiment shown in Table 3 described above, which will not be repeated here. Wherein, the drag framework 12 stores the correspondence between the identification of each control in the marked controls and the drag data, which can be stored by the drag framework 12, and in other embodiments, it can also be sent to the relay station 13 by the drag framework 12 and stored by the relay station 13. The specific operation steps can refer to the related steps in the above Figures 8-12 .

[0420] S1313, the drag framework 12 receives and responds to the operation 6 of the user, and sends the drag data of the controls 1 stored in the drag framework 12 to the application 2.

[0421] Operation 6 is used to send the drag data of the controls 1 stored in the drag framework 12 (or the relay station 13) to the application 2.

[0422] In some embodiments, operation 6 can be a long press drag operation on the relay station icon, or a long press drag operation on the thumbnail in the side bar of the relay station, for example, the long press drag operation on the thumbnail 321 in the embodiment described above Figure 3I , or the long press drag operation on the thumbnail 421 in the embodiment described above Figure 4I , and the like.

[0423] S1314, the system interface 15 receives and responds to the operation 7 of the user, and closes the display drag mode interface.

[0424] Operation 7 is used to exit the drag mode and close the display drag mode interface. Operation 7 can be a click operation on any point on the drag mode interface 500, or a click operation on the area of the drag mode interface 500 where no dragable control is displayed, in the embodiment described above Figure 5E . In some embodiments, operation 7 can also be other gestures or custom gesture operations, and the like, which are not limited in the present application.

[0425] In this way, after starting the drag mode, multiple controls in the application 1 can be transmitted to the application 2 through the drag framework 12 (or through the drag framework 12 and the relay station 13). The operation is simple and improves the efficiency of dragging multiple controls.

[0426] It should be noted that after the drag mode is opened, the transfer station icon can be displayed in the drag mode interface, the drag layer and the drag track can also be displayed during the dragging, and the drag data of the marked control can be sent to the transfer station 13, the drag data of the marked control is stored by the transfer station 13, and the thumbnail is displayed on the transfer station icon. For specific steps, please refer to the above Figure 8 The related steps in the embodiment shown in the above are not repeated here.

[0427] Figure 14 A flowchart of a method for dragging an interface element including multiple controls is shown.

[0428] As Figure 14 shown, the electronic device 100 can include an application 1, an application 2, a drag framework 12, a window management service 14, and a system interface 15. In a case where the electronic device 100 displays an interface 1 of the application 1, and the interface 1 displays an interface element 1 including multiple controls, a specific flow of the method for dragging the interface element including multiple controls can include the following steps:

[0429] S1401, the application 1 sends registration information of the interface element 1 in the interface 1 to the drag framework 12, including multiple control identifiers in the interface element 1, arrangement layout information of the multiple controls, and drag data of each control.

[0430] Wherein, the identifier of the control, the drag data of the control can refer to the above Figure 13 related description of the drag data in step S1301. The arrangement layout information of the multiple controls in the interface element 1 can be the relative position relationship of the multiple controls, or the coordinate information of each control in the multiple controls in the same coordinate system. The coordinate system can be a two-dimensional coordinate system constructed on the interface 1 with any point on the interface 1 as the origin. In some embodiments, the arrangement layout information of the multiple controls can also be other information that can be used to indicate the positional relationship of the multiple controls in the interface element 1, which is not limited in the present application.

[0431] In some embodiments, the application 1 can send the registration information of the interface element 1 to the drag framework 12 when it is detected that the interface 1 currently displayed includes the interface element 1 including multiple controls. In other embodiments, the application 1 can also receive and respond to a preset specific operation to send the registration information of the interface element 1 to the drag framework 12. It can be understood that if there is still one or more interface elements including multiple controls in the interface 1, the application 1 can also send the registration information of the one or more interface elements to the drag framework 12, which is not limited in the present application.

[0432] S1402, the drag framework 12 receives and stores the registration information of the interface element 1.

[0433] The drag framework 12 can store the registration information of the interface element 1. For example, Table 4 shows the registration information of the interface element 1 stored in the drag framework 12.

[0434] Table 4

[0435] Identity of control Type Drag data Arrangement layout information Control 1 Picture control Picture f Top left Control 2 Text control Text b Bottom Control 4 Picture control Picture h Top right

[0436] As shown in Table 4, the registration information of the interface element 1 stored in the drag framework can include the correspondence between the identification of the plurality of controls, the drag data, and the arrangement layout information, and optionally, the type of the plurality of controls.

[0437] According to Table 4, the interface element 1 can include three controls, the identification of the three controls are control 1, control 2 and control 4, wherein the control with the identification of control 1 is a picture control, the drag data is picture f, and the control is located at the top left corner of the interface element 1; the control with the identification of control 2 is a text control, the drag data is text b, and the control is located at the top right corner of the interface element 1; the control with the identification of control 4 is a picture control, the drag data is picture h, and the control is located at the lower part of the interface element 1.

[0438] It can be understood that the embodiment shown in Table 4 is only an example, and in the embodiments of the present application, the registration information of the interface element 1 can also include more or less data, and different content from the embodiment shown in Table 4 can also be stored, which is not limited herein.

[0439] S1403, the window manager service 14 sends the drag data of all the draggable controls in the interface 1 to the system UI 15, the drag data including any one or more of pictures, texts, hyperlinks.

[0440] S1404, the system UI 15 receives and stores the drag data of all the draggable controls in the interface 1.

[0441] S1405, the system UI 15 receives and responds to the operation 3 of the user starting the drag mode, and displays the drag mode interface, the drag mode interface including all the draggable controls in the interface 1.

[0442] S1406, the application 1 receives and responds to the operation 4 of the user on the drag mode interface, and determines the coordinates 1 of the position of the operation 4 in the drag mode interface.

[0443] S1407, the application 1 sends the coordinates 1 to the drag framework 12.

[0444] The specific contents of steps S1403 to S1407 can refer to the related contents in steps S1301 to S1305 in the above embodiment, which will not be repeated here. Figure 13

[0445] S1408, the drag framework 12 judges whether the position indicated by the coordinate 1 displays a controllable control.

[0446] If the position indicated by the coordinate 1 displays a controllable control, the drag framework 12 executes the following step S1409, and marks the control.

[0447] If the position indicated by the coordinate 1 does not display a controllable control, the drag framework 12 executes the following step S1412, and determines that the operation object of the operation 4 is empty.

[0448] S1409, the drag framework 12 judges whether the control belongs to the interface element 1 based on the registration information of the interface element 1.

[0449] If the control belongs to the interface element 1, the drag framework 12 executes the following step S1410.

[0450] If the control does not belong to the interface element 1, the drag framework 12 executes the following step S1411.

[0451] S1410, the drag framework 12 marks the interface element 1.

[0452] S1411, the drag framework 12 marks the control.

[0453] S1412, the drag framework 12 determines that the operation object is empty.

[0454] It should be noted that in the embodiment of the present application, steps S1405 to S1412 are repeatable steps, and the number of repeated times is the same as the number of operations 4 of the user to the drag mode interface.

[0455] S1413, the application 1 receives and responds to the operation 5 of the user to the drag mode interface, and sends a drag instruction to the drag framework 12.

[0456] S1414, the drag framework 12 sends an acquisition request to the system interface 15, for requesting to acquire the drag data of the marked control.

[0457] S1415, the system interface 15 sends the drag data of the marked control to the drag framework 12.

[0458] ​It should be noted that steps S1414 to S1415 are optional steps. If there is no tagged control other than interface element 1, the two steps do not need to be performed; if there are other tagged controls other than interface element 1, the drag data of the tagged controls can be obtained by performing the two steps.

[0459] S1416, the drag framework 12 receives and stores the drag data of the tagged control.

[0460] S1417, the drag framework 12 receives and responds to the operation 8 of the user, and sends the registration information of the interface element 1 stored in the drag framework 12 to the application 2.

[0461] The operation 8 is used to send the registration information of the interface element 1 to the application 2.

[0462] In some embodiments, the operation 8 can be a long press drag operation on the transit station icon, or a long press drag operation on the thumbnail in the transit station sidebar, for example, the long press drag operation on the thumbnail 652 in the embodiment described above with reference to FIG. 6, or the long press drag operation on the thumbnail 742 in the embodiment described above with reference to FIG. 7, and the like. Figure 6K Figure 7K The other specific contents of steps S1411 to S1418 can refer to the related descriptions in steps S1307 to S1314 in the embodiment described above with reference to FIG. 6, which will not be described here.

[0463] S1418, the system interface 15 receives and responds to the operation 7 of the user, and closes the display drag mode interface.

[0464] The other specific contents of steps S1411 to S1418 can refer to the related descriptions in steps S1307 to S1314 in the embodiment described above with reference to FIG. 6, which will not be described here. Figure 13

[0465] The following describes a software architecture of an electronic device 100 provided in an embodiment of the present application.

[0466] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate with each other through software interfaces. The embodiment of the present application illustrates the software structure of the electronic device 100 in combination with Figure 15A

[0467] As shown in FIG. 8, the electronic device 100 can include an application layer, a framework layer, a dynamic library, and a kernel layer. Figure 15A

[0468] ​​​​The application layer may include a series of application packages. This series of application packages may include self-developed applications, such as gallery applications, or third-party applications, such as social applications. The application layer may also include a transit station. In some embodiments, the transit station may include accessibility services. In some embodiments, the application layer may also include a system UI, which can be used to display a drag-and-drop interface.

[0469] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The framework layer can include activities, services, views, and system services. Views can include a top-level view (decorview) and one or more view modules of different types, such as imageviews, webviews, and textviews. The top-level view can also include multiple different types of drag-and-drop modules, as detailed below. Figure 15B The description in the illustrated embodiment is as follows. System services may include a drag-and-drop framework, an Activity Manager Service (AMS), and a Windows Manager Service (WMS). The WMS is used to manage window programs. The window manager can obtain the screen size, determine if a status bar is present, lock the screen, capture the screen, etc. Views can be used to build applications. The display interface can consist of one or more views. For example, a display interface including a text message notification icon may include a view displaying text and a view displaying images. In some embodiments, the framework layer may also include an accessibility framework, which can monitor events, obtain text, and send the obtained text to the accessibility service.

[0470] Dynamic libraries can include graphics processing libraries (such as OpenGL), graphics libraries (such as Skia), service managers, and databases (such as SQL), etc.

[0471] The kernel layer is the layer between hardware and software. The kernel layer can contain one or more drivers, such as Bluetooth drivers, Wi-Fi drivers, binder drivers, audio drivers, etc.

[0472] exist Figure 15A In the illustrated embodiments, both self-developed applications and third-party applications can act as data transmission senders, such as application 1 in the above embodiments, and can also act as data transmission receivers, such as application 2 in the above embodiments. The view can be as described above.Figures 8-12 View in the illustrated embodiment Figure 11 The top-level view can be the top-level view 1101 in the above embodiments; the graphics view can be the graphics view 1102 in the above embodiments; the text view can be the text view 1103 in the above embodiments; and the webpage view can be the webpage view 1104 in the above embodiments. The drag-and-drop frame can be the drag-and-drop frame 12 in the above embodiments; the transfer station can be the transfer station 13 in the above embodiments; and the system interface can be the system interface 15 in the above embodiments. The functions of the above modules can be referred to the above. Figures 8-12 The relevant descriptions in the illustrated embodiments will not be repeated here.

[0473] It is understandable that the above Figure 15A The illustrated embodiment is merely an example; in some embodiments, the electronic device 100 may also include components beyond those described above. Figure 15A The embodiments shown may have more or fewer modules, which is not limited herein.

[0474] Figure 15B A schematic diagram of the top-level view 1101 (decorview) is shown.

[0475] like Figure 15B As shown, the top-level view 1101 may include a drag-and-drop capability module (dragEx) 1101d, which may include one or more drag-and-drop modules of different types, such as an image drag-and-drop module (imagedragEx) 1101a, a text drag-and-drop module (textdragEx) 1101b, a web page drag-and-drop module (webdragEx) 1101c, etc.

[0476] Among them, the graphic drag-and-drop module 1101a can create drag-and-drop objects of image type and can obtain data such as images from image controls; the text drag-and-drop module 1101b can create drag-and-drop objects of text type and can obtain data such as text from text controls; the web page drag-and-drop module 1101c can create drag-and-drop objects of web page view control type and can obtain data such as hyperlinks, images, and text from web page view controls.

[0477] It is understandable that the above Figure 15B The illustrated embodiment is merely an example; in some embodiments, the top-level view 1101 may also include more than those described above. Figure 15B The embodiments shown may have more or fewer modules, which is not limited herein.

[0478] In some application scenarios, the data transmission method provided in the embodiments of this application can also be used to transmit data from electronic device 100 to another electronic device.

[0479] For example,Figure 16 A schematic diagram of the structure of a data transmission system 10 provided in an embodiment of this application is shown.

[0480] like Figure 16 As shown, the data transmission system 10 may include electronic device 1000, electronic device 2000, and server 3000. Electronic device 1000 may include application 3, view 1001, drag-and-drop frame 1002, and relay station 1003; electronic device 2000 may include application 4, view 2001, drag-and-drop frame 2002, and relay station 2003. A communication connection is established between electronic device 1000 and server 3000, and a communication connection is established between electronic device 2000 and server 3000. Electronic devices 1000 and 2000 have the same user identifier; for example, electronic devices 1000 and 2000 can log in to the same account, etc. The user identifier may include the user's ID, account, or other identifiers used to identify the user.

[0481] In the data transmission system 10, the electronic device 1000 can, upon detecting a user's operation 1 on the control 1, use the aforementioned methods through the view 1001 and drag frame 1002. Figure 8 Figure 9 Figures 11-14 In any embodiment, the draggable object (or drag type and drag data) of control 1 in application 3 is transmitted to and stored in transfer station 1003. Electronic device 1000 can upload the draggable object of control 1 stored in the transfer station to server 3000. At the same time, electronic device 1000 can also send the user identifier to server 3000.

[0482] Server 3000 can receive the dragged object of control 1 sent by electronic device 1000, and store the dragged object of control 1 based on the user identifier sent by electronic device 1000.

[0483] Electronic device 2000 can retrieve the draggable object of control 1 from server 3000 based on the same user identifier as electronic device 1000, and store it in relay station 2003 of electronic device 2000. Subsequently, electronic device 2000 can also use the aforementioned methods through modules such as relay station 2003 and drag-and-drop frame 2002. Figure 12 The method shown transfers the dragged object of control 1 in the transfer station to application 2 on electronic device 2000.

[0484] It is understood that in some embodiments, electronic device 1000 and / or electronic device 2000 may further include a system interface module, which can perform the functions performed by system interface 15 in the above embodiments.

[0485] In this way, the cross-device transmission of the control can be realized through the relay station, and in combination with the embodiment of simultaneously dragging multiple controls, the data transmission method can also be applied to the scenario of mobile phone cloning.

[0486] It should be noted that, in Figure 16 the data transmission system shown in FIG. 13, the hardware structure and software architecture of the electronic device 1000 and the electronic device 2000 can refer to the hardware structure and software architecture of the electronic device 100 shown in the above embodiments, and the hardware structure of the server 3000 can refer to the embodiment shown in FIG. 12. Figure 1B

[0487] Figure 17 FIG. 14 shows a flowchart of a data transmission method provided by an embodiment of the present application.

[0488] As shown in Figure 17 , the specific flow of the data transmission method can include the following steps:

[0489] S1701, the first electronic device displays a first interface of a first application, and the first interface includes a first control.

[0490] The first electronic device can be the electronic device 100 in the above embodiments, the first application can be the application 1 in the above Figure 8 embodiments, and the first control can be the control 1 in the above Figure 8 embodiments.

[0491] S1702, the first electronic device receives a first operation of a user on the first control.

[0492] The first operation can be the long-press drag operation of the user on the control 1 in the above embodiments. In some embodiments, the first operation can also be a combination operation, for example, including a long-press operation and a drag operation on the control 1.

[0493] S1703, in response to the first operation, the first electronic device creates a first drag object through a view module, the first drag object is used to carry drag data of the first control, and the drag data includes any one or more of text, pictures and hyperlinks.

[0494] The view module can be the view 11 in the above embodiments, and the first drag object can be the drag object of the control 1 in the above Figures 8-9C embodiments.

[0495] In some embodiments, the first electronic device can also create the first drag object of the first control through other modules in the framework layer, which is not limited herein.

[0496] The specific content of the first electronic device creating the first drag object through the view module can refer to the above​Figure 8 the related content in steps S801 to S804 in the embodiment shown, and Figures 9A-9C the related content in steps S801 to S804 in the embodiment shown.

[0497] S1704, the first electronic device draws a first drag layer of the first control based on the first drag object through the drag framework, and the display content of the first drag layer is the same as the display content of the first control.

[0498] The drag framework can be the drag framework 12 in the above embodiment.

[0499] The first drag layer of the first control can be the drag layer of the control 1 in the above Figure 8 embodiment shown.

[0500] S1705, the first electronic device displays the transit station icon and the first drag layer.

[0501] After displaying the first drag layer, the first electronic device can also draw and display a drag track of the first drag layer based on the track of the user drag operation.

[0502] S1706, when the first drag layer moves to the transit station icon, the first electronic device stores the first drag object through the transit station.

[0503] The transit station can be the transit station 13 in the above embodiment.

[0504] The specific content of this step can refer to the step S811 in the above Figure 8 embodiment shown.

[0505] S1707, the first electronic device displays a first thumbnail of the first control in the transit station icon.

[0506] The first thumbnail of the first control can be the thumbnail of the control 1 in the above embodiment.

[0507] S1708, the first electronic device displays a second interface of a second application, and the second interface displays a transit station sidebar, and the transit station sidebar displays the first thumbnail.

[0508] The second application can be the application 2 in the above Figure 12 embodiment shown, and the second interface can be the interface 2 in the above Figure 12 embodiment shown.

[0509] S1709, the first electronic device receives a second operation of the user dragging the first thumbnail to the second interface.

[0510] The second operation can be the operation 2 for the thumbnail 1 in the above Figure 12 embodiment shown.

[0511] S1710, in response to the second operation, the first electronic device sends the first drag object to the second application through the relay station.

[0512] S1711, the first electronic device displays the first control in the second interface based on the first drag object through the second application.

[0513] The specific content of steps S1708 to S1711 can refer to the related content in the above-mentioned embodiments. Figure 12

[0514] In some embodiments, if the first control is a webview control, the first drag object can include a hyperlink of the first control. After the first electronic device displays the first control in the second interface based on the first drag object through the second application, the first electronic device can also receive and respond to a click operation of the user on the first control to display a third interface corresponding to the hyperlink. The third interface is the same as the interface displayed by the first electronic device triggered by the first control in the first interface.

[0515] In other embodiments, the first electronic device can also form a data transmission system with the second electronic device and the server to realize cross-device data transmission through the relay station. The second electronic device can be the electronic device 2000 in the above-mentioned embodiments, and the server can be the server 3000 in the above-mentioned embodiments. The specific functions of each electronic device and the server can refer to the data transmission system 10 in the above-mentioned embodiments. Figure 16

[0516] The embodiments of the present application can be combined in any way to achieve different technical effects.

[0517] ​​In the above embodiments, all or part of the processes can be implemented by software, hardware, firmware, or any combination thereof. When implemented by software, all or part of the processes can be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes described in the present application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium or transferred from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions can be transferred from one website, computer, server or data center to another website, computer, server or data center through wired (such as coaxial cable, optical fiber, digital subscriber line) or wireless (such as infrared, wireless, microwave, etc.) manner. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that includes one or more available media sets. The available media can be a magnetic medium (for example, a floppy disk, a hard disk, a magnetic tape), an optical medium (for example, a DVD), or a semiconductor medium (for example, a solid state disk (SSD)), etc.

[0518] Those of ordinary skill in the art can understand that all or part of the processes in the above embodiments can be implemented by a computer program to instruct the relevant hardware, and the program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the above embodiments. The storage medium includes ROM or random access memory (RAM), magnetic or optical disks, and various media that can store program codes.

[0519] In summary, the above only describes the embodiments of the technical scheme of the present application, and is not used to limit the protection scope of the present application. Any modification, equivalent replacement, improvement, etc. made according to the disclosure of the present application shall be included in the protection scope of the present application.

Claims

1. A data transmission method, characterized in that, Applied to a first electronic device, the method includes: Displaying a first interface of a first application, the first interface including a first control; Receive the user's first operation on the first control; In response to the first operation, a first drag-and-drop object is created. The first drag-and-drop object is used to carry the drag-and-drop data of the first control. The drag-and-drop data includes any one or more of text, images, and hyperlinks. A first draggable layer of the first control is generated based on the first draggable object, and the display content of the first draggable layer is the same as the display content of the first control. Move the first dragged layer to the location of the transfer station icon, and display the first thumbnail corresponding to the first dragged object at the location of the transfer station icon; Receive a second operation from the user, in which the first thumbnail is dragged and dropped into the second application; In response to the second operation, the first dragged object is sent to the second application.

2. The method according to claim 1, characterized in that, The second application and the first application are different applications.

3. The method according to claim 1 or 2, characterized in that, The method further includes: The second interface of the second application is displayed, and the second interface of the second application displays a transfer station sidebar, in which the first thumbnail is displayed.

4. The method according to claim 1 or 2, characterized in that, The method further includes: The second application displays the control corresponding to the first dragged object based on the first dragged object.

5. The method according to claim 1 or 2, characterized in that, Creating the first drag-and-drop object specifically includes: Obtain the type of the first control and the drag data of the first control; The first drag-and-drop object is generated based on the type of the first control and the drag-and-drop data of the first control, and the type of the first drag-and-drop object is the same as the type of the first control.

6. The method according to claim 1 or 2, characterized in that, The first interface of the first application is the interface of a chat application, and the first control is an image control, a text control, or a web page control.

7. The method according to claim 1 or 2, characterized in that, The dragged data is text, and the first control is a text control; or, the dragged data is an image, and the first control is an image control; or, the dragged data is a hyperlink, and the first control is a webpage control.

8. The method according to claim 1 or 2, characterized in that, The first interface of the first application is the interface of a chat application, and the first interface further includes a second control; Receive a second operation from the user on the first control and the second control; In response to the second operation, a first drag object and a second drag object are created respectively. The first drag object is used to carry the drag data of the first control and the second drag object is used to carry the drag data of the second control. The drag data of the first control and the drag data of the second control are of different types. A first draggable layer of the first control is generated based on the first draggable object, and the display content of the first draggable layer is the same as the display content of the first control. A second drag layer of the second control is generated based on the second drag object, and the display content of the second drag layer is the same as the display content of the second control. Move the first dragged layer and the second dragged layer to the position of the transfer station icon, and store the first dragged object and the second dragged object through the transfer station; The transfer station icon displays a first thumbnail corresponding to the first dragged object and a second thumbnail corresponding to the second dragged object.

9. The method according to claim 1 or 2, characterized in that, The first operation is a combined operation, and the first operation includes a third operation and a fourth operation; The step of creating a first drag-and-drop object in response to the first operation specifically includes: In response to the third operation, the type of the first control is obtained; An empty drag-and-drop object is created based on the type of the first control, wherein the type of the empty drag-and-drop object is the same as the type of the first control; In response to the fourth operation, the drag data of the first control is obtained; The first drag object is obtained by filling the drag data of the first control into the empty drag object.

10. The method according to claim 1 or 2, characterized in that, The first control is a webview control; the method further includes: In the first interface of the first application, a fifth operation by the user on the first control is received; In response to the fifth operation, the third interface is displayed; After the second application displays the first control based on the first dragged object, the method further includes: In the second interface of the second application, a sixth operation by the user on the first control is received; In response to the sixth operation, the third interface is displayed, and the fifth operation is the same as the sixth operation.

11. The method according to claim 1 or 2, characterized in that, The method further includes: After the first dragged layer is moved to the position of the transfer station icon, the transfer station stores the first dragged object.

12. The method according to claim 11, characterized in that, The transfer station stores the first dragged object, specifically including: The transfer station stores the first dragged object based on the correspondence between the first dragged object and the first thumbnail.

13. The method according to claim 11, characterized in that, The method further includes: In response to the first operation, obtain the image of the first control; The transfer station stores the first dragged object, specifically including: Get the text of the first control based on the image of the first control; The transfer station stores the text of the first control and the first drag-and-drop object based on the relationship between the first thumbnail and the text of the first control.

14. A data transmission system, characterized in that, Includes a first electronic device, a server, and a second electronic device; The first electronic device is used to display a first interface of a first application, the first interface including a first control; The first electronic device is also configured to receive a first operation by the user on the first control; The first electronic device is also configured to, in response to the first operation, create a first drag-and-drop object, the first drag-and-drop object being configured to carry drag-and-drop data of the first control, the drag-and-drop data including any one or more of text, images, and hyperlinks; The first electronic device is further configured to generate a first drag layer of the first control based on the first drag object, wherein the display content of the first drag layer is the same as the display content of the first control; The first electronic device is also used to move the first drag-and-drop layer to the location of the transfer station icon; The first electronic device is also used to send the first dragged object to the server via a relay station; The first electronic device is also used to display a first thumbnail corresponding to the first dragged object in the transfer station icon; The server is used to receive and store the first dragged object sent by the first electronic device; The second electronic device is used to obtain the first dragged object from the server through the relay station of the second electronic device; The second electronic device is used to display a fourth interface of the third application, the fourth interface displaying a transfer station sidebar, the transfer station sidebar displaying the first thumbnail; The second electronic device is used to receive a seventh operation from the user when dragging the first thumbnail to the fourth interface; The second electronic device is used in response to the seventh operation to send the first dragged object to the third application via a relay station of the second electronic device; The second electronic device is used to display the control corresponding to the first dragged object in the fourth interface based on the first dragged object through the third application.

15. An electronic device, specifically a first electronic device, characterized in that: include: One or more processors and one or more memories; the one or more memories are coupled to the one or more processors, the one or more memories being used to store computer program code, the computer program code including computer instructions, which, when the one or more processors execute the computer instructions, cause the first electronic device to perform the data transmission method of any one of claims 1-13.

16. A computer-readable storage medium comprising computer instructions, characterized in that, When the computer instructions are executed on the electronic device, the electronic device causes the electronic device to perform the data transmission method according to any one of claims 1-13.

17. A computer program product, characterized in that, It includes computer instructions that, when executed by a processor, implement the data transmission method according to any one of claims 1-13.

Images