Data transmission method, system and related apparatus
By combining the view module and the relay station, drag-and-drop objects can be created and data transfer across processes, applications, and devices can be achieved, solving the problem of cumbersome operation in existing technologies and improving transmission efficiency.
Patent Information
- Application Number
- PCT/CN2024/092927
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-19
- Filing Date
- 2024-05-13
- Publication Date
- 2024-11-28
AI Technical Summary
In existing technologies, data transmission across processes, applications, and devices involves cumbersome steps, low efficiency, and requires application adaptation.
Drag-and-drop objects are created through the view module, and cross-process transfer is achieved using a transfer station. This includes displaying drag-and-drop layers and transfer station icons, allowing users to drag and drop data to the transfer station for storage, and then transferring the data to the target application via the transfer station.
It enables data transmission across processes, applications, and devices, is easy to operate, requires no adaptation of target applications, and improves transmission efficiency.
Smart Images

Figure CN2024092927_28112024_PF_FP_ABST
Abstract
Description
Data transmission method, system and related device
[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on May 19, 2023, with application number 202310577009.8 and application name “A Data Transmission Method, System and Related Devices”, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of communication technology, and in particular to a data transmission method, system and related devices. Background Art
[0003] With the development of communication technology, electronic devices are becoming increasingly integrated into our daily lives. When using electronic devices, users often need to share data such as pictures or text from one application to another.
[0004] An electronic device needs to receive and respond to multiple user operations before it can transfer data from one application to another. For example, in the scenario of transferring an image, the electronic device can save the image in application 1 to the local album, then open the album application and use the sharing function of the album application to transfer the image to application 2. For another example, in the scenario of transferring text, the electronic device can copy the text in application 1 to the clipboard, close application 1 and open application 2, and then paste the text in the clipboard into application 2.
[0005] This can achieve cross-process transmission of data such as pictures and text, but the operation steps are cumbersome and inefficient.
[0006] Summary of the Invention
[0007] The present application provides a data transmission method, system and related devices, which realize cross-process, cross-application and even cross-device transmission of data.
[0008] In a first aspect, the present application provides a data transmission method, which is applied to a first electronic device, comprising: displaying a first interface of a first application, the first interface including a first control; receiving a first operation of the user on the first control; in response to the first operation, creating a first drag object through a view module, the first drag object being used to carry the drag data of the first control, the drag data including any one or more of text, pictures and hyperlinks; drawing a first drag layer of the first control based on the first drag object through a drag frame, the display content of the first drag layer being the same as the display content of the first control; displaying a transfer station icon and the first drag layer; when the first drag layer moves to the transfer station icon, storing the first drag object through the transfer station; displaying a first thumbnail of the first control in the transfer station icon; displaying a second interface of the second application, a transfer station sidebar being displayed on the second interface, and the first thumbnail being displayed in the transfer station sidebar; receiving a second operation of the user dragging the first thumbnail to the second interface; in response to the second operation, sending the first drag object to the second application through the transfer station; and displaying the first control in the second interface based on the first drag object through the second application.
[0009] In this way, the first electronic device can obtain the first drag object of the first control through the view module and other modules in the framework layer, and realize cross-process transmission of the first drag object through the transfer station. The operation is simple and does not require application adaptation.
[0010] In one possible implementation, creating a first drag object through a view module specifically includes: obtaining the type of the first control through the view module; obtaining the drag data of the first control based on the type of the first control through the view module; generating a first drag object based on the type of the first control and the drag data of the first control through the view module, wherein the type of the first drag object is the same as the type of the first control.
[0011] In one possible implementation, the view module includes a first module and a second module; the view module generates a first drag object based on the type of the first control and the drag data of the first control, specifically including: when the type of the first control is the first type, the first module generates the first drag object based on the first type and the drag data of the first control; when the type of the first control is the second type, the second module generates the first drag object based on the second type and the drag data of the first control.
[0012] In this way, when the type of the first control is a picture type, the first electronic device can generate the first drag object through the picture view module; when the type of the first control is a text type, the first electronic device can generate the first drag object through the text view module; when the type of the first control is a web view type, the first electronic device can generate the first drag object through the webview module, and so on.
[0013] In a possible implementation, obtaining the drag data of the first control through the view module specifically includes: when the type of the first control is the first type, obtaining the drag data of the first control through the first module; when the type of the first control is the second type, obtaining the drag data of the first control through the second module.
[0014] In this way, when the type of the first control is a picture type, the first electronic device can obtain the drag data of the first control through the picture view module; when the type of the first control is a text type, the first electronic device can obtain the drag data of the first control through the text view module; when the type of the first control is a web view type, the first electronic device can obtain the drag data of the first control through the webview module, and so on.
[0015] In one possible implementation, the first operation is a combined operation, and the first operation includes a third operation and a fourth operation; in response to the first operation, a first drag object is created through the view module, specifically including: in response to the third operation, obtaining the type of the first control through the view module; creating an empty drag object based on the type of the first control through the view module, and the type of the empty drag object is the same as the type of the first control; in response to the fourth operation, obtaining the drag data of the first control through the view module; filling the drag data of the first control into the empty drag object through the view module to obtain the first drag object.
[0016] In one possible implementation, the first control is a webview control; before displaying the second interface of the second application, the method further includes: receiving a fifth operation of the user on the first control; in response to the fifth operation, displaying the third interface; after displaying the first control in the second interface based on the first dragged object by the second application, the method further includes: receiving a sixth operation of the user on the first control;
[0017] In response to the sixth operation, the third interface is displayed. The fifth operation is the same as the sixth operation.
[0018] In a possible implementation, storing the first dragged object through the transfer station specifically includes: storing the first dragged object through the transfer station based on a correspondence between the first dragged object and the first thumbnail.
[0019] In one possible implementation, the type of the first control is the third type; the type of the first drag object is the third type, and the first drag object is empty; the method also includes: in response to the first operation, obtaining a picture of the first control through the view module; drawing the first drag layer of the first control based on the first drag object through the drag frame, specifically including: drawing the first drag layer of the first control based on the first drag object and the picture of the first control through the drag frame; after displaying the transfer station icon and the first drag layer, the method also includes: obtaining the text of the first control based on the image of the first control through the transfer station; storing the first drag object through the transfer station, specifically including: storing the text of the first control and the first drag object through the transfer station based on the relationship between the first thumbnail and the text of the first control.
[0020] In a second aspect, the present application provides a data transmission system, comprising: a first electronic device, a server, and a second electronic device; wherein the first electronic device is used to display a first interface of a first application, the first interface including a first control; the first electronic device is used to receive a first operation of the user on the first control; the first electronic device is used to create a first drag object through a view module in response to the first operation, the first drag object is used to carry the drag data of the first control, the drag data including any one or more of text, pictures, and hyperlinks; the first electronic device is used to draw a first drag layer of the first control based on the first drag object through a drag frame, and the display content of the first drag layer is the same as the display content of the first control; the first electronic device is used to display a transfer station icon and the first drag layer; when the first drag layer moves to the transfer station icon, the first electronic device The device is used to store the first dragged object through the transfer station; the first electronic device is used to display the first thumbnail of the first control in the transfer station icon; after storing the first dragged object through the transfer station, the first electronic device is used to send the first dragged object to the server through the transfer station; the second electronic device is used to obtain the first dragged object from the server through the transfer station of the second electronic device; the second electronic device is used to display the fourth interface of the third application, the fourth interface is displayed with a transfer station sidebar, and the first thumbnail is displayed in the transfer station sidebar; the second electronic device is used to receive the seventh operation of the user dragging the first thumbnail to the fourth interface; the second electronic device is used to send the first dragged object to the third application through the transfer station of the second electronic device in response to the seventh operation; the second electronic device is used to display the first control in the second interface based on the first dragged object through the third application.
[0021] In this way, the first electronic device can realize cross-device transmission of data through the transfer station and the server, and there is no need to adapt the application, which is simple to operate.
[0022] In a third aspect, the present application provides an electronic device, which is a first electronic device, comprising one or more processors and one or more memories. The one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program code, the computer program code including computer instructions. When the one or more processors execute the computer instructions, a communication device performs the data transmission method in any possible implementation of any of the above aspects.
[0023] In a fourth aspect, an embodiment of the present application provides a computer storage medium comprising computer instructions, which, when executed on a first electronic device, enables the first electronic device to execute a data transmission method in any possible implementation of any of the above aspects.
[0024] In a fifth aspect, an embodiment of the present application provides a computer program product, which, when executed on a first electronic device, enables the first electronic device to execute the data transmission method in any possible implementation of any of the above aspects.
[0025] The beneficial effects of the third to fifth aspects can refer to the beneficial effects of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0026] FIG1A is a schematic diagram of the hardware structure of an electronic device 100 provided in an embodiment of the present application;
[0027] FIG1B is a schematic diagram of the hardware structure of a server 3000 provided in an embodiment of the present application;
[0028] 2A to 2M are schematic diagrams of a set of interfaces for transmitting pictures across applications according to an embodiment of the present application;
[0029] 3A to 3L are schematic diagrams of a set of interfaces for transmitting text across applications according to an embodiment of the present application;
[0030] 4A to 4L are schematic diagrams of a set of interfaces for transmitting web page view controls across applications according to an embodiment of the present application;
[0031] 5A to 5H are schematic diagrams of a set of interfaces for simultaneously dragging multiple controls to a transfer station, provided in an embodiment of the present application;
[0032] 6A to 6L are a set of interface diagrams for dragging an interface element including multiple text controls to a transfer station, provided in an embodiment of the present application;
[0033] 7A to 7M are schematic diagrams of a set of interfaces for dragging an interface element including multiple image controls to a transfer station, provided in an embodiment of the present application;
[0034] FIG8 is a schematic diagram of a module interaction process for transmitting data in Application 1 to a transfer station according to an embodiment of the present application;
[0035] 9A to 9C are schematic diagrams of three module interaction processes for generating a drag object of a control based on the type of the control provided in an embodiment of the present application;
[0036] FIG10 is a schematic diagram of a top-level view according to an embodiment of the present application, which determines execution logic based on a user's drag operation;
[0037] FIG11 is a schematic diagram of a module interaction process for transmitting a custom text control in Application 1 to a transfer station according to an embodiment of the present application;
[0038] FIG12 is a schematic diagram of a module interaction process for transmitting data in a transfer station to application 2 according to an embodiment of the present application;
[0039] FIG13 is a schematic diagram of a process of simultaneously dragging multiple controls using a data transmission method according to an embodiment of the present application;
[0040] FIG14 is a schematic diagram of a process of dragging an interface element including multiple controls using a data transmission method according to an embodiment of the present application;
[0041] FIG15A is a schematic diagram of a software architecture of an electronic device 100 provided in an embodiment of the present application;
[0042] FIG15B is a schematic structural diagram of a top-level view provided in an embodiment of the present application;
[0043] FIG16 is a schematic structural diagram of a data transmission system 10 provided in an embodiment of the present application;
[0044] FIG17 is a flow chart of a data transmission method provided in an embodiment of the present application. DETAILED DESCRIPTION
[0045] The following is a clear and detailed description of the technical solutions in the embodiments of the present application in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in the text is only a description of the association relationship between related objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.
[0046] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to imply or suggest relative importance or implicitly indicate the number of the technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of this application, unless otherwise specified, "plurality" means two or more.
[0047] The term "user interface (UI)" in the following embodiments of this application refers to a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The user interface is a source code written in a specific computer language such as Java and extensible markup language (XML). The interface source code is parsed and rendered on an electronic device and finally presented as content that the user can recognize. The commonly used form of user interface is graphical user interface (GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It can be a visual interface element such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc. displayed on the display screen of an electronic device.
[0048] The following describes a method for transmitting images across processes provided in an embodiment of the present application.
[0049] When the electronic device displays an image control of application 1, application 1 can receive and respond to a user's long-press and drag operation on the image control, obtain the image of the image control, and transfer the image to the transfer station via the drag framework. The transfer station can receive and respond to the user's operation and transfer the image to application 2. In this way, cross-process image transfer can be achieved.
[0050] However, because apps need to respond to long-press and drag operations, third-party apps need to adapt when using this method to transfer images across processes. Furthermore, the data transferred by App 1 via the drag framework (e.g., image parameters) may not match the data the user actually wants to transfer, which can affect the user experience.
[0051] The present application provides a data transmission method, and an electronic device may include a view, a drag frame and a transfer station. When the interface 1 (including control 1) of application 1 is displayed, the user's operation 1 on control 1 (such as a long press and drag operation) is detected, the view can obtain the type and drag data of control 1, create a drag object of control 1 based on the type and drag data of control 1, and initiate dragging through the drag frame to transfer the drag object of control 1 to the transfer station, and the drag data includes one or more of a picture, text, and hyperlink. The transfer station can display a thumbnail 1 of control 1 based on the drag data and / or type of control 1. When the interface of application 2 is displayed, and the transfer station displays a thumbnail 1 on the interface, the transfer station detects the user's operation 2 on thumbnail 1 (such as a long press and drag operation), and can transfer the drag object of control 1 to application 2 through the drag frame, and display control 1 in application 2. In an embodiment of the present application, the thumbnail of a control refers to a picture whose display content is the same as the display content of the control and whose display size is less than or equal to the display size of the control. The control display content may include images and / or text.
[0052] In this way, data such as image controls, text controls, and web page view controls can be transferred from application 1 to application 2, achieving cross-process data transmission with convenient operation and high efficiency. In addition, using the data transmission method provided by this application, the view can obtain the type and drag data of control 1 when detecting user operation 1 on control 1, without the need for application 1 to send the drag data and type of control 1, so application 1 does not need to adapt.
[0053] FIG. 1A shows a schematic structural diagram of an electronic device 100 .
[0054] The electronic device 100 may be a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a wearable device, an in-vehicle device, a smart home device, and / or a smart city device. The embodiments of the present application do not impose any particular restrictions on the specific type of the electronic device.
[0055] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a charging management module 140, a power management module 141, a battery 142, a sensor module 180, a display screen 194, etc. The sensor module 180 may include a touch sensor 180K, and optionally, may further include one or more of the following sensors: a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, an ambient light sensor, a bone conduction sensor, etc. In some embodiments, the electronic device 100 may further include the following communication modules, such as antenna 1, antenna 2, a mobile communication module 150, a wireless communication module 160, etc., for implementing wireless communication.
[0056] It should be understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0057] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.
[0058] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.
[0059] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.
[0060] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.
[0061] The charging management module 140 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via a USB port. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also provide power to the electronic device through the power management module 141.
[0062] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 and provides power to the processor 110, the internal memory 121, the display 194, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.
[0063] The wireless communication functions of electronic device 100 can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, a modem processor, and a baseband processor. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Mobile communication module 150 can provide wireless communication solutions for electronic device 100, including 2G / 3G / 4G / 5G. Mobile communication module 150 can include at least one filter, switch, power amplifier, low-noise amplifier (LNA), etc. Mobile communication module 150 can receive electromagnetic waves from antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modem processor for demodulation. Mobile communication module 150 can also amplify the signals modulated by the modem processor and convert them into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some of the functional modules of mobile communication module 150 can be located in processor 110. In some embodiments, at least some of the functional modules of mobile communication module 150 can be located in the same device as at least some of the modules of processor 110.
[0064] The wireless communication module 160 can provide wireless communication solutions for the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, demodulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive signals to be transmitted from the processor 110, frequency modulate them, amplify them, and convert them into electromagnetic waves for radiation through the antenna 2. In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology.
[0065] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.
[0066] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD). The display panel can also be made of an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 can include one or N display screens 194, where N is a positive integer greater than 1.
[0067] The internal memory 121 may include one or more random access memories (RAMs) and one or more non-volatile memories (NVMs). The RAM can be directly read and written by the processor 110 and can be used to store executable programs (e.g., machine instructions) of the operating system or other running programs, as well as user and application data. The NVM can also store executable programs and user and application data, and can be pre-loaded into the RAM for direct reading and writing by the processor 110.
[0068] The external memory interface 120 can be used to connect to an external non-volatile memory to expand the storage capacity of the electronic device 100. The external non-volatile memory communicates with the processor 110 via the external memory interface 120 to implement data storage. For example, files such as music and videos can be stored in the external non-volatile memory.
[0069] The touch sensor 180K is also called a "touch-sensitive device." The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen." The touch sensor 180K is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100, at a location different from that of the display screen 194.
[0070] FIG1B shows a schematic diagram of the hardware structure of a server 3000 provided in an embodiment of the present application.
[0071] As shown in FIG1B , server 3000 may include: one or more network device processors 3001, memory 3002, communication interface 3003, transmitter 3005, receiver 3006, coupler 3007, and antenna 3008. These components may be connected via bus 3004 or other means, with FIG1B using bus connection as an example.
[0072] The communication interface 3003 can be used for the server 3000 to communicate with other communication devices, such as electronic devices used by consumers of the project. Specifically, the communication interface 3003 can be a 3G communication interface, a long-term evolution (LTE) (4G) communication interface, a 5G communication interface, a WLAN communication interface, a WAN communication interface, etc. In addition to being limited to wireless communication interfaces, the server 3000 can also be configured with a wired communication interface 3003 to support wired communication.
[0073] In some embodiments of the present application, the transmitter 3005 and the receiver 3006 can be considered as a wireless modem. The transmitter 3005 can be used to transmit and process the signal output by the network device processor 3001. The receiver 3006 can be used to receive the signal. In the server 3000, the number of transmitters 3005 and receivers 3006 can be one or more. The antenna 3008 can be used to convert electromagnetic energy in the transmission line into electromagnetic waves in free space, or to convert electromagnetic waves in free space into electromagnetic energy in the transmission line. The coupler 3007 can be used to divide the mobile communication signal into multiple paths and distribute them to multiple receivers 3006. It is understandable that the antenna 3008 of the network device can be implemented as a large-scale antenna array.
[0074] Memory 3002 is coupled to network device processor 3001 and is used to store various software programs and / or multiple sets of instructions. Specifically, memory 3002 may include high-speed random access memory and may also include non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state storage devices.
[0075] The memory 3002 can store an operating system (hereinafter referred to as system), such as an embedded operating system such as uCOS, VxWorks, RTLinux, etc. The memory 3002 can also store a network communication program that can be used to communicate with other communication devices.
[0076] In an embodiment of the present application, the memory 3002 can store an implementation program of the data transmission method provided in an embodiment of the present application, etc.
[0077] In the embodiments of the present application, the network device processor 3001 can be used to read and execute computer-readable instructions. Specifically, the network device processor 3001 can be used to call a program stored in the memory 3002, such as an implementation program of the data transmission method provided in one or more embodiments of the present application, and execute the instructions contained in the program.
[0078] It should be noted that the server 3000 shown in FIG1B is only one implementation of the embodiment of the present application. In actual applications, the server 3000 may also include more or fewer components, which is not limited here.
[0079] The following describes the data transmission method provided in the embodiment of the present application in conjunction with the application scenario.
[0080] In some application scenarios, the electronic device 100 displays an interface 1 of an application 1 (such as a chat application), and the interface 1 may include a control 1, which is a picture control. The electronic device 100 can receive and respond to the user's operation 1 on the control 1 (such as a long press and drag operation), and can display the transfer station icon and the drag layer of the control 1 on the interface 1, and the drag layer moves along the trajectory of the operation 1. After detecting the user's release operation in the area where the transfer station icon is located, the electronic device 100 can turn off the display of the drag layer and display a thumbnail of the control 1 in the transfer station icon. Among them, the thumbnail of the control is a picture whose display content is the same as the display content of the control and whose display size is less than or equal to the display size of the control.
[0081] In this way, the electronic device 100 can drag the image control in the application 1 to the transfer station by dragging or the like, so as to facilitate the subsequent transmission of the image control to other processes (eg, other applications) through the transfer station.
[0082] Exemplarily, as shown in FIG2A , the electronic device 100 displays a desktop 200. The desktop 200 displays a page on which application icons are placed, and the page includes multiple application icons (for example, a reading application icon, a setting application icon, a browser application icon, a chat application icon 204, a social application icon 205, a document application icon 206, a gallery application icon 207, a photo application icon 208, etc.). Optionally, a page indicator 202 is also displayed below the page on which application icons are placed to indicate the total number of pages on the desktop and the positional relationship between the currently displayed page and other pages. For example, the desktop 200 may include three pages, and the white dot in the page indicator is located in the third position from the left, which may indicate that the currently displayed page is the third page from the left of the three pages. Optionally, a status bar 201 is also displayed above the page on which application icons are placed, and the status bar 201 may include information such as a communication signal strength indicator, a battery value, and time. Further optionally, there may be a tray (dock) area 203 below the page indicator, and the dock area 203 may include one or more tray icons (for example, a dial application icon, a message application icon, an address book application icon, a camera application icon, etc.), and one or more tray icons in the dock area may remain displayed when the page is switched.
[0083] The electronic device 100 may receive and, in response to a user click operation on the chat application icon 204 , display a chat application interface 210 as shown in FIG. 2B . The chat application interface 210 may be used to display one or more chat entries.
[0084] As shown in FIG2B , the chat application interface 210 may include one or more chat items and one or more auxiliary controls, such as a chat control, a discovery control, a contact list control, a search control, etc. The one or more chat items may include a group chat item 211, a private chat item 212, etc. Each chat item may be used to trigger the electronic device 100 to display the chat interface corresponding to the chat item.
[0085] The electronic device 100 may receive and, in response to a user click operation on the group chat entry 211 , display a group chat interface 220 as shown in FIG. 2C . The group chat interface 220 may be used to display one or more group chat contents.
[0086] As shown in FIG2C , group chat interface 220 may include one or more group chat contents, which may include pictures (including emoticons), text, voice, video, and other content sent by group chat members. The one or more group chat contents may include a picture control 221, a picture control 222, a text control 223, and the like. An avatar and name may also be displayed next to each group chat content to indicate that the group chat content was sent by the group chat member corresponding to the avatar and name.
[0087] The electronic device 100 can receive and respond to the user's long press and drag operation (including long press operation and drag operation) on the picture control 221, as shown in Figure 2D, and display the transfer station icon 224 and the drag layer 225 of the picture control 221 on the group chat interface 220.
[0088] As shown in Figure 2D, the electronic device 100 displays a transfer station icon 224 and a drag layer 225 on the group chat interface 220. Among them, the transfer station icon 224 is used to prompt the user that the electronic device 100 has turned on the transfer station. Text and / or patterns can also be displayed in the transfer station icon 224. For example, the text displayed in the transfer station icon 224 can be "Drag here". The display content of the drag layer 225 is the same as the display content (i.e., picture) of the picture control 221, and the display size of the drag layer 225 can be the same as or different from the display size of the picture control 221. In some embodiments, the drag layer 225 can be exactly the same as the picture control 221, that is, the display content, display size, clarity and other parameters of the two are the same, and this application does not limit this. It should be noted that the drag layer 225 can move along the trajectory of the user's drag operation.
[0089] The electronic device 100 can receive and respond to the user's drag operation on the drag layer 225, so that the drag layer 225 moves along the trajectory of the drag operation toward the transfer station icon 224. When the user releases the area where the transfer station icon 224 is located, as shown in FIG2E , the electronic device 100 can close the display of the drag layer 225 and display a thumbnail 226 of the picture control 221 in the transfer station icon 224, where the display size of the thumbnail 226 is smaller than the display size of the transfer station icon 224.
[0090] As shown in FIG2E , thumbnail 226 displays the same content as picture control 221, and the display size of thumbnail 226 is smaller than the display size of transfer station icon 224. The display size of thumbnail 226 is also smaller than or equal to the display size of picture control 221. In some embodiments, if the display size of picture control 221 is smaller than that of transfer station icon 224, the display size of thumbnail 226 may also be the same as the display size of the picture control.
[0091] In some embodiments, the electronic device 100 may also drag multiple picture controls into the transfer station in sequence.
[0092] For example, as shown in FIG2E , the electronic device 100 displays a group chat interface 220 . The electronic device 100 can receive and respond to a user's long press and drag operation on the image control 222 . As shown in FIG2F , the electronic device 100 can display a drag layer 227 of the image control 222 .
[0093] As shown in FIG2F , the display content of drag layer 227 is the same as the display content of image control 222. Drag layer 227 can move along the trajectory of the user's drag operation. For other contents of drag layer 227, please refer to the description of drag layer 225 shown in FIG2D above, and will not be repeated here.
[0094] The electronic device 100 can receive and respond to the user's drag operation on the drag layer 227, so that the drag layer 227 moves along the trajectory of the drag operation toward the transfer station icon 224. When the user releases the area where the transfer station icon 224 is located, as shown in FIG2G , the electronic device 100 can turn off the display of the drag layer 227 and display a thumbnail 228 in the transfer station icon 224.
[0095] As shown in FIG2G , the display content of thumbnail 228 is the same as that of picture control 222. Since the display size of picture control 222 is smaller than that of transfer station icon 224, the display size of thumbnail 228 can be the same as that of picture control 222. In some embodiments, thumbnail 228 can be displayed over thumbnail 226; in other embodiments, electronic device 100 can also turn off the display of thumbnail 226 and display thumbnail 228 over transfer station icon 224. Optionally, a numerical identifier, such as "2", can be displayed on thumbnail 228 (e.g., in the upper right or upper left corner of thumbnail 228). The numerical identifier can be used to prompt the user the number of controls that have been dragged into the transfer station.
[0096] After dragging an image control to the transfer station, the electronic device 100 can store the image control in the transfer station. When the electronic device 100 displays an interface 2 of an application 2 and a transfer station icon is displayed on the interface 2, the electronic device 100 can receive and respond to a user operation 2 on the transfer station icon (e.g., a long press and drag operation) to display all controls in the transfer station in the interface 2.
[0097] For example, when the electronic device 100 displays the group chat interface 220 as shown in Figure 2G, the electronic device 100 can receive and respond to the user's operation of sliding upward from the bottom edge of the display screen, close the display of the group chat interface 220, and display the desktop 200 as shown in Figure 2H.
[0098] As shown in FIG2H , a social application icon 205 may be displayed on the desktop 200 . For other detailed descriptions of the desktop 200 , please refer to the relevant content shown in FIG2A above, which will not be repeated here.
[0099] The electronic device 100 may receive and, in response to a user's click operation on the social application icon 205 , display a social application interface 230 as shown in FIG. 2I .
[0100] As shown in Figure 2I, the social application interface 230 may include a bottom control area 231, a top control area 233, and one or more web view controls. Among them, the bottom control area 231 may include one or more controls (or options), such as a new graphic control 232, a message option, a homepage option, etc., and the one or more controls (or options) can be used to trigger the electronic device 100 to display the corresponding interface. For example, the new graphic control 232 can be used to trigger the electronic device 100 to display the graphic editing interface. The top control area 233 may include one or more controls (or options), such as a search control, a discovery option, a follow option, a nearby option, etc. The one or more controls (or options) are used to trigger the electronic device 100 to change the one or more web view controls displayed in the social application interface 230. The one or more web view controls may include a web view control 234, and the web view control 234 can be used to trigger the electronic device 100 to display the corresponding web view interface. The web view control 234 may include an image control 234a and a text control 234b. Either the image control 234a or the text control 234b may trigger the electronic device 100 to display the web view interface corresponding to the web view control 234. In some embodiments, auxiliary controls such as a publisher control 235 and a like control may also be displayed next to the web view control 234. The publisher control 235 may be used to trigger the electronic device 100 to display the profile or information of the publisher of the web view interface.
[0101] The electronic device 100 may receive and respond to a user's click operation on the new graphic and text control 232 to display a graphic and text editing interface 240 as shown in FIG. 2J .
[0102] As shown in Figure 2J, the graphic and text editing interface 240 may include one or more options, such as a publishing option, a graphic and text template option, and a video template option. The publishing option can be used to trigger the electronic device 100 to publish the graphic and text content of the graphic and text editing interface 240, the graphic and text template option can be used to trigger the electronic device 100 to display one or more graphic and text templates, and the video template option can be used to trigger the electronic device 100 to display one or more video templates.
[0103] The electronic device 100 can receive and respond to the user's operation of sliding from the right edge of the display screen to the left (or sliding from the left edge of the display screen to the right), as shown in Figure 2K, and display the transfer station icon 241 on the graphic editing interface 240.
[0104] As shown in Figure 2K, a thumbnail 242 may be displayed in the transfer station icon 241. The thumbnail 242 may be the thumbnail 228 in the embodiment shown in Figure 2G. In addition, a number "2" may be displayed in the upper right corner of the thumbnail 242, indicating that the number of controls currently stored in the transfer station is two.
[0105] The electronic device 100 may receive and respond to the user's long press and drag operation on the transfer station icon 241 , as shown in FIG. 2L , so that the transfer station icon 241 moves along the trajectory of the user's drag operation.
[0106] When the electronic device 100 detects the user's release operation, in response to the release operation, as shown in Figure 2M, the electronic device 100 can display all controls in the transfer station in the graphic editing interface 240 and redisplay the transfer station icon 241 at the position before dragging.
[0107] As shown in FIG2M , when the controls dragged into the transfer station include the picture control 221 and the picture control 222 shown in FIG2C , the electronic device 100 can display the picture control 243 and the picture control 244 in the graphic editing interface 240 and redisplay the transfer station icon 241 at the position before the dragging, with the thumbnail 242 still displayed on the transfer station icon 241. The picture control 243 is the same as the picture control 221 shown in FIG2C , and the picture control 244 is the same as the picture control 222 shown in FIG2C . In some embodiments, the display position of the picture control 243 and the picture control 244 can be related to the position where the user releases the control. For example, the electronic device 100 can display the picture control 243 and the picture control 244 with the position where the user releases the control as the center. It is understandable that the relationship between the display position of the picture control 243 and the picture control 244 and the position where the user releases the control can also be other relationships, and this application is not limited to this.
[0108] In some embodiments, after the electronic device 100 displays the transfer station icon on the interface 2 of the application 2, the electronic device 100 may also receive and respond to the user's click operation on the transfer station icon to display a transfer station sidebar, in which one or more thumbnails are displayed. The electronic device 100 may receive and respond to the user's long press and drag operation on one of the thumbnails to display the image control (or other type of control) corresponding to the thumbnail in the interface 2. For the specific operation steps, please refer to the relevant content in the following embodiments, which will not be described in detail in this application.
[0109] It is understood that the embodiment shown in Figures 2A to 2M above is only an example. In the embodiments of the present application, Application 1 and Application 2 may also be different applications from the above embodiments, and the user may also drag more or fewer image controls than in the above embodiments to the transfer station, and the present application does not limit this. In some embodiments, the transfer station icon may also be displayed in the form of a floating ball or a top floating bar, and the present application does not limit this.
[0110] In some application scenarios, the electronic device 100 displays an interface 1 of an application 1 (such as a chat application), and the interface 1 may include a control 1, which is a text control. The electronic device 100 can receive and respond to the user's operation 1 on the control 1 (such as a long press and drag operation), display the transfer station icon and the drag layer of the control 1 on the interface 1, and the drag layer moves along the trajectory of the drag operation. After detecting the user's release operation in the area where the transfer station icon is located, the electronic device 100 can turn off the display of the drag layer and display a thumbnail of the control 1 in the transfer station icon. It should be noted that the control 1 is a text control, and the thumbnail of the text control can be a picture whose display content is the same as the display content of the text control and whose display size is less than or equal to that of the text control. In some embodiments, the thumbnail of the text control can also be a preset document pattern, and the document pattern can be used to prompt that the control dragged into the transfer station is a text control.
[0111] In this way, the electronic device 100 can drag the text control in the application 1 to the transfer station by dragging or the like, so as to facilitate the subsequent transmission of the text control to other processes (eg, other applications) through the transfer station.
[0112] For example, the electronic device 100 may display the group chat interface 220 shown in FIG3A . The group chat interface 220 may include a picture control 221, a picture control 222, a text control 223, and a transfer station icon 224. The transfer station icon 224 may also display a thumbnail 228, which may be a picture with the same content as the picture control 222. The transfer station icon 224 may be used to prompt the user that the electronic device 100 has opened the transfer station and that there are controls dragged into the transfer station. For other contents of the group chat interface 220, please refer to the relevant description of the embodiment shown in FIG2M above, and will not be repeated here.
[0113] The electronic device 100 can receive and respond to the user's long press and drag operation on the text control 223, and display the drag layer 229 in the group chat interface 220 as shown in Figure 3B.
[0114] As shown in FIG3B , the drag layer 229 has the same display content and display size as the text control 228. The drag layer 229 can move along the trajectory of the user's drag operation.
[0115] The electronic device 100 can receive and respond to the user's drag operation on the drag layer 229, so that the drag layer 229 moves along the trajectory of the drag operation toward the transfer station icon 224. When the user releases the area where the transfer station icon 224 is located, as shown in FIG3C, the electronic device 100 can turn off the display of the drag layer 229 and display the text thumbnail 223a in the transfer station icon 224.
[0116] As shown in FIG3C , the text thumbnail 223a can be a document pattern, and the text thumbnail 223a can be used to prompt the user that the control just dragged into the transfer station is a text control. In addition, a numerical identifier, such as "3", can also be displayed in the upper right corner (or upper left corner) of the text thumbnail 223a to prompt the user that the number of controls dragged into the transfer station is 3. In other embodiments, the text thumbnail 223a can also be a picture whose display content is the same as that of the text control 223 and whose display size is smaller than that of the transfer station icon 224. This application does not limit this.
[0117] In this way, the electronic device 100 can drag the text control in the application 1 into the transfer station.
[0118] After dragging control 1 (control 1 is a text control) into the transfer station, the electronic device 100 can store the text of control 1 in the transfer station. When the electronic device 100 displays interface 2 of application 2, and a transfer station sidebar is displayed on interface 2, and a thumbnail of control 1 is displayed in the transfer station sidebar, the electronic device 100 can receive and respond to the user's operation 2 on the thumbnail (such as a long press and drag operation) to display the control 1 (or the text of control 1) in interface 2.
[0119] For example, when the electronic device 100 displays the group chat interface 220 as shown in FIG3C , the electronic device 100 can receive and respond to the user's operation of sliding upward from the bottom edge of the display screen, close the display of the group chat interface 220, and display the desktop 200 as shown in FIG3D . The specific content of the desktop 200 can refer to the relevant description in the embodiment shown in FIG2A above.
[0120] The electronic device 100 may receive and respond to a user's click operation on the document application icon 206 in the desktop 200 to display the document application interface 300 as shown in FIG3E .
[0121] As shown in FIG3E , the document application interface 300 may include one or more controls, such as an open control 301 and a new file control 302. The open control 301 may be used to trigger the electronic device 100 to display a list of files stored on the electronic device 100, and the new file control 302 may be used to trigger the electronic device 100 to create a new file. The document application interface 300 may also display a file list including one or more stored files, which may be used to trigger the electronic device 100 to open the corresponding file and display the specific content of the file.
[0122] The electronic device 100 may receive and respond to a user's click operation on the new file control 302 , and display a type selection window 303 in the document application interface 300 , as shown in FIG3F .
[0123] As shown in FIG3F , the type selection window 303 may display one or more type options, such as a document option 304 , a table option, a note option, a presentation option, etc. Any type option may be used to trigger the electronic device 100 to create a file of the corresponding type.
[0124] The electronic device 100 may receive and, in response to a user click operation on the document option 304 , display a document editing interface 310 as shown in FIG. 3G .
[0125] As shown in Figure 3G, the document editing interface 310 may include an auxiliary control area 311, a status control area 312, and a document editing area 313. Among them, one or more auxiliary controls may be displayed in the auxiliary control area 311, such as a picture control, a typesetting format control, a text control, etc., and the auxiliary controls may be used to assist in editing the document. The status control area 312 may display one or more status controls, such as a completion control, a save control, a close control, etc. The status control may be used to trigger the electronic device 100 to end the editing state of the document, or to save the document, close the display of the document editing interface 310, etc. The document editing area 313 may be used to display the content of the document, and the user may edit the content displayed in the document editing area 313 through the auxiliary controls in the auxiliary control area 311.
[0126] The electronic device 100 can receive and respond to the user's operation of sliding from the right edge of the display screen to the left (or sliding from the left edge of the display screen to the right, etc.), as shown in Figure 3H, and display the transfer station icon 314 in the document editing interface 310.
[0127] As shown in FIG3H , a text thumbnail 314a may be displayed in the transfer station icon 314. For details of the text thumbnail 314a, please refer to the description of the text thumbnail 223a in the embodiment shown in FIG3C . The text thumbnail 314a may be used to remind the user that the last control dragged into the transfer station is a text control.
[0128] The electronic device 100 may receive and respond to a user click operation on the transfer station icon 314 , close the display of the transfer station icon, and display the transfer station sidebar 320 as shown in FIG. 3I in the document editing interface 310 .
[0129] As shown in Figure 3I, one or more thumbnails can be displayed in the transfer station sidebar 320. In the transfer station, each thumbnail corresponds to a picture and / or text of a control. For example, thumbnail 321, thumbnail 322 and thumbnail 323 can be displayed in the transfer station sidebar 320, wherein thumbnail 321 can be the thumbnail of the text control 223 in the embodiment shown in Figure 3A above, thumbnail 322 can be the thumbnail of the picture control 222 in Figure 3A above, and thumbnail 323 can be the thumbnail of the picture control 221 in Figure 3A above. Among them, the thumbnail of the control displayed in the transfer station sidebar 320 is also a picture whose display content is the same as the display content of the control, and whose display size is less than or equal to the display size of the control. It should be noted that the display size of the thumbnail displayed in the transfer station sidebar 320 can be greater than or equal to the display size of the thumbnail displayed in the transfer station icon in the aforementioned embodiment. For example, thumbnail 322 may be the same as thumbnail 242 shown in FIG. 2K , and the display size of thumbnail 323 may be greater than or equal to the display size of thumbnail 226 shown in FIG. 2F . In some embodiments, transfer station sidebar 320 may further display a menu control 324 , which may be used to trigger electronic device 100 to display a transfer station menu. The transfer station menu may be used to assist the user in adding or deleting images or text stored in the transfer station, and may also be used to adjust the order of thumbnails in the transfer station, etc.
[0130] The electronic device 100 may receive and respond to the user's long press and drag operation on the thumbnail 321 , as shown in FIG3J , so that the thumbnail 321 moves along the trajectory of the user's drag operation.
[0131] 3J , the thumbnail 321 may move along the trajectory of the user's dragging operation. While the user is dragging the thumbnail 321 , the electronic device 100 may temporarily close the transfer station sidebar 320 .
[0132] The electronic device 100 may receive and respond to the user's release operation, as shown in FIG3K , by displaying the text control 315 in the document editing interface 310 and redisplaying the transfer station sidebar 320 .
[0133] As shown in Figure 3K, after the user releases the thumbnail 321, the electronic device 100 can display a text control 315 in the document editing interface 310, and the text of the text control 315 is the same as the text of the text control 223 shown in Figure 3A. The display size of the text control 315 can be different from the display size of the text control 223. In some embodiments, the font, font size and layout of the text in the text control 315 can be determined based on the user's setting operation for the relevant controls in the auxiliary control area 311 before the drag operation. In other embodiments, the text control 315 can be the same as the text control 223 shown in Figure 3A above. After displaying the text control 315, the electronic device 100 can redisplay the transfer station sidebar 320 in the document editing interface 310, and the one or more thumbnails displayed in the transfer station sidebar 320 are the same as the one or more thumbnails displayed before the drag operation. In some embodiments, the position of the text control 315 in the document editing interface 310 may also be related to the position where the user releases the operation. For example, the text control 315 is displayed with the user's release position as the center, or the text control 315 is displayed with the user's release position as the upper left corner of the text control 315, etc. This application does not limit this.
[0134] The electronic device 100 can receive and respond to a user's click operation on a blank area in the document editing interface 310. As shown in FIG3L , the electronic device 100 can close the transfer station sidebar 320 and redisplay the transfer station icon 314. The transfer station icon 314 is the same as the transfer station icon 314 shown in FIG3H above.
[0135] It is understood that the embodiment shown in Figures 3A to 3L above is only an example. In the embodiments of the present application, Application 1 and Application 2 may also be different applications from the above embodiments. The user may also drag more or different text controls than in the above embodiments to the transfer station, or drag other types of controls to the transfer station. The present application does not limit this. In some embodiments, the transfer station icon may also be displayed in the form of a floating ball or a top floating bar, etc., which is not limited in the present application.
[0136] In some application scenarios, the electronic device 100 displays an interface 1 of an application 1 (such as a social application), and the interface 1 may include a control 1, which is a web view (webview) control. The electronic device 100 can receive and respond to the user's operation 1 on the control 1 (such as a long press and drag operation), display the transfer station icon on the interface 1, and display the drag layer of the control 1, and the display content of the drag layer is the same as the display content of the control 1. The electronic device 100 can move the drag layer following the trajectory of the operation 1 based on the user's operation 1. After detecting the user's release operation in the area where the transfer station icon is located, the electronic device 100 can turn off the display of the drag layer and display a thumbnail of the control 1 in the transfer station icon. Among them, the display content of the thumbnail of the control 1 is the same as the display content of the control 1, and the display size is less than or equal to the display size of the control 1.
[0137] In this way, the electronic device 100 can drag the webview control in application 1 to the transfer station by dragging or other methods, so as to facilitate the subsequent transmission of the webview control to other processes (such as other applications) through the transfer station.
[0138] For example, as shown in FIG4A , the electronic device 100 displays a desktop 200. The electronic device 100 may receive and respond to a user click operation on a social application icon 205 by displaying a social application interface 230 as shown in FIG4B . For a detailed description of the social application interface 230, please refer to the relevant description of the embodiment shown in FIG2I above, and will not be repeated here.
[0139] The electronic device 100 may receive and respond to a user's long-press and drag operation on the web view control 234 , as shown in FIG4C , by displaying a drag layer 237 and a transfer station icon 236 .
[0140] As shown in FIG4C , the specific description of the transfer station icon 236 can refer to the relevant description of the embodiment shown in FIG2D . The display content of the drag layer 237 can be the same as the display content of the web view control 234, or the same as the display content of the image control 234a in the web view control 234. The drag layer 237 can move along the trajectory of the user's drag operation.
[0141] The electronic device 100 can receive and respond to the user's drag operation on the drag layer 237, so that the drag layer 237 moves along the trajectory of the drag operation toward the transfer station icon 236. When the user releases the area where the transfer station icon 236 is located, as shown in FIG3C, the electronic device 100 can turn off the display of the drag layer 237 and display a thumbnail 238 in the transfer station icon 236.
[0142] As shown in FIG4D , thumbnail 238 may be a thumbnail of web page view control 234. The display content of thumbnail 238 is the same as the display content of image control 234a in web page view control 234. In some embodiments, the display content of thumbnail 238 may also be the same as the display content of web page view control 234. The display size of thumbnail 238 is less than or equal to the display size of web page view control 234 and smaller than the display size of transfer station icon 236.
[0143] In this way, the electronic device 100 can drag the web page view control in the application 1 into the transfer station.
[0144] After dragging the web view control into the transfer station, the electronic device 100 can store the drag data of the web view control in the transfer station, including pictures and hyperlinks. Optionally, if the web view control also includes text, the drag data can also include the text of the web view control. The electronic device 100 displays an interface 2 of an application 2, and a transfer station sidebar is displayed on the interface 2. One or more thumbnails are displayed in the transfer station sidebar, and one of the thumbnails is a thumbnail of the web view control. The electronic device 100 can receive and respond to the user's operation 2 on the thumbnail (such as a long press and drag operation) to display the web view control in the interface 2.
[0145] For example, when the electronic device 100 displays the social application interface 230 as shown in FIG4D , it receives and responds to the user sliding upward from the bottom edge of the display screen, closes the display of the social application interface 230, and displays the desktop 200 as shown in FIG4E . The specific description of the desktop 200 can refer to the embodiment shown in FIG2A above.
[0146] The electronic device 100 may receive and, in response to a user's click operation on the chat application icon 204 in the desktop 200 , display a chat application interface 400 as shown in FIG. 4F .
[0147] As shown in FIG4F , the chat application interface 400 may include one or more chat items, such as chat item 401. Each chat item may be used to trigger the electronic device 100 to display a corresponding chat interface. For other contents related to the chat application interface 400, reference may be made to the description of the chat application interface 210 shown in FIG2B above, and will not be repeated here.
[0148] The electronic device 100 may receive and, in response to a user's click operation on the chat item 401 , display a chat interface 410 as shown in FIG. 4G .
[0149] As shown in Figure 4G, the chat interface 410 may include one or more chat records, such as a text control 412. The chat interface 410 may also include a control area 411, which displays one or more chat controls. The chat controls can be used to assist users in editing or sending text, pictures, voice, emoticons and other messages.
[0150] The electronic device 100 can receive and respond to the user's operation of sliding from the right edge of the display screen to the left, as shown in Figure 4H, and display the transfer station icon 413 in the chat interface 410.
[0151] As shown in FIG4H , a thumbnail 413 a may be displayed in the transfer station icon 413 . The thumbnail 413 a may be the same as the thumbnail 238 shown in FIG4D , prompting the user that the control last dragged into the transfer station is the web view control 234 shown in FIG4D .
[0152] The electronic device 100 may receive and, in response to a user's click operation on the transfer station icon 413 , display a transfer station sidebar 420 , as shown in FIG. 4I .
[0153] As shown in FIG4I , the transfer station sidebar 420 may include one or more thumbnails, such as thumbnail 421. Thumbnail 421 may be the same as thumbnail 413a shown in FIG4H . The control for prompting the user to drag in the transfer station includes the web view control 234 shown in FIG4D . For other contents related to the transfer station sidebar 420, please refer to the relevant description of the embodiment shown in FIG3I .
[0154] The electronic device 100 can receive and respond to the user's drag operation on the thumbnail 421, as shown in Figure 4J, so that the thumbnail 421 moves along the trajectory of the user's drag operation. During the process of the user dragging the thumbnail 421, the electronic device 100 can temporarily close the display of the transfer station sidebar 420.
[0155] The electronic device 100 can receive and respond to the user's release operation, send the drag data (including pictures and hyperlinks) corresponding to the thumbnail 421 to the chat object of the chat interface 410 (i.e., the electronic device used by Xiaohong), and display the web view control 414 as shown in Figure 4K in the chat interface 410 based on the drag data.
[0156] As shown in FIG4K , the web view control 414 is the same as the web view control 234 shown in FIG4D described above.
[0157] The electronic device 100 may receive and, in response to a user click operation on the web view control 414 , display a web view interface 430 as shown in FIG. 4L .
[0158] As shown in FIG4L , the web view interface 430 may display graphic content, including one or more images and text. The graphic content is used to provide a detailed introduction to the image or text displayed in the web view control 414. It should be noted that the web view control 234 shown in FIG4D can also be used to trigger the electronic device 100 to display the web view interface 430.
[0159] It should be noted that if the chat partner (i.e. the electronic device used by Xiaohong) is electronic device 200, electronic device 200 can also receive and respond to the user's click operation on the web view control 414 sent by electronic device 100, and display the web view interface 430 shown in Figure 4L.
[0160] It can be understood that the embodiment shown in Figures 4A to 4K above is only an example. In the embodiment of the present application, Application 1 and Application 2 may also be applications different from the above embodiment, and the cross-process transmission achieved through the transfer station may also include more or fewer controls.
[0161] In this way, the web page view control can be transmitted to another application through the data transmission method provided in the embodiment of the present application.
[0162] In some embodiments, the data transmission method provided in the embodiments of this application can also be used to transmit images or text in a web view control to a transfer station, which can then be transferred to another application through the transfer station, where the corresponding image control or text control can be displayed. The image control or text control cannot trigger the display of the web page interface corresponding to the web view control. For specific interface diagrams, please refer to the above embodiments and this application will not describe them in detail.
[0163] The data transmission method provided in the embodiment of the present application can also be used to drag multiple controls (picture controls, text controls, web page view controls, etc.) to the transfer station at the same time.
[0164] In some application scenarios, the electronic device 100 displays an interface 1 of an application 1 (e.g., a chat application). The interface 1 may include controls 1 and 2. The types of controls 1 and 2 may be any one or more of the following: image controls, text controls, and web page view controls. The electronic device 100 may receive and respond to a user operation 3 to start a drag mode (e.g., a sliding operation starting from the edge of the display screen in an L-shaped trajectory on the display screen, a sliding operation from the edge of the display screen to the left or upward, and a long press operation after the sliding operation), and display a drag mode interface. The drag mode interface displays a transfer station icon and all draggable controls in the interface 1 (including controls 1 and 2). The electronic device 100 may sequentially receive and respond to user operations 4 (e.g., click operations) on controls 1 and 2, respectively, and user operations 5 (e.g., long press and drag operations) on the drag mode interface, and display a drag layer on the drag mode interface, so that the drag layer moves along the trajectory of the user's drag operation, wherein the display content of the drag layer may be the display content of control 1 (or control 2). After detecting the user's release operation in the area where the transfer station icon is located, the electronic device 100 can close the display drag layer and display a thumbnail of control 1 (or control 2) in the transfer station icon, and the display size of the thumbnail is smaller than the display size of the transfer station icon.
[0165] In this way, multiple controls can be dragged into the transfer station through a single drag operation, which is convenient to operate and improves the efficiency of data transmission.
[0166] Exemplarily, as shown in FIG5A , the electronic device 100 displays a group chat interface 220 . For a detailed description of the group chat interface 220 , reference may be made to the embodiment shown in FIG2C .
[0167] The electronic device 100 can receive and respond to a user sliding operation starting from the right edge of the display screen in an L-shaped trajectory on the display screen, turn on the drag mode, and display the drag mode interface 500 as shown in Figure 5B.
[0168] As shown in Figure 5B, the drag mode interface 500 may include a transfer station icon 501, and may also include one or more draggable controls, which are controls that can be dragged in the group chat interface 220, such as a picture control 221, a picture control 222, and a text control 223. A selection mark 502 may also be displayed on the one or more draggable controls to indicate whether the control is selected. In the embodiment shown in Figure 5B, no control is selected. It should be noted that in the embodiment of the present application, the selection mark 502 may be a circular mark as shown in Figure 5B, or a square or other shaped mark, and this application does not limit this.
[0169] The electronic device 100 can receive and respond to the user's click operations on the picture control 221, the picture control 222 and the text control 223 in sequence, as shown in FIG5C, by displaying a check mark in the selection identifier 502 on the above three controls.
[0170] As shown in FIG5C , a check mark is displayed on each of the image control 221, the image control 222, and the text control 223. It should be noted that the check mark can be displayed in the selection indicator. In other embodiments, whether the control is selected can also be indicated by highlighting (e.g., highlighting, displaying in a different color, bolding, etc.). In this case, the selection indicator and the check mark can be omitted. For details, please refer to the embodiments shown in FIG5G and FIG5H below.
[0171] The electronic device 100 may receive and respond to a long-press drag operation of the user on the drag mode interface 500 , and display a drag layer 503 on the drag mode interface 500 as shown in FIG. 5D .
[0172] As shown in FIG5D , the display content of drag layer 503 can be the same as the display content of image control 221. In some embodiments, the display content of drag layer 503 can also be the same as the display content of image control 222 or text control 223. A numerical mark, such as the number "3," can also be displayed on drag layer 503 to indicate to the user that there are three dragged controls. Drag layer 503 can move along the user's dragging trajectory.
[0173] When detecting that the user drags the drag layer 503 to the area where the transfer station icon 501 is located and detecting the user's release operation in the area, as shown in Figure 5E, the electronic device 100 can turn off the display of the drag layer 503 and display a thumbnail 504 in the transfer station icon 501.
[0174] 5E , thumbnail 504 may be a thumbnail of image control 221 or a thumbnail of another dragged control. A number “3” may also be displayed on thumbnail 504 to remind the user that the number of controls dragged into the transfer station is 3.
[0175] The electronic device 100 can receive and respond to the user's operation to close the drag mode (for example, a double-click operation on the drag mode interface 500, a specific gesture operation, etc.), close the drag mode, and redisplay the group chat interface 220 as shown in Figure 5A.
[0176] In some embodiments, the electronic device 100 may also turn off the drag mode and display the group chat interface 220 as shown in Figure 5F when detecting the user's release operation in the area where the transfer station icon 501 is located. The group chat interface 220 displays the transfer station icon 501 and the thumbnail 504. The specific description of the thumbnail 504 can refer to the embodiment shown in Figure 5E above, and will not be repeated here.
[0177] In this way, in the drag mode, multiple controls can be dragged to the transfer station at the same time, which can reduce the number of operation steps and improve efficiency. After the multiple controls are dragged into the transfer station, the electronic device 100 can also receive and respond to the user's operation of dragging the controls in the transfer station into the application 2, and display one or more controls in the transfer station in the interface of the application 2. The specific steps can be referred to the relevant description in the above embodiment, which will not be repeated here.
[0178] In some embodiments, the drag mode interface may also indicate whether the control is selected by highlighting (eg, highlighting, displaying in a different color, displaying in bold, etc.). In this case, the selection indicator and the check mark may not be displayed.
[0179] 5G , electronic device 100 displays a drag mode interface 510, which may include an image control 511, an image control 512, a text control 513, and a transfer station icon 514. Furthermore, unlike the drag mode interface 500 shown in FIG. 5B , no selection mark is displayed on the image control and the text control.
[0180] The electronic device 100 may receive and respond to the user's click operations on the picture control 511 , the picture control 512 and the text control 513 in sequence, as shown in FIG5H , to highlight the picture control 511 , the picture control 512 and the text control 513 .
[0181] In this way, the user can also determine whether the control is selected by observing whether the control in the drag mode interface is highlighted.
[0182] The data transmission method provided in the embodiment of the present application can also be used for cross-process transmission of interface elements including multiple controls, wherein the types of the multiple controls may include any one or more of the following: picture controls, text controls, webview controls, etc.
[0183] In some application scenarios, the electronic device 100 displays an interface 1 of an application 1. The interface 1 may include an interface element 1. The interface element 1 may include a control 1 and a control 2. The types of the control 1 and the control 2 may include any one or more of the following: an image control, a text control, and a web view control. The electronic device 100 may receive and respond to a user operation 3 to start a drag mode (e.g., a sliding operation starting from the edge of the display screen in an L-shaped trajectory on the display screen, a sliding operation from the edge of the display screen to the left or upward, and a long press operation after the sliding operation), and display a drag mode interface. The drag mode interface displays a transfer station icon and the interface element 1. Optionally, if the interface 1 also includes other draggable controls, the drag mode interface may also include the one or more draggable controls. The electronic device 100 may sequentially receive and respond to a user operation 4 (e.g., a click operation) on the interface element 1 (e.g., on any point on the control 1 or the control 2) and display a check mark on the interface element 1. The electronic device 100 receives and responds to the user's operation 5 on the drag mode interface (e.g., a long press and drag operation), displays a drag layer on the drag mode interface, and moves the drag layer along the trajectory of the user's drag operation, wherein the display content of the drag layer can be the display content of the interface element 1. After detecting the user's release operation in the area where the transfer station icon is located, the electronic device 100 can turn off the display of the drag layer and display a thumbnail of the interface element 1 in the transfer station icon, with the display size of the thumbnail being smaller than the display size of the transfer station icon.
[0184] In this way, multiple control interface elements can be dragged into the transfer station through a single drag operation, which is convenient to operate and improves the efficiency of data transmission.
[0185] In some embodiments, if the interface element includes multiple text controls, the electronic device 100 may also adopt the data transmission method provided in the embodiment of the present application to transmit the interface element from application 1 (e.g., a gallery application) to application 2 (e.g., a document application).
[0186] 6A , the electronic device 100 displays a desktop 200. For a detailed description of the desktop 200, reference may be made to the content of the embodiment shown in FIG2A . The electronic device 100 may receive and respond to a user clicking on the gallery application icon 207 by displaying an album interface 600 as shown in FIG6B .
[0187] As shown in FIG6B , one or more album icons may be displayed in the album interface 600 , such as a camera album icon, a screenshot album icon 601 , and a video album icon, etc.
[0188] The electronic device 100 may receive and respond to a user's click operation on the screenshot album icon 601 to display a screenshot album interface 610 as shown in FIG6C .
[0189] As shown in FIG6C , the screenshot album interface 610 may display one or more thumbnails of pictures, such as thumbnail 611. Each thumbnail may be used to trigger the electronic device 100 to display the picture corresponding to the thumbnail in full screen on the display screen.
[0190] The electronic device 100 may receive and respond to a user's click operation on the thumbnail 611 to display a picture browsing interface 620 as shown in FIG. 6D .
[0191] As shown in FIG6D , the image browsing interface 620 may display an image 622 corresponding to the thumbnail 611. The image 622 may include text content, such as "ABB," "?!*," "CDD," and so on. In the image browsing interface 620, the image 622 is displayed full screen, i.e., the display area of the image is the entire display screen area. The image browsing interface 620 may also display a text extraction control 621, which can be used to trigger the electronic device 100 to extract the text content in the image 622.
[0192] The electronic device 100 can receive and respond to a user's click operation on the text extraction control 621 to display the smart screen recognition interface 630 as shown in FIG6E .
[0193] As shown in Figure 6E, the smart screen recognition interface 630 may include a picture 631 and an extraction result display area 632. Among them, the picture 631 can be displayed in the upper area of the display screen, and the picture 631 is the same as the picture 622 in the embodiment shown in Figure 6D above. The extraction result display area 632 can be displayed in the lower area of the display screen, and the extraction result display area 632 may include an interface element 633, which is used to prompt the user that the electronic device 100 has extracted text content from the picture 622. The interface element 633 may include multiple text controls, each of which includes a text, such as "A", "B", "B", etc. The text in all text controls in the interface element 633 can be combined into text content according to the arrangement order of the corresponding text controls in the smart screen recognition interface 630. The text content is the text content in the picture 622 shown in Figure 6D. In addition, one or more auxiliary controls may be displayed in the extraction result display area 632, such as a select all control, a search control, a copy text control, a translation control, a sharing control, etc. These one or more auxiliary controls may be used to assist the user in performing operations such as selecting all, searching, copying, translating, and sharing the extracted text content.
[0194] The electronic device 100 can receive and respond to the user's sliding operation starting from the right edge of the display screen in an L-shaped trajectory on the display screen, turn on the drag mode, and display the drag mode interface 640 as shown in Figure 6F.
[0195] As shown in Figure 6F, the drag mode interface 640 may include interface element 633 and transfer station icon 641. For the specific content of transfer station icon 641, please refer to the relevant description in the above embodiment, and for the specific description of interface element 633, please refer to the relevant description in the embodiment shown in Figure 6E. In some embodiments, the drag mode interface 640 may also include all controls in the extraction result display area 632 (including interface element 633 and auxiliary controls, etc.).
[0196] The electronic device 100 can receive and respond to a user's click operation on any text control in the interface element 633 (or on the select all control), and display a selection mark on the interface element 633 as shown in FIG6G .
[0197] As shown in Figure 6G, the electronic device 100 displays a check mark on the interface element 633. This may be that the electronic device 100 changes the display color of all text controls in the interface element 633 to another color, such as changing the display color of the text control from white to black or other colors, and changing the font color in the text control from black to white, or changing it to other colors, etc., which is not limited in this application. The electronic device 100 can prompt the user that the interface element 633 is in a selected state by using different display colors. It will be understood that a check mark is provided here for example. In the embodiment of the present application, the electronic device 100 may also use other check marks, such as the check mark described in the embodiment shown in Figure 5C or Figure 5H above, which is not limited in this application.
[0198] The electronic device 100 receives and responds to the user's long press and drag operation on any point on the drag mode interface 640 , and displays a drag layer 642 in the drag mode interface 640 as shown in FIG6H .
[0199] As shown in FIG6H , the drag layer 642 can be a picture with the same display content and the same or different display size as the interface element 633. The drag layer 642 can move along the drag track of the user in the drag mode interface 640. When the user drags the drag layer 642 to the location of the transfer station icon 641 and the electronic device 100 detects the user's release operation, as shown in FIG6I , the electronic device 100 can turn off the display of the drag layer 642 and display a text thumbnail 643 in the transfer station icon 641.
[0200] As shown in FIG6I , the text thumbnail 643 may be a document pattern. The text thumbnail 643 may be used to prompt the user that the control just dragged into the transfer station is a text control.
[0201] In this way, the electronic device 100 can drag the interface element including multiple controls in the interface 1 into the transfer station.
[0202] After dragging the interface element 633 to the transfer station, the electronic device 100 can also receive and respond to the user's click operation and long press and drag operation on the control in the drag mode interface 640, and drag the control to the transfer station. The specific method can refer to the relevant description in the above embodiment and will not be repeated here. In addition, the electronic device 100 can also receive and respond to the user's click operation on the drag mode interface 640, as shown in Figure 6J, to close the display of the drag mode interface 640 and redisplay the smart screen recognition interface 630.
[0203] As shown in FIG6J , the electronic device 100 displays a smart screen recognition interface 630 . For a detailed description of the smart screen recognition interface 630 , reference may be made to the relevant description of the embodiment shown in FIG6E . Optionally, a transfer station icon 641 may be displayed in the smart screen recognition interface 630 , and a text thumbnail 643 may also be displayed in the transfer station icon 641 .
[0204] In this way, you can exit the drag mode and return to the previous interface.
[0205] After dragging an interface element including multiple controls into the transfer station, the electronic device 100 can store the data of the interface element in the transfer station (for example, the number of controls included in the interface element and the arrangement layout, the picture, text, hyperlink, etc. of each control). If the interface element only includes text controls, the electronic device 100 displays the interface 2 of the application 2, and the transfer station sidebar is displayed on the interface 2, and the thumbnail of the interface element is displayed in the transfer station sidebar. In this case, the electronic device 100 can receive and respond to the user's long press and drag operation on the thumbnail, and display the interface element in the interface 2, or display the text content in the interface element. Among them, the text content in the interface element refers to the text in all text controls in the interface element based on the arrangement layout of the text controls in the interface element. The text content is the text content obtained by splicing the text in all text controls in the interface element based on the arrangement layout of the text controls in the interface element.
[0206] Exemplarily, as shown in FIG6K , the electronic device 100 displays a document editing interface 650. The method of opening the document editing interface 650 can refer to the relevant descriptions in the embodiments shown in FIG3D to FIG3G , and the specific content of the document editing interface 650 can refer to the relevant descriptions of the document editing interface 310 shown in FIG3G . In addition, a transfer station sidebar 651 is also displayed in the document editing interface 650. The transfer station sidebar 651 displays a thumbnail 652, which is a thumbnail corresponding to the interface element 633. In some embodiments, the thumbnail 652 may display part of the text content of the interface element 633. In other embodiments, the thumbnail 652 may also be a picture whose display content is the same as that of the interface element 633, but whose display size is different from that of the interface element 633.
[0207] The electronic device 100 can receive and respond to the user's long press and drag operation on the thumbnail 652, display the drag layer of the thumbnail 652, and drag the drag layer to an area outside the transfer station sidebar 651. When the user's release operation is detected, as shown in Figure 6L, the electronic device 100 can display a text control 653 in the document editing interface 650. The text content in the text control 653 is the same as the text content in the interface element 633 shown in Figure 6E above. In addition, a transfer station icon 654 can also be displayed in the document editing interface 650, and a text thumbnail can be displayed in the transfer station icon 654.
[0208] In this way, an interface element including multiple controls can be transferred to another application through the transfer station.
[0209] It can be understood that the embodiment shown in Figures 6A to 6L is only an example. In the embodiment of the present application, application 1 may also be an application other than the gallery application (including self-developed applications and third-party applications), application 2 may also be an application other than the document application, and the interface elements may also include more or fewer controls. This application does not limit these.
[0210] In some embodiments, if the interface element includes multiple picture controls, the electronic device 100 may also adopt the data transmission method provided in the embodiment of the present application to transmit the interface element from application 1 (e.g., a beauty application) to application 2 (e.g., a document application).
[0211] For example, as shown in FIG7A , the electronic device 100 displays a desktop 200. For a detailed description of the desktop 200, reference may be made to the content of the embodiment shown in FIG2A . The electronic device 100 may receive and respond to a user clicking on the Meitu application icon 208 by displaying a Meitu application interface 700 as shown in FIG7B .
[0212] As shown in FIG7B , the Meitu application interface 700 may display one or more editing controls, such as a picture editing control, a camera control, a puzzle control 701, a video editing control, an artificial intelligence (AI) control, a portrait control, etc. Each of the one or more editing controls may be used to trigger the electronic device 100 to perform a corresponding editing operation on a selected video or picture.
[0213] The electronic device 100 may receive and respond to a user's click operation on the puzzle control 701 to display a picture selection interface 710 as shown in FIG7C .
[0214] As shown in Figure 7C, the picture selection interface 710 may display one or more picture thumbnails, such as thumbnail 711 and thumbnail 712. A selection mark may also be displayed on each thumbnail to prompt the user whether the thumbnail is selected.
[0215] The electronic device 100 may sequentially receive and respond to the user's click operations on the thumbnails 711 and 712 , and display check marks in the selection indicators on the thumbnails 711 and 712 , as shown in FIG. 7D .
[0216] As shown in FIG7D , a check mark is displayed in the selection mark on thumbnail 711 and thumbnail 712, which is used to prompt the user that thumbnail 711 and thumbnail 712 are selected. In addition, after detecting that there is a selected thumbnail, electronic device 100 can display a start puzzle control 713 in image selection interface 710, and start puzzle control 713 is used to trigger electronic device 100 to display puzzle interface 720.
[0217] The electronic device 100 may receive and, in response to a user's click operation on the start puzzle control 713 , display a puzzle interface 720 as shown in FIG. 7E .
[0218] As shown in Figure 7E, puzzle interface 720 may include interface element 721, a save control, a return control, and a mode setting area 722. Mode setting area 722 may display one or more mode options. Interface element 721 may include multiple image controls, such as image control 723 and image control 724. The mode options in mode setting area 722 may be used to trigger electronic device 100 to change the positional relationship between two image controls in interface element 721 or to change the display size of interface element 721.
[0219] The electronic device 100 can receive and respond to the user's sliding operation starting from the right edge of the display screen in an L-shaped trajectory on the display screen, turn on the drag mode, and display the drag mode interface 730 as shown in Figure 7F.
[0220] As shown in Figure 7F, the drag mode interface 730 may include interface element 721 and transfer station icon 731. The specific content of the transfer station icon 731 can refer to the relevant description in the above embodiment, and the specific description of the interface element 721 can refer to the relevant description in the embodiment shown in Figure 7E above.
[0221] The electronic device 100 may receive and respond to a user's click operation on the interface element 721 , and display a check mark on the interface element 721 , as shown in FIG. 7G .
[0222] As shown in Figure 7G, the electronic device 100 displays a check mark on the interface element 721, which may be that the electronic device 100 highlights the interface element 721. In some embodiments, the electronic device 100 may also prompt the user that the interface element 721 is selected by using different display colors or different display brightness. It is understood that this is only an exemplary selection mark. In the embodiment of the present application, the electronic device 100 may also use other selection marks, such as the selection mark described in the embodiment shown in Figure 5C or Figure 5H above, and the present application does not limit this.
[0223] The electronic device 100 receives and responds to the user's long press and drag operation on any point on the drag mode interface 730 , and displays a drag layer 732 in the drag mode interface 640 as shown in FIG7H .
[0224] As shown in FIG7H , the drag layer 732 can be an image with the same display content and the same or different display size as the interface element 721. The drag layer 732 can move along the drag trajectory of the user in the drag mode interface 730. When the user drags the drag layer 7322 to the location of the transfer station icon 7311 and the electronic device 100 detects the user's release operation, as shown in FIG7I , the electronic device 100 can turn off the display of the drag layer 732 and display a thumbnail 733 of the interface element 721 in the transfer station icon 731.
[0225] As shown in FIG. 7I , the thumbnail 733 may be a picture having the same display content as the interface element 721 and a display size smaller than the display size of the transfer station icon 731 .
[0226] In this way, the electronic device 100 can drag the interface element including multiple picture controls in the interface 1 into the transfer station.
[0227] After dragging the interface element 721 to the transfer station, the electronic device 100 may also receive and respond to a user click operation on the drag mode interface 730 , as shown in FIG7J , closing the display of the drag mode interface 730 and redisplaying the puzzle interface 720 .
[0228] As shown in FIG7J , the electronic device 100 displays a puzzle interface 720 . For a detailed description of the puzzle interface 720 , reference may be made to the relevant description of the embodiment shown in FIG7E . Optionally, a transfer station icon 731 may be displayed in the puzzle interface 720 , and a thumbnail 733 may also be displayed in the transfer station icon 731 .
[0229] In this way, you can exit the drag mode and return to the previous interface.
[0230] After dragging an interface element including multiple controls into the transfer station, the electronic device 100 can store the data of the interface element in the transfer station (for example, the number and arrangement of controls included in the interface element, the image, text, hyperlink, etc. of each control). If the interface element only includes image controls, the electronic device 100 displays interface 2 of application 2, and a transfer station sidebar is displayed on interface 2, and a thumbnail of the interface element is displayed in the transfer station sidebar. In this case, the electronic device 100 can receive and respond to the user's long press and drag operation on the thumbnail to display the interface element in interface 2.
[0231] For example, as shown in FIG7K , the electronic device 100 displays a document editing interface 740. The method for opening the document editing interface 740 can refer to the relevant descriptions in the embodiments shown in FIG3D to FIG3G , and the specific content of the document editing interface 740 can refer to the relevant descriptions of the document editing interface 310 shown in FIG3G . In addition, the document editing interface 740 also displays a transfer station sidebar 741, and the transfer station sidebar 741 displays thumbnails 742. Thumbnails 742 are thumbnails corresponding to interface elements 721. In some embodiments, thumbnails 742 can also be pictures that display the same content as interface element 721 but have a different display size than interface element 721.
[0232] The electronic device 100 may receive and respond to the user's long press and drag operation on the thumbnail 742 , and display a drag layer 743 of the thumbnail 742 as shown in FIG. 7L .
[0233] 7L , the drag layer 743 may display the same content and the same or different size as the thumbnail 742 . The drag layer 743 may move along the dragging operation track of the user on the document editing interface 740 .
[0234] When the user drags the drag layer 743 to an area outside the transfer station sidebar 741 and detects the user's release operation, as shown in Figure 7M, the electronic device 100 can display an interface element 744 in the document editing interface 740. The interface element 744 is the same as the interface element 721 in the embodiment shown in Figure 7E above. In addition, a transfer station icon 745 can also be displayed in the document editing interface 740, and a thumbnail 746 can be displayed in the transfer station icon 745. The thumbnail 746 can be a thumbnail of the interface element 721 or a thumbnail of other controls in the transfer station.
[0235] It can be understood that the embodiment shown in Figures 7A to 7M is only an example. In the embodiment of the present application, application 1 may also be an application other than the Meitu application (including self-developed applications and third-party applications), application 2 may also be an application other than the document application, and the interface elements may also include more or fewer controls. This application does not limit these.
[0236] The following describes the specific process of the data transmission method provided in the embodiment of the present application.
[0237] FIG8 shows a schematic diagram of a module interaction process for transmitting data in application 1 to a transfer station according to an embodiment of the present application.
[0238] As shown in FIG8 , the electronic device 100 may include a view 11, a drag frame 12, and a transfer station 13. The specific process of transmitting data in the application 1 to the transfer station may include the following steps:
[0239] S801 , view 11 detects a user long press operation on control 1 in application 1 and determines the type of control 1 . The types of controls include image control, text control, web page view control, etc.
[0240] When displaying interface 1 of application 1 and interface 1 includes control 1, view 11 can receive and respond to a user's long press operation on control 1. After determining that the long press operation targets control 1, the type of control 1 can be determined based on the code of control 1. Control types can include image controls, text controls, web view controls, and so on.
[0241] Exemplarily, the long press operation on control 1 can be the long press operation on the image control 221 in the embodiment shown in Figure 2C above, or the long press operation on the image control 222 in the embodiment shown in Figure 2E above, or the long press operation on the text control 223 in the embodiment shown in Figure 3A above, or the long press operation on the web view control 234 in the embodiment shown in Figure 5A above, etc.
[0242] S802 : View 11 creates an empty drag object based on the type of control 1 . The type of the drag object is the same as that of control 1 .
[0243] The specific content of view 11 creating an empty drag object can refer to the relevant steps in the embodiments shown in Figures 9A to 9C below, which will not be described in detail here.
[0244] S803 , view 11 detects a user drag operation on control 1 , and obtains drag data of control 1 based on the type of control 1 , where the drag data includes one or more of a picture, text, and a hyperlink.
[0245] When a user drag operation on control 1 is detected, view 11 can obtain drag data of control 1 based on the type of control 1. Control types can include any one or more of the following: image control, text control, web view control, etc. In other embodiments, view 11 can also obtain drag data of control 1 in response to a long press operation on control 1 in step S801 above.
[0246] The drag data includes one or more of an image, text, and a hyperlink. In some embodiments, when the control 1 is an image control, the drag data may include the image of the control 1; when the control 1 is a text control, the drag data may include the text of the control 1; when the control 1 is a web view control, the drag data of the control 1 may include the image and hyperlink of the control 1. If a text control exists in the web view control, the drag data of the control 1 may also include the text of the text control.
[0247] In some embodiments, the drag data for control 1 may also include a drag permission for control 1, which indicates that control 1 is a draggable control. Exemplarily, when view 11 determines that the drag data for control 1 includes a drag permission, control 1 is determined to be a draggable control, and the following steps may be performed. When view 11 determines that the drag data for control 1 does not include a drag permission, control 1 is determined to be a non-draggable control, and a prompt may be output to indicate to the user that control 1 cannot be dragged to the transfer station. In other embodiments, view 11 may also check the validity period of the drag permission, i.e., determine whether the drag permission is valid based on the drag permission (e.g., checking the validity period of the drag permission, checking the licensor of the drag permission, etc.), and the check result indicates whether the drag permission is valid. Exemplarily, when view 11 determines that the drag permission for control 1 is valid, control 1 is determined to be a draggable control, and the following steps may be performed. When view 11 determines that the drag permission for control 1 is invalid, control 1 is determined to be a non-draggable control, and a prompt may be output to indicate to the user that control 1 cannot be dragged to the transfer station. It is understandable that the drag data of control 1 may also include more or less content than the above embodiment, and this application does not limit this.
[0248] Based on the type of control 1, view 11 can obtain the drag data of control 1 from the view module corresponding to that type. View modules can include image views (imageview), text views (textview), web views (webview), etc. The specific process of view 11 obtaining drag data based on the type of control 1 and the specific process of generating the drag object of control 1 in the subsequent step S804 can be referred to the content of the embodiments shown in Figures 9A to 9C below and will not be described in detail here.
[0249] S804 , view 11 fills the drag data of control 1 into the empty drag object to generate the drag object of control 1 .
[0250] After acquiring the drag data of control 1, view 11 can fill the drag data of control 1 into the empty drag object to generate the drag object of control 1. For the specific process, please refer to the embodiment shown in Figures 9A to 9C below.
[0251] S805 , view 11 sends a drag instruction to the drag framework 12 , where the drag instruction includes the drag object of control 1 .
[0252] After generating the drag object of the control 1, the view 11 may send a drag instruction to the drag framework 12, where the drag instruction includes the drag object of the control 1. The drag instruction is used to instruct the drag framework 12 to initiate dragging.
[0253] S806: The drag framework 12 sends a start instruction to the transfer station 13, instructing to start the transfer station.
[0254] Step S806 is an optional step.
[0255] In some embodiments, upon receiving and responding to a drag instruction, when detecting that the transfer station 13 is not started, the drag framework 12 may send a start instruction to the transfer station 13 , where the start instruction is used to instruct to start the transfer station.
[0256] In other embodiments, upon receiving and responding to the drag instruction, upon detecting that the transfer station 13 has been started, the drag framework 12 may execute the following step S809 and subsequent steps.
[0257] S807, the transfer station 13 opens the transfer station and displays the transfer station icon.
[0258] The transfer station 13 receives and responds to the start instruction of the drag frame 12 , starts the transfer station, and draws and displays the transfer station icon.
[0259] Exemplarily, the transfer station icon may be the transfer station icon 224 shown in FIG. 2D .
[0260] S808 , the drag framework 12 displays the drag layer and the drag track of the control 1 based on the drag object of the control 1 .
[0261] After receiving the drag object of the control 1 , the drag framework 12 may draw and display the drag layer and the drag track of the control 1 based on the drag data in the drag object of the control 1 .
[0262] The drag layer of control 1 can be an image with the same display content as control 1, and the display size of the drag layer can be the same as or different from the display size of control 1. For example, if control 1 is the image control 221 in Figure 2C above, the drag layer of control 1 can be the drag layer 225 shown in Figure 2D; if control 1 is the image control 234a in the web view control 234 shown in Figure 4B above, the drag layer of control 1 can be the drag layer 237 shown in Figure 4C; if control 1 is the text control 223 shown in Figure 3A above, the drag layer of control 1 can be the drag layer 229 shown in Figure 3B.
[0263] The drag track can be drawn and displayed based on the track of user operation 1. It should be noted that in the above step S801, the object of user operation 1 is control 1, but it is the drag layer of control 1 that moves along the track of operation 1, and control 1 is still displayed in the original position.
[0264] S809 , when the drag layer is dragged to the area where the transfer station icon is located and a release operation of the user in the area is detected, the drag framework 12 sends the drag object of the control 1 to the transfer station 13 .
[0265] After the transfer station 13 is started, when it is detected that the user drags the drag layer to the area where the transfer station icon is located and detects the user releases the operation in the area, the drag framework 12 can send the drag object of the control 1 to the transfer station 13.
[0266] S810: The transfer station 13 displays a thumbnail of the control 1 on the transfer station icon based on the dragged object of the control 1.
[0267] After receiving the dragged object of control 1, transfer station 13 can generate a thumbnail of control 1 based on the drag data in the dragged object or the type of the dragged object. The thumbnail of control 1 can be an image with the same display content as control 1 and a display size smaller than or equal to the display size of control 1. It should be noted that the display size of the thumbnail displayed on the transfer station icon is smaller than the display size of the transfer station icon.
[0268] When control 1 is an image control or a web view control, transfer station 13 can obtain an image of control 1 based on the dragged object of control 1 and generate a thumbnail of control 1. For example, if control 1 is image control 221 shown in FIG. 2C , the thumbnail of control 1 can be thumbnail 226 shown in FIG. 2E . For another example, if control 1 is image control 234a in web view control 234 shown in FIG. 4B , the thumbnail of control 1 can be thumbnail 238 shown in FIG. 4D .
[0269] When control 1 is a text control, transfer station 13 can obtain the text of control 1 from the dragged object and generate a thumbnail of control 1 based on the text. In some embodiments, transfer station 13 can also determine that control 1 is a text control based on the dragged object and generate a text thumbnail based on the type of control 1. The text thumbnail is used to indicate the type of control 1. For example, the text thumbnail can be text thumbnail 223a shown in FIG. 3A above.
[0270] After generating the thumbnail of the control 1 , the transfer station 13 may display the thumbnail of the control 1 on the transfer station icon.
[0271] S811 , the transfer station 13 stores the drag object and thumbnail of the control 1 .
[0272] After generating the thumbnail of the control 1 , the transfer station 13 may store the thumbnail of the control 1 and the dragged object in a corresponding relationship.
[0273] Exemplarily, Table 1 shows a correspondence between drag objects and thumbnails stored in the transfer station 13 .
[0274] Table 1
[0275] As shown in Table 1, the transfer station 13 can store thumbnails and drag objects corresponding to one or more controls. There is a correspondence between the thumbnails and drag objects of the same control. As shown in Table 1, the thumbnail corresponding to drag object a is picture a; the thumbnail corresponding to drag object b is picture b.
[0276] It is understandable that the embodiment shown in Table 1 is only an example. In the embodiment of the present application, the transfer station 13 can also store more or less data, and can also store content different from the embodiment shown in Table 1. The present application does not limit this.
[0277] In some embodiments, the transfer station 13 can obtain the type and drag data of the control 1 from the drag object. After generating a thumbnail of the control 1, the transfer station 13 can store the type, thumbnail and drag data of the control 1 in a corresponding relationship.
[0278] Exemplarily, Table 2 shows a correspondence between control types, drag data, and thumbnails stored in the transfer station 13 .
[0279] Table 2
[0280] As shown in Table 2, the transfer station 13 can store the type, thumbnail, and drag data corresponding to one or more controls. There is a corresponding relationship between the thumbnail, type, and drag data of the same control. Table 2 shows that the drag data of an image control includes image d, and the thumbnail of the image control is image a; the drag data of a text control includes text a, and the thumbnail corresponding to the text control is image b; the drag data of a web view control includes image e and hyperlink c, and the thumbnail of the web view control is image c.
[0281] It is understandable that the embodiment shown in Table 2 is only an example. In the embodiment of the present application, the transfer station 13 can also store more or less data, and can also store content different from the embodiment shown in Table 2. This application does not limit this.
[0282] The data transmission method provided in the embodiment of the present application can realize cross-process data transmission. Not only is the operation simple, but also, if the third-party application is not adapted, the pictures, text, web page view controls and other controls in the third-party application can be transferred to the transfer station.
[0283] The following is a flow chart of how View 11 obtains the drag data of Control 1 based on the type of Control 1 and generates a drag object.
[0284] FIG9A shows a specific process of obtaining drag data of an image control and generating a drag object of the image control, provided by an embodiment of the present application.
[0285] As shown in Figure 9A, when control 1 is an image control, view 11 may include a top-level view (decorview) 1101 and a graphics view (imageview) 1102. The top-level view 1101 may include an image drag (imagedragEx) module 1101a. The specific process of view 11 acquiring the drag data of the image control and generating the drag object of the image control may include the following steps:
[0286] S901a, when the view 11 determines that the type of the control 1 is a picture control, the graphic drag module 1101a creates an empty drag object, and the type of the drag object is a picture control.
[0287] In the case of determining that the control 1 is a picture control, the graphic drag module 1101a may create an empty drag object based on the type of the control 1, where the type of the drag object is a picture control.
[0288] S902a , the graphic drag module 1101a obtains the drag data of the control 1 from the graphic view 1102 , including the image of the control 1 .
[0289] S903a, the graphic drag module 1101a fills the drag data of control 1 into the empty drag object to generate the drag object of control 1.
[0290] In this way, when a long press and drag operation of the user on the image control is detected, the drag response of the graphic view (imageview) 1102 can be called to obtain the image of the image control and generate a drag object of the image control.
[0291] FIG9B shows a specific process of obtaining drag data of a text control and generating a drag object of the text control, provided by an embodiment of the present application.
[0292] As shown in Figure 9B, when control 1 is a text control, view 11 may include a top-level view (decorview) 1101 and a text view (textview) 1103. The top-level view 1101 may include a text drag module (textdragEx) 1101b. The specific process of view 11 obtaining the drag data of the text control and generating the drag object of the text control may include the following steps:
[0293] S901b: When view 11 determines that the type of control 1 is a text control, the text drag module 1101b creates an empty drag object, and the type of the drag object is a text control.
[0294] When it is determined that the control 1 is a text control, the text drag module 1101b may create an empty drag object based on the type of the control 1, where the type of the drag object is a text control.
[0295] S902b, the text drag module 1101b obtains the drag data of control 1 from the text view 1103, including the text of control 1.
[0296] S903b, the text drag module 1101b fills the drag data of control 1 into the empty drag object to generate the drag object of control 1.
[0297] In this way, when a long press and drag operation of a user on a text control is detected, the drag response of the text view (textview) 1103 can be called to obtain the text of the text control and generate a drag object of the text control.
[0298] FIG9C shows a specific process of obtaining drag data of a webpage view control and generating a drag object of the webpage view control, provided by an embodiment of the present application.
[0299] As shown in Figure 9C, when control 1 is a web view control, view 11 may include a top-level view (decorview) 1101 and a web view (webview) 1104. Top-level view 1101 may include a web drag module (webdragEx) 1101c. The specific process by which view 11 obtains drag data from the web view control and generates a drag object for the web view control may include the following steps:
[0300] S901c, when the view 11 determines that the type of the control 1 is a web view control, the web drag module 1101c creates an empty drag object, and the type of the drag object is a web view control.
[0301] When it is determined that the control 1 is a web view control, the web drag module 1101c may create an empty drag object based on the type of the control 1, where the type of the drag object is a web view control.
[0302] S902c, the webpage drag module 1101c obtains the drag data of the control 1 from the webpage view 1104, including the image and hyperlink of the control 1.
[0303] In some embodiments, the drag data of control 1 may also include text in control 1 .
[0304] In other embodiments, the drag data of control 1 may also only include a picture of control 1, that is, the web view control is transmitted as a picture.
[0305] S903c, the webpage drag module 1101c fills the drag data of control 1 into the empty drag object to generate the drag object of control 1.
[0306] In this way, when a long press and drag operation of the user on the web view control is detected, the drag response of the web view (webview) 1104 can be called to obtain the drag data of the web view control and generate a drag object of the web view control.
[0307] In one possible implementation, upon detecting a user operation 1 on control 1, view 11 may obtain the type and drag data of control 1 and generate a drag object for control 1 based on the type and drag data of control 1. In some embodiments, operation 1 may be a single operation, such as a long-press drag operation. In other embodiments, operation 1 may be a combined operation, including a long-press operation and a drag operation.
[0308] In some embodiments, when the user's long press operation (or touch operation) on control 1 has native logic, the top-level view (decorview) 1101 can determine the next execution logic by detecting whether there is a drag operation on control 1. The native logic of control 1 refers to the event response that the electronic device 100 receives and executes in response to the user's long press operation on control 1 when the method of the present application is not implemented.
[0309] FIG10 shows a schematic diagram of the top-level view 1101 determining the execution logic based on the user's drag operation in an embodiment of the present application.
[0310] As shown in FIG10 , when the top-level view 1101 receives a touch or long press operation on the control 1 by the user, it can trigger drag behavior detection to detect whether the user performs a drag operation on the control 1 after the touch or long press operation.
[0311] If a user drag operation on control 1 is detected, the top-level view 1101 can call the drag response of the corresponding view module (such as graphic view, text view, web page view, custom control view, etc.), execute the data transmission method provided in the embodiment of the present application, and transmit the drag data of control 1 to the transfer station.
[0312] If no user drag operation on control 1 is detected, the top-level view 1101 can trigger the event distribution process, and call the corresponding view module based on the native logic of control 1 to execute the original event response, such as displaying the web page view corresponding to control 1.
[0313] The top-level view 1101 can set a time period for dragging behavior detection, that is, within a preset time period, it determines whether to execute the data transmission method provided in this application based on whether a user dragging operation on control 1 is detected.
[0314] In some embodiments, the top-level view 1101 may also determine whether to trigger drag behavior detection by detecting the duration of a long press operation. For example, if the long press operation is detected to have lasted for a preset time (e.g., 1.5 seconds), drag behavior detection is triggered. If the long press operation does not last for the preset time, the event distribution process is triggered.
[0315] In some embodiments, control 1 may also be a developer-defined control (also known as a custom control), such as a custom text control. Transfer station 13 may also include accessibility services. When control 1 is a custom text control, view 11 cannot obtain the text of control 1 from text view (textview) 1103. In this case, transfer station 13 can pull up accessibility services and obtain the text of control 1 through the accessibility services.
[0316] FIG11 shows a specific process for transmitting data of control 1 in application 1 to transfer station 13 provided by an embodiment of the present application when control 1 is a custom text control.
[0317] As shown in Figure 11, the electronic device 100 may include a view 11, a drag frame 12, and a transfer station 13. The transfer station 13 may include an accessibility service 1301. In the case where the control 1 is a custom text control, the embodiment of the present application provides a specific process for transmitting data of the control 1 in the application 1 to the transfer station 13, which may include the following steps:
[0318] S1101 , view 11 detects user operation 1 on control 1 in application 1 , and determines that the type of control 1 is a custom text type.
[0319] When the interface of application 1 is displayed and includes control 1, view 11 can detect a user operation 1 on control 1 in application 1 and determine the type of control 1. Operation 1 can be a single operation, such as a long-press and drag operation, or a combined operation, such as a long-press and drag operation. If operation 1 includes both a long-press and a drag operation, view 11 can also determine the type of control 1 in response to the long-press operation and execute step S1102 below. If a drag operation is detected, step S1103 and subsequent steps are executed.
[0320] View 11 may store one or more custom text types, such as type A, type B, type C, etc. When it is determined that the type of control 1 is the same as one of the custom text types stored in view 11, view 11 may determine that the type of control 1 is a custom text type.
[0321] S1102, view 11 creates an empty drag object, and the type of the drag object is a custom text control.
[0322] The drag object can be used to prompt the type of control 1.
[0323] S1103 , view 11 obtains the image of control 1 .
[0324] The image of control 1 refers to the image displayed by control 1 on the interface.
[0325] S1104 , view 11 sends a drag instruction to the drag framework 12 , where the drag instruction includes an empty drag object and the image of control 1 .
[0326] The empty drag object can be used to indicate that the type of the control 1 is a custom text type, and can also be used to instruct the drag framework 12 to send an accessibility service start instruction to the transfer station 13 .
[0327] In some embodiments, the empty drag object in the drag instruction may also be replaced with the type of control 1 , ie, a custom text type, for instructing the drag framework 12 to send an accessibility service start instruction to the transfer station 13 .
[0328] S1105 , the drag framework 12 sends an accessibility service start instruction to the transfer station 13 , for instructing the transfer station to start the accessibility service.
[0329] Step S1105 is optional. After receiving the drag command, the drag framework 12 can detect whether the accessibility service is enabled. If the accessibility service is not enabled, a startup instruction for the accessibility service is sent to the transfer station 13. If the accessibility service is enabled, step S1110 and subsequent steps can be executed.
[0330] In some embodiments, if the drag frame 12 detects that the transfer station 13 is not started, the drag frame 12 can pull up the transfer station. For details, please refer to the above steps S806 to S807, which will not be repeated here.
[0331] S1106 , the transfer station 13 sends an activation instruction to the barrier-free service 1301 , instructing to activate the barrier-free service.
[0332] The start instruction may include operation 1, such as a long press and drag operation. The start instruction may be used to instruct the accessibility service 1301 to register and monitor an event, where the event is a long press operation or a long press and drag operation performed by the user on the electronic device 100.
[0333] S1107, the accessibility service 1301 registers to monitor events.
[0334] After accessibility service 1301 is started, it can register for event monitoring to monitor user operations 1 on electronic device 100, such as a long-press drag operation or a long-press operation. After registering for event monitoring, when view 11 detects operation 1 on control 1, accessibility service 1301 can obtain the image of control 1 through view 11 and obtain the text of control 1 based on the image analysis of control 1.
[0335] S1108 , view 11 detects the user's operation 1 on control 1 and sends a drag instruction to the drag frame 12 .
[0336] The drag instruction includes an empty drag object and an image of control 1.
[0337] S1109 , the drag framework 12 draws and displays the drag layer and drag track of the control 1 based on the image of the control 1 .
[0338] S1110 , the drag framework 12 sends a text acquisition instruction to the transfer station 13 , where the text acquisition instruction includes an empty drag object and an image of the control 1 .
[0339] The empty drag object is used to indicate that the type of control 1 is a custom text type, and can also be used to instruct the transfer station 13 to obtain the text of control 1 based on the image of control 1. In some embodiments, the empty drag object in the text acquisition instruction can also be replaced with the type of control 1, that is, the custom text type, to instruct the transfer station 13 to obtain the text of control 1 based on the image of control 1.
[0340] S1111 , the transfer station 13 sends a text acquisition request to the accessibility service 1301 , requesting to acquire the text of control 1 .
[0341] The text retrieval request may include an image of control 1 .
[0342] S1112 , the accessibility service 1301 sends the text of control 1 to the transfer station 13 .
[0343] The accessibility service 1301 can call the accessibility framework to analyze the text of the control 1 based on the image of the control 1, and send the text of the control 1 to the transfer station 13.
[0344] S1113 , the transfer station 13 generates a thumbnail of the control 1 based on the text of the control 1 .
[0345] The transfer station 13 may generate a thumbnail based on the text of the control 1 . In some embodiments, the transfer station 13 may also generate a text thumbnail based on the type of the control 1 .
[0346] After the transfer station 13 generates a thumbnail based on the text of the control 1, the transfer station 13 may also store the correspondence between the thumbnail, the text content, and the control type (custom text control). The specific storage method can refer to the relevant content in step S811 shown in Figure 8 above, which will not be repeated here. In other embodiments, the transfer station 13 may also generate a drag object of the control 1 based on the text of the control 1 and an empty drag object, and store the thumbnail of the control 1 and the correspondence between the drag object.
[0347] S1114: When the user drags the drag layer to the area where the transfer station icon is located and a release operation of the user in the area is detected, a thumbnail of the control 1 is displayed on the transfer station icon.
[0348] S1115 , when the transfer station 13 detects that the closing condition is met, it sends a closing instruction to the accessibility service 1301 to instruct the accessibility service to be closed.
[0349] Step S1115 and step S1116 are optional steps.
[0350] The closing conditions may include any one or more of the following: detecting that the accessibility service has not been used within a preset period of time, receiving a user operation to close the accessibility service, etc.
[0351] In some embodiments, accessibility services may not be disabled.
[0352] S1116, the accessibility service 1301 ends monitoring the event.
[0353] After receiving the close instruction, the accessibility service 1301 may end the monitoring event and stop monitoring operation 1.
[0354] By adopting the data transmission method provided in the embodiment of the present application, the text of the custom text control can be obtained through the accessibility service and the text of the custom text control can be transmitted to the transfer station.
[0355] In some embodiments, the data in the transfer station 13 may also be transmitted to other applications.
[0356] FIG12 shows a specific process of transmitting data in the transfer station 13 to the application 2 provided in an embodiment of the present application.
[0357] As shown in Figure 12, the electronic device 100 may include an application 2, a drag frame 12, and a transfer station 13. The specific process of transferring data from the transfer station 13 to the application 2 may include the following steps:
[0358] S1201 , the transfer station 13 displays one or more thumbnails, including thumbnail 1 , on the interface of application 2 .
[0359] According to step S811 shown in FIG. 8 , after the control 1 of the application 1 is dragged into the transfer station 13 , the transfer station 13 stores thumbnails of one or more controls and corresponding dragged objects.
[0360] When the electronic device 100 displays the interface of application 2, the transfer station 13 may display the one or more thumbnails in the interface of application 2. The one or more thumbnails may include thumbnail 1.
[0361] Exemplarily, the interface of application 2 may be the document editing interface 310 shown in FIG3I above, and the one or more thumbnails may be one or more thumbnails displayed in the transfer station sidebar 320 shown in FIG3I , namely thumbnail 321 , thumbnail 322 and thumbnail 323 , and thumbnail 1 may be the above thumbnail 321 .
[0362] As another example, the interface of application 2 may also be the image and text editing interface 240 shown in FIG. 2K , and thumbnail 1 may be the thumbnail 242 shown in FIG. 2K .
[0363] It should be noted that the display size of the thumbnail displayed in step S1201 may be the same as or different from the display size of the thumbnail displayed in step S810.
[0364] S1202 : The transfer station 13 receives and responds to the user's operation 2 on the thumbnail 1 , and determines the drag object 1 corresponding to the thumbnail 1 .
[0365] Operation 2 may be a long press and drag operation.
[0366] The user's operation 2 on thumbnail 1 can be a long press and drag operation on thumbnail 321 by the user in the embodiment shown in Figure 3I above, or it can be a long press and drag operation on transfer station icon 241 (thumbnail 242 is displayed in transfer station icon 241) by the user in the embodiment shown in Figure 2K above.
[0367] When it is determined that the object of operation 2 includes thumbnail 1 , the transfer station 13 may determine the drag object 1 corresponding to thumbnail 1 based on the stored relationship between thumbnails and drag objects.
[0368] S1203 , the transfer station 13 sends a drag instruction including the drag object 1 to the drag framework 12 .
[0369] The drag instruction is used to initiate dragging to the drag frame 12 .
[0370] S1204 , the drag framework 12 displays a drag layer and a drag track on the interface of the application 2 based on the drag object 1 .
[0371] After receiving the drag object 1 , the drag framework 12 may draw and display a drag layer and a drag track based on the drag object 1 .
[0372] In some embodiments, the displayed content of the drag layer can be the same as the displayed content of thumbnail 1. For example, if thumbnail 1 is thumbnail 321 shown in Figure 3I , the drag layer can be thumbnail 321 shown in Figure 3J above. If thumbnail 1 is thumbnail 421 shown in Figure 4I , the drag layer can be thumbnail 421 shown in Figure 4J above.
[0373] In other embodiments, if the object of the user's long-press drag operation is a transfer station icon, the drag layer can be the transfer station icon. For example, if thumbnail 1 is thumbnail 242 in transfer station icon 241 shown in Figure 2K, the drag layer can be transfer station icon 241 shown in Figure 2L above.
[0374] The drag track may be drawn and displayed based on the track of the user's drag operation.
[0375] S1205 : After receiving and responding to the user's release operation, the drag framework 12 sends the drag object 1 to the application 2 .
[0376] S1206 , application 2 displays a control on the interface of application 2 based on dragged object 1 .
[0377] After receiving drag object 1, application 2 can draw and display a control on its interface based on drag object 1. If drag object 1 is an image, the control can be an image control, and the image in the image control is the image in drag object 1; if drag object 1 is a text type, the control can be a text control, and the text in the text control is the text in drag object 1; if drag object 1 is a web view control, the control can be a web view control, and the web view control can include the image and hyperlink in drag object 1.
[0378] Exemplarily, the interface of application 2 may be the graphic editing interface 240 shown in FIG2M above, and the controls displayed based on the dragged object 1 may include a picture control 243 and a picture control 244; the interface of application 2 may be the document editing interface 310, and the controls displayed based on the dragged object 1 may be a text control 315; the interface of application 2 may be the chat interface 410 shown in FIG4K above, and the controls displayed based on the dragged object 1 may be the web view control 414 shown in FIG4K.
[0379] The data transmission method provided in the embodiment of the present application can be used to transmit data in the transfer station to other applications. In this way, data from one application can be transferred to another application through the transfer station, and the operation steps are simple, efficient, and no third-party application adaptation is required.
[0380] In some embodiments, the electronic device 100 may also have a drag mode. In the drag mode, the electronic device 100 may use the data transmission method provided in the embodiment of the present application to simultaneously transmit multiple controls in application 1 to application 2 through the transfer station.
[0381] FIG13 shows a flow chart of simultaneously dragging multiple controls using a data transmission method provided by an embodiment of the present application.
[0382] As shown in Figure 13, the electronic device 100 may include application 1, application 2, a drag frame 12, a window management service (windowmanagerservice) 14, and a system interface (systemUI) 15. When the electronic device 100 displays the interface 1 of application 1, the specific process of simultaneously dragging multiple controls using the data transmission method may include the following steps:
[0383] S1301 , the window management service 14 sends the drag data of all draggable controls in the interface 1 to the system interface 15 , where the drag data includes any one or more of images, texts, and hyperlinks.
[0384] All draggable controls in interface 1 may include any one or more of a picture control, a text control, and a webview control. The drag data of each control may include any one or more of a picture, text, and a hyperlink. For example, the drag data of a picture control may include the picture of the picture control, the drag data of a text control may include the text of the text control, and the drag data of a webview control may include the hyperlink and picture of the webview control, and optionally, the text in the webview control. Exemplarily, interface 1 may be the group chat interface 220 shown in FIG. 5A above. In this case, the draggable controls in interface 1 may include the picture control 221, picture control 222, and text control 223 shown in FIG. 5A.
[0385] When the drag data of a control is sent to the system interface 15, the control identifier is also carried. The control identifier is used to identify the control and also to identify the drag data belonging to the same control. The control identifier can include any one or more of the following: identifier (id), name (name), link text (LinkText), category (class), CSS information, XPath information, etc.
[0386] S1302 , the system interface 15 receives and stores the drag data of all draggable controls in the interface 1 .
[0387] After receiving the drag data of all draggable controls in the interface 1, the system interface 15 can store the corresponding relationship between the identifier of each control and the drag data in all draggable controls in the interface 1. For example, Table 3 shows a corresponding relationship between the identifier of the control and the drag data stored in the system interface 15.
[0388] Table 3
[0389] As shown in Table 3, the system interface 15 may store a correspondence between the identifiers of one or more controls and the dragged data. Optionally, a correspondence between the identifiers of the one or more controls and the control types may also be stored. Table 3 shows that the control identified as Control 1 is an image control, and the dragged data is an image f; the control identified as Control 2 is a text control, and the dragged data is text b; and the control identified as Control 3 is a web view control, and the dragged data is an image g and a hyperlink d.
[0390] It is understandable that the embodiment shown in Table 3 is only an example. In the embodiment of the present application, the system interface 15 may store more or less data, and may also store content different from the embodiment shown in Table 3. The present application does not limit this.
[0391] S1303 , the system interface 15 receives and responds to the user's operation 3 , and displays a drag mode interface, which includes all draggable controls in the interface 1 .
[0392] Operation 3 is used to trigger the start of drag mode. Operation 3 can be an L-shaped sliding operation on the display screen starting from the edge of the display screen, a sliding operation in the left or upward direction from the edge of the display screen, a long press operation after the sliding operation, or other customized operation gestures, etc., which are not limited in this application.
[0393] The drag mode interface may include all draggable controls in interface 1. System interface 15 may display the drag mode interface based on the drag data of all draggable controls in interface 1 acquired in step S1301. For example, the drag mode interface may be the drag mode interface 500 shown in FIG. 5B .
[0394] S1304 , application 1 receives and responds to user operation 4 on the drag mode interface, and determines the coordinate 1 of the position of operation 4 in the drag mode interface.
[0395] Operation 4 can be a user click operation on any point on the drag mode interface, for example, in the embodiment shown in FIG5B above, the user clicks on the image control 221, or the user clicks on the image control 222, or the user clicks on the text control 223, and so on.
[0396] Coordinate 1 is used to indicate the position of operation 4 in the drag mode interface.
[0397] S1305 , application 1 sends coordinate 1 to the drag framework 12 .
[0398] After determining the coordinate 1 , the application 1 may send the coordinate 1 to the drag framework 12 .
[0399] S1306 , the drag framework 12 determines whether a draggable control is displayed at the position indicated by coordinate 1 .
[0400] After receiving the coordinate 1, the drag framework may determine whether a draggable control is displayed at the position in the drag mode interface indicated by the coordinate 1.
[0401] If a draggable control is displayed at the position indicated by coordinate 1, the drag framework 12 executes step S1307 to mark the control.
[0402] If no draggable control is displayed at the position indicated by coordinate 1, the drag framework 12 executes step S1308 to determine that the operation object of operation 4 is empty.
[0403] S1307: Drag the frame 12 to mark the control.
[0404] If a draggable control is displayed at the position indicated by coordinate 1 , and the drag framework 12 determines that the operation object of operation 4 is a draggable control, the drag framework 12 may mark the control.
[0405] In some embodiments, the drag frame 12 may further display a check mark on the control in the drag mode interface. The check mark may be the mark in the selection indicator 502 shown in FIG. 5C , or a pattern of other shapes. In addition, in some embodiments, the check mark may also be a different display color, different display brightness, etc. for the control, such as the relevant description in the embodiment shown in FIG. 5H , which is not limited herein.
[0406] S1308: The drag framework 12 determines that the operation object is empty.
[0407] It should be noted that, in the embodiment of the present application, steps S1304 to S1308 are steps that can be repeatedly executed, and the number of repetitions is the same as the number of times the user performs operation 4 on the drag mode interface.
[0408] S1309 , application 1 receives and responds to user operation 5 on the drag mode interface, and sends a drag instruction to the drag framework 12 .
[0409] Operation 5 may be a long press and drag operation of the user on any point on the drag mode interface.
[0410] The drag instruction may be used to instruct the drag framework 12 to drag all marked controls.
[0411] S1310: The drag framework 12 sends an acquisition request to the system interface 15, requesting to acquire the drag data of the marked control.
[0412] The acquisition request may include the identifier of the marked control. The marked control may include one or more controls, and the identifier of the marked control may include the identifiers of the one or more controls.
[0413] S1311 , the system interface 15 sends the drag data of the marked control to the drag framework 12 .
[0414] After receiving the acquisition request, the system interface 15 can determine the drag data of the marked control from the stored drag data of multiple draggable controls based on the identifier of the marked control in the acquisition request, and send the drag data of the marked control to the drag framework 12.
[0415] S1312: The drag framework 12 receives and stores the drag data of the marked control.
[0416] After receiving the drag data of the marked controls, the drag frame 12 can store the corresponding relationship between the identifier of each control in the marked controls and the drag data. The specific storage method can refer to the content of the embodiment shown in Table 3 above, and will not be repeated here. Among them, the drag frame 12 stores the corresponding relationship between the identifier of each control in the marked controls and the drag data. It can be stored by the drag frame 12. In other embodiments, it can also be sent to the transfer station 13 by the drag frame 12 and stored by the transfer station 13. The specific operation steps can refer to the relevant steps in Figures 8 to 12 above.
[0417] S1313 , the drag framework 12 receives and responds to the user's operation 6 , and sends the drag data of the control 1 stored in the drag framework 12 to the application 2 .
[0418] Operation 6 is used to send the drag data of the control 1 stored in the drag framework 12 (or the transfer station 13 ) to the application 2 .
[0419] In some embodiments, operation 6 can be a long press and drag operation on the transfer station icon, or a long press and drag operation on the thumbnail in the transfer station sidebar, for example, the long press and drag operation on thumbnail 321 in the embodiment shown in Figure 3I above, or the long press and drag operation on thumbnail 421 in the embodiment shown in Figure 4I above, and so on.
[0420] S1314 , the system interface 15 receives and responds to the user's operation 7 , and closes the display of the drag mode interface.
[0421] Operation 7 is used to exit drag mode and close the drag mode interface. Operation 7 can be a click operation on any point on the drag mode interface 500 in the embodiment shown in Figure 5E above, or a click operation on an area of the drag mode interface 500 that does not display a draggable control. In some embodiments, Operation 7 can also be other gestures or custom gesture operations, etc., which are not limited in this application.
[0422] In this way, after the drag mode is turned on, multiple controls in application 1 can be simultaneously transferred to application 2 through the drag framework 12 (or through the drag framework 12 and the transfer station 13). The operation is simple and the efficiency of dragging multiple controls is improved.
[0423] It should be noted that after the drag mode is turned on, the transfer station icon can be displayed in the drag mode interface, the drag layer and drag track can be displayed during the dragging process, and the drag data of the marked control can be sent to the transfer station 13, which stores the drag data of the marked control and displays a thumbnail on the transfer station icon. For specific steps, please refer to the relevant steps in the embodiment shown in Figure 8 above, and will not be repeated here.
[0424] FIG14 shows a schematic diagram of a process of dragging an interface element including multiple controls using a data transmission method provided in an embodiment of the present application.
[0425] As shown in Figure 14, the electronic device 100 may include application 1, application 2, a drag frame 12, a window management service (windowmanagerservice) 14, and a system interface (systemUI) 15. When the electronic device 100 displays an interface 1 of application 1, and the interface 1 displays an interface element 1 including multiple controls, the specific process of using the data transmission method to drag the interface element including multiple controls may include the following steps:
[0426] S1401 , application 1 sends registration information of interface element 1 in interface 1 to the drag framework 12 , including multiple control identifiers in interface element 1 , arrangement layout information of the multiple controls, and drag data of each control.
[0427] Among them, the identifier of the control and the drag data of the control can refer to the relevant description of the drag data in step S1301 shown in Figure 13 above. The arrangement and layout information of multiple controls in the interface element 1 can be the relative position relationship of the multiple controls, or it can be the coordinate information of each control in the multiple controls in the same coordinate system, and the coordinate system can be a two-dimensional coordinate system constructed on the interface 1 with any point on the interface 1 as the origin. In some embodiments, the arrangement and layout information of the multiple controls can also be other information that can be used to indicate the position relationship of the multiple controls in the interface element 1, and this application does not limit it here.
[0428] In some embodiments, upon detecting the presence of an interface element 1 comprising multiple controls in the currently displayed interface 1, application 1 may send registration information for interface element 1 to drag framework 12. In other embodiments, application 1 may also receive and send registration information for interface element 1 to drag framework 12 in response to a specific preset operation. It is understood that if one or more other interface elements comprising multiple controls exist in interface 1, application 1 may also send registration information for those one or more interface elements to drag framework 12, although this application does not limit this.
[0429] S1402 , the drag framework 12 receives and stores registration information of the interface element 1 .
[0430] The drag frame 12 may store registration information of the interface element 1 . For example, Table 4 shows registration information of the interface element 1 stored in the drag frame 12 .
[0431] Table 4
[0432] As shown in Table 4, the registration information of the interface element 1 stored in the drag frame may include the corresponding relationship between the identifiers of multiple controls, drag data, and arrangement layout information, and optionally, may also include the types of the multiple controls.
[0433] According to Table 4, interface element 1 can include three controls, which are identified as control 1, control 2 and control 4, respectively. Among them, the control type identified as control 1 is a picture control, the drag data is picture f, and the control is located in the upper left corner of interface element 1; the control type identified as control 2 is a text control, the drag data is text b, and the control is located in the upper right corner of interface element 1; the control type identified as control 4 is a picture control, the drag data is picture h, and the control is located in the lower part of interface element 1.
[0434] It is understandable that the embodiment shown in Table 4 is only an example. In the embodiment of the present application, the registration information of the interface element 1 may include more or less data, and may also store content different from the embodiment shown in Table 4. The present application does not limit this.
[0435] S1403, the window management service (windowmanagerservice) 14 sends the drag data of all draggable controls in the interface 1 to the system UI (systemUI) 15, where the drag data includes any one or more of pictures, texts, and hyperlinks.
[0436] S1404 , the system interface 15 receives and stores the drag data of all draggable controls in the interface 1 .
[0437] S1405 , the system interface 15 receives and responds to the user's operation 3 of starting the drag mode, and displays the drag mode interface, which includes all draggable controls in the interface 1 .
[0438] S1406 , application 1 receives and responds to user operation 4 on the drag mode interface, and determines coordinate 1 of the location of operation 4 in the drag mode interface.
[0439] S1407 , application 1 sends coordinate 1 to the drag framework 12 .
[0440] The specific contents of steps S1403 to S1407 can refer to the relevant contents of steps S1301 to S1305 in the embodiment shown in FIG13 above, and will not be repeated here.
[0441] S1408 , the drag framework 12 determines whether a draggable control is displayed at the position indicated by coordinate 1 .
[0442] If a draggable control is displayed at the position indicated by coordinate 1, the drag framework 12 executes step S1409 to mark the control.
[0443] If no draggable control is displayed at the position indicated by coordinate 1, the drag framework 12 executes step S1412 to determine that the operation object of operation 4 is empty.
[0444] S1409 , the drag framework 12 determines whether the control belongs to the interface element 1 based on the registration information of the interface element 1 .
[0445] If the control belongs to interface element 1, the drag frame 12 executes the following step S1410.
[0446] If the control does not belong to the interface element 1, the drag frame 12 executes the following step S1411.
[0447] S1410 , drag the frame 12 to mark the interface element 1 .
[0448] S1411, drag the frame 12 to mark the control.
[0449] S1412: The drag framework 12 determines that the operation object is empty.
[0450] It should be noted that, in the embodiment of the present application, steps S1405 to S1412 are steps that can be repeatedly executed, and the number of repetitions is the same as the number of times the user performs operation 4 on the drag mode interface.
[0451] S1413 , application 1 receives and responds to user operation 5 on the drag mode interface, and sends a drag instruction to the drag framework 12 .
[0452] S1414 , the drag framework 12 sends an acquisition request to the system interface 15 , requesting to acquire the drag data of the marked control.
[0453] S1415 , the system interface 15 sends the drag data of the marked control to the drag framework 12 .
[0454] It should be noted that steps S1414 to S1415 are optional. If there are no marked controls other than interface element 1, these two steps are not necessary. If there are other marked controls other than interface element 1, these two steps can be performed to obtain the drag data of the marked controls.
[0455] S1416 , the drag framework 12 receives and stores the drag data of the marked control.
[0456] S1417 , the drag framework 12 receives and responds to the user's operation 8 , and sends the registration information of the interface element 1 stored in the drag framework 12 to the application 2 .
[0457] Operation 8 is used to send the registration information of interface element 1 to application 2.
[0458] In some embodiments, operation 8 can be a long press and drag operation on the transfer station icon, or a long press and drag operation on the thumbnails in the transfer station sidebar, for example, the long press and drag operation on thumbnail 652 in the embodiment shown in Figure 6K above, or the long press and drag operation on thumbnail 742 in the embodiment shown in Figure 7K above, and so on.
[0459] S1418, the system interface 15 receives and responds to the user's operation 7, and closes the display of the drag mode interface.
[0460] For other specific contents of steps S1411 to S1418, reference may be made to the relevant descriptions of steps S1307 to S1314 in the embodiment shown in FIG13 , which will not be repeated here.
[0461] The following describes a software architecture of an electronic device 100 provided in an embodiment of the present application.
[0462] The software system of electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. A layered architecture divides the software into several layers, each with distinct roles and responsibilities. Layers communicate with each other via software interfaces. The software structure of electronic device 100 is illustrated in Figure 15A in conjunction with an embodiment of the present invention.
[0463] As shown in FIG. 15A , the electronic device 100 may include an application layer, a framework layer, a dynamic library, and a kernel layer.
[0464] The application layer may include a series of application packages. This series of application packages may include self-developed applications, such as gallery applications, etc., and may also include third-party applications, such as social applications. The application layer may also include a transfer station. In some embodiments, the transfer station may include accessibility services. In some embodiments, the application layer may also include a system interface (systemUI), which can be used to display the drag mode interface.
[0465] The framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The framework layer may include activities, services, views, and system services. Views may include a top-level view (decorview) and one or more different types of view modules, such as an image view, a web view, and a text view. The top-level view may also include multiple different types of drag modules. For details, please refer to the description of the embodiment shown in Figure 15B below. System services may include a drag framework, an activity manager service (AMS), and a window manager service (WMS). The WMS is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, and so on. Views can be used to build applications. A display interface may be composed of one or more views. For example, a display interface including a text notification icon may include a view for displaying text and a view for displaying images. In some embodiments, the framework layer may also include an accessibility framework, which can monitor events, obtain text, and send the obtained text to the accessibility service.
[0466] Dynamic libraries may include graphics processing libraries (such as OpenGL), graphics libraries (such as Skia), service managers, and databases (such as Sql), etc.
[0467] The kernel layer is the layer between hardware and software. The kernel layer can contain one or more drivers, such as Bluetooth driver, Wi-Fi driver, binder driver, audio driver, etc.
[0468] In the embodiment shown in Figure 15A, both self-developed applications and third-party applications can serve as the sending end of data transmission, such as application 1 in the above embodiment, and can also serve as the receiving end of data transmission, such as application 2 in the above embodiment. The view can be view 11 in the embodiment shown in Figures 8 to 12 above; the top-level view can be the top-level view 1101 in the above embodiment; the graphic view can be the graphic view 1102 in the above embodiment; the text view can be the text view 1103 in the above embodiment; and the web page view can be the web page view 1104 in the above embodiment. The drag frame can be the drag frame 12 in the above embodiment; the transfer station can be the transfer station 13 in the above embodiment; and the system interface can be the system interface 15 in the above embodiment. The functions of the above modules can refer to the relevant descriptions in the embodiments shown in Figures 8 to 12 above, and will not be repeated here.
[0469] It can be understood that the embodiment shown in FIG. 15A is only an example. In some embodiments, the electronic device 100 may also include more or fewer modules than the embodiment shown in FIG. 15A , and this application does not limit this.
[0470] FIG15B shows a schematic structural diagram of the top-level view 1101 (decorview).
[0471] As shown in Figure 15B, the top-level view 1101 may include a drag capability module (dragEx) 1101d, and the drag capability module 1101d may include one or more different types of drag modules, such as a graphic drag module (imagedragEx) 1101a, a text drag module (textdragEx) 1101b, a web page drag module (webdragEx) 1101c, and the like.
[0472] Among them, the graphic drag module 1101a can create a drag object of the picture type and can obtain the picture and other data of the picture control; the text drag module 1101b can create a drag object of the text type and can obtain the text and other data of the text control; the web page drag module 1101c can create a drag object of the web page view control type and can obtain the hyperlink, picture, text and other data of the web page view control.
[0473] It can be understood that the embodiment shown in FIG. 15B is only an example. In some embodiments, the top-level view 1101 may also include more or fewer modules than the embodiment shown in FIG. 15B , and this application does not limit this.
[0474] In some application scenarios, the data transmission method provided in the embodiment of the present application can also be used to transmit data in the electronic device 100 to another electronic device.
[0475] For example, FIG16 shows a schematic structural diagram of a data transmission system 10 provided in an embodiment of the present application.
[0476] As shown in Figure 16, the data transmission system 10 may include an electronic device 1000, an electronic device 2000, and a server 3000, wherein the electronic device 1000 may include an application 3, a view 1001, a drag frame 1002, and a transfer station 1003; the electronic device 2000 may include an application 4, a view 2001, a drag frame 2002, and a transfer station 2003. A communication connection is established between the electronic device 1000 and the server 3000, and a communication connection is established between the electronic device 2000 and the server 3000. The electronic device 1000 and the electronic device 2000 have the same user identification, for example, the electronic device 1000 and the electronic device 2000 can log in to the same account, etc. The user identification may include an identification such as a user ID and an account number for identifying the user's identity.
[0477] In the data transmission system 10, when the electronic device 1000 detects the user's operation 1 on the control 1, it can transmit the drag object (or drag type and drag data) of the control 1 in the application 3 to the transfer station 1003 through the view 1001 and the drag frame 1002 in the manner shown in any of the embodiments of Figures 8, 9, 11 to 14 above and store it in the transfer station 1003. The electronic device 1000 can upload the drag object of the control 1 stored in the transfer station to the server 3000. At the same time, the electronic device 1000 can also send the user identification to the server 3000.
[0478] The server 3000 may receive the drag object of the control 1 sent by the electronic device 1000 , and store the drag object of the control 1 based on the user identification sent by the electronic device 1000 .
[0479] The electronic device 2000 can obtain the drag object of the control 1 from the server 3000 based on the same user ID as the electronic device 1000, and store it in the transfer station 2003 of the electronic device 2000. Afterwards, the electronic device 2000 can also transmit the drag object of the control 1 in the transfer station to the application 2 on the electronic device 2000 through the transfer station 2003, the drag framework 2002 and other modules in the manner shown in FIG. 12 above.
[0480] It can be understood that, in some embodiments, the electronic device 1000 and / or the electronic device 2000 may further include a system interface module, and the system interface module may perform the functions performed by the system interface 15 in the above embodiments.
[0481] In this way, cross-device transmission of controls can be achieved through the transfer station. Moreover, combined with the above embodiment of dragging multiple controls at the same time, this data transmission method can also be applied in the scenario of mobile phone cloning.
[0482] It should be noted that in the data transmission system shown in Figure 16, the hardware structure and software architecture of the electronic device 1000 and the electronic device 2000 can refer to the hardware structure and software architecture of the electronic device 100 shown in the above embodiment, and the hardware structure of the server 3000 can refer to the embodiment shown in Figure 1B above.
[0483] FIG17 shows a flow chart of a data transmission method provided in an embodiment of the present application.
[0484] As shown in FIG17 , the specific process of the data transmission method may include the following steps:
[0485] S1701: A first electronic device displays a first interface of a first application, where the first interface includes a first control.
[0486] The first electronic device may be the electronic device 100 in the above embodiment, the first application may be the application 1 in the embodiment shown in FIG. 8 , and the first control may be the control 1 in the embodiment shown in FIG. 8 .
[0487] S1702: The first electronic device receives a first operation from a user on a first control.
[0488] The first operation may be a long press and drag operation of the user on the control 1 in the above embodiment. In some embodiments, the first operation may also be a combined operation, for example, including a long press operation and a drag operation on the control 1.
[0489] S1703, in response to the first operation, the first electronic device creates a first drag object through the view module, the first drag object is used to carry the drag data of the first control, and the drag data includes any one or more of text, picture and hyperlink.
[0490] The view module may be the view 11 in the above embodiment, and the first drag object may be the drag object of the control 1 in the embodiment shown in FIG. 8 to FIG. 9C .
[0491] In some embodiments, the first electronic device may also create the first drag object of the first control through other modules in the framework layer, which is not limited in this application.
[0492] For the specific content of the first electronic device creating the first drag object through the view module, reference can be made to the relevant content in steps S801 to S804 in the embodiment shown in FIG8 , as well as the relevant content in FIG9A to FIG9C .
[0493] S1704: The first electronic device draws a first drag layer of the first control based on the first drag object through the drag framework, and display content of the first drag layer is the same as display content of the first control.
[0494] The drag frame may be the drag frame 12 in the above embodiment.
[0495] The first drag layer of the first control may be the drag layer of the control 1 in the embodiment shown in FIG. 8 .
[0496] S1705: The first electronic device displays the transfer station icon and the first drag layer.
[0497] After displaying the first drag layer, the first electronic device may further draw and display a drag track of the first drag layer based on a track of the user's drag operation.
[0498] S1706: When the first drag layer moves to the transfer station icon, the first electronic device stores the first drag object through the transfer station.
[0499] The transfer station may be the transfer station 13 in the above embodiment.
[0500] For the specific content of this step, please refer to step S811 in the embodiment shown in FIG. 8 .
[0501] S1707: The first electronic device displays a first thumbnail of the first control in the transfer station icon.
[0502] The first thumbnail of the first control may be the thumbnail of the control 1 in the above embodiment.
[0503] S1708: The first electronic device displays a second interface of the second application, wherein a transfer station sidebar is displayed on the second interface, and a first thumbnail is displayed in the transfer station sidebar.
[0504] The second application may be application 2 in the embodiment shown in FIG. 12 , and the second interface may be interface 2 in the embodiment shown in FIG. 12 .
[0505] S1709: The first electronic device receives a second operation of the user dragging the first thumbnail to the second interface.
[0506] The second operation may be operation 2 for thumbnail 1 in the embodiment shown in FIG. 12 .
[0507] S1710: In response to the second operation, the first electronic device sends the first drag object to the second application through the transfer station.
[0508] S1711: The first electronic device displays a first control in a second interface based on the first dragged object through a second application.
[0509] For the specific contents of steps S1708 to S1711, reference may be made to the relevant contents in the embodiment shown in FIG. 12 .
[0510] In some embodiments, if the first control is a webview control, the first dragged object may include a hyperlink to the first control. After the first electronic device displays the first control in the second interface based on the first dragged object through the second application, the first electronic device may also receive and respond to a user click operation on the first control to display a third interface corresponding to the hyperlink. The third interface is the same as the interface displayed by the first electronic device when the first control in the first interface triggers the first electronic device to display the first control.
[0511] In other embodiments, the first electronic device may also form a data transmission system with a second electronic device and a server, and implement cross-device data transmission through a transfer station. The second electronic device may be the electronic device 2000 in the above embodiment, and the server may be the server 3000 in the above embodiment. The specific functions of each electronic device and server can refer to the data transmission system 10 in the embodiment shown in FIG. 16 .
[0512] The various implementation modes of this application can be combined arbitrarily to achieve different technical effects.
[0513] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments may be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described herein are generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated therein. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)).
[0514] Those skilled in the art will appreciate that all or part of the process steps in the above-described method embodiments can be implemented by a computer program instructing the relevant hardware. The program can be stored in a computer-readable storage medium, and when executed, the program can include the process steps in the above-described method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.
[0515] In short, the above description is only an embodiment of the technical solution of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent replacements, improvements, etc. made based on the disclosure of the present invention should be included in the scope of protection of the present invention.
Claims
1. A data transmission method, characterized in that: Applied to a first electronic device, the method includes: Display a first interface of a first application, wherein the first interface includes a first control; Receiving a first operation of the user on the first control; In response to the first operation, a first drag object is created through a view module, where the first drag object is used to carry the drag data of the first control, where the drag data includes any one or more of text, image, and hyperlink; Drawing a first drag layer of the first control based on the first drag object by using a drag framework, wherein display content of the first drag layer is the same as display content of the first control; Display the transfer station icon and the first drag layer; When the first drag layer moves to the transfer station icon, the first drag object is stored in the transfer station; Displaying a first thumbnail of the first control in the transfer station icon; Displaying a second interface of a second application, wherein a transfer station sidebar is displayed on the second interface, and the first thumbnail is displayed in the transfer station sidebar; receiving a second operation of the user dragging the first thumbnail to the second interface; In response to the second operation, sending the first drag object to the second application through the transfer station; The first control is displayed in the second interface based on the first dragged object through the second application.
2. The method according to claim 1, characterized in that: The step of creating the first drag object through the view module specifically includes: Acquire the type of the first control through the view module; Acquire the drag data of the first control based on the type of the first control through the view module; The first drag object is generated by the view module based on the type of the first control and the drag data of the first control, and the type of the first drag object is the same as the type of the first control.
3. The method according to claim 2, characterized in that The view module includes a first module and a second module; The generating the first drag object based on the type of the first control and the drag data of the first control by the view module specifically includes: When the type of the first control is the first type, generating the first drag object based on the first type and the drag data of the first control by the first module; When the type of the first control is the second type, the first drag object is generated by the second module based on the second type and the drag data of the first control.
4. The method according to claim 3, characterized in that The acquiring the drag data of the first control through the view module specifically includes: When the type of the first control is the first type, acquiring the drag data of the first control through the first module; When the type of the first control is the second type, the drag data of the first control is acquired through the second module.
5. The method according to claim 1, characterized in that The first operation is a combined operation, and the first operation includes a third operation and a fourth operation; The step of creating a first drag object by using a view module in response to the first operation specifically includes: In response to the third operation, obtaining the type of the first control through the view module; Creating an empty drag object based on the type of the first control through the view module, where the type of the empty drag object is the same as the type of the first control; In response to the fourth operation, acquiring the drag data of the first control through the view module; The first drag object is obtained by filling the drag data of the first control into the empty drag object through the view module.
6. The method according to any one of claims 1 to 5, characterized in that The first control is a webview control; before displaying the second interface of the second application, the method further includes: receiving a fifth operation of the user on the first control; In response to the fifth operation, displaying the third interface; After displaying the first control in the second interface based on the first dragged object by the second application, the method further includes: receiving a sixth operation of the user on the first control; In response to the sixth operation, the third interface is displayed, and the fifth operation is the same as the sixth operation.
7. The method according to any one of claims 1 to 6, characterized in that The storing the first dragged object through the transfer station specifically includes: The first dragged object is stored by the transfer station based on the corresponding relationship between the first dragged object and the first thumbnail.
8. The method according to claim 1, characterized in that The type of the first control is the third type; the type of the first drag object is the third type, and the first drag object is empty; the method further includes: In response to the first operation, obtaining a picture of the first control through the view module; Drawing the first drag layer of the first control based on the first drag object by using the drag framework specifically includes: Drawing a first drag layer of the first control based on the first drag object and the picture of the first control through a drag framework; After displaying the transfer station icon and the first drag layer, the method further includes: Acquiring the text of the first control based on the image of the first control through the transfer station; The storing the first dragged object through the transfer station specifically includes: The text of the first control and the first drag object are stored through the transfer station based on the relationship between the first thumbnail and the text of the first control.
9. A data transmission system, characterized in that: comprising a first electronic device, a server, and a second electronic device; The first electronic device is used to display a first interface of a first application, wherein the first interface includes a first control; The first electronic device is used to receive a first operation of the user on the first control; The first electronic device is used to create a first drag object through a view module in response to the first operation, the first drag object is used to carry the drag data of the first control, and the drag data includes any one or more of text, picture and hyperlink; The first electronic device is used to draw a first drag layer of the first control based on the first drag object through a drag framework, and display content of the first drag layer is the same as display content of the first control; The first electronic device is used to display the transfer station icon and the first drag layer; When the first drag layer moves to the transfer station icon, the first electronic device is used to store the first drag object through the transfer station; The first electronic device is used to display a first thumbnail of the first control in the transfer station icon; After storing the first dragged object through the transfer station, the first electronic device is used to send the first dragged object to the server through the transfer station; The server is used for receiving and storing the first drag object sent by the first electronic device; The second electronic device is used to obtain the first dragged object from the server through the transfer station of the second electronic device; The second electronic device is used to display a fourth interface of the third application, the fourth interface displays a transfer station sidebar, and the first thumbnail is displayed in the transfer station sidebar; The second electronic device is used to receive a seventh operation of the user dragging the first thumbnail to the fourth interface; The second electronic device is used for sending the first dragged object to the third application through the transfer station of the second electronic device in response to the seventh operation; The second electronic device is used to display the first control in the second interface based on the first dragged object through the third application.
10. An electronic device, being a first electronic device, characterized in that: include: One or more processors and one or more memories; the one or more memories are coupled to the one or more processors, the one or more memories are used to store computer program code, the computer program code includes computer instructions, and when the one or more processors execute the computer instructions, the first electronic device executes the method described in any one of claims 1 to 8.
11. A computer-readable storage medium comprising computer instructions, characterized in that: When the computer instructions are executed on an electronic device, the electronic device is caused to execute the method according to any one of claims 1 to 8.
Citation Information
Patent Citations
Data transmission method, system and related device
CN119002782A
Copying / pasting method and mobile terminal
CN106055202A
Data transmission method and device
CN111666055A
Dragging method and electronic equipment
CN115480682A
Mobile terminal and method for controlling the same
US20130072262A1
