Data transmission method and device

By detecting data types between terminal devices and providing visual feedback, the data transmission process between devices is simplified, the problems of complex operation and inefficiency in the prior art are solved, and the universality and efficiency of cross-device data transmission are achieved.

CN114356197BActive Publication Date: 2024-11-19HUAWEI TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202111463143.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-04-24
Publication Date
2024-11-19
Estimated Expiration
2040-04-24

AI Technical Summary

Technical Problem

The prior art is complex and inefficient in data drag and drop transmission between devices. Users need to rely on the same account and operating system window display and reverse control capabilities, which limits the universality and user experience of data transmission.

Method used

By detecting the data type of an object between terminal devices and sending judgment requests, receiving and displaying judgment results, simplifying drag and drop operations, realizing cross-device data transmission, supporting multiple devices and data types, providing intuitive visual feedback to avoid incorrect operations .

Benefits of technology

It improves the operation efficiency of data transmission between devices, simplifies user operation processes, supports the transmission of multiple devices and data types, and reduces the possibility of user error operations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114356197B_ABST
    Figure CN114356197B_ABST
Patent Text Reader

Abstract

The present application relates to a method and device for transmitting data. The method comprises: when a first terminal device detects a first cross-device transmission operation for an object on the first terminal device, obtaining the data type of the object, wherein the first cross-device transmission operation is used to initiate a process of transmitting the object to a second terminal device; sending a judgment request carrying the data type to the second terminal device, receiving a judgment result based on the data type from the second terminal device, the judgment result indicating whether the object can be transmitted to the second terminal device; and displaying the judgment result. Through the data transmission method and device of each embodiment of the present application, intuitive visual feedback can be provided to the user based on the matching degree of the data type of the object and the receiving end, thereby avoiding erroneous operations and repeated operations and improving operation efficiency.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of communication technology, and in particular to a data transmission method and device. Background Art

[0002] Data can be transferred between different devices by dragging and dropping. For example, when transferring data between a mobile phone and a computer with the same operating system, it is necessary to use a specific application on the computer to log in to the same account as the account logged in on the mobile phone, so as to drag the photos or files on the mobile phone to the computer. However, this method requires relying on the same account, as well as specific functions such as the operating system window display and reverse control capabilities. Not any two devices can achieve data transfer through such operations.

[0003] If a drag operation fails, the user will drag repeatedly, which will make the operation complicated and inefficient. Summary of the invention

[0004] In view of this, a data transmission method, apparatus, terminal device, storage medium and computer program product are proposed, which can provide users with intuitive visual feedback, avoid erroneous operations and repeated operations, and improve operation efficiency.

[0005] In a first aspect, an embodiment of the present application provides a data transmission method, the method is applied to a first terminal device, the first terminal device is connected to a second terminal device, and the method includes:

[0006] The first terminal device acquires a data type of the object when detecting a first cross-device transmission operation for the object on the first terminal device, wherein the first cross-device transmission operation is used to initiate a process of transmitting the object to the second terminal device;

[0007] Sending a request for determining the data type to the second terminal device,

[0008] receiving a determination result made by the second terminal device based on the data type, the determination result indicating whether the object can be transmitted to the second terminal device;

[0009] The judgment result is displayed.

[0010] In combination with the first possible implementation of the first aspect, the judgment request carries a data type field and / or an extended data type field, and the data type field and the extended data type field are used to indicate the data type of the object. According to the data transmission method of the above implementation of the present application, the draggable content can be extended, and the extended data type field can indicate a custom data type, or a data type suitable for a specific device or application, or a newly emerging data type, so that more data types and devices are applicable when transmitting data across devices, which is convenient for user operation.

[0011] In combination with the first aspect or the first possible implementation manner of the first aspect, in a second possible implementation manner, the method further includes, when a judgment result is that it can be transmitted to a second terminal device and a second cross-device transmission operation is detected, sending the object to the second terminal device, and the second cross-device transmission operation is used to confirm the transmission of the object to the second terminal device.

[0012] In combination with the second possible implementation manner of the first aspect, in a third possible implementation manner, sending the object to the second terminal device may be specifically implemented as follows:

[0013] Temporarily storing the object locally on the first terminal device;

[0014] Sending a data transmission request to the second terminal device, where the data transmission request is used to transmit the object;

[0015] When receiving a first response signal returned by the second terminal device for accepting the data transmission request, sending the object according to the first response signal;

[0016] When a second response signal returned by the second terminal device indicating that the data transmission request is not accepted is received, the sending object is cancelled.

[0017] In conjunction with the third possible implementation manner of the first aspect, in a fourth possible implementation manner, after temporarily storing the object locally on the first terminal device, the method further includes:

[0018] When a call-out instruction for the temporarily stored object is detected, the temporarily stored object is called out, and the data transmission request is sent to the second terminal device.

[0019] In combination with the third or fourth possible implementation manner of the first aspect, in a fifth possible implementation manner, sending an object according to the first response signal may be specifically implemented as follows:

[0020] When the first response signal is received, the object is sent directly; or when the first response signal is received, the object is sent with a delay.

[0021] According to the data transmission method of the third, fourth and fifth possible implementation methods mentioned above, optional operations for the dragged object can be displayed, so that the user can adjust the transmission process or processing method according to actual needs, so that the second terminal device can process the object according to actual needs.

[0022] In combination with the first aspect or the first, second, third, fourth or fifth possible implementation manner of the first aspect, in a sixth possible implementation manner, the first terminal device is connected to two or more candidate terminal devices, and the data transmission method of the present application may further include:

[0023] When the first terminal device detects a first cross-device transmission operation for an object on the first terminal device, the first terminal device displays information of more than two candidate terminal devices;

[0024] The second terminal device corresponding to the first cross-device transmission operation is determined according to the relationship between the stop position of the first cross-device transmission operation and the display positions of the information of the two or more candidate terminal devices.

[0025] In combination with the first aspect or the first, second, third, fourth or fifth possible implementation manner of the first aspect, in a seventh possible implementation manner, the first terminal device is connected to two or more candidate terminal devices, and the data transmission method of the present application may further include:

[0026] The second terminal device corresponding to the first cross-device transmission operation is determined according to the positional relationship between the stop position of the first cross-device transmission operation and the edge of the first terminal device.

[0027] According to the data transmission method of the sixth or seventh possible implementation manner, interaction between multiple terminal devices can be realized, and the types of the multiple terminal devices can be different, making it more convenient for users to share data between multiple different devices.

[0028] In combination with the first aspect or the seventh possible implementation manner of the first aspect, in an eighth possible implementation manner, the method further includes:

[0029] A display instruction is sent to the second terminal device to instruct the second terminal device to display the first image of the object according to the display instruction and the positional relationship between the second terminal device and the first terminal device, so that the second image of the object displayed on the first terminal device and the first image of the object displayed on the second terminal device can be combined into a complete image of the object; if it is detected that the area of ​​the second image of the object displayed on the display screen meets the sending condition, the object is sent to the second terminal device. According to the data transmission method of this implementation mode, the process of drag interaction is displayed in a concise and intuitive manner, which is conducive to users to judge the timing of dragging, avoid repeated operations, and simplify user operations.

[0030] In combination with the first aspect or the sixth possible implementation manner of the first aspect, in a ninth possible implementation manner, the method further includes:

[0031] Sending a display status request to the second terminal device, so that the second terminal device returns a current display interface of the second terminal device in response to the display status request, and displays the display interface;

[0032] In this implementation, in the first aspect, sending the determination request carrying the data type to the second terminal device may be specifically implemented as follows:

[0033] Sending a determination request to the second terminal device, wherein the determination request includes the data type and the coordinates of the location where the first cross-device transmission operation stops in the display interface,

[0034] In this implementation, in the first aspect, receiving a determination result made by the second terminal device based on the data type may be specifically implemented as follows:

[0035] Receive a determination result from the second terminal device based on the data type and the coordinates.

[0036] According to the data transmission method of the ninth possible implementation, the object can be directly dragged to the target location, which can simplify the user operation compared to the related art that requires further operation of dragging to the target location at the receiving end. The judgment result is displayed in real time during the dragging process, which can avoid repeated operations and improve operation efficiency.

[0037] In combination with the second possible implementation manner of the first aspect, in a tenth possible implementation manner, the method further includes:

[0038] Determine how the second terminal device processes the object;

[0039] Sending the object to the second terminal device includes:

[0040] The object and indication information are sent to the second terminal device, where the indication information is used to instruct the second terminal device to process the object in the processing manner.

[0041] In a second aspect, an embodiment of the present application provides a data transmission method, the method is applied to a second terminal device, the second terminal device is connected to the first terminal device, and the method includes:

[0042] Receiving a determination request sent by the first terminal device, wherein the determination request carries a data type of an object to be transmitted, and the determination request is used to request the second terminal device to determine whether an object of the data type can be transmitted to the second terminal device;

[0043] A judgment result is made according to the data type, and the judgment result is sent to the first terminal device so that the first terminal device displays the judgment result.

[0044] In combination with a first possible implementation manner of the second aspect, the method further includes:

[0045] Upon receiving a display status request sent by the first terminal device, returning the current display interface of the second terminal device to the first terminal device, so that the first terminal device determines the coordinates of the position where the first cross-device transmission operation stops in the display interface, wherein the first cross-device transmission operation is an operation for the first terminal device to initiate a process of transmitting an object to the second terminal device;

[0046] The determination request in the implementation of the second aspect carries the coordinates.

[0047] In the implementation of the second aspect, making a judgment result according to the data type includes:

[0048] The judgment result is made according to the data type and the coordinates. According to the data transmission method of the implementation mode, the object can be directly dragged to the target position, which can simplify the user operation compared with the related technology that requires further operation of dragging to the target position at the receiving end. The judgment result is displayed in real time during the dragging process, which can avoid repeated operations and improve operation efficiency.

[0049] In combination with the first possible implementation manner of the second aspect, in a second possible implementation manner, the method further includes:

[0050] When receiving the object sent by the first terminal device, the object is processed according to one or more of the data type, the local storage status, the application service installed by the second terminal device, and the coordinates.

[0051] In combination with the second possible implementation manner of the second aspect, in a third possible implementation manner, the object is processed according to one or more of the data type, the local storage status, the application service installed by the second terminal device, and the coordinates, which can be specifically implemented as follows:

[0052] When the local storage state is that the storage capacity is not available, opening the object according to the application service installed on the second terminal device;

[0053] When the local storage status is capable of storing data, the object is stored locally.

[0054] In combination with the third possible implementation manner of the second aspect, in a fourth possible implementation manner, when the local storage state is that the storage capability is available, storing the object locally may be specifically implemented as follows:

[0055] When the local storage state is that the storage capacity is available and the corresponding position of the coordinates in the display interface does not allow the data type to be inserted, the object is stored locally and an application is selected to open the object according to the data type;

[0056] When the local storage state is that the storage capacity is available and the corresponding position of the above coordinates in the above display interface allows the insertion of the above data type, the object is stored locally and opened in the above display interface according to the above coordinates.

[0057] According to the data transmission method of the above implementation, the receiving end can process the object according to local information, thereby simplifying user operations.

[0058] In combination with the second aspect or the first, second, third or fourth possible implementation manner of the second aspect, in a fifth possible implementation manner, the method further includes:

[0059] When receiving the object sent by the first terminal device, if the second terminal device has storage capability, temporarily storing the object locally;

[0060] Display processing options;

[0061] The object is processed according to the selection operation for the processing option.

[0062] In combination with the second aspect, in a sixth possible implementation manner, the method further includes:

[0063] When receiving a display instruction sent by the first terminal device, displaying a first image of the object according to the display instruction and the positional relationship between the second terminal device and the first terminal device,

[0064] The second image of the object displayed on the first terminal device and the first image of the object displayed on the second terminal device can be combined into a complete image of the object. According to the data transmission method of this implementation, the drag interaction process is presented in a concise and intuitive manner, which helps the user to judge the timing of dragging, avoids repeated operations, and simplifies user operations.

[0065] In a third aspect, an embodiment of the present application provides a data transmission device, wherein the method is applied to a first terminal device, the first terminal device is connected to a second terminal device, and the device includes:

[0066] A first acquisition module, configured for the first terminal device to acquire a data type of an object when detecting a first cross-device transmission operation for the object on the first terminal device, wherein the first cross-device transmission operation is used to initiate a process of transmitting the object to a second terminal device;

[0067] A first sending module is used to send a determination request carrying the data type to the second terminal device,

[0068] A first receiving module, configured to receive a determination result made by a second terminal device based on the data type, wherein the determination result indicates whether the object can be transmitted to the second terminal device;

[0069] The first display module is used to display the judgment result.

[0070] In combination with the first possible implementation manner of the third aspect, the judgment request carries a data type field and / or an extended data type field, and the data type field and the extended data type field are used to indicate the data type of the object.

[0071] In combination with the third aspect or the first possible implementation manner of the third aspect, in a second possible implementation manner, the apparatus further includes:

[0072] The second sending module is used to send the object to the second terminal device when the judgment result is that the object can be transmitted to the second terminal device and a second cross-device transmission operation is detected, and the second cross-device transmission operation is used to confirm the transmission of the object to the second terminal device.

[0073] In conjunction with the second possible implementation manner of the third aspect, in a third possible implementation manner, the second sending module may include:

[0074] A first storage unit, used for temporarily storing the object locally on the first terminal device;

[0075] A first sending unit, configured to send a data transmission request to a second terminal device, where the data transmission request is used to transmit the object;

[0076] A second sending unit is configured to send an object according to the first response signal when receiving a first response signal of accepting a data transmission request returned by the second terminal device;

[0077] The sending cancellation unit is used to cancel the sending object when receiving a second response signal returned by the second terminal device that does not accept the data transmission request.

[0078] In combination with the third possible implementation method of the third aspect, in a fourth possible implementation method, the first sending unit is also used to call out the temporarily stored object when a call out instruction for the temporarily stored object is detected, and to send the data transmission request to the second terminal device.

[0079] In combination with the third possible implementation manner of the third aspect, in a fifth possible implementation manner, the second sending unit is further used to: directly send the object when the first response signal is received, or, when the first response signal is received, delay sending the object.

[0080] In combination with the third aspect or the first, second, third, fourth or fifth possible implementation manner of the third aspect, in a sixth possible implementation manner, the first terminal device is connected to two or more candidate terminal devices,

[0081] The device also includes:

[0082] A second display module, configured to display information of two or more candidate terminal devices when the first terminal device detects a first cross-device transmission operation for an object local to the first terminal device;

[0083] The second determination module is used to determine the second terminal device corresponding to the first cross-device transmission operation according to the relationship between the stop position of the first cross-device transmission operation and the display position of the information of the two or more candidate terminal devices.

[0084] In combination with the third aspect or the first, second, third, fourth or fifth possible implementation manners of the third aspect, in a seventh possible implementation manner, the first terminal device is connected to two or more candidate terminal devices, and the apparatus further includes: a third determination module, for determining the second terminal device corresponding to the first cross-device transmission operation based on the positional relationship between the stop position of the first cross-device transmission operation and the edge of the first terminal device.

[0085] In combination with the third aspect or the seventh possible implementation manner of the third aspect, in an eighth possible implementation manner, the apparatus further includes:

[0086] A third sending module is used to send a display instruction to the second terminal device to instruct the second terminal device to display the first image of the object according to the display instruction and the positional relationship between the second terminal device and the first terminal device.

[0087] The second image of the object displayed on the first terminal device and the first image of the object displayed on the second terminal device can be combined into a complete image of the object;

[0088] The fourth sending module is used to send the object to the second terminal device if it is detected that the area of ​​the second image of the object displayed on the display screen meets the sending condition.

[0089] In combination with the third aspect or the sixth possible implementation manner of the third aspect, in a ninth possible implementation manner, the apparatus further includes:

[0090] a fifth sending module, configured to send a display status request to the second terminal device, so that the second terminal device returns a current display interface of the second terminal device in response to the display status request, and displays the display interface;

[0091] The first sending module includes:

[0092] The third sending unit is used to send a determination request to the second terminal device according to the data type and the coordinates of the position where the first cross-device transmission operation stops in the above display interface,

[0093] The first receiving module comprises:

[0094] The receiving unit is used to receive a determination result made by the second terminal device based on the above data type and the above coordinates.

[0095] In combination with the second possible implementation manner of the third aspect, in a tenth possible implementation manner, the apparatus further includes:

[0096] A third determination module, used to determine a processing method of the object by the second terminal device;

[0097] The second sending module also includes:

[0098] The fourth sending unit is used to send the object and indication information to the second terminal device, where the indication information is used to instruct the second terminal device to process the object in the processing manner.

[0099] In a fourth aspect, an embodiment of the present application provides a data transmission device, wherein the method is applied to a second terminal device, the second terminal device is connected to the first terminal device, and the device includes:

[0100] A second receiving module is used to receive a determination request sent by the first terminal device, wherein the determination request carries a data type of an object to be transmitted, and the determination request is used to request the second terminal device to determine whether an object of the data type can be transmitted to the second terminal device;

[0101] The first judgment module is used to make a judgment result according to the data type, and send the judgment result to the first terminal device so that the first terminal device displays the judgment result.

[0102] In combination with a first possible implementation manner of the fourth aspect, the device further includes:

[0103] a sixth sending module, configured to return the current display interface of the second terminal device to the first terminal device upon receiving the display status request sent by the first terminal device, so that the first terminal device determines the coordinates of the position where the first cross-device transmission operation stops in the display interface, wherein the first cross-device transmission operation is an operation for the first terminal device to initiate a process of transmitting an object to the second terminal device;

[0104] The judgment request in the fourth aspect carries the coordinates, and the first judgment module includes:

[0105] The first judgment unit is used to make a judgment result according to the above data type and the above coordinates.

[0106] In combination with the first possible implementation manner of the fourth aspect, in a second possible implementation manner, the apparatus further includes:

[0107] The first processing module is used to process the object according to one or more of the data type, local storage status, application services installed on the second terminal device, and the above-mentioned coordinates when receiving the object sent by the first terminal device.

[0108] In conjunction with the second possible implementation manner of the fourth aspect, in a third possible implementation manner, the first processing module includes:

[0109] A first processing unit, configured to open the object according to the application service installed on the second terminal device when the local storage status is that the storage capacity is not available;

[0110] The second processing unit is used to store the object locally when the local storage state is that the storage capacity is available.

[0111] In combination with the third possible implementation method of the fourth aspect, in a fourth possible implementation method, the second processing unit is also used to locally store the object and select an application to open the object according to the above-mentioned data type when the local storage status is that the storage capacity is available and the corresponding position of the above-mentioned coordinates in the above-mentioned display interface does not allow the insertion of the above-mentioned data type; and to locally store the object and open the object in the above-mentioned display interface according to the above-mentioned coordinates when the local storage status is that the storage capacity is available and the corresponding position of the above-mentioned coordinates in the above-mentioned display interface allows the insertion of the above-mentioned data type.

[0112] In combination with the fourth aspect or the first, second, third or fourth possible implementation manner of the fourth aspect, in a fifth possible implementation manner, the device further includes:

[0113] a storage module, configured to temporarily store the object locally when receiving the object sent by the first terminal device if the second terminal device has storage capability;

[0114] A third display module, used to display processing options;

[0115] The second processing module is used to process the object according to the selection operation for the processing option.

[0116] In combination with the fourth aspect, in a sixth possible implementation manner, the device further includes:

[0117] a fourth display module, configured to display a first image of the object according to the display instruction and the positional relationship between the second terminal device and the first terminal device when receiving the display instruction sent by the first terminal device;

[0118] The second image of the object displayed on the first terminal device and the first image of the object displayed on the second terminal device can be combined into a complete image of the object.

[0119] In combination with the first aspect, multiple implementations of the first aspect, the second aspect, multiple implementations of the second aspect, the third aspect, multiple implementations of the third aspect, the fourth aspect, and multiple implementations of the fourth aspect, in one possible implementation, the first cross-device transmission operation is a drag operation, and the second cross-device transmission operation is a drag-and-release operation.

[0120] In a fifth aspect, an embodiment of the present application provides a data transmission device, comprising: a processor; a memory for storing processor executable instructions; wherein the processor is configured to implement the above method when executing instructions.

[0121] In a sixth aspect, an embodiment of the present application provides a non-volatile computer-readable storage medium having computer program instructions stored thereon, wherein the computer program instructions implement the above method when executed by a processor.

[0122] In a seventh aspect, an embodiment of the present application provides a terminal device, which can execute a data transmission method of one or more of the above first aspect or multiple implementation methods of the first aspect.

[0123] In combination with the first possible implementation manner of the seventh aspect, the terminal device can also execute one or several data transmission methods of the above second aspect or multiple implementation manners of the second aspect.

[0124] In an eighth aspect, an embodiment of the present application provides a computer program product, comprising a computer-readable code, or a non-volatile computer-readable storage medium carrying a computer-readable code, and when the computer-readable code runs in an electronic device, the processor in the electronic device executes the above method.

[0125] Through the data transmission method and device of each of the above-mentioned embodiments, it is possible to provide users with intuitive visual feedback based on the data type of the object and the degree of matching of the receiving end, thereby avoiding erroneous operations and repeated operations and improving operational efficiency.

[0126] Other features and aspects of the present application will become apparent from the following detailed description of exemplary embodiments with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0127] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate exemplary embodiments, features, and aspects of the present application and, together with the description, serve to explain the principles of the present application.

[0128] Figure 1 A schematic diagram showing an application scenario according to an embodiment of the present application.

[0129] Figure 2 A schematic diagram of the internal system structure of a terminal device according to an embodiment of the present application is shown.

[0130] Figure 3a and Figure 3b Flowcharts of a data transmission method according to an embodiment of the present application are respectively shown.

[0131] Figure 4 A schematic diagram showing an application scenario of a data transmission method according to an embodiment of the present application.

[0132] Figure 5a and Figure 5b Examples of a method of displaying a determination result according to an embodiment of the present application are respectively shown.

[0133] Figure 6 A schematic diagram showing the fields included in a dragevent event according to an embodiment of the present application.

[0134] Figure 7 A schematic diagram showing an application scenario according to an embodiment of the present application.

[0135] Figure 8a and Figure 8b Flowcharts of a data transmission method according to an embodiment of the present application are respectively shown.

[0136] Figure 8c An interactive flow chart of an application scenario according to an embodiment of the present application is shown.

[0137] Figure 9a A flow chart of a data transmission method according to an embodiment of the present application is shown.

[0138] Figure 9b A flow chart of a data transmission method according to an embodiment of the present application is shown.

[0139] Fig.9c A flow chart of a data transmission method according to an embodiment of the present application is shown.

[0140] Figure 9d and Fig.9e Schematic diagrams of display interfaces of terminal devices according to an embodiment of the present application are respectively shown.

[0141] Figure 9fA schematic diagram showing a specific application scenario according to an embodiment of the present application.

[0142] Figure 9g A schematic diagram showing a display interface of a terminal device according to an embodiment of the present application is shown.

[0143] Fig.10 A schematic diagram showing an application scenario according to an embodiment of the present application.

[0144] Fig.11a A schematic diagram showing a display interface of a first terminal device according to an embodiment of the present application is shown.

[0145] Fig.11b A schematic diagram showing a display interface of a first terminal device according to an embodiment of the present application is shown.

[0146] Fig.11c A schematic diagram showing a display interface of a first terminal device according to an embodiment of the present application is shown.

[0147] Fig.11d A schematic diagram showing an application scenario of a display interface of a first terminal device according to an embodiment of the present application is shown.

[0148] Fig.12a A flow chart of a data transmission method according to an embodiment of the present application is shown.

[0149] Figure 12b A flow chart of a data transmission method according to an embodiment of the present application is shown.

[0150] Fig.13a A schematic diagram showing an application scenario according to an embodiment of the present application.

[0151] Fig.13b A schematic diagram showing cross-screen display according to an embodiment of the present application is shown.

[0152] Fig.14a A flow chart of a data transmission method according to an embodiment of the present application is shown.

[0153] Fig.14b A flow chart of a data transmission method according to an embodiment of the present application is shown.

[0154] Fig.15 A schematic diagram showing an application scenario according to an embodiment of the present application.

[0155] Fig.16 A flow chart of a data transmission method according to an embodiment of the present application is shown.

[0156] Fig.17 A block diagram of a data transmission device according to an embodiment of the present application is shown.

[0157] Fig.18 A block diagram of a data transmission device according to an embodiment of the present application is shown.

[0158] Fig.19 A schematic diagram of the structure of a terminal device according to an embodiment of the present application is shown.

[0159] Fig. 20 A software structure block diagram of a terminal device according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0160] Various exemplary embodiments, features and aspects of the present application will be described in detail below with reference to the accompanying drawings. The same reference numerals in the accompanying drawings represent elements with the same or similar functions. Although various aspects of the embodiments are shown in the accompanying drawings, the drawings are not necessarily drawn to scale unless otherwise specified.

[0161] The word “exemplary” is used exclusively herein to mean “serving as an example, example, or illustration.” Any embodiment described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other embodiments.

[0162] In addition, in order to better illustrate the present application, numerous specific details are given in the following specific embodiments. It should be understood by those skilled in the art that the present application can also be implemented without certain specific details. In some examples, methods, means, components and circuits well known to those skilled in the art are not described in detail in order to highlight the subject matter of the present application.

[0163] In order to solve the above technical problems, the present application provides a data transmission method. The data transmission method of the embodiment of the present application can realize cross-device data transmission. The transmission method can be applied to terminal devices to provide intuitive visual feedback according to the degree of matching between the object to be transmitted and the receiving device, thereby improving operational efficiency.

[0164] In the implementation of the present application, the party that initiates cross-device data transmission and sends data may be referred to as the source end, and the party that receives data may be referred to as the sink end. It should be noted that a device that is a source end in one pair of relationships may also be a sink end in another pair of relationships, that is, for a terminal device, it may be both a source end and a sink end for another terminal device.

[0165] The terminal devices involved in this application (including the source device and the receiving device mentioned above) may refer to devices with wireless connection functions. The wireless connection function means that it can be connected to other terminal devices through wireless connection methods such as wifi and Bluetooth. The terminal devices of this application may also have the function of communicating through wired connection. The terminal devices of this application may be touch-screen, non-touch-screen, or screenless. Touch-screen devices can be controlled by clicking and sliding on the display screen with fingers, stylus, etc. Non-touch-screen devices can be connected to input devices such as mice, keyboards, touch panels, etc., and the terminal devices can be controlled through input devices. Devices without screens may be, for example, Bluetooth speakers without screens.

[0166] For example, the terminal device of the present application can be a smart phone, a netbook, a tablet computer, a laptop computer, a wearable electronic device (such as a smart bracelet, a smart watch, etc.), a TV, a virtual reality device, a speaker, electronic ink, etc.

[0167] Fig.19 The following is a schematic diagram showing the structure of a terminal device according to an embodiment of the present application. Taking a mobile phone as an example, Fig.19 A schematic structural diagram of a mobile phone 200 is shown.

[0168] The mobile phone 200 may include a processor 210, an external memory interface 220, an internal memory 221, a USB interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 1, an antenna 2, a mobile communication module 251, a wireless communication module 252, an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, an earphone interface 270D, a sensor module 280, a button 290, a motor 291, an indicator 292, a camera 293, a display screen 294, and a SIM card interface 295, etc. The sensor module 280 may include a gyroscope sensor 280A, an acceleration sensor 280B, a proximity light sensor 280G, a fingerprint sensor 280H, and a touch sensor 280K (of course, the mobile phone 200 may also include other sensors, such as a temperature sensor, a pressure sensor, a distance sensor, a magnetic sensor, an ambient light sensor, an air pressure sensor, a bone conduction sensor, etc., which are not shown in the figure).

[0169] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the mobile phone 200. In other embodiments of the present application, the mobile phone 200 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0170] The processor 210 may include one or more processing units, for example: the processor 210 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and / or a neural network processor (Neural-network Processing Unit, NPU), etc. Among them, different processing units can be independent devices or integrated in one or more processors. Among them, the controller can be the nerve center and command center of the mobile phone 200. The controller can generate an operation control signal according to the instruction opcode and the timing signal to complete the control of fetching and executing instructions.

[0171] The processor 210 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. The memory may store instructions or data that the processor 210 has just used or cyclically used. If the processor 210 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 210, and thus improves the efficiency of the system.

[0172] The processor 210 can run the data transmission method provided in the embodiment of the present application to reduce the user's operation complexity, improve the intelligence of the terminal device, and enhance the user experience. The processor 210 can include different devices. For example, when the CPU and GPU are integrated, the CPU and GPU can cooperate to execute the data transmission method provided in the embodiment of the present application. For example, part of the algorithm in the data transmission method is executed by the CPU, and the other part of the algorithm is executed by the GPU to obtain faster processing efficiency.

[0173] The display screen 294 is used to display images, videos, etc. The display screen 294 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the mobile phone 200 may include 1 or N display screens 294, where N is a positive integer greater than 1. The display screen 294 can be used to display information input by a user or information provided to a user and various graphical user interfaces (GUI). For example, the display 294 can display photos, videos, web pages, or files, etc. For another example, the display 294 can display a graphical user interface. Among them, the graphical user interface includes a status bar, a hidden navigation bar, a time and weather widget, and application icons, such as a browser icon. The status bar includes the operator name (such as China Mobile), the mobile network (such as 4G), the time, and the remaining power. The navigation bar includes a back key icon, a home key icon, and a forward key icon. In addition, it can be understood that in some embodiments, the status bar may also include a Bluetooth icon, a Wi-Fi icon, an external device icon, etc. It can also be understood that in other embodiments, the graphical user interface may also include a Dock bar, and the Dock bar may include commonly used application icons, etc. When the processor 210 detects a touch event of a user's finger (or a stylus, etc.) for a certain application icon, in response to the touch event, the user interface of the application corresponding to the application icon is opened, and the user interface of the application is displayed on the display 294.

[0174] In the embodiment of the present application, the display screen 294 may be an integrated flexible display screen, or a spliced ​​display screen consisting of two rigid screens and a flexible screen located between the two rigid screens.

[0175] After the processor 210 runs the data transmission method provided in the embodiment of the present application, the terminal device can establish a connection with other terminal devices through antenna 1, antenna 2 or USB interface, and transmit data according to the data transmission method provided in the embodiment of the present application and control the display screen 294 to display the corresponding graphical user interface.

[0176] The camera 293 (a front camera or a rear camera, or one camera can be used as both a front camera and a rear camera) is used to capture still images or videos. Generally, the camera 293 may include a photosensitive element such as a lens group and an image sensor, wherein the lens group includes a plurality of lenses (convex lenses or concave lenses) for collecting light signals reflected by the object to be photographed and transmitting the collected light signals to the image sensor. The image sensor generates an original image of the object to be photographed based on the light signal.

[0177] The internal memory 221 can be used to store computer executable program codes, which include instructions. The processor 210 executes various functional applications and data processing of the mobile phone 200 by running the instructions stored in the internal memory 221. The internal memory 221 may include a program storage area and a data storage area. Among them, the program storage area may store codes of operating systems, applications (such as camera applications, WeChat applications, etc.), etc. The data storage area may store data created during the use of the mobile phone 200 (such as images, videos, etc. collected by the camera application), etc.

[0178] The internal memory 221 may also store one or more computer programs 1310 corresponding to the data transmission method provided in the embodiment of the present application. The one or more computer programs 1304 are stored in the above-mentioned memory 221 and are configured to be executed by the one or more processors 210. The one or more computer programs 1310 include instructions, and the above-mentioned instructions can be used to execute such as Figure 3a , Figure 3b , Figure 8a , Figure 8b , Figure 9a — Fig.9c , Fig.12a , Figure 12b , Fig.14a , Fig.14b or Fig.16In the respective steps of the corresponding embodiment, the computer program 1310 may include a first acquisition module 61, a first sending module 62, a first receiving module 63 and a first display module 64. The first acquisition module 61 is used for the first terminal device to acquire the data type of the object when detecting the first cross-device transmission operation for the object on the first terminal device; the first sending module 62 is used to send a judgment request carrying the data type to the second terminal device; the first receiving module 63 is used to receive a judgment result made by the second terminal device based on the data type, the judgment result indicating whether the object can be transmitted to the second terminal device; the first display module 64 is used to display the judgment result. When the code of the data transmission method stored in the internal memory 221 is executed by the processor 210, the processor 210 can control the display screen to display the judgment result.

[0179] In addition, the internal memory 221 may include a high-speed random access memory and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0180] Of course, the code of the data transmission method provided in the embodiment of the present application can also be stored in an external memory. In this case, the processor 210 can run the code of the data transmission method stored in the external memory through the external memory interface 220.

[0181] The functions of the sensor module 280 are described below.

[0182] The gyroscope sensor 280A can be used to determine the motion posture of the mobile phone 200. In some embodiments, the angular velocity of the mobile phone 200 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 280A. That is, the gyroscope sensor 280A can be used to detect the current motion state of the mobile phone 200, such as shaking or stillness.

[0183] When the display screen in the embodiment of the present application is a foldable screen, the gyroscope sensor 280A can be used to detect the folding or unfolding operation acting on the display screen 294. The gyroscope sensor 280A can report the detected folding operation or unfolding operation as an event to the processor 210 to determine the folded state or unfolded state of the display screen 294.

[0184] The acceleration sensor 280B can detect the magnitude of the acceleration of the mobile phone 200 in all directions (generally three axes). That is, the gyroscope sensor 280A can be used to detect the current motion state of the mobile phone 200, such as shaking or stillness. When the display screen in the embodiment of the present application is a foldable screen, the acceleration sensor 280B can be used to detect the folding or unfolding operation acting on the display screen 294. The acceleration sensor 280B can report the detected folding operation or unfolding operation as an event to the processor 210 to determine the folding state or unfolding state of the display screen 294.

[0185] The proximity light sensor 280G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The mobile phone emits infrared light outward through the light emitting diode. The mobile phone uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the mobile phone. When insufficient reflected light is detected, the mobile phone can determine that there is no object near the mobile phone. When the display screen in the embodiment of the present application is a foldable screen, the proximity light sensor 280G can be set on the first screen of the foldable display screen 294, and the proximity light sensor 280G can detect the size of the folding angle or unfolding angle between the first screen and the second screen based on the optical path difference of the infrared signal.

[0186] The gyroscope sensor 280A (or the acceleration sensor 280B) can send the detected motion state information (such as angular velocity) to the processor 210. The processor 210 determines whether the current state is handheld or tripod based on the motion state information (for example, when the angular velocity is not 0, it means that the mobile phone 200 is in the handheld state).

[0187] The fingerprint sensor 280H is used to collect fingerprints. The mobile phone 200 can use the collected fingerprint characteristics to achieve fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.

[0188] The touch sensor 280K is also called a "touch panel". The touch sensor 280K can be set on the display screen 294, and the touch sensor 280K and the display screen 294 form a touch screen, also called a "touch screen". The touch sensor 280K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 294. In other embodiments, the touch sensor 280K can also be set on the surface of the mobile phone 200, which is different from the position of the display screen 294.

[0189] Exemplarily, the display screen 294 of the mobile phone 200 displays a main interface, which includes icons of multiple applications (such as a camera application, a WeChat application, etc.). The user clicks the icon of the camera application in the main interface through the touch sensor 280K, triggering the processor 210 to start the camera application and turn on the camera 293. The display screen 294 displays the interface of the camera application, such as a viewfinder interface.

[0190] The wireless communication function of the mobile phone 200 can be realized through the antenna 1, the antenna 2, the mobile communication module 251, the wireless communication module 252, the modem processor and the baseband processor.

[0191] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in mobile phone 200 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0192] The mobile communication module 251 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the mobile phone 200. The mobile communication module 251 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 251 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 251 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 251 can be set in the processor 210. In some embodiments, at least some of the functional modules of the mobile communication module 251 can be set in the same device as at least some of the modules of the processor 210. In an embodiment of the present application, the mobile communication module 251 can also be used to interact with other terminal devices for information.

[0193] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 270A, a receiver 270B, etc.), or displays an image or video through a display screen 294. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 210 and be set in the same device as the mobile communication module 251 or other functional modules.

[0194] The wireless communication module 252 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the mobile phone 200. The wireless communication module 252 can be one or more devices integrating at least one communication processing module. The wireless communication module 252 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and filters it, and sends the processed signal to the processor 210. The wireless communication module 252 can also receive the signal to be sent from the processor 210, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2. In the embodiment of the present application, the wireless communication module 252 is used to transmit data between other terminal devices under the control of the processor 210. For example, when the processor 210 runs the data transmission method provided in the embodiment of the present application, the processor can control the wireless communication module 252 to send a judgment request to other terminal devices, and can also receive the judgment result made by other terminal devices based on the above judgment request. The judgment result indicates whether the data to be transmitted can be transmitted to other terminal devices, and then controls the display screen 294 to display the judgment result, providing intuitive visual feedback to the user, avoiding erroneous operations and repeated operations, and improving operation efficiency.

[0195] In addition, the mobile phone 200 can implement audio functions through the audio module 270, the speaker 270A, the receiver 270B, the microphone 270C, the headphone interface 270D, and the application processor. For example, music playback, recording, etc. The mobile phone 200 can receive the key 290 input and generate key signal input related to the user settings and function control of the mobile phone 200. The mobile phone 200 can use the motor 291 to generate a vibration prompt (such as an incoming call vibration prompt). The indicator 292 in the mobile phone 200 can be an indicator light, which can be used to indicate the charging status, power changes, and can also be used to indicate messages, missed calls, notifications, etc. The SIM card interface 295 in the mobile phone 200 is used to connect the SIM card. The SIM card can be inserted into the SIM card interface 295, or pulled out from the SIM card interface 295, to achieve contact and separation with the mobile phone 200.

[0196] It should be understood that in actual applications, the mobile phone 200 may include Fig.19 The embodiments of the present application are not limited to the more or fewer components shown. The illustrated mobile phone 200 is only an example, and the mobile phone 200 may have more or fewer components than those shown in the figure, may combine two or more components, or may have different component configurations. The various components shown in the figure may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and / or application specific integrated circuits.

[0197] The software system of the terminal device can adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software structure of the terminal device.

[0198] Fig. 20 It is a software structure block diagram of the terminal device of an embodiment of the present application.

[0199] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.

[0200] The application layer can include a series of application packages.

[0201] like Fig. 20 As shown, the application package may include applications such as phone, camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

[0202] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0203] like Fig. 20 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0204] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc. The window manager can also be used to detect whether there is an expansion device transmission operation in the embodiment of the present application, such as a drag operation.

[0205] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0206] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0207] The phone manager is used to provide communication functions for terminal devices, such as the management of call status (including answering, hanging up, etc.).

[0208] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0209] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, the terminal device vibrates, the indicator light flashes, etc.

[0210] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0211] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0212] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0213] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0214] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0215] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0216] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0217] A 2D graphics engine is a drawing engine for 2D drawings.

[0218] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0219] Figure 1 A schematic diagram showing an application scenario according to an embodiment of the present application is shown. Figure 1 As shown, the first terminal device and the second terminal device can establish a wireless connection and pair through Bluetooth, hotspot, WIFI, etc., or can be connected in a wired manner, such as a mobile phone and a laptop computer connected through a USB data cable, etc. The present application does not limit the specific connection method. It can be understood by those skilled in the art that the first terminal device and the second terminal device can both be source terminals or receiving terminals. In the embodiments of the present application, in order to facilitate the clear description of the technical solution, the first terminal device is the source terminal and the second terminal device is the receiving terminal unless otherwise specified.

[0220] Figure 2 A schematic diagram of the internal system structure of a terminal device according to an embodiment of the present application is shown as follows: Figure 2As shown, the system of the terminal device may include an application service layer, an application framework layer ( Figure 2 The Framework in is an example) and a cross-device transmission service system that implements cross-device data transmission functions, for example, Figure 2 The drag service system in is an example of a cross-device transmission service system.

[0221] The application framework layer can be found in Fig. 20 , in this embodiment, the application framework layer may include inputDispatcher, View system and WmS (windowManagerService), the inputDispatcher in the Framework layer is responsible for receiving user operations and distributing them to various windows for processing; WmS can manage the displayed windows together with the View system as part of the window manager, WmS responds to user operations in the window, such as dragging actions, touch screen actions, clicking operations, etc., WmS can determine whether the user operation is a cross-device transmission operation (for example, a drag operation) in response to the user operation, where the cross-device transmission operation may refer to an operation for transmitting an object on one terminal device to another terminal device, that is, an operation in which the terminal device detects it as the source end, and the cross-device transmission operation may be one or a series of pre-set operations, and when WmS compares the user operation with the pre-set operation and determines that the user operation meets the pre-set operation, it can determine that the user operation is a cross-device transmission operation. If WmS determines that the user operation is a cross-device transmission operation, a cross-device transmission event can be generated and sent to the drag service system. The drag service system can be a service added in the system runtime layer to implement cross-device data transmission based on various forms of operations such as dragging. The drag service system can listen to the cross-device transmission events of the Framework layer and send the cross-device transmission events to the drag service system of another connected terminal device.

[0222] The application service in the application service layer can register a listener for cross-device transmission operations (for example, drag listener) in the WmS of the Framework layer. After registering the listener for cross-device transmission operations, if the Framework layer of the terminal device detects that there is a cross-device transmission event (for example, a drag event) for the application service in the window or the drag service system of one terminal receives a cross-device transmission event sent by the drag service system of another terminal, the Framework layer can send the cross-device transmission event to the application service, and the application service can determine whether it can accept the object (data) of the cross-device transmission event. Among them, the cross-device transmission event for the application service can refer to the user dragging an object on one terminal to the application service on another terminal, the location within the application service, etc., and the Framework layer of the terminal device detects that there is a cross-device transmission event for the application service in the window, which can refer to the device as the receiving end detecting the dragging of the object in the local display window after receiving the object sent by the source end, etc., for dragging the object into the application service or the location within the application service. At this time, the Framework layer of the receiving end can send the cross-device transmission event to the application service, and the application service can determine whether it can accept the object (data) of the cross-device transmission event.

[0223] In one possible implementation, Figure 2 The drag service system in the embodiment may include a first interface and a second interface. The first interface may be used for communication with the Framework layer, and the second interface may be used for communication with a communication component of a terminal device. The communication component of the terminal device may be a wireless communication component, such as an antenna, or a hardware interface for implementing wired communication, which is not limited in this application.

[0224] Both the first interface and the second interface can be implemented in the form of software interfaces. For example, both the first interface and the second interface can be implemented through callback functions, and other functions of the drag service system can also be implemented in the form of software. For example, a callback function that listens to cross-device transmission operations can be registered at the Framework layer, that is, a pointer to call the drag service system (drag service function) can be registered at the Framework layer. When the Framework layer listens to the cross-device transmission operation, it can generate a cross-device transmission event, thereby triggering the call to the drag service system (drag service function). The drag service system can generate a judgment request based on the cross-device transmission event of the Framework layer, and send it to another terminal device through the second interface and the communication component. After receiving the judgment request, the drag service system of another terminal device can send it to its own Framework layer through the first interface.

[0225] It should be noted that Figure 2Only the internal structure of the Framework layer of one terminal device is shown. The same structure also exists in another terminal device, but it is not shown.

[0226] The operating system installed in the terminal device can be Android, iOS, Windows, Mac, Linux and other systems. This application does not limit this. For different systems, drag service applications can be developed according to the above method to support cross-device data transmission by dragging.

[0227] According to the above examples, it can be seen that by improving the system of the terminal device or adding new application services, data can be transmitted between two terminals. On this basis, the data transmission method of this application is introduced. Figure 3a and Figure 3b Flowcharts of a data transmission method according to an embodiment of the present application are respectively shown. Figure 3a The data transmission method shown can be applied to Figure 1 The first terminal device in the example, that is, the source device, can be applied to the transmission method, which may include:

[0228] Step S100: When a first terminal device detects a first cross-device transmission operation for an object on the first terminal device, the first terminal device obtains a data type of the object, wherein the first cross-device transmission operation is used to initiate a process of transmitting the object to a second terminal device;

[0229] Step S101: sending a determination request carrying the data type to the second terminal device.

[0230] Step S102, receiving a determination result made by the second terminal device based on the data type, wherein the determination result indicates whether the object can be transmitted to the second terminal device;

[0231] Step S103: display the judgment result.

[0232] Figure 3b The method shown can be applied to Figure 1 The second terminal device in the embodiment can be applied to a receiving device. In this embodiment, the data transmission method may include:

[0233] Step S201, receiving a determination request sent by a first terminal device, wherein the determination request carries a data type of an object to be transmitted, and the determination request is used to request the second terminal device to determine whether an object of the data type can be transmitted to the second terminal device;

[0234] Step S202: Make a judgment result according to the data type, and send the judgment result to the first terminal device so that the first terminal device displays the judgment result.

[0235] In step S100, the first cross-device transmission operation is used to initiate the process of transmitting the object to the second terminal device, which may mean that the drag service system can be invoked through the first cross-device transmission operation. That is, the user can trigger the dragstart event through the first cross-device transmission operation on the display screen of the first terminal device, and the drag data (object) can be specified through setData() in the dragstart event. Triggering the dragstart event can invoke the drag service system and initiate the process of transmitting the object to the second terminal device.

[0236] like Figure 2 As shown, the Framework layer of the first terminal device can monitor user operations, and can pre-set operations that can invoke the drag service system as preset operations on the first terminal device and the second terminal device. The first terminal device can compare the monitored user operations with the preset operations. When the user operations match the preset operations, the first terminal device can determine that there is a first cross-device transmission operation for a certain object, which is equivalent to detecting the first cross-device transmission operation for the object on the first terminal device, and can invoke the drag service system.

[0237] In one possible implementation, the first cross-device transmission operation may refer to the process from initiating the operation to stopping the operation. When the location where the operation stops is within a preset area of ​​the first terminal device (such as the edge of the display screen, etc.), it indicates that cross-device transmission is to be performed, and the drag service system can be evoked.

[0238] In one possible implementation, the first cross-device transmission operation may be a drag operation. For ease of explanation, the following description is made using the drag operation as an example, but the present application is not limited thereto. For different terminal device types (for example, a touch screen device or a non-touch screen device) or different objects, the corresponding first cross-device operation may also be different.

[0239] For example, for a touch screen device, the preset operation may be that the user's finger or palm long presses the object and drags the object to the edge of the screen, or that the user taps the object with a stylus pen and immediately slides it to the edge of the screen. The direction of sliding is not limited and may be downward, upward, left, right or in other directions. Alternatively, after selecting a section of text, long pressing the selected text may bring up multiple controls that may include a "cross-device transmission" control. When the "cross-device transmission" control is triggered, the drag service system may be invoked, that is, the preset operation may be that the "cross-device transmission" control is triggered, and so on. For a non-touch screen device, the preset operation may be that the mouse moves to the object, the finger clicks the left mouse button and does not release it and drags it to the edge of the display screen, or the finger controls the touch panel to select the object and drags it to the edge of the screen, and so on. It should be noted that the above possible ways in which the first terminal device detects the first cross-device transmission operation are only some examples of the present application, and the present application is not limited thereto.

[0240] The object of this application can be a document, folder, text, picture, audio, video or link, etc. The first terminal device can identify the type of data by the extension of the data. For example, for an object, the data type of the object can be obtained by identifying the extension of the object. Taking video as an example, if the extension of the object contains ".avi", ".mov" and other extensions representing images, the data type of the object can be identified as video; taking audio as an example, if the extension of the object contains ".wav", ".mp4", ".mp3" and other extensions representing sounds, the type of the object can be identified as audio.

[0241] In one possible implementation, the drag data specified by setData() in the dragstart event may include two parts of information, namely, the data type and the value of the data, that is, the data type of the object and the data corresponding to the object. After obtaining the data type of the object, the first terminal device may add it to the setData() of the dragstart event. When the dragstart event is triggered to invoke the drag service system, the drag service system may send a judgment request to the second terminal according to the data type specified in the dragstart event, and the judgment request may carry the data type of the object.

[0242] Figure 4 A schematic diagram showing an application scenario of a data transmission method according to an embodiment of the present application. Figure 4 As shown, device 1 and device 2 are paired and connected wirelessly, device 2 and device 3 can be paired and connected wirelessly or by wire, and device 1 and device 3 are connected wirelessly or by wire. Device 1, device 2, and device 3 can perform cross-device data transmission in the embodiment of the present application.

[0243] In a possible implementation, device 1 and device 2 may be touch-screen terminal devices, such as smart phones, tablet computers, etc., and multiple applications may be installed on device 1 and device 2, such as Figure 4 As shown, both device 1 and device 2 can be installed with application A and application B. Application A can refer to "rich media" applications such as social networking, email, and browsers, and the content can include text, pictures, documents, links, etc. Application B can refer to file management applications, such as file managers and photo galleries, and the content mainly includes pictures, videos, audio, and documents, without separate text content. Device 3 can be a non-touch screen device, such as a laptop computer, and device 3 can be installed with program A and store folders. Program A can refer to office software, browsers, and other applications in Windows / Mac systems. Figure 4 Shows some example object data types and possible presentation forms, which can be located in the application or archive management. This application is not limited to Figure 4 The type and presentation form of the object represented in.

[0244] For step S101, Figure 2 As shown, the first terminal device can send a judgment request to the drag service system of the second terminal device through the evoked drag service system, and the judgment request includes the data type of the object. Therefore, in step S201, the second terminal device receives the judgment request sent by the first terminal device, the judgment request carries the data type of the object to be transmitted, and the judgment request is used to request the second terminal device to judge whether the object with the above data type can be transmitted to the second terminal device.

[0245] For step S202, in a possible implementation, the second terminal device can determine whether the object can be transmitted to the second terminal device according to the data type of the object and the type of the second terminal device, and each type of the second terminal device can be preset with data types that are allowed to be transmitted or not allowed to be transmitted. For example, if the object is a text file or a folder, and the second terminal device is a Bluetooth speaker, then the determination result of the second terminal device may be that it cannot be transmitted to the second terminal device; if the object is an audio file or a video file with audio, and the second terminal device is a Bluetooth speaker, then the determination result of the second terminal device may be that it can be transmitted to the second terminal device.

[0246] For step S202, in a possible implementation, the second terminal device may also determine whether the object can be transmitted to the second terminal device according to the data type of the object and the application service installed on the second terminal device. The application service installed on the second terminal device may refer to an application or software program installed on the second terminal device, such as an APP installed on a smart phone, a software program installed on a laptop, etc.

[0247] The above are merely two exemplary implementations of determining whether an object can be transmitted to a second terminal device based on its data type, and the present application is not limited thereto.

[0248] After making a judgment result, the second terminal device can send the judgment result to the drag service system of the first terminal device through the drag service system. After receiving the judgment result, the drag service system of the first terminal device can send it to the Framework layer, and the Framework layer controls the display screen of the first terminal device to display the judgment result.

[0249] There are many ways to display the judgment results. Figure 5a and Figure 5b Examples of a method of displaying a determination result according to an embodiment of the present application are respectively shown. Figure 5a Schematic diagrams showing display interfaces of two examples of first terminal devices, Figure 5b Schematic diagrams showing display interfaces of the first terminal devices of two other examples. Figure 5a and Figure 5b The edge area of ​​the display screen is indicated by a dotted line.

[0250] For example, Figure 5a As shown, taking the mouse dragging method as an example, a small icon can be displayed near the mouse pointer on the display screen, and different colors of the small icon can represent different judgment results. For example, a green small icon indicates that the data can be transmitted to the second terminal device, and a red small icon indicates that the data cannot be transmitted to the second terminal device, or Figure 5a As shown, different shapes of small icons can represent different judgment results. A small icon with a check mark “√” can indicate that the data can be transmitted to the second terminal device, a small icon with a cross “×” can indicate that the data cannot be transmitted to the second terminal device, and so on.

[0251] like Figure 5b As shown, taking finger operation as an example, prompt information can be displayed near the icon of the object (such as a thumbnail) to display the judgment result. For example, the prompt information "XX cannot be received" or "XX is acceptable" can be displayed in the upper right corner of the object's icon to indicate different judgment results, where "XX" can represent the identification information of the second terminal device. The example of mouse operation can also use this method to display the judgment result.

[0252] The displayed judgment result may also include the reason for generating the judgment result, such as "device B cannot receive .avi format files", etc., so that the user can know the reason more intuitively and take corresponding solutions.

[0253] It should be noted that the above methods of displaying the judgment results are merely some examples of the present application and do not limit the present application in any way, as long as the judgment results can be displayed to the user intuitively.

[0254] Through the data transmission method of the above-mentioned implementation mode of the present application, it is possible to provide users with intuitive visual feedback based on the data type of the object and the degree of matching of the receiving end, thereby avoiding erroneous operations and repeated operations and improving operational efficiency.

[0255] In the related art, only the dragging of text, documents, pictures, files and other contents can be realized, and the draggable contents are limited. In order to solve this technical problem, the present application adds an extended field in the dragevent event to extend the draggable contents. Figure 6 FIG. 1 is a schematic diagram showing the fields included in the dragevent event according to an embodiment of the present application. Figure 6 As shown, the fields label and mimeTypes in the dotted boxes are the fields extended on the clipDescription object, where label is of String type and can extend the action, such as "open", and mimeTypes is the data type of the object. The above two extended fields can be used to extend the drag object and the actions on the drag object.

[0256] Figure 6 The "action" on the left side of the draggable event directly connected to the draggable event refers to drag, dragstart, dragenter, dragend, drop and other actions, which refers to a series of drag actions; x and y can represent the coordinates of the position where the drag action stops, clipdata can refer to some attributes of the dragged data, such as the MIME type of the clip object, the text contained in the ClipData.Item object, web page text, Uri or Intent data; result can be a field that records the returned judgment result. It should be noted that Figure 6 What is shown is only one way of extending fields in the present application. The present application is not limited thereto, and fields may also be extended on other suitable objects or locations on the dragevent event.

[0257] Therefore, in a possible implementation, the judgment request may carry a data type field and / or an extended data type field, and the data type field and the extended data type field are used to indicate the data type of the object. In this way, when the drag service system of the first terminal device sends the judgment request to the second terminal device, the second terminal device may judge whether it can process the object that the first terminal device is going to move to the second terminal device according to the data type field and / or the extended data type field, and obtain a judgment result.

[0258] According to the data transmission method of the above-mentioned implementation mode of the present application, the draggable content can be expanded, and the extended data type field can indicate a customized data type, a data type suitable for a specific device or application, or a newly emerging data type, so that a wider variety of data types and devices are applicable when transmitting data across devices, which is convenient for user operation.

[0259] For example, the related art cannot implement the drag and drop operation on some public account articles on social platforms. According to the implementation of the present application, the data type "Weblinks" can be added to the extended field of the dragevent event, and the corresponding action can be to open in the browser or in the application corresponding to the social platform, etc. Different strings can be used to represent different actions. In one example, for the "Weblinks" data type, if it is not set (for example, the label field is empty), it can be opened in the browser by default.

[0260] Figure 7 A schematic diagram showing an application scenario according to an embodiment of the present application is shown in FIG. Figure 7 As shown, assuming that both the first terminal device and the second terminal device are smart phones, the first terminal device opens a public account article with a link in application A (the link can be an object), and the preset operation set for such an object can be a large-area touch and then a slide to one side. When the first terminal device detects a large-area touch and then a slide to one side operation on the currently displayed page, it can be determined that the public account article with a link opened in application A needs to be transmitted across devices. For example, Figure 7 As shown, when the user touches the screen with the entire palm or most of the palm and slides to the right, triggering the dragstart event, the first terminal device can send a judgment request to the second terminal device. The judgment request table carries an extended data type field: the data type is "Weblinks" and the label field is empty. The second terminal device receives the judgment request. The second terminal device is a smart phone with a browser installed locally. Therefore, the judgment result can be transmitted to the second terminal device. The second terminal device can send the judgment result to the first terminal device. The first terminal device displays the judgment result on the display screen. After the user sees the judgment result, if the drag gesture is released, that is, the first terminal device detects the drop operation, the above-mentioned link and the extended data type field can be sent to the second terminal device. The second terminal device recognizes that the data type of the object is "Weblinks" and the label field is empty based on the extended data type. Therefore, the object is opened in the default way, such as Figure 7 Open the link in your browser as shown.

[0261] Figure 8a and Figure 8b Flowcharts showing a method for transmitting data according to an embodiment of the present application are shown respectively. Figure 8a The transmission method shown can be applied to a first terminal device, such as Figure 8a As shown, the transmission method of this embodiment may include:

[0262] Step S800: When the first terminal device detects a first cross-device transmission operation for an object on the first terminal device, the first terminal device obtains a data type of the object, wherein the first cross-device transmission operation is used to initiate a process of transmitting the object to a second terminal device;

[0263] Step S801: sending a determination request carrying the data type to the second terminal device.

[0264] Step S802, receiving a determination result made by the second terminal device based on the data type, wherein the determination result indicates whether the object can be transmitted to the second terminal device;

[0265] Step S803, displaying the judgment result;

[0266] Step S804, when the judgment result is that the object can be transmitted to the second terminal device and a second cross-device transmission operation is detected, the object is sent to the second terminal device, and the second cross-device transmission operation is used to confirm that the object is transmitted to the second terminal device for display.

[0267] For steps S800-S803, see Figure 3a The description of steps S100-S103 in the corresponding implementation method part will not be repeated here.

[0268] For step S804, the second cross-device transmission operation corresponds to the first cross-device transmission operation, for example, if the first cross-device transmission operation is a drag operation, then the second cross-device transmission operation may be a drag-and-release operation. Taking a non-touch screen device as an example, if the first cross-device transmission operation is a finger clicking the left mouse button and not releasing it and dragging, then the second cross-device transmission operation may be releasing the left mouse button, or taking a touch screen device as an example, if the first cross-device transmission operation is a finger or a touch pen pressing and dragging an object, then the second cross-device transmission operation may be the finger or the touch pen leaving the touch screen.

[0269] Sending the object to the second terminal device may refer to sending one or more of the data corresponding to the object, the data type, the indication information of the processing method of the object, etc. to the second terminal device, and the second terminal device may process the data according to the processing method. In one possible implementation, as described above, the indication information of the processing method of the object may also be carried in the dragstart event.

[0270] Figure 8b The transmission method shown can be applied to a second terminal device, such as Figure 8b As shown, the transmission method of this embodiment may include:

[0271] Step S301, receiving a determination request sent by a first terminal device, wherein the determination request carries a data type of an object to be moved, and the determination request is used to request the second terminal device to determine whether an object of the data type can be transmitted to the second terminal device;

[0272] Step S302, making a judgment result according to the data type, and sending the judgment result to the first terminal device so that the first terminal device displays the judgment result;

[0273] Step S303: When receiving the object sent by the first terminal device, the object is processed according to one or more of the data type, the local storage status, and the application service installed by the second terminal device.

[0274] For details about steps S301-S302, see Figure 3b The description of steps S201-S202 of the corresponding implementation method will not be repeated here.

[0275] For step S303, taking the local storage status as an example, when the local storage status is no storage capacity, the second terminal device can open the object according to the application service installed on the second terminal device; when the local storage status is storage capacity, the second terminal device can store the object locally.

[0276] In one possible implementation, the local storage status of the second terminal device is that it has no storage capacity. The second terminal device can select an application service installed on the second terminal device to open the object according to the data type of the object, or the second terminal device can also display options for selectable application services installed on the second terminal device and open the object according to the application service selected by the user.

[0277] In a possible implementation, the local storage state of the second terminal device is that it has storage capacity. In addition to storing the object locally, the second terminal device can also process the object according to the operation specified by the first terminal device. As described above, when the first terminal device sends the object to the second terminal device, it also sends the indication information of the processing method of the object. Therefore, the second terminal device can process the object according to the processing method. If the first terminal device does not specify the processing method of the object, the second terminal device can select the installed application service to open the object according to the data type of the object, or, as described above, open the object according to the application service selected by the user.

[0278] It should be noted that the above are merely examples of several processing methods for objects shown in this application and do not limit this application in any way.

[0279] Figure 8c FIG. 1 shows an interactive flow chart of an application scenario according to an embodiment of the present application. Figure 8c As shown, device A is an example of a first terminal device, and device B is an example of a second terminal device. Device A (Framework layer) detects a drag operation on a local object, and the Framework layer of device A generates a dragstart event to invoke the drag service system of device A. The drag service system of device A can generate a judgment request according to the data type of the object specified by the dragstart event. The judgment request can be a request to determine whether dragging is allowed. The drag service system of device A sends the judgment request to the drag service system of device B. The drag service system of device B sends the judgment request to the WindowManager on device B, which is then sent to WmS by WindowManager. WmS can send the judgment request to the corresponding application service (APP), and the application service makes a judgment result in response to the judgment request, and returns the judgment result to device A step by step. Device A can display the judgment result. If the judgment result is that dragging is allowed, the Framework layer of device A detects the drag and release operation and can send the object to the drag service system of device A. The drag service system of device A transmits the object to the drag service system of device B. After the drag service system of device B receives the object, it can save the object and send it to the Framework layer and application service layer through the notifyDragAndDrop message to process the object.

[0280] The data transmission method according to the above-mentioned implementation manner can simplify user operations. Through simple actions such as dragging and dropping, not only can the display position of the object be changed, copied, transmitted, etc., but the receiving end can also directly perform corresponding processing according to the data type of the object. For example, in addition to storage, you can also choose to open the application service, open it with the currently opened application service, etc., without the need for further operations by the user at the receiving end, which greatly simplifies user operations.

[0281] Figure 9a A flow chart of a data transmission method according to an embodiment of the present application is shown. Figure 9a The flowchart of an example of the process included in the step of "sending the object to the second terminal device" in step S804 is shown. Figure 9a As shown, the step of "sending the object to the second terminal device" may include:

[0282] Step S8041, temporarily storing the object locally in the first terminal device;

[0283] Step S8042, sending a data transmission request to the second terminal device, where the data transmission request is used to transmit the object;

[0284] Step S8043, when receiving a first response signal returned by the second terminal device for accepting the data transmission request, sending the object according to the first response signal;

[0285] Step S8044: upon receiving a second response signal returned by the second terminal device indicating that the data transmission request is not accepted, cancel sending the object.

[0286] Figure 9b A flow chart of a data transmission method according to an embodiment of the present application is shown. Figure 9b The transmission method can be applied to the second terminal device. The transmission method of this implementation may include:

[0287] Step S204, when receiving the data transmission request sent by the first terminal device, displaying processing options;

[0288] Step S205: determining a response signal in response to the data transmission request according to the selection operation for the processing option, and sending the response signal to the first terminal device.

[0289] That is to say, when the first terminal device determines that the object can be transmitted to the second terminal device and detects the second cross-device transmission operation, it can temporarily store the object locally on the first terminal device, and send a data transmission request to the second terminal device, and process the object according to the response signal to the data transmission request returned by the second terminal device.

[0290] When the second terminal device receives the data transmission request sent by the first terminal device, the second terminal device displays processing options. The processing options may refer to processing options for the object, for example, multiple selectable controls displayed in the form of controls, or prompt information of different selectable gestures.

[0291] In one example, the second terminal device displays a plurality of selectable controls in the form of controls, for example, "cancel", "delay sending", "receive", etc. In another example, the second terminal device displays processing options in the form of selectable prompt information of different gestures, for example, a left-slide gesture is displayed on the display screen to cancel sending, a right-slide gesture is displayed to receive, and an upward or downward-slide gesture is displayed to delay sending.

[0292] In step S205, the response signal in response to the data transmission request may include a first response signal and a second response signal. The first response signal may be a signal indicating acceptance of the data transmission request, for example, the user selects to receive or delay transmission, or the user slides to the right, slides up, etc., indicating that the second terminal device allows the sending of the object corresponding to the data transmission request. In this case, the second terminal device determines that the response to the data transmission request is the first response signal, and sends the first response signal to the first terminal device. The second response signal may be a signal indicating that the data transmission request is not accepted, that is, the second terminal device does not allow the first terminal device to send the object corresponding to the data transmission request. For example, the user selects to cancel, or the user slides to the left, etc. The second terminal device may determine that the response to the data transmission request is the second response signal according to the user's selection operation for the processing option, and sends the second corresponding signal to the first terminal device.

[0293] In step S8043, when the first terminal device receives the first response signal, it sends the object according to the first response signal. For example, when the first response signal is received, the object can be sent directly or delayed. The delay time of delayed sending can be preset by the first terminal device, or can be specified by the first response signal fed back by the second terminal device. For example, when the second terminal device displays the processing options, it can also provide the user with an option to select a delay time for the delayed sending option, or provide an input box for the delay time, and collect the delay time input by the user through the input box. The second terminal device can generate a first response signal according to the delay time selected or input by the user, and send the first response signal to the first terminal device. The first terminal device can delay sending the object according to the delay time carried by the first response signal.

[0294] In step S8044, the first terminal device cancels the sending of the object when receiving the second response signal. After canceling the sending of the object, the object can be saved (temporarily stored) for a certain period of time in the foreground of the first terminal device. The length of the saving time can be preset by the first terminal, or can be adjusted in real time according to the amount of data saved in the foreground. For example, when the amount of saved data exceeds the set threshold, the earliest saved data can be deleted, and so on.

[0295] In a possible implementation, after canceling the sending object, the following steps may also be included:

[0296] When a call-out instruction for the temporarily stored object is detected, the temporarily stored object is called out, and the data transmission request is sent to the second terminal device.

[0297] This step is sufficient as long as most objects are temporarily stored locally on the first terminal device. It is only an example after the sending of the object is canceled, and the specific scenario is not limited to this.

[0298] That is, after canceling the sending of the object, if the user wants to continue sending the object, the temporarily stored object can be called out through a call-out instruction, and the call-out instruction can be detected when the first terminal device detects the user's call-out operation, and the call-out operation can be a pre-set operation, such as sliding along one side of the screen to the middle. The first terminal device can also resend the data transmission request to the second terminal device, and the subsequent process can refer to the above description.

[0299] According to the data transmission method of the above-mentioned embodiment, optional operations for the dragged object can be displayed on the display screen of the receiving device, so that the user can adjust the transmission process or processing method according to actual needs, so that the second terminal device can process the object according to actual needs.

[0300] In a possible implementation, the user may also use the above-described process to temporarily store multiple objects in the foreground of the first terminal device, such as sending the first object to the second terminal device, and then sending the second object to the second terminal device, and both the first object and the second object are temporarily stored in the foreground of the first terminal device. In this case, if the second terminal device receives multiple data transmission requests in succession, the processing options provided may be different from those when only one data transmission request is received, for example, "receive all" or "delay all" may be provided. The second terminal device may also display thumbnails of multiple objects, and display a selection control near the thumbnail of each object for the user to select. The user may select the object to be received, and then select "receive" or "delay receiving" or "cancel", etc. The second terminal device may process the object according to the detected selection operation.

[0301] Fig.9c A flow chart of a data transmission method according to an embodiment of the present application is shown. Fig.9c The transmission method can be applied to the second terminal device. The transmission method of this implementation may include:

[0302] Step S206, when receiving the object sent by the first terminal device, if the second terminal device has storage capability, temporarily storing the object locally;

[0303] Step S207, displaying processing options;

[0304] Step S208: Process the object according to the selection operation for the processing option.

[0305] That is, in step S804, after the first terminal device sends the object to the second terminal device, when the second terminal device receives the object, it can first determine whether the local device has storage capacity. If the storage capacity is available, the object can be temporarily stored locally, for example, temporarily stored in the foreground. Then, the processing options are displayed. The displayed processing options and the process of processing the object according to the selection operation for the processing options can be referred to the description of steps S204-S205 above, which will not be repeated here.

[0306] In one possible implementation, after temporarily storing the object locally, when the second terminal device detects a drag operation on the temporarily stored object, it can determine whether the position where the drag operation stops is a draggable position, generate a judgment result, and display the judgment result. For example, the second terminal device can determine whether the position where the drag operation stops is a draggable position based on the coordinates of the position where the drag operation stops in the current display interface and / or the data type of the object.

[0307] In one example, if the current display interface of the second terminal device is a desktop or a folder, if the drag operation stops at a blank location on the desktop or a folder, it is determined to be a draggable location. If the drag operation is released, the second terminal device can directly store the object locally, such as in a system disk or a folder, and can also select an application service to open the object according to the data type of the object, or as described above, open the object according to the application service selected by the user.

[0308] In another example, if the drag operation stays on the shortcut icon of the application service, the second terminal device can determine whether it is a draggable position based on the data type of the object and the application service. For example, if the application service can open the object of the data type, it can be determined that it can be dragged into the position, and if the drag operation is released, the second terminal device can use the application service to open the object; if the application service cannot open the object of the data type, it can be determined that it cannot be dragged into the position, and if the drag operation is released, the object can be saved locally, and the application service installed by the second terminal device can be selected to open the object based on the data type of the object, or as described above, the object can be opened according to the application service selected by the user.

[0309] In another example, if the second terminal device currently opens an application service, the second terminal device may determine whether the position is a draggable position based on the position where the drag operation stops in the current display interface of the application service and the data type of the object.

[0310] In a possible implementation, the application services of the first terminal device and the second terminal device may pre-register the drag listener in the Framework layer, for example, register the drag listener with the WMS of the Framework layer. In this way, when the Framework layer of the first terminal device and the second terminal device detects a drag event or receives a drag event sent by another terminal device, it may send the drag event to the corresponding application service, and the application service may determine whether the object can be dragged in according to the drag event.

[0311] like Figure 2 As shown, the Framework layer of the second terminal device can generate a DRAG_LOCATION event based on the captured coordinates of the above-mentioned location and the data type of the object, and send the DRAG_LOCATION event to the corresponding application service. The application service opened by the second terminal device as described above can determine whether the location corresponding to the coordinates can be dragged into the object of the above-mentioned data type based on the coordinates and the data type. If it can be dragged in, the determination result is displayed in the current display interface of the second terminal device. For specific display methods, please refer to Figure 5a or Figure 5b Examples in .

[0312] Figure 9d and 9e Schematic diagrams of display interfaces of terminal devices according to an embodiment of the present application are respectively shown. Figure 9d As shown, when the first terminal device detects the second cross-device transmission operation, it can send a data transmission request to the second terminal device after temporarily storing the object locally, or it can directly send the object to the second terminal device. The second terminal device can display processing options. The second terminal device (such as a smart phone) displays a desktop or an open folder. The user can select a processing method (such as undo, delay, etc.) in the second terminal device, or continue to drag the object. If the second terminal device detects that the object is dragged to a blank position, the second terminal device can directly store the object locally, such as in a system disk or a folder, and can also select an application service to open the object according to the data type of the object, or as described above, open the object according to the application service selected by the user. Figure 9d The fourth display screen in FIG. 1 shows a scene of opening an object (picture).

[0313] like Fig.9e As shown, the second terminal device displays the scene of the application service being opened. If the second terminal device captures the user's drag operation staying at a certain position in the current display interface of the application service, it can determine whether it is a draggable position based on the coordinates of the position and the data type of the object. Fig.9eAs shown, if a drag-release operation is detected, and the position where the drag operation stops before the release is where the object can be dragged, the second terminal device can open the object at the position, such as Fig.9e As shown in the fourth display screen in FIG. , the object is opened in the conversation interface of the instant messaging application service.

[0314] Figure 9f A schematic diagram showing a specific application scenario according to an embodiment of the present application is shown as follows: Figure 9f As shown, the second terminal device opens the mail service and creates a new mail according to the user's operation. After the second terminal device receives the data transmission request sent by the first terminal device or temporarily stores the object sent by the first terminal device locally, processing options are displayed on the display interface, including "Undo", "Drag out from XX", thumbnails of objects, etc. When the user drags an object on the display interface of the second terminal device (for example, a thumbnail of the dragged object), it displays in real time whether objects of this data type are allowed to be dragged into this position based on the position where the drag operation stops in the newly created mail and the data type of the object.

[0315] If the user chooses to cancel the drag, the object is temporarily stored in the foreground of the second terminal device or the first terminal device. Taking the temporary storage in the foreground of the second terminal device as an example, after the second terminal device detects the operation of canceling the drag, the object can still be temporarily stored in the foreground, and the second terminal device can collapse the processing options, such as Figure 9g Example shown. If the user wants to process the object again, he can slide out the processing options, and the second terminal device processes the object according to the selection operation for the processing options. According to the data transmission method of the above embodiment, the selectable operations for the dragged object can be displayed on the display screen of the receiving end device, so that the second terminal device can process the object according to actual needs.

[0316] In a possible implementation, the first terminal device is connected to more than two candidate terminal devices, where the connection may include a wired connection and / or a wireless connection, which is not limited in this application. Fig.10 A schematic diagram showing an application scenario according to an embodiment of the present application is shown. Fig.10 As shown, the first terminal device is wirelessly connected to three candidate terminal devices (candidate terminal device 1, candidate terminal device 2 and candidate terminal device 3). In this embodiment, the data transmission method of the present application may also include: determining the second terminal device from more than two candidate terminal devices.

[0317] In a possible implementation, when the first terminal device detects a first cross-device transmission operation on an object locally on the first terminal device, the first terminal device determines a second terminal device corresponding to the first cross-device transmission operation from the two or more candidate terminal devices according to a stop position of the first cross-device transmission operation.

[0318] In a possible implementation, terminal devices corresponding to different positions on the display screen of the first terminal device may be preset, and dragging to a corresponding position may indicate that the user wants to drag the object into the terminal device corresponding to the position. Figure 4 For example, for device 2, when pairing, the left area of ​​the display screen of device 2 can be set to correspond to device 1, and the right area can be set to correspond to device 2. The left area or the right area is only an example of the present application, and the present application is not limited thereto. For example, it can also be the upper area or the lower area. The size of each area can be set according to actual conditions. For example, if only the corresponding terminal devices are set for the left area and the right area, the left 1 / 3 of the display screen can be set as the left area, and the right 1 / 3 can be set as the right area.

[0319] In one possible implementation, the first terminal device may also display information of two or more candidate terminal devices on a display screen when detecting a first cross-device transmission operation for an object locally on the first terminal device. For example, it may be identification information of the second terminal device. The display may be in the form of displaying "icons and / or text" at a fixed position on the display screen, wherein the icons may include icons representing candidate terminal devices, icons of candidate terminal devices, icons of application services installed on candidate terminal devices, etc., and the text may be identification information of the candidate terminal device, options for how to process the object, etc.

[0320] Fig.11a A schematic diagram showing a display interface of a first terminal device according to an embodiment of the present application is shown. Fig.11a An example in which the first terminal device displays information of more than two candidate terminal devices is shown in FIG. Fig.11a As shown, the first terminal device can also display a draggable drawer (an example of an icon representing a candidate terminal device) on the right edge of the display screen when detecting a first cross-device transfer operation for an object local to the first terminal device. Each drawer can correspond to a candidate terminal device, for example, device 1 to device 4, and the device identifier of the corresponding candidate terminal device can be displayed on the drawer. The edge position of the first terminal device can display a draggable drawer, Fig.11a What is shown is merely an example and does not limit the present application in any way.

[0321] In one possible implementation, the first cross-device transmission operation may refer to a process from initiating an operation to stopping the operation. The first terminal device may display a draggable drawer on the right edge of the screen when detecting the initiation operation, and may also display a draggable drawer on the edge of the screen where the first cross-device transmission operation stops when detecting that the operation stops and the stop position is the edge of the screen. This application does not limit the specific process of displaying the draggable drawer.

[0322] In a possible implementation, determining the second terminal device corresponding to the first cross-device transmission operation from the two or more candidate terminal devices according to the stop position of the first cross-device transmission operation may include:

[0323] A second terminal device corresponding to the first cross-device transmission operation is determined according to a relationship between a stop position of the first cross-device transmission operation and display positions of information of the two or more candidate terminal devices.

[0324] During the movement of the first cross-device transmission operation, a thumbnail corresponding to the object may be generated, and the thumbnail may move along with the movement of the finger or the mouse, such as Fig.11a A small icon following the finger is shown. Therefore, the first terminal device can determine the second terminal device corresponding to the first cross-device transmission operation based on the relationship between the stop position of the thumbnail of the object and the display position of the information of more than two candidate terminal devices when the first cross-device transmission operation stops. The information of the candidate terminal device can be the drawer as described above and the device ID and other information.

[0325] When the first cross-device transmission operation is paused, the relationship between the stop position of the thumbnail of the object and the display position of the information of more than two candidate terminal devices can be: the stop position of the thumbnail of the object does not overlap with the display position of the information of more than two candidate terminal devices; or, the stop position of the thumbnail of the object at least partially overlaps with the display position of the information of one of the candidate terminal devices, for example, the stop position of the thumbnail of the object is completely located at the display position of the information of one of the candidate terminal devices or partially overlaps with the display position of the information of one of the candidate terminal devices; or, the stop position of the thumbnail of the object overlaps with the display position of the information of two or more of the candidate terminal devices.

[0326] If the position of the thumbnail of the object does not coincide with the display position of the information of more than two candidate terminal devices, the first terminal device can determine that the second terminal device is not currently selected, that is, the receiving terminal device is not selected, such as Fig.11a shown.

[0327] Fig.11b A schematic diagram showing a display interface of a first terminal device according to an embodiment of the present application is shown. Fig.11b An example is shown in which the position where the thumbnail of the object stays at least partially overlaps with the display position of the information of one of the candidate terminal devices (device 2). Fig.11b The thumbnail in the middle partially overlaps with the information of the second candidate terminal device displayed on the right edge, and the first terminal device can determine that the candidate terminal device is the second terminal device.

[0328] If the stop position of the thumbnail of the object overlaps with the display position of the information of two or more candidate terminal devices, the first terminal device may determine the candidate terminal device whose display position of the information overlaps the most with the stop position of the thumbnail of the object as the second terminal device. The first terminal device determining the candidate terminal device with the most overlap as the second terminal device is only an example of the present application, and the present application is not limited thereto. Alternatively, the first terminal device may also prompt the user to continue moving until the second terminal device can be determined.

[0329] Fig.11c A schematic diagram showing a display interface of a first terminal device according to an embodiment of the present application is shown. Fig.11d A schematic diagram showing an application scenario of a display interface of a first terminal device according to an embodiment of the present application is shown.

[0330] In a possible implementation, the first terminal device may determine the second terminal device and the processing method of the second terminal device for the object according to the detected trigger instruction of the information of more than two candidate terminal devices. In this implementation, sending the object to the second terminal device may include: sending the object and indication information to the second terminal device, the indication information is used to instruct the second terminal device to process the object in the processing method. After receiving the object and the indication information, the second terminal device may process the object according to the processing method.

[0331] Fig.11c An example is shown in which a first terminal device displays information of more than two candidate terminal devices. The first terminal device can determine a second terminal device according to a selection operation, wherein the selection operation can be a user clicking an icon of a candidate terminal device with a finger or a stylus, or clicking an icon of a candidate terminal device with a mouse. After the second terminal device is determined according to the selection operation, the processing method of the selectable second terminal on the object can be displayed, such as Fig.11cAs shown in the small window in the middle, the upper part of the small window displays the selected object and can also display the number of selected objects, that is, multiple objects can be selected. The middle part of the small window displays the information of the candidate terminal device in the form of device icons and text. The lower part of the small window also displays the applications (such as application 1, application 2) installed on the selected candidate terminal device (such as device 1) and the options for the processing methods that can be performed on the object (such as storage, opening, copying, etc.). The first terminal device can determine the processing method of the second terminal device on the object according to the selection operation. In this way, when the first terminal device sends the object to the second terminal device, it can also send instruction information to instruct the second terminal device to process the object in the above processing method.

[0332] like Fig.11c or Fig.11d As shown, the user selects the second terminal device, the application service installed on the second terminal device, and the processing method (save, open, etc.) of the second terminal device to process the object in the small window. In this way, the first terminal device can determine the second terminal device and the processing method of the second terminal device for the object.

[0333] When there is only one candidate terminal device as the second terminal device, options for the second terminal device's processing method for the object can also be displayed on the first terminal device, and the second terminal device's processing method for the object can be determined by selecting the options on the first terminal device.

[0334] According to the data transmission method of the above implementation, interaction between multiple terminal devices can be realized, and the types of the multiple terminal devices can be different, making it more convenient for users to share data between multiple different devices.

[0335] for Fig.11a and Fig.11b In the example of displaying a drawer shown, it should be noted that if the first terminal device sends an object to the second terminal device: temporarily storing the object locally can be temporarily storing the object in correspondence with the drawer (i.e., with the candidate terminal device). For example, the drawer icon is associated with a cache space. When the first terminal device detects that the user has performed a drag-and-release action in the drawer, the object corresponding to the drag-and-release action can be stored in the associated cache space.

[0336] In a possible implementation, after temporarily storing the object, the first terminal device can also display options for the second terminal device to process the object for the user to choose, as described above. The first terminal device can determine the second terminal device's processing method for the object by selecting the options, and then send a data transmission request to the second terminal device, and the data transmission request can also carry the processing method. In this way, the object processing selection method can be implemented more flexibly.

[0337] The first terminal device sends a data transmission request to the second terminal device, and the second terminal device returns a second response signal (such as Figure 9a and Figure 9b In the example shown in FIG. 1 , when the first terminal device receives the second response signal, the sending object is cancelled, and the same method can also be used. Figure 9g In a similar way, the drawer is folded and the object is still temporarily stored in the cache space. If the user wants to send the object again, he can slide out the drawer and drag the object again for transmission.

[0338] In a possible implementation, determining, according to the stop position of the first cross-device transmission operation, the second terminal device corresponding to the first cross-device transmission operation from the two or more candidate terminal devices may further include:

[0339] The second terminal device corresponding to the first cross-device transmission operation is determined according to the positional relationship between the stop position of the first cross-device transmission operation and the edge of the first terminal device.

[0340] In one possible implementation, based on the positional relationship between the first terminal device and the connected candidate terminal device, the correspondence between different edges of the first terminal device and the candidate terminal devices can be pre-set. In this way, the second terminal device corresponding to the first cross-device transmission operation can be determined based on the positional relationship between the stop position of the first cross-device transmission operation and the edge of the first terminal device.

[0341] Alternatively, in another possible implementation, a position sensor may be installed in the terminal device of the present application, which can sense the positional relationship between other terminal devices. When the first terminal device captures that the first cross-device transmission operation stays at the edge of the first terminal device, the sensor can be enabled to sense the candidate terminal device placed at the edge, and the candidate terminal device placed at the edge can be used as the second terminal device.

[0342] Fig.12a A flow chart showing a method for transmitting data according to an embodiment of the present application is shown. Fig.12a The method shown can be applied to the first terminal device. Based on steps S100-S103, the transmission method of this embodiment can also include:

[0343] Step S105: sending a display instruction to the second terminal device to instruct the second terminal device to display the first image of the object according to the display instruction and the positional relationship between the second terminal device and the first terminal device.

[0344] The second image of the object displayed on the first terminal device and the first image of the object displayed on the second terminal device can be assembled into a complete image of the object.

[0345] Figure 12b A flow chart showing a method for transmitting data according to an embodiment of the present application is shown. Figure 12b The method shown can be applied to a second terminal device. Figure 3b Based on the steps S201-S202 shown, the transmission method of this embodiment may further include:

[0346] Step S209: upon receiving a display instruction sent by the first terminal device, displaying a first image of the object corresponding to the data according to the display instruction and a positional relationship between the second terminal device and the first terminal device.

[0347] The second image of the object displayed on the first terminal device and the first image of the object displayed on the second terminal device can be assembled into a complete image of the object.

[0348] The first image and the second image may refer to a part of the thumbnail of the object, and the complete image of the object may refer to the complete thumbnail of the object. That is to say, in this embodiment, a partial image in the thumbnail corresponding to the object may be displayed according to the positional relationship between the first terminal device and the second terminal device. For example, if the second terminal device is on the right side of the first terminal device, then after the first terminal device determines the second terminal device, a display instruction may be sent to the second terminal device. The display instruction may carry the second image of the object currently displayed by the first terminal device. In this way, the second terminal device may display the complete image of the object on the display screen of the second terminal device according to the positional relationship between the second terminal device and the first terminal device, removing the first image of the second image.

[0349] In a possible implementation, displaying the first image according to the positional relationship between the second terminal device and the first terminal device may refer to displaying the first image on a side of the display screen of the second terminal device close to the first terminal device. For example, as in the above example, if the second terminal device is on the right side of the first terminal device, the first image may be displayed on the left side of the display screen of the second terminal device.

[0350] The side of the display screen of the second terminal device close to the first terminal device can be pre-set according to the initial position relationship between the second terminal device and the first terminal device, or the position relationship between the two can be sensed in real time. For example, the position relationship between the second terminal device and the first terminal device is pre-set, for example, the second terminal device is located on the right side of the first terminal device, then when the second terminal device receives the display instruction, even if the actual position of the second terminal device is not on the right side of the first terminal device, the second terminal device can display the first image on the left side. For another example, as mentioned above, both the first terminal device and the second terminal device can be installed with a position sensor, and the second terminal device can sense the position relationship with the first terminal device in real time. When the second terminal device receives the display instruction, if it senses that the first terminal device is located on the left side of the second terminal device, the first image can be displayed on the left side of the display screen.

[0351] If the first terminal device is connected to a second terminal device, or after the second terminal device is determined from more than two candidate terminal devices, the first terminal device can send a display instruction to the second terminal device, and the display instruction can carry a second image of the object displayed by the first terminal device. In this way, the second terminal device can display the complete image of the object on the display screen of the second terminal without the first image of the second image based on the display instruction and the positional relationship between the second terminal device and the first terminal device.

[0352] In a possible implementation, "sending the object to the second terminal device" in step S104 may also include: if it is detected that the area of ​​the second image of the object displayed on the display screen meets the sending condition, sending the object to the second terminal device.

[0353] The sending condition may mean that the object can be sent when the relationship between the area of ​​the second image and the area of ​​the complete image meets a certain ratio. If the relationship between the area of ​​the second image and the area of ​​the complete image does not meet a certain ratio, the object will not be sent to the second terminal device even when the second cross-device transmission operation is detected. For example, if the ratio of the area of ​​the second image to the area of ​​the complete image is less than a ratio threshold, the object will be sent to the second terminal device when the second cross-device transmission operation is detected. If the ratio of the area of ​​the second image to the area of ​​the complete image is not less than a ratio threshold, the object will not be sent to the second terminal device when the second cross-device transmission operation is detected. The ratio threshold may be pre-set, for example, 50%.

[0354] Fig.13a A schematic diagram showing an application scenario according to an embodiment of the present application is shown. Fig.13b FIG. 1 is a schematic diagram showing a cross-screen display according to an embodiment of the present application. Fig.13aAs shown, the positions of different edges of the first terminal device may correspond to candidate terminal devices, the position of the left edge of the first terminal device corresponds to candidate terminal device 1, the position of the right edge of the first terminal device corresponds to candidate terminal device 2, and the position of the upper edge of the first terminal device corresponds to candidate terminal device 3. In this way, according to the above, the second terminal device corresponding to the first cross-device transmission operation can be determined according to the positional relationship between the stop position of the first cross-device transmission operation and the edge of the first terminal device.

[0355] like Fig.13a As shown in FIG. 1 , if the stop position of the first cross-device transmission operation is the right edge of the first terminal device, then the candidate terminal device 2 may be the second terminal device. At this time, the first terminal device may send a display instruction to the second terminal device, and the display instruction may carry the second image of the object displayed by the first terminal device. In this way, the second terminal device may display the complete image of the object on the display screen of the second terminal device according to the display instruction and the positional relationship between the second terminal device and the first terminal device, removing the first image of the second image, as shown in FIG. Fig.13a As shown, the first image is displayed on the left edge of the candidate terminal device 2. If the first terminal device detects the drag and release action, at this time, the area of ​​the second image displayed on the first terminal device is less than half of the complete image, that is, the ratio of the area of ​​the second image to the area of ​​the complete image is less than the ratio threshold, so the first terminal device can send the object to the second terminal device. The specific process of sending the object to the second terminal device can refer to the part described in the above description of step S804 and Figure 9a-9c The embodiments shown are not described in detail in this application.

[0356] exist Fig.13b In the specific application scenario shown, the second terminal device currently opens the application service, such as Fig.13b In the example shown, the second terminal device opens a chat window of an instant messaging application. The first terminal device detects that the first cross-device transmission operation stops at the right edge of the display screen of the first terminal device, and can send a display instruction to the second terminal device, so that the second terminal device displays the second image of the object at the left edge of the display screen.

[0357] In one possible implementation, the display instruction sent by the first terminal device may also carry the data type of the object. The second terminal device may determine whether it can receive the object based on information such as the data type, currently open application services, application services installed on the second terminal device, and the local storage status of the second terminal, and make a judgment result and provide real-time feedback to the first terminal device.

[0358] When the first terminal device detects the second cross-device transmission operation, if the ratio of the second image of the object displayed by the first terminal device to the complete image is less than the ratio threshold, and the judgment result is that it can be transmitted to the second terminal device, the first terminal device can send the object to the second terminal device. After the second terminal device receives the object, if the currently opened application service can open the object, it can directly open the object in the currently opened application service, such as Fig.13b As shown, the second terminal device can open an object (e.g., a picture) in an instant messaging application, and can choose to send the picture or store the picture locally according to further operations of the user; if the currently opened application service cannot open the object, the second terminal device can select an application service to open the object according to the data type of the object. The second terminal device can also store the object.

[0359] According to the data transmission method of the above implementation mode, the drag interaction process is displayed in a concise and intuitive manner, which helps the user to judge the timing of dragging, avoids repeated operations, and simplifies user operations.

[0360] Fig.14a A flow chart of a data transmission method according to an embodiment of the present application is shown. Fig.14a The transmission method shown can be applied to the first terminal device. In addition to steps S100-S103, the transmission method of this embodiment can also include:

[0361] Step S106: Send a display status request to the second terminal device, so that the second terminal device returns the current display interface of the second terminal device in response to the display status request and displays the display interface.

[0362] Fig.14b A flow chart of a data transmission method according to an embodiment of the present application is shown. Fig.14b The transmission method shown can be applied to the second terminal device. In addition to steps S201-S202, the transmission method of this embodiment can also include:

[0363] Step S210, when receiving the display status request sent by the first terminal device, returning the current display interface of the second terminal device to the first terminal device, so that the first terminal device determines the position coordinates of the position where the first cross-device transmission operation stays in the display interface.

[0364] The first cross-device transmission operation is an operation used by the first terminal device to initiate a process of transmitting the object to the second terminal device.

[0365] The display status request is used to request the second terminal device to return the current display interface of the second terminal device. When the second terminal device receives the display status request, it can take a screenshot of the current display interface to obtain a screenshot image, and return the screenshot image to the first terminal device, or it can directly project the screen onto the display interface of the first terminal device. This application does not limit the specific method of returning the current display interface of the second terminal device.

[0366] The transmission method of this embodiment can be used with Figure 3a and Figure 3b The examples shown can also be combined with Fig.11a , Fig.11b That is, if the first terminal device is connected to a second terminal device, or after the second terminal device is determined from two or more candidate terminal devices, the first terminal device may send a display status request to the second terminal device.

[0367] After receiving the current display interface of the second terminal device returned by the second terminal device, the second terminal device may continue to monitor the first cross-device transmission operation. In a possible implementation, step S101 may include: sending a judgment request to the second terminal device, the judgment request including the data type and the coordinates of the position where the first cross-device transmission operation stops in the display interface. That is, the judgment request received by the second terminal device may carry the coordinates of the position where the first cross-device transmission operation stops in the display interface, and making a judgment result according to the data type in step S202 may include: making a judgment result according to the data type and the coordinates.

[0368] For example, if the application service registers a drag listener, the second terminal device can send the judgment request sent by the first terminal device to the application service, and the service can judge whether it can be transmitted to the second terminal device based on the data type and the position of the coordinates. The second terminal device can send the judgment result made based on the data type and the coordinates to the first terminal device, and step S102 may include: receiving the judgment result made by the second terminal device based on the data type and the coordinates. The display method of the judgment result can refer to the above implementation method and will not be repeated.

[0369] In a possible implementation, the second terminal device may also make a judgment result based on the local storage status. When the local storage status is that the storage capacity is available, the second terminal device makes a judgment result that the data can be moved to the second terminal device. When the local storage status is that the storage capacity is not available, the judgment result may be made based on the above-mentioned data type and location coordinates.

[0370] Fig.15 A schematic diagram showing an application scenario according to an embodiment of the present application is shown. Fig.15 As shown, combined Fig.14a , Fig.14b as well as Fig.11b The transmission method of this application is described as follows: Fig.11b As shown, the stop position of the thumbnail of the object partially overlaps with the display position of the information of one of the candidate terminal devices, and the candidate terminal device is selected as the second terminal device. The first terminal device can send a display status request to the second terminal device. When the second terminal device receives the display status request, it can take a screenshot of the current display interface to obtain a screenshot image, and return the screenshot image to the first terminal device. The first terminal device displays the screenshot image of the second terminal device on the display screen.

[0371] The first terminal device continues to monitor the first cross-device transmission operation, and sends a determination request to the second terminal device, the determination request carrying the data type of the object and the coordinates of the position where the first cross-device transmission operation stops in the screenshot image of the display interface of the second terminal device. For example, Fig.15 When the thumbnail of the object dragged by the middle finger on the first terminal device stops in the message input box of the conversation interface of the instant messaging application in the screenshot image of the second terminal device, or in the conversation content display box, the first terminal device can obtain the coordinates of the stop position, carry it in the judgment request, and send it to the second terminal device. The second terminal device receives the judgment request, and the second terminal device can make a judgment result based on the data type and coordinates. For example, the drag service system of the second terminal device receives the judgment request, and sends the judgment request to the Framework layer. The Framework layer generates a DRAG_LOCATION event and sends the DRAG_LOCATION event to the application service. The application service can determine whether it can be dragged according to the coordinates and data type, and send the judgment result step by step (such as Figure 8c The judgment result is returned to the first terminal device, and the judgment result is displayed in the current display interface of the first terminal device. For specific display methods, see Figure 5a or Figure 5b Examples in .

[0372] If the object in this embodiment is a picture or a piece of text, and the dialog box of the instant messaging application allows dragging pictures or allows dragging text into the input box, then the display interface of the first terminal device displays the judgment result. The user releases the drag operation, and the first terminal device can send the object to the second terminal device when detecting the release of the drag operation, and the second terminal device can directly open the object at the corresponding position, for example, Fig.15 As shown, the second terminal device displays the object (eg, a picture) in a dialog box.

[0373] According to the data transmission method of the above embodiment, the object can be directly dragged to the target location, which can simplify the user operation compared to the related art that requires further operation of dragging to the target location at the receiving end. The judgment result is displayed in real time during the dragging process, which can avoid repeated operations and improve operation efficiency.

[0374] Based on the above Fig.14a , Fig.14b implementation method, Fig.16 A flow chart showing a method for transmitting data according to an embodiment of the present application is shown. Fig.16 The method shown can be applied to a second terminal device, such as Fig.16 As shown, the method may further include: step S211, when receiving the object sent by the first terminal device, processing the object according to one or more of the data type, local storage status, application services installed by the second terminal device, and the location coordinates.

[0375] In a possible implementation, step S211 may include:

[0376] When the local storage state is that the storage capacity is not available, opening the object according to the application service installed on the second terminal device;

[0377] When the local storage state is that the storage capability is available, the object is stored locally.

[0378] In a possible implementation, when the local storage status is that the storage capability is available, storing the object locally may include:

[0379] When the local storage state is that the storage capacity is available and the location of the position coordinates in the display interface does not allow the data type to be inserted, the object is stored locally and an application is selected according to the data type to open the object;

[0380] When the local storage state is that the storage capacity is available and the position coordinates in the display interface allow the data type to be inserted, the object is stored locally and opened in the display interface according to the position coordinates.

[0381] The specific process of opening the object according to the application service installed on the second terminal device can be referred to in the above description. Whether the position coordinates in the display interface allow the above data type to be inserted can be determined based on whether the drag listener of the data type is registered at the position, and the specific process can be referred to in the above description.

[0382] According to the data transmission method of the above-mentioned implementation mode, the object can be directly dragged to the target position. Compared with the related technology which requires further operation at the receiving end to drag the object to the target position, the user operation can be simplified. The receiving end can process the object according to local information, thus simplifying the user operation.

[0383] The present application also provides a data transmission device, which is applied to a first terminal device, wherein the first terminal device is connected to a second terminal device, such as Figure 1 The application scenario shown. Fig.17 A block diagram of a data transmission device according to an embodiment of the present application is shown as follows: Fig.17 As shown, the device comprises:

[0384] A first acquisition module 61 is configured to, when the first terminal device detects a first cross-device transmission operation on an object on the first terminal device, acquire a data type of the object, wherein the first cross-device transmission operation is used to initiate a process of transmitting the object to a second terminal device;

[0385] A first sending module 62 is configured to send a determination request carrying the data type to the second terminal device,

[0386] A first receiving module 63, configured to receive a determination result made by the second terminal device based on the data type, the determination result indicating whether the object can be transmitted to the second terminal device;

[0387] The first display module 64 is used to display the judgment result.

[0388] According to the data transmission device of the above-mentioned implementation mode of the present application, it is possible to provide the user with intuitive visual feedback according to the data type of the object and the degree of matching of the receiving end, thereby avoiding erroneous operations and repeated operations and improving operational efficiency.

[0389] In a possible implementation, the determination request carries a data type field and / or an extended data type field, and the data type field and the extended data type field are used to indicate the data type of the object.

[0390] In a possible implementation manner, the device further includes:

[0391] The second sending module is used to send the object to the second terminal device when the judgment result is that the object can be transmitted to the second terminal device and a second cross-device transmission operation is detected, and the second cross-device transmission operation is used to confirm the transmission of the object to the second terminal device.

[0392] In a possible implementation, the second sending module includes:

[0393] A first storage unit, used for temporarily storing the object locally on the first terminal device;

[0394] A first sending unit, configured to send a data transmission request to the second terminal device, wherein the data transmission request is used to transmit the object;

[0395] The second sending unit is configured to send the object according to the first response signal returned by the second terminal device to accept the data transmission request when the first response signal is received.

[0396] In a possible implementation, the first sending unit is further configured to call out the temporarily stored object when a call out instruction for the temporarily stored object is detected, and to send the data transmission request to the second terminal device.

[0397] In a possible implementation manner, the second sending unit is further configured to:

[0398] Upon receiving the first response signal, directly sending the object;

[0399] Alternatively, upon receiving the first response signal, sending the object is delayed.

[0400] In a possible implementation manner, the second sending module further includes:

[0401] The sending cancellation unit is used to cancel the sending of the object when receiving a second response signal returned by the second terminal device that does not accept the data transmission request.

[0402] In a possible implementation, the first terminal device is connected to two or more candidate terminal devices.

[0403] The device also includes:

[0404] A second display module, configured to display information of the two or more candidate terminal devices when the first terminal device detects a first cross-device transmission operation on an object local to the first terminal device;

[0405] The second determining module is used to determine a second terminal device corresponding to the first cross-device transmission operation according to the relationship between the stop position of the first cross-device transmission operation and the display position of the information of the two or more candidate terminal devices.

[0406] In a possible implementation, the device further includes a third determination module, configured to determine a second terminal device corresponding to the first cross-device transmission operation according to a positional relationship between a stop position of the first cross-device transmission operation and an edge of the first terminal device. In a possible implementation, the device further includes:

[0407] a third sending module, configured to send a display instruction to the second terminal device to instruct the second terminal device to display the first image of the object according to the display instruction and a positional relationship between the second terminal device and the first terminal device;

[0408] The second image of the object displayed on the first terminal device and the first image of the object displayed on the second terminal device can be assembled into a complete image of the object.

[0409] In a possible implementation, the fourth sending module is used to send the object to the second terminal device if it is detected that the area of ​​the second image of the object displayed on the display screen meets the sending condition.

[0410] In a possible implementation manner, the device further includes:

[0411] a fifth sending module, configured to send a display status request to the second terminal device, so that the second terminal device returns a current display interface of the second terminal device in response to the display status request, and displays the display interface;

[0412] The first sending module includes:

[0413] The third sending unit is configured to send a determination request to the second terminal device, wherein the determination request carries the data type and the coordinates of the location where the first cross-device transmission operation stops in the display interface.

[0414] The first receiving module comprises:

[0415] A receiving unit is used to receive a judgment result made by the second terminal device based on the data type and the coordinates.

[0416] In a possible implementation manner, the device further includes:

[0417] A third determination module, used to determine a processing method of the object by the second terminal device;

[0418] The second sending module also includes:

[0419] The fourth sending unit is used to send the object and indication information to the second terminal device, where the indication information is used to instruct the second terminal device to process the object in the processing manner.

[0420] In a possible implementation manner, the first cross-device transmission operation is a drag operation.

[0421] In a possible implementation, the second cross-device transmission operation is a drag-and-release operation.

[0422] In a possible implementation, the first terminal device is a touch screen device or a non-touch screen device, and the second terminal device is a touch screen device, a non-touch screen device, or a screenless device.

[0423] The present application also provides a data transmission device, which is applied to a second terminal device, and is characterized in that the second terminal device is connected to the first terminal device, such as Figure 1 The application scenario shown. Fig.18 A block diagram of a data transmission device according to an embodiment of the present application is shown as follows: Fig.18 As shown,

[0424] The device comprises:

[0425] The second receiving module 71 is used to receive a determination request sent by the first terminal device, wherein the determination request carries the data type of the object to be transmitted, and the determination request is used to request the second terminal device to determine whether the object of the data type can be transmitted to the second terminal device;

[0426] The first judgment module 72 is used to make a judgment result according to the data type, and send the judgment result to the first terminal device so that the first terminal device displays the judgment result.

[0427] In a possible implementation manner, the device further includes:

[0428] The sixth sending module is used to return the current display interface of the second terminal device to the first terminal device when receiving a display status request sent by the first terminal device, so that the first terminal device can determine the coordinates of the position where the first cross-device transmission operation stays in the display interface, wherein the first cross-device transmission operation is an operation used by the first terminal device to initiate a process of transmitting the object to the second terminal device.

[0429] In a possible implementation, the determination request carries the coordinates.

[0430] The first judgment module includes:

[0431] The first judgment unit is used to make a judgment result according to the data type and the coordinates.

[0432] In a possible implementation manner, the device further includes:

[0433] The first processing module is used to process the object according to one or more of the data type, the local storage status, the application service installed by the second terminal device, and the coordinates when receiving the object sent by the first terminal device.

[0434] In a possible implementation, the first processing module includes:

[0435] A first processing unit, configured to open the object according to the application service installed on the second terminal device when the local storage state is that the storage capacity is not available;

[0436] The second processing unit is used to store the object locally when the local storage status is that the storage capacity is available.

[0437] In a possible implementation, the second processing unit is further configured to store the object locally and select an application to open the object according to the data type when the local storage state is that the storage capacity is available and the corresponding position of the coordinates in the display interface does not allow the data type to be inserted;

[0438] When the local storage state is that the storage capacity is available and the corresponding position of the coordinates in the display interface allows the data type to be inserted, the object is stored locally and opened in the display interface according to the coordinates.

[0439] In a possible implementation manner, the device further includes:

[0440] a storage module, configured to temporarily store the object locally when receiving the object sent by the first terminal device if the second terminal device has storage capability;

[0441] A third display module, used to display processing options;

[0442] The second processing module is used to process the object according to the selection operation for the processing option.

[0443] In a possible implementation manner, the device further includes:

[0444] a fourth display module, configured to display a first image of the object corresponding to the data according to the display instruction and a positional relationship between the second terminal device and the first terminal device when receiving a display instruction sent by the first terminal device;

[0445] The second image of the object displayed on the first terminal device and the first image of the object displayed on the second terminal device can be assembled into a complete image of the object.

[0446] In a possible implementation, the first terminal device is a touch screen device or a non-touch screen device, and the second terminal device is a touch screen device, a non-touch screen device, or a screenless device.

[0447] An embodiment of the present application provides a terminal device, which can execute one or more of the data transmission methods in the above-mentioned multiple implementation modes.

[0448] The present application may be a system, a method and / or a computer program product. The computer program product may include a computer-readable storage medium carrying computer-readable program instructions for causing a processor to implement various aspects of the present application.

[0449] An embodiment of the present application provides a computer program product, including a computer-readable code, or a non-volatile computer-readable storage medium carrying the computer-readable code. When the computer-readable code runs in a processor of an electronic device, the processor in the electronic device executes the above method.

[0450] A computer-readable storage medium may be a tangible device that can hold and store instructions used by an instruction execution device. A computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples of computer-readable storage media (a non-exhaustive list) include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disk read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanical encoding device, such as a punch card or a raised structure in a groove on which instructions are stored, and any suitable combination of the foregoing. As used herein, a computer-readable storage medium is not to be interpreted as a transient signal per se, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or other transmission medium (e.g., a light pulse through a fiber optic cable), or an electrical signal transmitted through a wire.

[0451] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to each computing / processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include copper transmission cables, optical fiber transmissions, wireless transmissions, routers, firewalls, switches, gateway computers, and / or edge servers. The network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing / processing device.

[0452] The computer program instructions for performing the operation of the present application can be assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages, such as Smalltalk, C++, etc., and conventional procedural programming languages, such as "C" language or similar programming languages. Computer-readable program instructions can be executed completely on a user's computer, partially on a user's computer, executed as an independent software package, partially on a user's computer, partially on a remote computer, or completely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (for example, using an Internet service provider to connect through the Internet). In some embodiments, by using the state information of a computer-readable program instruction to personalize an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA) or a programmable logic array (PLA), the electronic circuit can execute a computer-readable program instruction, thereby realizing various aspects of the present application.

[0453] Various aspects of the present application are described herein with reference to the flowcharts and / or block diagrams of the methods, devices (systems) and computer program products according to the embodiments of the present application. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0454] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processor of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0455] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operating steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0456] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of the module, program segment or instruction includes one or more executable instructions for realizing the logical function of the specification. In some alternative implementations, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can also be executed in the opposite order sometimes, depending on the function involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be realized by a dedicated hardware-based system that performs the function or action of the specification, or can be realized by a combination of special-purpose hardware and computer instructions.

[0457] The embodiments of the present application have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and changes will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The selection of terms used herein is intended to best explain the principles of the embodiments, practical applications, or technical improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. A data transmission method, the method is applied to a system including a first terminal device and a second terminal device, the first terminal device and the second terminal device are connected in a near field manner, characterized in that: The method comprises: When the first terminal device detects a first cross-device transmission operation for an object on the first terminal device, acquiring a data type of the object, wherein the first cross-device transmission operation is used to initiate a process of transmitting the object to the second terminal device; The first terminal device sends a display status request to the second terminal device, and receives a current display interface of the second terminal device returned by the second terminal device; The first terminal device determines the coordinates of a position where the first cross-device transmission operation stops in the display interface; The first terminal device sends the data type and the coordinates to the second terminal device; The second terminal device makes a judgment result based on the data type and the coordinates and displays the judgment result, wherein the judgment result indicates that the object can be transmitted to the second terminal device; The second terminal device sends the determination result to the first terminal device; When the first terminal device detects the second cross-device transmission operation, the first terminal device sends the object to the second terminal device according to the determination result, wherein the second cross-device transmission operation is used to confirm transmission of the object to the second terminal device.

2. The method according to claim 1, characterized in that: During the movement of the first cross-device transmission operation, the thumbnail of the object moves along with the movement of the first cross-device transmission operation.

3. The method according to claim 1, characterized in that The method further comprises: The first terminal device sends a display instruction to the second terminal device; The second terminal device displays the first image of the object according to the display instruction and the positional relationship between the second terminal device and the first terminal device; The second image of the object displayed on the first terminal device and the first image of the object displayed on the second terminal device can be assembled into a complete image of the object, wherein the complete image of the object is a thumbnail of the object.

4. The method according to claim 2 or 3, characterized in that: The method further comprises: When the first terminal device detects that the area of ​​the second image of the object displayed on the display screen meets the sending condition, the first terminal device sends the object to the second terminal device.

5. The method according to claim 1, characterized in that The method further comprises: When the first terminal device detects the first cross-device transmission operation, the first terminal device displays a first prompt message near the edge of the screen of the second terminal device.

6. The method according to claim 1, characterized in that The method further comprises: The second terminal device displays second prompt information near the screen edge of the first terminal device, and the second prompt information indicates that the source of the object is the first terminal device.

7. The method according to claim 1, characterized in that The second terminal device makes a judgment result based on the data type, including: The second terminal device makes a judgment result based on the data type and the coordinates of the location where the first cross-device transmission operation stays in the second terminal device.

8. The method according to claim 7, characterized in that The method further comprises: When the second terminal device receives the object sent by the first terminal device, the second terminal device processes the object according to one or more of the data type, the local storage status, the application service installed by the second terminal device, and the coordinates.

9. The method according to claim 8, characterized in that The second terminal device processes the object according to one or more of the data type, the local storage state, the application service installed by the second terminal device, and the coordinates, including: When the local storage state is that the storage capacity is not available, the second terminal device opens the object according to the application service installed by the second terminal device; When the local storage state is that the storage capability is available, the second terminal device stores the object locally.

10. The method according to claim 9, characterized in that When the local storage state is that the storage capability is available, the second terminal device locally stores the object, including: When the local storage state is that the storage capacity is available and the stop position does not allow the data type to be inserted, the second terminal device stores the object locally and selects an application according to the data type to open the object; When the local storage state is that the storage capacity is available and the stop position allows the data type to be inserted, the second terminal device stores the object locally and opens the object in the second terminal device according to the coordinates.

11. The method according to claim 1, characterized in that: The first terminal device is connected to two or more candidate terminal devices in a near field manner. The method further comprises: When the first terminal device detects a first cross-device transmission operation for an object on the first terminal device, the first terminal device displays information of the two or more candidate terminal devices; When the first terminal device detects a first cross-device transmission operation for an object on the first terminal device, the first terminal device determines a second terminal device corresponding to the first cross-device transmission operation according to a relationship between a stop position of the first cross-device transmission operation and a display position of information of the two or more candidate terminal devices.

12. The method according to claim 1, characterized in that The first terminal device is connected to two or more candidate terminal devices in a near field manner. The method further comprises: The second terminal device corresponding to the first cross-device transmission operation is determined according to the positional relationship between the stop position of the first cross-device transmission operation and the edge of the first terminal device.

13. The method according to claim 1, characterized in that The first cross-device transmission operation is a drag operation, and the second cross-device transmission operation is a drag-and-release operation.

14. A data transmission method, the method being applied to a first terminal device, characterized in that: The first terminal device is near-field connected to the second terminal device, and the method includes: When the first terminal device detects a first cross-device transmission operation for an object on the first terminal device, acquiring a data type of the object, wherein the first cross-device transmission operation is used to initiate a process of transmitting the object to the second terminal device; Sending a display status request to the second terminal device, and accepting the current display interface of the second terminal device returned by the second terminal device; Determining coordinates of a location where the first cross-device transmission operation stops in the display interface; Sending the data type and the coordinates to the second terminal device, so that the second terminal device makes a judgment result based on the data type and the coordinates and displays the judgment result, wherein the judgment result indicates that the object can be transmitted to the second terminal device; receiving the determination result from the second terminal device; When a second cross-device transmission operation is detected, the object is sent to the second terminal device according to the determination result, wherein the second cross-device transmission operation is used to confirm transmission of the object to the second terminal device.

15. The method according to claim 14, characterized in that During the movement of the first cross-device transmission operation, the thumbnail of the object moves along with the movement of the first cross-device transmission operation.

16. The method according to claim 14, characterized in that The method further comprises: Sending a display instruction to the second terminal device to instruct the second terminal device to display the first image of the object according to the display instruction and a positional relationship between the second terminal device and the first terminal device; The second image of the object displayed on the first terminal device and the first image of the object displayed on the second terminal device can be assembled into a complete image of the object, wherein the complete image of the object is a thumbnail of the object.

17. The method according to claim 15 or 16, characterized in that The method further comprises: If it is detected that the area of ​​the second image of the object displayed on the display screen meets the sending condition, the object is sent to the second terminal device.

18. The method according to claim 14, characterized in that Sending the data type to the second terminal device includes: sending a judgment request to the second terminal device, the judgment request including the data type, the judgment request carrying a data type field and / or an extended data type field, and the data type field and the extended data type field are used to represent the data type of the object.

19. The method according to claim 14, characterized in that The method further comprises: When the first terminal device detects the first cross-device transmission operation, the first terminal device displays a first prompt message near the edge of the screen of the second terminal device.

20. The method according to claim 19, characterized in that Sending the object to the second terminal device includes: Temporarily storing the object locally on the first terminal device; Sending a data transmission request to the second terminal device, where the data transmission request is used to transmit the object; When a first response signal returned by the second terminal device for accepting the data transmission request is received, the object is sent according to the first response signal.

21. The method according to claim 20, characterized in that After temporarily storing the object locally on the first terminal device, the method further includes: When a call-out instruction for the temporarily stored object is detected, the temporarily stored object is called out, and the data transmission request is sent to the second terminal device.

22. The method according to claim 20 or 21, characterized in that Sending the object according to the first response signal includes: Upon receiving the first response signal, directly sending the object; Alternatively, upon receiving the first response signal, sending the object is delayed.

23. The method according to claim 14, characterized in that The first terminal device is connected to two or more candidate terminal devices in a near field manner. The method further comprises: When the first terminal device detects a first cross-device transmission operation for an object on the first terminal device, the first terminal device displays information of the two or more candidate terminal devices; A second terminal device corresponding to the first cross-device transmission operation is determined according to a relationship between a stop position of the first cross-device transmission operation and display positions of information of the two or more candidate terminal devices.

24. The method according to claim 14, characterized in that The first terminal device is connected to two or more candidate terminal devices in a near field manner. The method further comprises: The second terminal device corresponding to the first cross-device transmission operation is determined according to the positional relationship between the stop position of the first cross-device transmission operation and the edge of the first terminal device.

25. The method according to claim 14, characterized in that The first cross-device transmission operation is a drag operation, and the second cross-device transmission operation is a drag-and-release operation.

26. A data transmission method, the method being applied to a second terminal device, characterized in that: The second terminal device is connected to the first terminal device in a near field manner, and the method includes: Upon receiving the display status request sent by the first terminal device, returning the current display interface of the second terminal device to the first terminal device, so that the first terminal device determines the coordinates of the position where the first cross-device transmission operation stops in the display interface; receiving a data type and the coordinates of an object to be transmitted sent by a first terminal device, wherein the data type is acquired by the first terminal device when detecting the first cross-device transmission operation for the object on the first terminal device, wherein the first cross-device transmission operation is used to initiate a process of transmitting the object to the second terminal device; Making a judgment result according to the data type and the coordinates, displaying the judgment result, and sending the judgment result to the first terminal device, the judgment result indicating that the object can be transmitted to the second terminal device; The object is received, where the first terminal device sends the object to the second terminal device according to the determination result when the first terminal device detects a second cross-device transmission operation, wherein the second cross-device transmission operation is used to confirm transmission of the object to the second terminal device.

27. The method according to claim 26, characterized in that During the movement of the first cross-device transmission operation, the thumbnail of the object moves along with the movement of the first cross-device transmission operation.

28. The method according to claim 26, characterized in that The method further comprises: When receiving a display instruction sent by the first terminal device, displaying a first image of the object according to the display instruction and a positional relationship between the second terminal device and the first terminal device, The second image of the object displayed on the first terminal device and the first image of the object displayed on the second terminal device can be assembled into a complete image of the object, wherein the complete image of the object is a thumbnail of the object.

29. The method according to claim 26, characterized in that A judgment result is made according to the data type, including: A determination result is made based on the data type and the coordinates of the location where the first cross-device transmission operation stops in the second terminal device.

30. The method according to claim 29, characterized in that The method further comprises: When the object sent by the first terminal device is received, the object is processed according to one or more of the data type, the local storage status, the application service installed by the second terminal device, and the coordinates.

31. The method according to claim 30, characterized in that Processing the object according to one or more of the data type, the local storage state, the application service installed on the second terminal device, and the coordinates includes: When the local storage state is that the storage capacity is not available, opening the object according to the application service installed on the second terminal device; When the local storage state is that the storage capability is available, the object is stored locally.

32. The method according to claim 31, characterized in that When the local storage state is that the storage capability is available, the object is stored locally, including: When the local storage state is that the storage capacity is available and the stop position does not allow the data type to be inserted, the object is stored locally and an application is selected according to the data type to open the object; When the local storage state is that the storage capacity is available and the stay position allows the data type to be inserted, the object is stored locally and opened in the second terminal device according to the coordinates.

33. The method according to any one of claims 26 to 32, characterized in that: The method further comprises: When receiving the object sent by the first terminal device, if the second terminal device has storage capability, temporarily storing the object locally; Display processing options; The object is processed according to the selection operation for the processing option.

34. The method according to claim 26, characterized in that The method further includes: the second terminal device displays second prompt information close to a screen edge of the first terminal device, wherein the second prompt information indicates that a source of the object is the first terminal device.

35. A data transmission device, characterized in that: include: processor; a memory for storing processor-executable instructions; Wherein, the processor is configured to implement the method of any one of claims 14-25 or the method of any one of claims 26-34 when executing the instructions.

36. A non-volatile computer-readable storage medium having computer program instructions stored thereon, characterized in that: When the computer program instructions are executed by a processor, the method described in any one of claims 14 to 25 is implemented, or the method described in any one of claims 26 to 34 is implemented.

37. A computer program product comprising instructions, characterized in that When the computer program product runs on a computer, the computer is enabled to execute the method according to any one of claims 14 to 25, or to implement the method according to any one of claims 26 to 34.