Data moving method, device, storage medium and electronic device

Abstract

The present application discloses a data movement method, device, storage medium and electronic device, wherein the method comprises: sending the application window of the terminal application displayed by the mobile terminal to the display device for screen projection display, if a moving operation is detected in the display device, obtaining the mobile operation information corresponding to the mobile operation, sending the mobile operation information from the display device to the mobile terminal, obtaining the application data and the target terminal application in the mobile terminal based on the mobile operation information, and adding the application data to the terminal application window of the target terminal application. By adopting the present application, by obtaining the mobile operation information of the mobile operation performed in the display device, the mobile terminal is controlled to automatically move the application data, so that the screen projection on the display device uses the mobile operation that conforms to the operation logic of the display device, and the terminal device can be controlled to complete the data movement, reducing the steps required for data movement, improving the efficiency of data movement operation, and thus improving the operation effect of data projection.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a data movement method, device, storage medium and electronic device. Background Art

[0002] With the continuous development and improvement of computer technology, mobile terminals such as mobile phones and tablets can be connected to display devices such as computers and smart TVs, and the application window on the current screen of the mobile terminal can be projected onto the screen of the display device, which facilitates the user's operation of the application window. However, when moving application data such as files, texts and pictures between application windows on the display device, it is necessary to first long-press the application data to cache it, use a specific button to jump the application window, and then long-press to copy the application data in the jumped application window. At the same time, the data movement process will also be synchronized in the mobile terminal. Since the existing data movement operation on the display device still needs to follow the data movement logic of the mobile terminal, the data movement process in the mobile terminal is still relatively cumbersome when performing operation synchronization, which affects the efficiency of the data movement operation, and thus affects the operation effect of data projection. Summary of the invention

[0003] The embodiments of the present application provide a data movement method, device, storage medium and electronic device, which can reduce the steps required for data movement, improve the efficiency of data movement operations, and thus improve the operation effect of data projection. The technical solution is as follows:

[0004] In a first aspect, an embodiment of the present application provides a data movement method, the method comprising:

[0005] Based on the connection relationship with the display device, data of the application window of the terminal application displayed by the mobile terminal is sent to the display device, so as to project and display the application window on the display device;

[0006] Receiving mobile operation information sent by the display device, and acquiring application data and target terminal application based on the mobile operation information;

[0007] The application data is added to the terminal application window of the target terminal application in the mobile terminal, and the terminal application window after adding the application data is displayed on the mobile terminal. The terminal application window is the application window displayed by the target terminal application in the mobile terminal.

[0008] In a second aspect, an embodiment of the present application provides a data movement method, the method comprising:

[0009] Based on the connection relationship with the mobile terminal, receiving data of an application window of a terminal application displayed by the mobile terminal, and projecting and displaying the application window on the screen;

[0010] If a moving operation is detected, obtaining moving operation information corresponding to the moving operation;

[0011] sending the mobile operation information to the mobile terminal;

[0012] The mobile operation information is used to instruct the mobile terminal to add application data to the terminal application window of the target terminal application. The mobile operation information includes association information of the application data and application data of the target terminal application. The terminal application window is an application window displayed by the target terminal application in the mobile terminal.

[0013] In a third aspect, an embodiment of the present application provides a data moving device, the device comprising:

[0014] A screen projection sending module, used to send data of an application window of a terminal application displayed by the mobile terminal to the display device based on a connection relationship with the display device, so as to project and display the application window on the display device;

[0015] A data acquisition module, used to receive the mobile operation information sent by the display device, and acquire application data and target terminal application based on the mobile operation information;

[0016] The data adding module is used to add the application data to the terminal application window of the target terminal application in the mobile terminal, and display the terminal application window after adding the application data on the mobile terminal. The terminal application window is the application window displayed by the target terminal application in the mobile terminal.

[0017] In a fourth aspect, an embodiment of the present application provides an information sending device, the device comprising:

[0018] A screen projection receiving module, used to receive data of an application window of a terminal application displayed by the mobile terminal based on a connection relationship with the mobile terminal, and to project and display the application window on the screen;

[0019] An information acquisition module, configured to acquire movement operation information corresponding to the movement operation if a movement operation is detected;

[0020] An information sending module, used for sending the mobile operation information to the mobile terminal;

[0021] The mobile operation information is used to instruct the mobile terminal to add application data to the terminal application window of the target terminal application. The mobile operation information includes association information of the application data and application data of the target terminal application. The terminal application window is an application window displayed by the target terminal application in the mobile terminal.

[0022] In a fifth aspect, an embodiment of the present application provides a computer storage medium, wherein the computer storage medium stores a plurality of instructions, wherein the instructions are suitable for being loaded by a processor and executing the above-mentioned method steps.

[0023] In a sixth aspect, an embodiment of the present application provides an electronic device, which may include: a processor and a memory; wherein the memory stores a computer program, and the computer program is suitable for being loaded by the processor and executing the above-mentioned method steps.

[0024] The beneficial effects brought about by the technical solutions provided by some embodiments of the present application include at least:

[0025] In one or more embodiments of the present application, the data of the application window of the terminal application displayed in the mobile terminal is sent to the display device for screen projection display. If a mobile operation is detected in the display device, the mobile operation information corresponding to the mobile operation is obtained, and the mobile operation information is sent from the display device to the mobile terminal. The application data and the target terminal application are obtained in the mobile terminal based on the mobile operation information, and the application data is added to the terminal application window of the target terminal application. By obtaining the mobile operation information of the mobile operation performed in the display device, the mobile terminal is controlled to automatically move the application data, so that the screen projection uses the mobile operation that conforms to the operation logic of the display device on the display device, and the terminal device can be controlled to complete the data movement, which reduces the steps required for data movement, improves the efficiency of data movement operations, and thus improves the operation effect of data projection. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0027] Figure 1 is an example schematic diagram of an interaction between a display device and a mobile terminal provided in an embodiment of the present application;

[0028] Figure 2 It is a flowchart of a data movement method provided in an embodiment of the present application;

[0029] Figure 3 It is a flowchart of a data movement method provided in an embodiment of the present application;

[0030] Figure 3a This is an example schematic diagram of generating mobile operation information provided by an embodiment of the present application;

[0031] Figure 3b This is an example schematic diagram of text information selection provided by an embodiment of the present application;

[0032] Figure 4 It is a flowchart of a data movement method provided in an embodiment of the present application;

[0033] Figure 5 It is a flowchart of a data movement method provided in an embodiment of the present application;

[0034] Figure 6 It is a flowchart of a data movement method provided in an embodiment of the present application;

[0035] Figure 7 It is a flowchart of a data movement method provided in an embodiment of the present application;

[0036] Figure 8 is a structural schematic diagram of a data moving device provided in an embodiment of the present application;

[0037] Fig. 9 is a structural schematic diagram of a data moving device provided in an embodiment of the present application;

[0038] Fig.10 It is a structural diagram of a data adding module provided in an embodiment of the present application;

[0039] Fig.11 It is a structural diagram of a window identification acquisition module provided in an embodiment of the present application;

[0040] Fig.12 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application;

[0041] Fig.13 It is a schematic diagram of the structure of the operating system and user space provided in the embodiment of the present application;

[0042] Fig.14 yes Fig.12 The architecture diagram of the Android operating system;

[0043] Fig.15 yes Fig.12 The architecture diagram of the IOS operating system;

[0044] Fig.16 It is a structural schematic diagram of an information sending device provided in an embodiment of the present application;

[0045] Fig.17 It is a structural schematic diagram of an information sending device provided in an embodiment of the present application;

[0046] Fig.18 is a structural diagram of an information acquisition module provided in an embodiment of the present application;

[0047] Fig.19 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application;

[0048] Fig. 20 It is a schematic diagram of the structure of the operating system and user space provided in the embodiment of the present application;

[0049] Fig.21 yes Fig.19 The architecture diagram of the Android operating system;

[0050] Fig. 22 yes Fig.19 Architecture diagram of the IOS operating system. DETAILED DESCRIPTION

[0051] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0052] In the description of the present application, it should be understood that the terms "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. In the description of the present application, it should be noted that, unless otherwise clearly specified and limited, "including" and "having" and any of their variations are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally also includes steps or units that are not listed, or optionally also includes other steps or units inherent to these processes, methods, products or devices. For those of ordinary skill in the art, the specific meanings of the above terms in the present application can be understood in specific circumstances. In addition, in the description of the present application, unless otherwise specified, "multiple" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B, which can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects before and after are an "or" relationship.

[0053] The data moving method provided in the embodiment of the present application can be implemented by a computer program and can be run on a data moving device and an information sending device based on the von Neumann system. The computer program can be integrated in an application or run as an independent tool application. The data moving device in the embodiment of the present application can be a mobile terminal such as a mobile phone, a personal computer, a tablet computer, a handheld device, a vehicle-mounted device, a wearable device, or a module in a terminal device that can implement the data moving method. The information sending device in the embodiment of the present application can be a display device such as a personal computer, a tablet computer, a smart TV, a smart projection device, or a module in a display device that can implement the data moving method. The mobile terminal can send the data of the application window of the terminal application displayed by the mobile terminal to the display device for display, so as to realize the same-screen display. The display device can control the mobile terminal on the screen of the display device, for example, the application window of the mobile terminal can be clicked by a mouse instead of a finger touch to control the terminal application on the mobile terminal. The mobile terminal can not only project the application window currently displayed on the screen of the mobile terminal to the display device, but also send the data of the application window of the terminal application displayed by other mobile terminals in the mobile terminal to the display device for projection display according to the user's selection on the mobile terminal or the display device, so as to realize multi-screen display. The terminal application window in the embodiment of the present application is an application window in which the terminal application in the mobile terminal is displayed in the mobile terminal, and the device application window is an application window in which the terminal application in the mobile terminal is displayed in the display device. The terminal application window and the device application window should correspond and be synchronized. The operations of the mobile terminal in the terminal application window can be synchronized to the device application window, and the operations of the display device in the device application window can be synchronized to the terminal application window.

[0054] Please also see Figure 1 , provides an example schematic diagram of the interaction between a display device and a mobile terminal for an embodiment of the present application, wherein the mobile terminal sends data of an application window of a terminal application displayed on the mobile terminal to the display device for screen projection display, and the user can control the display device mobile terminal, for example Figure 1 You can use the mouse to click the application window to view or share the content in the application window, or use Figure 1 The moving operation shown by the mouse is to select and drag the content of terminal application A in the display device to the display window of terminal application B on the display device with the mouse. The display device will obtain the moving operation information of the moving operation and send it to the mobile terminal. The mobile terminal realizes data movement according to the moving operation information.

[0055] The data migration method provided by the present application is described in detail below in conjunction with specific embodiments.

[0056] See also Figure 2, which is a flowchart of a data movement method provided in an embodiment of the present application. Figure 2 As shown, the embodiment of the present application is described from both the mobile terminal and the display device, and the method may include the following steps S101-S105.

[0057] S101, based on the connection relationship with the display device, the mobile terminal sends data of the application window of the terminal application displayed by the mobile terminal to the display device, so as to project and display the application window on the display device.

[0058] Specifically, the mobile terminal can establish a connection relationship with the display device through a wired or wireless method. The mobile terminal sends the application window of the terminal application that has been started on the mobile terminal to the display device for screen projection display through the connection relationship. After receiving, the display device can display these application windows on the screen. The application window displayed by the same terminal application on the mobile terminal is called the terminal application window, and the application window displayed on the display device is called the device application window. The terminal application window and the device application window should be corresponding and synchronized. The operation of the mobile terminal in the terminal application window can be synchronized to the device application window, and the operation of the display device in the device application window can be synchronized to the terminal application window. It can be understood that multi-screen display can be realized in the display device, that is, the device application windows of multiple terminal applications can be displayed at the same time.

[0059] S102: If the display device detects a movement operation, it obtains movement operation information corresponding to the movement operation.

[0060] Specifically, since the display device can display device application windows of multiple terminal applications at the same time, the user can perform a move operation between device application windows. For example, when the user wants to add and share a file or application data to an instant messaging software, the user can select and drag the application data of one device application window to another device application window to add the application data to the terminal application corresponding to the other device application window. Since the cross-window move operation cannot be completed in the terminal device, the move operation process can only be implemented in the display device, so the display device needs to send the move operation information of the move operation to the terminal device. The application data can be a file, a picture, or text information, etc.

[0061] If the display device detects that a moving operation has occurred, it will obtain moving operation information corresponding to the moving operation. The moving operation information is used to instruct the mobile terminal to add the application data to the terminal application window of the target terminal application. The moving operation information includes the association information of the application data and the application data of the target terminal application. The association information of the application data can instruct the mobile terminal to find the application data, such as the data identifier, file name, storage address, etc. of the application data. The application data of the target terminal application can instruct the mobile terminal to find the target terminal application, such as the application name, application package name, etc. of the target terminal application.

[0062] S103: The display device sends the mobile operation information to the mobile terminal.

[0063] Specifically, the display device sends the mobile operation information to the mobile terminal, so that the mobile terminal finds the application data and the target terminal application, and enables the mobile terminal to add and move the application data to the target terminal application.

[0064] S104: The mobile terminal obtains application data and target terminal application based on the mobile operation information.

[0065] Specifically, the mobile terminal obtains application data that needs to be moved and a target terminal application waiting for adding mobile data based on the mobile operation information sent by the display device.

[0066] S105, adding the application data to the terminal application window of the target terminal application in the mobile terminal, and displaying the terminal application window after adding the application data on the mobile terminal.

[0067] Specifically, the mobile terminal adds the application data to the terminal application window of the target terminal application. Similarly, due to the correspondence between the terminal application window and the device application window, the target terminal application will also display the application data added to the device application window in the device application window on the display device.

[0068] In the embodiment of the present application, the data of the application window of the terminal application displayed in the mobile terminal is sent to the display device for screen projection display. If a mobile operation is detected in the display device, the mobile operation information corresponding to the mobile operation is obtained, and the mobile operation information is sent from the display device to the mobile terminal. The application data and the target terminal application are obtained in the mobile terminal based on the mobile operation information, and the application data is added to the terminal application window of the target terminal application. By obtaining the mobile operation information of the mobile operation performed in the display device, the mobile terminal is controlled to automatically move the application data, so that the screen projection uses the mobile operation that conforms to the operation logic of the display device on the display device, and the terminal device can be controlled to complete the data movement, which reduces the steps required for data movement, improves the efficiency of data movement operation, and thus improves the operation effect of data projection.

[0069] See also Figure 3 , which is a flowchart of a data movement method provided in an embodiment of the present application. Figure 3 As shown, the method of the embodiment of the present application may include the following steps S201-S208.

[0070] S201, based on the connection relationship with the display device, the mobile terminal sends data of the application window of the terminal application displayed by the mobile terminal to the display device, so as to project and display the application window on the display device.

[0071] Specifically, the mobile terminal can establish a connection relationship with the display device through a wired or wireless method. The mobile terminal sends the application window of the terminal application that has been started on the mobile terminal to the display device for screen projection display through the connection relationship. After receiving, the display device can display these application windows on the screen. The application window displayed by the same terminal application on the mobile terminal is called the terminal application window, and the application window displayed on the display device is called the device application window. The terminal application window and the device application window should be corresponding and synchronized. The operation of the mobile terminal in the terminal application window can be synchronized to the device application window, and the operation of the display device in the device application window can be synchronized to the terminal application window. It can be understood that multi-screen display can be realized in the display device, that is, the device application windows of multiple terminal applications can be displayed at the same time.

[0072] S202: If the display device detects a moving operation, the starting position and the ending position of the moving operation are obtained.

[0073] Specifically, since the display device can display device application windows of multiple terminal applications at the same time, the user can perform a move operation between device application windows. For example, when the user wants to add and share a file or application data to an instant messaging software, the user can use the move operation to move the data. The user can select the application data of a device application window and drag it to another device application window to add the application data to the terminal application corresponding to the other device application window. Since the cross-window move operation cannot be completed in the terminal device, the move operation process can only be implemented in the display device, so the display device needs to send the move operation information of the move operation to the terminal device. The application data can be a file, a picture, or text information. If the display device detects that a move operation has occurred, the display device can obtain the starting position and the end position of the move operation.

[0074] S203: The display device obtains the starting point coordinates of the starting point position and the window identifier of the application window where the end point position is located, and generates movement operation information based on the starting point coordinates and the window identifier.

[0075] Specifically, each point on the screen of the display device has a corresponding coordinate, which is used for the display device to confirm the position of the mouse. The display device can obtain the starting coordinate of the starting position of the moving operation, and the starting coordinate can instruct the mobile terminal to find the application data at the position corresponding to the starting coordinate; the application windows opened on the display device have corresponding window identifiers, which can be the number, name, etc. of the application window. The display device can obtain the window identifier of the application window where the end position is located, and the window identifier can instruct the terminal device to obtain the target terminal application. The display device can generate mobile operation information based on the starting coordinates and the window identifier, and can send the mobile operation information to the mobile terminal to instruct the mobile terminal to find the application data and the target terminal application.

[0076] It can be understood that the display device can obtain the window identifier corresponding to the starting point coordinates and the end point position based on the starting point position and the end point position of the moving operation. Similarly, the mobile terminal can obtain the application data or window corresponding to the two based on the starting point position and the end point position of the moving operation. Therefore, if the display device detects a moving operation, it can obtain the starting point coordinates of the starting point position and the end point coordinates of the end point position of the moving operation, and generate the moving operation information directly based on the starting point coordinates and the end point coordinates, so that the mobile terminal can find the application data according to the starting point coordinates, find the corresponding window identifier according to the end point coordinates, and then find the corresponding target terminal application.

[0077] Please also see Figure 3a, an example schematic diagram of generating mobile operation information is provided for an embodiment of the present application, when the display device detects a mobile operation, the starting position and the end position of the mobile operation are obtained, such as Figure 3a The starting point falls on a compressed package named "Summer Social Practice". As long as the starting point coordinates of the starting point are obtained, the mobile terminal can find the application data corresponding to the starting point coordinates according to the starting point coordinates, that is, the compressed package named "Summer Social Practice"; the end point falls on an application window. The display device can obtain the end point coordinates of the end point, or the window identifier of this application window, and the mobile terminal can find out which target terminal application this application window belongs to according to the end point coordinates or the window identifier.

[0078] Optionally, when the application data is a file or a picture, the display device obtains the starting coordinates of the starting position and sends them to the mobile terminal, and the mobile terminal can find the corresponding application data. However, the data moving device can not only realize the data transfer of files or pictures, but also realize the data transfer of text information. If the display device detects a moving operation, it can obtain the selected area corresponding to the starting position of the moving operation, obtain the text information in the selected area, and then obtain the window identifier of the application window where the end position of the moving operation is located. The display device can generate the moving operation information based on the text information and the window identifier. The selected area can be the area selected by the user after clicking the right button of the mouse and dragging.

[0079] Please also see Figure 3b , which provides an example schematic diagram of selecting text information in an embodiment of the present application, a user can right-click and drag the mouse to select the text information to be moved, forming a Figure 3b The selected area is shown in the figure, and then the selected area is moved and dragged to other application windows. After the display device detects the moving operation, it will obtain the selected area corresponding to the starting point of the moving operation, and obtain the text information in the selected area. Based on the text information and the window identifier corresponding to the end point, the moving operation information is generated and sent to the mobile terminal.

[0080] S204: The display device sends the mobile operation information to the mobile terminal.

[0081] Specifically, the display device sends the mobile operation information to the mobile terminal, so that the mobile terminal finds the application data and the target terminal application, and enables the mobile terminal to add and move the application data to the target terminal application.

[0082] S205: The mobile terminal obtains the starting point coordinates and the window identifier carried in the mobile operation information.

[0083] Specifically, after receiving the mobile operation information sent by the display device, the mobile terminal can obtain the starting point coordinates and the window identifier carried in the mobile operation information.

[0084] S206, the mobile terminal obtains the data identifier corresponding to the starting point coordinates, obtains the application data corresponding to the data identifier, obtains the application identifier corresponding to the window identifier, and obtains the target terminal application corresponding to the application identifier.

[0085] Specifically, the mobile terminal can obtain the data identifier corresponding to the starting point coordinates, and the data representation can be a data name, a data address, etc., and the corresponding application data can be obtained according to the data identifier, for example, searching for application data with the same name in the mobile terminal according to the data name, or obtaining application data within the data address according to the data address. The mobile terminal can obtain the application identifier corresponding to the window identifier, and the application identifier can be an application name or an application package name, and the mobile terminal can obtain the corresponding target terminal application according to the application identifier.

[0086] It is understandable that the terminal data can also be obtained by obtaining the starting point coordinates and the end point coordinates carried in the moving operation information, and then obtaining the window identifier of the device application window where the end point coordinates are located, and obtaining the application data indicated by the starting point coordinates according to the starting point coordinates.

[0087] It can be understood that when the application data is text information, the terminal device obtains the mobile operation information sent by the display device, and obtains the text information and window identifier carried in the mobile operation information.

[0088] S207, if the mobile terminal obtains the sharing permission of the application data and the data adding permission of the target terminal application, the application data is added to the terminal application window of the target terminal application in the mobile terminal, and the terminal application window after adding the application data is displayed on the mobile terminal.

[0089] Specifically, not all application data in the mobile terminal can be moved or shared, and not all terminal applications can accept the addition of application data. Therefore, it is necessary to obtain both the sharing permission of the application data and the data adding permission of the target terminal application to complete the data movement. If the mobile terminal obtains the sharing permission and the data adding permission, the application data can be added to the terminal application window of the target terminal application, for example, it can be shared in the chat window of the instant messaging software. If the user then clicks send, the application data can be shared with friends who are chatting in the terminal application window.

[0090] S208: The display device adds the display image of the application data to the device application window of the target terminal application based on the moving operation.

[0091] Specifically, if the application data can successfully achieve data movement, the display device will display an animation on the screen of dragging the display image of the application data to the device application window of the target terminal application. The display image of the application data is the image effect of the application data displayed in the display terminal. This animation does not have real operational significance, but it can give users a better visual experience. Since the terminal application window and the device application window are corresponding and synchronized, as long as the application data can achieve data movement, the application data can appear in the terminal application window, that is, after the animation on the display device is played, the application data can also appear in the device application window.

[0092] S209: If the mobile terminal fails to obtain the sharing permission or the data adding permission, it sends an adding failure message to the display device.

[0093] Specifically, if the mobile terminal does not obtain the sharing permission or the data adding permission, the mobile terminal sends an adding failure message to the real device.

[0094] S210: The display device displays the adding failure information on the screen.

[0095] Specifically, after receiving the adding failure information, the display device may display the adding failure information on the screen. Similarly, the adding failure information may also be output by language output, prompt sound, etc.

[0096] In an embodiment of the present application, by sending the data of the application window of the terminal application displayed in the mobile terminal to the display device for screen projection display, if a moving operation is detected in the display device, the mobile operation information corresponding to the moving operation is generated based on the starting point coordinates and window identifier corresponding to the moving operation, and the mobile operation information is sent from the display device to the mobile terminal, and the application data and the target terminal application are obtained in the mobile terminal based on the mobile operation information, and the sharing authority and data adding authority are obtained, and then the application data is added to the terminal application window of the target terminal application, thereby ensuring the security of the application data and the target terminal application. By obtaining the mobile operation information of the mobile operation performed in the display device, the mobile terminal is controlled to automatically move the application data, so that the screen projection uses the mobile operation that conforms to the operation logic of the display device on the display device, and the terminal device can be controlled to complete the data movement, which reduces the steps required for data movement, improves the efficiency of data movement operation, and thus improves the operation effect of data projection. At the same time, the display image of the application data is added to the device application window of the target terminal application on the screen of the display device, which enriches the user's visual experience and further improves the use effect.

[0097] See also Figure 4, which is a flowchart of a data movement method provided in an embodiment of the present application. Figure 4 As shown, the embodiment of the present application is described from the mobile terminal side, and the method may include the following steps S301-S303.

[0098] S301, based on the connection relationship with the display device, sending data of the application window of the terminal application displayed by the mobile terminal to the display device, so as to project and display the application window on the display device.

[0099] Specifically, the mobile terminal can establish a connection relationship with the display device through a wired or wireless method. The mobile terminal sends the application window of the terminal application that has been started on the mobile terminal to the display device for screen projection display through the connection relationship. After receiving, the display device can display these application windows on the screen. The application window displayed by the same terminal application on the mobile terminal is called the terminal application window, and the application window displayed on the display device is called the device application window. The terminal application window and the device application window should be corresponding and synchronized. The operation of the mobile terminal in the terminal application window can be synchronized to the device application window, and the operation of the display device in the device application window can be synchronized to the terminal application window. It can be understood that multi-screen display can be realized in the display device, that is, the device application windows of multiple terminal applications can be displayed at the same time.

[0100] S302: Receive mobile operation information sent by the display device, and acquire application data and target terminal application based on the mobile operation information.

[0101] The mobile terminal receives mobile operation information of the mobile operation executed in the display device, the mobile operation information is used to instruct the mobile terminal to add application data to the terminal application window of the target terminal application, the mobile operation information includes association information of the application data and application data of the target terminal application, the association information of the application data can instruct the mobile terminal to find the application data, for example, it can be the data identifier, file name, storage address, etc. of the application data, the application data of the target terminal application can instruct the mobile terminal to find the target terminal application, for example, it can be the application name, application package name, etc. of the target terminal application. Then the mobile terminal obtains the application data and the target terminal application according to the mobile operation information.

[0102] S303: Add the application data to the terminal application window of the target terminal application in the mobile terminal, and display the terminal application window after adding the application data on the mobile terminal.

[0103] Specifically, the mobile terminal adds the application data to the terminal application window of the target terminal application. Similarly, due to the correspondence between the terminal application window and the device application window, the target terminal application will also display the application data added to the device application window in the device application window on the display device.

[0104] In an embodiment of the present application, based on the connection relationship with the display device, the data of the application window of the terminal application displayed by the mobile terminal is sent to the display device, so that the application window is projected and displayed on the display device. If the display device detects a moving operation, it obtains the mobile operation information corresponding to the mobile operation, and sends the mobile operation information to the mobile terminal. The mobile terminal obtains the application data and the target terminal application based on the mobile operation information, and adds the application data to the terminal application window of the target terminal application. By obtaining the mobile operation information of the mobile operation performed in the display device, the mobile terminal is controlled to automatically move the application data, so that the screen projection on the display device uses the mobile operation that conforms to the operation logic of the display device, and the terminal device can be controlled to complete the data movement, which reduces the steps required for data movement, improves the efficiency of data movement operations, and thus improves the operation effect of data projection.

[0105] See also Figure 5 , which is a flowchart of a data movement method provided in an embodiment of the present application. Figure 5 As shown, the embodiment of the present application is described from the mobile terminal side, and the method may include the following steps S401-S405.

[0106] S401, based on the connection relationship with the display device, sending data of the application window of the terminal application displayed by the mobile terminal to the display device, so as to project and display the application window on the display device.

[0107] Specifically, the mobile terminal can establish a connection relationship with the display device through a wired or wireless method. The mobile terminal sends the application window of the terminal application that has been started on the mobile terminal to the display device for screen projection display through the connection relationship. After receiving, the display device can display these application windows on the screen. The application window displayed by the same terminal application on the mobile terminal is called the terminal application window, and the application window displayed on the display device is called the device application window. The terminal application window and the device application window should be corresponding and synchronized. The operation of the mobile terminal in the terminal application window can be synchronized to the device application window, and the operation of the display device in the device application window can be synchronized to the terminal application window. It can be understood that multi-screen display can be realized in the display device, that is, the device application windows of multiple terminal applications can be displayed at the same time.

[0108] S402: Acquire movement operation information sent by the display device, and acquire the starting point coordinates and window identifier carried in the movement operation information.

[0109] Specifically, after the mobile terminal receives the mobile operation information sent by the display device, it can obtain the starting point coordinates and window identifier carried in the mobile operation information. The starting point coordinates can instruct the mobile terminal to find the application data at the position corresponding to the starting point coordinates, and the window identifier can be the number, name, etc. of the application window. The display device can obtain the window identifier of the application window where the end point is located, and the window identifier can indicate the terminal device to obtain the target terminal application.

[0110] S403, obtaining a data identifier corresponding to the starting point coordinates, obtaining application data corresponding to the data identifier, obtaining an application identifier corresponding to the window identifier, and obtaining a target terminal application corresponding to the application identifier.

[0111] Specifically, the mobile terminal can obtain the data identifier corresponding to the starting point coordinates, and the data representation can be a data name, a data address, etc., and the corresponding application data can be obtained according to the data identifier, for example, searching for application data with the same name in the mobile terminal according to the data name, or obtaining application data within the data address according to the data address. The mobile terminal can obtain the application identifier corresponding to the window identifier, and the application identifier can be an application name or an application package name, and the mobile terminal can obtain the corresponding target terminal application according to the application identifier.

[0112] Optionally, the mobile terminal can obtain the mobile operation information sent by the display device, obtain the starting point coordinates and the end point coordinates carried in the mobile operation information, and then obtain the window identifier of the device application window where the end point coordinates are located, obtain the application data indicated by the starting point coordinates, and obtain the target terminal application corresponding to the window identifier.

[0113] Optionally, when the application data is a file or a picture, the display device obtains the starting coordinates of the starting position and sends them to the mobile terminal, and the mobile terminal can find the corresponding application data. However, the data moving device can not only realize the data transfer of files or pictures, but also realize the data transfer of text information. If the display device detects a moving operation, it can obtain the selected area corresponding to the starting position of the moving operation, obtain the text information in the selected area, and then obtain the window identifier of the application window where the end position of the moving operation is located. The display device can generate the moving operation information based on the text information and the window identifier. The selected area can be the area selected by the user after clicking the right mouse button and dragging. The mobile terminal can obtain the moving operation information sent by the display device, obtain the text information and window identifier carried in the moving operation information, and then obtain the target terminal application corresponding to the window identifier.

[0114] S404, if the sharing permission of the application data and the data adding permission of the target terminal application are obtained, the application data is added to the terminal application window of the target terminal application in the mobile terminal, and the terminal application window after adding the application data is displayed on the mobile terminal.

[0115] Specifically, not all application data in the mobile terminal can be moved or shared, and not all terminal applications can accept the addition of application data. Therefore, it is necessary to obtain both the sharing permission of the application data and the data adding permission of the target terminal application to complete the data movement. If the mobile terminal obtains the sharing permission and the data adding permission, the application data can be added to the terminal application window of the target terminal application, for example, it can be shared in the chat window of the instant messaging software. If the user then clicks send, the application data can be shared with friends who are chatting in the terminal application window.

[0116] S405: If the sharing permission or the data adding permission is not obtained, sending adding failure information to the display device.

[0117] Specifically, if the mobile terminal does not obtain the sharing permission or the data adding permission, the mobile terminal sends an adding failure message to the real device to prompt the user that the data movement corresponding to the moving operation has failed.

[0118] In the embodiment of the present application, based on the connection relationship with the display device, the data of the application window of the terminal application displayed by the mobile terminal is sent to the display device for screen projection display, and the mobile operation information sent by the display device is obtained. The mobile terminal obtains the application data and the target terminal application based on the mobile operation information, and obtains the sharing permission and data adding permission, and then adds the application data to the terminal application window of the target terminal application, thereby ensuring the security of the application data and the target terminal application. By obtaining the mobile operation information of the mobile operation performed in the display device, the mobile terminal is controlled to automatically move the application data, so that the screen projection uses the mobile operation that conforms to the operation logic of the display device on the display device, and the terminal device can be controlled to complete the data movement, which reduces the steps required for data movement, improves the efficiency of data movement operation, and thus improves the operation effect of data projection.

[0119] See also Figure 6 , which is a flowchart of a data movement method provided in an embodiment of the present application. Figure 6 As shown, the embodiment of the present application is described from the display device side, and the method may include the following steps S501-S503.

[0120] S501, based on the connection relationship with the mobile terminal, receiving data of an application window of a terminal application displayed by the mobile terminal, and projecting and displaying the application window on the screen.

[0121] Specifically, the mobile terminal can establish a connection relationship with the display device through a wired or wireless method. The mobile terminal sends the application window of the terminal application that has been started on the mobile terminal to the display device for screen projection display through the connection relationship. After receiving, the display device can display these application windows on the screen. The application window displayed by the same terminal application on the mobile terminal is called the terminal application window, and the application window displayed on the display device is called the device application window. The terminal application window and the device application window should be corresponding and synchronized. The operation of the mobile terminal in the terminal application window can be synchronized to the device application window, and the operation of the display device in the device application window can be synchronized to the terminal application window. It can be understood that multi-screen display can be realized in the display device, that is, the device application windows of multiple terminal applications can be displayed at the same time.

[0122] S502: If a moving operation is detected, obtaining moving operation information corresponding to the moving operation.

[0123] Specifically, since the display device can display device application windows of multiple terminal applications at the same time, the user can perform a move operation between device application windows. For example, when the user wants to add and share a file or application data to an instant messaging software, the user can select and drag the application data of one device application window to another device application window to add the application data to the terminal application corresponding to the other device application window. Since the cross-window move operation cannot be completed in the terminal device, the move operation process can only be implemented in the display device, so the display device needs to send the move operation information of the move operation to the terminal device. The application data can be a file, a picture, or text information, etc.

[0124] If the display device detects that a moving operation has occurred, it will obtain moving operation information corresponding to the moving operation. The moving operation information is used to instruct the mobile terminal to add the application data to the terminal application window of the target terminal application. The moving operation information includes the association information of the application data and the application data of the target terminal application. The association information of the application data can instruct the mobile terminal to find the application data, such as the data identifier, file name, storage address, etc. of the application data. The application data of the target terminal application can instruct the mobile terminal to find the target terminal application, such as the application name, application package name, etc. of the target terminal application.

[0125] S503: Send the mobile operation information to the mobile terminal.

[0126] Specifically, the display device sends the mobile operation information to the mobile terminal, so that the mobile terminal finds the application data and the target terminal application, and enables the mobile terminal to add and move the application data to the target terminal application.

[0127] In the embodiment of the present application, based on the connection relationship with the mobile terminal, the data of the application window of the terminal application displayed in the mobile terminal is received, and the screen is projected and displayed on the screen. If a moving operation is detected, the mobile operation information corresponding to the mobile operation is obtained, and the mobile operation information is sent to the mobile terminal. By obtaining the mobile operation information of the mobile operation performed in the display device, the mobile terminal is controlled to automatically move the application data, so that the screen projection uses the mobile operation that conforms to the operation logic of the display device on the display device, and the terminal device can be controlled to complete the data movement, which reduces the steps required for data movement, improves the efficiency of data movement operation, and thus improves the operation effect of data projection.

[0128] See also Figure 7 , which is a flowchart of a data movement method provided in an embodiment of the present application. Figure 7 As shown, the embodiment of the present application is described from the display device side, and the method may include the following steps S601-S605.

[0129] S601, based on the connection relationship with the mobile terminal, receiving data of an application window of a terminal application displayed by the mobile terminal, and projecting and displaying the application window on the screen.

[0130] Specifically, the mobile terminal can establish a connection relationship with the display device through a wired or wireless method. The mobile terminal sends the application window of the terminal application that has been started on the mobile terminal to the display device for screen projection display through the connection relationship. After receiving, the display device can display these application windows on the screen. The application window displayed by the same terminal application on the mobile terminal is called the terminal application window, and the application window displayed on the display device is called the device application window. The terminal application window and the device application window should be corresponding and synchronized. The operation of the mobile terminal in the terminal application window can be synchronized to the device application window, and the operation of the display device in the device application window can be synchronized to the terminal application window. It can be understood that multi-screen display can be realized in the display device, that is, the device application windows of multiple terminal applications can be displayed at the same time.

[0131] S602: If a moving operation is detected, obtain a starting point position and an end point position of the moving operation.

[0132] Specifically, since the display device can display device application windows of multiple terminal applications at the same time, the user can perform a move operation between device application windows. For example, when the user wants to add and share a file or application data to an instant messaging software, the user can use the move operation to move the data. The user can select the application data of a device application window and drag it to another device application window to add the application data to the terminal application corresponding to the other device application window. Since the cross-window move operation cannot be completed in the terminal device, the move operation process can only be implemented in the display device, so the display device needs to send the move operation information of the move operation to the terminal device. The application data can be a file, a picture, or text information. If the display device detects that a move operation has occurred, the display device can obtain the starting position and the end position of the move operation.

[0133] S603: Acquire the starting point coordinates of the starting point position and the window identifier of the application window where the end point position is located, and generate movement operation information based on the starting point coordinates and the window identifier.

[0134] For details, please refer to S203, which will not be repeated here.

[0135] S604: Based on the moving operation, add the display image of the application data to the device application window of the target terminal application.

[0136] Specifically, if the application data can successfully achieve data movement, the display device will display an animation on the screen of dragging the display image of the application data to the device application window of the target terminal application. The display image of the application data is the image effect of the application data displayed in the display terminal. This animation does not have real operational significance, but it can give users a better visual experience. Since the terminal application window and the device application window are corresponding and synchronized, as long as the application data can achieve data movement, the application data can appear in the terminal application window, that is, after the animation on the display device is played, the application data can also appear in the device application window.

[0137] S605: If the mobile terminal does not obtain the sharing authority of the application data and the data adding authority of the target terminal application, receiving the adding failure information sent by the mobile terminal, and displaying the adding failure information on the screen.

[0138] Specifically, not all application data in the mobile terminal can be moved or shared, and not all terminal applications can accept the addition of application data, so it is necessary to obtain the sharing permission of the application data and the data adding permission of the target terminal application at the same time to complete the data movement. If the mobile terminal obtains the sharing permission and the data adding permission, the application data can be added to the terminal application window of the target terminal application, for example, it can be shared to the chat window of the instant messaging software. If the user then clicks send, the application data can be shared with friends who are chatting in the terminal application window. If the mobile terminal does not obtain the sharing permission or the data adding permission, the mobile terminal sends an adding failure message to the real device. After the display device receives the adding failure message, it can display the adding failure message on the screen. Similarly, the adding failure message can also be output by language output, prompt sound, etc.

[0139] In an embodiment of the present application, based on the connection relationship with the mobile terminal, the data of the application window of the terminal application displayed in the mobile terminal is received, and the screen is projected and displayed on the screen. If a moving operation is detected, the mobile operation information corresponding to the moving operation is generated based on the starting point coordinates and window identifier corresponding to the moving operation, and the mobile operation information is sent to the mobile terminal. After the mobile terminal obtains the sharing authority and data adding authority of the application data and the target terminal application based on the mobile operation information, the application data is added to the terminal application window of the target terminal application, thereby ensuring the security of the application data and the target terminal application. By obtaining the mobile operation information of the mobile operation executed in the display device, the mobile terminal is controlled to automatically move the application data, so that the screen projection uses the mobile operation that conforms to the operation logic of the display device on the display device, and the terminal device can be controlled to complete the data movement, which reduces the steps required for data movement, improves the efficiency of data movement operation, and thus improves the operation effect of data projection. At the same time, the display image of the application data is added to the device application window of the target terminal application on the screen of the display device, which enriches the user's visual experience and further improves the use effect.

[0140] The following will be combined with the attached Figure 8 -Attached Fig.11 , the data moving device provided in the embodiment of the present application is introduced in detail. It should be noted that the attached Figure 8 -Attached Fig.11 The data moving device in the present application is used to execute Figure 4 and Figure 5 For the convenience of explanation, only the parts related to the embodiments of the present application are shown. For specific technical details not disclosed, please refer to the present application. Figure 4-Figure 5 The embodiment shown.

[0141] See also Figure 8, which shows a schematic diagram of the structure of a data moving device provided by an exemplary embodiment of the present application. The data moving device can be implemented as all or part of the device through software, hardware or a combination of both. The device 1 includes a screen projection sending module 11, a data acquisition module 12 and a data adding module 13.

[0142] A screen projection sending module 11 is used to send data of an application window of a terminal application displayed by the mobile terminal to the display device based on a connection relationship with the display device, so as to project and display the application window on the display device;

[0143] A data acquisition module 12, configured to receive mobile operation information sent by the display device, and acquire application data and target terminal application based on the mobile operation information;

[0144] The data adding module 13 is used to add the application data to the terminal application window of the target terminal application in the mobile terminal, and display the terminal application window after adding the application data on the mobile terminal. The terminal application window is the application window displayed by the target terminal application in the mobile terminal.

[0145] In an embodiment of the present application, based on the connection relationship with the display device, the data of the application window of the terminal application displayed by the mobile terminal is sent to the display device, so that the application window is projected and displayed on the display device. If the display device detects a moving operation, it obtains the mobile operation information corresponding to the mobile operation, and sends the mobile operation information to the mobile terminal. The mobile terminal obtains the application data and the target terminal application based on the mobile operation information, and adds the application data to the terminal application window of the target terminal application. By obtaining the mobile operation information of the mobile operation performed in the display device, the mobile terminal is controlled to automatically move the application data, so that the screen projection on the display device uses the mobile operation that conforms to the operation logic of the display device, and the terminal device can be controlled to complete the data movement, which reduces the steps required for data movement, improves the efficiency of data movement operations, and thus improves the operation effect of data projection.

[0146] See also Fig. 9 , which shows a schematic diagram of the structure of a data moving device provided by an exemplary embodiment of the present application. The data moving device can be implemented as all or part of the device through software, hardware or a combination of both. The device 1 includes a screen projection sending module 11, a data acquisition module 12, a data adding module 13, a coordinate acquisition module 14, a window identification acquisition module 15 and a text information acquisition module 16.

[0147] A screen projection sending module 11 is used to send data of an application window of a terminal application displayed by the mobile terminal to the display device based on a connection relationship with the display device, so as to project and display the application window on the display device;

[0148] A data acquisition module 12, configured to receive mobile operation information sent by the display device, and acquire application data and target terminal application based on the mobile operation information;

[0149] A data adding module 13, configured to add the application data to a terminal application window of the target terminal application in the mobile terminal, and display the terminal application window after adding the application data on the mobile terminal, wherein the terminal application window is an application window displayed by the target terminal application in the mobile terminal;

[0150] For details, please refer to Fig.10 , which is a structural diagram of a data adding module provided in an embodiment of the present application. Fig.10 As shown, the data adding module 13 may include:

[0151] The data adding unit 131 is configured to add the application data to the terminal application window of the target terminal application in the mobile terminal if the sharing permission of the application data and the data adding permission of the target terminal application are obtained, and display the terminal application window after the application data is added on the mobile terminal;

[0152] The failure information sending unit 132 is configured to send adding failure information to the display device if the sharing permission or the data adding permission is not obtained.

[0153] A coordinate acquisition module 14 is used to acquire the movement operation information sent by the display device, and acquire the starting point coordinates and the end point coordinates carried in the movement operation information;

[0154] Obtaining a window identifier of a device application window where the end point coordinates are located;

[0155] The indicated application data and the target terminal application corresponding to the window identifier are obtained;

[0156] The window identification acquisition module 15 is used to acquire the movement operation information sent by the display device, and acquire the starting point coordinates and the window identification carried in the movement operation information;

[0157] Acquire the application data indicated by the starting point coordinates, and acquire the target terminal application corresponding to the window identifier;

[0158] The window identifier is the number of the device application window where the end point of the moving operation is located in the display device;

[0159] For details, please refer to Fig.11 , which is a structural diagram of a window identification acquisition module provided in an embodiment of the present application.

[0160] Place Fig.11 As shown, the window identification acquisition module 15 may include:

[0161] A data acquisition unit 151 is used to acquire a data identifier corresponding to the starting point coordinates, and acquire application data corresponding to the data identifier;

[0162] The application acquisition unit 152 is used to acquire the application identifier corresponding to the window identifier, and acquire the target terminal application corresponding to the application identifier.

[0163] Optionally, the data acquisition unit 151 is specifically used to acquire a data address corresponding to the starting point coordinates, and acquire application data in the data address.

[0164] A text information acquisition module 16, used to acquire the mobile operation information sent by the display device, and acquire the text information and window identification carried in the mobile operation information;

[0165] Obtain the target terminal application corresponding to the window identifier.

[0166] In the embodiment of the present application, based on the connection relationship with the display device, the data of the application window of the terminal application displayed by the mobile terminal is sent to the display device for screen projection display, and the mobile operation information sent by the display device is obtained. The mobile terminal obtains the application data and the target terminal application based on the mobile operation information, and obtains the sharing permission and data adding permission, and then adds the application data to the terminal application window of the target terminal application, thereby ensuring the security of the application data and the target terminal application. By obtaining the mobile operation information of the mobile operation performed in the display device, the mobile terminal is controlled to automatically move the application data, so that the screen projection uses the mobile operation that conforms to the operation logic of the display device on the display device, and the terminal device can be controlled to complete the data movement, which reduces the steps required for data movement, improves the efficiency of data movement operation, and thus improves the operation effect of data projection.

[0167] Please refer to Fig.12 , which shows a block diagram of the structure of an electronic device provided by an exemplary embodiment of the present application. The electronic device in the present application may include one or more of the following components: a processor 110, a memory 120, an input device 130, an output device 140, and a bus 150. The processor 110, the memory 120, the input device 130, and the output device 140 may be connected via the bus 150.

[0168] The processor 110 may include one or more processing cores. The processor 110 uses various interfaces and lines to connect various parts of the entire electronic device, and executes various functions and processes data of the electronic device 100 by running or executing instructions, programs, code sets or instruction sets stored in the memory 120, and calling data stored in the memory 120. Optionally, the processor 110 can be implemented in at least one hardware form of digital signal processing (DSP), field-programmable gate array (FPGA), and programmable logic array (PLA). The processor 110 can integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing display content; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 110, but may be implemented separately through a communication chip.

[0169] The memory 120 may include a random access memory (RAM) or a read-only memory (ROM). Optionally, the memory 120 includes a non-transitory computer-readable storage medium. The memory 120 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 120 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the following various method embodiments, etc. The operating system may be an Android system, including a system deeply developed based on the Android system, an IOS system developed by Apple, including a system deeply developed based on the IOS system or other systems. The data storage area may also store data created by the electronic device during use, such as a phone book, audio and video data, chat record data, etc.

[0170] See also Fig.13As shown, the memory 120 can be divided into an operating system space and a user space. The operating system runs in the operating system space, and native and third-party applications run in the user space. In order to ensure that different third-party applications can achieve good operating results, the operating system allocates corresponding system resources to different third-party applications. However, different application scenarios in the same third-party application also have different requirements for system resources. For example, in the local resource loading scenario, the third-party application has higher requirements for disk reading speed; in the animation rendering scenario, the third-party application has higher requirements for GPU performance. The operating system and third-party applications are independent of each other, and the operating system often cannot perceive the current application scenario of the third-party application in a timely manner, resulting in the operating system being unable to perform targeted system resource adaptation according to the specific application scenario of the third-party application.

[0171] In order for the operating system to distinguish the specific application scenarios of third-party applications, it is necessary to open up data communication between third-party applications and the operating system so that the operating system can obtain the current scenario information of the third-party applications at any time, and then perform targeted system resource adaptation based on the current scenario.

[0172] Taking the Android operating system as an example, the programs and data stored in the memory 120 are as follows: Fig.14As shown, the memory 120 may store a Linux kernel layer 320, a system runtime library layer 340, an application framework layer 360 and an application layer 380, wherein the Linux kernel layer 320, the system runtime library layer 340 and the application framework layer 360 belong to the operating system space, and the application layer 380 belongs to the user space. The Linux kernel layer 320 provides underlying drivers for various hardware of electronic devices, such as display drivers, audio drivers, camera drivers, Bluetooth drivers, Wi-Fi drivers, power management, etc. The system runtime library layer 340 provides the main feature support for the Android system through some C / C++ libraries. For example, the SQLite library provides database support, the OpenGL / ES library provides 3D drawing support, and the Webkit library provides browser kernel support, etc. The Android runtime library (Android runtime) is also provided in the system runtime library layer 340, which mainly provides some core libraries that allow developers to use the Java language to write Android applications. The application framework layer 360 provides various APIs that may be used when building applications. Developers can also use these APIs to build their own applications, such as activity management, window management, view management, notification management, content provider, package management, call management, resource management, and location management. At least one application runs in the application layer 380. These applications can be native applications that come with the operating system, such as contact applications, text messaging applications, clock applications, camera applications, etc.; they can also be third-party applications developed by third-party developers, such as game applications, instant messaging applications, photo beautification applications, remote diagnosis applications, etc.

[0173] Taking the operating system as an IOS system as an example, the programs and data stored in the memory 120 are as follows: Fig.15As shown, the IOS system includes: a core operating system layer 420 (Core OS layer), a core service layer 440 (Core Services layer), a media layer 460 (Media layer), and a touchable layer 480 (Cocoa Touch Layer). The core operating system layer 420 includes the operating system kernel, drivers, and underlying program frameworks, which provide functions closer to the hardware for use by the program framework located in the core service layer 440. The core service layer 440 provides system services and / or program frameworks required by the application, such as the foundation framework, account framework, advertising framework, data storage framework, network connection framework, geographic location framework, motion framework, etc. The media layer 460 provides audio-visual interfaces for the application, such as graphics and image related interfaces, audio technology related interfaces, video technology related interfaces, and wireless playback (AirPlay) interfaces for audio and video transmission technologies. The touchable layer 480 provides various commonly used interface-related frameworks for application development, and the touchable layer 480 is responsible for the user's touch interaction operations on the electronic device. For example, local notification service, remote push service, advertising framework, game tool framework, message user interface (UI) framework, user interface UIKit framework, map framework, etc.

[0174] exist Fig.15 Among the frameworks shown, the frameworks related to most applications include but are not limited to: the basic framework in the core service layer 440 and the UIKit framework in the touchable layer 480. The basic framework provides many basic object classes and data types, provides the most basic system services for all applications, and has nothing to do with UI. The classes provided by the UIKit framework are basic UI class libraries for creating touch-based user interfaces. iOS applications can provide UIs based on the UIKit framework, so it provides the basic architecture of applications for building user interfaces, drawing, processing and user interaction events, responding to gestures, etc.

[0175] Among them, the method and principle of implementing data communication between third-party applications and the operating system in the IOS system can be referred to the Android system, and this application will not go into details here.

[0176] Among them, the input device 130 is used to receive input instructions or data, and the input device 130 includes but is not limited to a keyboard, a mouse, a camera, a microphone or a touch device. The output device 140 is used to output instructions or data, and the output device 140 includes but is not limited to a display device and a speaker. In one example, the input device 130 and the output device 140 can be combined, and the input device 130 and the output device 140 are touch screen displays, which are used to receive touch operations on or near the user using any suitable object such as a finger or a touch pen, and to display the user interface of each application. The touch screen display is usually set on the front panel of the electronic device. The touch screen display can be designed as a full screen, a curved screen or a special-shaped screen. The touch screen display can also be designed as a combination of a full screen and a curved screen, or a combination of a special-shaped screen and a curved screen, which is not limited in the embodiments of the present application.

[0177] In addition, those skilled in the art will appreciate that the structure of the electronic device shown in the above drawings does not constitute a limitation on the electronic device, and the electronic device may include more or fewer components than shown, or combine certain components, or arrange the components differently. For example, the electronic device also includes a radio frequency circuit, an input unit, a sensor, an audio circuit, a wireless fidelity (WiFi) module, a power supply, a Bluetooth module and other components, which will not be described in detail here.

[0178] In the embodiment of the present application, the execution subject of each step may be the electronic device described above. Optionally, the execution subject of each step is the operating system of the electronic device. The operating system may be an Android system, an IOS system, or other operating systems, which is not limited in the embodiment of the present application.

[0179] The electronic device of the embodiment of the present application may also be equipped with a display device, which may be any device capable of realizing a display function, such as a cathode ray tube display (CR), a light-emitting diode display (LED), an electronic ink screen, a liquid crystal display (LCD), a plasma display panel (PDP), etc. The user may use the display device on the electronic device 101 to view displayed text, images, videos and other information. The electronic device may be a smart phone, a tablet computer, a gaming device, an AR (Augmented Reality) device, a car, a data storage device, an audio playback device, a video playback device, a notebook, a desktop computing device, a wearable device such as an electronic watch, an electronic glasses, an electronic helmet, an electronic bracelet, an electronic necklace, electronic clothing and other devices.

[0180] exist Fig.12 In the electronic device shown, the processor 110 can be used to call the remote diagnosis application stored in the memory 120, and specifically perform the following operations:

[0181] Based on the connection relationship with the display device, data of the application window of the terminal application displayed by the mobile terminal is sent to the display device, so as to project and display the application window on the display device;

[0182] Receiving mobile operation information sent by the display device, and acquiring application data and target terminal application based on the mobile operation information;

[0183] The application data is added to the terminal application window of the target terminal application in the mobile terminal, and the terminal application window after adding the application data is displayed on the mobile terminal. The terminal application window is the application window displayed by the target terminal application in the mobile terminal.

[0184] In one embodiment, the processor 110 specifically performs the following steps when receiving the mobile operation information sent by the display device and acquiring the application data and the target terminal application based on the mobile operation information:

[0185] Acquire the movement operation information sent by the display device, and acquire the starting point coordinates and the end point coordinates carried in the movement operation information;

[0186] Obtaining a window identifier of a device application window where the end point coordinates are located;

[0187] Acquire the application data indicated by the starting point coordinates, and acquire the target terminal application corresponding to the window identifier;

[0188] The starting point coordinates are the starting point position of the moving operation in the display device, the ending point coordinates are the ending point position of the moving operation in the display device, and the device application window is the application window displayed by the target terminal application in the display device.

[0189] In one embodiment, the processor 110 specifically performs the following steps when receiving the mobile operation information sent by the display device and acquiring the application data and the target terminal application based on the mobile operation information:

[0190] Acquire the mobile operation information sent by the display device, and acquire the starting point coordinates and window identifier carried in the mobile operation information;

[0191] Acquire the application data indicated by the starting point coordinates, and acquire the target terminal application corresponding to the window identifier;

[0192] The window identifier is the number of the device application window where the end point of the moving operation is located in the display device.

[0193] In one embodiment, the processor 110 specifically performs the following steps when executing the process of acquiring the application data indicated by the starting point coordinates and acquiring the target terminal application corresponding to the window identifier:

[0194] Obtaining a data identifier corresponding to the starting point coordinates, and obtaining application data corresponding to the data identifier;

[0195] An application identifier corresponding to the window identifier is obtained, and a target terminal application corresponding to the application identifier is obtained.

[0196] In one embodiment, the processor 110 specifically performs the following steps when executing the process of obtaining the data identifier corresponding to the starting point coordinates and obtaining the application data corresponding to the data identifier:

[0197] Obtain a data address corresponding to the starting point coordinates, and obtain application data in the data address.

[0198] In one embodiment, the processor 110 specifically performs the following steps when receiving the mobile operation information sent by the display device and acquiring the application data and the target terminal application based on the mobile operation information:

[0199] Acquire the mobile operation information sent by the display device, and acquire the text information and window identifier carried in the mobile operation information;

[0200] Obtain the target terminal application corresponding to the window identifier.

[0201] In one embodiment, when the processor 110 adds the application data to the terminal application window of the target terminal application in the mobile terminal and displays the terminal application window after adding the application data on the mobile terminal, the processor 110 specifically performs the following steps:

[0202] If the sharing permission of the application data and the data adding permission of the target terminal application are obtained, the application data is added to the terminal application window of the target terminal application in the mobile terminal, and the terminal application window after the application data is added is displayed on the mobile terminal;

[0203] If the sharing permission or the data adding permission is not obtained, an adding failure message is sent to the display device.

[0204] In the embodiment of the present application, based on the connection relationship with the display device, the data of the application window of the terminal application displayed by the mobile terminal is sent to the display device for screen projection display, and the mobile operation information sent by the display device is obtained. The mobile terminal obtains the application data and the target terminal application based on the mobile operation information, and obtains the sharing permission and data adding permission, and then adds the application data to the terminal application window of the target terminal application, thereby ensuring the security of the application data and the target terminal application. By obtaining the mobile operation information of the mobile operation performed in the display device, the mobile terminal is controlled to automatically move the application data, so that the screen projection uses the mobile operation that conforms to the operation logic of the display device on the display device, and the terminal device can be controlled to complete the data movement, which reduces the steps required for data movement, improves the efficiency of data movement operation, and thus improves the operation effect of data projection.

[0205] The following will be combined with the attached Fig.16 -Attached Fig.18 , the information sending device provided in the embodiment of the present application is introduced in detail. It should be noted that the attached Fig.16 -Attached Fig.18 The information sending device is used to execute the application Figure 6 and Figure 7 For the convenience of explanation, only the parts related to the embodiments of the present application are shown. For specific technical details not disclosed, please refer to the present application. Figure 6-Figure 7 The embodiment shown.

[0206] See also Fig.16, which shows a schematic diagram of the structure of an information sending device provided by an exemplary embodiment of the present application. The information sending device can be implemented as all or part of the device through software, hardware or a combination of both. The device 2 includes a screen projection receiving module 21, an information acquisition module 22 and an information sending module 23.

[0207] The screen projection receiving module 21 is used to receive data of an application window of a terminal application displayed by the mobile terminal based on a connection relationship with the mobile terminal, and to project and display the application window on the screen;

[0208] An information acquisition module 22, configured to acquire movement operation information corresponding to the movement operation if a movement operation is detected;

[0209] An information sending module 23, used for sending the mobile operation information to the mobile terminal;

[0210] The mobile operation information is used to instruct the mobile terminal to add application data to the terminal application window of the target terminal application, and display the terminal application window after adding the application data on the mobile terminal. The mobile operation information includes association information of the application data and the application data of the target terminal application. The terminal application window is an application window displayed by the target terminal application in the mobile terminal.

[0211] In the embodiment of the present application, based on the connection relationship with the mobile terminal, the data of the application window of the terminal application displayed in the mobile terminal is received, and the screen is projected and displayed on the screen. If a moving operation is detected, the mobile operation information corresponding to the mobile operation is obtained, and the mobile operation information is sent to the mobile terminal. By obtaining the mobile operation information of the mobile operation performed in the display device, the mobile terminal is controlled to automatically move the application data, so that the screen projection uses the mobile operation that conforms to the operation logic of the display device on the display device, and the terminal device can be controlled to complete the data movement, which reduces the steps required for data movement, improves the efficiency of data movement operation, and thus improves the operation effect of data projection.

[0212] See also Fig.17 , which shows a schematic diagram of the structure of an information sending device provided by an exemplary embodiment of the present application. The information sending device can be implemented as all or part of the device through software, hardware or a combination of both. The device 2 includes a screen projection receiving module 21, an information acquisition module 22, an information sending module 23, an image adding module 24 and a failure information display module 25.

[0213] The screen projection receiving module 21 is used to receive data of an application window of a terminal application displayed by the mobile terminal based on a connection relationship with the mobile terminal, and to project and display the application window on the screen;

[0214] An information acquisition module 22, configured to acquire movement operation information corresponding to the movement operation if a movement operation is detected;

[0215] For details, please refer to Fig.18 , which is a schematic diagram of the structure of an information acquisition module provided in the embodiment of the present application. Fig.18 As shown, the information acquisition module 22 may include:

[0216] A coordinate acquisition unit 221 is used to acquire the starting point coordinates of the starting point position and the ending point coordinates of the ending point position of the moving operation if a moving operation is detected;

[0217] generating movement operation information based on the starting point coordinates and the end point coordinates;

[0218] The window identification acquisition unit 222 is used to acquire the starting position and the ending position of the moving operation if a moving operation is detected;

[0219] Obtaining the starting point coordinates of the starting point position and the window identifier of the application window where the end point position is located;

[0220] Generate movement operation information based on the starting point coordinates and the window identifier;

[0221] The text information acquisition unit 223 is used to acquire a selected area corresponding to the starting point of the moving operation and acquire text information in the selected area if a moving operation is detected;

[0222] Obtaining a window identifier of the application window where the end point of the moving operation is located;

[0223] The moving operation information is generated based on the text information and the window identifier.

[0224] An information sending module 23, used for sending the mobile operation information to the mobile terminal;

[0225] The mobile operation information is used to instruct the mobile terminal to add the application data to the terminal application window of the target terminal application, and display the terminal application window after adding the application data on the mobile terminal, the mobile operation information includes the association information of the application data and the application data of the target terminal application, and the terminal application window is the application window of the target terminal application displayed in the mobile terminal;

[0226] An image adding module 24, configured to add a display image of the application data to a device application window of the target terminal application based on the moving operation;

[0227] The display image of the application data is an image effect of the application data displayed in the display terminal, and the device application window is an application window of the target terminal application displayed in the display device;

[0228] A failure information display module 25 is used to receive the adding failure information sent by the mobile terminal if the mobile terminal does not obtain the sharing authority of the application data and the data adding authority of the target terminal application;

[0229] The adding failure information is displayed on the screen.

[0230] In an embodiment of the present application, based on the connection relationship with the mobile terminal, the data of the application window of the terminal application displayed in the mobile terminal is received, and the screen is projected and displayed on the screen. If a moving operation is detected, the mobile operation information corresponding to the moving operation is generated based on the starting point coordinates and window identifier corresponding to the moving operation, and the mobile operation information is sent to the mobile terminal. After the mobile terminal obtains the sharing authority and data adding authority of the application data and the target terminal application based on the mobile operation information, the application data is added to the terminal application window of the target terminal application, thereby ensuring the security of the application data and the target terminal application. By obtaining the mobile operation information of the mobile operation executed in the display device, the mobile terminal is controlled to automatically move the application data, so that the screen projection uses the mobile operation that conforms to the operation logic of the display device on the display device, and the terminal device can be controlled to complete the data movement, which reduces the steps required for data movement, improves the efficiency of data movement operation, and thus improves the operation effect of data projection. At the same time, the display image of the application data is added to the device application window of the target terminal application on the screen of the display device, which enriches the user's visual experience and further improves the use effect.

[0231] Please refer to Fig.19 , which shows a block diagram of the structure of an electronic device provided by an exemplary embodiment of the present application. The electronic device in the present application may include one or more of the following components: a processor 210, a memory 220, an input device 230, an output device 240, and a bus 250. The processor 210, the memory 220, the input device 230, and the output device 240 may be connected via a bus 250.

[0232] The processor 210 may include one or more processing cores. The processor 210 uses various interfaces and lines to connect various parts of the entire electronic device, and executes various functions and processes data of the electronic device 200 by running or executing instructions, programs, code sets or instruction sets stored in the memory 220, and calling data stored in the memory 220. Optionally, the processor 210 can be implemented in at least one hardware form of digital signal processing (DSP), field-programmable gate array (FPGA), and programmable logic array (PLA). The processor 210 can integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing display content; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 210, but may be implemented separately through a communication chip.

[0233] The memory 220 may include a random access memory (RAM) or a read-only memory (ROM). Optionally, the memory 220 includes a non-transitory computer-readable storage medium. The memory 220 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 220 may include a storage program area and a storage data area, wherein the storage program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the following various method embodiments, etc. The operating system may be an Android system, including a system deeply developed based on the Android system, an IOS system developed by Apple, including a system deeply developed based on the IOS system or other systems. The storage data area may also store data created by the electronic device during use, such as a phone book, audio and video data, chat record data, etc.

[0234] See also Fig. 20As shown, the memory 220 can be divided into an operating system space and a user space. The operating system runs in the operating system space, and native and third-party applications run in the user space. In order to ensure that different third-party applications can achieve good operating results, the operating system allocates corresponding system resources to different third-party applications. However, different application scenarios in the same third-party application also have different requirements for system resources. For example, in the local resource loading scenario, the third-party application has higher requirements for disk reading speed; in the animation rendering scenario, the third-party application has higher requirements for GPU performance. The operating system and third-party applications are independent of each other, and the operating system often cannot perceive the current application scenario of the third-party application in a timely manner, resulting in the operating system being unable to perform targeted system resource adaptation according to the specific application scenario of the third-party application.

[0235] In order for the operating system to distinguish the specific application scenarios of third-party applications, it is necessary to open up data communication between third-party applications and the operating system so that the operating system can obtain the current scenario information of the third-party applications at any time, and then perform targeted system resource adaptation based on the current scenario.

[0236] Taking the Android operating system as an example, the programs and data stored in the memory 220 are as follows: Fig.21As shown, the memory 220 may store a Linux kernel layer 520, a system runtime library layer 540, an application framework layer 560 and an application layer 580, wherein the Linux kernel layer 520, the system runtime library layer 540 and the application framework layer 560 belong to the operating system space, and the application layer 580 belongs to the user space. The Linux kernel layer 520 provides underlying drivers for various hardware of electronic devices, such as display drivers, audio drivers, camera drivers, Bluetooth drivers, Wi-Fi drivers, power management, etc. The system runtime library layer 540 provides the main feature support for the Android system through some C / C++ libraries. For example, the SQLite library provides database support, the OpenGL / ES library provides 3D drawing support, and the Webkit library provides browser kernel support, etc. The system runtime library layer 540 also provides an Android runtime library (Android runtime), which mainly provides some core libraries, allowing developers to use Java language to write Android applications. The application framework layer 560 provides various APIs that may be used when building applications. Developers can also use these APIs to build their own applications, such as activity management, window management, view management, notification management, content provider, package management, call management, resource management, and location management. At least one application runs in the application layer 580. These applications can be native applications that come with the operating system, such as contact applications, text messaging applications, clock applications, camera applications, etc.; they can also be third-party applications developed by third-party developers, such as game applications, instant messaging applications, photo beautification applications, remote diagnosis applications, etc.

[0237] Taking the operating system as an IOS system as an example, the programs and data stored in the memory 220 are as follows: Fig. 22As shown, the IOS system includes: a core operating system layer 620 (Core OS layer), a core service layer 640 (Core Services layer), a media layer 660 (Media layer), and a touchable layer 680 (Cocoa Touch Layer). The core operating system layer 620 includes the operating system kernel, drivers, and underlying program frameworks, which provide functions closer to the hardware for use by the program framework located in the core service layer 640. The core service layer 640 provides system services and / or program frameworks required by the application, such as the foundation framework, account framework, advertising framework, data storage framework, network connection framework, geographic location framework, motion framework, etc. The media layer 660 provides audio-visual interfaces for the application, such as graphics and image related interfaces, audio technology related interfaces, video technology related interfaces, and wireless playback (AirPlay) interfaces for audio and video transmission technologies. The touchable layer 680 provides various commonly used interface-related frameworks for application development, and the touchable layer 680 is responsible for the user's touch interaction operations on the electronic device. For example, local notification service, remote push service, advertising framework, game tool framework, message user interface (UI) framework, user interface UIKit framework, map framework, etc.

[0238] exist Fig. 22 Among the frameworks shown, the frameworks related to most applications include but are not limited to: the basic framework in the core service layer 640 and the UIKit framework in the touchable layer 680. The basic framework provides many basic object classes and data types, provides the most basic system services for all applications, and has nothing to do with UI. The classes provided by the UIKit framework are basic UI class libraries for creating touch-based user interfaces. iOS applications can provide UIs based on the UIKit framework, so it provides the basic architecture of applications for building user interfaces, drawing, processing and user interaction events, responding to gestures, etc.

[0239] Among them, the method and principle of implementing data communication between third-party applications and the operating system in the IOS system can be referred to the Android system, and this application will not go into details here.

[0240] Among them, the input device 230 is used to receive input instructions or data, and the input device 230 includes but is not limited to a keyboard, a mouse, a camera, a microphone or a touch device. The output device 240 is used to output instructions or data, and the output device 240 includes but is not limited to a display device and a speaker. In one example, the input device 230 and the output device 240 can be combined, and the input device 230 and the output device 240 are a touch display screen, which is used to receive touch operations on or near it by a user using any suitable object such as a finger or a touch pen, and to display the user interface of each application. The touch display screen is usually set on the front panel of the electronic device. The touch display screen can be designed as a full screen, a curved screen or a special-shaped screen. The touch display screen can also be designed as a combination of a full screen and a curved screen, or a combination of a special-shaped screen and a curved screen, which is not limited in the embodiments of the present application.

[0241] In addition, those skilled in the art will appreciate that the structure of the electronic device shown in the above drawings does not constitute a limitation on the electronic device, and the electronic device may include more or fewer components than shown, or combine certain components, or arrange the components differently. For example, the electronic device also includes a radio frequency circuit, an input unit, a sensor, an audio circuit, a wireless fidelity (WiFi) module, a power supply, a Bluetooth module and other components, which will not be described in detail here.

[0242] In the embodiment of the present application, the execution subject of each step may be the electronic device described above. Optionally, the execution subject of each step is the operating system of the electronic device. The operating system may be an Android system, an IOS system, or other operating systems, which is not limited in the embodiment of the present application.

[0243] The electronic device of the embodiment of the present application may also be equipped with a display device, which may be any device capable of realizing a display function, such as a cathode ray tube display (CR), a light-emitting diode display (LED), an electronic ink screen, a liquid crystal display (LCD), a plasma display panel (PDP), etc. The user may use the display device on the electronic device 101 to view displayed text, images, videos and other information. The electronic device may be a smart phone, a tablet computer, a gaming device, an AR (Augmented Reality) device, a car, a data storage device, an audio playback device, a video playback device, a notebook, a desktop computing device, a wearable device such as an electronic watch, an electronic glasses, an electronic helmet, an electronic bracelet, an electronic necklace, electronic clothing and other devices.

[0244] exist Fig.19 In the electronic device shown, the processor 210 can be used to call the remote diagnosis application stored in the memory 220, and specifically perform the following operations:

[0245] Based on the connection relationship with the mobile terminal, receiving data of an application window of a terminal application displayed by the mobile terminal, and projecting and displaying the application window on the screen;

[0246] If a moving operation is detected, obtaining moving operation information corresponding to the moving operation;

[0247] sending the mobile operation information to the mobile terminal;

[0248] The mobile operation information is used to instruct the mobile terminal to add application data to the terminal application window of the target terminal application, and display the terminal application window after adding the application data on the mobile terminal. The mobile operation information includes association information of the application data and the application data of the target terminal application. The terminal application window is an application window displayed by the target terminal application in the mobile terminal.

[0249] In one embodiment, when the processor 210 detects a movement operation and obtains movement operation information corresponding to the movement operation, the processor 210 specifically performs the following operations:

[0250] If a moving operation is detected, obtaining the starting point coordinates of the starting point position and the ending point coordinates of the ending point position of the moving operation;

[0251] Movement operation information is generated based on the start point coordinates and the end point coordinates.

[0252] In one embodiment, when the processor 210 detects a movement operation and obtains movement operation information corresponding to the movement operation, the processor 210 specifically performs the following operations:

[0253] If a moving operation is detected, obtaining the starting position and the ending position of the moving operation;

[0254] Obtaining the starting point coordinates of the starting point position and the window identifier of the application window where the end point position is located;

[0255] The moving operation information is generated based on the starting point coordinates and the window identifier.

[0256] In one embodiment, when the processor 210 detects a movement operation and obtains movement operation information corresponding to the movement operation, the processor 210 specifically performs the following operations:

[0257] If a moving operation is detected, obtaining a selected area corresponding to the starting point of the moving operation, and obtaining text information in the selected area;

[0258] Obtaining a window identifier of the application window where the end point of the moving operation is located;

[0259] The moving operation information is generated based on the text information and the window identifier.

[0260] In one embodiment, after executing sending the mobile operation information to the mobile terminal, the processor 210 further performs the following operations:

[0261] Based on the moving operation, adding a display image of the application data to a device application window of the target terminal application;

[0262] The display image of the application data is an image effect of the application data displayed in the display terminal, and the device application window is an application window of the target terminal application displayed in the display device.

[0263] In one embodiment, when executing the data moving method, the processor 210 further performs the following operations:

[0264] If the mobile terminal does not obtain the sharing permission of the application data and the data adding permission of the target terminal application, receiving the adding failure information sent by the mobile terminal;

[0265] The adding failure information is displayed on the screen.

[0266] In an embodiment of the present application, based on the connection relationship with the mobile terminal, the data of the application window of the terminal application displayed in the mobile terminal is received, and the screen is projected and displayed on the screen. If a moving operation is detected, the mobile operation information corresponding to the moving operation is generated based on the starting point coordinates and window identifier corresponding to the moving operation, and the mobile operation information is sent to the mobile terminal. After the mobile terminal obtains the sharing authority and data adding authority of the application data and the target terminal application based on the mobile operation information, the application data is added to the terminal application window of the target terminal application, thereby ensuring the security of the application data and the target terminal application. By obtaining the mobile operation information of the mobile operation executed in the display device, the mobile terminal is controlled to automatically move the application data, so that the screen projection uses the mobile operation that conforms to the operation logic of the display device on the display device, and the terminal device can be controlled to complete the data movement, which reduces the steps required for data movement, improves the efficiency of data movement operation, and thus improves the operation effect of data projection. At the same time, the display image of the application data is added to the device application window of the target terminal application on the screen of the display device, which enriches the user's visual experience and further improves the use effect.

[0267] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing related hardware through a computer program, and the program can be stored in a computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above-mentioned methods. The storage medium can be a disk, an optical disk, a read-only storage memory, or a random access memory, etc.

[0268] The above disclosure is only the preferred embodiment of the present application, which certainly cannot be used to limit the scope of rights of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope covered by the present application.

Claims

1. A data migration method, characterized in that: Applied in a mobile terminal, the method comprises: Based on the connection relationship with the display device, data of the application window of the terminal application displayed by the mobile terminal is sent to the display device, so as to project and display the application window on the display device; receiving mobile operation information sent by the display device, and acquiring application data and a target terminal application based on the mobile operation information, wherein the mobile operation information includes association information of the application data and application data of the target terminal application, wherein the association information of the application data is used to indicate that the mobile terminal has found the application data, and the application data of the target terminal application is used to indicate that the mobile terminal has found the target terminal application; Adding the application data to a terminal application window of the target terminal application in the mobile terminal, and displaying the terminal application window after adding the application data on the mobile terminal; the terminal application window is an application window displayed by the target terminal application in the mobile terminal; The receiving the mobile operation information sent by the display device, and acquiring the application data and the target terminal application based on the mobile operation information, comprises: Acquire the movement operation information sent by the display device, and acquire the starting point coordinates and the end point coordinates carried in the movement operation information; Obtaining a window identifier of a device application window where the end point coordinates are located; Acquire the application data indicated by the starting point coordinates, and acquire the target terminal application corresponding to the window identifier; The starting point coordinates are the starting point position of the moving operation in the display device, the ending point coordinates are the ending point position of the moving operation in the display device, and the device application window is the application window displayed by the target terminal application in the display device.

2. The method according to claim 1, characterized in that: The receiving the mobile operation information sent by the display device, and acquiring the application data and the target terminal application based on the mobile operation information, comprises: Acquire the mobile operation information sent by the display device, and acquire the starting point coordinates and the window identifier carried in the mobile operation information; Acquire the application data indicated by the starting point coordinates, and acquire the target terminal application corresponding to the window identifier; The window identifier is the number of the device application window where the end point of the moving operation is located in the display device.

3. The method according to claim 1 or 2, characterized in that: The acquiring the application data indicated by the starting point coordinates and acquiring the target terminal application corresponding to the window identifier includes: Obtaining a data identifier corresponding to the starting point coordinates, and obtaining application data corresponding to the data identifier; The application identifier corresponding to the window identifier is obtained, and the target terminal application corresponding to the application identifier is obtained.

4. The method according to claim 3, characterized in that The obtaining of the data identifier corresponding to the starting point coordinates and the obtaining of the application data corresponding to the data identifier include: Obtain a data address corresponding to the starting point coordinates, and obtain application data in the data address.

5. The method according to claim 1, characterized in that The receiving the mobile operation information sent by the display device, and acquiring the application data and the target terminal application based on the mobile operation information, includes: Acquire the mobile operation information sent by the display device, and acquire the text information and the window identifier carried in the mobile operation information; The target terminal application corresponding to the window identifier is obtained.

6. The method according to claim 1, characterized in that The step of adding the application data to the terminal application window of the target terminal application in the mobile terminal, and displaying the terminal application window after adding the application data on the mobile terminal includes: If the sharing permission of the application data and the data adding permission of the target terminal application are obtained, the application data is added to the terminal application window of the target terminal application in the mobile terminal, and the terminal application window after the application data is added is displayed on the mobile terminal; If the sharing permission or the data adding permission is not obtained, an adding failure message is sent to the display device.

7. A data migration method, characterized in that: Applied to a display device, the method comprises: Based on the connection relationship with the mobile terminal, receiving data of an application window of a terminal application displayed by the mobile terminal, and projecting and displaying the application window on the screen; If a moving operation is detected, obtaining moving operation information corresponding to the moving operation; sending the mobile operation information to the mobile terminal; The mobile operation information is used to instruct the mobile terminal to add the application data to the terminal application window of the target terminal application, and display the terminal application window after adding the application data on the mobile terminal, the mobile operation information includes association information of the application data and application data of the target terminal application, the association information of the application data is used to instruct the mobile terminal to find the application data, the application data of the target terminal application is used to instruct the mobile terminal to find the target terminal application, and the terminal application window is an application window of the target terminal application displayed in the mobile terminal; If a moving operation is detected, obtaining moving operation information corresponding to the moving operation includes: If the moving operation is detected, obtaining the starting position and the ending position of the moving operation; Obtaining the starting point coordinates of the starting point position and the window identifier of the application window where the end point position is located; The moving operation information is generated based on the starting point coordinates and the window identifier.

8. The method according to claim 7, characterized in that If a moving operation is detected, obtaining moving operation information corresponding to the moving operation includes: If the moving operation is detected, a selected area corresponding to the starting point position is obtained, and text information in the selected area is obtained; Obtaining a window identifier of the application window where the end point is located; The moving operation information is generated based on the text information and the window identifier.

9. The method according to claim 7, characterized in that: After sending the mobile operation information to the mobile terminal, the method further includes: Based on the moving operation, adding a display image of the application data to a device application window of the target terminal application; The display image of the application data is an image effect of the application data displayed in the display terminal, and the device application window is an application window of the target terminal application displayed in the display device.

10. The method according to claim 7, characterized in that The method further comprises: If the mobile terminal does not obtain the sharing permission of the application data and the data adding permission of the target terminal application, receiving the adding failure information sent by the mobile terminal; The adding failure information is displayed on the screen.

11. A data moving device, characterized in that: The device comprises: A screen projection sending module, used to send data of an application window of a terminal application displayed by the mobile terminal to the display device based on a connection relationship with the display device, so as to project and display the application window on the display device; A data acquisition module, used to receive mobile operation information sent by the display device, and acquire application data and target terminal application based on the mobile operation information, wherein the mobile operation information includes association information of the application data and application data of the target terminal application, wherein the association information of the application data is used to indicate that the mobile terminal has found the application data, and the application data of the target terminal application is used to indicate that the mobile terminal has found the target terminal application; the receiving of the mobile operation information sent by the display device, and acquiring application data and target terminal application based on the mobile operation information, includes: acquiring the mobile operation information sent by the display device, acquiring the starting point coordinates and the ending point coordinates carried in the mobile operation information; acquiring the window identifier of the device application window where the ending point coordinates are located; acquiring the application data indicated by the starting point coordinates, and acquiring the target terminal application corresponding to the window identifier; the starting point coordinates are the starting point position of the mobile operation in the display device, the ending point coordinates are the ending point position of the mobile operation in the display device, and the device application window is the application window displayed by the target terminal application in the display device A data adding module is used to add the application data to the terminal application window of the target terminal application in the mobile terminal, and display the terminal application window after adding the application data on the mobile terminal; the terminal application window is the application window displayed by the target terminal application in the mobile terminal.

12. An information sending device, characterized in that: The device comprises A screen projection receiving module, used to receive data of an application window of a terminal application displayed by the mobile terminal based on a connection relationship with the mobile terminal, and to project and display the application window on the screen; An information acquisition module, configured to acquire movement operation information corresponding to the movement operation if a movement operation is detected; If a moving operation is detected, obtaining moving operation information corresponding to the moving operation includes: if the moving operation is detected, obtaining a starting point position and an end point position of the moving operation; obtaining a starting point coordinate of the starting point position and a window identifier of an application window where the end point position is located; and generating the moving operation information based on the starting point coordinates and the window identifier; An information sending module, used for sending the mobile operation information to the mobile terminal; The mobile operation information is used to instruct the mobile terminal to add application data to the terminal application window of the target terminal application, and display the terminal application window after adding the application data on the mobile terminal. The mobile operation information includes association information of the application data and application data of the target terminal application. The association information of the application data is used to instruct the mobile terminal to find the application data. The application data of the target terminal application is used to instruct the mobile terminal to find the target terminal application. The terminal application window is an application window displayed by the target terminal application in the mobile terminal.

13. A computer storage medium, characterized in that: The computer storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the method steps as claimed in any one of claims 1 to 10.

14. An electronic device, characterized in that: include: A processor and a memory; wherein the memory stores a computer program, and the computer program is suitable for being loaded by the processor and executing the method steps as claimed in any one of claims 1 to 10.

Images