A screen-flying interaction method, device, electronic device, and storage medium
By recognizing the interactive operations of terminal devices and using cloud instances to push applications to be displayed on the flying screen, the problem of frequent device pairing in multi-screen interaction is solved, thus improving the user experience.
Patent Information
- Application Number
- CN202411534693.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-31
- Publication Date
- 2025-10-31
- Estimated Expiration
- 2044-10-31
AI Technical Summary
In existing technologies, multi-screen smart cockpits require device pairing each time the screen is operated, resulting in a poor user experience.
By recognizing the interactive operations on the terminal device's display screen, the application to be shared and the target terminal device are identified. The application to be shared is then pushed to the target terminal device using a cloud instance, enabling direct sharing of the application.
This eliminates the need for device pairing during each screen-flying operation, improving the intelligence of multi-screen interaction and enhancing the user experience.
Smart Images

Figure CN119603352B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of smart cockpit technology, and more specifically, to a flying screen interaction method, device, electronic device, and storage medium. Background Technology
[0002] A smart cockpit typically consists of components such as an instrument panel, head-up display, central control screen, and front and rear seat entertainment systems. By integrating various advanced technologies and equipment, it can enhance the user experience and safety for both drivers and passengers. In a smart cockpit, information and content can be seamlessly transmitted between various displays (such as the instrument panel, central control screen, passenger screen, and rear seat entertainment screen), enabling multi-screen interaction. Users can seamlessly switch between different screens, making operation more convenient and intuitive.
[0003] However, when implementing multi-screen interaction such as screen sharing, it is usually necessary to pair the two screens before the content of the current screen can be transmitted to the target screen to achieve content sharing. Therefore, the current level of intelligence in multi-screen interaction is not high, resulting in a poor user experience. Summary of the Invention
[0004] The problem addressed by this invention is how to optimize the multi-screen interaction experience.
[0005] To address the aforementioned problems, this invention provides a screen-flying interaction method, device, electronic device, and storage medium.
[0006] In a first aspect, the present invention provides a screen-flying interaction method applied to terminal devices, wherein at least two of the terminal devices are connected to a cloud, and the cloud deploys a cloud instance, the screen-flying interaction method comprising:
[0007] The interactive operations on the display screen of the current terminal device are identified, and the application to be screen-flying and the target terminal device of the screen-flying are determined based on the identification results. The current terminal device and the target terminal device are bound to the same cloud instance. The current terminal device is any one of at least two terminal devices, and the target terminal device is any one of at least two terminal devices other than the current terminal device.
[0008] The status data of the application to be launched is sent to the cloud so that the cloud can push the application to be launched to the target terminal device through the cloud instance after receiving the status data.
[0009] Optionally, the step of recognizing interactive operations on the display screen of the current terminal device and determining the application to be used for screen sharing in the current terminal device and the target terminal device for screen sharing based on the recognition result includes:
[0010] The interactive operation on the display screen of the current terminal device is identified. When the interactive operation is a first touch gesture, the application to be flipped is determined according to the first touch gesture, and the application to be flipped is adjusted to a state that can move with the touch gesture.
[0011] When the application to be launched is in a state that can move with touch gestures, the interactive operation on the display screen of the current terminal device is identified again. When the interactive operation is a second touch gesture, the target terminal device is determined according to the second touch gesture.
[0012] Optionally, recognizing the interactive operation on the display screen of the current terminal device, and when the interactive operation is a first touch gesture, determining the application to be used for screen sharing based on the first touch gesture includes:
[0013] Identify the touch points on the display screen of the current terminal device;
[0014] When the number of touch points meets the preset requirement and the touch points slide, the interactive operation on the display screen of the current terminal device is determined to be the first touch gesture, the application corresponding to the touch point is determined to be the application to be launched, and / or the application currently displayed on the display screen of the current terminal device is determined to be the application to be launched.
[0015] Optionally, the step of recognizing the interactive operation on the display screen of the current terminal device again, and when the interactive operation is a second touch gesture, determining the target terminal device based on the second touch gesture includes:
[0016] Identify the touch points on the display screen of the current terminal device;
[0017] When the touch point selects the application to be launched that is in a state that can move with the touch gesture, and the touch point moves, the target terminal device is determined according to the end position of the touch point, or the target terminal device is determined according to the moving direction and moving speed of the touch point.
[0018] Optionally, determining the target terminal device based on the end position of the touch point includes:
[0019] When the end position of the touch point is located in a target area on the display screen of the current terminal device, and the touch point stays in the target area for more than a first preset time, the terminal device corresponding to the target area is determined as the target terminal device. Here, at least two target areas are deployed on the display screen of the current terminal device, and at least two target areas correspond one-to-one with at least two terminal devices.
[0020] Optionally, determining the target terminal device based on the movement direction and speed of the touch point includes:
[0021] When the moving speed of the touch point meets the preset speed requirement and the moving direction is a preset moving direction, the terminal device corresponding to the preset moving direction is determined to be the target terminal device. The touch point has at least two preset moving directions on the display screen of the current terminal device, and each preset moving direction corresponds to one terminal device.
[0022] Optionally, the screen-flying interaction method further includes: when the application to be screen-flyed is in a state that can move with touch gestures, and the touch point is located on the display screen of the current terminal device in the area corresponding to the application to be screen-flyed and the dwell time exceeds a second preset duration, determining that the touch point selects the application to be screen-flyed in a state that can move with touch gestures.
[0023] Secondly, the present invention provides a screen-flying interaction device applied to terminal devices, wherein at least two of the terminal devices are connected to a cloud, and the cloud deploys a cloud instance; the screen-flying interaction device includes:
[0024] The first module is used to identify interactive operations on the display screen of the current terminal device, and determine the application to be screen-flying in the current terminal device and the target terminal device to be screen-flying based on the identification result. The current terminal device and the target terminal device are bound to the same cloud instance, and the current terminal device is any one of at least two terminal devices.
[0025] The second module is used to send the status data of the application to be launched to the cloud, so that the cloud can push the application to be launched to the target terminal device through the cloud instance after receiving the status data.
[0026] Thirdly, the present invention provides an electronic device, including a memory and a processor;
[0027] The memory is used to store computer programs;
[0028] The processor is configured to implement the screen-flying interaction method as described in the first aspect when executing the computer program.
[0029] Fourthly, the present invention provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the screen-flying interaction method as described in the first aspect.
[0030] The beneficial effects of the screen-flying interaction method of the present invention are as follows: by recognizing the interactive operation on the display screen of the current terminal device, the application to be screen-flying and the target terminal device to be screen-flying in the current terminal device are determined. Since the target terminal device and the current terminal device are bound to the same cloud instance, the application to be screen-flying can be directly pushed to the target terminal device through the cloud instance, realizing screen-flying sharing of applications such as navigation and music, avoiding device pairing every time an application screen-flying is performed, and effectively improving the multi-screen linkage experience. Attached Figure Description
[0031] Figure 1 This is a flowchart illustrating the screen-flying interaction method according to an embodiment of the present invention;
[0032] Figure 2 This is a schematic diagram illustrating the process of recognizing interactive operations on the display screen of a current terminal device according to an embodiment of the present invention;
[0033] Figure 3 This is a schematic diagram illustrating the process of determining the application to be displayed based on a first touch gesture according to an embodiment of the present invention;
[0034] Figure 4 This is a schematic diagram of the process of determining the target terminal device based on the second touch gesture according to an embodiment of the present invention;
[0035] Figure 5 This is a system architecture diagram of the flying screen interactive device according to an embodiment of the present invention;
[0036] Figure 6 This is a system architecture diagram of an electronic device according to an embodiment of the present invention. Detailed Implementation
[0037] To make the above-mentioned objects, features, and advantages of the present invention more apparent and understandable, specific embodiments of the present invention will be described in detail below with reference to the accompanying drawings. Although some embodiments of the present invention are shown in the drawings, it should be understood that the present invention can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present invention. It should be understood that the accompanying drawings and embodiments of the present invention are for illustrative purposes only and are not intended to limit the scope of protection of the present invention.
[0038] It should be understood that the various steps described in the method embodiments of the present invention may be performed in different orders and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present invention is not limited in this respect.
[0039] The term "comprising" and its variations as used herein are open-ended, meaning "including but not limited to"; the term "based on" means "at least partially based on"; the term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments"; and the term "optionally" means "optional embodiments". Definitions of other terms will be given in the following description. It should be noted that the concepts of "first," "second," etc., mentioned in this invention are used only to distinguish different devices, modules, or units, and are not intended to limit the order of functions performed by these devices, modules, or units or their interdependencies.
[0040] It should be noted that the terms "a" and "a plurality of" used in this invention are illustrative rather than restrictive. Those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".
[0041] The names of the messages or information exchanged between the multiple devices in the embodiments of the present invention are for illustrative purposes only and are not intended to limit the scope of these messages or information.
[0042] like Figure 1 As shown in the figure, an embodiment of the present invention provides a screen-flying interaction method, applied to terminal devices, wherein at least two terminal devices are connected to the cloud, and the cloud deploys a cloud instance. The screen-flying interaction method includes:
[0043] S100: Identify the interactive operations on the display screen of the current terminal device, and determine the application to be screen-flying and the target terminal device of the screen-flying based on the identification result. The current terminal device and the target terminal device are bound to the same cloud instance. The current terminal device is any one of at least two terminal devices, and the target terminal device is any one of at least two terminal devices other than the current terminal device.
[0044] Specifically, the flying screen interaction method in this embodiment is applied to terminal devices, such as various terminal devices in a smart cockpit (vehicle screen, passenger screen, etc.), as well as user terminals such as mobile phones and tablets brought by users. Each terminal device can be connected to the cloud, where cloud instances are deployed. The cloud instances can create virtual screens corresponding to the terminal devices. When a user operates on the display screen of the current terminal device (which is already connected to the cloud), the current terminal device recognizes the interactive operation, determines the application to be flying screen in the current terminal device, and the target terminal device to be flying screen. The target terminal device must be bound to the same cloud instance as the current terminal device.
[0045] Each terminal device can establish a connection with cloud instance resources through the middle platform, and the cloud can push streams to each terminal device. By deploying the application's operation, interaction, and resource consumption in the cloud, the requirements for vehicle hardware performance can be reduced.
[0046] In this context, cloud instances typically refer to independent computing units that run in the cloud.
[0047] S200: Send the status data of the application to be launched to the cloud, so that after receiving the status data, the cloud will push the application to be launched to the target terminal device through the cloud instance.
[0048] Specifically, the current terminal device sends the status data of the application to be shared to the cloud. After receiving the status data, the cloud pushes the application to be shared to the target terminal device through a cloud instance to achieve application sharing. For example, the video application on the car screen can be shared to the rear seat entertainment screen, and the rear passengers can watch movies or videos synchronized with the car screen on the rear seat entertainment screen, thereby effectively improving the multi-screen interaction experience.
[0049] In this embodiment, by recognizing the interactive operations on the display screen of the current terminal device, the application to be shared on the current terminal device and the target terminal device to be shared are determined. Since the target terminal device and the current terminal device are bound to the same cloud instance, the application to be shared can be directly pushed to the target terminal device through the cloud instance, realizing the sharing of applications such as navigation and music. This avoids the need for device pairing every time an application is shared, effectively improving the multi-screen linkage experience.
[0050] Optionally, the step of recognizing interactive operations on the display screen of the current terminal device and determining the application to be used for screen sharing in the current terminal device and the target terminal device for screen sharing based on the recognition result includes:
[0051] S110: Recognize the interactive operation on the display screen of the current terminal device. When the interactive operation is a first touch gesture, determine the application to be flipped based on the first touch gesture, and adjust the application to be flipped to a state that can move with the touch gesture.
[0052] Specifically, in combination Figure 2 As shown, taking interactive operation as a touch gesture as an example, the first touch gesture can be a three-finger swipe or other gestures. When a three-finger swipe is performed, the application corresponding to the touch point can be identified as the application to be screened, or the application currently displayed on the screen of the current terminal device can be identified as the application to be screened. At the same time, the application to be screened is adjusted to a state that can move with the touch gesture, such as switching from the initial state to the collapsed state, so that the user can clearly perceive the screen-screening process of the application to be screened.
[0053] In addition to touch gestures, users can also use air gestures and other methods as interactive operation methods.
[0054] S120: When the application to be launched is in a state that can move with touch gestures, the interactive operation on the display screen of the current terminal device is identified again. When the interactive operation is a second touch gesture, the target terminal device is determined according to the second touch gesture.
[0055] Specifically, in combination Figure 2 As shown, when the application to be screen-flying is in a state that can move with touch gestures, the interactive operation on the display screen of the current terminal device is recognized again. Taking the interactive operation as a touch gesture as an example, the second touch gesture can be a three-finger swipe to the target area, and the target terminal device is determined according to the terminal device corresponding to the target area, or it can be a three-finger swipe quickly in a certain direction, and the terminal device corresponding to the swipe direction is determined as the target terminal device.
[0056] In this optional embodiment, after determining the application to be screen-flying based on the first touch gesture, the target terminal device is determined based on the second touch gesture, which increases the user's operability and effectively improves the multi-screen linkage experience.
[0057] Optionally, recognizing the interactive operation on the display screen of the current terminal device, and when the interactive operation is a first touch gesture, determining the application to be used for screen sharing based on the first touch gesture includes:
[0058] S111: Identify the touch points on the display screen of the current terminal device.
[0059] Specifically, in combination Figure 3 As shown, when a user performs a touch operation on the display screen of the current terminal device, the touch points of the user on the display screen of the current terminal device are identified, thereby determining the number of touch points, the initial position, and the end position, etc.
[0060] The end position of the touch point can refer to the position where the touch point leaves the current screen, or it can refer to the position where the touch point stops swiping.
[0061] S112: When the number of touch points meets the preset number requirement and the touch points slide, determine the interactive operation on the display screen of the current terminal device as the first touch gesture, determine the application corresponding to the touch point as the application to be screen-flying, and / or determine the application currently displayed on the display screen of the current terminal device as the application to be screen-flying.
[0062] Specifically, in combination Figure 3As shown, for example, when a user slides three fingers to the right side of the current terminal device's display screen, the interaction is the first touch gesture. The application corresponding to the touch point can be identified as the application to be screened, or the application currently displayed on the current terminal device's display screen can be identified as the application to be screened.
[0063] In this optional embodiment, the touch points of the user on the display screen of the current terminal device are identified, and the application corresponding to the touch point is determined as the application to be screen-flyed, or the application currently displayed on the display screen of the current terminal device is determined as the application to be screen-flyed. This can accurately identify the application to be screen-flyed, thereby enabling the corresponding screen-flying control.
[0064] Optionally, the step of recognizing the interactive operation on the display screen of the current terminal device again, and when the interactive operation is a second touch gesture, determining the target terminal device based on the second touch gesture includes:
[0065] S121: Identify the touch points on the display screen of the current terminal device.
[0066] Specifically, in combination Figure 4 As shown, when a user performs a touch operation on the display screen of the current terminal device, the touch points of the user on the display screen of the current terminal device are identified, thereby determining the number of touch points, the initial position, and the end position, etc.
[0067] S122: When the touch point selects the application to be launched that is in a state that can move with the touch gesture, and the touch point moves, the target terminal device is determined according to the end position of the touch point, or the target terminal device is determined according to the moving direction and moving speed of the touch point.
[0068] Specifically, in combination Figure 4 As shown, when the application to be screen-flyed moves with the touch point, the target terminal device can be determined based on the end position of the touch point, or based on the moving direction and speed of the touch point.
[0069] In this optional embodiment, the touch points of the user on the display screen of the current terminal device are identified, and the target terminal device is determined according to the end position of the touch point, or according to the moving direction and moving speed of the touch point. This can accurately identify the target terminal device and thus realize the corresponding screen-flying control.
[0070] Optionally, determining the target terminal device based on the end position of the touch point includes:
[0071] When the end position of the touch point is located in a target area on the display screen of the current terminal device, and the touch point stays in the target area for more than a first preset time, the terminal device corresponding to the target area is determined as the target terminal device. Here, at least two target areas are deployed on the display screen of the current terminal device, and at least two target areas correspond one-to-one with at least two terminal devices.
[0072] Specifically, if the target area on the display screen of the current terminal device is divided into target area A, target area B and target area C, if the touch point stays in target area A for more than a first preset time (e.g. 2s), the terminal device corresponding to target area A is determined as the target terminal device.
[0073] In this optional embodiment, the target terminal device is determined based on the target area where the touch point stays, which can accurately identify the target terminal device and thus realize the corresponding screen-flying control.
[0074] Optionally, determining the target terminal device based on the movement direction and speed of the touch point includes:
[0075] When the moving speed of the touch point meets the preset speed requirement and the moving direction is a preset moving direction, the terminal device corresponding to the preset moving direction is determined to be the target terminal device. The touch point has at least two preset moving directions on the display screen of the current terminal device, and each preset moving direction corresponds to one terminal device.
[0076] Specifically, when the touch point slides quickly (the movement speed meets the preset speed requirement), the terminal device corresponding to the preset movement direction of the touch point is designated as the target terminal device. For example, if the current terminal device is the vehicle screen and the preset movement direction is to the right, then the passenger screen located to the right of the vehicle screen is designated as the target terminal device.
[0077] Among them, the relationship between other preset movement directions and terminal devices can be set according to the actual situation. For example, the vehicle screen + right side = passenger screen, and the vehicle screen + bottom side = rear seat entertainment screen.
[0078] In this optional embodiment, the terminal device corresponding to the preset movement direction of the touch point is the target terminal device, which can realize fast screen flying.
[0079] Optionally, the screen-flying interaction method further includes: when the application to be screen-flyed is in a state that can move with touch gestures, and the touch point is located on the display screen of the current terminal device in the area corresponding to the application to be screen-flyed and the dwell time exceeds a second preset duration, determining that the touch point selects the application to be screen-flyed in a state that can move with touch gestures.
[0080] Specifically, when the application to be screened is in a state that can be moved with touch gestures, and the touch point is located on the display screen of the current terminal device in the area corresponding to the application to be screened and stays for more than a second preset time (e.g., 2 seconds), it is determined that the touch point selects the application to be screened that is in a state that can be moved with touch gestures.
[0081] In this optional embodiment, the touch point is selected to select the application to be swiped, which is in a state that can be moved with touch gestures. This makes it easier to move the application to be swiped to determine the target terminal device, thereby enabling the corresponding swiping control.
[0082] like Figure 5 As shown in the figure, an embodiment of the present invention provides a screen-flying interaction device 500, which is applied to terminal devices. At least two of the terminal devices are connected to the cloud, and the cloud deploys a cloud instance. The screen-flying interaction device 500 includes:
[0083] The first module 510 is used to identify interactive operations on the display screen of the current terminal device, and determine the application to be screen-flying and the target terminal device of the screen-flying based on the identification result. The current terminal device and the target terminal device are bound to the same cloud instance. The current terminal device is any one of at least two terminal devices, and the target terminal device is any one of at least two terminal devices other than the current terminal device.
[0084] The second module 520 is used to send the status data of the application to be launched to the cloud, so that the cloud can push the application to be launched to the target terminal device through the cloud instance after receiving the status data.
[0085] like Figure 6 As shown, an electronic device 600 provided in this embodiment of the invention includes a memory 620 and a processor 610; the memory 620 is used to store a computer program; the processor 610 is used to implement the screen-flying interaction method as described above when the computer program is executed.
[0086] Alternatively, an electronic device 600 includes a memory 620 and a processor 610 coupled to the memory 620; the memory 620 is configured to store a computer program; and the processor 610 is configured to perform the following operations when the computer program is executed:
[0087] The interactive operations on the display screen of the current terminal device are identified, and the application to be screen-flying and the target terminal device of the screen-flying are determined based on the identification results. The current terminal device and the target terminal device are bound to the same cloud instance. The current terminal device is any one of at least two terminal devices, and the target terminal device is any one of at least two terminal devices other than the current terminal device.
[0088] The status data of the application to be launched is sent to the cloud so that the cloud can push the application to be launched to the target terminal device through the cloud instance after receiving the status data.
[0089] This invention provides a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, it implements the screen-flying interaction method described above.
[0090] Alternatively, a non-volatile computer-readable storage medium storing a computer program that, when executed by a processor, causes the processor to perform the following operations:
[0091] The interactive operations on the display screen of the current terminal device are identified, and the application to be screen-flying and the target terminal device of the screen-flying are determined based on the identification results. The current terminal device and the target terminal device are bound to the same cloud instance. The current terminal device is any one of at least two terminal devices, and the target terminal device is any one of at least two terminal devices other than the current terminal device.
[0092] The status data of the application to be launched is sent to the cloud so that the cloud can push the application to be launched to the target terminal device through the cloud instance after receiving the status data.
[0093] Electronic device 600, which can serve as a server or client of the present invention, is described below as an example of a hardware device applicable to various aspects of the present invention. Electronic device 600 is intended to represent various forms of digital electronic computer devices, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. Electronic device 600 can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.
[0094] Electronic device 600 includes a computing unit that can perform various appropriate actions and processes based on a computer program stored in read-only memory (ROM) or a computer program loaded from a storage unit into random access memory (RAM). The RAM may also store various programs and data required for device operation. The computing unit, ROM, and RAM are interconnected via a bus. Input / output (I / O) interfaces are also connected to the bus.
[0095] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. The storage medium can be a magnetic disk, optical disk, read-only memory (ROM), or random access memory (RAM), etc. In this application, the units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of the embodiments of the present invention according to actual needs. Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated units can be implemented in hardware or as software functional units.
[0096] While the present invention has been disclosed above, its scope of protection is not limited thereto. Those skilled in the art can make various changes and modifications without departing from the spirit and scope of the present invention, and all such changes and modifications will fall within the scope of protection of the present invention.
Claims
1. A screen-flying interaction method, characterized in that, The flying screen interaction method is applied to terminal devices, at least two of which are connected to a cloud, and the cloud deploys a cloud instance. The interactive operations on the display screen of the current terminal device are identified, and the application to be screen-flying and the target terminal device of the screen-flying are determined based on the identification results. The current terminal device and the target terminal device are bound to the same cloud instance. The current terminal device is any one of at least two terminal devices, and the target terminal device is any one of at least two terminal devices other than the current terminal device. The status data of the application to be launched is sent to the cloud, so that the cloud, upon receiving the status data, pushes the application to be launched to the target terminal device through the cloud instance; The application to be launched and the target terminal device are determined by touch gestures; The target terminal device is determined by the end position of the touch point, specifically including: when the end position of the touch point is located in a target area on the display screen of the current terminal device, and the touch point stays in the target area for more than a first preset time, the terminal device corresponding to the target area is determined as the target terminal device; The cloud instance is an independent computing unit running in the cloud.
2. The screen-flying interaction method according to claim 1, characterized in that, The step of recognizing interactive operations on the display screen of the current terminal device and determining the application to be screen-flying and the target terminal device to be screen-flying based on the recognition result includes: The interactive operation on the display screen of the current terminal device is identified. When the interactive operation is a first touch gesture, the application to be flipped is determined according to the first touch gesture, and the application to be flipped is adjusted to a state that can move with the touch gesture. When the application to be launched is in a state that can move with touch gestures, the interactive operation on the display screen of the current terminal device is identified again. When the interactive operation is a second touch gesture, the target terminal device is determined according to the second touch gesture.
3. The screen-flying interaction method according to claim 2, characterized in that, The step of recognizing the interactive operation on the display screen of the current terminal device, and when the interactive operation is a first touch gesture, determining the application to be displayed based on the first touch gesture includes: Identify the touch points on the display screen of the current terminal device; When the number of touch points meets the preset requirement and the touch points slide, the interactive operation on the display screen of the current terminal device is determined to be the first touch gesture, the application corresponding to the touch point is determined to be the application to be launched, and / or the application currently displayed on the display screen of the current terminal device is determined to be the application to be launched.
4. The screen-flying interaction method according to claim 2, characterized in that, The step of recognizing the interactive operation on the display screen of the current terminal device again, and when the interactive operation is a second touch gesture, determining the target terminal device based on the second touch gesture includes: Identify the touch points on the display screen of the current terminal device; When the touch point selects the application to be launched that is in a state that can move with the touch gesture, and the touch point moves, the target terminal device is determined according to the end position of the touch point, or the target terminal device is determined according to the moving direction and moving speed of the touch point.
5. The screen-flying interaction method according to claim 4, characterized in that, The display screen of the current terminal device has at least two target areas deployed, and the at least two target areas correspond one-to-one with the at least two terminal devices.
6. The screen-flying interaction method according to claim 4, characterized in that, Determining the target terminal device based on the moving direction and moving speed of the touch point includes: When the moving speed of the touch point meets the preset speed requirement and the moving direction is a preset moving direction, the terminal device corresponding to the preset moving direction is determined to be the target terminal device. The touch point has at least two preset moving directions on the display screen of the current terminal device, and each preset moving direction corresponds to one terminal device.
7. The screen-flying interaction method according to claim 4, characterized in that, Also includes: When the application to be launched is in a state that can be moved with touch gestures, and the touch point is located on the display screen of the current terminal device in the area corresponding to the application to be launched and the dwell time exceeds the second preset time, it is determined that the touch point selects the application to be launched that is in a state that can be moved with touch gestures.
8. A screen-flying interactive device, characterized in that, Applied to terminal devices, at least two of the terminal devices are connected to a cloud, and the cloud deploys a cloud instance; the flying screen interaction device includes: The first module is used to identify interactive operations on the display screen of the current terminal device, and determine the application to be screen-flying and the target terminal device of the screen-flying based on the identification result. The current terminal device and the target terminal device are bound to the same cloud instance. The current terminal device is any one of at least two terminal devices, and the target terminal device is any one of at least two terminal devices other than the current terminal device. The second module is used to send the status data of the application to be launched to the cloud, so that the cloud can push the application to be launched to the target terminal device through the cloud instance after receiving the status data; The application to be launched and the target terminal device are determined by touch gestures; The target terminal device is determined by the end position of the touch point, specifically including: when the end position of the touch point is located in a target area on the display screen of the current terminal device, and the touch point stays in the target area for more than a first preset time, the terminal device corresponding to the target area is determined as the target terminal device; The cloud instance is an independent computing unit running in the cloud.
9. An electronic device, characterized in that, Including memory and processor; The memory is used to store computer programs; The processor is configured to implement the screen-flying interaction method as described in any one of claims 1 to 7 when executing the computer program.
10. A computer-readable storage medium, characterized in that, The storage medium stores a computer program, which, when executed by a processor, implements the screen-flying interaction method as described in any one of claims 1 to 7.
Citation Information
Patent Citations
In-vehicle touch screen flying interaction method
CN109992193A
Multi-screen content sharing method
CN115801745A