Control component matching control method and device, electronic equipment and storage medium
By identifying the interactive operation of the initial terminal device and sending status data to the cloud, the automatic matching connection between the control components and the target terminal device is realized, solving the problem of long matching time of the control components in the smart cockpit and improving the user experience.
Patent Information
- Application Number
- CN202411534622.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-31
- Publication Date
- 2025-03-11
AI Technical Summary
In the smart cockpit, users need to manually reconnect the control components (such as handles) with the new terminal device, resulting in a long operation time and affecting the user experience.
By identifying the interactive operation of the initial terminal device, determining the application to be flying and the target terminal device and sending status data to the cloud, the automatic matching connection between the control components and the target terminal device is realized.
It realizes that the control components are automatically matched to the target terminal device after applying the flying screen, reducing manual operation time and improving user experience.
Smart Images

Figure CN119597688A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of smart cockpits, and in particular to a control method, device, electronic device and storage medium for controlling matching of control components. Background Art
[0002] Smart cockpits are usually composed of instrument panels, head-up displays, car screens, and front and rear seat entertainment systems. By integrating a variety of advanced technologies and equipment, they can improve the user experience and safety of drivers and passengers. In a smart cockpit, users can connect control components such as handles to the car screen via Bluetooth, and then play games on the car screen and other screens.
[0003] However, when the user needs to switch screens to play games, the controller needs to be reconnected to the new terminal device in the car settings in order to match the controller to the new terminal device, which takes a long time and affects the user's gaming progress, resulting in a poor user experience. Summary of the invention
[0004] The problem solved by the present invention is how to quickly achieve matching between a control component such as a handle and a new terminal device.
[0005] In order to solve the above problems, the present invention provides a control method, device, electronic device and storage medium for controlling matching of control components.
[0006] In a first aspect, the present invention provides a control method for matching a control component, comprising:
[0007] In response to the application startup operation, connecting the control component to the initial terminal device where the application is currently located;
[0008] When the application is transferred from the initial terminal device to the target terminal device, the control component is connected to the target terminal device.
[0009] Optionally, before the application is displayed from the initial terminal device to the target terminal device, the control component matching control method further includes:
[0010] Identify the interactive operation on the display screen of the initial terminal device, and determine the application to be screened in the initial terminal device and the target terminal device to be screened according to the identification result;
[0011] The status data of the application to be screened is sent to the cloud, so that the cloud pushes the application to be screened to the target terminal device through the cloud instance after receiving the status data.
[0012] Optionally, the identifying the interactive operation on the display screen of the initial terminal device, and determining the application to be screened in the initial terminal device and the target terminal device to be screened according to the identification result includes:
[0013] Identifying the interactive operation on the display screen of the initial terminal device, and when the interactive operation is a first touch gesture, determining the application to be screen-flying according to the first touch gesture, and adjusting the application to be screen-flying to a state that can be moved with the touch gesture;
[0014] When the flying screen application is in a state where it can be moved with a touch gesture, the interactive operation on the display screen of the initial terminal device is identified again. When the interactive operation is a second touch gesture, the target terminal device is determined according to the second touch gesture.
[0015] Optionally, the identifying the interactive operation on the display screen of the initial terminal device, when the interactive operation is a first touch gesture, determining the to-be-screened application according to the first touch gesture includes:
[0016] Identifying a touch point on a display screen of the initial terminal device;
[0017] When the number of touch points meets the preset number requirement and the touch points slide, the interactive operation on the display screen of the initial terminal device is determined to be the first touch gesture, the application corresponding to the touch point is determined to be the application to be displayed on the screen, and / or the application currently displayed on the display screen of the initial terminal device is determined to be the application to be displayed on the screen.
[0018] Optionally, the identifying the interactive operation on the display screen of the initial terminal device again, when the interactive operation is a second touch gesture, determining the target terminal device according to the second touch gesture includes:
[0019] Identifying a touch point on a display screen of the initial terminal device;
[0020] When the touch point selects the to-be-flying screen application that is in a state that can move with a touch gesture, and the touch point moves, the target terminal device is determined according to the end position of the touch point, or the target terminal device is determined according to the moving direction and speed of the touch point.
[0021] Optionally, determining the target terminal device according to the end position of the touch point includes:
[0022] When the end position of the touch point is located in a target area on the display screen of the initial terminal device, and the touch point stays in the target area for more than a first preset time, the terminal device corresponding to the target area is determined as the target terminal device, wherein at least two of the target areas are deployed on the display screen of the initial terminal device, and at least two of the target areas correspond one-to-one to at least two of the terminal devices.
[0023] Optionally, determining the target terminal device according to the moving direction and moving speed of the touch point includes:
[0024] When the moving speed of the touch point meets the preset speed requirement and the moving direction is a preset moving direction, the terminal device corresponding to the preset moving direction is determined to be the target terminal device, wherein the touch point has at least two preset moving directions on the display screen of the initial terminal device, and each preset moving direction corresponds to one terminal device.
[0025] Optionally, when the application is transferred from the initial terminal device to the target terminal device, connecting the control component to the target terminal device includes:
[0026] When the application is transferred from the initial terminal device to the target terminal device, callback information is generated, wherein the callback information includes an initial screen code, a target screen code and an application code;
[0027] Unbinding the control component from the initial terminal device according to the initial screen code;
[0028] The control component is connected to the target terminal device according to the target screen code and the application code.
[0029] In a second aspect, the present invention provides a control device for matching a control component, comprising:
[0030] The first module is used to connect the control component to the initial terminal device where the application is currently located in response to the application startup operation;
[0031] The second module is used to connect the control component with the target terminal device when the application is transferred from the initial terminal device to the target terminal device.
[0032] In a third aspect, the present invention provides an electronic device, including a memory and a processor;
[0033] The memory is used to store computer programs;
[0034] The processor is used to implement the control component matching control method as described in the first aspect when executing the computer program.
[0035] In a fourth aspect, the present invention provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the control component matching control method as described in the first aspect is implemented.
[0036] The beneficial effect of the control component matching control method of the present invention is: when the application is started, the control component is connected to the initial terminal device where the application is currently located. When the application flies from the initial terminal device to the target terminal device, the binding between the control component and the initial terminal device is disconnected and re-matched to the target terminal device, so that the application located on the target terminal device can be controlled through the control component. The entire process does not require manual reconnection of the control component and the target terminal device. After the application flies to the screen, the control component matching can be automatically transferred, which effectively improves the user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0037] Figure 1 A schematic diagram of a flow chart of a control component matching control method according to an embodiment of the present invention;
[0038] Figure 2 A schematic diagram of the flying screen interaction process of an embodiment of the present invention;
[0039] Figure 3 A schematic diagram of a process of identifying an interactive operation on a display screen of an initial terminal device according to an embodiment of the present invention;
[0040] Figure 4 It is a schematic diagram of a process of determining a to-be-screened application according to a first touch gesture according to an embodiment of the present invention;
[0041] Figure 5 This is a schematic diagram of a process of determining a target terminal device according to a second touch gesture according to an embodiment of the present invention;
[0042] Figure 6 A schematic diagram of a flow chart of connecting a control component and a target terminal device according to an embodiment of the present invention;
[0043] Figure 7 A system architecture diagram of a control component matching control device according to an embodiment of the present invention;
[0044] Figure 8 4 is a system architecture diagram of an electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION
[0045] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the specific embodiments of the present invention are described in detail below in conjunction with the accompanying drawings. Although certain embodiments of the present invention are shown in the accompanying drawings, it should be understood that the present invention can be implemented in various forms and should not be interpreted as being limited to the embodiments described herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present invention. It should be understood that the drawings and embodiments of the present invention are only for exemplary purposes and are not intended to limit the scope of protection of the present invention.
[0046] It should be understood that the various steps described in the method embodiments of the present invention may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present invention is not limited in this respect.
[0047] The term "including" and its variations used in this document are open inclusions, that is, "including but not limited to"; the term "based on" means "based at least in part on"; the term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one other embodiment"; the term "some embodiments" means "at least some embodiments"; the term "optionally" means "optional embodiments". The relevant definitions of other terms will be given in the following description. It should be noted that the concepts of "first", "second", etc. mentioned in the present invention are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.
[0048] It should be noted that the modifications of "one" and "plurality" mentioned in the present invention are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise clearly indicated in the context, it should be understood as "one or more".
[0049] The names of the messages or information exchanged between multiple devices in the embodiments of the present invention are only used for illustrative purposes, and are not used to limit the scope of these messages or information.
[0050] like Figure 1 As shown, an embodiment of the present invention provides a control method for matching a control component, comprising:
[0051] S100: In response to an application startup operation, connecting a control component to an initial terminal device where the application is currently located.
[0052] Specifically, the user can search and connect the control components (such as a handle, keyboard, and mouse, etc.) in the vehicle computer. When the control component is successfully connected, the user can use the control component; when the application is started, for example, when the user opens the application on the vehicle screen (i.e., the initial terminal device), the control component automatically connects to the vehicle screen, that is, the control component is matched with the vehicle screen, so that the control component can control the application on the vehicle screen. The connection between the control component and the terminal device can be a wireless connection.
[0053] S200: When the application is transferred from the initial terminal device to the target terminal device, the control component is connected to the target terminal device.
[0054] Specifically, the user can operate on the display screen of the initial terminal device to fly the running application to the target terminal device, disconnect the control component from the initial terminal device, and re-match it to the target terminal device, so that the application on the target terminal device can be controlled through the control component. For example, the game application on the car screen can be flew to the rear seat entertainment screen, and the rear passengers can play the game on the rear seat entertainment screen through the handle, which effectively improves the user experience.
[0055] In this embodiment, when the application is started, the control component is connected to the initial terminal device where the application is currently located. When the application flies from the initial terminal device to the target terminal device, the binding between the control component and the initial terminal device is disconnected and re-matched to the target terminal device, so that the application located on the target terminal device can be controlled through the control component. The entire process does not require manual reconnection of the control component and the target terminal device. After the application flies to the screen, the matching transfer of the control component can be automatically realized, which effectively improves the user experience.
[0056] Optionally, before the application is displayed from the initial terminal device to the target terminal device, the control component matching control method further includes:
[0057] S110: Identify the interactive operation on the display screen of the initial terminal device, and determine the application to be displayed on the initial terminal device and the target terminal device to be displayed on the initial terminal device according to the identification result.
[0058] Specifically, combined Figure 2 As shown, when the user operates on the display screen of the initial terminal device (which is connected to the cloud), the initial terminal device identifies the interactive operation, determines the application to be screened in the initial terminal device and the target terminal device to be screened, and the target terminal device needs to be bound to the same cloud instance as the initial terminal device.
[0059] Among them, each terminal device can establish a connection with the cloud instance resources through the middle platform, and push the stream from the cloud to each terminal device. By deploying the operation, interaction and resource consumption of the application on the cloud, the requirements for vehicle hardware performance can be reduced.
[0060] Among them, the middle platform can receive data uploaded by each terminal device, command upload and authentication request, etc., and send the corresponding request to the cloud, and the cloud responds through the middle platform.
[0061] Among them, the cloud instance can create virtual screens corresponding to the screen information of multiple terminal devices, and push the stream to the corresponding terminal devices.
[0062] S120: Sending the status data of the application to be screened to the cloud, so that the cloud pushes the application to be screened to the target terminal device through the cloud instance after receiving the status data.
[0063] Specifically, combined Figure 2 As shown, the initial terminal device sends the status data of the application to be screened to the cloud. After receiving the status data, the cloud pushes the application to be screened to the target terminal device through the cloud instance to realize application sharing. For example, the video application on the car screen is screened to the rear seat entertainment screen. The rear passengers can watch movies or videos synchronized with the car screen on the rear seat entertainment screen, thereby effectively improving the multi-screen linkage experience.
[0064] In this optional embodiment, the interactive operations on the display screen of the initial terminal device are identified to determine the application to be screened in the initial terminal device and the target terminal device to be screened. Since the target terminal device is bound to the same cloud instance as the initial terminal device, the application to be screened can be pushed to the target terminal device through the cloud instance, thereby realizing screen sharing of applications such as navigation, music, and games, effectively improving the multi-screen linkage experience.
[0065] Optionally, the identifying the interactive operation on the display screen of the initial terminal device, and determining the application to be screened in the initial terminal device and the target terminal device to be screened according to the identification result includes:
[0066] S111: Identify the interactive operation on the display screen of the initial terminal device. When the interactive operation is a first touch gesture, determine the application to be displayed on the screen according to the first touch gesture, and adjust the application to be displayed on the screen to be movable with the touch gesture.
[0067] Specifically, combined Figure 3As shown, taking the interactive operation as a touch gesture as an example, the first touch gesture can be a three-finger slide or other gestures. When three fingers slide, the application corresponding to the touch point can be determined as the application to be screened, or the application currently displayed on the display screen of the initial terminal device can be determined as the application to be screened. At the same time, the application to be screened is adjusted to a state that can be moved with the touch gesture, for example, switching from an initial state to a contracted state, so that the user can clearly perceive the flying process of the application to be screened.
[0068] In addition to touch gestures, users can also use air operations and other methods as a means of interactive operation.
[0069] S112: When the flying screen application is in a state where it can be moved with a touch gesture, the interactive operation on the display screen of the initial terminal device is identified again; when the interactive operation is a second touch gesture, the target terminal device is determined according to the second touch gesture.
[0070] Specifically, combined Figure 3 As shown, when the flying screen application is in a state where it can move with the touch gesture, the interactive operation on the display screen of the initial terminal device is recognized again. Taking the interactive operation as a touch gesture as an example, the second touch gesture can be a three-finger slide to the target area, and the target terminal device is determined according to the terminal device corresponding to the target area. It can also be a three-finger quick slide in a certain direction, and the terminal device corresponding to the sliding direction is determined as the target terminal device.
[0071] In this optional embodiment, after determining the application to be screened according to the first touch gesture, the target terminal device is determined according to the second touch gesture, which increases the user's operability and effectively improves the multi-screen linkage experience.
[0072] Optionally, the identifying the interactive operation on the display screen of the initial terminal device, when the interactive operation is a first touch gesture, determining the to-be-screened application according to the first touch gesture includes:
[0073] S1111: Identify touch points on the display screen of the initial terminal device.
[0074] Specifically, combined Figure 4 As shown, when the user performs a touch operation on the display screen of the initial terminal device, the touch points of the user on the display screen of the initial terminal device are identified to determine the number, initial position and end position of the touch points.
[0075] S1112: When the number of touch points meets the preset number requirement and the touch points slide, determine that the interactive operation on the display screen of the initial terminal device is the first touch gesture, determine the application corresponding to the touch point as the application to be displayed on the screen, and / or determine the application currently displayed on the display screen of the initial terminal device as the application to be displayed on the screen.
[0076] Specifically, combined Figure 4 As shown, for example, when the user uses three fingers to slide to the right side of the display screen of the initial terminal device, the interactive operation is a first touch gesture. The application corresponding to the touch point can be determined as the application to be screened, or the application currently displayed on the display screen of the initial terminal device can be determined as the application to be screened.
[0077] In this optional embodiment, the touch point of the user on the display screen of the initial terminal device is identified, and the application corresponding to the touch point is determined as the application to be displayed on the screen, or the application currently displayed on the display screen of the initial terminal device is determined as the application to be displayed on the screen, so that the application to be displayed on the screen can be accurately identified, and the corresponding display screen control can be implemented.
[0078] Optionally, the identifying the interactive operation on the display screen of the initial terminal device again, when the interactive operation is a second touch gesture, determining the target terminal device according to the second touch gesture includes:
[0079] S1121: Identify touch points on the display screen of the initial terminal device.
[0080] Specifically, combined Figure 5 As shown, when the user performs a touch operation on the display screen of the initial terminal device, the touch points of the user on the display screen of the initial terminal device are identified to determine the number, initial position and end position of the touch points.
[0081] S1122: When the touch point selects the to-be-flying screen application that is in a state that can move with a touch gesture, and the touch point moves, the target terminal device is determined according to the end position of the touch point, or the target terminal device is determined according to the moving direction and speed of the touch point.
[0082] Specifically, combined Figure 5 As shown, when the flying screen application moves with the touch point, the target terminal device can be determined according to the end position of the touch point, or according to the moving direction and moving speed of the touch point.
[0083] In this optional embodiment, the touch point of the user on the display screen of the initial terminal device is identified, and the target terminal device is determined based on the end position of the touch point, or the target terminal device is determined based on the moving direction and speed of the touch point. The target terminal device can be accurately identified, and the corresponding flying screen control can be implemented.
[0084] Optionally, determining the target terminal device according to the end position of the touch point includes:
[0085] When the end position of the touch point is located in a target area on the display screen of the initial terminal device, and the touch point stays in the target area for more than a first preset time, the terminal device corresponding to the target area is determined as the target terminal device, wherein at least two of the target areas are deployed on the display screen of the initial terminal device, and at least two of the target areas correspond one-to-one to at least two of the terminal devices.
[0086] Specifically, if the target areas on the display screen of the initial terminal device are divided into target area A, target area B and target area C, if the touch point stays in target area A for more than a first preset time (for example, 2s), the terminal device corresponding to target area A is determined as the target terminal device.
[0087] In this optional embodiment, the target terminal device is determined according to the target area where the touch point stays, so that the target terminal device can be accurately identified, and then the corresponding flying screen control can be implemented.
[0088] Optionally, determining the target terminal device according to the moving direction and moving speed of the touch point includes:
[0089] When the moving speed of the touch point meets the preset speed requirement and the moving direction is a preset moving direction, the terminal device corresponding to the preset moving direction is determined to be the target terminal device, wherein the touch point has at least two preset moving directions on the display screen of the initial terminal device, and each preset moving direction corresponds to one terminal device.
[0090] Specifically, when the touch point slides quickly (the moving speed meets the preset speed requirement), the terminal device corresponding to the preset moving direction of the touch point is the target terminal device. For example, if the initial terminal device is the car screen and the preset moving direction is right, the passenger screen located to the right of the car screen will be determined as the target terminal device.
[0091] Among them, the relationship between other preset moving directions and terminal devices can be set according to actual conditions, for example, car screen + right = co-pilot screen, car screen + bottom = rear seat entertainment screen.
[0092] In this optional embodiment, the terminal device corresponding to the preset moving direction of the touch point is set as the target terminal device, which can realize fast screen flying.
[0093] Optionally, when the application is transferred from the initial terminal device to the target terminal device, connecting the control component to the target terminal device includes:
[0094] S210: When the application is transferred from the initial terminal device to the target terminal device, callback information is generated, wherein the callback information includes an initial screen code, a target screen code, and an application code.
[0095] Specifically, combined Figure 6 As shown, when the application flies from the initial terminal device to the target terminal device, the screen switching management module will call the background interface to notify the background interface service that the switching operation has been completed. After receiving the notification, the background interface service generates a callback information, which includes the initial screen code (that is, the screen identifier of the initial terminal device), the target screen code (that is, the screen identifier of the target terminal device) and the application code (the unique identifier of the application in the system).
[0096] S220: Unbinding the control component from the initial terminal device according to the initial screen code.
[0097] Specifically, combined Figure 6 As shown, the binding between the control component and the initial terminal device is released according to the initial screen code, that is, the control component is disconnected from the initial terminal device.
[0098] S230: Connecting the control component to the target terminal device according to the target screen code and the application code.
[0099] Specifically, combined Figure 6 As shown, the connection between the control component and the target terminal device is realized according to the target screen code, and the same application is displayed on the target terminal device according to the application code.
[0100] In this optional embodiment, the binding between the control component and the initial terminal device is released according to the initial screen code, and then the connection between the control component and the target terminal device is achieved according to the target screen code. The same application is displayed on the target terminal device according to the application code, so that the application located on the target terminal device can be controlled through the control component, effectively improving the user experience.
[0101] like Figure 7 As shown, an embodiment of the present invention provides a control component matching control device 700, comprising:
[0102] The first module 710 is used to connect the control component to the initial terminal device where the application is currently located in response to the application startup operation;
[0103] The second module 720 is used to connect the control component with the target terminal device when the application is transferred from the initial terminal device to the target terminal device.
[0104] like Figure 8 As shown, an electronic device 800 provided by an embodiment of the present invention includes a memory 820 and a processor 810; the memory 820 is used to store a computer program; the processor 810 is used to implement the control method for matching control components as described above when executing the computer program.
[0105] In other words, an electronic device 800 includes a memory 820 and a processor 810 coupled to the memory 820; the memory 820 is configured to store a computer program; and the processor 810 is configured to perform the following operations when executing the computer program:
[0106] In response to the application startup operation, connecting the control component to the initial terminal device where the application is currently located;
[0107] When the application is transferred from the initial terminal device to the target terminal device, the control component is connected to the target terminal device.
[0108] An embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the control method for matching control of control components as described above is implemented.
[0109] In other words, a non-volatile computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor performs the following operations:
[0110] In response to the application startup operation, connecting the control component to the initial terminal device where the application is currently located;
[0111] When the application is transferred from the initial terminal device to the target terminal device, the control component is connected to the target terminal device.
[0112] An electronic device 800 that can be used as a server or client of the present invention will now be described, which is an example of a hardware device that can be applied to various aspects of the present invention. The electronic device 800 is intended to represent various forms of digital electronic computer equipment, such as laptop computers, desktop computers, workbenches, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device 800 can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples, and are not intended to limit the implementation of the present invention described herein and / or required.
[0113] The electronic device 800 includes a computing unit, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) or a computer program loaded from a storage unit into a random access memory (RAM). In the RAM, various programs and data required for the operation of the device can also be stored. The computing unit, ROM, and RAM are connected to each other via a bus. An input / output (I / O) interface is also connected to the bus.
[0114] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, the storage medium can be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc. In the present application, the unit described as a separate component may or may not be physically separated, and the component displayed as a unit may or may not be a physical unit, that is, it may be located in one place, or it may be distributed on multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiment of the present invention. In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
[0115] Although the present invention is disclosed as above, the protection scope of the present invention is not limited thereto. Those skilled in the art may make various changes and modifications without departing from the spirit and scope of the present invention, and these changes and modifications will fall within the protection scope of the present invention.
Claims
1. A control method for matching a control component, characterized in that: include: In response to the application startup operation, connecting the control component to the initial terminal device where the application is currently located; When the application is transferred from the initial terminal device to the target terminal device, the control component is connected to the target terminal device.
2. The control component matching control method according to claim 1, characterized in that: Before the application is transferred from the initial terminal device to the target terminal device, the application further includes: Identify the interactive operation on the display screen of the initial terminal device, and determine the application to be screened in the initial terminal device and the target terminal device to be screened according to the identification result; The status data of the application to be screened is sent to the cloud, so that the cloud pushes the application to be screened to the target terminal device through the cloud instance after receiving the status data.
3. The control component matching control method according to claim 2, characterized in that: The identifying of the interactive operation on the display screen of the initial terminal device and determining the application to be screened in the initial terminal device and the target terminal device to be screened according to the identification result include: Identifying the interactive operation on the display screen of the initial terminal device, and when the interactive operation is a first touch gesture, determining the application to be screen-flying according to the first touch gesture, and adjusting the application to be screen-flying to a state that can be moved with the touch gesture; When the flying screen application is in a state where it can be moved with a touch gesture, the interactive operation on the display screen of the initial terminal device is identified again. When the interactive operation is a second touch gesture, the target terminal device is determined according to the second touch gesture.
4. The control component matching control method according to claim 3, characterized in that: The identifying the interactive operation on the display screen of the initial terminal device, and when the interactive operation is a first touch gesture, determining the to-be-screened application according to the first touch gesture comprises: Identifying a touch point on a display screen of the initial terminal device; When the number of touch points meets the preset number requirement and the touch points slide, the interactive operation on the display screen of the initial terminal device is determined to be the first touch gesture, the application corresponding to the touch point is determined to be the application to be displayed on the screen, and / or the application currently displayed on the display screen of the initial terminal device is determined to be the application to be displayed on the screen.
5. The control component matching control method according to claim 3, characterized in that: The step of again identifying the interactive operation on the display screen of the initial terminal device, and when the interactive operation is a second touch gesture, determining the target terminal device according to the second touch gesture comprises: Identifying a touch point on a display screen of the initial terminal device; When the touch point selects the to-be-flying screen application that is in a state that can move with a touch gesture, and the touch point moves, the target terminal device is determined according to the end position of the touch point, or the target terminal device is determined according to the moving direction and speed of the touch point.
6. The control component matching control method according to claim 5, characterized in that: The determining the target terminal device according to the end position of the touch point comprises: When the end position of the touch point is located in a target area on the display screen of the initial terminal device, and the touch point stays in the target area for more than a first preset time, the terminal device corresponding to the target area is determined as the target terminal device, wherein at least two of the target areas are deployed on the display screen of the initial terminal device, and at least two of the target areas correspond one-to-one to at least two of the terminal devices.
7. The control component matching control method according to claim 5, characterized in that: The determining the target terminal device according to the moving direction and moving speed of the touch point comprises: When the moving speed of the touch point meets the preset speed requirement and the moving direction is a preset moving direction, the terminal device corresponding to the preset moving direction is determined to be the target terminal device, wherein the touch point has at least two preset moving directions on the display screen of the initial terminal device, and each preset moving direction corresponds to one terminal device.
8. The control component matching control method according to any one of claims 1 to 7, characterized in that: When the application is transferred from the initial terminal device to the target terminal device, connecting the control component to the target terminal device includes: When the application is transferred from the initial terminal device to the target terminal device, callback information is generated, wherein the callback information includes an initial screen code, a target screen code and an application code; Unbinding the control component from the initial terminal device according to the initial screen code; The control component is connected to the target terminal device according to the target screen code and the application code.
9. A control device for matching a control component, characterized in that: include: The first module is used to connect the control component to the initial terminal device where the application is currently located in response to the application startup operation; The second module is used to connect the control component with the target terminal device when the application is transferred from the initial terminal device to the target terminal device.
10. An electronic device, characterized in that: including memory and processor; The memory is used to store computer programs; The processor is used to implement the control component matching control method according to any one of claims 1 to 8 when executing the computer program.
11. A computer-readable storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is executed by a processor, the control component matching control method according to any one of claims 1 to 8 is implemented.
Citation Information
Patent Citations
Cloud game cross-terminal switching method and related device
CN112691363A
Equipment connection method, device and system
CN115703006A
Screen projection method and mobile phone
CN116708645A
Multi-screen interaction method and device, terminal equipment and vehicle
CN117492557A
Connection switching method and device of Bluetooth remote controller, equipment and medium
CN118590948A