Equipment control method and device, equipment and storage medium

Abstract

The invention provides an equipment control method and device, equipment and a storage medium, and relates to the technical field of Internet, in particular to intelligent communication, equipment interconnection and data processing technologies. According to the specific implementation scheme, a main control device sends a Bluetooth connection request to a terminal device, the terminal device allows the main control device to perform touch control on the terminal device based on Bluetooth adaptation information, after the main control device is successfully connected with the terminal device, a target touch instruction is generated based on a preset touch rule in response to user operation, and the target touch instruction is sent to the terminal device. And the main control device sends the target touch instruction to the terminal device, and the terminal device synchronously executes the specified operation on the display interface and the display interface of the main control device based on the target touch instruction. Through the method, touch full-coverage control of the main control equipment on the terminal equipment is realized, the user experience is improved, the delay is reduced, and high synchronization between the two pieces of equipment is realized.

Description

Technical Field

[0001] The present disclosure relates to intelligent communication, device interconnection, and data processing technology in the field of Internet technology, and in particular to a device control method, apparatus, device, and storage medium. Background Art

[0002] With the rapid development of technologies such as mobile Internet, Internet of Things, cloud computing, and big data, the interconnection and data transmission between devices have become more efficient and convenient. For example, with the development of intelligence, people have higher and higher requirements for in-vehicle interconnection technology. In order to improve driving safety and intelligence, people connect the car computer with the terminal device through a specific connection method, so that the driver can view and operate the mobile phone content on the in-vehicle screen.

[0003] Nowadays, in order to control terminal devices through the car computer, the car computer and the terminal can be interconnected through a USB connection. However, this method cannot realize the car computer operation control terminal operation. In order to realize the car computer operation control terminal operation, the car computer and the terminal can be connected through USB or wireless connection, and then with the authorization of the terminal manufacturer and the terminal application, simple car computer operation control terminal operation can be realized.

[0004] However, the above method has limitations on the terminals and applications that can be controlled by the vehicle computer, and cannot achieve full coverage of terminal control. Summary of the invention

[0005] The present disclosure provides a method, apparatus, device and storage medium for controlling a device.

[0006] According to a first aspect of the present disclosure, there is provided a device control method, comprising:

[0007] The main control device sends a Bluetooth connection request to the terminal device, wherein the Bluetooth connection request includes pre-configured Bluetooth adaptation information, and the Bluetooth adaptation information is used to indicate that the terminal device allows the main control device to perform touch control on the terminal device;

[0008] After the master device is successfully connected to the terminal device, in response to the user operation, based on a preset touch rule, the target touch instruction is generated, wherein the touch rule is generated based on the display interface information of the master device and the display interface information of the terminal device, and is used to convert the touch operation of the master device into a synchronous touch operation of the terminal device;

[0009] The target touch control instruction is sent to the terminal device, so that the terminal device implements a synchronous designated operation with the main control device on the display interface according to the target touch control instruction on the display interface.

[0010] According to a second aspect of the present disclosure, there is provided a device control method, comprising:

[0011] Receiving a Bluetooth connection request sent by a master control device, wherein the Bluetooth connection request includes pre-configured Bluetooth adaptation information;

[0012] Based on the Bluetooth adaptation information, allowing the main control device to perform touch control on the terminal device;

[0013] After successfully connecting to the master device via Bluetooth, receiving a target touch command sent by the master device;

[0014] Based on the target touch instruction, a designated operation is synchronously performed on the display interface and the display interface of the main control device.

[0015] According to a third aspect of the present disclosure, there is provided a device control apparatus, comprising:

[0016] A first sending unit, configured for the main control device to send a Bluetooth connection request to the terminal device, wherein the Bluetooth connection request includes pre-configured Bluetooth adaptation information, and the Bluetooth adaptation information is used to indicate that the terminal device allows the main control device to perform touch control on the terminal device;

[0017] a generating unit, configured to generate the target touch control instruction in response to the user operation based on a preset touch control rule after the master control device is successfully connected to the terminal device, wherein the touch control rule is generated based on the display interface information of the master control device and the display interface information of the terminal device, and is configured to convert the touch control operation of the master control device into a synchronous touch control operation of the terminal device;

[0018] The second sending unit is used to send the target touch control instruction to the terminal device, so that the terminal device can implement the synchronous designated operation with the main control device on the display interface according to the target touch control instruction on the display interface.

[0019] According to a fourth aspect of the present disclosure, there is provided a device control apparatus, comprising:

[0020] A first receiving unit, configured to receive a Bluetooth connection request sent by a master control device, wherein the Bluetooth connection request includes pre-configured Bluetooth adaptation information;

[0021] A processing unit, configured to allow the main control device to perform touch control on the terminal device based on the Bluetooth adaptation information;

[0022] A second receiving unit, configured to receive a target touch control instruction sent by the master control device after successfully connecting to the master control device via Bluetooth;

[0023] An execution unit is used to synchronously execute a specified operation on a display interface and a display interface of the main control device based on the target touch instruction.

[0024] According to a fifth aspect of the present disclosure, a main control device is provided, including:

[0025] at least one processor; and

[0026] a memory and a display connected in communication with the at least one processor; wherein,

[0027] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method described in the first aspect.

[0028] According to a sixth aspect of the present disclosure, a terminal device is provided, including:

[0029] at least one processor; and

[0030] a memory and a display connected in communication with the at least one processor; wherein,

[0031] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method described in the second aspect.

[0032] According to a seventh aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to cause the computer to execute the method described in any one of the aspects.

[0033] According to an eighth aspect of the present disclosure, a computer program product is provided, the computer program product comprising: a computer program, the computer program is stored in a readable storage medium, at least one processor of a main control device and a terminal device can read the computer program from the readable storage medium, and the at least one processor executes the computer program so that the main control device executes the method described in the first aspect and the terminal device executes the method described in the second aspect.

[0034] The technology disclosed in the present invention solves the problem of a master control device controlling terminal devices more conveniently and efficiently.

[0035] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present disclosure.

[0037] Figure 1 is a system architecture diagram that can implement the device control method of the embodiment of the present disclosure;

[0038] Figure 2 A schematic diagram of a flow chart of a device control method provided in the first embodiment of the present disclosure;

[0039] Figure 3 A schematic diagram of a flow chart of a device control method provided in the second embodiment of the present disclosure;

[0040] Figure 4 A schematic diagram of a flow chart of a device control method provided in the third embodiment of the present disclosure;

[0041] Figure 5 A schematic diagram of a flow chart of a device control method provided in the fourth embodiment of the present disclosure;

[0042] Figure 6 A schematic diagram of a flow chart of a device control method provided in the fifth embodiment of the present disclosure;

[0043] Figure 7 A structural block diagram of a device control device provided in an embodiment of the present disclosure;

[0044] Figure 8 A structural block diagram of another device control device provided in an embodiment of the present disclosure;

[0045] Fig. 9 is a block diagram of a main control device used to implement the device control method of the embodiment of the present disclosure;

[0046] Fig.10 It is a block diagram of a terminal device used to implement the device control method of an embodiment of the present disclosure. DETAILED DESCRIPTION

[0047] The following is a description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0048] In the related technologies, with the rapid development of technologies such as mobile Internet, Internet of Things, cloud computing, and big data, the interconnection and data transmission between devices have become more efficient and convenient. For example, with the development of intelligence, people have higher and higher requirements for in-vehicle interconnection technology. In order to improve the safety and intelligence of driving, people connect the car computer with the terminal device through a specific connection method, so that the driver can view and operate the mobile phone content on the in-vehicle screen. Nowadays, in order to be able to control the terminal device through the car computer, the car computer and the terminal can be connected through a USB connection. However, this method cannot realize the operation of the car computer to control the terminal operation. In order to realize the operation of the car computer to control the terminal operation, the car computer and the terminal can be connected through USB or wireless connection, and then under the authorization of the terminal manufacturer and the authorization of the terminal application, simple car computer operation control terminal operation can be realized. However, the above method has limitations on the terminals and applications that can be controlled by the car computer, and it is impossible to achieve full coverage of terminal control.

[0049] In response to this existing problem, the technical conception process of the present invention is as follows: When studying vehicle-mounted interconnection, the inventor found that the existing method of vehicle-mounted interconnection is to project the application to the vehicle computer through a specified system and connection method after the application opens permissions, thereby achieving control. However, applications that do not open permissions cannot be controlled synchronously, which has limitations. Therefore, the inventor considers whether it is possible to introduce Bluetooth HID host services in the vehicle-mounted system so that the vehicle computer can actively serve as the host of the HID device rather than a traditional slave device. Allow the vehicle computer to send touch commands to the mobile phone to simulate the user's touch operation on the mobile phone. This allows the vehicle computer to fully control any mobile phone application.

[0050] It should be noted that in the technical solution of the present disclosure, the collection, storage, use, processing, transmission, provision and disclosure of user personal information involved are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0051] Figure 1 is a system architecture diagram that can implement the device control method of the embodiment of the present disclosure, such as Figure 1 As shown, the system includes a vehicle computer and a mobile phone, wherein the vehicle computer and the mobile phone can be connected to each other through Bluetooth, and then through the Bluetooth connection channel, the mobile phone display interface can be controlled through the vehicle computer display interface.

[0052] In addition to being able to directly control the display interface through the screen, the mobile phone can also receive control from external devices, such as game controllers, mice, keyboards, etc. In order to be able to control any mobile phone application through the car screen, the car screen can be connected through the software protocol and converted into a Bluetooth touchpad to achieve arbitrary control of the mobile phone system.

[0053] Specifically, the Bluetooth HID host service is introduced into the vehicle system, so that the vehicle computer can actively act as the host of the HID device, rather than the traditional slave device. This allows the vehicle computer to send touch commands to the mobile phone, simulating the user's touch operation on the mobile phone.

[0054] It should be noted that the above-mentioned car machine and mobile phone are only examples that can implement the solution of this embodiment. In actual application, the main control device can be any electronic device that can realize touch operation and can configure Bluetooth HID host service, such as a tablet computer, other smart phones, etc. Similarly, the terminal device (mobile phone) can be a smart phone, tablet computer, etc., which can configure Bluetooth HID service.

[0055] The present invention discloses a device control method, apparatus, equipment and storage medium, which are applied to intelligent communication, device interconnection and data processing technology in the field of Internet technology. A main control device and a terminal device are connected by Bluetooth communication, and according to pre-configured touch rules, the main control device can achieve full coverage control of the terminal device, breaking the limitation of the prior art that only a specified system and a USB connection method device can be controlled.

[0056] The following specific embodiments are used to describe in detail the technical solution of the present invention and how the technical solution of the present invention solves the above-mentioned technical problems. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present invention will be described below in conjunction with the accompanying drawings.

[0057] The specific implementation scheme of the device control method provided by the present disclosure is introduced below.

[0058] Figure 2 A schematic diagram of a flow chart of a device control method provided in the first embodiment of the present disclosure, Figure 3 The device control method shown in the figure can be configured as a device control apparatus, which can be located in a main control device or a terminal device. It can include the following steps:

[0059] S201: The master device sends a Bluetooth connection request to the terminal device.

[0060] S202: The terminal device allows the main control device to perform touch control on the terminal device based on the Bluetooth adaptation information.

[0061] In order to realize the touch control of any terminal device by the master control device, the master control device performs Bluetooth configuration, configures it as a Bluetooth HID service, follows the standard Bluetooth HID protocol, and sends a Bluetooth connection request to the terminal device to be controlled. The Bluetooth connection request includes pre-configured Bluetooth adaptation information, which is used to indicate that the terminal device allows the master control device to perform touch control on the terminal device.

[0062] Specifically, the master device supports and enables the Bluetooth HID service. And configures Bluetooth HID-related parameters and settings in the operating system or firmware of the master device. These Bluetooth adaptation information are used to indicate the terminal device in the Bluetooth connection request, allowing the master device to control it by touch. The Bluetooth adaptation information may include the device's name, address, service type, characteristic value, etc., which helps the terminal device identify and respond to the connection request from the master device.

[0063] S203: After the main control device is successfully connected to the terminal device, in response to the user operation, a target touch control instruction is generated based on a preset touch control rule.

[0064] In this step, in order to achieve full coverage of the touch control of the terminal device by the main control device, after the main control device completes the Bluetooth configuration and successfully connects to the terminal device, it monitors the user operation in real time, and responds to the user operation. According to the pre-set touch rules, it generates target touch instructions, wherein the touch rules are generated based on the display interface information of the main control device and the display interface information of the terminal device, and are used to convert the touch operation of the main control device into the synchronous touch operation of the terminal device.

[0065] Specifically, the user operation is converted into a touch signal, based on the touch signal, a touch instruction for the main control device is generated, and then according to the touch rule, the touch instruction is converted into a target touch instruction, that is, a touch instruction that instructs the terminal device to operate synchronously.

[0066] Exemplarily, take the car computer as the main control device and the mobile phone as the terminal device as an example. When the car computer and the mobile phone are connected via Bluetooth, the user touches the display interface of the car computer display screen, thereby generating a touch command, which is then converted into a target control command to control the touch of the mobile phone according to the touch rules.

[0067] S204: The main control device sends a target touch control instruction to the terminal device.

[0068] S205: The terminal device executes a designated operation synchronously on the display interface and the display interface of the main control device based on the target touch instruction.

[0069] After the master device generates the target touch command, it sends the target touch command to the terminal device via the Bluetooth HID protocol. After the terminal device receives the touch command sent by the master device via the Bluetooth interface, it analyzes the touch command and executes the operation specified in the touch command synchronously on the display interface and the display interface of the master device.

[0070] For example, the car computer is the main control device and the mobile phone is the terminal device. When the user clicks on any position on the car computer display interface, the car computer detects the coordinates of the user's click, and then converts the coordinates of the click on the car computer into the coordinates of the click on the mobile phone display interface based on the touch control rules, and then packages them into target touch control instructions and sends them to the mobile phone. After receiving them, the mobile phone parses them to obtain the click operation and the click coordinates. If the coordinates on the mobile phone display interface correspond to the position of application 1, the click instruction is transmitted to application 1, and application 1 starts the program in response to the click instruction. Open the main interface of application 1, and at the same time, the car computer display screen will also synchronously display the main interface of application 1.

[0071] Optionally, when the main control device controls the terminal device, the terminal device can project the display interface onto the display screen of the main control device, or it may not project. As long as the function of controlling the terminal device is turned on, the main control device will display the control area that can control the terminal device, and all touch operations of the user in this area can realize the control of the terminal device.

[0072] In one possible implementation, the touch control rule may be a set of coordinate mapping rules generated based on the display interface information of the master device and the terminal device. This set of rules defines how to convert the touch coordinates (X, Y) on the master device into the corresponding touch coordinates (X', Y') on the terminal device.

[0073] In order to more accurately control the elements on the terminal device, the touch rule may also include an element recognition mechanism, that is, when the user touches a specific element on the main control device, the system can recognize the corresponding element of the element on the terminal device.

[0074] Optionally, considering the difference in screen size and resolution between the host device and the terminal device, the touch rule can also include a scaling adaptation mechanism. This allows the system to automatically adjust the scaling of touch coordinates according to the screen ratio and resolution, ensuring the accuracy of touch operations and the consistency of element layout.

[0075] When a terminal device (such as a mobile phone) is in landscape or portrait mode, the touch rules also need to be able to recognize this change and adjust the coordinate mapping rules accordingly to ensure that the touch operation remains accurate on the rotated screen.

[0076] For example, suppose the user is using a navigation system. At this point, the phone is placed on a car holder and may be in landscape or portrait mode depending on driving needs or user habits. When the phone screen is in portrait mode, the touch coordinates (X, Y) on the car screen will be directly mapped according to the resolution and layout of the phone screen. For example, if the user clicks a button on the car screen, the coordinates (X, Y) of the button will be directly converted to the corresponding coordinates on the phone screen, and the corresponding click operation will be performed.

[0077] When the phone screen is rotated to landscape mode, the mapping of touch coordinates becomes more complicated. Because the screen resolution and layout in landscape mode are different from those in portrait mode, simple coordinate conversion may result in inaccurate touch operations.

[0078] In order to achieve rotation adaptation, the touch rules need to be updated in the following way:

[0079] Detecting screen rotation: First, the system needs to detect that the phone screen has been rotated to landscape mode. This is usually achieved through a screen orientation sensor or an API provided by the operating system.

[0080] Adjust coordinate mapping rules: Once screen rotation is detected, the system needs to immediately adjust the coordinate mapping rules. This includes recalculating the mapping relationship of touch coordinates based on the screen resolution and layout in landscape mode.

[0081] Execute touch operations: Finally, the system accurately maps the touch operations on the car screen to the corresponding positions on the mobile phone screen according to the adjusted coordinate mapping rules, and performs the corresponding operations.

[0082] In another possible implementation, in addition to basic click and slide operations, touch rules can also include gesture recognition. For example, the user can perform specific gestures on the car screen, and the system converts these gestures into complex operations or commands on the terminal device.

[0083] Customized operations: Allow users to set customized touch operations on the car screen according to personal habits or specific needs. These customized operations can be associated with specific functions or applications on the terminal device to improve the convenience and personalization of operations.

[0084] For elements that change dynamically on the terminal device (such as scrolling lists, animation effects, etc.), touch rules should include dynamic element tracking. Allow the system to track the position and status of these elements in real time, and adjust the coordinate mapping rules as needed to ensure the accuracy of touch operations. In addition to position synchronization, touch rules should also consider the synchronization of element states. For example, when a user clicks on an interactive element on the car screen, the system should ensure that the corresponding element on the terminal device is also in an interactive state and respond correctly to the user's operation.

[0085] For example, in an in-car entertainment system, the user is using a music application on a mobile phone and controlling it through the car screen. The playlist in the music application is a dynamic interface element because it scrolls and updates as the songs are played. When the user selects a song in the playlist on the car screen, the system first determines the specific position of the song in the playlist (including its coordinates on the screen and its index in the list) through the element recognition mechanism.

[0086] Subsequently, the system starts the dynamic element tracking mechanism to monitor the scrolling and updating of the playlist in real time. This usually involves monitoring the position of the playlist scroll bar, the scrolling speed, and the newly loaded song information. According to the dynamic changes of the playlist, the system dynamically adjusts the mapping relationship of the touch coordinates. For example, if the playlist scrolls down one page, the system will offset the coordinates originally clicked by the user downward by a corresponding distance to ensure that the touch operation can be accurately mapped to the corresponding position on the mobile phone screen.

[0087] The system sends the adjusted touch coordinates to the mobile phone and performs the corresponding operation (such as playing the selected song). At the same time, the system also receives feedback information from the mobile phone (such as playback status, song information, etc.) and updates the display content on the car screen in real time to keep the interface synchronized.

[0088] In another possible implementation, in scenarios that support multi-screen interaction, touch rules need to be able to handle the interaction between multiple screens. This includes identifying the association between different screens, coordinating the synchronous execution of touch operations on multiple screens, etc. For scenarios that require multiple devices or screens to work together (such as split-screen operations, multitasking, etc.), touch rules can also provide corresponding coordination mechanisms. This can ensure that users' operations on different screens or devices can be seamlessly connected and collaboratively complete complex tasks.

[0089] For example, the user is using the in-car navigation system and the mobile phone for multi-screen interaction. The in-car navigation system displays maps and navigation information, while the mobile phone is used to receive calls, check messages, etc. The system first establishes an association between the in-car navigation system and the mobile phone, and identifies their respective screens and display content. When the user performs a touch operation on the car screen (such as clicking on a location on the map to set the navigation destination), the system assigns the operation to the corresponding device or application (in this case, the in-car navigation system) according to the touch rules. At the same time, the system also monitors touch operations on the mobile phone (such as answering calls, sliding to view messages, etc.), and ensures that these operations do not conflict with operations on the car screen.

[0090] During multi-screen interaction, the system needs to ensure the coordination between various devices and applications. For example, when a user answers a call on the phone, the in-vehicle navigation system may automatically lower the volume or pause the navigation broadcast; when the user sets the navigation destination on the car screen, the phone may receive the corresponding navigation information and display it on the screen. Data synchronization is also the key to multi-screen interaction. The system needs to synchronize data between various devices and applications (such as navigation information, music playlists, etc.) in real time to ensure that users can maintain a consistent experience when switching between different screens.

[0091] In the device control method provided in this embodiment, the main control device sends a Bluetooth connection request to the terminal device, and the terminal device allows the main control device to perform touch control on the terminal device based on the Bluetooth adaptation information. After the main control device and the terminal device are successfully connected, the target touch control instruction is generated based on the preset touch control rules in response to the user operation, and the main control device sends the target touch control instruction to the terminal device. The terminal device performs the specified operation synchronously on the display interface and the display interface of the main control device based on the target touch control instruction. The above method realizes the full touch control of the terminal device by the main control device, improves the user experience, reduces the delay, and realizes the high synchronization between the two devices.

[0092] Figure 3 A schematic diagram of a device control method provided in the second embodiment of the present disclosure, referring to Figure 3 The device control method shown is different from the aforementioned embodiment in that, in this embodiment, in response to user operation, a target touch instruction is generated based on preset touch rules, which can be further refined as: in response to user operation, the user operation is converted into a touch signal, based on the touch signal, a touch instruction is generated, and according to the touch rules, the touch instruction is converted into a target touch instruction.

[0093] like Figure 3 As shown, the method comprises the following steps:

[0094] S301: The main control device responds to the user operation and converts the user operation into a touch signal.

[0095] When the user operates on the display screen of the main control device, the sensor or interface of the main control device will capture the user's operation, and the operating system or driver of the main control device will recognize the user's operation and convert it into a touch signal that the main control device can recognize. The touch signal usually includes parameters such as position, pressure, and duration.

[0096] S302: The main control device generates a touch control instruction based on the touch control signal.

[0097] The software in the master device (such as the operating system, application program, etc.) will generate corresponding touch commands according to the content of the touch signal and the current state of the master device. In order to improve the user experience and response speed, the master device can also optimize the generated touch commands, such as predicting the user's next operation, merging continuous operations, etc. For example, if the user double-clicks, the master device can recognize it as a continuous double-click command instead of a two-click command.

[0098] S303: The main control device converts the touch control instruction into a target touch control instruction according to the touch control rule.

[0099] The touch command includes the touch type, touch timestamp, touch duration and the touch coordinates corresponding to the master device. In order to realize the synchronous touch operation control of the terminal device, the touch coordinates corresponding to the master device are converted into the touch coordinates corresponding to the terminal device according to the touch rules to obtain the target touch command.

[0100] S304: The main control device sends a target touch control instruction to the terminal device.

[0101] S305: The terminal device synchronously executes the designated operation on the display interface and the display interface of the main control device based on the target touch instruction.

[0102] The specific implementation of step S304 and step S305 is the same as that in the above-mentioned embodiment, and will not be repeated here.

[0103] Optionally, the touch type includes a click type, a long press type, a slide type, and any one of any preset gesture types.

[0104] In the device control method provided in this embodiment, the main control device responds to the user operation and converts the user operation into a touch signal. The main control device generates a touch instruction based on the touch signal. The main control device converts the touch instruction into a target touch instruction according to the touch rule. The main control device sends the target touch instruction to the terminal device. The terminal device performs the specified operation on the display interface synchronously with the display interface of the main control device based on the target touch instruction.

[0105] Figure 4 A schematic diagram of a device control method provided in the third embodiment of the present disclosure, referring to Figure 4 The device control method shown is different from the aforementioned embodiment in that, in this embodiment, a touch instruction is generated based on a touch signal, which can be further refined as follows: the touch signal is analyzed to obtain the touch coordinates, touch timestamp, and touch duration corresponding to the main control device; if the touch duration is less than a preset duration threshold, the touch type is determined to be a click type; if the touch duration is greater than the duration threshold and the touch coordinates corresponding to the main control device are single coordinates, the touch type is determined to be a long press type.

[0106] like Figure 4 As shown, the method comprises the following steps:

[0107] S401: The main control device responds to the user operation and converts the user operation into a touch signal.

[0108] S402: Analyze the touch signal to obtain the touch coordinates, touch timestamp, and touch duration corresponding to the master control device.

[0109] The specific implementation of step S401 and step S402 is the same as that in the above-mentioned embodiment, and will not be repeated here.

[0110] S403: If the touch duration is less than a preset duration threshold, determine that the touch type is a click type.

[0111] In order to accurately and efficiently control the terminal device, it is crucial to determine the touch type, and the touch duration is less than the preset duration threshold. This duration threshold is usually a relatively short time, such as a few hundred milliseconds, to distinguish whether the user intends to perform a short click operation or a longer long press operation. The touch coordinates corresponding to the main control device are single coordinates. This indicates that the user touched a specific point instead of sliding or multi-touch on the screen. When the above conditions are met, the user's touch type is determined to be a click type (Tap). Click operations are usually used to select elements on the screen, activate buttons or links, etc.

[0112] Optionally, the click type may be further determined as double click or multi-click based on the touch timestamp.

[0113] Exemplarily, the time interval between the first touch and the second touch is less than a preset double-click time threshold. This time threshold is usually shorter than the long press threshold, usually within a few hundred milliseconds (such as 300 milliseconds). The locations of the two clicks should be in the same area on the screen, or at least close enough to be considered as part of the same double-click operation. That is, the coordinates of the two touches are the same, or within a preset range.

[0114] When the system detects the first touch, it starts counting down and waits for the second touch.

[0115] If a second touch is detected within the double touch time threshold and the positions of the two touches meet the preset conditions, the system determines it as a double-touch type.

[0116] If the second touch is not detected within the dual touch time threshold, or the location of the second touch does not meet the criteria, the system treats the first click as a single click type.

[0117] The judgment types of multiple clicks and double clicks will not be elaborated here.

[0118] S404: If the touch duration is greater than the duration threshold and the touch coordinates corresponding to the master device are single coordinates, determine that the touch type is a long press type.

[0119] The touch duration is longer than the preset duration threshold. In contrast to a click operation, a long press operation requires the user to continuously touch the screen for a certain period of time to trigger different behaviors or display additional options.

[0120] Similarly, the touch coordinates corresponding to the master device are single coordinates. When the above conditions are met, the system determines that the user's touch type is long press. Long press type is widely used in many applications, such as long pressing an icon on a mobile phone screen to display editing options, long pressing in a text editor to select text, etc.

[0121] S405: The main control device converts the touch control instruction into a target touch control instruction according to the touch control rule.

[0122] S406: The main control device sends a target touch control instruction to the terminal device.

[0123] S407: The terminal device performs a designated operation synchronously on the display interface and the display interface of the main control device based on the target touch instruction.

[0124] The specific implementation of step S405 to step S407 is the same as that in the above-mentioned embodiment, and will not be repeated here.

[0125] In the device control method provided in this embodiment, the main control device responds to the user operation, converts the user operation into a touch signal, analyzes the touch signal, obtains the touch coordinates, touch timestamp, and touch duration corresponding to the main control device, and if the touch duration is less than the preset duration threshold, the touch type is determined to be a click type; if the touch duration is greater than the duration threshold and the touch coordinates corresponding to the main control device are single coordinates, the touch type is determined to be a long press type, and the main control device converts the touch command into a target touch command according to the touch rule, and the main control device sends the target touch command to the terminal device, and the terminal device performs the specified operation synchronously on the display interface and the display interface of the main control device based on the target touch command. By quickly identifying and analyzing the user operation, the touch signal is converted into a touch command, and sent to the terminal device for execution in real time, the operation delay is reduced and the immediacy of the user operation is improved. The interaction efficiency is enhanced, the system stability is improved, and a more convenient, efficient and reliable human-computer interaction experience is provided to users.

[0126] Figure 5 A flow chart of a device control method provided in the fourth embodiment of the present disclosure, referring to Figure 5The device control method shown is different from the aforementioned embodiment in that, in this embodiment, the target touch instruction also includes a touch trajectory corresponding to the main control device. Based on the touch signal, a touch instruction is generated, which can be further refined as follows: if the length of the touch trajectory corresponding to the main control device is less than a preset trajectory threshold, the touch type is determined to be a sliding type; if the length of the touch trajectory corresponding to the main control device is greater than the trajectory threshold, the touch type is determined to be a gesture type.

[0127] like Figure 5 As shown, the method comprises the following steps:

[0128] S501: The main control device responds to the user operation and converts the user operation into a touch signal.

[0129] S502: Analyze the touch signal to obtain the touch coordinates, touch timestamp, and touch duration corresponding to the master control device.

[0130] S503: If the touch track length corresponding to the master control device is less than a preset track threshold, determine that the touch type is a sliding type.

[0131] A slide usually refers to a short, fast movement of the user on the screen. This operation may be used to scroll a page, switch views, or perform similar navigation functions. Since the track of a slide operation is relatively short, it can be identified by setting a shorter track threshold.

[0132] S504: If the length of the touch track corresponding to the master control device is greater than the track threshold, determine that the touch type is a gesture type.

[0133] Gesture types cover a wider range of more complex touch operations, which usually involve longer tracks and / or specific shapes and directions. Gestures can be used to perform more complex commands, trigger specific functions, or perform more sophisticated interactions. Specific gestures can be determined based on the length of the touch track, and optionally the direction of each track, as well as the shape of the overall track.

[0134] In one possible implementation, gesture recognition can also generally take into account touch speed, acceleration, direction change, the number of touch points (for multi-touch), and other factors. In addition, different applications and operating systems can define their own gesture sets and provide corresponding APIs to recognize and respond to these gestures.

[0135] S505: The main control device converts the touch control instruction into a target touch control instruction according to the touch control rule.

[0136] S506: The main control device sends a target touch control instruction to the terminal device.

[0137] S507: The terminal device executes a designated operation synchronously on the display interface and the display interface of the main control device based on the target touch instruction.

[0138] In the device control method provided in this embodiment, the main control device responds to the user operation, converts the user operation into a touch signal, analyzes the touch signal, obtains the touch coordinates, touch timestamp, and touch duration corresponding to the main control device, and if the length of the touch track corresponding to the main control device is less than the preset track threshold, the touch type is determined to be a sliding type, and the main control device converts the touch command into a target touch command according to the touch rule, and the main control device sends the target touch command to the terminal device. The terminal device performs the specified operation synchronously on the display interface and the display interface of the main control device based on the target touch command. The above method accurately identifies the touch type, which not only improves the interaction fluency, expands the interaction mode, and improves the operation accuracy, but also realizes synchronous display and operation and optimizes the user experience.

[0139] Figure 6 A flow chart of a device control method provided in the fifth embodiment of the present disclosure, referring to Figure 6 The device control method shown is different from the aforementioned embodiment in that, in this embodiment, the Bluetooth adapter can also be initialized, the connectable devices can be monitored and scanned, a pairing request can be sent to the terminal device, and based on the connection agreement message fed back by the terminal device, the Bluetooth connection can be completed with the terminal device, and the display interface information sent by the terminal device can be received through the Bluetooth HID protocol.

[0140] like Figure 6 As shown, the method comprises the following steps:

[0141] S601: Initialize the Bluetooth adapter.

[0142] S602: The master device monitors and scans for connectable devices, and sends a Bluetooth connection request to the terminal device.

[0143] S603: The terminal device opens the touch control channel based on the Bluetooth connection request and generates a connection consent message.

[0144] S604: The terminal device sends a connection approval message to the main control device.

[0145] S605: The main control device completes the Bluetooth connection with the terminal device based on the connection consent message fed back by the terminal device.

[0146] In order to achieve full coverage touch control of the terminal device by the main control device, the main control device can be adapted to Bluetooth, and then the Bluetooth HID host service can be introduced in the main control device, so that the main control device can actively serve as the host of the HID device. After the adaptation is completed, the device scan is performed, using the startDiscovery() method of BluetoothAdapter or the startScan() method of BluetoothLeScanner for connectable devices to start the scan. During the scan, the scanned device information can be received through the callback interface. In the scan results, the HID device can be identified by checking the Bluetooth Class of the device. For example, check whether the device class is BluetoothClass.Device.PERIPHERAL_KEYBOARD, etc.

[0147] Select the HID device to be connected as the terminal device in the scan results, and then send a pairing request. After the terminal device receives the pairing request sent by the master device, it prompts the user to process the request through the terminal device's display interface or prompt sound. The user can choose to confirm or refuse. After the user chooses to confirm, the terminal device opens the touch control channel, generates a connection consent message and feeds it back to the master device to complete the Bluetooth pairing. After the connection is successful, the master device and the terminal device can communicate through the Bluetooth HID protocol.

[0148] S606: Receive display interface information sent by the terminal device through the Bluetooth HID protocol.

[0149] In order to realize touch control of the terminal device through the Bluetooth HID protocol, the main control device also needs to set touch rules. The touch rules need to be set based on the display interface information of the terminal device. The terminal device receives the display interface information sent by the terminal device through the Bluetooth HID protocol.

[0150] The device control method provided in this embodiment initializes the Bluetooth adapter, the main control device listens and scans for connectable devices, sends a pairing request to the terminal device, the terminal device generates a connection consent message based on the pairing request and responds to the user operation, the terminal device sends the connection consent message to the main control device, the main control device completes the Bluetooth connection with the terminal device based on the connection consent message fed back by the terminal device, and receives the display interface information sent by the terminal device through the Bluetooth HID protocol. Through the above method, the convenience and security are improved, the flexibility and efficiency of the connection are also improved, and the compatibility of the device and the user experience are optimized.

[0151] Figure 7 A structural block diagram of a device control device provided in an embodiment of the present disclosure, referring to Figure 7The device control device 700 shown includes the following units:

[0152] The first sending unit 701 is used for the main control device to send a Bluetooth connection request to the terminal device. The Bluetooth connection request includes pre-configured Bluetooth adaptation information. The Bluetooth adaptation information is used to instruct the terminal device to allow the main control device to perform touch control on the terminal device.

[0153] A generating unit 702 is used to generate a target touch control instruction based on a preset touch control rule in response to a user operation after the master device completes the Bluetooth configuration and successfully connects to the terminal device, wherein the touch control rule is generated based on the display interface information of the master device and the display interface information of the terminal device, and is used to convert the touch control operation of the master device into a synchronous touch control operation of the terminal device;

[0154] The second sending unit 703 is used to send a target touch control instruction to the terminal device, so that the terminal device can implement a synchronous designated operation with the main control device on the display interface according to the target touch control instruction.

[0155] Optionally, the generating unit 702 includes:

[0156] A first conversion module, configured to respond to a user operation and convert the user operation into a touch signal;

[0157] A generation module, used to generate a touch command based on the touch signal, the touch command including a touch type, a touch timestamp, a touch duration, and a touch coordinate corresponding to the master control device;

[0158] The second conversion module is used to convert the touch instruction into a target touch instruction according to the touch rule, where the target touch instruction includes a touch type, a touch timestamp, a touch duration, and touch coordinates corresponding to the terminal device.

[0159] In a possible implementation, the touch type includes any one of a click type, a long press type, a slide type, and any preset gesture type.

[0160] In another possible implementation, the generation module includes:

[0161] The analysis submodule is used to analyze the touch signal to obtain the touch coordinates, touch timestamp, and touch duration corresponding to the main control device;

[0162] A first determination submodule, configured to determine that the touch type is a click type if the touch duration is less than a preset duration threshold;

[0163] The second determination submodule is used to determine that the touch type is a long press type if the touch duration is greater than a duration threshold and the touch coordinates corresponding to the main control device are single coordinates.

[0164] Optionally, the generation module also includes:

[0165] A third determination submodule, configured to determine that the touch type is a sliding type if the length of the touch track corresponding to the master control device is less than a preset track threshold;

[0166] The fourth determination submodule is used to determine that the touch type is a gesture type if the length of the touch track corresponding to the main control device is greater than the track threshold.

[0167] In a possible design, the device control apparatus 700 further includes:

[0168] A connection unit 704 is configured to complete a Bluetooth connection with the terminal device based on a connection consent message fed back by the terminal device;

[0169] The third sending unit 705 is used to receive the display interface information sent by the terminal device through the Bluetooth HID protocol.

[0170] Figure 8 A structural block diagram of another device control device provided in the embodiment of the present disclosure, referring to Figure 8 The device control device 800 shown includes the following units:

[0171] The first receiving unit 801 is used to receive a Bluetooth connection request sent by a master control device, where the Bluetooth connection request includes pre-configured Bluetooth adaptation information;

[0172] The processing unit 802 is used to allow the main control device to perform touch control on the terminal device based on the Bluetooth adaptation information;

[0173] The second receiving unit 803 is used to receive the target touch control instruction sent by the main control device after the main control device successfully connects to the Bluetooth;

[0174] The execution unit 804 is used to synchronously execute a specified operation on the display interface and the display interface of the main control device based on the target touch instruction.

[0175] Optionally, the device control apparatus 800 further includes:

[0176] A generating unit 805 is used to open a touch control channel and generate a connection consent message based on a Bluetooth connection request;

[0177] A first sending unit 806 is configured to send a connection approval message to a master control device;

[0178] The second sending unit 807 is used to send the display interface information to the main control device through the Bluetooth HID protocol after the terminal device and the main control device are successfully connected to each other through Bluetooth.

[0179] According to an embodiment of the present disclosure, the present disclosure also provides a main control device, a terminal device, a readable storage medium and a computer program product.

[0180] According to an embodiment of the present disclosure, the present disclosure also provides a computer program product, which includes: a computer program, the computer program is stored in a readable storage medium, at least one processor of a main control device and a terminal device can read the computer program from the readable storage medium, and at least one processor executes the computer program so that the main control device and the terminal device execute the solution provided by any of the above embodiments.

[0181] Fig. 9 A schematic block diagram of an example master control device 900 that can be used to implement an embodiment of the present disclosure is shown. The master control device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workbenches, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The master control device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0182] like Fig. 9 As shown, the main control device 900 includes a computing unit 901, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 902 or a computer program loaded from a storage unit 908 into a random access memory (RAM) 903. In the RAM 903, various programs and data required for the operation of the device 900 can also be stored. The computing unit 901, the ROM 902, and the RAM 903 are connected to each other via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0183] A number of components in the device 900 are connected to the I / O interface 905, including: an input unit 906, such as a keyboard, a mouse, etc.; an output unit 907, such as various types of displays, speakers, etc.; a storage unit 908, such as a disk, an optical disk, etc.; and a communication unit 909, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 909 allows the device 900 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0184] The computing unit 901 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 901 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 901 performs the various methods and processes described above, such as method device control. For example, in some embodiments, the method device control may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 908. In some embodiments, part or all of the computer program may be loaded and / or installed on the main control device 900 via ROM 902 and / or communication unit 909. When the computer program is loaded into RAM 903 and executed by the computing unit 901, one or more steps of the method device control described above may be performed. Alternatively, in other embodiments, the computing unit 901 may be configured to perform method device control in any other appropriate manner (e.g., by means of firmware).

[0185] Fig.10 A schematic block diagram of an example terminal device 1000 that can be used to implement an embodiment of the present disclosure is shown. The terminal device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workbenches, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The terminal device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0186] like Fig.10 As shown, the terminal device 1000 includes a computing unit 1001, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 1002 or a computer program loaded from a storage unit 1008 into a random access memory (RAM) 1003. In the RAM 1003, various programs and data required for the operation of the device 1000 can also be stored. The computing unit 1001, the ROM 1002, and the RAM 1003 are connected to each other via a bus 1004. An input / output (I / O) interface 1005 is also connected to the bus 1004.

[0187] A number of components in the device 1000 are connected to the I / O interface 1005, including: an input unit 1006, such as a keyboard, a mouse, etc.; an output unit 1007, such as various types of displays, speakers, etc.; a storage unit 1008, such as a disk, an optical disk, etc.; and a communication unit 1009, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 1009 allows the device 1000 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0188] The computing unit 1001 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 1001 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 1001 performs the various methods and processes described above, such as method device control. For example, in some embodiments, the method device control may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 1008. In some embodiments, part or all of the computer program may be loaded and / or installed on the terminal device 1000 via ROM 1002 and / or communication unit 1009. When the computer program is loaded into RAM 1003 and executed by the computing unit 1001, one or more steps of the method device control described above may be performed. Alternatively, in other embodiments, the computing unit 1001 may be configured to perform method device control in any other appropriate manner (e.g., by means of firmware).

[0189] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0190] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0191] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0192] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0193] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.

[0194] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship between the client and the server is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services ("Virtual Private Server", or "VPS" for short). The server may also be a server of a distributed system, or a server combined with a blockchain.

[0195] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this document does not limit this.

[0196] The above specific implementations do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. A device control method, comprising: The main control device sends a Bluetooth connection request to the terminal device, wherein the Bluetooth connection request includes pre-configured Bluetooth adaptation information, and the Bluetooth adaptation information is used to indicate that the terminal device allows the main control device to perform touch control on the terminal device; After the master device is successfully connected to the terminal device, in response to a user operation, a target touch instruction is generated based on a preset touch rule, wherein the touch rule is generated based on the display interface information of the master device and the display interface information of the terminal device, and is used to convert the touch operation of the master device into a synchronous touch operation of the terminal device; The target touch control instruction is sent to the terminal device, so that the terminal device implements a synchronous designated operation with the main control device on the display interface according to the target touch control instruction on the display interface.

2. The method according to claim 1, wherein: In response to the user operation, a target touch instruction is generated based on a preset touch rule, including: In response to the user operation, converting the user operation into a touch signal; Generate a touch command based on the touch signal, wherein the touch command includes a touch type, a touch timestamp, a touch duration, and a touch coordinate corresponding to the master control device; According to the touch rule, the touch instruction is converted into the target touch instruction, where the target touch instruction includes the touch type, the touch timestamp, the touch duration, and the touch coordinates corresponding to the terminal device.

3. The method according to claim 2, wherein: The touch type includes any one of a click type, a long press type, a slide type, and any preset gesture type.

4. The method according to claim 3, wherein: Generating a touch command based on the touch signal includes: Analyze the touch signal to obtain the touch coordinates, the touch timestamp, and the touch duration corresponding to the master control device; If the touch duration is less than a preset duration threshold, determining that the touch type is the click type; If the touch duration is greater than the duration threshold and the touch coordinates corresponding to the master control device are single coordinates, it is determined that the touch type is the long press type.

5. The method according to claim 4, wherein the target touch instruction includes a touch track corresponding to the master control device, and further comprising: If the touch track length corresponding to the master control device is less than a preset track threshold, determining that the touch type is the sliding type; If the touch track length corresponding to the master control device is greater than the track threshold, the touch type is determined to be the gesture type.

6. The method according to claim 1, further comprising: Based on the connection consent message fed back by the terminal device, completing the Bluetooth connection with the terminal device; The display interface information sent by the terminal device is received through the Bluetooth HID protocol.

7. A device control method, comprising: Receiving a Bluetooth connection request sent by a master control device, wherein the Bluetooth connection request includes pre-configured Bluetooth adaptation information; Based on the Bluetooth adaptation information, allowing the main control device to perform touch control on the terminal device; After successfully connecting to the master device via Bluetooth, receiving a target touch command sent by the master device; Based on the target touch instruction, a designated operation is synchronously performed on the display interface and the display interface of the main control device.

8. The method according to claim 7, further comprising: Based on the Bluetooth connection request, opening a touch control channel and generating a connection consent message; Sending the connection approval message to the main control device; After the terminal device and the main control device are successfully connected via Bluetooth, display interface information is sent to the main control device via the Bluetooth HID protocol.

9. A device control apparatus, comprising: A first sending unit, configured for the main control device to send a Bluetooth connection request to the terminal device, wherein the Bluetooth connection request includes pre-configured Bluetooth adaptation information, and the Bluetooth adaptation information is used to indicate that the terminal device allows the main control device to perform touch control on the terminal device; a generating unit, configured to generate a target touch control instruction in response to a user operation based on a preset touch control rule after the master control device is successfully connected to the terminal device, wherein the touch control rule is generated based on the display interface information of the master control device and the display interface information of the terminal device, and is configured to convert the touch control operation of the master control device into a synchronous touch control operation of the terminal device; The second sending unit is used to send the target touch control instruction to the terminal device, so that the terminal device can implement the synchronous designated operation with the main control device on the display interface according to the target touch control instruction on the display interface.

10. The device according to claim 9, wherein: The generating unit comprises: A first conversion module, configured to convert the user operation into a touch signal in response to the user operation; A generating module, configured to generate a touch instruction based on the touch signal, wherein the touch instruction includes a touch type, a touch timestamp, a touch duration, and a touch coordinate corresponding to the master control device; The second conversion module is used to convert the touch instruction into the target touch instruction according to the touch rule, and the target touch instruction includes the touch type, the touch timestamp, the touch duration and the touch coordinates corresponding to the terminal device.

11. The device according to claim 10, wherein: The touch type includes any one of a click type, a long press type, a slide type, and any preset gesture type.

12. The device according to claim 11, wherein The generating module comprises: An analysis submodule, used to analyze the touch signal to obtain the touch coordinates, the touch timestamp, and the touch duration corresponding to the master control device; A first determination submodule, configured to determine that the touch type is the click type if the touch duration is less than a preset duration threshold; The second determination submodule is used to determine that the touch type is the long press type if the touch duration is greater than the duration threshold and the touch coordinates corresponding to the main control device are single coordinates.

13. The device according to claim 12, wherein: The generating module further includes: A third determination submodule, configured to determine that the touch type is the sliding type if the touch track length corresponding to the master control device is less than a preset track threshold; The fourth determination submodule is configured to determine that the touch type is the gesture type if the touch track length corresponding to the master control device is greater than the track threshold.

14. The apparatus according to claim 9, further comprising: A connecting unit, configured to complete a Bluetooth connection with the terminal device based on a connection consent message fed back by the terminal device; The third sending unit is used to receive the display interface information sent by the terminal device through the Bluetooth HID protocol.

15. A device control apparatus, comprising: A first receiving unit, configured to receive a Bluetooth connection request sent by a master control device, wherein the Bluetooth connection request includes pre-configured Bluetooth adaptation information; A processing unit, configured to allow the main control device to perform touch control on the terminal device based on the Bluetooth adaptation information; A second receiving unit, configured to receive a target touch control instruction sent by the master control device after successfully connecting to the master control device via Bluetooth; An execution unit is used to synchronously execute a specified operation on a display interface and a display interface of the main control device based on the target touch instruction.

16. The apparatus according to claim 15, further comprising: A generating unit, configured to open a touch control channel and generate a connection consent message based on the Bluetooth connection request; A first sending unit, configured to send the connection approval message to the main control device; The second sending unit is used to send display interface information to the main control device through the Bluetooth HID protocol after the terminal device and the main control device are successfully connected to each other via Bluetooth.

17. A main control device, comprising: at least one processor; as well as a memory and a display connected in communication with the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 6.

18. A terminal device, comprising: at least one processor; as well as a memory and a display connected in communication with the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 7 to 8.

19. A non-transitory computer-readable storage medium storing computer instructions, wherein: The computer instructions are used to cause the computer to execute the method according to any one of claims 1-8.

20. A computer program product, comprising a computer program, which implements the steps of the method according to any one of claims 1 to 8 when executed by a processor.

Images