Terminal control method, terminal control system and storage medium

Abstract

The present invention discloses a terminal control method, system and storage medium. The system further includes an access device, a server and a controlled terminal. When the method is applied to a Bluetooth headset in the system, it includes: when a voice control instruction of a user is detected, acquiring the user's ear canal information to authenticate the user; if the authentication is passed, establishing a communication connection with the access device; based on this communication connection, sending the ear canal information and the voice control instruction to the access device, so that the access device sends the ear canal information and the voice control instruction to the server, for the server to determine a target account according to the ear canal information, and control the controlled terminal corresponding to the target account to execute the operation corresponding to the voice control instruction. When the terminal is not within the communication range of the Bluetooth headset, using the access device and the server as communication relays to realize the communication between the headset and the terminal, enabling the user to control the terminal through the Bluetooth headset, ensuring the normal use of the terminal by the user, and enhancing the user experience.

Description

Technical Field

[0001] The present invention relates to the technical field of earphones, and particularly to a terminal control method, a terminal control system and a storage medium. Background Art

[0002] With the development of earphone technology, Bluetooth earphones including TWS earphones have become a part of more and more people's daily lives. Especially for TWS earphones, they are small and easy to carry. In some application scenarios, for example, when users are doing outdoor sports, in the case of inconveniently carrying devices such as mobile phones, they generally only carry earphones. It is known that earphones communicate with mobile phones via Bluetooth. When the distance between a terminal device such as a mobile phone and a user is relatively far, it will affect the communication between the earphone and the terminal. Once it exceeds the Bluetooth communication range of the earphone, communication interruption will occur, affecting the user's control and normal use of the terminal such as the mobile phone. Summary of the Invention

[0003] The main object of the present invention is to provide a terminal control method, a terminal control system and a storage medium, aiming to solve the technical problem that when the distance between a terminal and a Bluetooth earphone exceeds the Bluetooth communication range of the Bluetooth earphone in the prior art, communication interruption with the terminal occurs, affecting the user's control and use of the terminal.

[0004] In addition, to achieve the above object, the present invention also provides a terminal control method for a Bluetooth earphone applied to a terminal control system. The terminal control system further includes an access device, a server and a controlled terminal. The terminal control method includes the following steps:

[0005] When a voice control instruction of a user is detected, obtain the ear canal information of the user and authenticate the user according to the ear canal information;

[0006] If the authentication is passed, establish a communication connection with the access device;

[0007] Based on the communication connection, send the ear canal information and the voice control instruction to the access device, so that the access device sends the ear canal information and the voice control instruction to the server, for the server to determine a target account according to the ear canal information, and control the controlled terminal corresponding to the target account to execute the operation corresponding to the voice control instruction.

[0008] Optionally, the step of establishing a communication connection with the access device includes:

[0009] Send Bluetooth address information to the access device via NFC, for the access device to send a Bluetooth address detail and a pairing request according to the Bluetooth address information;

[0010] Receive the Bluetooth address details and pairing requests sent by the access device, and establish a Bluetooth communication connection with the access device according to the pairing requests.

[0011] Optionally, there are one or more access devices. When there are multiple access devices, after the step of establishing a Bluetooth communication connection with the access device according to the pairing request, the following steps are further included:

[0012] When it is detected that the communication signal strength with the access device is lower than a preset threshold, scan the signal strengths of the respective access devices corresponding to the Bluetooth address details;

[0013] Determine the target access device with the strongest signal strength, and establish a Bluetooth communication connection with the target access device.

[0014] Optionally, after the step of sending the ear canal information and the voice control instruction to the access device based on the communication connection, the following steps are further included:

[0015] Receive the target operation information corresponding to the voice control instruction returned by the access device, where the target operation information is obtained by the server through voice conversion of the returned information received from the controlled terminal according to the operation type corresponding to the voice control instruction. The returned information includes text information and voice information, and the server sends the target operation information to the access device so that the access device sends the target operation information;

[0016] Play the target operation information to the user.

[0017] In addition, to achieve the above object, the present invention further provides a terminal control method for a server applied to a terminal control system. The terminal control system further includes a Bluetooth headset, an access device, and a controlled terminal. The terminal control method includes the following steps:

[0018] Receive the voice control instruction and ear canal information sent by the access device, where the ear canal information is obtained by the Bluetooth headset when detecting the user's voice control instruction. The Bluetooth headset has a communication connection with the access device, and the Bluetooth headset authenticates the user according to the ear canal information. If the authentication is passed, the voice control instruction and the ear canal information are sent to the access device so that the access device sends the voice control instruction and the ear canal information;

[0019] Determine the target account according to the ear canal information, and control the controlled terminal corresponding to the target account to execute the operation corresponding to the voice control instruction.

[0020] Optionally, after the step of controlling the controlled terminal corresponding to the target account to execute the operation corresponding to the voice control instruction, the method further includes:

[0021] Receiving return information sent by the controlled terminal according to the operation type corresponding to the voice control instruction, where the return information includes text information and voice information;

[0022] When the return information includes text information, performing voice conversion on the text information in the return information to obtain target operation information;

[0023] Sending the target operation information to the access device, so that the access device sends the target operation information to the Bluetooth headset and plays the target operation information to the user through the Bluetooth headset.

[0024] In addition, to achieve the above object, the present invention further provides a terminal control method for a first access device applied to a terminal control system. The terminal control system further includes a Bluetooth headset, a server, and a controlled terminal. The terminal control method includes the following steps:

[0025] Establishing a communication connection with the Bluetooth headset and receiving a voice control instruction and ear canal information sent by the Bluetooth headset, where the ear canal information is obtained by the Bluetooth headset when detecting the user's voice control instruction, and the voice control instruction and the ear canal information are sent by the Bluetooth headset when the user's identity authentication is passed according to the ear canal information;

[0026] Sending the voice control instruction and the ear canal information to the server for the server to determine a target account according to the ear canal information and control the controlled terminal corresponding to the target account to execute the operation corresponding to the voice control instruction.

[0027] Optionally, the step of receiving the Bluetooth address information of the Bluetooth headset and establishing a communication connection with the Bluetooth headset includes:

[0028] Receiving the Bluetooth address information sent by the Bluetooth headset and sending a pairing request to the Bluetooth headset through NFC according to the Bluetooth address information;

[0029] Establishing a Bluetooth communication connection with the Bluetooth headset according to the pairing request.

[0030] Optionally, the first access device is communicatively connected to one or more second access devices. After the step of receiving the Bluetooth address information sent by the Bluetooth headset, the method further includes:

[0031] Detect whether there is a second access device within a preset range. If so, obtain the Bluetooth address information of the second access device and generate a Bluetooth address details including its own Bluetooth address information.

[0032] Send the Bluetooth address details to the Bluetooth headset via NFC, so that when the communication signal strength with the Bluetooth headset is lower than a preset strength threshold, the Bluetooth headset can scan the signal strengths of the access devices corresponding to the Bluetooth address details, determine the target access device with the strongest signal strength from each access device, and establish a Bluetooth communication connection with the target access device.

[0033] Optionally, after the step of sending the voice control instruction and the ear canal information to the server, the following steps are further included:

[0034] Receive the target operation information sent by the server, where the target operation information is obtained by the server through voice conversion of the received return information sent by the controlled terminal according to the operation type corresponding to the voice control instruction, and the return information includes text information and voice information.

[0035] Send the target operation information to the Bluetooth headset for the Bluetooth headset to play the target operation information to the user.

[0036] In addition, to achieve the above object, the present invention further provides a terminal control system, the terminal control system includes a Bluetooth headset, and the Bluetooth headset includes:

[0037] An ear canal recognition module, configured to obtain the user's ear canal information and authenticate the user according to the ear canal information when detecting the user's voice control instruction.

[0038] An NFC module, configured to establish a communication connection with an access device if the authentication is passed.

[0039] A Bluetooth module, configured to send the ear canal information and the voice control instruction to the access device based on the communication connection, so that the access device sends the ear canal information and the voice control instruction to the server, and the server determines a target account according to the ear canal information and controls the controlled terminal corresponding to the target account to execute the operation corresponding to the voice control instruction.

[0040] In addition, to achieve the above object, the present invention further provides a terminal device, the terminal device includes: a memory, a processor, and a terminal control program stored on the memory and executable on the processor, and when the terminal control program is executed by the processor, the steps of the above terminal control method are implemented.

[0041] In addition, to achieve the above object, the present invention also provides a computer-readable storage medium, on which a terminal control program is stored. When the terminal control program is executed by a processor, the steps of the terminal control method as described above are implemented.

[0042] A terminal control method, a terminal control system and a storage medium provided by an embodiment of the present invention. When the method is applied to a Bluetooth headset in the terminal control system, the terminal control system further includes an access device, a server and a controlled terminal. In the prior art, when a user is not convenient to carry a terminal device such as a mobile phone and only carries a Bluetooth headset, if the terminal exceeds the Bluetooth communication range of the Bluetooth headset, communication interruption will occur, affecting the control and normal use of the terminal device such as the mobile phone by the user. Based on this, in the embodiment of the present invention, when a voice control instruction of the user is detected, the ear canal information of the user is obtained and the user is authenticated according to the ear canal information; if the authentication is passed, a communication connection is established with the access device; based on the communication connection, the ear canal information and the voice control instruction are sent to the access device, so that the access device sends the ear canal information and the voice control instruction to the server for the server to determine a target account according to the ear canal information and control the controlled terminal corresponding to the target account to execute the operation corresponding to the voice control instruction. When a terminal device such as a mobile phone is not within the Bluetooth communication range of the Bluetooth headset carried by the user, based on the communication between the Bluetooth headset and the access device, and between the access device and the server, the access device and the server are used as communication relays between the controlled terminal, realizing communication between the Bluetooth headset and the controlled terminal, so that the user can control the terminal device such as the mobile phone through the Bluetooth headset, ensuring the normal use of the terminal device by the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Figure 1 It is a schematic hardware structure diagram of an implementation manner of a terminal device provided by an embodiment of the present invention;

[0044] Figure 2 It is a schematic flowchart of the first embodiment of the terminal control method of the present invention;

[0045] Figure 3 It is a schematic diagram of the distribution of access devices in the first embodiment of the terminal control method of the present invention;

[0046] Figure 4 It is a schematic diagram of the functional modules of an embodiment of the terminal control system of the present invention.

[0047] The realization, functional features and advantages of the object of the present invention will be further described with reference to the embodiments and the accompanying drawings. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0048] It should be understood that the specific embodiments described herein are merely for explaining the present invention and are not intended to limit the present invention.

[0049] In the following description, suffixes such as "module", "component", or "unit" used to represent elements are only for the convenience of describing the present invention and have no specific meaning in themselves. Therefore, "module", "component", or "unit" can be used interchangeably.

[0050] The terminal in the embodiments of the present invention (also called a terminal, a device, or a terminal device) can be a PC, or a movable terminal device with display and data processing functions such as a smart phone, a tablet computer, and a portable computer.

[0051] As Figure 1 shown, the terminal may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and optionally, the user interface 1003 may further include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1005 may be a high-speed RAM memory, or a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may optionally be a storage device independent of the aforementioned processor 1001.

[0052] Optionally, the terminal may further include a camera, an RF (Radio Frequency) circuit, sensors, an audio circuit, a WiFi module, and so on. Among them, the sensors include, for example, a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor. Among them, the ambient light sensor can adjust the brightness of the display screen according to the brightness of the ambient light, and the proximity sensor can turn off the display screen and / or the backlight when the mobile terminal moves to the ear. As a kind of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary, and can be used for applications that identify the posture of the mobile terminal (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as a pedometer, tapping), etc.; of course, the mobile terminal can also be configured with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which will not be elaborated here.

[0053] Those skilled in the art can understand that Figure 1The terminal structure shown does not limit the terminal, and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0054] As Figure 1 shown, the memory 1005, as a storage medium, may include an operating system, a network communication module, a user interface module, and a terminal control program.

[0055] In Figure 1 the terminal shown, the network interface 1004 is mainly used to connect to the background server and communicate data with the background server; the user interface 1003 is mainly used to connect to the client (user side) and communicate data with the client; and the processor 1001 may be used to call the terminal control program stored in the memory 1005, and when the terminal control program is executed by the processor, the operations in the terminal control method provided in the following embodiments are implemented.

[0056] Based on the above device hardware structure, various embodiments of the terminal control method of the present invention are proposed.

[0057] It should be noted that in the terminal control method of the present invention, there is a terminal control system, which includes a Bluetooth headset, an access device, a server, a controlled terminal, etc. The terminal control method of the present invention can be applied to different devices or equipment such as Bluetooth headsets, access devices, servers, and controlled terminals in the terminal control system, so as to realize the control function of the terminal. The following will detail the terminal control method of the present invention by applying it to different devices or equipment.

[0058] Referring to Figure 2 , in the first embodiment of the terminal control method of the present invention, the terminal method is applied to a Bluetooth headset in a terminal control system, and the terminal control system further includes an access device, a server, and a controlled terminal. The terminal control method includes:

[0059] Step S10, when detecting a voice control instruction of a user, obtain the ear canal information of the user and authenticate the user according to the ear canal information;

[0060] In this embodiment, the terminal control method is applied to a Bluetooth headset in a terminal control system. The Bluetooth headset can be a TWS headset or other headsets with Bluetooth and NFC communication functions, which is not limited here. Taking the TWS headset as an example below, the terminal control system further includes an access device, a server, and a controlled terminal. Among them, the controlled terminal can be a mobile phone or other mobile terminal devices such as a tablet computer. Taking the mobile phone as the controlled terminal as an example for illustration below. It is known that when the user is in some specific scenarios, such as when doing outdoor sports, it is inconvenient to carry terminal devices such as mobile phones. However, due to the small and portable nature of the TWS headset, users generally carry the TWS headset and establish a communication connection between the TWS headset and the mobile phone via Bluetooth. On the one hand, they can listen to music during exercise, and on the other hand, they can control the mobile phone through the Bluetooth headset for calls and the like. But when the distance between the mobile phone and the user exceeds the Bluetooth communication range of the TWS headset, communication will be interrupted, affecting the user's control and use of the terminal device. Based on this, a terminal control method is proposed in this embodiment, which can be applied to the Bluetooth headset in the terminal control system. When the mobile phone exceeds the Bluetooth communication range of the TWS headset, communication and control with the mobile phone are realized through the access device and the server as communication relays, ensuring the normal use of the user.

[0061] Specifically, when a voice control instruction of the user is detected, the ear canal information of the user is obtained, and the current user is authenticated based on the obtained ear canal information. Authenticating the user's identity based on the ear canal information is to determine whether the current user is the real user of the mobile phone and the TWS headset, so as to ensure the user's privacy and information security. Among them, the user's voice control instructions are, for example, playing music, calling someone in the address book, and reading unread messages, etc. When authenticating the user, the obtained ear canal information is compared and matched with the preset ear canal information to confirm whether the obtained ear canal information is consistent with the ear canal information pre-stored in the Bluetooth headset by the user, so as to authenticate the current user. Further, the authentication of the user's identity can be carried out in the headset or in the charging case of the headset, which is not limited here.

[0062] Step S20, if the verification is passed, establish a communication connection with the access device;

[0063] After authenticating the user, if the authentication fails, the voice control instruction of the user is not responded to ensure the security of the user's information. If the authentication passes, it is detected whether the mobile phone is within the communication range. If so, a communication connection is directly established with the mobile phone, and the user's voice control instruction is sent to the mobile phone to control the mobile phone to execute corresponding operations in response to the user's voice control instruction. If the mobile phone is not within the communication range, a communication connection is established with the access device, and the communication connection is a Bluetooth communication. Among them, the access device can be installed on public facilities such as outdoor street lamp poles, and generally has communication functions such as NFC, Bluetooth, 4G / 5G / WIFI, and self-power supply function. Before establishing a Bluetooth communication connection with the access device, information interaction is performed with the access device through NFC to establish the communication connection.

[0064] Further, the established communication connection with the access device is a Bluetooth communication connection. The steps of establishing the communication connection include:

[0065] Step S201, sending Bluetooth address information to the access device through NFC for the access device to send a Bluetooth address detail and a pairing request according to the Bluetooth address information;

[0066] Step S202, receiving the Bluetooth address detail and the pairing request sent by the access device, and establishing a Bluetooth communication connection with the access device according to the pairing request.

[0067] When establishing a Bluetooth communication connection with the access device, first send its own Bluetooth address information to the access device through NFC, so that after receiving the Bluetooth address information, the access device returns corresponding information according to the Bluetooth address information. Receive the information returned by the access device. Among them, the information returned by the access device includes a Bluetooth address detail containing the Bluetooth address information of each access device and a pairing request. When receiving the Bluetooth address detail and the pairing request returned by the access device, establish a Bluetooth communication connection with the access device according to the pairing request.

[0068] Furthermore, the access device includes one or more. That is, within the preset range of the user's location, one access device can be provided, or multiple access devices can be provided. Specifically, it can be customized according to the site size and communication environment. When there are multiple access devices, after establishing a communication connection with one of the access devices, if the user is in a moving state, the distance between the user and the established communication device may gradually increase, resulting in a gradual weakening of the communication signal. When the distance between the user and the access device exceeds the preset distance threshold, it may cause the communication to be interrupted. Therefore, when there are multiple access devices, after establishing a communication connection with one access device, it further includes:

[0069] Step S203: When the communication signal strength with the access device is detected to be lower than the preset threshold, scan the signal strengths of the respective access devices corresponding to the Bluetooth address details.

[0070] Step S204: Determine the target access device with the strongest signal strength and establish a Bluetooth communication connection with the target access device.

[0071] When the communication signal strength with the access device is detected to be lower than the preset threshold, based on the received Bluetooth address details, scan the signal strengths of the respective access devices corresponding to the Bluetooth address details, and use the access device with the strongest signal strength as the target access device, and then establish a Bluetooth communication connection with the target access device. Among them, the scanning of the signal strengths of the respective access devices and the establishment of a communication connection with the target access device are performed during the communication gap with the access device with which the communication connection is established. Therefore, when scanning the signal strength and switching the access device for establishing the communication connection, it will not affect the normal communication.

[0072] As Figure 3 shown, Figure 3 This is a schematic diagram of the distribution of access devices when multiple access devices are set in the terminal control system in this embodiment. In Figure 3 it, BT2 to BT20 respectively represent 20 access devices. Taking the layout of 20 access devices in a 400-meter playground in an outdoor sports scenario as an example, an access device is set every 20 meters around the playground. When the distance between the headset and any access device is less than 10 meters during the user's movement, it is within the Bluetooth communication range of the headset. Assuming that the user is initially connected to the BT1 access device, during the NFC information exchange process, BT1 will also send the Bluetooth address information of BT2 - BT20 in the same group to the headset. The headset will use the communication gap to scan the signal strengths of the respective access devices during the movement and sort them. When it is found that the signal strength of the currently connected access device is less than the preset strength threshold, it means that the distance from the connected access device is relatively far. Then the headset will actively switch the device and establish a Bluetooth communication connection with the access device with the strongest signal strength.

[0073] Step S30: Based on the communication connection, send the ear canal information and the voice control instruction to the access device, so that the access device sends the ear canal information and the voice control instruction to the server, for the server to determine the target account according to the ear canal information and control the controlled terminal corresponding to the target account to execute the operation corresponding to the voice control instruction.

[0074] After establishing a Bluetooth communication connection with the access device, send the obtained ear canal information and the user's voice control instruction to the access device based on the established Bluetooth communication connection, so that the access device sends the received ear canal information and voice control instruction to the server, for the server to determine the target account corresponding to the user according to the ear canal information, thereby controlling the controlled terminal corresponding to the target account to execute the operation corresponding to the user's voice control instruction. For example, controlling a mobile phone to call someone, play music, or read unread messages, etc. Among them, the user's target account is registered and saved in the server in advance by the user through the mobile phone terminal. The registered account contains the user's ear canal information. Therefore, when the user's identity authentication is passed, the target account corresponding to the user can be determined based on the obtained ear canal information, and the controlled terminal corresponding to the target account, that is, the user's mobile phone, can be determined. It is known that there may be one or more user account information stored in the server. The account information contains the user's ear canal information and the device identifier of the controlled terminal. The account information of different users is identified and distinguished according to the user's ear canal information, and the target account is registered and pre-stored in the server in advance by the user through the controlled terminal.

[0075] It should be noted that when sending the obtained ear canal information and voice control instruction to the access device, it is sent based on the established Bluetooth communication with the access device. When the access device sends the ear canal information and the voice control instruction to the server, it is sent through communication connections such as 4G / 5G / WIFI. Through the access device and the server as a relay, the deficiency of the limited Bluetooth communication range is made up for.

[0076] Further, after sending the ear canal information and the voice control instruction to the access device, it further includes:

[0077] Step S40, receive the target operation information corresponding to the voice control instruction returned by the access device, where the target operation information is obtained by the server through voice conversion of the return information received from the controlled terminal according to the operation type corresponding to the voice control instruction. The return information includes text information and voice information. The server sends the target operation information to the access device, so that the access device sends the target operation information;

[0078] Step S50, play the target operation information to the user.

[0079] After sending the ear canal information and voice control instructions to the access device, the access device forwards the received ear canal information and voice control instructions to the server. The server determines the user's target account based on the ear canal information, and then controls the terminal corresponding to the target account to perform corresponding operations according to the user's voice control instructions. Then it receives the target operation information corresponding to the user's voice control instructions returned by the access device. Among them, the target operation information is obtained by the server through voice conversion of the return information sent by the mobile phone according to the operation type corresponding to the voice control instructions. Specifically, when the server controls the mobile phone to perform corresponding operations according to the voice control instructions, it determines the data packet that the mobile phone needs to return according to the operation type corresponding to the voice control instructions. The operation types include call, information reading, and voice playing. Among them, voice playing includes playing music, videos, and broadcasts, etc. According to the different operation types, the mobile phone sends different types of data packets as return information to the server, and the return information includes text information and voice information. For example, when the operation type corresponding to the voice control instruction is call, after the call is connected, the mobile phone returns the call voice of the called party to the server; when the operation type corresponding to the voice control instruction is information reading, taking the reading of unread information as an example, the mobile phone reads the unread information and sends the corresponding text information of the read unread information to the server. The server performs voice conversion on the text information in the return information to obtain the target operation information, and then sends it to the access device so that the access device sends the target operation information. After receiving the target operation information sent by the access device, the voice corresponding to the target operation information is played to the user so that the user can read the unread information in the mobile phone, achieving the purpose of terminal control.

[0080] Further, when the server controls the controlled terminal to perform the operation corresponding to the voice control instruction, it first performs voice recognition on the received user's voice control instruction. For example, when the user's voice control instruction received by the server is "read unread information", the corresponding text instruction "read unread information" is obtained through voice recognition. According to the voice recognition result, an information reading instruction is sent to the mobile phone to control the mobile phone to start the information application and query unread messages. Among them, after the mobile phone starts the information application and queries the unread information, it reads the text information in the unread information and returns it to the server. When the server receives the text information returned by the mobile phone, it converts the text information into voice information and forwards it to the access device. When receiving the voice information sent by the access device, the voice information is played to the user to respond to the user's voice control instruction of "read unread information" issued to the mobile phone.

[0081] In this embodiment, the terminal control method is applied to a Bluetooth headset in a terminal control system. The terminal control system further includes an access device, a server, and a controlled terminal. When a voice control instruction of a user is detected, the ear canal information of the user is obtained and the user is authenticated based on the ear canal information. If the authentication is passed, a communication connection is established with the access device. Based on the communication connection, the ear canal information and the voice control instruction are sent to the access device, so that the access device sends the ear canal information and the voice control instruction to the server for the server to determine a target account according to the ear canal information and control the controlled terminal corresponding to the target account to execute the operation corresponding to the voice control instruction. When a terminal device such as a mobile phone is not within the Bluetooth communication range of the Bluetooth headset carried by the user, based on the communication between the Bluetooth headset and the access device, and between the access device and the server, the access device and the server are used as communication relays between the Bluetooth headset and the controlled terminal to realize the communication between the Bluetooth headset and the controlled terminal, so that the user can control the terminal device such as a mobile phone through the Bluetooth headset, ensuring the normal use of the terminal device by the user.

[0082] Further, on the basis of the above embodiments of the present invention, a second embodiment of the terminal control method of the present invention is proposed.

[0083] Based on the above embodiments, in this embodiment, the terminal control method is applied to a server in a terminal control system. The terminal control system further includes a Bluetooth headset, an access device, and a controlled terminal. When the terminal control method is applied to the server in the terminal control system, the following steps are included:

[0084] Step A10, receive the voice control instruction and the ear canal information sent by the access device, where the ear canal information is obtained by the Bluetooth headset when detecting the voice control instruction of the user. The Bluetooth headset has established a communication connection with the access device, and the Bluetooth headset authenticates the user based on the ear canal information. If the authentication is passed, the voice control instruction and the ear canal information are sent to the access device so that the access device sends the voice control instruction and the ear canal information.

[0085] Based on the above embodiments, in this embodiment, the terminal control method is applied to the server. The method further includes a Bluetooth headset, an access device, and a controlled terminal. Similarly, in this embodiment, the TWS headset is still used as the Bluetooth headset (hereinafter referred to as the headset) and the mobile phone is used as the controlled terminal for description.

[0086] When the terminal control method is applied to a server, receive the voice control execution and ear canal information sent by an access device. Among them, the received ear canal information is obtained by the earphone when detecting the user's voice control instruction. When the earphone passes the user authentication based on the obtained ear canal information, it sends the obtained ear canal information and the voice control instruction to the access device, so that the access device forwards the ear canal information and the voice control instruction.

[0087] Step A20: Determine the target account according to the ear canal information, and control the controlled terminal corresponding to the target account to execute the operation corresponding to the voice control instruction.

[0088] After receiving the ear canal information and the voice control instruction sent by the access device, determine the target account corresponding to the user according to the received ear canal information. After determining the target account corresponding to the user, control the mobile phone (controlled terminal) corresponding to the target account to execute the corresponding operation according to the user's voice control instruction. When controlling the controlled terminal to execute the operation corresponding to the voice control instruction, first perform voice recognition on the received user's voice control instruction. For example, if the received user's voice control instruction is "Read unread messages", the corresponding text instruction "Read unread messages" is obtained through voice recognition, and an information reading instruction is sent to the mobile phone according to the voice recognition result to control the mobile phone to start the information application and query for unread messages. Among them, after the mobile phone starts the information application and queries for unread messages, it reads the text information in the unread messages and returns it. When receiving the text information returned by the mobile phone, convert the text information into voice information and forward it to the access device, so that the access device sends the converted voice information to the Bluetooth earphone and plays it to the user through the Bluetooth earphone to respond to the user's voice control instruction of "Read unread messages" for the mobile phone.

[0089] Further, after controlling the mobile phone to execute the operation corresponding to the voice control instruction, it further includes:

[0090] Step A30: Receive the return information sent by the controlled terminal according to the operation type corresponding to the voice control instruction, where the return information includes text information and voice information;

[0091] After controlling the mobile phone to execute the operation corresponding to the voice control instruction, receive the return information sent by the mobile phone. The return information is returned by the mobile phone after executing the corresponding operation according to the operation type corresponding to the voice control instruction. For different operation types corresponding to the voice control instruction, such as call, information reading, or music playing, etc., the mobile phone returns different types of data packets as the return information. When receiving the return information sent by the mobile phone, different processing is performed on the return information according to the different operation types of the voice control instruction. Among them, the return information includes text information and voice information.

[0092] Step A40, when the returned information includes text information, perform voice conversion on the text information in the returned information to obtain target operation information;

[0093] When processing the received returned information, first detect whether the returned information contains text information. If it does, convert the text information into voice information to obtain target operation information, that is, the execution result of the voice control instruction by the mobile phone side.

[0094] Step A50, send the target operation information to the access device, so that the access device sends the target operation information to the Bluetooth headset, and plays the target operation information to the user through the Bluetooth headset.

[0095] After obtaining the target operation information, send the target operation information to the access device through communication methods such as 4G / 5G WIFI, so that the access device sends the obtained target operation information to the Bluetooth headset, and plays it to the user in the form of voice through the Bluetooth headset, realizing the control and use of the terminal by the user. When the mobile phone is not within the communication range of the headset, the mobile phone can still be normally controlled and used through the headset, improving the user experience.

[0096] In this embodiment, the terminal control method is applied to the server in the terminal control system. By receiving the voice control instruction and ear canal information sent by the access device, where the ear canal information is obtained by the Bluetooth headset when detecting the user's voice control instruction, the Bluetooth headset has established a communication connection with the access device, and the Bluetooth headset authenticates the user according to the ear canal information. If the authentication is passed, the voice control instruction and the ear canal information are sent to the access device, so that the access device sends the voice control instruction and the ear canal information; determine the target account according to the ear canal information, and control the controlled terminal corresponding to the target account to execute the operation corresponding to the voice control instruction. When the user does not carry the controlled terminal and the controlled terminal is not within the communication range of the Bluetooth headset, the server and the access device act as a communication relay between the Bluetooth headset and the controlled terminal together to realize the communication between the Bluetooth headset and the controlled terminal, so that the user can control terminal devices such as mobile phones through the Bluetooth headset, ensuring the normal use of the terminal device by the user and improving the user experience.

[0097] Further, based on the above first and / or second embodiments of the present invention, a third embodiment of the terminal control method of the present invention is proposed.

[0098] Based on the above embodiments, in this embodiment, the terminal control method is applied to the first access device in the terminal control system. A communication connection is established between the first access device and the second access device in the terminal control system. The terminal control system further includes a Bluetooth headset, a server, and a controlled terminal. When the terminal control method is applied to the first access device in the terminal control system, the following steps are included:

[0099] Step B10, receive the Bluetooth address information of the Bluetooth headset and establish a communication connection with the Bluetooth headset;

[0100] In this embodiment, the terminal control method is applied to the first access device in the terminal control system. The terminal control system further includes a Bluetooth headset, a server, and a controlled terminal. Based on the above embodiments, in this embodiment, the TWS headset is still used as the Bluetooth headset (hereinafter referred to as the headset), and the mobile phone is used as the controlled terminal for illustration. Specifically, first, a communication connection is established with the headset, and the established communication connection is a Bluetooth communication connection. Before establishing the Bluetooth communication connection, information interaction is performed with the headset through NFC to complete the establishment of the Bluetooth communication connection.

[0101] Step B20, receive the voice control instruction and ear canal information sent by the Bluetooth headset. Among them, the ear canal information is obtained by the Bluetooth headset when detecting the user's voice control instruction, and the voice control instruction and the ear canal information are sent by the Bluetooth headset when the user's identity authentication is passed according to the ear canal information;

[0102] After establishing the Bluetooth communication connection, receive the ear canal information and voice control instruction sent by the headset. Among them, the ear canal information is obtained by the headset when detecting the user's voice control instruction, and the ear canal information and the voice control instruction are sent when the user's identity authentication is passed by the headset according to the ear canal information.

[0103] Further, the steps for establishing a Bluetooth communication connection with the headset include:

[0104] Step B101, receive the Bluetooth address information sent by the Bluetooth headset and send a pairing request to the Bluetooth headset through NFC according to the Bluetooth address information;

[0105] Step B102, establish a Bluetooth communication connection with the Bluetooth headset according to the pairing request.

[0106] When establishing a Bluetooth communication connection with the headset, first receive the Bluetooth address information sent by the headset through NFC. Based on this Bluetooth address information, send a pairing request to the headset through NFC for the headset to perform pairing based on this pairing request, so as to establish a Bluetooth communication connection with the headset according to the sent pairing request.

[0107] Further, a communication connection is established between the first access device and the second access device, which can be one or more of NFC communication, Bluetooth communication, 4G / 5G / WIFI communication, and is not limited herein. The second access device includes one or more. After establishing a communication connection with the earphone, it further includes:

[0108] Step B103, detect whether there is a second access device within a preset range. If so, obtain the Bluetooth address information of the second access device and generate a Bluetooth address list containing its own Bluetooth address information;

[0109] Step B104, send the Bluetooth address list to the Bluetooth earphone through NFC, so that when the communication signal strength with the Bluetooth earphone is lower than a preset strength threshold, the Bluetooth earphone can scan the signal strengths of the access devices corresponding to the Bluetooth address list, determine the target access device with the strongest signal strength from the second access devices, and establish a Bluetooth communication connection with the target access device.

[0110] When the Bluetooth address information sent by the earphone is received, detect whether there is a second access device within a preset range. If so, based on the communication connection with the second access device, obtain the Bluetooth address information of each second access device and generate a Bluetooth address list containing its own Bluetooth address information. Then, when sending a pairing request to the earphone through NFC, send the generated Bluetooth address list to the earphone together, so that when the strength of the communication signal with the earphone is lower than a preset strength threshold, the earphone can scan the signal strengths of the access devices corresponding to the Bluetooth address list, determine the target access device with the strongest signal strength from the access devices, and re-establish a Bluetooth communication connection with the target access device to realize the switching of the communication device and prevent communication interruption.

[0111] It should be noted that the earphone scans the signal strength of the access device during the communication gap. Therefore, the switching of the access device established with the earphone and the scanning of the access device by the earphone will not affect the communication or have little impact on the communication.

[0112] Step B30, send the voice control instruction and the ear canal information to the server, so that the server can determine the target account according to the ear canal information and control the controlled terminal corresponding to the target account to execute the operation corresponding to the voice control instruction.

[0113] After receiving the ear canal information and voice control instructions sent by the earphone, the ear canal information and voice control instructions are sent to the server, so that the server can determine the target account corresponding to the user based on the ear canal information, and control the controlled terminal corresponding to the target account to execute the operation corresponding to the user's voice control instructions. It is known that there may be account information of one or more users stored in the server. The account information contains the ear canal information of the user and the device identifier of the controlled terminal. The account information of different users is identified and distinguished according to the ear canal information of the user, and the target account is pre-registered and stored in the server by the user through the controlled terminal in advance. Control the mobile phone corresponding to the target account to execute the operation corresponding to the user's voice control instructions. For example, control the mobile phone to call someone, play music or read unread messages, etc.

[0114] Further, when the server controls the controlled terminal to execute the operation corresponding to the voice control instruction, it first performs voice recognition on the received voice control instruction of the user. For example, when the voice control instruction of the user received by the server is "read unread messages", the corresponding text instruction "read unread messages" is obtained through voice recognition, and an information reading instruction is sent to the mobile phone according to the voice recognition result to control the mobile phone to start the information application and query for unread messages. Among them, after the mobile phone starts the information application and queries for unread messages, it reads the text information in the unread messages and returns it to the server. When the server receives the text information returned by the mobile phone, it converts the text information into voice information and forwards it. When receiving the voice information sent by the access device, it forwards the voice information to the Bluetooth earphone for the Bluetooth earphone to play the voice information to the user, so as to respond to the user's voice control instruction of "read unread messages" for the mobile phone.

[0115] When sending the ear canal information and voice control instructions to the server, it is sent based on communication methods such as 4G / 5G WIFI. After sending the ear canal information and voice control instructions to the server, it further includes:

[0116] Step B40, receive the target operation information sent by the server, where the target operation information is obtained by the server through voice conversion of the received return information sent by the controlled terminal according to the operation type corresponding to the voice control instruction, and the return information includes text information and voice information;

[0117] Step B50, send the target operation information to the Bluetooth earphone for the Bluetooth earphone to play the target operation information to the user.

[0118] After sending the ear canal information and the voice control instruction to the server, the server determines the target account of the user based on the received ear canal information, and controls the mobile phone corresponding to the target account to execute the operation corresponding to the voice control instruction according to the voice control instruction of the user. After the mobile phone executes the operation corresponding to the voice control instruction, according to the operation type corresponding to the voice control instruction, different types of data packets are returned to the server as return information, and the return information is the execution result of the mobile phone for the voice control instruction. Among them, the return information of the mobile phone received by the server includes text information and voice information, and the operation types of the voice control instruction include call, information reading, voice playing, etc. For example, when the operation type corresponding to the voice control instruction is call, after the call is connected, the mobile phone returns the call voice of the called party to the server; when the operation type corresponding to the voice control instruction is information reading, the mobile phone reads the unread information and sends the text information corresponding to the read unread information to the server, and the server performs voice conversion on the text information in the return information to obtain the target operation information, and then sends the target operation information. After receiving the target operation information sent by the server, the target operation information is sent to the earphone, so that the earphone plays the voice corresponding to the target operation information to the user, enabling the user to obtain the unread information in the mobile phone and achieving the purpose of terminal control.

[0119] In this embodiment, the terminal control method is applied to the first access device in the terminal control system. The terminal control system further includes a second access device, a Bluetooth earphone, a server, and a controlled terminal. By establishing a Bluetooth communication connection with the Bluetooth earphone and receiving the voice control instruction and the ear canal information sent by the Bluetooth earphone, wherein the ear canal information is obtained by the Bluetooth earphone when detecting the voice control instruction of the user, and the voice control instruction and the ear canal information are sent by the Bluetooth earphone when the user's identity authentication is passed according to the ear canal information; the voice control instruction and the ear canal information are sent to the server, so that the server determines the target account according to the ear canal information and controls the controlled terminal corresponding to the target account to execute the operation corresponding to the voice control instruction. Together with the server, the access device serves as a communication relay between the Bluetooth earphone and the controlled terminal, realizing the communication between the Bluetooth earphone and the controlled terminal, so that the user can control terminal devices such as mobile phones through the Bluetooth earphone, ensuring the normal use of the terminal devices by the user and improving the user experience.

[0120] It can be understood that the terminal control method in the present invention can also be applied to the controlled terminal in the terminal control system. When applied to the controlled terminal, the terminal control system further includes a Bluetooth headset, an access device, and a server. When the controlled terminal receives a voice control instruction sent by the server, it performs corresponding operations, and according to the operation type corresponding to the voice control instruction, returns different types of data packets to the server as return information, so that the server can forward the return information to the Bluetooth headset through the access device and play it to the user in the form of voice through the Bluetooth headset. Among them, the instruction sent by the server received can also be an instruction generated by the server after voice recognition of the user's voice control instruction, which is not limited herein. It can be known that when the terminal control method in the present invention is applied to the controlled terminal in the terminal control system, the functions and the processes of function implementation are the same as those in the above embodiments, and will not be repeated here.

[0121] In addition, referring to Figure 4 , an embodiment of the present invention further provides a terminal control system. The terminal control system includes a Bluetooth headset, and the Bluetooth headset includes:

[0122] An ear canal recognition module 10, configured to obtain the user's ear canal information and authenticate the user according to the ear canal information when detecting the user's voice control instruction;

[0123] An NFC module 20, configured to establish a communication connection with the access device if the authentication is passed;

[0124] A Bluetooth module 30, configured to send the ear canal information and the voice control instruction to the access device based on the communication connection, so that the access device sends the ear canal information and the voice control instruction to the server, and the server determines a target account according to the ear canal information and controls the controlled terminal corresponding to the target account to perform the operation corresponding to the voice control instruction.

[0125] Optionally, the NFC module 20 is further configured to:

[0126] Send Bluetooth address information to the access device through NFC, so that the access device sends a Bluetooth address detail and a pairing request according to the Bluetooth address information;

[0127] Receive the Bluetooth address detail and the pairing request sent by the access device, and establish a Bluetooth communication connection with the access device according to the pairing request.

[0128] Optionally, the Bluetooth headset further includes a connection management module, configured to:

[0129] When the communication signal strength with the access device is detected to be lower than a preset threshold, scan the signal strengths of the access devices corresponding to the Bluetooth address details;

[0130] Determine the target access device with the strongest signal strength, and establish a Bluetooth communication connection with the target access device.

[0131] Optionally, the Bluetooth headset further includes a voice playback module for:

[0132] Receive the target operation information corresponding to the voice control instruction returned by the access device, where the target operation information is obtained by the server through voice conversion of the return information received from the controlled terminal according to the operation type corresponding to the voice control instruction, the return information includes text information and voice information, and the server sends the target operation information to the access device so that the access device sends the target operation information;

[0133] Play the target operation information to the user.

[0134] In addition, an embodiment of the present invention further provides a terminal control system, and the terminal control system further includes a server, and the server includes:

[0135] A first communication module for receiving the voice control instruction and ear canal information sent by the access device, where the ear canal information is obtained by the Bluetooth headset when detecting the user's voice control instruction, the Bluetooth headset is communicatively connected to the access device, and the Bluetooth headset authenticates the user according to the ear canal information. If the authentication is passed, the voice control instruction and the ear canal information are sent to the access device so that the access device sends the voice control instruction and the ear canal information;

[0136] A terminal control module for determining a target account according to the ear canal information and controlling the controlled terminal corresponding to the target account to execute the operation corresponding to the voice control instruction.

[0137] Optionally, the server further includes:

[0138] A first information receiving module for receiving the return information sent by the controlled terminal according to the operation type corresponding to the voice control instruction, where the return information includes text information and voice information;

[0139] An information conversion module for performing voice conversion on the text information in the return information to obtain target operation information when the return information includes text information;

[0140] A first information sending module, configured to send the target operation information to the access device, so that the access device sends the target operation information to the Bluetooth headset, and plays the target operation information to the user through the Bluetooth headset.

[0141] In addition, an embodiment of the present invention further provides a terminal control system, and the terminal control system further includes a first access device, where the first access device includes:

[0142] An NFC receiving module, configured to receive the Bluetooth address information of the Bluetooth headset and establish a communication connection with the Bluetooth headset;

[0143] A Bluetooth receiving module, configured to receive the voice control instruction and ear canal information sent by the Bluetooth headset, where the ear canal information is obtained by the Bluetooth headset when detecting the user's voice control instruction, and the voice control instruction and the ear canal information are sent by the Bluetooth headset when the user's identity authentication is passed according to the ear canal information;

[0144] A second information sending module, configured to send the voice control instruction and the ear canal information to the server, so that the server determines a target account according to the ear canal information and controls the controlled terminal corresponding to the target account to execute the operation corresponding to the voice control instruction.

[0145] Optionally, the NFC communication module is further configured to:

[0146] Receive the Bluetooth address information sent by the Bluetooth headset, and send a pairing request to the Bluetooth headset through NFC according to the Bluetooth address information;

[0147] Establish a Bluetooth communication connection with the Bluetooth headset according to the pairing request.

[0148] Optionally, the first access device further includes:

[0149] An information detection module, configured to detect whether a second access device exists within a preset range. If so, obtain the Bluetooth address information of the second access device and generate a Bluetooth address detail including its own Bluetooth address information;

[0150] The NFC communication module is further configured to send the Bluetooth address detail to the Bluetooth headset through NFC, so that when the communication signal strength with the Bluetooth headset is lower than a preset strength threshold, the Bluetooth headset scans the signal strengths of the access devices corresponding to the Bluetooth address detail, determines a target access device with the strongest signal strength from each access device, and establishes a Bluetooth communication connection with the target access device.

[0151] Optionally, the first access device further includes:

[0152] A second information receiving module, configured to receive the target operation information sent by the server, where the target operation information is obtained by the server through voice conversion of the received return information sent by the controlled terminal according to the operation type corresponding to the voice control instruction, and the return information includes text information and voice information;

[0153] A Bluetooth sending module, configured to send the target operation information to the Bluetooth headset for the Bluetooth headset to play the target operation information to the user.

[0154] In addition, an embodiment of the present invention further provides a computer-readable storage medium, on which a terminal control program is stored. When the terminal control program is executed by a processor, the operations in the terminal control method provided in the above embodiment are implemented.

[0155] For each embodiment of the storage medium of the present invention, reference may be made to each embodiment of the terminal control method of the present invention, which will not be elaborated here.

[0156] It should be noted that, in this article, relational terms such as first and second are only used to distinguish one entity / operation / object from another entity / operation / object, and do not necessarily require or imply any actual relationship or order between these entities / operations / objects; the terms "comprising", "including" or any other variant thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system comprising a series of elements not only includes those elements, but also includes other elements not expressly listed, or further includes elements inherent to such process, method, article or system. Without further limitation, an element defined by the statement "comprising an..." does not exclude the existence of additional identical elements in the process, method, article or system comprising the element.

[0157] For the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple. For the relevant parts, reference may be made to the partial description of the method embodiment. The system embodiments described above are only illustrative, and the units described as separate components may or may not be physically separated. Some or all of the modules in the can be selected according to actual needs to achieve the purpose of the solution of the present invention. Those of ordinary skill in the art can understand and implement it without creative efforts.

[0158] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages and disadvantages of the embodiments.

[0159] Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general hardware platform. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes several instructions for causing a terminal device (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the terminal control method described in each embodiment of the present invention.

[0160] The above are only the preferred embodiments of the present invention, and do not limit the patent scope of the present invention accordingly. Any equivalent structure or equivalent process transformation made by using the content of the specification and drawings of the present invention, or directly or indirectly applied in other related technical fields, shall be equally included in the patent protection scope of the present invention.

Claims

1. A terminal control method, applied to a Bluetooth headset in a terminal control system, characterized in that The terminal control system further includes an access device, a server, and a controlled terminal. The terminal control method includes the following steps: When a voice control instruction of a user is detected, obtain the ear canal information of the user and authenticate the user according to the ear canal information; If the authentication is passed, detect whether the controlled terminal is within the Bluetooth communication range of the Bluetooth headset. If the controlled terminal is not within the Bluetooth communication range of the Bluetooth headset, send the Bluetooth address information to the access device via NFC, so that the access device sends the Bluetooth address details and a pairing request according to the Bluetooth address information; Receive the Bluetooth address details and the pairing request sent by the access device, and establish a Bluetooth communication connection with the access device according to the pairing request; Based on the communication connection, send the ear canal information and the voice control instruction to the access device, so that the access device sends the ear canal information and the voice control instruction to the server, for the server to determine a target account according to the ear canal information and control the controlled terminal corresponding to the target account to execute the operation corresponding to the voice control instruction.

2. The terminal control method according to claim 1, wherein, One or more access devices are included. When multiple access devices are included, after the step of establishing a Bluetooth communication connection with the access device according to the pairing request, the following steps are further included: When it is detected that the communication signal strength with the access device is lower than a preset threshold, scan the signal strengths of the respective access devices corresponding to the Bluetooth address details; Determine the target access device with the strongest signal strength, and establish a Bluetooth communication connection with the target access device.

3. The terminal control method according to claim 1, characterized in that After the step of sending the ear canal information and the voice control instruction to the access device based on the communication connection, the following steps are further included: Receive the target operation information corresponding to the voice control instruction returned by the access device, where the target operation information is obtained by the server through voice conversion of the return information received from the controlled terminal according to the operation type corresponding to the voice control instruction. The return information includes text information and voice information, and the server sends the target operation information to the access device, so that the access device sends the target operation information; Play the target operation information to the user.

4. A terminal control method, applied to a server in a terminal control system, characterized in that, The terminal control system further includes a Bluetooth headset, an access device, and a controlled terminal. The terminal control method includes the following steps: Receive the voice control instruction and ear canal information sent by the access device, where the ear canal information is obtained by the Bluetooth headset when detecting the user's voice control instruction, and the Bluetooth headset authenticates the user according to the ear canal information. If the authentication is passed, it detects whether the controlled terminal is within the Bluetooth communication range of the Bluetooth headset. If the controlled terminal is not within the Bluetooth communication range of the Bluetooth headset, it sends the Bluetooth address information to the access device through NFC for the access device to send the Bluetooth address details and pairing request according to the Bluetooth address information; receive the Bluetooth address details and pairing request sent by the access device, establish a Bluetooth communication connection with the access device according to the pairing request, and send the voice control instruction and the ear canal information to the access device so that the access device sends the voice control instruction and the ear canal information; Determine the target account according to the ear canal information, and control the controlled terminal corresponding to the target account to execute the operation corresponding to the voice control instruction.

5. The terminal control method according to claim 4, wherein After the step of controlling the controlled terminal corresponding to the target account to execute the operation corresponding to the voice control instruction, it further includes: Receive the return information sent by the controlled terminal according to the operation type corresponding to the voice control instruction, where the return information includes text information and voice information; When the return information includes text information, perform voice conversion on the text information in the return information to obtain the target operation information; Send the target operation information to the access device so that the access device sends the target operation information to the Bluetooth headset and plays the target operation information to the user through the Bluetooth headset.

6. A terminal control method, applied to a first access device in a terminal control system, characterized in that The terminal control system further includes a Bluetooth headset, a server, and a controlled terminal, and the terminal control method includes the following steps: Receive the Bluetooth address information of the Bluetooth headset and establish a communication connection with the Bluetooth headset; Receive the voice control instruction and ear canal information sent by the Bluetooth headset, where the ear canal information is obtained by the Bluetooth headset when detecting the user's voice control instruction, and the Bluetooth headset authenticates the user according to the ear canal information. If the authentication is passed, it detects whether the controlled terminal is within the Bluetooth communication range of the Bluetooth headset. If the controlled terminal is not within the Bluetooth communication range of the Bluetooth headset, it sends the Bluetooth address information to the access device through NFC for the first access device to send the Bluetooth address details and pairing request according to the Bluetooth address information; receive the Bluetooth address details and pairing request sent by the first access device, establish a Bluetooth communication connection with the first access device according to the pairing request, and send the ear canal information and voice control instruction to the first access device based on the Bluetooth communication connection; Send the voice control instruction and the ear canal information to the server for the server to determine the target account according to the ear canal information and control the controlled terminal corresponding to the target account to execute the operation corresponding to the voice control instruction.

7. The terminal control method according to claim 6, wherein The first access device is communicatively connected to the second access device, and the second access device includes one or more. The step of receiving the Bluetooth address information of the Bluetooth headset and establishing a communication connection with the Bluetooth headset includes: Receiving the Bluetooth address information sent by the Bluetooth headset, and sending a pairing request to the Bluetooth headset via NFC according to the Bluetooth address information; Establishing a Bluetooth communication connection with the Bluetooth headset according to the pairing request; After the step of receiving the Bluetooth address information sent by the Bluetooth headset, the following steps are further included: Detecting whether there is a second access device within a preset range. If there is, obtaining the Bluetooth address information of the second access device and generating a Bluetooth address detail including its own Bluetooth address information; Sending the Bluetooth address detail to the Bluetooth headset via NFC, so that when the communication signal strength with the Bluetooth headset is lower than a preset strength threshold, the Bluetooth headset can scan the signal strengths of the access devices corresponding to the Bluetooth address detail, determine the target access device with the strongest signal strength from each of the access devices, and establish a Bluetooth communication connection with the target access device.

8. The terminal control method according to claim 6, wherein, After the step of sending the voice control instruction and the ear canal information to the server, the following steps are further included: Receiving the target operation information sent by the server, where the target operation information is obtained by the server through voice conversion of the return information received and sent by the controlled terminal according to the operation type corresponding to the voice control instruction, and the return information includes text information and voice information; Sending the target operation information to the Bluetooth headset for the Bluetooth headset to play the target operation information to the user.

9. A terminal control system, characterized in that, The terminal control system includes a Bluetooth headset, and the Bluetooth headset includes: An ear canal recognition module, configured to obtain the user's ear canal information and authenticate the user according to the ear canal information when detecting the user's voice control instruction; An NFC module, configured to, if the authentication is passed, detect whether the controlled terminal is within the Bluetooth communication range of the Bluetooth headset. If the controlled terminal is not within the Bluetooth communication range of the Bluetooth headset, send the Bluetooth address information to the access device via NFC for the access device to send the Bluetooth address detail and the pairing request according to the Bluetooth address information; receive the Bluetooth address detail and the pairing request sent by the access device, and establish a Bluetooth communication connection with the access device according to the pairing request; A Bluetooth module, configured to send the ear canal information and the voice control instruction to the access device based on the communication connection, so that the access device sends the ear canal information and the voice control instruction to the server for the server to determine the target account according to the ear canal information and control the controlled terminal corresponding to the target account to execute the operation corresponding to the voice control instruction.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a terminal control program, and when the terminal control program is executed by a processor, the steps of the terminal control method according to any one of claims 1 to 8 are implemented.

Images