Wearable device control method, device, terminal device and storage medium

Through voice wake-up and positioning technology, quick connection and control between smart wearable devices is achieved, cumbersome multi-device control problems in the existing technology are solved, and user interaction efficiency and experience are improved.

CN114999489BActive Publication Date: 2025-08-22GEER TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210744564.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-06-28
Publication Date
2025-08-22
Estimated Expiration
2042-06-28

AI Technical Summary

Technical Problem

The interconnection control process of existing smart wearable devices is cumbersome, and users need to frequently use remote controls or mobile apps to control multiple devices, which affects interaction efficiency.

Method used

By waking up the first wearable device through voice, the sound source positioning and broadcast signal source positioning are performed, the target device is matched and the communication link is created, and the rapid interactive control between devices is realized.

Benefits of technology

Simplifies user operations and improves the interactive efficiency and user experience of wearable devices.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114999489B_ABST
    Figure CN114999489B_ABST
Patent Text Reader

Abstract

The present invention discloses a control method, apparatus, terminal device, and computer-readable storage medium for a wearable device. When a first wearable device recognizes a preset wake-up voice in voice information collected from the environment, the first wearable device locates the sound source of the voice information to obtain the sound source information of the voice information; locates the broadcast signal source of each second wearable device in the environment to obtain the broadcast signal source information of each second wearable device; if the sound source information matches the target signal source information in the broadcast signal source information, a communication link is established between the target wearable device corresponding to the target signal source, and interactive control with the target wearable device is performed through the communication link. The technical solution of the present invention can realize fast and flexible connection and control between different wearable devices through voice, thereby improving the efficiency of users interacting with wearable devices.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of intelligent wearable devices, and in particular relates to a control method, device, terminal device and computer-readable storage medium for a wearable device. Background Art

[0002] Nowadays, smart wearable devices are becoming more and more popular in the market.

[0003] Connecting smart wearable devices is a crucial step in enabling interaction and control between various devices. However, to achieve interconnection with smart wearable devices, users usually need to use traditional remote controls or specific mobile apps (Applications) to connect the wearable device to other wearable terminal devices.

[0004] In this way, once there are many wearable devices in the user's environment, the user needs to use multiple remote controls to control them separately or frequently add and operate multiple devices through mobile phone apps, which makes the user's control process extremely cumbersome and greatly affects the user's interaction efficiency in using wearable devices. Summary of the Invention

[0005] The main purpose of the present invention is to provide a control method, apparatus, terminal device, and computer-readable storage medium for a wearable device. The purpose is to enable fast and flexible connection and control between different wearable devices through voice communication, thereby improving the efficiency of user interaction with wearable devices.

[0006] To achieve the above object, the present invention provides a control method for a wearable device, wherein the control method for a wearable device is applied to a first wearable device, and the control method for a wearable device includes:

[0007] When a preset wake-up voice is recognized from voice information collected from the environment, performing sound source localization on the voice information to obtain sound source information of the voice information;

[0008] Positioning the broadcast signal source of each second wearable device in the environment to obtain broadcast signal source information of each second wearable device;

[0009] If the sound source information matches the target signal source information in each of the broadcast signal source information, a communication link is created between the target wearable device corresponding to the target signal source, and interactive control with the target wearable device is performed through the communication link.

[0010] Optionally, the first wearable device is configured with an array microphone, and the sound source information includes: a sound source azimuth angle;

[0011] The step of performing sound source localization on the voice information to obtain the sound source information of the voice information includes:

[0012] Acquiring the arrival time difference of the voice information through the array microphone;

[0013] A calculation is performed based on the arrival time difference to determine the sound source azimuth angle of the voice information.

[0014] Optionally, the first wearable device is configured with an array antenna, and the broadcast signal source information includes: a broadcast signal azimuth angle;

[0015] The step of locating the broadcast signal source of each second wearable device in the environment to obtain the broadcast signal source information of each second wearable device includes:

[0016] receiving a broadcast signal from each of the second wearable devices through the array antenna;

[0017] Calculating the phase difference of each of the broadcast signals in sequence based on different array elements in the array antenna;

[0018] A preset signal angle estimation algorithm is called to perform calculation based on each of the phase differences to determine the broadcast signal azimuth angle of each of the second wearable devices.

[0019] Optionally, the step of establishing a communication link between the target wearable device corresponding to the target signal source and performing interactive control with the target wearable device through the communication link includes:

[0020] Establishing a Bluetooth connection between the target wearable device corresponding to the target signal source in each of the second wearable devices;

[0021] Establishing a communication link with the target wearable device via the Bluetooth connection;

[0022] A preset voice prompt is output through the communication link to perform interactive control with the target wearable device.

[0023] Optionally, before the step of performing sound source localization on the voice information to obtain sound source information of the voice information when a preset wake-up voice is recognized in the voice information collected from the environment, the method further includes:

[0024] The preset wake-up voice is set based on a unique identifier of the first wearable device, wherein the unique identifier includes at least one of a Bluetooth name, a device name, and a custom name.

[0025] Optionally, the method further includes:

[0026] When the voice information is collected in the environment and the unique identifier is detected in the text information corresponding to the voice information, it is determined that the wake-up voice is recognized from the voice information.

[0027] Optionally, the first wearable device includes: a master device and a slave device;

[0028] After the step of locating the broadcast signal source of each second wearable device in the environment to obtain the broadcast signal source information of each second wearable device, the method further includes:

[0029] Aggregating the broadcast signal source information of each of the broadcast signal sources to the master device for calibration processing to obtain a final angle value of each of the second wearable devices, wherein the broadcast signal source information of each of the broadcast signal sources is obtained by positioning the broadcast signal source by the master device and / or the slave device;

[0030] Detecting whether there is a target angle value that matches the sound source information among the final angle values;

[0031] If so, the broadcast signal source information corresponding to the target angle value is determined as the target signal source information matching the sound source information.

[0032] In addition, to achieve the above-mentioned object, the present invention further provides a control device for a wearable device, wherein the control device for a wearable device is applied to a first wearable device, and the control device for a wearable device comprises:

[0033] A sound source localization module is used to, when a preset wake-up voice is recognized in the voice information collected from the environment, perform sound source localization on the voice information to obtain the sound source information of the voice information;

[0034] a broadcast positioning module, configured to locate the broadcast signal source of each second wearable device in the environment and obtain the broadcast signal source information of each second wearable device;

[0035] A connection control module is used to create a communication link between the target wearable device corresponding to the target signal source if the sound source information matches the target signal source information in each of the broadcast signal source information, and to perform interactive control with the target wearable device through the communication link.

[0036] Each functional module of the control device of the wearable device of the present invention implements the steps of the above-mentioned method for controlling motion monitoring of the wireless headset when running.

[0037] In addition, to achieve the above-mentioned purpose, the present invention also provides a terminal device, which includes: a memory, a processor, and a control program for a wearable device stored on the memory and runnable on the processor. When the control program for motion monitoring of the wireless headset is executed by the processor, the steps of the control method for motion monitoring of the wireless headset as described above are implemented.

[0038] In addition, to achieve the above-mentioned purpose, the present invention also provides a computer-readable storage medium, on which a control program of a wearable device is stored. When the control program of the wearable device is executed by a processor, the steps of the control method of the wearable device as described above are implemented.

[0039] The embodiments of the present invention propose a control method, apparatus, terminal device and computer-readable storage medium for a wearable device. When a first wearable device recognizes a preset wake-up voice in voice information collected from the environment, the first wearable device performs sound source positioning on the voice information to obtain the sound source information of the voice information; and performs broadcast signal source positioning on each second wearable device in the environment to obtain the broadcast signal source information of each second wearable device; thereby, if the sound source information matches the target signal source information in each broadcast signal source information, a communication link is created between the target wearable device corresponding to the target signal source, and interactive control with the target wearable device is performed through the communication link.

[0040] In this way, compared with the traditional method in which users add and control wearable devices through remote controls or mobile phone apps, the present invention wakes up the first wearable device through voice to trigger connection preparation, then performs sound source positioning operation to find the position of the user who makes the voice, and performs broadcast signal source positioning to search for the positions of other second wearable devices, and directly connects to the target wearable device that matches the position, and creates a communication link for interactive control between the two devices. In this way, users can quickly and flexibly connect and interactively control different wearable devices through voice, which greatly simplifies the user's operation and effectively improves the efficiency and experience of users interacting with wearable devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Figure 1 Schematic diagram of the device structure of the hardware operating environment of the terminal device involved in the embodiment of the present invention;

[0042] Figure 2 1 is a flow chart of a first embodiment of a control method for a wearable device according to the present invention;

[0043] Figure 3 This is a schematic diagram of the principle of locating a broadcast signal source according to an embodiment of a control method for a wearable device of the present invention;

[0044] Figure 4 A schematic diagram of an application scenario for performing orientation recognition of a wearable device according to an embodiment of a control method for a wearable device of the present invention;

[0045] Figure 5 A schematic diagram of an application scenario of voice interaction with a wearable device according to an embodiment of a method for controlling a wearable device of the present invention;

[0046] Figure 6 FIG. 1 is a schematic diagram of functional modules of an embodiment of a control device for a wearable device according to the present invention.

[0047] The purpose, features and advantages of the present invention will be further described with reference to the accompanying drawings and in conjunction with the embodiments. DETAILED DESCRIPTION

[0048] It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0049] Reference Figure 1 , Figure 1 This is a schematic diagram of the device structure of the hardware operating environment of the terminal device involved in the embodiment of the present invention.

[0050] The terminal device of the embodiment of the present invention can be a wearable device such as a bracelet, a watch, glasses, headphones, TWS (True Wireless Stereo) headphones, etc., and the wearable device is equipped with an array microphone and an array antenna.

[0051] like Figure 1 As shown, the terminal device may include: a processor 1001, such as a CPU, a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the user interface 1003 may optionally include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a Wi-Fi interface). The memory 1005 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may optionally also be a storage device independent of the aforementioned processor 1001.

[0052] Those skilled in the art will understand that Figure 1The terminal device structure shown in the figure does not constitute a limitation on the terminal device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0053] like Figure 1 As shown, the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a control program for the wearable device.

[0054] exist Figure 1 In the terminal shown, the network interface 1004 is mainly used to connect to the background server and communicate data with the background server; the user interface 1003 is mainly used to connect to the client and communicate data with the client; and the processor 1001 can be used to call the control program of the wearable device stored in the memory 1005 to implement various embodiments of the control method of the wearable device of the present invention.

[0055] Based on the above-mentioned terminal device, various embodiments of the control method of the wearable device of the present invention are proposed. In various embodiments of the motion monitoring method of the wireless headset of the present invention, the control method of the wearable device of the present invention is applied to the process of monitoring the motion of the headset wearer based on the wireless headset.

[0056] Please refer to Figure 2 , Figure 2 This is a flow chart of a first embodiment of a control method for a wearable device according to the present invention. In the first embodiment of the control method for a wearable device according to the present invention, the control method for a wearable device according to the present invention is applied to a first wearable device in an environment where multiple wearable devices coexist. The control method for a wearable device according to the present invention includes:

[0057] Step S10: When a preset wake-up voice is recognized from the voice information collected from the environment, the sound source of the voice information is localized to obtain the sound source information of the voice information;

[0058] In this embodiment, in an environment where multiple wearable devices exist at the same time, each wearable device acts as the first wearable device to collect voice information in the current environment, and detects whether the preset wake-up voice is recognized in the collected voice information. When the wake-up voice is recognized in the voice information, the sound source positioning operation is immediately performed on the voice information to obtain the sound source information of the voice information in the current environment.

[0059] For example, Figure 4As shown in the schematic diagram of the application scenario, in this embodiment, it is assumed that there are four users A, B, C, and D in the room, all wearing smart wearable devices, and the smart wearable device worn by user A is specifically a TWS headset. Then, when user B needs to connect to the TWS headset worn by user A through the headset he is wearing to interact, user B sends a voice message of "connecting to user A". In this way, the TWS headset worn by user A acts as the first wearable device to collect voice information in the current indoor environment, and recognizes the wake-up voice of "user A" from the voice information sent by user B, confirms that the wake-up is successful, and immediately starts to synchronize the sound features of the voice information collected by the microphones of its left and right earphones to perform TDOA (a method of positioning using time difference) sound source recognition operation to obtain the sound source information of the voice information sent by user B.

[0060] In addition, in some feasible embodiments, before the above step S10, the control method of the wearable device of the present invention may further include:

[0061] Step A: Setting the preset wake-up voice based on the unique identifier of the first wearable device, wherein the unique identifier includes at least one of a Bluetooth name, a device name, and a custom name.

[0062] In this embodiment, during the startup process, the first wearable device can set its own unique identifier: Bluetooth name, device name and / or custom name as the wake-up voice for waking itself up to connect and interact with other wearable devices by interacting with the user through voice.

[0063] In addition, the first wearable device can also be set up by the user through the associated mobile phone App to confirm that the Bluetooth name, device name and / or custom name are set as the wake-up voice for waking itself up to connect and interact with other wearable devices.

[0064] It should be understood that based on the different design requirements of actual applications, in different feasible implementation methods, the wearable device's own Bluetooth name, device name and user-set custom name may of course be different. Based on this, the control method of the wearable device of the present invention is not limited to the specific content of the wearable device's own Bluetooth name, device name and / or custom name, as long as each name can serve as a unique identifier of the wearable device for the wearable device to determine whether it has been awakened.

[0065] Furthermore, in some feasible embodiments, the control method of the wearable device of the present invention further includes:

[0066] Step B: collecting the voice information in the environment and determining that the wake-up voice is recognized from the voice information when detecting that the unique identifier exists in the text information corresponding to the voice information.

[0067] In this embodiment, after the above-mentioned first wearable device collects voice information sent by the wearer of other wearable devices from the current environment, it immediately performs voice content recognition on the voice information to obtain text information corresponding to the voice information, and thereby detects whether there is text content in the text information that is the same as its own unique identifier: Bluetooth name, device name and / or custom name, and when the existence is detected, determines that the unique identifier exists in the text information corresponding to the voice information, and further determines that a wake-up voice for waking itself up to connect and interact with other devices is currently recognized from the voice information.

[0068] In addition, in some feasible embodiments, the first wearable device is configured with an array microphone, and the sound source information of the voice information obtained by performing a sound source localization operation on the collected voice information by the first wearable device includes: a sound source azimuth angle.

[0069] The step of “localizing the sound source of the voice information to obtain the sound source information of the voice information” in the above-mentioned step S10 may include:

[0070] Step S101: Acquiring the arrival time difference of the voice information through the array microphone;

[0071] In this embodiment, after the first wearable device determines that the wake-up voice has been recognized from the collected voice information, it immediately performs a TDOA sound source recognition operation to obtain the sound source information of the voice information. In other words, the first wearable device synchronizes the sound features of the collected voice information through its own array microphones, thereby determining the time difference between the voice information reaching any two microphones in the array microphones.

[0072] Step S102: performing calculation based on the arrival time difference to determine the sound source azimuth angle of the voice information.

[0073] In this embodiment, after determining the time difference between the voice information reaching any two microphones in the array microphone configured by itself, the above-mentioned first wearable device calculates the distance difference based on the speed of the voice information propagating in the air and the time difference, and then infers the sound source azimuth angle of the voice information in the current environment relative to the first wearable device.

[0074] In addition, as a feasible implementation method, the first wearable device can also perform a sound source localization operation on the collected voice information based on beamforming and high-resolution spectrum estimation to identify the sound source azimuth angle of the voice information.

[0075] Step S20: locating the broadcast signal source of each second wearable device in the environment to obtain the broadcast signal source information of each second wearable device;

[0076] In this embodiment, after the above-mentioned first wearable device performs a sound source positioning operation on the collected voice information to identify the sound source information of the voice information, it further performs a broadcast signal source positioning operation on all second wearable devices that broadcast Bluetooth signals in the current environment to identify the broadcast signal source information of each second wearable device.

[0077] For example, Figure 4 In the application scenario shown, it is assumed that there are four users A, B, C, and D in the room, all wearing smart wearable devices. The smart wearable device worn by user A is specifically a TWS headset, and each of the smart wearable devices broadcasts Bluetooth signals in the current indoor environment. In this way, when user B needs to connect and interact with the TWS headset worn by user A through the headset he wears, and user B sends a voice message of "connecting with user A", the TWS headset worn by user A acts as the first wearable device to collect voice information in the current indoor environment, and performs the sound source positioning operation of the voice information of "connecting with user A" to confirm the sound source azimuth angle of user B relative to himself in the current indoor environment.

[0078] In addition, at the same time or after the TWS headset worn by user A starts to perform the sound source positioning operation on the voice information "connected to user A", the three smart wearable devices worn by users B, C and D are all regarded as second wearable devices, and the broadcast signal source positioning operation is started for the Bluetooth signals broadcast by each second wearable device to obtain the broadcast signal source information of each second wearable device. That is, the TWS headset worn by user A is used as the first wearable device to scan the radio frequency information of the second wearable device b worn by user B, the second wearable device c worn by user C, and the second wearable device d worn by user D through the left and right earphones and calculate the angle of each radio frequency information. Then, the TWS headset summarizes the calculated angles into the main earphone for position averaging and calibration, and obtains the broadcast signal source information of the second wearable device b: L1_1, R1_1, the broadcast signal source information of the second wearable device c: L2_1, R2_1, and the broadcast signal source information of the second wearable device d: L3_1, R3_1.

[0079] In addition, in some feasible embodiments, the above-mentioned first wearable device is configured with an array antenna, and the first wearable device performs broadcast signal source positioning operations on each of the above-mentioned second wearable devices respectively, and the obtained broadcast signal source information of each second wearable device includes: broadcast signal azimuth angle.

[0080] The above-mentioned step S20: locating the broadcast signal source of each second wearable device in the environment to obtain the broadcast signal source information of each second wearable device may include:

[0081] Step S201: receiving a broadcast signal from each of the second wearable devices through the array antenna;

[0082] Step S202: Calculating the phase difference of each broadcast signal in sequence based on different array elements in the array antenna;

[0083] Step S203: calling a preset signal angle estimation algorithm to perform calculation based on each of the phase differences to determine the broadcast signal azimuth angle of each of the second wearable devices.

[0084] It should be noted that, in this embodiment, the preset signal angle estimation algorithm is an algorithm for calculating the azimuth angle between the signal transmission source and the device where the array antenna is located based on the phase difference and the signal wavelength. For example, the signal angle estimation algorithm may be specifically:

[0085]

[0086] Where θ is the azimuth angle, λ is the wavelength of the broadcast signal, △Φ is the phase difference, and d is the relative distance between two elements in the array antenna.

[0087] In this embodiment, if Figure 3 The principle of broadcast signal source positioning shown in the figure is that the first wearable device uses its own array antenna to scan the broadcast signals output by each of the above-mentioned second wearable devices in a radio frequency manner. Therefore, the first wearable device can use the array antenna to perform IQ sampling to determine the phase difference caused by the different distances between the broadcast signals of each second wearable device and any two elements in the array antenna. Finally, the first wearable device further calculates the azimuth angle of the broadcast signal of each of the above-mentioned second wearable devices using the above-mentioned signal angle estimation algorithm.

[0088] Step S30: If the sound source information matches the target signal source information in each of the broadcast signal source information, a communication link is created between the target wearable device corresponding to the target signal source, and interactive control with the target wearable device is performed through the communication link.

[0089] In this embodiment, after the above-mentioned first wearable device further performs a broadcast signal source positioning operation on each second wearable device to identify the broadcast signal source information of each second wearable device relative to itself, the first wearable device matches the sound source information corresponding to the above-mentioned voice information with each broadcast signal source information one by one. Therefore, when the sound source information matches a target signal source among each broadcast signal source information, the first wearable device immediately connects to the target wearable device corresponding to the target signal source among each second wearable device, and establishes a communication link with the target wearable device, thereby further performing interactive control with the target wearable device through the communication link.

[0090] In some feasible embodiments, the first wearable device includes a master device and a slave device. Based on this, after the step S20 of locating the broadcast signal source of each second wearable device in the environment to obtain the broadcast signal source information of each second wearable device, the control method of the wearable device of the present invention may further include:

[0091] Step C: Aggregating the broadcast signal source information of each of the master devices for calibration processing to obtain the final angle value of each of the second wearable devices, wherein the broadcast signal source information of each of the master devices and / or the slave devices is obtained by locating the broadcast signal source;

[0092] Step D: Detecting whether there is a target angle value that matches the sound source information among the final angle values;

[0093] Step E: If it exists, the broadcast signal source information corresponding to the target angle value is determined as the target signal source information that matches the sound source information.

[0094] In this embodiment, after the above-mentioned first wearable device performs a broadcast signal source positioning operation on each second wearable device through the master device and / or the slave device to identify the broadcast signal source information of each second wearable device relative to itself, the above-mentioned first wearable device further aggregates the broadcast signal source information of each second wearable device to the master device for calibration processing, thereby obtaining the final angle value of each second wearable device. Afterwards, the first wearable device matches the sound source information corresponding to the above-mentioned voice information with each final angle value one by one, so that when the sound source information matches a target angle value among each final angle value, it is confirmed that the broadcast signal source corresponding to the target angle value among each broadcast signal source is the target signal source that matches the sound source information.

[0095] For example, Figure 4In the application scenario shown, the main earphone of the TWS earphone worn by user A uses data fusion to aggregate the broadcast signal source information L1_1, R1_1 of the second wearable device b (worn by user B), the broadcast signal source information L2_1, R2_1 of the second wearable device c (worn by user C), and the broadcast signal source information L3_1, R3_1 of the second wearable device d (worn by user D) obtained by performing the process shown in the above steps S201 to S203 on its own main earphone and / or the slave earphone to the main earphone for angle calibration calculation to obtain the final angle values ​​between the TWS earphone of user A and the second wearable device b, the second wearable device c, and the second wearable device d: T1, T2, and T3. Then, the TWS headset worn by user A will compare the sound source azimuth angle of user B relative to himself in the current indoor environment, who has performed the sound source positioning operation for the above voice information, with T1, T2 and T3 respectively, so as to detect the target angle value T1 among T1, T2 and T3 that matches the sound source azimuth angle. Then, the TWS headset worn by user A determines that the broadcast signal source information of the second wearable device b corresponding to the target angle value T1 in the above-mentioned broadcast signal source information is the target signal source that matches the sound source azimuth angle.

[0096] Furthermore, in some feasible embodiments, the step of "creating a communication link between the target wearable device corresponding to the target signal source and performing interactive control with the target wearable device through the communication link" in the above step S30 may include:

[0097] Step S301: establishing a Bluetooth connection between the target wearable device corresponding to the target signal source in each of the second wearable devices;

[0098] Step S302: establishing a communication link with the target wearable device via the Bluetooth connection;

[0099] Step S303: Outputting a preset voice prompt via the communication link to perform interactive control with the target wearable device.

[0100] In this embodiment, when the above-mentioned first wearable device determines that the above-mentioned sound source information matches the target signal source among the various broadcast signal source information, it immediately establishes a Bluetooth connection with the target wearable device corresponding to the target signal source among the various second wearable devices. Thereafter, based on the Bluetooth connection, it further creates a Bluetooth communication link between itself and the target wearable device, thereby further outputting voice prompts for itself and the respective wearers of the target wearable device through the communication link, so that the wearer can perform interactive control based on the function list supported by both itself and the target wearable device.

[0101] For example, Figure 5 In the application scenario shown, after the TWS headset worn by user A determines that the second wearable device b worn by user B is the target wearable device, it analyzes the service type supported by the second wearable device b through its own main headset to establish a Bluetooth connection with the second wearable device b. After that, the TWS headset further creates an LE Audio link with the second wearable device based on the Bluetooth connection (a lower power communication link in Bluetooth 5.2 technology, using the new LC3 encoding, capable of transmitting multiple stream audio and supporting broadcast functions). Furthermore, the TWS headset worn by user A can play the supported function list (such as synchronized equalizer parameters, etc.) with the second wearable device b worn by user B through the LE audio link, and user A can directly perform corresponding functional interactions according to the voice prompts output by the TWS headset through voice broadcast. Among them, the second wearable device b worn by user B transmits the voice prompts including the function information of the second wearable device b to the TWS headset through the LE audio link, and the TWS headset outputs it to user A through voice broadcast. Similarly, user B can also perform corresponding functional interactions according to the voice prompts output by the second wearable device b through voice broadcast.

[0102] Thus, in this embodiment, in an environment with multiple wearable devices, each wearable device acts as a first wearable device to collect voice information in the current environment and detect whether a preset wake-up voice is recognized in the collected voice information. Upon recognizing the wake-up voice in the voice information, the first wearable device immediately performs a sound source localization operation on the voice information to obtain the sound source information of the voice information in the current environment. The first wearable device then further performs a broadcast signal source localization operation on all second wearable devices in the current environment that are broadcasting Bluetooth signals to identify the broadcast signal source information of each second wearable device. Finally, the first wearable device matches the sound source information corresponding to the voice information with each broadcast signal source information one by one. When the sound source information matches a target signal source in each broadcast signal source information, the first wearable device immediately connects to the target wearable device corresponding to the target signal source among the second wearable devices and establishes a communication link with the target wearable device, thereby further performing interactive control with the target wearable device via the communication link.

[0103] Compared to traditional methods where users add and control wearable devices via remote controls or mobile phone apps, this invention uses voice to wake up the first wearable device to trigger connection preparation. It then performs sound source localization to locate the user who issued the voice call, locates the broadcast signal source to search for the locations of other second wearable devices, directly connects to the target wearable device with a matching location, and establishes a communication link for interactive control between the two devices. This allows users to quickly and flexibly connect and interactively control different wearable devices using voice, greatly simplifying user operations and effectively improving the efficiency and experience of user interaction with wearable devices.

[0104] In addition, an embodiment of the present invention further provides a control device for a wearable device, and the control device for a wearable device of the present invention is applied to a first wearable device. Figure 6 , Figure 6 FIG. 1 is a functional module diagram of an embodiment of a control device for a wearable device according to the present invention, as shown in FIG. Figure 6 As shown, the control device of the wearable device of the present invention includes:

[0105] The sound source localization module 10 is used to localize the sound source of the voice information collected from the environment when a preset wake-up voice is recognized, and obtain the sound source information of the voice information;

[0106] The broadcast positioning module 20 is used to locate the broadcast signal source of each second wearable device in the environment to obtain the broadcast signal source information of each second wearable device;

[0107] The connection control module 30 is used to create a communication link between the target wearable device corresponding to the target signal source if the sound source information matches the target signal source information in each of the broadcast signal source information, and to perform interactive control with the target wearable device through the communication link.

[0108] Optionally, the first wearable device is equipped with an array microphone, and the sound source information includes: a sound source azimuth angle;

[0109] The sound source localization module 10 includes:

[0110] An acquisition unit, configured to acquire a time difference of arrival of the voice information through the microphone array;

[0111] A first calculation unit is configured to perform calculation based on the arrival time difference to determine the sound source azimuth angle of the voice information.

[0112] Optionally, the first wearable device is configured with an array antenna, and the broadcast signal source information includes: a broadcast signal azimuth angle;

[0113] The broadcast positioning module 20 includes:

[0114] a signal scanning unit, configured to receive broadcast signals from each of the second wearable devices through the array antenna;

[0115] A second calculation unit, configured to sequentially calculate a phase difference of each of the broadcast signals based on different array elements in the array antenna;

[0116] The third calculation unit is configured to call a preset signal angle estimation algorithm to perform calculation based on each of the phase differences to determine the broadcast signal azimuth angle of each of the second wearable devices.

[0117] Optionally, the connection control module 30 includes:

[0118] a connecting unit, configured to establish a Bluetooth connection between the target wearable device corresponding to the target signal source in each of the second wearable devices;

[0119] A link establishing unit, configured to establish a communication link with the target wearable device via the Bluetooth connection;

[0120] An interactive control unit is used to output a preset voice prompt through the communication link to perform interactive control with the target wearable device.

[0121] Optionally, the control device of the wearable device of the present invention further includes:

[0122] A wake-up setting module is used to set the preset wake-up voice based on the unique identifier of the first wearable device, wherein the unique identifier includes at least one of a Bluetooth name, a device name, and a custom name.

[0123] Optionally, the wake-up setting module is further configured to collect the voice information in the environment and determine that the wake-up voice is recognized from the voice information when detecting that the unique identifier exists in the text information corresponding to the voice information.

[0124] Optionally, the first wearable device includes: a master device and a slave device;

[0125] The control device of the wearable device of the present invention further includes:

[0126] a signal source angle calibration module, configured to aggregate the broadcast signal source information to the master device for calibration processing to obtain a final angle value of each second wearable device, wherein the broadcast signal source information is obtained by positioning the broadcast signal source by the master device and / or the slave device;

[0127] a detection module, configured to detect whether there is a target angle value that matches the sound source information in each of the final angle values;

[0128] The angle matching confirmation module is configured to determine the broadcast signal source information corresponding to the target angle value as the target signal source information matching the sound source information if the detection module detects the existence of the target angle value.

[0129] The specific embodiments of the functional modules of the control device of the wearable device of the present invention during operation are basically the same as the embodiments of the control program method of the wearable device of the present invention described above, and will not be described in detail here.

[0130] The present invention also provides a computer storage medium storing a control program for a wearable device. When the control program for the wearable device is executed by a processor, the steps of the control program method for the wearable device described in any of the above embodiments are implemented.

[0131] The specific embodiments of the computer storage medium of the present invention are basically the same as the above-mentioned embodiments of the control program method for the wearable device of the present invention, and will not be described in detail here.

[0132] The present invention also provides a computer program product, which includes a computer program. When the computer program is executed by a processor, it implements the steps of the control method of the wearable device of the present invention as described in any of the above embodiments, which will not be repeated here.

[0133] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or system comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or system. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or system comprising the element.

[0134] The serial numbers of the above embodiments of the present invention are for description only and do not represent the advantages or disadvantages of the embodiments.

[0135] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better embodiment. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes a number of instructions for enabling a terminal device (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present invention.

[0136] The above are only preferred embodiments of the present invention and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention description and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A control method for a wearable device, characterized in that: The control method of the wearable device is applied to a first wearable device, wherein the first wearable device is configured with an array antenna. The control method of the wearable device includes: When a preset wake-up voice is recognized from voice information collected from the environment, performing sound source localization on the voice information to obtain sound source information of the voice information; Positioning the broadcast signal source of each second wearable device in the environment to obtain broadcast signal source information of each second wearable device; If the sound source information matches the target signal source information in each of the broadcast signal source information, a communication link is established between the target wearable device corresponding to the target signal source, and interactive control with the target wearable device is performed through the communication link; Wherein, the broadcast signal source information includes the broadcast signal azimuth angle; The step of locating the broadcast signal source of each second wearable device in the environment to obtain the broadcast signal source information of each second wearable device includes: receiving a broadcast signal from each of the second wearable devices through the array antenna; Calculating the phase difference of each of the broadcast signals in sequence based on different array elements in the array antenna; A preset signal angle estimation algorithm is called to perform calculation based on each of the phase differences to determine the broadcast signal azimuth angle of each of the second wearable devices.

2. The control method of the wearable device according to claim 1, wherein: The first wearable device is equipped with an array microphone, and the sound source information includes: the direction angle of the sound source; The step of performing sound source localization on the voice information to obtain the sound source information of the voice information includes: Acquiring the arrival time difference of the voice information through the array microphone; A calculation is performed based on the arrival time difference to determine the sound source azimuth angle of the voice information.

3. The control method of the wearable device according to claim 1, wherein: The step of establishing a communication link between the target wearable device corresponding to the target signal source and performing interactive control with the target wearable device through the communication link includes: Establishing a Bluetooth connection between the target wearable device corresponding to the target signal source in each of the second wearable devices; Establishing a communication link with the target wearable device via the Bluetooth connection; A preset voice prompt is output through the communication link to perform interactive control with the target wearable device.

4. The control method of the wearable device according to claim 1, wherein: Before the step of, when a preset wake-up voice is recognized in voice information collected from the environment, performing sound source localization on the voice information to obtain sound source information of the voice information, the method further includes: The preset wake-up voice is set based on a unique identifier of the first wearable device, wherein the unique identifier includes at least one of a Bluetooth name, a device name, and a custom name.

5. The control method of the wearable device according to claim 4, wherein: The method further comprises: When the voice information is collected in the environment and the unique identifier is detected in the text information corresponding to the voice information, it is determined that the wake-up voice is recognized from the voice information.

6. The control method of the wearable device according to claim 1, wherein: The first wearable device includes: a master device and a slave device; After the step of locating the broadcast signal source of each second wearable device in the environment to obtain the broadcast signal source information of each second wearable device, the method further includes: Aggregating the broadcast signal source information of each of the broadcast signal sources to the master device for calibration processing to obtain a final angle value of each of the second wearable devices, wherein the broadcast signal source information of each of the broadcast signal sources is obtained by positioning the broadcast signal source by the master device and / or the slave device; Detecting whether there is a target angle value that matches the sound source information among the final angle values; If so, the broadcast signal source information corresponding to the target angle value is determined as the target signal source information that matches the sound source information.

7. A control device for a wearable device, characterized in that: The control device of the wearable device is applied to a first wearable device, the first wearable device is configured with an array antenna, and the control device of the wearable device includes: A sound source localization module is used to, when a preset wake-up voice is recognized in the voice information collected from the environment, perform sound source localization on the voice information to obtain the sound source information of the voice information; a broadcast positioning module, configured to locate the broadcast signal source of each second wearable device in the environment and obtain the broadcast signal source information of each second wearable device; a connection control module, configured to establish a communication link between the target wearable device corresponding to the target signal source if the sound source information matches the target signal source information in each of the broadcast signal source information, and to perform interactive control with the target wearable device through the communication link; The broadcast signal source information includes the broadcast signal azimuth angle, and the broadcast positioning module is further configured to: receiving a broadcast signal from each of the second wearable devices through the array antenna; Calculating the phase difference of each of the broadcast signals in sequence based on different array elements in the array antenna; A preset signal angle estimation algorithm is called to perform calculation based on each of the phase differences to determine the broadcast signal azimuth angle of each of the second wearable devices.

8. A terminal device, characterized in that: The terminal device includes: a memory, a processor, and a control program for a wearable device stored in the memory and executable on the processor. When the control program for the wearable device is executed by the processor, the steps of the control method for a wearable device as described in any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a control program for the wearable device, and when the control program for the wearable device is executed by the processor, the steps of the control method for the wearable device according to any one of claims 1 to 6 are implemented.

Citation Information

Patent Citations

  • Voice interaction method and system, terminal and readable storage medium

    CN110364156A

  • Positioning method and electronic device

    WO2022001147A1