Intelligent wearable device and control method between wireless earphones

Abstract

The embodiment of the invention provides an intelligent wearable device and a control method between wireless earphones, and the method comprises the steps: when a first device and a second device are worn by the same user, the first device detects the hand motion of the user, and transmits the detected hand motion information to a central device; the central equipment receives the hand action information, searches a corresponding control instruction from a preset control instruction library according to the hand action information, and then sends the searched control instruction to the second equipment; the second equipment receives the control instruction and executes a control operation corresponding to the control instruction; wherein the intelligent wearable device and the wireless earphone are a first device and a second device for each other. In this way, seamless interaction control between the intelligent wearable device and the wireless earphone can be realized through hand actions depending on the instruction mapping and forwarding capability of the central device, so that the control barrier between devices is effectively broken, and the continuity and naturalness of cross-device operation are improved.

Description

Technical Field

[0001] This disclosure relates to the field of device control technology, and in particular to a control method between a smart wearable device and a wireless headset. Background Technology

[0002] With the increasing popularity of smart wearable devices and wireless headphones, users have become accustomed to using them for various scenarios such as daily music playback, calls, and multimedia interaction, significantly enhancing the convenience and immersion of mobile life. However, most smart wearable devices and wireless headphones are currently functionally isolated, failing to achieve effective collaborative operation. This isolation between devices not only limits the possibility of functional integration but also increases the cumbersome nature of multitasking for users, ultimately significantly impacting the overall experience. Therefore, promoting the improvement of interoperability and collaborative control capabilities between devices has become an important direction for enhancing user satisfaction. Summary of the Invention

[0003] In a first aspect, embodiments of this disclosure provide a control method between a smart wearable device and wireless earphones, the method comprising: When the first device and the second device are worn by the same user, the first device detects the user's hand movements and sends the detected hand movement information to the central device; The central device receives hand movement information, searches for the corresponding control command in the preset control command library based on the hand movement information, and then sends the found control command to the second device. The second device receives control commands and executes control operations corresponding to the control commands; Among them, smart wearable devices and wireless headphones are each other's first and second devices.

[0004] In some possible implementations of the first aspect, the first device is a smart wearable device and the second device is a wireless headset; When the wireless earphone is in use, the wireless earphone detects the surrounding area through the integrated camera. If it detects the area of ​​the hand wearing the smart wearable device, it captures an image of the hand area, including the smart wearable device. Based on the hand area image, it identifies whether the smart wearable device and the wireless earphone are worn by the same user. If the identification result is that the smart wearable device and the wireless earphone are worn by the same user, the identification result is informed to the smart wearable device through the central device.

[0005] In some possible implementations of the first aspect, the wireless earphones identify whether the smart wearable device and the wireless earphones are worn by the same user based on an image of the hand area, including: The wireless earphone enhances the color and saturation of a hand region image, and then inputs the enhanced hand region image into a pre-trained recognition model. The recognition model processes the enhanced hand region image to identify whether the smart wearable device and the wireless earphone are worn by the same user. The recognition model is trained on a pre-set MobileNet model based on a dataset containing multiple samples. The samples are labeled enhanced hand region images, and the labels are used to characterize whether the smart wearable device and the wireless earphone are worn by the same user.

[0006] In some possible implementations of the first aspect, the wireless headphones enhance the color and saturation of the image of the hand area, including: The wireless earphone converts the hand area image from the RGB color space to the HSL color space, and then performs channel separation on the converted HSL color space image to obtain the H channel, S channel, and L channel. Then, it enhances the S channel based on the H channel, and combines the enhanced S channel with the H and L channels. Next, it converts the combined image from the HSL color space back to the RGB color space, and then combines the H channel with the R, G, and B channels of the converted RGB color space image to obtain a hand area image with enhanced color and saturation.

[0007] In some possible implementations of the first aspect, the wireless earphone enhances the S channel based on the H channel, including: The wireless earphone calculates a normalized hue histogram based on the H channel, and uses the hue histogram to determine the principal hue distribution and hue entropy value. Based on the principal hue distribution and hue entropy value, a dynamic enhancement function is constructed. The dynamic enhancement function is used to enhance the S channel, and gradient constraints are used to protect the hue transition boundaries corresponding to the S channel.

[0008] In some possible implementations of the first aspect, the wireless earphones identify whether the smart wearable device and the wireless earphones are worn by the same user based on an image of the hand area, including: The wireless earphones identify the boundary contour of the smart wearable device based on the image of the hand area, calculate the pixel size of the boundary contour, retrieve the pre-stored actual physical size of the smart wearable device and the focal length parameters of the camera, substitute the pixel size, actual physical size and focal length parameters into the perspective projection model, calculate the spatial distance between the wireless earphones and the smart wearable device, and identify whether the smart wearable device and the wireless earphones are worn by the same user based on the spatial distance.

[0009] In some possible implementations of the first aspect, the wireless earphones identify whether the smart wearable device and the wireless earphones are worn by the same user based on spatial distance, including: The wireless earphone identifies key hand joints based on the hand area image to construct a hand plane, calculates the angle between the hand plane and the optical axis of the camera, compensates and calibrates the spatial distance based on the angle, and identifies whether the smart wearable device and the wireless earphone are worn by the same user based on the calibrated spatial distance.

[0010] In some possible implementations of the first aspect, the first device is a wireless headset and the second device is a smart wearable device; The wireless earphone detects the spatial distance between itself and the smart wearable device. If the spatial distance is less than or equal to a preset threshold, it is determined that the earphone and the smart wearable device are worn by the same user. If the spatial distance is greater than the preset threshold, it is determined that the earphone and the smart wearable device are not worn by the same user.

[0011] In some possible implementations of the first aspect, the wireless earphones detect the spatial distance between themselves and the smart wearable device, including: The wireless earphones send a UWB pulse request signal to the smart wearable device and record the timestamp of the UWB pulse request signal transmission. The smart wearable device receives the UWB pulse request signal and records the timestamp of the UWB pulse request signal reception. Then it sends the UWB pulse response signal to the wireless earphone and records the timestamp of the UWB pulse response signal transmission. Next, it sends the timestamps of the UWB pulse request signal reception and the UWB pulse response signal transmission to the wireless earphone. The wireless earphone receives the UWB pulse response signal and records the UWB pulse response signal reception timestamp. In addition, it also receives the UWB pulse request signal reception timestamp and the UWB pulse response signal transmission timestamp. Based on the UWB pulse request signal transmission timestamp, UWB pulse request signal reception timestamp, UWB pulse response signal transmission timestamp, and UWB pulse response signal reception timestamp, it calculates the signal propagation time and, based on this, calculates the spatial distance between itself and the smart wearable device.

[0012] In some possible implementations of the first aspect, the wireless earphones detect the spatial distance between themselves and the smart wearable device, including: The wireless earphones use an integrated camera to detect the surrounding area. If the earphones detect the area of ​​the hand wearing the smart wearable device, they capture an image of the hand area, including the smart wearable device, and then detect the spatial distance between themselves and the smart wearable device based on the hand area image.

[0013] In some possible implementations of the first aspect, the wireless earphones detect the spatial distance between themselves and the smart wearable device based on an image of the hand area, including: The wireless earphone enhances the color and saturation of the hand area image, identifies the boundary contour of the smart wearable device based on the enhanced hand area image, calculates the pixel size of the boundary contour, identifies key hand joints based on the enhanced hand area image to construct a hand plane, calculates the angle between the hand plane and the optical axis of the camera, retrieves the pre-stored actual physical size of the smart wearable device and the focal length parameters of the camera, and substitutes the pixel size, angle, actual physical size and focal length parameters into the perspective projection model to calculate the spatial distance between itself and the smart wearable device.

[0014] In some possible implementations of the first aspect, the wireless headphones enhance the color and saturation of the image of the hand area, including: The wireless earphone converts the hand area image from the RGB color space to the HSL color space, and then performs channel separation on the converted HSL color space image to obtain the H channel, S channel, and L channel. Then, it enhances the S channel based on the H channel, and combines the enhanced S channel with the H and L channels. Next, it converts the combined image from the HSL color space back to the RGB color space, and then combines the H channel with the R, G, and B channels of the converted RGB color space image to obtain a hand area image with enhanced color and saturation.

[0015] In some possible implementations of the first aspect, the wireless earphone enhances the S channel based on the H channel, including: The wireless earphone calculates a normalized hue histogram based on the H channel, and uses the hue histogram to determine the principal hue distribution and hue entropy value. Based on the principal hue distribution and hue entropy value, a dynamic enhancement function is constructed. The dynamic enhancement function is used to enhance the S channel, and gradient constraints are used to protect the hue transition boundaries corresponding to the S channel.

[0016] Secondly, embodiments of this disclosure provide a control system between a smart wearable device and a wireless earphone, the system comprising: a first device, a central device, and a second device; When the first device and the second device are worn by the same user, the first device detects the user's hand movements and sends the detected hand movement information to the central device; The central device receives hand movement information, searches for the corresponding control command in the preset control command library based on the hand movement information, and then sends the found control command to the second device. The second device receives control commands and executes control operations corresponding to the control commands; Among them, smart wearable devices and wireless headphones are each other's first and second devices.

[0017] Thirdly, embodiments of this disclosure provide an electronic device comprising: at least one processor; and a memory communicatively connected to the at least one processor; the memory storing instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the method described above.

[0018] Fourthly, embodiments of this disclosure provide a non-transitory computer-readable storage medium storing computer instructions for causing a computer to perform the methods described above.

[0019] Compared with the prior art, this disclosure has at least the following technical effects: Leveraging the command mapping and forwarding capabilities of the central device, seamless interactive control between smart wearable devices and wireless headphones can be achieved through hand gestures. This effectively breaks down control barriers between devices, improves the continuity and naturalness of cross-device operation, and enables users to achieve a more efficient and intuitive multi-device collaborative experience in different scenarios.

[0020] It should be understood that the description in the Summary of the Invention is not intended to limit the key or essential features of the embodiments of this disclosure, nor is it intended to restrict the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0021] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. The drawings are provided for a better understanding of the invention and are not intended to limit the scope of this disclosure. In the drawings, the same or similar reference numerals denote the same or similar elements, wherein: Figure 1 A flowchart illustrating a control method between a smart wearable device and wireless headphones provided in an embodiment of this disclosure is shown. Figure 2 A flowchart is shown showing another control method between a smart wearable device and wireless headphones provided in an embodiment of this disclosure; Figure 3 A flowchart is shown illustrating another control method between a smart wearable device and a wireless headset provided in an embodiment of this disclosure; Figure 4 This diagram illustrates a structural diagram of a control system between a smart wearable device and wireless headphones, according to an embodiment of this disclosure. Figure 5 A structural diagram of an exemplary electronic device capable of implementing embodiments of the present disclosure is shown. Detailed Implementation

[0022] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this disclosure, and not all embodiments. Based on the embodiments of this disclosure, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this disclosure.

[0023] Furthermore, the term "and / or" in this article is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. Additionally, the character " / " in this article generally indicates that the preceding and following related objects have an "or" relationship.

[0024] To address the problems in the background art, this disclosure provides a control method, system, device, and storage medium for a smart wearable device and a wireless earphone. Specifically, when a first device and a second device are worn by the same user, the first device detects the user's hand movements and sends the detected hand movement information to a central device; the central device receives the hand movement information, searches for the corresponding control command in a preset control command library based on the hand movement information, and then sends the found control command to the second device; the second device receives the control command and executes the control operation corresponding to the control command; wherein, the smart wearable device and the wireless earphone are each other's first device and second device.

[0025] In this way, relying on the command mapping and forwarding capabilities of the central device, seamless interactive control between smart wearable devices and wireless headphones can be achieved through hand gestures, thereby effectively breaking down the control barriers between devices, improving the continuity and naturalness of cross-device operation, and enabling users to achieve a more efficient and intuitive multi-device collaborative experience in different scenarios.

[0026] The following detailed description, with reference to the accompanying drawings, illustrates a control method, system, device, and storage medium between a smart wearable device and wireless headphones provided in this disclosure, through specific embodiments.

[0027] Figure 1 A flowchart illustrating a control method between a smart wearable device and wireless headphones according to an embodiment of this disclosure is shown, such as... Figure 1 As shown, method 100 may include the following steps: S110, when the first device and the second device are worn by the same user, the first device detects the user's hand movements and sends the detected hand movement information to the central device.

[0028] S120, the central device receives hand movement information, searches for the corresponding control command in the preset control command library based on the hand movement information, and then sends the found control command to the second device.

[0029] S130, the second device receives the control command and executes the control operation corresponding to the control command.

[0030] Among them, smart wearable devices and wireless headphones are each other's first and second devices.

[0031] In summary, the embodiments disclosed herein achieve at least the following technical effects: Leveraging the command mapping and forwarding capabilities of the central device, seamless interactive control between smart wearable devices and wireless headphones can be achieved through hand gestures. This effectively breaks down control barriers between devices, improves the continuity and naturalness of cross-device operation, and enables users to achieve a more efficient and intuitive multi-device collaborative experience in different scenarios.

[0032] To facilitate understanding of the control method provided in the embodiments of this disclosure, the following is combined with... Figures 2-3 The control methods are described separately when the first device is a smart wearable device and the second device is a wireless headset, and when the first device is a wireless headset and the second device is a smart wearable device.

[0033] like Figure 2 As shown, when the first device is a smart wearable device and the second device is a wireless headset, method 200 may include the following steps: S210: When the smart wearable device and wireless headphones are worn by the same user, the smart wearable device detects the user's hand movements.

[0034] Specifically, when a smart wearable device (such as a smartphone, smartwatch, smart bracelet, smart necklace, smart ring, smart glasses, etc.) and a wireless earphone are worn by the same user, the smart wearable device can accurately detect the user's hand movements (such as touch screen actions such as screen tapping, screen drawing, screen dragging, finger extension, fist clenching, hand shaking, etc.) through built-in sensors (such as inertial measurement sensors, millimeter-wave radar sensors, etc.).

[0035] S220, the smart wearable device sends the detected hand movement information to the central device (such as the earphone box).

[0036] S230, the central device receives hand movement information and searches for the corresponding control command from the preset control command library based on the hand movement information.

[0037] The preset control instruction library stores various hand movement information and their corresponding control instructions, which users can add, delete, modify, and query according to their actual needs.

[0038] S240, the central device sends the located control command to the wireless headset.

[0039] The S250 wireless headset receives control commands and executes the corresponding control operations.

[0040] The control operations can include song switching, answering / hanging up calls, volume control, voice assistant activation, fast forward / rewind, etc., and there are no restrictions on these operations.

[0041] It is worth noting that method 200 can effectively determine whether the smart wearable device and the wireless headphones are worn by the same user through the following steps: When the wireless earphone is in use, the wireless earphone detects the surrounding area through the integrated camera. If it detects the area of ​​the hand wearing the smart wearable device, it captures an image of the hand area, including the smart wearable device. Based on the hand area image, it identifies whether the smart wearable device and the wireless earphone are worn by the same user. If the identification result is that the smart wearable device and the wireless earphone are worn by the same user, the identification result is informed to the smart wearable device through the central device.

[0042] For example, the aforementioned wireless earphones can identify whether the smart wearable device and the wireless earphones are worn by the same user based on the hand area image, including the following two methods: Method 1: The wireless earphone enhances the color and saturation of a hand region image, and then inputs the enhanced hand region image into a pre-trained recognition model. The recognition model processes the enhanced hand region image to determine whether the smart wearable device and the wireless earphone are worn by the same user. The recognition model is trained on a pre-defined MobileNet model using a dataset containing multiple labeled enhanced hand region images. The labels are used to indicate whether the smart wearable device and the wireless earphone are worn by the same user.

[0043] In this way, the recognizability of hand area image features can be improved by enhancing color and saturation, and high-precision recognition of the same user identity across devices can be achieved through a lightweight deep learning model.

[0044] Method 2: The wireless earphone recognizes the boundary outline of the smart wearable device based on the image of the hand area, calculates the pixel size of the boundary outline, retrieves the pre-stored actual physical size of the smart wearable device and the focal length parameters of the camera, substitutes the pixel size, actual physical size and focal length parameters into the perspective projection model, calculates the spatial distance between the wireless earphone and the smart wearable device, and identifies whether the smart wearable device and the wireless earphone are worn by the same user based on the spatial distance.

[0045] In this way, high-precision identification of the same user across devices can be achieved by calculating the spatial distance between the wireless earphone and the smart wearable device, reducing the amount of data calculation and improving identification efficiency.

[0046] Alternatively, the color and saturation enhancement in Method 1 can be achieved through the following steps: The wireless earphone converts the hand area image from the RGB color space to the HSL color space, and then performs channel separation on the converted HSL color space image to obtain the H channel, S channel, and L channel. Then, it enhances the S channel based on the H channel, and combines the enhanced S channel with the H and L channels. Next, it converts the combined image from the HSL color space back to the RGB color space, and then combines the H channel with the R, G, and B channels of the converted RGB color space image to obtain a hand area image with enhanced color and saturation.

[0047] Alternatively, the enhancement of the S channel by the H channel in the wireless headphones mentioned here can be further elaborated as follows: The wireless earphone calculates a normalized hue histogram based on the H channel, and uses this histogram to determine the dominant hue distribution and hue entropy value. Then, a dynamic enhancement function is constructed based on the dominant hue distribution and hue entropy value. This function is used to enhance the S channel, and gradient constraints are applied to protect the hue transition boundaries corresponding to the S channel. The dynamic enhancement function and enhancement process can be described as follows: (1) (2) In the formula, Indicates the dynamic enhancement value; express One main hue; Indicates pixel hue; Indicates the ring distance; Indicates the range of enhanced control; This represents the enhancement factor, which is dynamically adjusted by the hue entropy value. The larger the hue entropy value, the stronger the enhancement factor. The smaller the value, the smaller the hue entropy value. The larger; This indicates the enhanced pixel saturation. This indicates the saturation of the original pixel.

[0048] Alternatively, the perspective projection model in Method 2 can be as follows: (3) In the formula, This indicates the spatial distance between the wireless headphones and the smart wearable device; Indicates the actual physical size of the smart wearable device; This indicates the camera's focal length parameter; This indicates the pixel size of the smart wearable device, which is the pixel size of the smart wearable device's boundary outline in the hand area image.

[0049] Furthermore, to improve the accuracy of identifying the same user, the wireless earphone can also identify key hand joints based on the hand area image to construct a hand plane, calculate the angle between the hand plane and the optical axis of the camera, and perform spatial distance compensation calibration based on the angle. The calibrated spatial distance is then used to determine whether the smart wearable device and the wireless earphone are worn by the same user. Specifically, if the calibrated spatial distance is less than or equal to a preset threshold (e.g., 0.8 meters), the smart wearable device and the wireless earphone are worn by the same user; otherwise, they are not. The compensation calibration is implemented as follows: (4) In the formula, Indicates the calibrated spatial distance; Indicates spatial distance; This indicates the angle between the plane of the hand and the optical axis of the camera.

[0050] like Figure 3 As shown, when the first device is a wireless headset and the second device is a smart wearable device, method 300 may include the following steps: The S310 allows wireless earbuds to detect the user's hand movements via an integrated camera when worn by the same user as a smart wearable device.

[0051] In some embodiments, the wireless earphone can detect the spatial distance between itself and the smart wearable device. If the spatial distance is less than or equal to a preset threshold (e.g., 0.8 meters), it is determined that the earphone and the smart wearable device are worn by the same user. Otherwise, it is determined that the earphone and the smart wearable device (e.g., smartphone, smartwatch, smart bracelet, smart necklace, smart ring, smart glasses, etc.) are not worn by the same user. If it is subsequently detected that the earphone and the smart wearable device are worn by the same user, the user's hand movements (e.g., touch screen actions such as screen tapping, screen drawing, screen dragging, finger extension, fist clenching, hand shaking, etc.) are detected through the integrated camera.

[0052] For example, wireless headphones can detect the spatial distance between themselves and smart wearable devices in the following two ways: Method 1: The wireless earphone sends a UWB pulse request signal to the smart wearable device and records the transmission timestamp of the UWB pulse request signal. The smart wearable device receives the UWB pulse request signal, records the reception timestamp of the UWB pulse request signal, and then sends a UWB pulse response signal to the wireless earphone, recording the transmission timestamp of the UWB pulse response signal. It then sends both the reception timestamp of the UWB pulse request signal and the transmission timestamp of the UWB pulse response signal to the wireless earphone. The wireless earphone receives the UWB pulse response signal, records the reception timestamp of the UWB pulse response signal, and also receives the reception timestamp of the UWB pulse request signal and the transmission timestamp of the UWB pulse response signal. Based on these timestamps, it calculates the signal propagation time and, based on this, calculates the spatial distance between itself and the smart wearable device.

[0053] The formulas for calculating the signal propagation time and spatial distance are as follows: (5) (6) In the formula, Indicates the duration of signal propagation; Indicates the timestamp of the UWB pulse request signal transmission; Indicates the timestamp of the UWB pulse request signal reception; Indicates the timestamp of the UWB pulse response signal transmission; Indicates the timestamp of the UWB pulse response signal reception; Indicates spatial distance; It represents the speed of light.

[0054] In this way, UWB ranging technology can be used to accurately sense the spatial distance between wireless headphones and smart wearable devices, achieving centimeter-level accuracy and thus significantly improving the reliability of spatial distance detection.

[0055] Method 2: The wireless earphone detects the surrounding area through an integrated camera. If it detects the area of ​​the hand wearing the smart wearable device, it captures an image of the hand area including the smart wearable device and detects the spatial distance between itself and the smart wearable device based on the hand area image.

[0056] Specifically, the wireless earphones' ability to detect the spatial distance between themselves and the smart wearable device based on the hand area image can include the following steps: The wireless earphone enhances the color and saturation of the hand area image, identifies the boundary contour of the smart wearable device based on the enhanced hand area image, calculates the pixel size of the boundary contour, identifies key hand joints based on the enhanced hand area image to construct a hand plane, calculates the angle between the hand plane and the optical axis of the camera, retrieves the pre-stored actual physical size of the smart wearable device and the focal length parameters of the camera, and substitutes the pixel size, angle, actual physical size and focal length parameters into the perspective projection model to calculate the spatial distance between itself and the smart wearable device.

[0057] The aforementioned color and saturation enhancements can be achieved through the following steps: The wireless earphone converts the hand area image from the RGB color space to the HSL color space, and then performs channel separation on the converted HSL color space image to obtain the H channel, S channel, and L channel. Then, it enhances the S channel based on the H channel, and combines the enhanced S channel with the H and L channels. Next, it converts the combined image from the HSL color space back to the RGB color space, and then combines the H channel with the R, G, and B channels of the converted RGB color space image to obtain a hand area image with enhanced color and saturation.

[0058] Optionally, the wireless earphone's enhancement of the S channel based on the H channel can be further elaborated as follows: The wireless earphone calculates a normalized hue histogram based on the H channel, and uses the hue histogram to determine the principal hue distribution and hue entropy value. Then, a dynamic enhancement function is constructed based on the principal hue distribution and hue entropy value. The dynamic enhancement function is used to enhance the S channel, and gradient constraints are used to protect the hue transition boundaries corresponding to the S channel.

[0059] As an example, the above dynamic enhancement function and enhancement process can be described as follows: (7) (8) In the formula, Indicates the dynamic enhancement value; express One main hue; Indicates pixel hue; Indicates the ring distance; Indicates the range of enhanced control; This represents the enhancement factor, which is dynamically adjusted by the hue entropy value. The larger the hue entropy value, the stronger the enhancement factor. The smaller the value, the smaller the hue entropy value. The larger; This indicates the enhanced pixel saturation. This indicates the saturation of the original pixel.

[0060] It is worth noting that the above perspective projection model can be represented as follows: (9) In the formula, This indicates the spatial distance between the wireless headphones and the smart wearable device; Indicates the actual physical size of the smart wearable device; This indicates the camera's focal length parameter; This indicates the pixel size of the smart wearable device, which is also the pixel size of the smart wearable device's boundary outline in the hand area image; This indicates the angle between the plane of the hand and the optical axis of the camera.

[0061] In this way, computer vision technology can be used to accurately perceive the spatial distance between wireless headphones and smart wearable devices, thereby achieving near-field ranging with millimeter-level accuracy. Moreover, it can break through the physical limitations of traditional wireless ranging and maintain stability in complex electromagnetic environments.

[0062] S320: The wireless earphones send detected hand gesture information to a central device (such as the earphone case).

[0063] S330: The central device receives hand movement information and searches for the corresponding control command from the preset control command library based on the hand movement information.

[0064] The preset control instruction library stores various hand movement information and their corresponding control instructions, which users can add, delete, modify, and query according to their actual needs.

[0065] S340, the central device sends the found control command to the smart wearable device.

[0066] S350: The smart wearable device receives control commands and executes the corresponding control operations.

[0067] The control operations can include voice assistant wake-up, menu scrolling, map zooming, emergency calls, etc., and there are no restrictions on them.

[0068] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that this disclosure is not limited to the described order of actions, because according to this disclosure, some steps can be performed in other orders or simultaneously. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily essential to this disclosure.

[0069] The above is an introduction to the method embodiments. The following system embodiments will further illustrate the solution described in this disclosure.

[0070] Figure 4 This diagram illustrates a structural diagram of a control system between a smart wearable device and wireless headphones, as provided in an embodiment of this disclosure. Figure 4 As shown, system 400 may include: a first device 410, a central device 420, and a second device 430.

[0071] The central device 420 maintains communication connections with the first device 410 and the second device 430, respectively, and the communication method can be Bluetooth or other wireless communication protocols.

[0072] The first device 410 is used to detect the user's hand movements and send the detected hand movement information to the central device when the first device and the second device are worn by the same user.

[0073] The central device 420 is used to receive hand movement information, search for the corresponding control command from the preset control command library based on the hand movement information, and then send the found control command to the second device.

[0074] The second device 430 is used to receive control commands and execute control operations corresponding to the control commands.

[0075] Among them, the smart wearable device and the wireless earphone are the first device 410 and the second device 430, respectively.

[0076] Understandable Figure 4 Each module / unit in the system 400 shown has the ability to implement Figure 1 The functions of each step in method 100 shown, and their corresponding technical effects, will not be elaborated here for the sake of brevity.

[0077] Figure 5 A structural diagram of an exemplary electronic device capable of implementing embodiments of the present disclosure is shown. Electronic device 500 is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. Electronic device 500 may also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0078] like Figure 5As shown, the electronic device 500 may include a computing unit 501, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 502 or a computer program loaded from a storage unit 508 into a random access memory (RAM) 503. The RAM 503 may also store various programs and data required for the operation of the electronic device 500. The computing unit 501, ROM 502, and RAM 503 are interconnected via a bus 504. An input / output (I / O) interface 505 is also connected to the bus 504.

[0079] Multiple components in electronic device 500 are connected to I / O interface 505, including: input unit 506, such as keyboard, mouse, etc.; output unit 507, such as various types of monitors, speakers, etc.; storage unit 508, such as disk, optical disk, etc.; and communication unit 509, such as network card, modem, wireless transceiver, etc. Communication unit 509 allows electronic device 500 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0080] The computing unit 501 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the computing unit 501 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 501 performs the various methods and processes described above, such as method 100. For example, in some embodiments, method 100 may be implemented as a computer program product, including a computer program tangibly contained in a computer-readable medium, such as storage unit 508. In some embodiments, part or all of the computer program may be loaded and / or installed on device 500 via ROM 502 and / or communication unit 509. When the computer program is loaded into RAM 503 and executed by the computing unit 501, one or more steps of method 100 described above may be performed. Alternatively, in other embodiments, the computing unit 501 may be configured to perform method 100 by any other suitable means (e.g., by means of firmware).

[0081] The various embodiments described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-a-chip (SoCs), payload programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0082] The program code used to implement the methods of this disclosure may be written in any combination of one or more programming languages. This program code may be provided to a processor or controller of a general-purpose computer, special-purpose computer, or other programmable data processing apparatus, such that when executed by the processor or controller, the program code causes the functions / operations specified in the flowcharts and / or block diagrams to be implemented. The program code may be executed entirely on a machine, partially on a machine, as a standalone software package partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0083] In the context of this disclosure, a computer-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. A computer-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of computer-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0084] It should be noted that this disclosure also provides a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause a computer to execute method 100 and achieve the corresponding technical effects achieved by executing the method in the embodiments of this disclosure. For the sake of brevity, they will not be described in detail here.

[0085] In addition, this disclosure also provides a computer program product including a computer program that implements method 100 when executed by a processor.

[0086] To provide interaction with a user, the embodiments described above can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0087] The embodiments described above can be implemented in computing systems that include backend components (e.g., as a data server), or computing systems that include middleware components (e.g., an application server), or computing systems that include frontend components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with the implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., a communication network). Examples of communication networks include local area networks (LANs), wide area networks (WANs), and the Internet.

[0088] Computer systems can include clients and servers. Clients and servers are generally located far apart and typically interact via communication networks. Client-server relationships are created by computer programs running on the respective computers and having a client-server relationship with each other. Servers can be cloud servers, servers in distributed systems, or servers incorporating blockchain technology.

[0089] It should be understood that the various forms of processes shown above can be used to rearrange, add, or delete steps. For example, the steps described in this disclosure can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution disclosed in this disclosure can be achieved, and this is not limited herein.

[0090] The specific embodiments described above do not constitute a limitation on the scope of protection of this disclosure. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this disclosure should be included within the scope of protection of this disclosure.

Claims

1. A control method between a smart wearable device and wireless headphones, characterized in that, The method includes: When the first device and the second device are worn by the same user, the first device detects the user's hand movements and sends the detected hand movement information to the central device; The central device receives hand movement information, searches for the corresponding control command in the preset control command library based on the hand movement information, and then sends the found control command to the second device. The second device receives control commands and executes control operations corresponding to the control commands; Among them, smart wearable devices and wireless headphones are each other's first and second devices.

2. The method according to claim 1, characterized in that, The first device is a smart wearable device, and the second device is a wireless headset; When the wireless earphone is in the wearing state, the wireless earphone detects the surrounding area through the integrated camera. If the hand area of ​​the smart wearable device is detected, an image of the hand area of ​​the smart wearable device is captured. Based on the hand area image, it is identified whether the smart wearable device and the wireless earphone are worn by the same user. If the identification result is that the smart wearable device and the wireless earphone are worn by the same user, the identification result is informed to the smart wearable device through the central device.

3. The method according to claim 2, characterized in that, The wireless earphone identifies whether the smart wearable device and the wireless earphone are worn by the same user based on the hand area image, including: The wireless earphone enhances the color and saturation of the hand region image and inputs the enhanced hand region image into a pre-trained recognition model. The recognition model processes the enhanced hand region image to identify whether the smart wearable device and the wireless earphone are worn by the same user. The recognition model is trained on a preset MobileNet model based on a dataset containing multiple samples, where the samples are labeled enhanced hand region images. The labels are used to characterize whether the smart wearable device and the wireless earphone are worn by the same user.

4. The method according to claim 3, characterized in that, The wireless earphone enhances the color and saturation of the hand area image, including: The wireless earphone converts the hand area image from RGB color space to HSL color space, and performs channel separation on the converted HSL color space image to obtain H channel, S channel, and L channel. Then, it enhances the S channel based on the H channel, combines the enhanced S channel with the H and L channels, and then converts the combined image from HSL color space to RGB color space. Finally, it combines the H channel with the R, G, and B channels of the converted RGB color space image to obtain a hand area image with enhanced color and saturation.

5. The method according to claim 4, characterized in that, The wireless earphone enhances the S channel based on the H channel, including: The wireless earphone calculates a normalized hue histogram based on the H channel, and uses the hue histogram to determine the principal hue distribution and hue entropy value. Based on the principal hue distribution and the hue entropy value, a dynamic enhancement function is constructed. The dynamic enhancement function is used to enhance the S channel, and gradient constraints are used to protect the hue transition boundaries corresponding to the S channel.

6. The method according to claim 2, characterized in that, The wireless earphone identifies whether the smart wearable device and the wireless earphone are worn by the same user based on the hand area image, including: The wireless earphone identifies the boundary contour of the smart wearable device based on the hand area image, calculates the pixel size of the boundary contour, retrieves the pre-stored actual physical size of the smart wearable device and the focal length parameters of the camera, substitutes the pixel size, the actual physical size and the focal length parameters into the perspective projection model, calculates the spatial distance between the wireless earphone and the smart wearable device, and identifies whether the smart wearable device and the wireless earphone are worn by the same user based on the spatial distance.

7. The method according to claim 6, characterized in that, The wireless earphone identifies whether the smart wearable device and the wireless earphone are worn by the same user based on the spatial distance, including: The wireless earphone identifies key hand joints based on the hand area image to construct a hand plane, calculates the angle between the hand plane and the optical axis of the camera, compensates and calibrates the spatial distance based on the angle, and identifies whether the smart wearable device and the wireless earphone are worn by the same user based on the calibrated spatial distance.

8. The method according to claim 1, characterized in that, The first device is a wireless headset, and the second device is a smart wearable device; The wireless earphone detects the spatial distance between itself and the smart wearable device. If the spatial distance is less than or equal to a preset threshold, it is determined that the earphone and the smart wearable device are worn by the same user. If the spatial distance is greater than the preset threshold, it is determined that the earphone and the smart wearable device are not worn by the same user.

9. The method according to claim 8, characterized in that, The wireless earphone detects the spatial distance between itself and the smart wearable device, including: The wireless earphone sends a UWB pulse request signal to the smart wearable device and records the UWB pulse request signal transmission timestamp; The smart wearable device receives the UWB pulse request signal and records the UWB pulse request signal reception timestamp. Then it sends a UWB pulse response signal to the wireless earphone and records the UWB pulse response signal transmission timestamp. Next, it sends the UWB pulse request signal reception timestamp and the UWB pulse response signal transmission timestamp to the wireless earphone. The wireless earphone receives the UWB pulse response signal and records the UWB pulse response signal reception timestamp. In addition, it also receives the UWB pulse request signal reception timestamp and the UWB pulse response signal transmission timestamp. Based on the UWB pulse request signal transmission timestamp, UWB pulse request signal reception timestamp, UWB pulse response signal transmission timestamp, and UWB pulse response signal reception timestamp, it calculates the signal propagation duration and calculates the spatial distance between itself and the smart wearable device.

10. The method according to claim 8, characterized in that, The wireless earphone detects the spatial distance between itself and the smart wearable device, including: The wireless earphone detects the surrounding area using an integrated camera. If it detects the area of ​​the hand wearing the smart wearable device, it captures an image of the hand area, including the smart wearable device, and detects the spatial distance between itself and the smart wearable device based on the hand area image.

11. The method according to claim 10, characterized in that, The wireless earphones detect the spatial distance between themselves and the smart wearable device based on the hand area image, including: The wireless earphone enhances the color and saturation of the hand area image, identifies the boundary contour of the smart wearable device based on the enhanced hand area image, calculates the pixel size of the boundary contour, identifies key hand joints based on the enhanced hand area image to construct a hand plane, calculates the angle between the hand plane and the optical axis of the camera, retrieves the pre-stored actual physical size of the smart wearable device and the focal length parameters of the camera, and substitutes the pixel size, the angle, the actual physical size, and the focal length parameters into a perspective projection model to calculate the spatial distance between itself and the smart wearable device.

12. The method according to claim 11, characterized in that, The wireless earphone enhances the color and saturation of the hand area image, including: The wireless earphone converts the hand area image from RGB color space to HSL color space, and performs channel separation on the converted HSL color space image to obtain H channel, S channel, and L channel. Then, it enhances the S channel based on the H channel, combines the enhanced S channel with the H and L channels, and then converts the combined image from HSL color space to RGB color space. Finally, it combines the H channel with the R, G, and B channels of the converted RGB color space image to obtain a hand area image with enhanced color and saturation.

13. The method according to claim 12, characterized in that, The wireless earphone enhances the S channel based on the H channel, including: The wireless earphone calculates a normalized hue histogram based on the H channel, and uses the hue histogram to determine the principal hue distribution and hue entropy value. Based on the principal hue distribution and the hue entropy value, a dynamic enhancement function is constructed. The dynamic enhancement function is used to enhance the S channel, and gradient constraints are used to protect the hue transition boundaries corresponding to the S channel.

14. A control system between a smart wearable device and wireless headphones, characterized in that, The system includes: a first device, a central device, and a second device; When the first device and the second device are worn by the same user, the first device detects the user's hand movements and sends the detected hand movement information to the central device; The central device receives hand movement information, searches for the corresponding control command in the preset control command library based on the hand movement information, and then sends the found control command to the second device. The second device receives control commands and executes control operations corresponding to the control commands; Among them, smart wearable devices and wireless headphones are each other's first and second devices.

15. An electronic device, characterized in that, The electronic device includes: at least one processor; and a memory communicatively connected to the at least one processor; The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1-13.

16. A non-transitory computer-readable storage medium storing computer instructions, characterized in that, The computer instructions are used to cause the computer to perform the method according to any one of claims 1-13.

Images