Wearable device, wearable device system, and wearable device control method
By using processors and inertial sensors in wearable devices, classifying user actions and performing intelligent control, the problem of single control methods in the prior art is solved, and smarter and more diverse device operations are achieved, improving user experience.
Patent Information
- Application Number
- PCT/CN2024/090705
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-08
- Filing Date
- 2024-04-29
- Publication Date
- 2024-11-14
AI Technical Summary
The control method of the infrared ranging sensor in the existing wearable devices is single, not intelligent enough, and cannot effectively cooperate with user activities to make diversified functional adjustments.
Using processors and inertial sensors, by obtaining dynamic data of user actions, classifying user actions, comparing with preset action templates, determining specified actions, and performing diversified controls based on the action and device status, such as automatic playback, pausing music or switching equipment.
The intelligent and diversified control of wearable devices is improved, and corresponding automatic operations can be performed according to the user's different actions and device status to improve the user experience.
Smart Images

Figure CN2024090705_14112024_PF_FP_ABST
Abstract
Description
Wearable device, wearable device system, and wearable device control method
[0001] This application claims priority to the Chinese patent application entitled “Wearable device, wearable device system and wearable device control method” filed with the Patent Office of the State Intellectual Property Office of China on May 8, 2023, with application number CN 202310508975.4, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The embodiments of the present application relate to the technical field of wearable devices, and in particular to a wearable device, a wearable device system, and a wearable device control method. Background Art
[0003] Automatic control allows the controlled wearable device to switch functions without direct user instruction. Automatic control can seamlessly adapt to user activity and make corresponding functional adjustments, greatly improving the user experience. For example, proximity sensors on Bluetooth headsets use sensors, such as infrared ranging sensors, to continuously measure the distance between obstructing objects and the sensor. For example, whenever a user puts on headphones, their cheek and ear are close to the surface of the headphones, keeping the obstructing object (the user) and the sensor (the headphones) close. If the measured distance increases, it is determined that the headphones are not being worn. Based on whether the headphones are worn, the headset's playback and power status can be automatically controlled.
[0004] However, the infrared ranging sensors in existing wearable devices often only detect the usage status, have a single control method, and are not smart enough. Technical issues
[0005] The embodiments of the present application provide a wearable device, a control system, and a control method, which can solve the problem that the control method of wearable devices is single and not intelligent enough. Technical Solutions
[0006] An embodiment of the present application provides a wearable device, including:
[0007] processor and inertial sensors;
[0008] The processor is connected to the inertial sensor and is used to obtain dynamic data of user actions through the inertial sensor, classify the user actions according to the dynamic data, and determine the designated action corresponding to the user action by comparing the dynamic data with a preset designated action template according to the type of the user action, and control the wearable device to perform corresponding functional operations according to the designated action and the working status of the wearable device.
[0009] On one hand, an embodiment of the present application further provides a wearable device system, including: a smart terminal, a cloud server, and the wearable device as described above.
[0010] On one hand, an embodiment of the present application further provides a wearable device control method, comprising: achieving automatic control through the wearable device as described above. Beneficial effects
[0011] It can be seen from the above-mentioned embodiments of the present application that the wearable device includes a processor and an inertial sensor, which obtains dynamic data of user actions through the inertial sensor, classifies the user actions according to the dynamic data, and determines the designated action corresponding to the user action by comparing the dynamic data with a preset designated action template according to the type of the user action. According to the designated action and the working status of the wearable device, the wearable device is controlled to perform the corresponding functional operation. According to different user actions, it can be analyzed whether the user action is a designated action. According to the designated action and the usage status of the wearable device, diversified control can be made accordingly to improve the intelligence and diversification of the wearable device control. BRIEF DESCRIPTION OF THE DRAWINGS
[0012] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the embodiments or descriptions of the prior art. Obviously, the drawings described below are only some embodiments of the present application.
[0013] FIG1 is a schematic diagram of the structure of smart glasses provided in one embodiment of the present application;
[0014] FIG2 is a schematic diagram of the hardware structure of smart glasses provided in one embodiment of the present application;
[0015] FIG3 is a schematic diagram of a flow chart of a method for controlling smart glasses in an embodiment of the present application;
[0016] FIG4 is a schematic diagram of an implementation flow of a wearable device control method provided in an embodiment of the present application;
[0017] FIG5 is a schematic diagram of the structure of a smart glasses system provided in one embodiment of the present application. Best Mode for Carrying Out the Invention
[0018] Type here the best mode description paragraph of the invention. Modes for Carrying Out the Invention
[0019] To make the purpose, technical solutions, and advantages of the embodiments of the present application more clear, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without making creative efforts shall fall within the scope of protection of this application.
[0020] The embodiments of the present application provide a wearable device that can not only determine the user's rapid movements in a short period of time, such as folding the glasses arm or removing the glasses light, but also determine the user's continuous background activities, such as running, walking, going up and down stairs, etc., and combine the device usage status, such as the music playback status, to make automatic control judgments to match the user's activities, such as pausing or playing music, turning the device on and off, etc. According to the different dynamics of the user and the various usage states of the wearable device by the user, diversified controls can be made accordingly. In the following embodiments, the wearable device takes smart glasses as an example. In addition, wearable devices also include: smart helmets, smart watches, smart bracelets and other wearable portable devices that are worn directly on the body or integrated into the user's clothes or accessories.
[0021] Referring to Figures 1 and 2, Figure 1 is a schematic diagram of the structure of smart glasses provided in one embodiment of the present application, and Figure 2 is a schematic diagram of the hardware structure of smart glasses provided in one embodiment of the present application. For ease of illustration, only the parts relevant to the embodiment of the present application are shown. The smart glasses may include:
[0022] Processor 11 and inertial sensor 12;
[0023] The processor 11 and the inertial sensor 12 may be disposed in the temple 10 , and the processor 11 is connected to the inertial sensor 12 ;
[0024] The inertial sensor 12 includes a three-axis acceleration sensor and a three-axis gyroscope.
[0025] The processor 11 is used to obtain dynamic data of user actions through the inertial sensor 12, classify the user actions according to the dynamic data, and determine the designated action corresponding to the user action by comparing the dynamic data with a preset designated action template according to the type of the user action obtained after classification, and control the wearable device to perform functional operations corresponding to the designated action and the working status of the wearable device based on the designated action and the working status of the wearable device.
[0026] The processor 11 continuously obtains dynamic data of user actions and makes user behavior judgments based on a short period of time. The short period of time is, for example, one second or two seconds, which is pre-set in the processor 11 .
[0027] The dynamic data includes the acceleration measured by the three-axis acceleration sensor and the angular velocity measured by the three-axis gyroscope in the inertial sensor 12. The processor 11 continuously collects the acceleration and angular velocity data of the wearable device.
[0028] The dynamic data is classified into static and dynamic states based on the absolute values of acceleration and angular velocity. The processor 11 is further configured to calculate an absolute change in acceleration within a preset time period, or an absolute change in angular velocity within a preset time period, and if the absolute change in acceleration within the preset time period is less than a first threshold, or the absolute change in angular velocity within the preset time period is less than a second threshold, then the user action is determined to be in a static state.
[0029] If the absolute change in acceleration within the preset time period is greater than the first threshold, or the absolute change in angular velocity within the preset time period is greater than the second threshold, the user action is determined to be a dynamic state type.
[0030] The static state refers to a state where the user's head movement is relatively small. The head movement amplitude is determined by the absolute changes in acceleration and angular velocity. When the head movement amplitude is less than the head movement amplitude threshold during normal walking, the user is determined to be in a static state. Examples include riding in a car, chatting, attending a meeting, eating, reading, and using a mobile phone.
[0031] A dynamic state refers to a situation where the user's head moves significantly. The magnitude of head movement is determined by the absolute changes in acceleration and angular velocity. When the magnitude of head movement exceeds the threshold for normal walking, the user is considered to be in a dynamic state, such as running, walking, or climbing stairs.
[0032] The processor 11 is further configured to, if the user action is of the static state type, determine that the designated action corresponding to the user action is a static state or an idle state by comparing the similarity between the acceleration or the angular velocity and the first designated action template, where the idle state means that the user is not performing any action;
[0033] The first designation module includes an idle action template, wherein the idle action template is provided with an idle similarity threshold;
[0034] Specifically, the processor 11 is also used to calculate the Euclidean distance between the acceleration or the angular velocity and the idle action template. If the Euclidean distance is greater than the idle similarity threshold preset in the idle action template, the user action is determined to be the static state; if the Euclidean distance is less than the idle similarity threshold preset in the idle action template, the user action is determined to be the idle state.
[0035] On the other hand, if the user action is of the dynamic state type, the direction of the acceleration or angular velocity is compared with the preset designated action category conditions to classify the user action into a designated action. By classifying the user action into the designated action category, coarse filtering is performed to determine the approximate activity direction of the user action.
[0036] The user action belonging to the wearable device operation category is determined to be the designated action corresponding to the user action as the wearable device operation state or dynamic state by comparing the similarity between the acceleration or angular velocity of the user action and the second designated action template. The wearable device operation state may include operation states such as taking off the wearable device, putting on the wearable device, and folding the wearable device.
[0037] The second designated action template is a wearable device operation action template. There can be multiple or one wearable device operation action templates. When there are multiple templates, they can include four templates: a wearable device removal action template, a wearable device placement action template, and a wearable device folding action template. When there is only one template, the four templates can be combined. Each wearable device operation action template is provided with a corresponding similarity threshold, which can include a wearable device removal similarity threshold, a wearable device placement similarity threshold, and a wearable device folding similarity threshold.
[0038] Furthermore, the processor 11 is further configured to compare the direction of the acceleration or the angular velocity with a preset condition of a designated action category;
[0039] If the direction of the acceleration or the angular velocity meets the remove-wearable-device category condition, determining that the designated action category of the user action is the remove-wearable-device category;
[0040] If the direction of the acceleration or the angular velocity meets the wearable device category condition, determining that the designated action category of the user action is the wear wearable device category;
[0041] If the direction of the acceleration or the angular velocity meets the foldable wearable device category condition, determining that the specified action category of the user action is the foldable wearable device category;
[0042] If the direction of the acceleration or the angular velocity does not meet the removal wearable device category condition, the wearing wearable device category condition, or the folding wearable device category condition, it is determined that the user action is in a dynamic state.
[0043] The direction or magnitude of user actions have commonalities. For example, when folding glasses, the arms are folded, and the structure of the glasses can only fold inward, so the direction of acceleration and angular velocity can only be inward. When removing glasses, they are usually slightly downward from the horizontal line, while putting on glasses is from the bottom up to the line of sight. Therefore, based on the commonalities in direction and magnitude, dynamic data can be classified as belonging to the category of specific actions.
[0044] The processor 11 is further configured to calculate a Euclidean distance between the acceleration or the angular velocity and an operation motion template of the wearable device;
[0045] If the Euclidean distance is less than the similarity threshold of removing the wearable device in the wearable device operation action template, it is determined that the user action is removing the wearable device;
[0046] If the Euclidean distance is less than the similarity threshold of "putting on the wearable device" in the wearable device operation action template, it is determined that the user action is putting on the wearable device;
[0047] If the Euclidean distance is less than the similarity threshold of folding the wearable device in the wearable device operation action template, it is determined that the user action is folding the wearable device;
[0048] If the Euclidean distance is greater than the similarity threshold for removing the wearable device, the similarity threshold for wearing the wearable device, and the similarity threshold for the folding wearable device, it is determined that the designated action corresponding to the user action is a dynamic state.
[0049] The above calculated Euclidean distance d (μ) between the acceleration or angular velocity and the idle action template or the wearable device operation action template i ,x) is calculated as follows:
[0050]
[0051] in,
[0052] x(t) is the acceleration or angular velocity, is a category data set of a specified action, where S1~S k Indicates different categories; μ i (t) is an idle action template or a wearable device operation action template.
[0053] After classifying user actions into designated action categories, the dynamic data of the user action is compared with the aforementioned action templates for similarity, and the dynamic data is used to determine whether the user action is a designated action. Action templates are obtained by collecting wearable device operations. Specifically, data can be clustered on daily dynamic data of actions such as taking off glasses, putting on glasses, and folding glasses to derive the class centroids of the designated actions. Each class centroid becomes the action template for that action.
[0054] Euclidean distance is a measure of similarity. This embodiment compares the Euclidean distance between dynamic data and action templates to determine the degree of similarity between the user action and the action template, thereby determining whether the user action belongs to a designated action.
[0055] Dynamic data on users' daily activities, such as walking, climbing stairs, sitting, and running, is collected in advance. The Euclidean distance between these dynamic data and each template is compared. Clustering analysis is then performed using Euclidean distance to identify the classification boundary between the daily activities and the specified actions. A similarity threshold is then calculated, taking into account the trade-off between sensitivity and specificity.
[0056] The above coarse-to-fine approach determines the user actions as corresponding designated actions, such as taking off glasses, putting on glasses, folding glasses, and idle, which can increase computing speed and reduce power consumption.
[0057] The processor 11 is also used to determine the automatic control condition corresponding to the specified action according to the specified action corresponding to the user action, and control the wearable device to perform the corresponding operation according to the automatic control condition and the current working state of the wearable device.
[0058] The operation can be a real-time or delayed function control, such as powering on, powering on, pausing, stopping, or playing music.
[0059] The processor 11 is further configured to, if the automatic control condition corresponding to the specified action is a music playing state and the current working state of the smart glasses is playing music, control the corresponding music playing state according to the specified action;
[0060] If the automatic control condition corresponding to the specified action is to control the on / off state, and the current working state of the smart glasses is on or off, the smart glasses are controlled to perform on / off control according to the specified action;
[0061] The designated actions corresponding to the user actions are taking off glasses, putting on glasses or folding glasses; the automatic control conditions include controlling the music playback state and controlling the switch state; the music playback state includes pausing, stopping or playing music; the control switch state includes turning on or off.
[0062] Function control includes control of the wearable device itself, as well as control of other electronic devices connected wirelessly via Bluetooth, WIFI, etc.
[0063] Specifically, the processor 11 is further configured to control the smart glasses to play music if it is determined that the user action is wearing the smart glasses and the working state of the smart glasses is a non-playing music state;
[0064] If it is determined that the user action is to take off the smart glasses, and the working state of the smart glasses is playing music, then control the smart glasses to stop playing music;
[0065] If it is determined that the user action is to fold the arms of the smart glasses, and the working state of the smart glasses is on, then the smart glasses are controlled to shut down immediately;
[0066] If it is determined that the user action is to place the smart glasses forward, when the placement time reaches a first time length and the working state of the smart glasses is in the power-on state, controlling the smart glasses to shut down immediately;
[0067] If it is determined that the user action is to place the smart glasses in reverse, when the placement time reaches a second time length and the working state of the smart glasses is on, the smart glasses are controlled to shut down immediately, and the first time length is greater than the second time length.
[0068] The determination of whether the smart glasses are placed forward or reverse can be achieved through the sensors in the smart glasses. The processor obtains the data collected by the sensor and determines the placement direction of the glasses based on the sensor data. The specific sensor is not limited, and the collected data can enable the processor to determine whether the smart glasses are placed forward or reverse.
[0069] For example, the designated action is taking off glasses, and the corresponding automatic control condition is stopping playing music. If the action performed by the user is determined to be taking off glasses, and the smart glasses are currently playing music A, the processor controls the player to stop playing music A.
[0070] In another example, the designated action is folding the glasses, and the corresponding automatic control condition is shutting down. When the action performed by the user is determined to be folding the glasses, the smart glasses are currently in a non-working state, and the processor controls the smart glasses to shut down.
[0071] Referring to FIG3 , FIG3 is a schematic diagram showing a specific flow of the control method processed by the processor, with smart glasses being taken as an example of a wearable device.
[0072] 2 , the smart glasses further include: an input device 13 , a playback device 14 , a first wireless data transmission module 15 , a proximity sensor 16 , a microphone 17 and a battery 18 .
[0073] The input device 13 includes a touch control device, and the preset input operation is correspondingly a touch operation; the input device 13 also includes a button, and the preset input operation is correspondingly an operation of pressing the button.
[0074] The playback device 14 may specifically be a speaker.
[0075] The temples 10 of the smart glasses are also provided with a first wireless data transmission module 15 for wirelessly connecting the smart glasses to a smart terminal having a second wireless data transmission module. The smart terminal can be an electronic device such as a mobile phone, smart watch, tablet computer, desktop computer, etc.
[0076] In this embodiment, the wearable device includes a processor and an inertial sensor. Dynamic data of user actions is obtained through the inertial sensor, and the user actions are classified according to the dynamic data. According to the type of user action, the designated action corresponding to the user action is determined by comparing the dynamic data with a preset designated action template. According to the designated action and the working status of the wearable device, the wearable device is controlled to perform the corresponding functional operation. According to different user actions, whether the user action is a designated action can be analyzed. According to the designated action and the usage status of the wearable device, diversified control can be made accordingly, thereby improving the intelligence and diversification of the wearable device control.
[0077] An embodiment of the present application also provides a wearable device control method, which realizes automatic control through the wearable device as described above.
[0078] Referring to FIG4 , FIG4 is a schematic diagram of an implementation flow of the wearable device control method, the method comprising:
[0079] S301, obtaining dynamic data of user actions through an inertial sensor;
[0080] Inertial sensors may include a three-axis accelerometer and a three-axis gyroscope;
[0081] The dynamic data includes the acceleration measured by the three-axis acceleration sensor and the angular velocity measured by the three-axis gyroscope.
[0082] S302: Classify the user action according to the dynamic data;
[0083] Calculating the absolute change of the acceleration within a preset time period, or calculating the absolute change of the angular velocity within a preset time period;
[0084] If the absolute change in the acceleration is less than the first threshold, or the absolute change in the angular velocity is less than the second threshold, the user action is determined to be a static state type; if the absolute change in the acceleration is greater than the first threshold, or the absolute change in the angular velocity is greater than the second threshold, the user action is determined to be a dynamic state type.
[0085] S303: Determine the designated action corresponding to the user action by comparing the dynamic data with a preset designated action template according to the type of the user action;
[0086] If the user action is of the static state type, determining that the designated action corresponding to the user action is a static state or an idle state by comparing the similarity between the acceleration or the angular velocity and the first designated action template;
[0087] If the user action is of the dynamic state type, the user action is classified into a designated action category by comparing the direction of the acceleration or the angular velocity with the preset designated action category condition, and the user action belonging to the wearable device operation category is determined to be a wearable device operation state or a dynamic state by comparing the similarity between the acceleration or the angular velocity of the user action and the second designated action template.
[0088] The process of comparing the direction of the acceleration or angular velocity with the preset specified action category conditions to classify the user action into specified action categories includes:
[0089] Comparing the direction of the acceleration or the angular velocity with a preset condition for a specified action category;
[0090] If the direction of the acceleration or the angular velocity meets the removing wearable device category condition, the designated action category of the user action is determined to be the removing wearable device category; if the direction of the acceleration or the angular velocity meets the wearing wearable device category condition, the designated action category of the user action is determined to be the wearing wearable device category; if the direction of the acceleration or the angular velocity meets the folding wearable device category condition, the designated action category of the user action is determined to be the folding wearable device category; if the direction of the acceleration or the angular velocity does not meet the removing wearable device category condition, the wearing wearable device category condition or the folding wearable device category condition, the user action is determined to be in a dynamic state.
[0091] The step of comparing the acceleration or the angular velocity with the first designated action template to determine whether the designated action corresponding to the user action is a static state or an idle state includes:
[0092] Calculating the Euclidean distance between the acceleration or the angular velocity and the idle motion template;
[0093] If the Euclidean distance is less than the idle similarity threshold in the idle action template, the user action is determined to be in the static state;
[0094] If the Euclidean distance is greater than the idle similarity threshold in the idle action template, the user action is determined to be the idle state.
[0095] Determining, by comparing the similarity between the dynamic data and the second designated action template, that the designated action corresponding to the user action is an operating state or a dynamic state of the wearable device includes:
[0096] Calculating the Euclidean distance between the acceleration or the angular velocity and the operation motion template of the wearable device;
[0097] If the Euclidean distance is less than the similarity threshold of removing the wearable device in the wearable device operation action template, it is determined that the user action is removing the wearable device;
[0098] If the Euclidean distance is less than the similarity threshold of "putting on the wearable device" in the wearable device operation action template, it is determined that the user action is putting on the wearable device;
[0099] If the Euclidean distance is less than the similarity threshold of folding the wearable device in the wearable device operation action template, it is determined that the user action is folding the wearable device;
[0100] If the Euclidean distance is greater than the similarity threshold for removing the wearable device, the similarity threshold for wearing the wearable device, and the similarity threshold for the folding wearable device, it is determined that the designated action corresponding to the user action is a dynamic state.
[0101] S304: Control the wearable device to perform a corresponding functional operation according to the designated action and the working state of the wearable device.
[0102] According to the designated action corresponding to the user action, an automatic control condition corresponding to the designated action is determined; according to the automatic control condition and the current working state of the wearable device, the wearable device is controlled to perform the corresponding operation.
[0103] For the specific contents of the embodiments of this application, please refer to the description of the aforementioned embodiments.
[0104] In an embodiment of the present application, dynamic data of user actions is obtained through an inertial sensor, and the user actions are classified according to the dynamic data. According to the type of user action, the designated action corresponding to the user action is determined by comparing the dynamic data with a preset designated action template. According to the designated action and the working status of the wearable device, the wearable device is controlled to perform the corresponding functional operation. According to different user actions, it is possible to analyze whether the user action is a designated action. According to the designated action and the usage status of the wearable device, diversified control is made accordingly, thereby improving the intelligence and diversification of wearable device control.
[0105] 5 , an embodiment of the present application further provides a wearable device system, including a wearable device 100 , a smart terminal 200 , and a cloud server 300 ;
[0106] The wearable device can be the smart glasses in the above embodiment, the smart terminal 200 is the smart terminal in the above embodiment, an application is running on the smart terminal 200, and the cloud server 300 can store data and applications.
[0107] The wearable device 100 is connected to the smart terminal 200 via a wireless network, and the smart terminal 200 is connected to the cloud server 300 via a wireless network or a mobile network.
[0108] Wireless networks include Bluetooth, WIFI, etc.; mobile networks include 4G or 5G, etc.
[0109] The wearable device 100 obtains data of an application program set by the user on the smart terminal 200 through a wireless network.
[0110] The smart terminal 200 exchanges data with the cloud server 300 via a wireless network, such as downloading applications, uploading setting data of the wearable device to the cloud server 300, etc.
[0111] It should be noted that for the aforementioned method embodiments, for ease of description, they are all expressed as a series of action combinations, but those skilled in the art should be aware that this application is not limited by the order of the actions described, because according to this application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in this specification are all preferred embodiments, and the actions and modules involved are not necessarily required by this application.
[0112] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant description of other embodiments.
[0113] The above is a description of the wearable device, wearable device system and wearable device control method provided in this application. For those skilled in the art, based on the ideas of the embodiments of this application, there may be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on this application. Industrial Applicability
[0114] Type your industrial applicability description paragraph here. Sequence Listing Free Content
[0115] Type your sequence listing free description paragraph here.
Claims
1. A wearable device, characterized in that: The wearable device comprises: processor and inertial sensors; The processor is connected to the inertial sensor and is used to obtain dynamic data of user actions through the inertial sensor, classify the user actions according to the dynamic data, and determine the designated action corresponding to the user action by comparing the dynamic data with a preset designated action template according to the type of the user action, and control the wearable device to perform corresponding functional operations according to the designated action and the working state of the wearable device.
2. The wearable device according to claim 1, characterized in that: The inertial sensor includes a three-axis acceleration sensor and a three-axis gyroscope; The dynamic data includes the acceleration measured by the three-axis acceleration sensor and the angular velocity measured by the three-axis gyroscope.
3. The wearable device according to claim 2, characterized in that: The processor is further configured to calculate an absolute change in the acceleration within a preset time period, or calculate an absolute change in the angular velocity within a preset time period, and if the absolute change in the acceleration is less than a first threshold, or the absolute change in the angular velocity is less than a second threshold, determine that the user action is a static state type; If the absolute change in the acceleration is greater than the first threshold, or the absolute change in the angular velocity is greater than the second threshold, it is determined that the user action is a dynamic state type.
4. The wearable device according to claim 3, characterized in that: The processor is further configured to, if the user action is of the static state type, determine that the designated action corresponding to the user action is a static state or an idle state by comparing the similarity between the acceleration or the angular velocity and the first designated action template; If the user action is of the dynamic state type, the user action is classified into a designated action type by comparing the direction of the acceleration or the angular velocity with a preset designated action category condition, and the user action belonging to the wearable device operation category is determined to be a wearable device operation state or a dynamic state by comparing the acceleration or the angular velocity of the user action with the similarity of a second designated action template.
5. The wearable device according to claim 4, characterized in that: The processor is further configured to compare the direction of the acceleration or the angular velocity with a preset specified action category condition; If the direction of the acceleration or the angular velocity meets the remove-wearable-device category condition, determining that the designated action category of the user action is the remove-wearable-device category; If the direction of the acceleration or the angular velocity meets the wearable device category condition, determining that the specified action category of the user action is the wear wearable device category; If the direction of the acceleration or the angular velocity meets the foldable wearable device category condition, determining that the specified action category of the user action is a foldable wearable device category; If the direction of the acceleration or the angular velocity does not meet the removal wearable device category condition, the wearing wearable device category condition or the folding wearable device category condition, it is determined that the user action is in a dynamic state.
6. The wearable device according to any one of claims 1 to 5, characterized in that: The processor is further used to calculate the Euclidean distance between the acceleration or the angular velocity and the idle action template; If the Euclidean distance is greater than the idle similarity threshold in the idle action template, determining that the user action is in the static state; If the Euclidean distance is less than the idle similarity threshold in the idle action template, the user action is determined to be the idle state.
7. The wearable device according to claim 5, characterized in that: The processor is further used to calculate the Euclidean distance between the acceleration or the angular velocity and the operation action template of the wearable device; If the Euclidean distance is less than the similarity threshold of removing the wearable device in the wearable device operation action template, determining that the user action is removing the wearable device; If the Euclidean distance is less than the similarity threshold of putting on the wearable device in the wearable device operation action template, determining that the user action is putting on the wearable device; If the Euclidean distance is less than the similarity threshold of the folding wearable device in the wearable device operation action template, determining that the user action is a folding wearable device; If the Euclidean distance is greater than the similarity threshold of removing the wearable device, the similarity threshold of putting on the wearable device, and the similarity threshold of the folded wearable device, it is confirmed that the designated action corresponding to the user action is a dynamic state.
8. The wearable device according to claim 7, characterized in that: The processor is further configured to determine an automatic control condition corresponding to the designated action according to the designated action corresponding to the user action; According to the automatic control condition and the current working state of the wearable device, the wearable device is controlled to perform a corresponding operation.
9. The wearable device according to claim 8, characterized in that: The wearable device is a smart glasses, and the processor is further configured to control the smart glasses to play music if it is determined that the user action is to put on the smart glasses and the working state of the smart glasses is a state where music is not played; If it is determined that the user action is to take off the smart glasses, and the working state of the smart glasses is a music playing state, controlling the smart glasses to stop playing music; If it is determined that the user action is to fold the arms of the smart glasses, and the working state of the smart glasses is on, then the smart glasses are controlled to shut down immediately; If it is determined that the user action is to place the smart glasses forward, when the placement time reaches a first time and the working state of the smart glasses is in the on state, controlling the smart glasses to shut down immediately; If it is determined that the user action is to place the smart glasses in reverse, when the placement time reaches a second time length and the working state of the smart glasses is on, the smart glasses are controlled to shut down immediately, and the first time length is greater than the second time length.
10. A wearable device system, characterized in that: include: A smart terminal, a cloud server, and a wearable device as described in any one of claims 1 to 9.
11. A wearable device control method, characterized in that: The wearable device includes a processor and an inertial sensor; the control method includes: Acquiring dynamic data of user actions through the inertial sensor; The processor classifies the user actions according to the dynamic data, and determines the designated action corresponding to the user action by comparing the dynamic data with a preset designated action template according to the type of the user action; and controls the wearable device to perform corresponding functional operations according to the designated action and the working status of the wearable device.
12. The wearable device control method according to claim 11, characterized in that: The inertial sensor includes a three-axis acceleration sensor and a three-axis gyroscope; the dynamic data includes the acceleration measured by the three-axis acceleration sensor and the angular velocity measured by the three-axis gyroscope; The control method further comprises: The processor calculates the absolute change of the acceleration within a preset time period, or calculates the absolute change of the angular velocity within a preset time period. If the absolute change of the acceleration is less than a first threshold, or the absolute change of the angular velocity is less than a second threshold, it is determined that the user action is a static state type; if the absolute change of the acceleration is greater than the first threshold, or the absolute change of the angular velocity is greater than the second threshold, it is determined that the user action is a dynamic state type.
13. The wearable device control method according to claim 12, characterized in that: The control method further comprises: If the user action is of the static state type, the processor determines that the designated action corresponding to the user action is a static state or an idle state by comparing the similarity between the acceleration or the angular velocity and the first designated action template; If the user action is of the dynamic state type, the processor classifies the user action into a designated action type by comparing the direction of the acceleration or the angular velocity with a preset designated action category condition, and determines that the designated action corresponding to the user action belonging to the wearable device operation category is a wearable device operation state or a dynamic state by comparing the acceleration or the angular velocity of the user action with the similarity of a second designated action template.
14. The wearable device control method according to claim 13, characterized in that: The control method further comprises: The processor compares the direction of the acceleration or the angular velocity with a preset specified action category condition; If the direction of the acceleration or the angular velocity meets the remove-wearable-device category condition, the processor determines that the designated action category of the user action is the remove-wearable-device category; If the direction of the acceleration or the angular velocity meets the wear-wearable device category condition, the processor determines that the designated action category of the user action is the wear-wearable device category; If the direction of the acceleration or the angular velocity meets the foldable wearable device category condition, the processor determines that the specified action category of the user action is a foldable wearable device category; If the direction of the acceleration or the angular velocity does not meet the removal of the wearable device category condition, the wearing of the wearable device category condition, or the folding of the wearable device category condition, the processor determines that the user action is in a dynamic state.
15. The wearable device control method according to claim 1, characterized in that: The control method further comprises: The processor calculates the Euclidean distance between the acceleration or the angular velocity and an idle motion template; If the Euclidean distance is greater than the idle similarity threshold in the idle action template, the processor determines that the user action is the static state; If the Euclidean distance is less than the idle similarity threshold in the idle action template, the processor determines that the user action is the idle state.
16. The wearable device according to claim 14, characterized in that: The control method further comprises: The processor calculates the Euclidean distance between the acceleration or the angular velocity and the operation action template of the wearable device; If the Euclidean distance is less than the similarity threshold of removing the wearable device in the wearable device operation action template, the processor determines that the user action is removing the wearable device; If the Euclidean distance is less than the similarity threshold of putting on the wearable device in the wearable device operation action template, the processor determines that the user action is putting on the wearable device; If the Euclidean distance is less than the folding wearable device similarity threshold in the wearable device operation action template, the processor determines that the user action is folding the wearable device; If the Euclidean distance is greater than the similarity threshold for removing the wearable device, the similarity threshold for putting on the wearable device, and the similarity threshold for the folded wearable device, the processor confirms that the designated action corresponding to the user action is a dynamic state.
17. The wearable device according to claim 16, characterized in that: The control method further comprises: The processor determines, according to the designated action corresponding to the user action, an automatic control condition corresponding to the designated action; The processor controls the wearable device to perform corresponding operations according to the automatic control condition and the current working state of the wearable device.
18. The wearable device according to claim 17, characterized in that: The wearable device is smart glasses; the control method further includes: If it is determined that the user action is to put on the smart glasses, and the working state of the smart glasses is a state where music is not being played, the processor controls the smart glasses to play music; If it is determined that the user action is to take off the smart glasses, and the working state of the smart glasses is a music playing state, the processor controls the smart glasses to stop playing music; If it is determined that the user action is to fold the arms of the smart glasses, and the working state of the smart glasses is on, the processor controls the smart glasses to shut down immediately; If it is determined that the user action is to place the smart glasses forward, when the placement time reaches a first time and the working state of the smart glasses is in the power-on state, the processor controls the smart glasses to shut down immediately; If it is determined that the user action is to place the smart glasses in reverse, when the placement time reaches a second time length and the working state of the smart glasses is on, the processor controls the smart glasses to shut down immediately, and the first time length is greater than the second time length.
Citation Information
Patent Citations
Wearable device and method of outputting content thereof
CN104423584A
Wearable glasses and method of providing content using the same
CN105320279A
Motion type recognition method, device and equipment
CN107329563A
Management method and apparatus for wearable smart device
CN108886749A
Intelligent glasses
CN109946853A
