Fitness assisting method and device based on AR glasses and electronic equipment

Data collected through AR glasses are generated to generate a personalized fitness plan and monitor exercise status, which solves the problem that traditional fitness methods cannot provide personalized support, and realizes accurate assessment of user movements and fatigue and safety reminders, reducing the risk of injury.

CN118919016APending Publication Date: 2024-11-08GUDONG TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410951316.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-16
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

Traditional fitness methods cannot provide sufficient personalized support, which may cause unsuitable movements or fatigue during training, increasing the risk of injury.

Method used

Collect physical energy test data through AR glasses, generate personalized fitness plans, and monitor exercise data in real time to determine whether the user has abnormal behavior, such as irregular movements or fatigue, and send a notification to remind the user to pause training.

Benefits of technology

It effectively reduces the risk of injury during fitness, provides personalized fitness plans and movement assessments, timely identify user fatigue status, and ensures training safety and effectiveness.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118919016A_ABST
    Figure CN118919016A_ABST
Patent Text Reader

Abstract

The invention discloses a fitness assisting method and device based on AR glasses and electronic equipment, and relates to the field of data processing. In the method, communication connection with target AR glasses is established, and the target AR glasses are AR glasses worn by a target user; obtaining physical fitness test data for the target user collected by the target AR glasses; the physical fitness test data are input into a preset fitness plan generation model, a fitness plan of the target user is obtained, and the fitness plan comprises training actions, training frequency and training intensity; acquiring motion data of the target user in real time; judging whether the target user has an abnormal behavior or not according to the fitness plan and the exercise data; and if it is determined that the target user has the abnormal behavior, sending an abnormal notification to the target user to prompt the user to pause the fitness plan. According to the technical scheme, an abnormal behavior judgment mechanism is provided, and the injury risk occurring in the body building process is reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of data processing, and specifically to a fitness assistance method, device and electronic equipment based on AR glasses. Background Art

[0002] With the rapid development of the fitness industry and changes in people's lifestyles, personal health awareness continues to improve. However, traditional fitness methods often fail to provide sufficient personalized support, especially for users with specific health conditions or goals. Many users train without professional guidance, which may lead to poor training results or sports injuries.

[0003] Currently, related fitness assistance methods may ignore the user's body signals and guide the user to continue inappropriate training, thereby increasing the risk of injury.

[0004] Therefore, there is an urgent need for a fitness assistance method, device and electronic equipment based on AR glasses. Summary of the invention

[0005] The present application provides a fitness assistance method, device and electronic equipment based on AR glasses, provides an abnormal behavior judgment mechanism, and reduces the risk of injury during fitness.

[0006] In a first aspect of the present application, a fitness assistance method based on AR glasses is provided, in which a communication connection with a target AR glasses is established, wherein the target AR glasses are AR glasses worn by a target user; physical fitness test data for the target user collected by the target AR glasses is obtained; the physical fitness test data is input into a preset fitness plan generation model to obtain a fitness plan for the target user, wherein the fitness plan includes training movements, training frequency, and training intensity; the motion data of the target user is obtained in real time; based on the fitness plan and the motion data, it is determined whether the target user has abnormal behavior; if it is determined that the target user has abnormal behavior, an abnormal notification is sent to the target user to prompt the user to pause the fitness plan.

[0007] By adopting the above technical solution, by inputting the physical fitness test data collected by the target AR glasses into the preset fitness plan generation model, a personalized fitness plan suitable for the individual ability and fitness goals of the target user can be generated according to the actual situation of the target user. By obtaining the motion data of the target user in real time, the motion state of the user during the actual training process can be monitored and analyzed. Based on the comparative analysis of the fitness plan and motion data, it can be determined whether the target user has abnormal behavior. Once abnormal behavior is found, a notification can be sent to the target user to remind him to suspend the fitness plan to avoid potential injury risks.

[0008] Optionally, the abnormal behavior includes non-standard action behavior, and judging whether the target user has abnormal behavior based on the fitness plan and the exercise data specifically includes: obtaining an action picture of the target user, and performing feature extraction on the action picture to obtain action features; using cosine similarity to calculate the similarity between the action features and preset standard features; if it is determined that the similarity is less than or equal to a preset similarity threshold, determining that the target user has non-standard action behavior.

[0009] By adopting the above technical solution, the accuracy of the user's action can be evaluated by obtaining the target user's action picture and extracting its features. By comparing the extracted action features with the preset standard features, it is possible to quantitatively measure whether the user's action meets the specifications and standards.

[0010] Optionally, abnormal behavior also includes fatigue behavior, and determining whether the target user has abnormal behavior based on the fitness plan and the motion data specifically includes: performing statistical analysis on the motion data to determine whether the target user has fatigue characteristics; if it is determined that the target user has fatigue characteristics, then determining that the target user has abnormal behavior.

[0011] By adopting the above technical solution, by statistically analyzing the target user's motion data, potential fatigue characteristics can be identified. By analyzing these characteristics, it can be detected whether the target user has fatigue characteristics.

[0012] Optionally, the motion data includes multiple heart rate data, and the statistical analysis of the motion data to determine whether the target user has fatigue characteristics specifically includes: calculating the difference between first heart rate data and second heart rate data, the first heart rate data and the second heart rate data being any two adjacent heart rate data among the multiple heart rate data; determining whether the difference is greater than or equal to a preset heart rate threshold; if it is determined that the difference is greater than or equal to the preset heart rate threshold, determining that the target user has fatigue characteristics.

[0013] By adopting the above technical solution, by calculating the difference between the heart rate data, the change of the user's heart rate during exercise can be understood. This can provide information about the increase or decrease of the heart rate, which is used to identify the user's fatigue state. By comparing the heart rate difference with the preset heart rate threshold, it can be determined whether the target user has fatigue characteristics. If the heart rate difference is greater than or equal to the preset heart rate threshold, this indicates that the user's heart rate changes greatly and may be in a fatigued state.

[0014] Optionally, before inputting the physical fitness test data into a preset fitness plan generation model to obtain the target user's fitness plan, the method further includes: obtaining a training data set, the training data set including historical physical fitness test data and historical fitness plans of multiple historical users; constructing a deep learning model based on a transformer structure; inputting the training data set into the deep learning model for training to obtain the preset fitness plan generation model.

[0015] By adopting the above technical solution, a personalized fitness plan can be generated based on the physical fitness test data of the target user through a deep learning model trained based on historical data. The model takes into account the data and plans of historical users and can better adapt to the needs and characteristics of users. Using a deep learning model to generate a fitness plan can realize an automated process and reduce the workload of manual plan formulation. This saves time and effort and provides more efficient and consistent plan generation.

[0016] Optionally, before obtaining the physical fitness test data of the target user collected by the target AR glasses, the method also includes: sending an information collection command to the AR glasses so that the AR glasses guide the target user to fill in basic information; matching the corresponding physical fitness test task according to the basic information; sending the physical fitness test task to the AR glasses so that the AR glasses guide the target user to perform a physical fitness test.

[0017] By adopting the above technical solution, through the collection and matching of basic information, a customized physical fitness test task can be generated for each target user. This helps to meet the individual needs and ability levels of users and provide more accurate and effective test content. By sending information collection commands to AR glasses, the target user can be guided to fill in the basic information directly on the glasses, eliminating additional steps and equipment.

[0018] Optionally, matching the corresponding physical fitness test task according to the basic information specifically includes: inputting the basic information into a preset physical fitness task database to obtain the physical fitness test task, and the preset physical fitness task database includes the correspondence between the basic information and the physical fitness test task.

[0019] By adopting the above technical solution, personalized physical fitness test tasks can be obtained by matching the basic information of the target user with the preset physical fitness task database. These tasks can customize different test contents and difficulty levels according to the characteristics and needs of the user to meet the individual needs and ability levels of the user. By matching the correspondence between the basic information and the physical fitness test tasks, it is ensured that the selected test tasks match the characteristics and needs of the user. This helps to improve the pertinence and accuracy of the test and ensure that the user can perform a physical fitness test suitable for their own situation.

[0020] In a second aspect of the present application, a fitness auxiliary device based on AR glasses is provided, and the device includes: an acquisition module and a processing module, wherein: the processing module is used to establish a communication connection with a target AR glasses, and the target AR glasses are AR glasses worn by a target user; the acquisition module is used to acquire physical fitness test data for the target user collected by the target AR glasses; the processing module is also used to input the physical fitness test data into a preset fitness plan generation model to obtain a fitness plan for the target user, and the fitness plan includes training movements, training frequency and training intensity; the acquisition module is also used to acquire the motion data of the target user in real time; the processing module is also used to determine whether the target user has abnormal behavior based on the fitness plan and the motion data; the processing module is also used to send an abnormal notification to the target user if it is determined that the target user has abnormal behavior, so as to prompt the user to suspend the fitness plan.

[0021] In the third aspect of the present application, an electronic device is provided, including a processor, a memory, a user interface and a network interface, the memory is used to store instructions, the user interface and the network interface are both used to communicate with other devices, and the processor is used to execute the instructions stored in the memory so that the electronic device executes any one of the methods described above.

[0022] In a fourth aspect of the present application, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores instructions, and when the instructions are executed, any of the methods described above is executed.

[0023] In summary, one or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages: 1. By inputting the physical fitness test data collected by the target AR glasses into the preset fitness plan generation model, a personalized fitness plan suitable for the individual ability and fitness goals of the target user can be generated according to the actual situation of the target user. By obtaining the target user's motion data in real time, the user's motion status during the actual training process can be monitored and analyzed. Based on the comparative analysis of fitness plans and motion data, it can be determined whether the target user has abnormal behavior. Once abnormal behavior is found, a notification can be sent to the target user to remind him to suspend the fitness plan to avoid potential injury risks.

[0024] 2. By obtaining the target user's action pictures and extracting their features, the accuracy of the user's actions can be evaluated. By comparing the extracted action features with the preset standard features, it is possible to quantitatively measure whether the user's actions meet the specifications and standards.

[0025] 3. By calculating the difference between the heart rate data, you can understand the changes in the user's heart rate during exercise. This can provide information about the increase or decrease in heart rate, which is used to identify the user's fatigue state. By comparing the heart rate difference with the preset heart rate threshold, it can be determined whether the target user has fatigue characteristics. If the heart rate difference is greater than or equal to the preset heart rate threshold, this indicates that the user's heart rate changes greatly and may be in a state of fatigue. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 It is a flowchart of a fitness assistance method based on AR glasses disclosed in an embodiment of the present application; Figure 2 It is a module schematic diagram of a fitness auxiliary device based on AR glasses disclosed in an embodiment of the present application; Figure 3 It is a structural schematic diagram of an electronic device disclosed in an embodiment of the present application.

[0027] Explanation of the reference numerals: 201, acquisition module; 202, processing module; 300, electronic device; 301, processor; 302, communication bus; 303, user interface; 304, network interface; 305, memory. DETAILED DESCRIPTION

[0028] In order to enable technicians in this field to better understand the technical solutions in this specification, the technical solutions in the embodiments of this specification will be clearly and completely described below in conjunction with the drawings in the embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this application, not all of the embodiments.

[0029] In the description of the embodiments of the present application, words such as "for example" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "for example" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "for example" or "for example" is intended to present related concepts in a specific way.

[0030] In the description of the embodiments of the present application, the meaning of the term "multiple" refers to two or more. For example, multiple systems refer to two or more systems, and multiple screen terminals refer to two or more screen terminals. In addition, the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. The terms "include", "comprise", "have" and their variations all mean "including but not limited to", unless otherwise specifically emphasized.

[0031] This application provides a fitness assistance method based on AR glasses, referring to Figure 1 , Figure 1 1 is a flow chart of a fitness assistance method based on AR glasses provided in an embodiment of the present application. The method is applied to a server and includes steps S101 to S104, which are as follows: Step S101: Establish a communication connection with a target AR glasses, where the target AR glasses are the AR glasses worn by a target user.

[0032] In step S101, the communication between the server and the target AR glasses can be based on wireless network technology, such as WiFi, Bluetooth, 5G, etc. The server can be equipped with a corresponding wireless communication module, and by broadcasting its own network information (such as SSID, MAC address, etc.), the target AR glasses can detect and connect to the wireless network established by the server.

[0033] Step S102: Obtain physical fitness test data of the target user collected by the target AR glasses.

[0034] Before step S102, an information collection command is sent to the AR glasses so that the AR glasses can guide the target user to fill in basic information; the corresponding physical fitness test task is matched according to the basic information; and the physical fitness test task is sent to the AR glasses so that the AR glasses can guide the target user to perform the physical fitness test.

[0035] Among them, matching the corresponding physical fitness test task according to the basic information specifically includes: inputting the basic information into a preset physical fitness task database to obtain the physical fitness test task, and the preset physical fitness task database includes the correspondence between the basic information and the physical fitness test task.

[0036] Specifically, the server sends an information collection instruction to the target AR glasses through a communication connection established with the target AR glasses, triggering the user information collection function of the target AR glasses. The instruction may contain metadata such as the information field to be collected, the filling format, and the submission method. After receiving the instruction, the target AR glasses will generate a corresponding information filling form or interactive guidance on the user interface, prompting the user to enter basic information, including gender, age, and height. Under the guidance of the target AR glasses, the user fills in his or her basic information item by item in the format required by the server. To ensure the accuracy and completeness of the basic information, the target AR glasses can set mandatory item verification and value range restrictions. For example, the age field only allows integers of 0-120 to be entered, the height and weight fields only allow positive numbers to be entered, and the gender field has only two types. After the user completes the filling, the target AR glasses will send the collected basic information to the server. After the server obtains the verified basic information of the user, it needs to generate a personalized physical fitness test plan for the user based on this. The server will use the user information as input and pass it into the preset physical fitness task database for matching and retrieval. The preset physical task database pre-sets the correspondence between different basic information and physical test tasks. These relationships can be manually configured by experts based on professional knowledge such as sports medicine and sports science. After the server matches the test plan suitable for the user from the preset physical task database, it packages the plan into a task instruction and sends it to the target AR glasses through a communication connection. After the target AR glasses receive the physical test task sent by the server, they can start to guide the user to take the test. The target AR glasses can clearly show the user the content and requirements of each test item included in the physical test item through various interactive methods such as vision, hearing, and touch.

[0037] In step S102, after establishing a communication connection with the target AR glasses, the server needs to obtain the target user's physical fitness test data from the target AR glasses as input for subsequent generation of a personalized fitness plan. The physical fitness test data includes cardiopulmonary function indicators, strength indicators, and muscle endurance indicators.

[0038] Step S103: inputting the physical fitness test data into a preset fitness plan generation model to obtain a fitness plan for the target user, the fitness plan including training movements, training frequency and training intensity; Before step S103, the method also includes: obtaining a training data set, the training data set including historical physical fitness test data and historical fitness plans of multiple historical users; building a deep learning model based on a transformer structure; inputting the training data set into the deep learning model for training to obtain a preset fitness plan generation model.

[0039] Specifically, the server needs to obtain a large amount of training data sets from the database as the raw materials for the preset training fitness plan generation model. The training data set mainly includes two parts: one is the historical physical fitness test data of historical users, and the other is the historical fitness plan of historical users. After obtaining the training data set, the server builds a suitable deep learning model based on the Transformer model for mapping learning from physical fitness test data to fitness plans. After building the Transformer model, the server needs to train it with the training data set and optimize the model parameters so that it can learn the corresponding relationship between physical fitness test data and fitness plans.

[0040] Step S104: Acquire the target user's exercise data in real time.

[0041] In step S104, the server may receive the user's motion data from the AR glasses once per second, including motion pictures and heart rate. For motion pictures, the AR glasses are usually equipped with one or more cameras, which can shoot video streams from the user's first-person perspective and obtain motion pictures from the video streams. For heart rate data, the AR glasses can achieve non-sensing measurement through the built-in optical heart rate sensor. Step S105: Determine whether the target user has abnormal behavior based on the fitness plan and exercise data.

[0042] In step S105, abnormal behavior includes non-standard action behavior. According to the fitness plan and exercise data, it is determined whether the target user has abnormal behavior, which specifically includes: obtaining an action picture of the target user, and extracting features from the action picture to obtain action features; using cosine similarity to calculate the similarity between the action features and preset standard features; if it is determined that the similarity is less than or equal to a preset similarity threshold, it is determined that the target user has non-standard action behavior.

[0043] Specifically, the server needs to obtain the user's current motion posture data. AR glasses capture the user's motion pictures in real time and upload the video stream to the server. For the video stream data, the server will select the key frame image to obtain the action picture. The server will normalize the size, convert the color space, enhance the quality, etc. of the action picture to improve the robustness of feature extraction. Then the server uses the scale-invariant feature transform (SIFT) algorithm to detect the key bone points (key frames) of the human body from the image. The inter-frame difference and visual saliency algorithms are used to select the key frames that best represent the action. The human skeleton coordinates in the key frame are extracted and scale-normalized to form a compact feature vector, namely the action feature. Then the server will calculate the similarity between the extracted user's action features and the standard action features. The standard action features are pre-defined and can be entered through demonstrations by professional athletes or modeled and generated based on physical training teaching materials. The similarity calculation uses cosine similarity. Cosine similarity regards two feature vectors as two rays in a high-dimensional space and measures the similarity of the vectors by calculating the cosine value of the angle between the rays. The smaller the angle, the larger the cosine value, indicating that the two vectors are more similar. Finally, the calculated similarity is compared with the preset threshold. If the similarity is less than or equal to the threshold, it means that the user's action is significantly different from the standard action, that is, there is an irregular action.

[0044] In a possible implementation, abnormal behavior also includes fatigue behavior. Based on the fitness plan and exercise data, it is determined whether the target user has abnormal behavior, which specifically includes: performing statistical analysis on the exercise data to determine whether the target user has fatigue characteristics; if it is determined that the target user has fatigue characteristics, then it is determined that the target user has abnormal behavior.

[0045] In one possible implementation, the motion data includes multiple heart rate data, and statistical analysis is performed on the motion data to determine whether the target user has fatigue characteristics, specifically including: calculating the difference between first heart rate data and second heart rate data, the first heart rate data and the second heart rate data being any two adjacent heart rate data among the multiple heart rate data; determining whether the difference is greater than or equal to a preset heart rate threshold; if it is determined that the difference is greater than or equal to the preset heart rate threshold, determining that the target user has fatigue characteristics.

[0046] Specifically, the server needs to receive motion data from AR glasses in real time, including continuous heart rate measurements. AR glasses can achieve non-sensing measurement through the built-in optical heart rate sensor and upload the data to the server at a certain frequency (such as once per second). After receiving the data, the server will perform statistical analysis on the heart rate data. In order to determine whether the user has fatigue characteristics, the server will continue to track the trend of heart rate changes. Specifically, the server will compare any heart rate data (first heart rate data) with the heart rate at the previous sampling moment (second heart rate data) and calculate the absolute value of the difference between the two. The server compares the difference with a pre-set preset heart rate threshold. The preset heart rate threshold can be personalized according to the user's age, gender, health status and other factors, representing the warning line for sudden changes in heart rate. For example, for an adult male with normal cardiopulmonary function, if the difference between the heart rates of two samples exceeds 30 beats / minute, it can be determined as a drastic heart rate change. If the calculated heart rate difference is equal to or greater than the preset threshold, the server can preliminarily determine that the user has fatigue characteristics, that is, the heart rate rises or drops too sharply. Once the server confirms that the user has fatigue characteristics, it will immediately mark the situation as abnormal behavior. The server will then generate a fatigue prompt message and push it to the user's AR glasses via the wireless network in a timely manner. The user can receive this message through voice broadcast or visual prompts, and realize in time that his physical condition is no longer suitable for continuing training. At the same time, the server will automatically modify the user's fitness plan, adjust the training intensity or suggest that the user directly terminate the training. These adjustment information will also be pushed to the AR glasses to guide the user to take corresponding measures.

[0047] Step S106: If it is determined that the target user has abnormal behavior, an abnormal notification is sent to the target user to prompt the user to suspend the fitness plan.

[0048] In step S106, after confirming that the user's action is abnormal, the server will immediately generate an abnormal notification message. The abnormal notification message includes prompting the user that non-standard action or fatigue behavior has occurred; the abnormal notification generated by the server is sent to the user's terminal device in the form of a push notification, such as a smart watch, smart bracelet, AR glasses, etc. These devices generally support message reminder functions, which can attract the user's attention in a timely manner through vibration, ringtones, pop-up windows, etc.

[0049] Reference Figure 2The present application also provides a fitness auxiliary device based on AR glasses, which is a server. The server includes an acquisition module 201 and a processing module 202, including an acquisition module 201 and a processing module 202, wherein: the processing module 202 is used to establish a communication connection with the target AR glasses, and the target AR glasses are AR glasses worn by the target user; the acquisition module 201 is used to obtain physical fitness test data for the target user collected by the target AR glasses; the processing module 202 is also used to input the physical fitness test data into a preset fitness plan generation model to obtain a fitness plan for the target user, and the fitness plan includes training movements, training frequency and training intensity; the acquisition module 201 is also used to obtain the motion data of the target user in real time; the processing module 202 is also used to determine whether the target user has abnormal behavior based on the fitness plan and motion data; the processing module 202 is also used to send an abnormal notification to the target user if it is determined that the target user has abnormal behavior, so as to prompt the user to suspend the fitness plan.

[0050] In a possible implementation, abnormal behavior includes non-standard action behavior, and the processing module 202 determines whether the target user has abnormal behavior based on the fitness plan and exercise data, specifically including: the acquisition module 201 acquires the action picture of the target user, and extracts features from the action picture to obtain action features; the processing module 202 uses cosine similarity to calculate the similarity between the action features and the preset standard features; if it is determined that the similarity is less than or equal to the preset similarity threshold, the processing module 202 determines that the target user has non-standard action behavior.

[0051] In a possible implementation, abnormal behavior also includes fatigue behavior. The processing module 202 determines whether the target user has abnormal behavior based on the fitness plan and exercise data. Specifically, the processing module 202 performs statistical analysis on the exercise data to determine whether the target user has fatigue characteristics; if it is determined that the target user has fatigue characteristics, the processing module 202 determines that the target user has abnormal behavior.

[0052] In one possible implementation, the motion data includes multiple heart rate data, and statistical analysis is performed on the motion data. The processing module 202 determines whether the target user has fatigue characteristics, specifically including: the processing module 202 calculates the difference between the first heart rate data and the second heart rate data, the first heart rate data and the second heart rate data are any two adjacent heart rate data among the multiple heart rate data; the processing module 202 determines whether the difference is greater than or equal to a preset heart rate threshold; if it is determined that the difference is greater than or equal to the preset heart rate threshold, the processing module 202 determines that the target user has fatigue characteristics.

[0053] In one possible implementation, the processing module 202 inputs the physical fitness test data into a preset fitness plan generation model to obtain a fitness plan for the target user. The method further includes: the acquisition module 201 acquires a training data set, the training data set includes historical physical fitness test data and historical fitness plans of multiple historical users; the processing module 202 constructs a deep learning model based on a transformer structure; the training data set is input into the deep learning model for training to obtain a preset fitness plan generation model.

[0054] In a possible implementation, before the acquisition module 201 acquires the physical fitness test data of the target user collected by the target AR glasses, the method also includes: the processing module 202 sends an information collection command to the AR glasses, so that the AR glasses guide the target user to fill in basic information; the processing module 202 matches the corresponding physical fitness test task according to the basic information; the processing module 202 sends the physical fitness test task to the AR glasses, so that the AR glasses guide the target user to perform the physical fitness test.

[0055] In a possible implementation, the processing module 202 matches the corresponding physical fitness test task according to the basic information, specifically including: the processing module 202 inputs the basic information into a preset physical fitness task database to obtain the physical fitness test task, and the preset physical fitness task database includes the correspondence between the basic information and the physical fitness test task.

[0056] It should be noted that: when the device provided in the above embodiment realizes its function, only the division of the above functional modules is used as an example. In actual application, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the device and method embodiments provided in the above embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0057] The present application also provides an electronic device. Figure 3 , Figure 3 The electronic device 300 may include: at least one processor 301 , at least one network interface 304 , a user interface 303 , a memory 305 , and at least one communication bus 302 .

[0058] The communication bus 302 is used to realize the connection and communication between these components.

[0059] The user interface 303 may include a display screen (Display) and a camera (Camera). Optionally, the user interface 303 may also include a standard wired interface and a wireless interface.

[0060] The network interface 304 may optionally include a standard wired interface or a wireless interface (such as a WI-FI interface).

[0061] Among them, the processor 301 may include one or more processing cores. The processor 301 uses various interfaces and lines to connect various parts in the entire server, and executes various functions of the server and processes data by running or executing instructions, programs, code sets or instruction sets stored in the memory 305, and calling data stored in the memory 305. Optionally, the processor 301 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 301 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing the content to be displayed on the display screen; the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 301, and it can be implemented separately through a chip.

[0062] Among them, the memory 305 may include a random access memory (Random Access Memory, RAM) and may also include a read-only memory (Read-Only Memory). Optionally, the memory 305 includes a non-transitory computer-readable storage medium. The memory 305 can be used to store instructions, programs, codes, code sets or instruction sets. The memory 305 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc.; the data storage area may store data involved in the above-mentioned various method embodiments, etc. The memory 305 may optionally also be at least one storage device located away from the aforementioned processor 301. Refer to Figure 3 , the memory 305 as a computer storage medium may include an operating system, a network communication module, a user interface module, and an application program for a fitness assistance method based on AR glasses.

[0063] exist Figure 3 In the electronic device 300 shown, the user interface 303 is mainly used to provide an input interface for the user and obtain the data input by the user; and the processor 301 can be used to call the application program storing a fitness assistance method based on AR glasses in the memory 305. When executed by one or more processors 301, the electronic device 300 executes one or more of the methods described in the above embodiments. It should be noted that for the aforementioned method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should know that the present application is not limited to the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required for the present application.

[0064] The present application also provides a computer-readable storage medium, which stores instructions. When executed by one or more processors 301, the electronic device 300 executes one or more of the methods described in the above embodiments.

[0065] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0066] In the several embodiments provided in this application, it should be understood that the disclosed devices can be implemented in other ways. For example, the device embodiments described above are only schematic, such as the division of units, which is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some service interfaces, and the indirect coupling or communication connection of devices or units can be electrical or other forms.

[0067] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0068] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0069] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a memory and includes several instructions for a computer device (which can be a personal computer, server or network device, etc.) to execute all or part of the steps of the various embodiments of the present application. The aforementioned memory includes: various media that can store program codes, such as USB flash drives, mobile hard drives, magnetic disks or optical disks.

[0070] The above is only an exemplary embodiment of the present disclosure and cannot be used to limit the scope of the present disclosure. That is, any equivalent changes and modifications made according to the teachings of the present disclosure are still within the scope of the present disclosure. After considering the disclosure of the specification and the truth of practice, those skilled in the art will easily think of other embodiments of the present disclosure.

[0071] This application is intended to cover any variation, use or adaptation of the present disclosure, which follows the general principles of the present disclosure and includes common knowledge or customary technical means in the art not described in the present disclosure. The description and examples are to be regarded as exemplary only, and the scope and spirit of the present disclosure are defined by the claims.

Claims

1. A fitness assistance method based on AR glasses, characterized in that: The method comprises: Establishing a communication connection with a target AR glasses, where the target AR glasses are AR glasses worn by a target user; Acquire physical fitness test data for the target user collected by the target AR glasses; Inputting the physical fitness test data into a preset fitness plan generation model to obtain a fitness plan for the target user, wherein the fitness plan includes training movements, training frequency, and training intensity; Acquire the target user's sports data in real time; Determining whether the target user has abnormal behavior according to the fitness plan and the exercise data; If it is determined that the target user has abnormal behavior, an abnormal notification is sent to the target user to prompt the user to suspend the fitness plan.

2. The method according to claim 1, characterized in that The abnormal behavior includes non-standard action, and judging whether the target user has abnormal behavior according to the fitness plan and the exercise data specifically includes: Acquire an action picture of the target user, and perform feature extraction on the action picture to obtain action features; The cosine similarity is used to calculate the similarity between the action feature and the preset standard feature; If it is determined that the similarity is less than or equal to a preset similarity threshold, it is determined that the target user has non-standard action behavior.

3. The method according to claim 1, characterized in that The abnormal behavior also includes fatigue behavior, and judging whether the target user has abnormal behavior according to the fitness plan and the exercise data specifically includes: Performing statistical analysis on the exercise data to determine whether the target user has fatigue characteristics; If it is determined that the target user has fatigue characteristics, then it is determined that the target user has abnormal behavior.

4. The method according to claim 3, characterized in that The exercise data includes a plurality of heart rate data, and the statistical analysis of the exercise data to determine whether the target user has fatigue characteristics specifically includes: Calculating a difference between first heart rate data and second heart rate data, wherein the first heart rate data and the second heart rate data are any two adjacent heart rate data among the plurality of heart rate data; Determining whether the difference is greater than or equal to a preset heart rate threshold; If it is determined that the difference is greater than or equal to the preset heart rate threshold, it is determined that the target user has fatigue characteristics.

5. The method according to claim 1, characterized in that: Before inputting the physical fitness test data into a preset fitness plan generation model to obtain the fitness plan of the target user, the method further includes: Acquire a training data set, wherein the training data set includes historical physical fitness test data and historical fitness plans of multiple historical users; Build a deep learning model based on the transformer structure; The training data set is input into the deep learning model for training to obtain the preset fitness plan generation model.

6. The method according to claim 1, characterized in that Before acquiring the physical fitness test data for the target user collected by the target AR glasses, the method further includes: Sending an information collection command to the target AR glasses so that the target AR glasses can guide the target user to fill in basic information; Matching corresponding physical fitness test tasks according to the basic information; The physical fitness test task is sent to the target AR glasses so that the target AR glasses guide the target user to perform the physical fitness test.

7. The method according to claim 6, characterized in that The matching of the corresponding physical fitness test tasks according to the basic information specifically includes: The basic information is input into a preset physical fitness task database to obtain the physical fitness test task, wherein the preset physical fitness task database includes a correspondence between the basic information and the physical fitness test task.

8. A fitness auxiliary device based on AR glasses, characterized in that: The device comprises an acquisition module (201) and a processing module (202), wherein: The processing module (202) is used to establish a communication connection with a target AR glasses, wherein the target AR glasses are AR glasses worn by a target user; The acquisition module (201) is used to acquire the physical fitness test data of the target user collected by the target AR glasses; The processing module (202) is further used to input the physical fitness test data into a preset fitness plan generation model to obtain a fitness plan for the target user, wherein the fitness plan includes training movements, training frequency and training intensity; The acquisition module (201) is also used to acquire the motion data of the target user in real time; The processing module (202) is further used to determine whether the target user has abnormal behavior based on the fitness plan and the exercise data; The processing module (202) is further configured to send an abnormal notification to the target user if it is determined that the target user has abnormal behavior, so as to prompt the user to suspend the fitness plan.

9. An electronic device, characterized in that: The electronic device (300) comprises a processor (301), a memory (305), a user interface (303) and a network interface (304), wherein the memory (305) is used to store instructions, the user interface (303) and the network interface (304) are used to communicate with other devices, and the processor (301) is used to execute the instructions stored in the memory (305) so that the electronic device (300) executes the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores instructions, and when the instructions are executed, the method according to any one of claims 1 to 7 is executed.