MR Glasses Control Method and Device for Vertigo Rehabilitation and MR Glasses for Vertigo Rehabilitation

Abstract

This application is applicable to the technical field of MR glasses, and particularly relates to a control method and device for MR glasses for vertigo rehabilitation, and an MR glasses for vertigo rehabilitation. The method includes: obtaining the current rehabilitation training data of the patient; determining whether the patient meets the rehabilitation guidance condition based on the current rehabilitation training data of the patient; wherein, the rehabilitation guidance condition is used to represent that the patient needs training guidance when using the MR glasses for vertigo rehabilitation to perform vertigo rehabilitation training; if the patient meets the rehabilitation guidance condition, generating a rehabilitation guidance plan according to the current rehabilitation training data of the patient; and outputting the rehabilitation guidance plan to guide the patient to perform vertigo rehabilitation training. This method can provide personalized and real-time rehabilitation guidance plans and help improve the training efficiency of patients.

Description

Technical Field

[0001] This application belongs to the technical field of MR glasses, and particularly relates to a control method and device for an MR glasses for vertigo rehabilitation, and an MR glasses for vertigo rehabilitation. Background Art

[0002] An MR glasses for vertigo rehabilitation is a medical device based on Mixed Reality (MR) technology, which is specifically used to assist in the treatment and rehabilitation of patients with vertigo-related diseases. The MR glasses for vertigo rehabilitation uses virtual scenarios and interaction technologies to help patients perform functional training of the vestibular system, improve balance ability, and thus relieve vertigo symptoms.

[0003] In the prior art, when using an MR glasses for vertigo rehabilitation for vertigo rehabilitation training, patients may not receive timely training feedback or personalized guidance. Especially when the complexity of the rehabilitation task is high, it is difficult for patients to judge whether their actions are correct or reach the goal. If there is a lack of appropriate guidance during the rehabilitation training process, patients may repeatedly perform ineffective training, resulting in low rehabilitation efficiency. At the same time, training guidance without appropriate feedback and dynamic adjustment is likely to make patients feel confused or lose confidence.

[0004] In summary, when using an MR glasses for vertigo rehabilitation for vertigo rehabilitation training, there is a problem that the training efficiency of patients is low due to the lack of targeted guidance. Summary of the Invention

[0005] The embodiments of this application provide a control method and device for an MR glasses for vertigo rehabilitation, and an MR glasses for vertigo rehabilitation, which can solve the problem in the related art that when using an MR glasses for vertigo rehabilitation for vertigo rehabilitation training, the training efficiency of patients is low due to the lack of targeted guidance.

[0006] In a first aspect, the embodiments of this application provide a control method for an MR glasses for vertigo rehabilitation, including:

[0007] Obtaining the current rehabilitation training data of the patient; wherein, the current rehabilitation training data of the patient includes current action data and current training task information, the current training task information includes task type, standard action data, action threshold, and preset duration, and the current action data is obtained through the data acquisition module of the MR glasses for vertigo rehabilitation;

[0008] Based on the current rehabilitation training data of the patient, determining whether the patient meets the rehabilitation guidance condition; wherein, the rehabilitation guidance condition is used to represent that the patient needs training guidance when using the MR glasses for vertigo rehabilitation for vertigo rehabilitation training;

[0009] If the patient meets the rehabilitation guidance conditions, generate a rehabilitation guidance plan based on the patient's current rehabilitation training data;

[0010] Output the rehabilitation guidance plan to guide the patient in performing vestibular rehabilitation training.

[0011] In the embodiments of the present application, the above technical solutions have at least the following technical effects:

[0012] The method for controlling an MR glasses for vestibular rehabilitation provided by the present application first obtains the patient's current rehabilitation training data, which is beneficial to knowing the patient's current motion data (obtained through the data acquisition module of the MR glasses for vestibular rehabilitation) and the current training task information. Then, based on the patient's current rehabilitation training data, it is determined whether the patient meets the rehabilitation guidance conditions, which is beneficial to knowing whether the patient needs training guidance when using the MR glasses for vestibular rehabilitation for vestibular rehabilitation training. If the patient meets the rehabilitation guidance conditions, a rehabilitation guidance plan is generated according to the patient's current rehabilitation training data. Finally, the rehabilitation guidance plan is output to guide the patient in performing vestibular rehabilitation training. This method can analyze the patient's current motion data and training task information to determine in real time whether the patient meets the rehabilitation guidance conditions, can customize the most suitable rehabilitation plan for each patient, and improve the pertinence and personalization of rehabilitation training. If the patient fails to meet the training standard or motion threshold, this method can timely provide a guidance plan for the patient to help the patient adjust the motion and avoid inefficient or incorrect training, thereby improving the training efficiency. Through precise data monitoring and analysis, the patient's rehabilitation training plan is no longer a one-size-fits-all approach, but a personalized guidance plan generated according to the patient's real-time performance, which can help the patient avoid overtraining or undertraining during the rehabilitation process and thus promote the rehabilitation process more scientifically.

[0013] In a second aspect, an embodiment of the present application provides a control device for an MR glasses for vestibular rehabilitation, including:

[0014] An acquisition unit, configured to acquire the patient's current rehabilitation training data; wherein, the patient's current rehabilitation training data includes current motion data and current training task information, the current training task information includes task type, standard motion data, motion threshold, and preset duration, and the current motion data is obtained through the data acquisition module of the MR glasses for vestibular rehabilitation;

[0015] A judgment unit, configured to determine whether the patient meets the rehabilitation guidance conditions based on the patient's current rehabilitation training data; wherein, the rehabilitation guidance conditions are used to represent that the patient needs training guidance when using the MR glasses for vestibular rehabilitation for vestibular rehabilitation training;

[0016] A solution generation unit, configured to generate a rehabilitation guidance plan according to the current rehabilitation training data of the patient if the patient meets the rehabilitation guidance condition;

[0017] An output unit, configured to output the rehabilitation guidance plan to guide the patient to perform vertigo rehabilitation training.

[0018] In a third aspect, an embodiment of the present application provides an MR glasses for vertigo rehabilitation, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the method described in any one of the embodiments in the first aspect is implemented.

[0019] It can be understood that the beneficial effects of the above second aspect to the third aspect can refer to the relevant descriptions in the above first aspect, and will not be elaborated here. Description of the Drawings

[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0021] Figure 1 It is a schematic flowchart of a control method for MR glasses for vertigo rehabilitation provided by an embodiment of the present application;

[0022] Figure 2 It is a schematic implementation flowchart of a real-time control method in the control method for MR glasses for vertigo rehabilitation provided by an embodiment of the present application;

[0023] Figure 3 It is a schematic implementation flowchart of a control method based on the patient's voice in the control method for MR glasses for vertigo rehabilitation provided by an embodiment of the present application;

[0024] Figure 4 It is a schematic structural diagram of a control device for MR glasses for vertigo rehabilitation provided by an embodiment of the present application;

[0025] Figure 5 It is a schematic structural diagram of an MR glasses for vertigo rehabilitation provided by an embodiment of the present application. Detailed Embodiments

[0026] In the following description, specific details such as specific system architectures, technologies, etc. are presented for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, those skilled in the art should clearly understand that the present application can also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid unnecessary details from obscuring the description of the present application.

[0027] It should be understood that when used in the specification of the present application and the appended claims, the term "comprising" indicates the presence of the described features, wholes, steps, operations, elements, and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components, and / or their combinations.

[0028] It should also be understood that the term "and / or" used in the specification of the present application and the appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0029] As used in the specification of the present application and the appended claims, the term "if" can be interpreted as "when" or "once" or "in response to determining" or "in response to detecting" depending on the context. Similarly, the phrase "if determined" or "if [the described condition or event] is detected" can be interpreted as meaning "once determined" or "in response to determining" or "once [the described condition or event] is detected" or "in response to detecting [the described condition or event]" depending on the context.

[0030] In addition, in the description of the specification of the present application and the appended claims, the terms "first", "second", "third", etc. are only used for distinguishing descriptions and cannot be understood as indicating or implying relative importance.

[0031] The reference to "one embodiment" or "some embodiments" or the like described in the specification of the present application means that a specific feature, structure, or characteristic described in connection with that embodiment is included in one or more embodiments of the present application. Thus, statements such as "in one embodiment", "in some embodiments", "in other some embodiments", "in still other embodiments", etc. that appear in different places in this specification do not necessarily all refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in another way. The terms "comprising", "including", "having", and their variants all mean "including but not limited to", unless otherwise specifically emphasized in another way.

[0032] In the related art, when using an MR glasses for vertigo rehabilitation to perform vertigo rehabilitation training, patients may not receive timely training feedback or personalized guidance. Especially when the complexity of the rehabilitation task is relatively high, it is difficult for patients to determine whether their movements are correct or whether they have achieved the goal. During the rehabilitation training process, if there is a lack of appropriate guidance, patients may repeatedly perform ineffective training, resulting in low rehabilitation efficiency. At the same time, training guidance without appropriate feedback and dynamic adjustment is likely to make patients feel confused or lose confidence.

[0033] To solve the above problems, the embodiments of the present application provide a control method, a device, and an MR glasses for vertigo rehabilitation. In this method, first, by obtaining the current rehabilitation training data of the patient, it is beneficial to know the patient's current movement data (obtained through the data acquisition module of the MR glasses for vertigo rehabilitation) and the current training task information. Then, based on the patient's current rehabilitation training data, it is determined whether the patient meets the rehabilitation guidance conditions, which is beneficial to know whether training guidance is required when the patient uses the MR glasses for vertigo rehabilitation to perform vertigo rehabilitation training. If the patient meets the rehabilitation guidance conditions, a rehabilitation guidance plan is generated according to the patient's current rehabilitation training data. Finally, the rehabilitation guidance plan is output to guide the patient to perform vertigo rehabilitation training. By analyzing the patient's current movement data and training task information, this method can determine in real time whether the patient meets the rehabilitation guidance conditions, can customize the most suitable rehabilitation plan for each patient, and improve the pertinence and personalization of rehabilitation training. If the patient fails to meet the training standard or movement threshold, this method can timely provide a guidance plan for the patient to help the patient adjust the movement, avoid inefficient or incorrect training, and thus improve the training efficiency. Through precise data monitoring and analysis, the patient's rehabilitation training plan is no longer a one-size-fits-all approach, but a personalized guidance plan generated according to the patient's real-time performance, which can help the patient avoid overtraining or undertraining during the rehabilitation process, thereby promoting the rehabilitation process more scientifically.

[0034] The control method for the MR glasses for vertigo rehabilitation provided by the embodiments of the present application can be applied to the MR glasses for vertigo rehabilitation. At this time, the MR glasses for vertigo rehabilitation are the execution subject of the control method for the MR glasses for vertigo rehabilitation provided by the embodiments of the present application. The embodiments of the present application do not impose any restrictions on the specific type of the MR glasses for vertigo rehabilitation.

[0035] Exemplarily, the MR glasses for vertigo rehabilitation may include a display module, a voice playback module, a data acquisition module, and a control module. The display module is a module capable of displaying rehabilitation guidance content, and may include waveguide display, OLED / LED screen display, head-mounted display (HMD), etc.; the voice playback module is a module capable of playing rehabilitation guidance content, and may include an integrated text-to-speech (TTS) module, natural language processing (NLP) voice recognition, two-way voice communication, etc.; the data acquisition module is a module capable of acquiring the motion data of the patient, and may include an inertial measurement unit (IMU), an eye tracker, a temperature sensor, etc.; the control module is a module capable of performing data processing and controlling the display module, the voice playback module, and the data acquisition module, and may include a central processing unit (CPU / SoC), a motion capture and analysis module, a wireless communication module (such as Bluetooth, Wi-Fi), a battery management and power control module, an environmental perception module, a biofeedback module, etc.

[0036] To better understand the control method of the MR glasses for vertigo rehabilitation provided by the embodiments of the present application, the following provides an exemplary introduction to the specific implementation process of the control method of the MR glasses for vertigo rehabilitation provided by the embodiments of the present application.

[0037] Figure 1 The schematic flowchart of the control method of the MR glasses for vertigo rehabilitation provided by the embodiments of the present application is shown. The control method of the MR glasses for vertigo rehabilitation includes:

[0038] S100, obtaining the current rehabilitation training data of the patient. Among them, the current rehabilitation training data of the patient includes current motion data and current training task information. The current training task information includes task type, standard motion data, motion threshold, and preset duration. The current motion data is obtained through the data acquisition module of the MR glasses for vertigo rehabilitation.

[0039] It can be understood that the current motion data of the patient may include head motion data, eye movement data, acceleration and gyroscope data, and physiological signals. The head motion data may include the rotation angle, tilt angle, displacement, etc. of the head, and can be used as a basis for evaluating the patient's balance control and vertigo response; the eye movement data records the eye movement trajectory, eyeball rotation angle, etc. of the patient through an eye movement sensor. The eye movement control is closely related to balance; the acceleration and gyroscope data can detect the overall motion state of the patient and judge whether the patient has an unstable body posture or abnormal movement; the physiological signals, such as the patient's heart rate, blood oxygen saturation, etc., are used to evaluate the patient's physiological response and help judge whether the patient is over-fatigued or has other health problems.

[0040] The data acquisition module may include: an inertial measurement unit (IMU), integrating an accelerometer and a gyroscope, for monitoring the movements of the patient's head and eyes; an eye tracker, for tracking the dynamic changes of the eyes and evaluating whether the patient's eye movements are normal; other sensors, such as a temperature sensor, a heart rate sensor, etc., to further supplement the data during the training process.

[0041] Exemplarily, the movement and physiological data of the patient can be collected in real time through built-in sensors (IMU, eye tracker, heart rate sensor, etc.).

[0042] Exemplarily, the current training task information is pre-stored in the MR glasses for vertigo rehabilitation. The current training task information includes task type, standard action data, action threshold, and preset duration. The task type is used to define the nature of the current task. For example, it is balance training, rotation training, eye movement training, etc. Different types of tasks will have different requirements for the patient's actions. The standard action data can be preset to ensure the standardization and effectiveness of the rehabilitation training as a reference for the patient to complete the task. The standard action data can include the frequency, angle, duration, speed, position, etc. of the action. The action threshold can be set to monitor the quality of the patient's actions. When the patient's actions deviate from the standard action data by a certain degree, a warning can be issued or the training content can be adjusted. For example, when the angle deviation of the action exceeds a certain range, the patient can be prompted to make adjustments. The preset duration can be set for each training task to limit the training time and avoid the patient from being over-fatigued. The training duration can be dynamically adjusted according to the patient's physical condition or rehabilitation progress.

[0043] Through this step, the current action data of the patient can be collected in real time, which helps to judge the patient's rehabilitation status and provides a basis for whether the patient needs rehabilitation training guidance in the future.

[0044] S200, based on the patient's current rehabilitation training data, determine whether the patient meets the rehabilitation guidance conditions. Among them, the rehabilitation guidance conditions are used to represent that the patient needs training guidance when using the MR glasses for vertigo rehabilitation training.

[0045] It can be understood that the rehabilitation guidance conditions can be a set of preset criteria, which are designed to determine whether one or more rehabilitation guidance conditions are met through the analysis of the patient's current training data. These conditions indicate that the patient may encounter difficulties during training and need additional guidance. The rehabilitation guidance conditions can include: movement accuracy, whether the patient's current movement matches the standard movement data (such as angles, frequencies, speeds, etc.). If the patient's movement deviates significantly from the standard movement, guidance may be needed to adjust the movement; movement intensity, whether the patient's movement reaches the preset movement threshold. For example, rotational or balance tasks during training require a certain level of movement intensity. If the movement intensity is insufficient, it may mean that the training effect is not ideal; movement duration, whether the patient can maintain the movement for a sufficient time to complete the training task. If the patient fails to maintain the specified movement duration, or the training duration is insufficient to meet the rehabilitation requirements, guidance can be provided; movement stability, whether the patient's balance is stable during training. If the patient frequently shows unstable balance during rehabilitation training, auxiliary guidance may be needed; physiological state monitoring, whether physiological parameters such as heart rate and blood oxygen are within the normal range. If the patient's physiological state deviates from the normal range (such as excessive fatigue, too fast heart rate, etc.), the training intensity may need to be reduced or restorative guidance provided.

[0046] Exemplarily, the patient's current movement data can be compared with the standard movement data to check whether the patient is within the specified movement angle range, whether the movement frequency and duration required for the task are completed, whether the movement is completed within the predetermined time, and whether there is unstable balance or abnormal posture. For example, if the training task requires the patient to perform 10 head rotations, and the patient's frequency is less than 10 times, the patient will be prompted to increase the movement frequency.

[0047] Based on the preset movement threshold, it can be judged whether the patient's movement is qualified. For example, a movement amplitude threshold is set. When the patient's movement amplitude is less than the movement amplitude threshold, it can be judged that the patient fails to complete the task requirements, and the patient is prompted to strengthen the movement.

[0048] The patient's physiological state can be evaluated through physiological monitoring (such as heart rate, blood oxygen, etc.). If the patient's physiological indicators exceed the safe range (such as too fast or too slow heart rate, too low blood oxygen saturation), it can be judged that the patient needs to interrupt the training for recovery or adjust the training intensity. For example, if the heart rate exceeds 120 beats per minute or the blood oxygen saturation is less than 90%, the patient will be prompted to slow down or pause the training.

[0049] If the patient frequently shows imbalance, dizziness or other unstable manifestations during training, the balance state can be detected by sensors to judge whether the rehabilitation guidance conditions are met. For example, if it is detected that the patient often loses balance during training, the patient may be prompted to adjust the training posture or pause the training to restore stability.

[0050] Through this step, by comparing and analyzing the current training data with the preset standard action data, action thresholds, etc., it is possible to determine whether the patient meets the rehabilitation guidance conditions. When the patient's performance does not meet the training standards, rehabilitation guidance can be automatically triggered to provide personalized training adjustments and suggestions, which is beneficial to the scientific nature and effectiveness of rehabilitation training and can avoid low rehabilitation efficiency caused by errors or inappropriateness in training.

[0051] In a possible implementation, please refer to Figure 2 , S200, based on the patient's current rehabilitation training data, determine whether the patient meets the rehabilitation guidance conditions, including:

[0052] S210, according to the task type in the current training task information, extract the action data corresponding to the task type from the current action data.

[0053] It can be understood that the task type can include balance training, rotation training, eye movement training, gaze tracking training, and vestibular training. The goal of balance training is to improve the patient's balance ability and reduce symptoms such as dizziness. The task of balance training is to train the patient to perform stable control of the head, body, or eyes. The action data corresponding to balance training can include stability data of the head, eyes, or body, such as angle changes and position movements.

[0054] The goal of rotation training is to improve the patient's rotational control ability of the head or body. The task of rotation training is to train the patient to perform rotational movements of the head, body, or eyes. The action data corresponding to rotation training can include rotation angle, rotation speed, rotation direction, and duration.

[0055] The goal of eye movement training is to enhance eye coordination and control the stability of eye movement. The task of eye movement training is to train the patient to perform eye movements. The action data corresponding to eye movement training can include the rotation angle of the eyeball, rotation speed, and duration of eye movement.

[0056] The goal of gaze tracking training is to improve the patient's eye tracking ability. The task of gaze tracking training is to train the patient to track a moving target with the eyes. The action data corresponding to gaze tracking training can include the tracking path of the eyes, tracking speed, and tracking accuracy.

[0057] The goal of vestibular training is to improve the patient's vestibular adaptation ability and reduce the occurrence of dizziness. The task of vestibular training is to train the response and control of the patient's vestibular system. The action data corresponding to vestibular training can include head acceleration, rotation angle, and stability of head posture.

[0058] Exemplarily, for each task type, there is corresponding action data, and the relevant action data can be captured and extracted in real time by the data acquisition module. Balance training: Angle data of the head, eyes or body can be extracted from the current action data, and the angle data of the head, eyes or body can be obtained by devices such as acceleration sensors, gyroscopes, and eye trackers. For example, an IMU sensor is used to monitor the angle change of the head, or eye movement data of the eyeballs is extracted through an eye tracking device.

[0059] Rotation training: Data such as rotation angle, rotation speed, and rotation direction can be extracted from the current action data, and the rotation angle, rotation speed, rotation direction, etc. can be used to monitor the rotation process in real time through a gyroscope or a motion capture device. For example, monitor the rotation angle and rotation speed of the head, and record the amplitude and duration of each rotation.

[0060] Eye movement training: Data such as the rotation angle (such as horizontal and vertical angles) and rotation speed of the eyeballs can be extracted from the current action data, and the rotation angle, rotation speed, etc. of the eyeballs can be obtained by an eye tracker or a head-mounted eye tracking device.

[0061] Gaze tracking training: Data such as the path of the eyes tracking an object, tracking speed, and tracking accuracy can be extracted from the current action data, and the path data of the eyes tracking an object, tracking speed, and tracking accuracy can be obtained by an eye tracking system (eye tracker or head-mounted eye tracking device).

[0062] Vestibular training: Data such as the acceleration, rotation angle, and position of the head can be extracted from the current action data, and the acceleration, rotation angle, and position of the head can be obtained through the acceleration sensor and gyroscope data of the head.

[0063] The data extracted through this step is used for subsequent analysis, comparison, and rehabilitation guidance.

[0064] S220. Calculate the deviation between the action data corresponding to the task type and the standard action data in the current training task information to obtain a deviation value.

[0065] It can be understood that the deviation value reflects the difference between the patient's current action and the standard requirements. The larger the deviation value, the more the patient's action does not meet the standard, and it may be necessary to adjust the training task or provide further rehabilitation guidance. The size of the deviation value is the basis for judging whether the rehabilitation guidance conditions are met.

[0066] For each type of task mentioned in step S210, the action data corresponding thereto has corresponding standard action data. For example, for rotation training, the action data may include the rotation angle, rotation speed, rotation direction, and duration. Then, the standard action data in the rotation training task information may include the standard rotation angle, standard rotation speed, standard rotation direction, and standard duration.

[0067] Exemplarily, for rotation training, balance training, or eye movement training, the angular deviation between the angular data of the patient's current action and the angular data of the standard action can be calculated, that is , represents the angular deviation value, represents the angular data of the current action, represents the angular data of the standard action. For example, if the patient's head rotation angle is 25°, while the standard action requires 30°, then the deviation value is .

[0068] For training tasks involving time (such as the duration of maintaining a certain action), the duration deviation can be calculated, that is , represents the duration deviation, represents the duration of the current action, represents the standard duration. For example, the standard duration is 60 seconds, while the patient completed it in 50 seconds, then the deviation value is .

[0069] For training tasks involving speed (such as the rotation speed in rotation training and the tracking speed in gaze tracking training), the speed deviation between the actual action speed of the patient and the standard action speed can be calculated, that is , represents the speed deviation, represents the current action speed, represents the standard action speed. For example, the standard rotation speed is 60° / second, while the patient's rotation speed is 55° / second, then the deviation value is .

[0070] In balance training, the position deviation between the patient's actual action and the standard action can be calculated. The position deviation refers to the gap between the relative position of the body or head and the standard position, that is , represents the position deviation, represents the position of the current action, represents the position of the standard action. For example, the standard action position is 0° (representing the balance center position), but the patient is offset by 5°, then the deviation value is .

[0071] The deviation value obtained by comparing the actual movement data of the patient with the standard movement data reflects the patient's performance in rehabilitation training. The deviation value can help determine whether the patient needs rehabilitation guidance and provide a basis for subsequent rehabilitation programs.

[0072] S230. Compare the deviation value with the movement threshold in the current training task information to determine whether the deviation value exceeds the movement threshold, and obtain a first judgment result.

[0073] It can be understood that the movement threshold refers to the maximum allowable deviation between the patient's movement data and the standard movement data, and is used to determine whether the patient's movement meets the standard. The movement threshold can be set according to the requirements of the training task to ensure the training effect and safety.

[0074] Exemplarily, compare the calculated deviation value with the movement threshold in the training task information. If the deviation value is greater than the movement threshold, the first judgment result is that the deviation exceeds the standard, indicating that the patient's movement does not meet the standard requirements and rehabilitation guidance can be provided. If the deviation value is within the movement threshold, the first judgment result is that the deviation is normal, indicating that the patient's movement meets the requirements and no rehabilitation guidance is temporarily required.

[0075] S240. When the first judgment result indicates that the deviation value exceeds the movement threshold, determine that the patient meets the rehabilitation guidance condition.

[0076] Exemplarily, when the deviation value exceeds the set movement threshold, it can be determined that the patient meets the rehabilitation guidance condition, and a further rehabilitation guidance plan, such as movement correction, training adjustment, etc., can be initiated. For example, the standard movement data requires the patient to maintain for 10 seconds at a rotation angle of 30°. The patient actually rotates 20° and maintains for 12 seconds, and the movement threshold is an angle threshold of 3° and a duration threshold of 3s. Then the angle deviation is 10° and the duration deviation is 2s. The angle deviation exceeds the angle threshold, and the duration deviation does not exceed the duration threshold. The patient's movement does not meet the standard requirements, and rehabilitation guidance can be provided.

[0077] By calculating the deviation from the standard movement data and comparing the deviation value with the set movement threshold, it can effectively determine whether the patient meets the rehabilitation guidance condition and provide a basis for whether subsequent rehabilitation training of the patient needs to be guided.

[0078] S300. If the patient meets the rehabilitation guidance condition, generate a rehabilitation guidance plan according to the patient's current rehabilitation training data.

[0079] Exemplarily, the training tasks can be adjusted according to the patient's performance. The difficulty of the training tasks can be adjusted. If the patient fails to meet the standard movement requirements (such as movement angle, frequency, etc.), the difficulty of the task can be reduced or the task can be simplified. For example, if the rotation angle of the patient's movement is insufficient, it can be recommended to reduce the standard angle. The training duration can be adjusted. If the patient cannot maintain the training duration (such as not reaching the set 1-minute training time), the training duration can be shortened and gradually increased to avoid over-fatigue. The task type can be changed. If the patient encounters difficulties in a specific training task, the task type can be temporarily changed. For example, if the patient has difficulties in balance training, it can be changed to a simpler head movement training.

[0080] The patient's current movement can be corrected. Instant movement correction guidance can be provided through a display module (such as the display screen of MR glasses) or a voice playback module. For example, if the deviation of the patient's head rotation angle is large, a voice prompt can be used to ask the patient to turn the head to a 30-degree angle, or an action demonstration can be presented on the display screen. If the intensity of the patient's movement does not meet the requirements, suggestions can be provided to strengthen the movement, such as increasing the rotation speed or the range of motion.

[0081] If the patient's balance is unstable or there are obvious dizziness symptoms, the training content can be adjusted to increase more balance exercises. For example, for dizziness relief training, slow and progressive movements are provided to avoid rapid head movements and reduce the patient's sense of dizziness; for strengthening support training, such as suggesting that the patient support on a wall or a chair for more stable balance training.

[0082] If abnormal physiological parameters of the patient are detected (such as too fast heart rate, too low blood oxygen, etc.), the rehabilitation guidance plan may include adjusting the training intensity. If the patient's physiological indicators are on the high side, the training intensity can be reduced or the training can be suspended until the physiological parameters return to the normal range; rest or recovery. If the patient's physiological state is unstable, the patient can be prompted to rest or perform restorative training, such as deep breathing training, static balance training, etc.

[0083] Through this step, the training tasks can be adjusted in real time according to the patient's current rehabilitation training data, corrective feedback can be provided, and appropriate guidance can be given according to the patient's physiological state and training progress. It helps to optimize the rehabilitation process, improve the training efficiency, avoid mistakes or over-fatigue in training, and ultimately achieve better rehabilitation effects.

[0084] In a possible implementation, please refer to Figure 2 , in step S300, a rehabilitation guidance plan is generated according to the patient's current rehabilitation training data, including:

[0085] S310. Determine the deviation direction of the action data corresponding to the task type according to the action data corresponding to the task type and the standard action data in the current training task information.

[0086] It can be understood that the deviation direction can represent the difference direction between the patient's actual action and the standard action. According to different task types and calculation methods of deviation values, the deviation direction can have multiple manifestations, which can be specifically determined according to the characteristics of the task type and action data.

[0087] Exemplarily, for the determination of the rotation deviation direction: If the current rotation angle is greater than the standard angle (for example, the patient rotates 40° while the standard requires 30°), the deviation direction can be excessive. If the current rotation angle is less than the standard angle (for example, the patient rotates 20° while the standard requires 30°), the deviation direction can be insufficient.

[0088] For the determination of the action duration deviation direction: If the current duration is greater than the standard duration (for example, the patient's action time is 70 seconds and the standard is 60 seconds), the deviation direction is too long. If the current duration is less than the standard duration (for example, the patient's action time is 50 seconds and the standard is 60 seconds), the deviation direction is too short.

[0089] For the determination of the speed deviation direction: If the patient's rotation speed is greater than the standard speed (for example, the patient's rotation speed is 65° / second and the standard is 60° / second), the deviation direction is too fast. If the patient's rotation speed is less than the standard speed (for example, the patient's rotation speed is 55° / second and the standard is 60° / second), the deviation direction is too slow.

[0090] For the determination of the position deviation direction: If the patient's balance angle deviates from the standard position and the deviation is greater than the range allowed by the standard, the deviation direction is too far.

[0091] The determination of the deviation direction can be used to determine the action data whose deviation value exceeds the corresponding action threshold, and there is no need to determine the deviation direction of the action data whose deviation value is within the corresponding action threshold. For example, for the action data of rotation training involving action duration and rotation angle, the patient rotates 40°, the standard is 30°, and the corresponding threshold is 5°, then the deviation value (10°) exceeds the threshold (5°); the patient's action time is 61 seconds, the standard is 60 seconds, and the corresponding threshold is 3 seconds, then the deviation value (1 second) does not exceed the threshold (3 seconds); then only the rotation deviation direction of this patient needs to be determined, and the deviation direction is excessive, and there is no need to determine the action duration deviation direction.

[0092] S320. Obtain the first text template according to the deviation direction of the action data corresponding to the task type.

[0093] It can be understood that based on step S210 and step S220, it can be known that each task type corresponds to multiple action data. A text template can be set for each action data. The text template can be preset as a general guiding statement, and the template content can include information such as how to correct deviations and how to improve training.

[0094] Exemplarily, the first text template for the rotation angle (such as balance training, rotation training, etc.) can include a text template with an excessive deviation direction and a text template with a deficient deviation direction. The text template with an excessive deviation direction can be set as "Your rotation angle is {current angle}°, exceeding the standard requirement of {standard angle}°. Please reduce the rotation amplitude to the standard angle."; the text template with a deficient deviation direction can be set as "Your rotation angle is {current angle}°, lower than the standard requirement of {standard angle}°. Please increase the rotation amplitude to the standard angle."

[0095] The first text template for the action duration (the patient maintains a certain action posture within a certain period of time) can include a text template with an excessive deviation direction and a text template with a deficient deviation direction. The text template with an excessive deviation direction can be set as "Your training duration is {current duration} seconds, exceeding the standard duration of {standard duration} seconds. It is recommended to reduce the training duration to the standard range."; the text template with a deficient deviation direction can be set as "Your training duration is {current duration} seconds, lower than the standard duration of {standard duration} seconds. Please continue to maintain until you reach the standard."

[0096] The first text template for speed can include a text template with an excessive deviation direction and a text template with a deficient deviation direction. The text template with an excessive deviation direction can be set as "Your training speed is {current speed}° / second, exceeding the standard requirement of {standard speed}° / second. It is recommended to slow down the speed to the standard range."; the text template with a deficient deviation direction can be set as "Your training speed is {current speed}° / second, lower than the standard requirement of {standard speed}° / second. Please increase the speed to the standard range."

[0097] The first text template for the position (such as balance training) can include a text template with an excessive deviation direction. The text template with an excessive deviation direction can be set as "Your balance angle is {current angle}°, deviating from the standard balance position. Please adjust your posture and try to stay within the standard balance range."

[0098] The first text template corresponding to the deviation direction can be selected from the pre-stored text template collection. For example, based on the example in step S310, it can be known that the rotation deviation direction of the rotation training is excessive and the duration deviation value does not exceed the corresponding threshold. Then, select the text template with an excessive rotation deviation direction from the pre-stored text template collection.

[0099] S330. Generate rehabilitation guidance text data based on the action data corresponding to the task type, the standard action data in the current training task information, and the first text template.

[0100] Exemplarily, fill the action data corresponding to the task type and the standard action data in the current training task information into the selected first text template to generate rehabilitation guidance text data. For example, if the rotation deviation direction of the rotation training is excessive, and the selected first text template is "Your rotation angle is {current angle}°, exceeding the standard requirement of {standard angle}°. Please reduce the rotation amplitude to the standard angle.", the patient rotates 40° and the standard is 30°. Fill these data into the text template to obtain the rehabilitation guidance text data as "Your rotation angle is 40°, exceeding the standard requirement of 30°. Please reduce the rotation amplitude to the standard angle.".

[0101] S340. Perform speech conversion processing on the rehabilitation guidance text data to obtain rehabilitation guidance speech data.

[0102] Exemplarily, a suitable text-to-speech engine can be selected, such as Google TTS, Amazon Polly, Baidu Speech Synthesis, etc. After selecting the text-to-speech engine, parameters such as speech rate and pitch can be adjusted to make the speech more suitable for the rehabilitation training environment. Input the rehabilitation guidance text data into the engine, and the engine will convert the text into an audio file (rehabilitation guidance speech data), which can be in formats such as MP3, WAV, or other audio formats.

[0103] S350. Mark the standard action data in the current training task information to obtain the marked standard action data.

[0104] It can be understood that marking the standard action data means making the patient more clearly aware of the requirements of the standard action through visual or other forms of marking.

[0105] Exemplarily, the standard action data can be marked using graphical markings. Graphical markings display the standard action data through virtual marking lines, graphics, or identifiers. Suppose the standard rotation angle in rotation training is 30°. The MR glasses can display a virtual arc marking line on the screen to indicate the standard rotation angle and use color changes or other visual effects (for example, green represents compliance with the standard, and red represents deviation). In balance training, the standard position is 0°. A center point or vertical line can be displayed in the MR glasses to help the patient judge their balance angle.

[0106] Numeric markers can be used to mark standard action data. The numeric markers guide patients by showing the numeric requirements of standard actions (such as angles, durations, speeds, etc.), and can be presented in a combination of text, numbers, or graphics. For example, MR glasses can display the standard duration and countdown to help patients track their progress in time.

[0107] In complex training tasks, graphics and numeric markers can be combined to provide dual feedback, enabling patients to simultaneously see the numeric requirements of standard actions and graphical visual guidance.

[0108] By displaying graphical and numeric markers in MR glasses, it can help patients perform training tasks more precisely, especially in rehabilitation training that requires precise control of angles, durations, or speeds. Graphical markers provide intuitive visual references, while numeric markers can provide clear standard requirements. The combination of the two can enhance patients' understanding and execution ability of standard actions, improving the effectiveness of rehabilitation training.

[0109] S360, Determine the rehabilitation guidance text data, rehabilitation guidance voice data, and marked standard action data as the rehabilitation guidance plan.

[0110] Exemplarily, the text data, voice data, and marked data can be integrated into a complete rehabilitation guidance plan and provided to patients for the next step of training.

[0111] Through these above steps, specific rehabilitation guidance text can be generated, converted into voice for real-time prompts, and at the same time, by marking the standard action data, it helps patients understand the correct training requirements, which can improve the training effect of patients and contribute to more personalized and precise rehabilitation training.

[0112] S400, Output the rehabilitation guidance plan to guide patients in performing vertigo rehabilitation training.

[0113] Exemplarily, the rehabilitation guidance plan can be output through a voice playback module to provide patients with specific action correction suggestions, training adjustments, and physiological state recovery prompts.

[0114] The rehabilitation guidance plan can be output through a display module (such as the screen of MR glasses) to provide patients with dynamic action demonstrations, real-time prompts, or comparisons between standard actions and current actions, helping patients better understand the training tasks.

[0115] A training progress report can be generated to provide feedback on the patient's current training status, achieved goals, and areas for improvement. The report can be provided to patients or rehabilitation experts through MR glasses, mobile devices, or a telemedicine platform.

[0116] Rehabilitation training is a process of continuous optimization. After each training session, data can be recorded based on the patient's performance, and this data can be used to optimize the rehabilitation plan. For example, if a patient often fails to meet the standard requirements in a certain task, the training difficulty can be increased or the training method can be changed. Additionally, the physiological state changes of the patient can be tracked to adjust the training intensity and task difficulty, so that the rehabilitation training can challenge the patient while avoiding overloading.

[0117] Through this step, personalized and timely guidance can be provided to the patient, improving the training effect and avoiding rehabilitation delays caused by improper training or incorrect postures.

[0118] In a possible implementation, in step S400, a rehabilitation guidance plan is output, including:

[0119] S410, sending the rehabilitation guidance text data and the marked standard action data to the display module of the MR glasses for vertigo rehabilitation, so that the display module displays the rehabilitation guidance text data and the marked standard action data.

[0120] Exemplarily, the text data can be sent to the display system module of the MR glasses through a suitable protocol (such as HTTP, WebSocket, etc.). The display module receives the text data and renders the data onto the display screen. The marked standard action data (such as virtual marking lines, angle values, etc.) is transmitted to the display module through wireless transmission technologies (such as Wi-Fi, Bluetooth, etc.).

[0121] After receiving the data, the display module can perform real-time rendering through the rendering engine built into the MR glasses, and display the rehabilitation guidance text and the graphical markings of the standard actions in the patient's field of view. According to the text format, the rehabilitation guidance text is displayed in an appropriate font and layout; according to the standard action data, virtual graphical marking lines or markings are superimposed in the patient's field of view.

[0122] S420, sending the rehabilitation guidance voice data to the voice playback module of the MR glasses for vertigo rehabilitation, so that the voice playback module plays the voice content in the rehabilitation guidance voice data.

[0123] Exemplarily, the voice data can be streamed to the voice playback module of the MR glasses using a wireless transmission method (such as Wi-Fi, Bluetooth, etc.). After receiving the voice data, the voice playback module plays the voice content through the built-in speaker or earphone of the MR glasses.

[0124] A timestamp, event-driven, or polling mechanism can be used to achieve the consistency of the display and voice content. For example, the audio and display content are synchronized according to the timestamp, so that both are updated at the same time point.

[0125] Through the above steps, the rehabilitation guidance text data and the marked standard action data can be effectively sent to the display module of the MR glasses for vertigo rehabilitation, and the rehabilitation guidance voice data can be sent to the voice playback module, thereby realizing dual feedback of vision and hearing, helping patients perform rehabilitation training tasks more accurately, and significantly improving the training effect and the patient's sense of participation.

[0126] In a possible implementation, please refer to Figure 3 , the control method of the MR glasses for vertigo rehabilitation further includes:

[0127] S10, Obtain the voice data of the patient.

[0128] Exemplarily, the voice acquisition module (such as a microphone or a built-in audio sensor) of the MR glasses for vertigo rehabilitation can be used to record the voice data of the patient in real time. The voice data can include the voice feedback or interaction content of the patient during the training process. The recorded voice data can be stored in the form of an audio file (such as WAV, MP3, FLAC, etc.).

[0129] S20, Perform noise reduction processing on the voice data of the patient to obtain the first voice data.

[0130] Exemplarily, after receiving the voice data, a noise reduction algorithm can be used to perform noise reduction processing on the voice data. For example, spectral subtraction, by estimating the noise spectrum and subtracting the noise from the signal to retain the main voice signal; Wiener filtering, based on statistical information for filtering to remove noise; deep learning noise reduction, using deep neural networks (DNNs) or convolutional neural networks (CNNs) to enhance the voice signal. The noise-reduced voice data (the first voice data) is clearer, the background noise is effectively suppressed, and the voice content is easier to process.

[0131] S30, Perform voice content recognition on the noise-reduced voice data to obtain the first text data.

[0132] Exemplarily, voice recognition models such as Google Speech-to-Text, Microsoft Azure Speech, etc. APIs can be used to recognize the noise-reduced voice data and convert the voice data into text (the first text data), or local voice recognition technology can be used to complete it.

[0133] S40, Perform purpose prediction on the first text data to obtain a prediction result, and determine whether the patient meets the rehabilitation guidance conditions according to the prediction result.

[0134] Exemplarily, the purpose of the first text data can be predicted based on rules, and the patient's intention can be judged according to keywords or fixed statement patterns. For example, keywords such as "completed", "achieved", "standard", etc. identify progress feedback; keywords such as "next", "what to do", etc. identify the need for guidance. Deep learning models (such as language models like BERT, GPT, etc.) can be used to understand the patient's intention based on the context. The prediction results can include progress feedback (indicating that the patient is giving feedback on their training progress), standard confirmation (indicating that the patient is asking whether the standard has been achieved), guidance request (indicating that the patient is requesting the next step of guidance), fatigue / rest request (indicating that the patient is requesting a rest).

[0135] If the patient's feedback indicates that the standard action has been completed (such as "I have already rotated 30°"), the prediction result is progress feedback, and it can be verified whether the patient's action meets the standard. If the action angle, duration, etc. all meet the set standard, no further rehabilitation guidance is required. If the patient asks whether the standard has been achieved (such as "Am I doing it right?"), the prediction result is standard confirmation, and it can be compared with the standard based on the current training data. If the patient has not reached the standard, a rehabilitation guidance plan is generated to inform the patient that further training is needed. If the patient expresses doubts about the next step of training (such as "What to do next?" or "Can I continue training?"), the prediction result is a guidance request, and appropriate guidance can be generated according to the current training task and progress to guide the patient to carry out the next step of training. If the patient expresses a need for rest (such as "I'm too tired"), the prediction result is a fatigue / rest request, and the training can be paused or the training intensity can be reduced.

[0136] Through these above steps, the patient's purpose can be identified in a timely manner, the patient's training status can be evaluated, and personalized feedback can be provided to the patient, thereby effectively improving the efficiency of rehabilitation training.

[0137] Optionally, please refer to Figure 3 , S40, perform purpose prediction on the first text data to obtain a prediction result, and according to the prediction result, determine whether the patient meets the rehabilitation guidance conditions, including:

[0138] S41, extract the text features of the first text data to obtain a text feature vector.

[0139] Exemplarily, the first text data can be preprocessed, such as word segmentation, stop word removal, case conversion, etc. A suitable feature extraction method (such as bag-of-words model, TF-IDF, Word2Vec, GloVe, BERT, etc.) can be selected to convert the preprocessed first text data into a feature vector (text feature vector). The generated text feature vector is a set of numerical values, representing the semantics and structure of the text, and can be processed by machine learning models.

[0140] S42. Input the text feature vector into the purpose prediction model, so that the purpose prediction model predicts the purpose of the patient, and obtain the prediction result. Among them, the purpose prediction model is a machine learning model.

[0141] Exemplarily, the training process of the purpose prediction model: The voice data of the patient can be collected (collected through MR glasses) and converted into text data through speech recognition technology. Each piece of text data can be manually or semi-automatically labeled with a purpose (such as pause request, guidance request, fatigue / rest request, request to change the training task, standard confirmation, action adjustment request), and each piece of text data is subjected to data cleaning and preprocessing. Input the processed text data into the feature extraction method to generate the corresponding feature vector. The feature vector represents the vocabulary and semantic information in the text and can be understood by the machine learning model. Divide the text data into a training set (to train the parameters of the model), a validation set (to verify the performance of the model and adjust the hyperparameters), and a test set (to evaluate the generalization ability of the model).

[0142] A suitable machine learning model can be selected for purpose prediction, such as Support Vector Machine (SVM), Random Forest, Gradient Boosting Trees (XGBoost, LightGBM). Use the training set to train the selected machine learning model. During the training process, the model will continuously adjust the parameters through optimization algorithms (such as gradient descent) so that the model can accurately predict the purpose of the training data. Adjust the hyperparameters of the model (such as learning rate, tree depth, regularization parameter, etc.) through methods such as cross-validation or grid search, thereby improving the performance of the model. Evaluate the performance of the model on the validation set and use the test set to evaluate the generalization ability of the finally trained model, so that the model can make accurate predictions on actual data.

[0143] Deploy the trained purpose prediction model to the MR glasses system. When a new text feature vector is input, the purpose prediction model can predict the purpose of the patient in real time.

[0144] S43. Match the prediction result with the purpose label. When the prediction result matches the purpose label successfully, it is determined that the patient meets the rehabilitation guidance condition.

[0145] Exemplarily, compare the prediction result with the pre-set purpose label. If there is a label corresponding to the prediction result in the purpose label, it can be confirmed that the patient meets the rehabilitation guidance condition.

[0146] In a possible implementation manner, please refer to Figure 3 , the MR glasses control method for vertigo rehabilitation further includes:

[0147] S101. Determine the rehabilitation guidance template according to the purpose label. Among them, the rehabilitation guidance template includes a task adjustment template and a second text template.

[0148] It can be understood that the task adjustment template is used to adjust the content or intensity of the current training task, and can guide the patient's adjustment during training, such as increasing or decreasing the training intensity, speed, task content, etc. The task adjustment template is conducive to adapting the rehabilitation plan to the patient's current condition, and avoiding adverse consequences caused by overtraining or too low-intensity training. For example, a pause request adjusts the task to a paused training and adds a prompt. A fatigue request reduces the current training load, extends the rest time, and adjusts to low-intensity training.

[0149] The second text template can provide the patient with text-based guidance to help the patient understand how to adjust the training and provide necessary guidance and suggestions. The second text template can include content such as training suggestions, recovery prompts, emotional support, etc., which is conducive to the patient obtaining clear and detailed rehabilitation guidance. For example, the text template for a guidance request can be "It is recommended that you take a deep breath, relax your body, and maintain a relaxed posture."; the text template for a task replacement request can be "Based on your current physical condition, a certain training has been replaced for you."

[0150] Exemplarily, through the purpose label, the most suitable task adjustment template and the second text template for the patient's current state can be selected from a set of predefined templates, and the matching can be performed through a machine learning model (such as a decision tree, SVM, etc.) or a rule engine. For example, when the purpose label is a fatigue / rest request label, a task adjustment template that increases the rest time and reduces the training intensity can be selected, and the corresponding text template can be coordinated, such as "The current task has been paused. Please rest for five minutes." As the patient's state changes (such as recovery, pain, mood swings, etc.), the target label can be dynamically updated, and a suitable rehabilitation guidance template can be reselected.

[0151] S102. Generate a rehabilitation guidance plan based on the current training task information and the rehabilitation guidance template. Among them, the rehabilitation guidance plan includes second text data, second voice data, and task adjustment information.

[0152] Exemplarily, the task adjustment information can be generated according to the current training task information and the task adjustment template. The task adjustment information can be specific operations, such as adjusting the training intensity, duration, rest time, etc. For example, in the current training task information, the task intensity is medium intensity, the task type is balance training, the preset duration is 10 minutes, the patient's purpose label is a fatigue / rest request, and the task adjustment template is to increase the rest time and reduce the training intensity. Then the generated task adjustment information can be to reduce the current balance training intensity to low intensity and increase the rest time by 5 minutes.

[0153] The second text data can be generated based on the current training task information, task adjustment information, and the second text template. For example, the text template with the target label of fatigue / rest request is "The current training intensity is too high, and the training has been paused for you to rest." The second text data generated according to the current training task information, task adjustment information, and the text template can be "The current balance training intensity is too high, and the training has been paused for you to rest for 5 minutes, followed by low-intensity training."

[0154] The second text data can be converted into the second voice data, and the conversion method is the same as that in step S340, which will not be elaborated here.

[0155] Integrate the second text data, the second voice data, and the task adjustment information to obtain a rehabilitation guidance plan.

[0156] S103. Generate a task adjustment instruction according to the task adjustment information, and perform an adjustment operation on the current training task according to the task adjustment instruction.

[0157] Exemplarily, the task adjustment information can be parsed, and a task adjustment instruction can be generated according to the parsed task adjustment information. For example, if the task adjustment information is to reduce the current balance training intensity to low intensity and increase the rest time by 5 minutes, the generated task adjustment instruction can include the instruction type (increase rest time and adjust training intensity) and instruction parameters (increase rest time by 5 minutes, adjust the current balance training intensity from medium intensity to low intensity).

[0158] The task adjustment instruction can be passed to the training task control module, and the training task control module adjusts the current training task according to the task adjustment instruction. The adjustment process can be automatically completed through the control interface, sensor system, feedback system, etc. of the device. For example, in the process of adjusting the training intensity: the intensity of visual and motion stimuli can be adjusted through the control module of the MR glasses, and the motion intensity in the virtual training environment can be reduced from medium intensity to low intensity, so that the patient can experience a lower training load; in the process of increasing the rest time: stop the task content or display a rest countdown interface to remind the patient to rest.

[0159] S104. After completing the adjustment operation of the current training task, send the second text data to the display module and send the second voice data to the voice playback module.

[0160] Exemplarily, after the adjustment operation of the current training task is completed, in the same way as in step S410, send the second text data to the display module; in the same way as in step S420, send the second voice data to the voice playback module.

[0161] Through these steps above, the patient can obtain dynamic and personalized guidance during the rehabilitation process, which is beneficial to the accuracy and flexibility of the rehabilitation plan.

[0162] In a possible implementation, the method for controlling an MR glasses for dizziness rehabilitation further includes:

[0163] S401. When the patient completes the current training task, obtain the training duration of the patient.

[0164] Exemplarily, the training duration of the patient can be obtained from the time tracking module. The training duration is the total time spent by the patient from the start of training to the end of the current training task. The time tracking module starts timing when the patient starts training and stops timing when the training ends.

[0165] S402. Compare the training duration of the patient with the preset duration in the current training task information, determine whether the training duration is greater than the preset duration, and obtain a second judgment result.

[0166] Exemplarily, compare the training duration of the patient with the preset duration to determine whether the actual training duration of the patient is greater than the preset duration. The second judgment result is that the training duration is greater than the preset duration or the training duration is within the preset duration.

[0167] S403. When the second judgment result indicates that the training duration is greater than the preset duration, determine that the patient meets the rehabilitation guidance condition.

[0168] Exemplarily, when the second judgment result is that the training duration is greater than the preset duration, it means that the patient meets the rehabilitation guidance condition, and further rehabilitation guidance can be initiated to provide guidance on training task adjustment, rest suggestions, or continued training.

[0169] In another possible implementation, in step S400, generating a rehabilitation guidance plan based on the current rehabilitation training data of the patient includes:

[0170] When the patient completes the current training task, the training duration of the patient is greater than the preset duration of the current task, and the patient meets the rehabilitation guidance condition, perform the following steps:

[0171] S501. Determine the completion accuracy of the patient's current task according to the current motion data and the standard motion data.

[0172] It can be understood that the completion accuracy of the current task can refer to the degree of completion obtained by the patient in the current training task based on the comparison between the current motion data and the standard motion data. The completion accuracy of the current task can be quantified by calculating the difference between the patient's actual motion and the standard motion.

[0173] Exemplarily, in order to calculate the completion accuracy of the current task, the Euclidean distance method, the angular error method, or the Dynamic Time Warping (DTW) method can be used to quantify the difference between the current motion and the standard motion.

[0174] Euclidean distance is a method for calculating the difference between two points (or two sets of data). For the action data at each time point, the Euclidean distance between the current action data and the standard action data can be calculated. The completion accuracy is evaluated by calculating the total difference of the entire action sequence.

[0175] If the training task involves rotation or angle adjustment, the angular difference between the current action and the standard action can be calculated. By calculating the error between the two angles, the accuracy of the task can be quantified.

[0176] DTW is an algorithm used to compare time series data. For some complex action sequences, the DTW algorithm can best match misaligned actions and calculate the difference between the current action and the standard action.

[0177] By comparing the difference between the current action data and the standard action data, the completion accuracy of the task can be calculated, and the calculation result of the completion accuracy is a value ranging from 0 to 1. High accuracy (close to 1) indicates that the patient performs well in the current task, the completed action is close to the standard, and the training goal is close to being achieved; medium accuracy means that the patient may need more training to improve the action, and may need to make fine adjustments or adjust the training difficulty based on the accuracy data; low accuracy (close to 0) indicates that the patient's current task completion is low, the action is greatly different from the standard, and higher intensity or different types of training are needed to improve.

[0178] S502, obtaining historical rehabilitation training data corresponding to the task type, wherein the historical rehabilitation training data includes the patient's historical motion data, historical training duration, and historical training task information.

[0179] Exemplarily, historical rehabilitation training data corresponding to the task type can be obtained from the database of MR glasses or the cloud platform. For example, if the current task is balance training, the balance training data that the patient has performed in the past can be obtained. When the patient uses MR glasses for vertigo rehabilitation training, the MR glasses can record relevant data of the patient's training process, such as training task information, patient motion data during training, training duration, etc. When the training is completed, the MR glasses can upload the recorded data to the cloud platform or save it locally.

[0180] If the training duration and data dimensions of different tasks are different, the data can be adjusted to the same scale through normalization to facilitate comparison. The historical action data, historical training duration, historical training task information and other data are aggregated to form a complete training file. The data can be arranged on a timeline to view the changes in the patient's performance in different time periods.

[0181] S503. Determine the historical task completion accuracy of the patient based on the historical action data and the standard action data in the historical training task information.

[0182] Exemplarily, the historical task completion accuracy may refer to the matching degree between the historical action data and the standard action data of the patient in the historical training task. The difference between the historical action data and the standard action data can be evaluated using the same method as the current task completion accuracy calculation method.

[0183] S504. Calculate the average value of the historical training duration in the historical rehabilitation training data to obtain the historical duration average.

[0184] Exemplarily, assume that the patient has carried out 5 balance training sessions in the historical rehabilitation training, and the training durations of the five sessions are 35 minutes, 40 minutes, 30 minutes, 20 minutes, and 25 minutes respectively. Then the total historical training duration is 150 minutes, and the historical duration average is 30 minutes.

[0185] S505. Compare the historical duration average with the preset duration in the historical training task information to obtain a comparison result.

[0186] Exemplarily, the historical duration average can be compared with the preset duration in the historical training task information. If the historical duration average is less than or close to the preset duration, it indicates that the patient was able to complete tasks with a longer duration in the past training and is suitable for the current task; if the historical duration average is greater than the preset duration, it may be necessary to adjust the training duration or the difficulty of the training task. The comparison result can be quantified. If the historical duration average is less than or close to the preset duration, the comparison result is 0; if the historical duration average is greater than the preset duration, the comparison result is 1.

[0187] S506. Determine the task difficulty of the current training task based on the current task completion accuracy, the historical task completion accuracy, and the comparison result to obtain the task difficulty information.

[0188] Exemplarily, the calculation of the task difficulty can be carried out by weighted average or by scoring method in combination with these three factors: the current task completion accuracy, the historical task completion accuracy, and the comparison result. Here, the weighted average method is used to calculate the task difficulty. Weights can be assigned to the current task completion accuracy, the historical task completion accuracy, and the comparison result, which are 、 、 respectively. The task difficulty calculation formula is where, represents the task difficulty, represents the current task completion accuracy, represents the historical task completion accuracy, represents the comparison result.

[0189] Suppose the current task completion accuracy is 0.8, the historical task completion accuracy is 0.7, the historical duration mean is 40 minutes, the historical preset duration is 30 minutes, and the comparison result is 1. is 0.4, is 0.3, is 0.3, then the task difficulty is .

[0190] S507. Generate a rehabilitation guidance plan based on the task difficulty information and the current training task information.

[0191] It can be understood that the task difficulty information provides the evaluation result of the current training task and can help determine the adaptability of the training task. If the training task is of high difficulty, the training time can be increased, the training intensity can be reduced, and the rest time can be increased to ensure that the patient will not feel overly fatigued or injured. If the training task is of medium difficulty, the existing task duration or intensity can be maintained, but some challenges can be added to enhance the patient's sense of participation and training effect. If the training task is of low difficulty, the training intensity or task complexity may need to be increased to promote the patient's faster progress.

[0192] Exemplarily, according to the difficulty level (low, medium, high) of the task, the intensity, duration, and training content of the current training task can be adjusted accordingly, and the difficulty level of the task can be divided according to the task difficulty information. For example, 0 - 0.4 is low difficulty, 0.4 - 0.6 is medium difficulty, and 0.6 - 1 is high difficulty.

[0193] When the difficulty level of the task is low, the task difficulty can be increased, and the training intensity or duration can be increased. For example, increase the duration of the training task, such as extending the current 20 - minute task to 25 minutes; increase the task complexity, such as adding more pose changes in the pose training.

[0194] When the difficulty level of the task is medium, the current task difficulty can be maintained, or the task duration and intensity can be fine - tuned. For example, continue with the current task, but the task duration can be fine - tuned, or new action challenges (such as higher rotation frequency, balance angle, etc.) can be added.

[0195] When the difficulty level of the task is high, the task duration or intensity can be appropriately reduced, or the task execution method can be changed. For example, the task duration can be extended from 30 minutes to 40 minutes; if the patient's balance accuracy is low, the task complexity can be reduced, such as lowering the balance requirement, or adding auxiliary support in the task.

[0196] According to the above - mentioned method, task adjustment information can be generated and task adjustment instructions can be generated based on the task adjustment information, and the task adjustment instructions are sent to the training task control module.

[0197] New text data and voice data can be generated according to the generated rehabilitation guidance plan to provide task guidance and feedback.

[0198] For example, when the current task is of high difficulty and the patient's task completion accuracy is low. The rehabilitation guidance plan generated by the MR glasses may include task adjustment information, such as reducing the task duration from 30 minutes to 40 minutes, lowering the training complexity, and reducing the pace frequency; the new text data is "Your training duration has been adjusted to 40 minutes, and the pace frequency has been reduced. Please train according to the new requirements and keep your pace stable."; the new voice data is "Your training duration has been adjusted to 40 minutes, and the pace frequency has been reduced. Please train according to the new requirements and keep your pace stable."

[0199] By comprehensively analyzing the patient's current task completion accuracy, historical task completion accuracy, and historical duration average, the difficulty of the task can be intelligently evaluated and a targeted rehabilitation guidance plan can be generated. This is beneficial for the rehabilitation training to meet the patient's needs and gradually improve the task completion ability, thus promoting better rehabilitation effects.

[0200] It should be understood that the magnitudes of the sequence numbers of the steps in the above embodiments do not mean the order of execution. The execution order of each process should be determined according to its function and internal logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.

[0201] Corresponding to the method for controlling an MR glasses for vertigo rehabilitation described in the above embodiments, an embodiment of the present application further provides a device for controlling an MR glasses for vertigo rehabilitation. Each unit of the device can implement each step of the method for controlling an MR glasses for vertigo rehabilitation. Figure 4 The block diagram of the device for controlling an MR glasses for vertigo rehabilitation provided by the embodiment of the present application is shown. For the sake of convenience of description, only the parts related to the embodiment of the present application are shown.

[0202] Referring to Figure 4 , the device includes:

[0203] An acquisition unit, configured to acquire the patient's current rehabilitation training data. Among them, the patient's current rehabilitation training data includes current action data and current training task information. The current training task information includes task type, standard action data, action threshold, and preset duration. The current action data is acquired through the data acquisition module of the MR glasses for vertigo rehabilitation.

[0204] A judgment unit, configured to determine whether the patient meets the rehabilitation guidance condition based on the patient's current rehabilitation training data. Among them, the rehabilitation guidance condition is used to represent that the patient needs training guidance when performing vertigo rehabilitation training using the MR glasses for vertigo rehabilitation.

[0205] A solution generation unit, configured to generate a rehabilitation guidance solution according to the patient's current rehabilitation training data if the patient meets the rehabilitation guidance conditions.

[0206] An output unit, configured to output the rehabilitation guidance solution to guide the patient to perform vertigo rehabilitation training.

[0207] It should be noted that the information interaction, execution process, etc. between the above units, due to being based on the same concept as the method embodiments of the present application, for their specific functions and the technical effects brought, reference can be specifically made to the method embodiment part, and details will not be elaborated here.

[0208] Those skilled in the art can clearly understand that, for the convenience and conciseness of description, only the above-mentioned division of each functional unit and module is used as an example. In practical applications, the above functions can be allocated to different functional units and modules according to needs, that is, the internal structure of the device is divided into different functional units or modules to complete all or part of the functions described above. Each functional unit and module in the embodiments can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit. The above integrated units can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of each functional unit and module are only for the convenience of mutual distinction and do not limit the protection scope of the present application. The specific working process of the units and modules in the above device can refer to the corresponding process in the foregoing method embodiments, and details will not be elaborated here.

[0209] The embodiment of the present application also provides a pair of MR glasses for vertigo rehabilitation. Figure 5 It is a schematic structural diagram of a pair of MR glasses for vertigo rehabilitation provided by an embodiment of the present application. The MR glasses for vertigo rehabilitation include a display module, a voice playback module, a data acquisition module, and a control module. As Figure 5 shown, the control module 6 of the MR glasses for vertigo rehabilitation in this embodiment includes: at least one processor 60 ( Figure 5 only one is shown in the figure), at least one memory 61 ( Figure 5 only one is shown in the figure), and a computer program 62 stored in the at least one memory 61 and executable on the at least one processor 60. When the processor 60 executes the computer program 62, the MR glasses for vertigo rehabilitation implement the steps in any of the above-mentioned method embodiments for controlling MR glasses for vertigo rehabilitation, or the functions of each unit in the above-mentioned device embodiments are implemented for the MR glasses for vertigo rehabilitation.

[0210] Exemplarily, the computer program 62 can be divided into one or more modules / units, which are stored in the memory 61 and executed by the processor 60 to complete the present application. The one or more modules / units can be a series of computer program instruction segments capable of performing specific functions, and these instruction segments are used to describe the execution process of the computer program 62 in the control module 6 of the MR glasses for vertigo rehabilitation.

[0211] The control device 6 of the MR glasses for vertigo rehabilitation can be a central processing unit (CPU / SoC), a motion capture and analysis module, a wireless communication module (such as Bluetooth, Wi-Fi), a battery management and power control module, etc. The MR glasses for vertigo rehabilitation can include, but are not limited to, the processor 60 and the memory 61. Those skilled in the art can understand that Figure 5 merely examples of the MR glasses for vertigo rehabilitation, which do not constitute a limitation on the MR glasses for vertigo rehabilitation. It may include more or fewer components than those shown in the figure, or combine certain components, or different components. For example, it may also include input / output devices, network access devices, buses, etc.

[0212] The processor 60 can be a central processing unit (CPU). The processor 60 can also be other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor, etc.

[0213] The memory 61 may be an internal storage unit of the control module 6 of the MR glasses for vertigo rehabilitation in some embodiments, such as the hard disk or memory of the MR glasses for vertigo rehabilitation. The memory 61 may also be an external storage device of the MR glasses for vertigo rehabilitation in some other embodiments, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) card, a Flash Card, etc. equipped on the MR glasses for vertigo rehabilitation. Further, the memory 61 may also include both the internal storage unit and the external storage device of the MR glasses for vertigo rehabilitation. The memory 61 is used to store an operating system, application programs, a BootLoader, data, and other programs, such as the program code of the computer program. The memory 61 may also be used to temporarily store data that has been output or will be output.

[0214] An embodiment of the present application also provides a computer-readable storage medium storing a computer program, and when the computer program is executed by a processor, the steps in any of the above method embodiments are implemented.

[0215] An embodiment of the present application provides a computer program product, and when the computer program product runs on the MR glasses for vertigo rehabilitation, the MR glasses for vertigo rehabilitation implement the steps in any of the above method embodiments.

[0216] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a computer-readable storage medium. Based on such an understanding, to implement all or part of the processes in the above method embodiments of the present application, a computer program may be used to instruct relevant hardware to complete. The computer program may be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps in the above method embodiments can be implemented. Among them, the computer program includes computer program code, and the computer program code may be in the form of source code, object code, an executable file, or some intermediate form, etc. The computer-readable medium may at least include: any entity or device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunications signal, and a software distribution medium that can carry the computer program code to the MR glasses for vertigo rehabilitation. For example, a USB flash drive, a mobile hard disk, a magnetic disk, or an optical disc, etc. In some jurisdictions, according to legislation and patent practice, the computer-readable medium may not be an electrical carrier signal and a telecommunications signal.

[0217] In the above embodiments, the descriptions of the various embodiments have their own emphases. For parts not detailed or recorded in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.

[0218] Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be implemented by electronic hardware, or by a combination of computer software and electronic hardware. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered to exceed the scope of this application.

[0219] In the embodiments provided in this application, it should be understood that the disclosed control method, device for a MR glasses for vertigo rehabilitation, and the MR glasses for vertigo rehabilitation can be implemented in other ways. For example, the embodiments of the control device for a MR glasses for vertigo rehabilitation and the MR glasses for vertigo rehabilitation described above are merely illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed couplings or direct couplings or communication connections to each other can be through some interfaces, and the indirect couplings or communication connections of the devices or units can be in electrical, mechanical or other forms.

[0220] The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0221] The above-described embodiments are only used to illustrate the technical solutions of this application, rather than to limit them; although this application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included in the protection scope of this application.

Claims

1. A method for controlling MR glasses for vertigo rehabilitation, characterized in that: include: Acquire the patient's current rehabilitation training data; wherein the patient's current rehabilitation training data includes current motion data and current training task information, the current training task information includes task type, standard motion data, motion threshold, and preset duration, and the current motion data is acquired through a data acquisition module of MR glasses for vertigo rehabilitation; Based on the current rehabilitation training data of the patient, determining whether the patient meets the rehabilitation guidance condition; wherein the rehabilitation guidance condition is used to indicate that the patient needs training guidance when performing vertigo rehabilitation training using the MR glasses for vertigo rehabilitation; If the patient meets the rehabilitation guidance conditions, generating a rehabilitation guidance plan according to the patient's current rehabilitation training data; Outputting the rehabilitation guidance program to guide the patient to perform vertigo rehabilitation training; Wherein, the method further comprises: When the training time taken by the patient to complete the current training task is greater than the preset time, determining that the patient meets the rehabilitation guidance condition; Calculating the difference between the current motion data and the standard motion data to quantify the patient's current task completion accuracy; wherein, the Euclidean distance between the current motion data and the standard motion data is calculated, and the completion accuracy is evaluated by calculating the total difference of the entire motion sequence, or the angle difference between the current motion and the standard motion is calculated to quantify the completion accuracy of the task, or the DTW algorithm is used to perform the best match on the misaligned motions to calculate the difference between the current motion and the standard motion; Acquire historical rehabilitation training data corresponding to the task type; wherein the historical rehabilitation training data includes the patient's historical movement data, historical training duration, and historical training task information; Determining the patient's historical task completion accuracy based on the historical action data and the standard action data in the historical training task information; Calculating an average value of the historical training duration in the historical rehabilitation training data, and comparing the average value with the preset duration in the historical training task information to obtain a comparison result; Determine the task difficulty of the current training task based on the current task completion accuracy, the historical task completion accuracy and the comparison result, and obtain task difficulty information; According to the task difficulty information, the intensity, duration and training content of the current training task are adjusted accordingly to obtain the rehabilitation guidance plan.

2. The MR glasses control method for vertigo rehabilitation according to claim 1, characterized in that: The determining whether the patient meets the rehabilitation guidance conditions based on the current rehabilitation training data of the patient includes: According to the task type in the current training task information, extracting action data corresponding to the task type from the current action data; Calculating the deviation between the action data corresponding to the task type and the standard action data in the current training task information to obtain a deviation value; Comparing the deviation value with the action threshold in the current training task information, determining whether the deviation value exceeds the action threshold, and obtaining a first determination result; When the first judgment result indicates that the deviation value exceeds the action threshold, it is determined that the patient meets the rehabilitation guidance condition.

3. The MR glasses control method for vertigo rehabilitation according to claim 2, characterized in that: Generating a rehabilitation guidance program according to the current rehabilitation training data of the patient includes: Determining a deviation direction of the action data corresponding to the task type according to the action data corresponding to the task type and the standard action data in the current training task information; Acquire a first text template according to the deviation direction of the action data corresponding to the task type; Generate rehabilitation guidance text data based on the action data corresponding to the task type, the standard action data in the current training task information and the first text template; Performing voice conversion processing on the rehabilitation guidance text data to obtain rehabilitation guidance voice data; Marking the standard action data in the current training task information to obtain the marked standard action data; The rehabilitation guidance text data, the rehabilitation guidance voice data and the marked standard action data are determined as the rehabilitation guidance plan.

4. The MR glasses control method for vertigo rehabilitation according to claim 3, characterized in that: The outputting of the rehabilitation guidance program includes: Sending the rehabilitation guidance text data and the marked standard action data to a display module of MR glasses for vertigo rehabilitation, so that the display module displays the rehabilitation guidance text data and the marked standard action data; The rehabilitation guidance voice data is sent to a voice playing module of the MR glasses for vertigo rehabilitation, so that the voice playing module plays the voice content in the rehabilitation guidance voice data.

5. The MR glasses control method for vertigo rehabilitation according to claim 4, characterized in that: The method further comprises: Acquiring voice data of the patient; Performing noise reduction processing on the patient's voice data to obtain first voice data; Performing voice content recognition on the noise-reduced voice data to obtain first text data; The first text data is subjected to purpose prediction to obtain a prediction result, and based on the prediction result, it is determined whether the patient meets the rehabilitation guidance condition.

6. The MR glasses control method for vertigo rehabilitation according to claim 5, characterized in that: The performing purpose prediction on the first text data to obtain a prediction result, and determining whether the patient meets the rehabilitation guidance condition according to the prediction result, includes: Extracting text features of the first text data to obtain a text feature vector; Inputting the text feature vector into a purpose prediction model so that the purpose prediction model predicts the patient's purpose and obtains a prediction result; wherein the purpose prediction model is a machine learning model; The prediction result is matched with the target label, and when the prediction result is successfully matched with the target label, it is determined that the patient meets the rehabilitation guidance condition.

7. The MR glasses control method for vertigo rehabilitation according to claim 6, characterized in that: The method further comprises: Determining a rehabilitation guidance template according to the purpose tag; wherein the rehabilitation guidance template includes a task adjustment template and a second text template; Based on the current training task information and the rehabilitation guidance template, generating the rehabilitation guidance plan; wherein the rehabilitation guidance plan includes the second text data, the second voice data and the task adjustment information; Generate a task adjustment instruction according to the task adjustment information, and perform an adjustment operation on the current training task according to the task adjustment instruction; After the adjustment operation of the current training task is completed, the second text data is sent to the display module and the second voice data is sent to the voice playback module.

8. A MR glasses control device for vertigo rehabilitation, characterized in that: Used to implement the MR glasses control method for vertigo rehabilitation according to any one of claims 1 to 7, the MR glasses control device for vertigo rehabilitation comprises: An acquisition unit, used for acquiring the patient's current rehabilitation training data; wherein the patient's current rehabilitation training data includes current motion data and current training task information, the current training task information includes task type, standard motion data, motion threshold, and preset duration, and the current motion data is acquired through a data acquisition module of MR glasses for vertigo rehabilitation; A judgment unit, used for determining whether the patient meets the rehabilitation guidance condition based on the current rehabilitation training data of the patient; wherein the rehabilitation guidance condition is used to indicate that the patient needs training guidance when performing vertigo rehabilitation training using the MR glasses for vertigo rehabilitation; a program generating unit, configured to generate a rehabilitation guidance program according to the current rehabilitation training data of the patient if the patient meets the rehabilitation guidance conditions; The output unit is used to output the rehabilitation guidance program to guide the patient to perform vertigo rehabilitation training.

9. A MR glasses for vertigo rehabilitation, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 7 is implemented.

Images