Balance training data processing method and device in ship taking simulation scene

Abstract

The invention provides a balance training data processing method and device in a ship-taking simulation scene, and the method is applied to a server, and comprises the steps: obtaining ship-taking attitude data; determining a ship taking capability grade according to the ship taking attitude data; determining a target ship taking scene and a target training task matched with the ship taking capability level; creating a target ship taking scene to perform balance training, prompting a user to complete a target training task and displaying guidance information; and after the target ship taking scene is ended, obtaining ship taking training data so as to determine the balance ability score of the user in the current balance training. Therefore, according to the method and the device, the ship taking attitude data of the to-be-trained user is analyzed and processed through the server, so that the ship taking capability levels of the user under different ship taking attitudes are determined, and then the adaptive target ship taking scene and training task are determined for the user to execute targeted balance training; the flexibility and practicability of ship taking training data processing in the ship taking scene by the server and the accuracy of balance capability evaluation are improved.

Description

Technical Field

[0001] The present application belongs to the general data processing technology field of the Internet industry, and specifically relates to a method and device for processing balance training data in a boating simulation scenario. Background Art

[0002] At present, due to reasons such as stroke or cerebellar damage, many patients find it difficult to maintain stable standing or sitting on means of transportation. The most difficult of these is taking a boat. Common rehabilitation medical institutions use servers to simulate boating scenes to allow patients to adapt to the scenes and overcome seasickness.

[0003] However, the effect of this training and treatment method cannot improve the user's balance ability in the boat scene, which may cause the user to be injured during the training, resulting in poor actual training effect. In addition, since the boat scene simulated by the server cannot be effectively adjusted according to the user's own situation, the user cannot effectively complete the training, and the flexibility of the server in executing balance training is poor. Summary of the invention

[0004] The embodiment of the present application provides a method and device for processing balance training data in a boating simulation scenario, which creates an adaptive target boating scenario and training tasks according to the user's actual boating ability level through interaction between multiple devices in the training system, and guides the user to perform balancing movements during the training process to train the user's balance ability, thereby improving the intelligence and flexibility of the server in performing balance training and the accuracy of the user's balance ability assessment.

[0005] In a first aspect, an embodiment of the present application provides a method for processing balance training data in a boating simulation scenario, which is applied to a server in a human motion quantification training system, wherein the human motion quantification training system further includes: a six-axis motion platform, a stereo audio-visual system, and a motion capture system; the method includes:

[0006] Acquire boating posture data, wherein the boating posture data is associated data collected by the motion capture system and the six-axis motion platform when the user completes various preset types of boating postures;

[0007] Determine a boating ability level according to the boating posture data, wherein the boating ability level includes a posture mastery level corresponding to each of the preset types of boating postures;

[0008] Determine a target boating scene and a target training task that are adapted to the boating ability level, wherein the target training task is a training task that the user needs to complete in the current target boating scene;

[0009] Controlling the stereoscopic audio-visual system and the six-axis motion platform to create the target boat riding scene for balance training, and controlling the stereoscopic audio-visual system to prompt the user to complete the target training task and display guidance information, wherein the guidance information is used to guide the user to synchronously imitate corresponding guidance actions to maintain a balanced state;

[0010] After the target boat riding scene is finished, the boat riding training data collected by the motion capture system is obtained to determine the balance ability score of the user in the current balance training.

[0011] In a second aspect, a balance training data processing device in a boating simulation scenario is applied to a server in a human motion quantification training system, wherein the human motion quantification training system further includes: a six-axis motion platform, a stereo audio-visual system, and a motion capture system; the device includes:

[0012] A data acquisition unit, used to acquire boating posture data, wherein the boating posture data is associated data collected by the motion capture system and the six-axis motion platform when the user completes various preset types of boating postures;

[0013] A first determining unit, configured to determine a boating ability level according to the boating posture data, wherein the boating ability level includes a posture mastery level corresponding to each of the preset types of boating postures;

[0014] A second determining unit is used to determine a target boating scene and a target training task that are adapted to the boating ability level, wherein the target training task is a training task that the user needs to complete in the current target boating scene;

[0015] A training unit, used to control the stereoscopic audio-visual system and the six-axis motion platform to create the target boat riding scene for balance training, and to control the stereoscopic audio-visual system to prompt the user to complete the target training task and display guidance information, wherein the guidance information is used to guide the user to synchronously imitate corresponding guidance actions to maintain a balance state;

[0016] The third determining unit is used to obtain the boating training data collected by the motion capture system after the target boating scene ends, so as to determine the balance ability score of the user in the current balance training.

[0017] In a third aspect, an embodiment of the present application provides a server, comprising a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the program includes instructions for executing the steps in the first aspect of the embodiment of the present application.

[0018] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program / instructions stored thereon, which, when executed by a processor, implement the steps in the first aspect of the embodiment of the present application.

[0019] In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program / instructions, which, when executed by a processor, implement some or all of the steps described in the first aspect of the embodiment of the present application.

[0020] It can be seen that in the embodiment of the present application, the server analyzes and processes the boating posture data of the user to be trained to determine the user's boating ability level under different boating postures, and then determines an adapted target boating scene and training task for the user to control the remaining equipment to provide the user with targeted balance training, thereby improving the flexibility and practicality of the server's processing of boating training data in boating scenes, and the accuracy of balance ability assessment. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0022] Figure 1 It is a structural block diagram of a human motion quantification training system provided in an embodiment of the present application;

[0023] Figure 2 It is a flowchart of a method for processing balance training data in a boating simulation scenario provided by an embodiment of the present application;

[0024] Figure 3 It is a scene schematic diagram of creating a target boating scene provided by an embodiment of the present application;

[0025] Figure 4 This is a schematic diagram of a scene in which a stereoscopic audio-visual system displays guidance information provided by an embodiment of the present application;

[0026] Figure 5 is a schematic diagram of a scene based on shaking differences of different spatial coordinates provided in an embodiment of the present application;

[0027] Figure 6 It is a block diagram of the functional units of a balance training data processing device in a boating simulation scenario provided by an embodiment of the present application;

[0028] Figure 7It is a block diagram of the functional units of another balance training data processing device in a boating simulation scenario provided by an embodiment of the present application;

[0029] Figure 8 It is a structural block diagram of a server provided in an embodiment of the present application. DETAILED DESCRIPTION

[0030] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0031] The terms "first", "second", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices.

[0032] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0033] See also Figure 1 , Figure 1 is a structural block diagram of a human motion quantification training system provided by an embodiment of the present application. Figure 1As shown, the human motion quantification training system 100 includes a server 110, a six-axis motion platform 120, a stereoscopic audio-visual system 130 and a motion capture system 140. The six-axis motion platform 120, the stereoscopic audio-visual system 130 and the motion capture system 140 are all connected to the server 110 in communication. The server 110 can control the movement of the six-axis motion platform 120 through data interaction, and control the stereoscopic audio-visual system 130 to play the corresponding image. Specifically, the server 110 sends the platform motion information corresponding to the target boating scene to the six-axis motion platform 120 to control the six-axis motion platform 120 to move, and the server 110 sends the first-view image corresponding to the target boating scene to the stereoscopic audio-visual system 130 to control the stereoscopic audio-visual system 130 to play the image, thereby creating a target boating scene for the user to perform balance training. In addition, the server 110 can also obtain the training user's data collected by the motion capture system 140 in real time or at a fixed time. The specific data type is associated with the device type of the motion capture system 140 and the training needs of the balance training, and specifically includes boating posture data, boating training data, etc. The server 110 obtains the associated data of each boating posture completed by the user in advance to determine the user's posture mastery level for each boating posture, and then controls the six-axis motion platform 120 and the stereoscopic audio-visual system 130 to perform the balance training adapted to the user and complete the training task to improve the balance ability. In addition, the motion data of the user collected by the motion capture system 140 is used to perform the balance ability score evaluation operation. A human motion quantification training system 100 can correspond to multiple servers 110 at the same time, and one server 110 corresponds to one or more six-axis motion platforms 120, stereoscopic audio-visual systems 130 and motion capture systems 140. Usually, a set of training equipment includes a six-axis motion platform 120, a stereoscopic audio-visual system 130 and a motion capture system 140, which are used to perform balance training corresponding to the boating scene for a user.

[0034] Based on this, an embodiment of the present application provides a method for processing balance training data in a boat riding simulation scenario. The embodiment of the present application is described in detail below in conjunction with the accompanying drawings.

[0035] See also Figure 2 , Figure 2 1 is a flow chart of a method for processing balance training data in a boating simulation scenario provided by an embodiment of the present application. The method is applied to a server 110 in a human motion quantification training system 100. The human motion quantification training system 100 also includes: a six-axis motion platform 120, a stereo audio-visual system 130, and a motion capture system 140. The method includes:

[0036] Step S201, obtaining boating posture data.

[0037] The boating posture data are the associated data collected by the motion capture system and the six-axis motion platform when the user completes various preset types of boating postures.

[0038] Among them, the motion capture system in the human motion quantitative training system, also known as the high-definition motion capture system, is a high-tech technology that accurately measures and records the motion trajectory or posture of an object in real three-dimensional space in real time, and reconstructs the motion state of the moving object at every moment in virtual three-dimensional space. This system can capture the subtle movements and expressions of objects or human bodies through high-precision sensors and advanced algorithms, and generate high-quality three-dimensional motion data.

[0039] Among them, the six-axis motion platform in the human motion quantitative training system, also known as the six-degree-of-freedom motion platform, is a mechanical motion platform with six degrees of freedom (three translational degrees of freedom and three rotational degrees of freedom). It can realize accurate control and precise positioning of any posture in space. It is a high-precision, high-reliability mechanical motion platform that realizes the adjustment of the platform's arbitrary position and posture in space by controlling the movement of six independent actuators (such as servo electric cylinders). By controlling the extension and rotation of the electric cylinder, the upper platform produces translational and rotational motion in space. These movements are achieved through precise algorithms and control systems to ensure that the platform can move according to a preset trajectory. Among them, in this application, the six-axis motion platform is embedded with a dual-track force measuring treadmill, as well as other fixed, linked, and ancillary structures for users to exercise on it and collect user data. The dual-track treadmill usually contains six six-dimensional force measuring platforms and a plantar pressure distribution sensing system, which can be combined with a motion capture system to collect user motion data of various associated types, thereby improving the accuracy and rationality of the server's execution of personalized balance training, user ability assessment and other operations. The six-dimensional force platform is embedded with multiple force measuring units and pressure sensors, which are used to collect three-dimensional force data (i.e. force components, which are used to describe the thrust, pull and other forces acting on an object) and three-dimensional torque data (i.e. torque components, which are used to describe the rotational force acting on an object in space).

[0040] Step S202, determining the boating ability level according to the boating posture data.

[0041] Among them, the boating ability level includes the posture mastery level corresponding to each preset type of boating posture. The preset types of boating postures may include sitting, standing, lying, walking, and leaning postures. There is no limitation here. Specific types of boating postures may be added or deleted according to the specific balance scenarios trained by the user.

[0042] In a possible embodiment, the boating ability level includes a standing posture mastery level corresponding to a standing posture on board and a sitting posture mastery level corresponding to a sitting posture on board; determining the boating ability level according to the boating posture data includes: determining the standing posture data corresponding to the standing posture on board and the sitting posture data corresponding to the sitting posture on board according to the boating posture data; determining the change trajectory information of the plantar pressure center of the user in the standing posture on board according to the plantar pressure data; determining the center of gravity stability index according to the swing trajectory length, the swing speed and the covered area; and, determining the posture symmetry of the user in the standing posture on board according to the first action data; and, determining the center of gravity inclination angle and the body shaking index of the user in the sitting posture on board according to the second action data; determining the sitting posture mastery level according to the center of gravity inclination angle and the body shaking index; and determining the standing posture mastery level according to the center of gravity stability index and the posture symmetry.

[0043] The standing posture data on board includes the first motion data collected by the motion capture system and the plantar pressure data collected by the six-axis motion platform, the sitting posture data on board includes the second motion data collected by the motion capture system, and the change trajectory information includes the swing trajectory length, the swing speed and the covered area. The longer the total moving distance indicated by the swing trajectory length, the worse the balance of the center of gravity; the faster the swing speed, the weaker the balance adjustment ability; the larger the area covered by the movement of the pressure center, the worse the surface balance stability.

[0044] Among them, when the server determines the posture mastery level corresponding to the boat standing posture, the server can obtain the plantar pressure data collected by the plantar pressure distribution sensor system carried by the double-track treadmill on the six-axis motion platform, including the pressure values ​​of each area of ​​the sole, usually displayed in the form of a pressure distribution diagram. These data help to understand the force applied to the sole of the foot during the user's standing process. Based on the plantar pressure data, the server can determine the change trajectory information of multiple plantar pressure centers, and then determine the center of gravity stability index, which is used to characterize the strength of the user's center of gravity balance ability when receiving external force from the platform. In addition, the server can also obtain the first motion data collected by the motion capture system. The data types included in the first motion data and the second motion data can be the human body posture data of the user at different times, the angular velocity and acceleration of the target joint point, etc., and then determine the posture symmetry of the user in the standing posture on the boat, and then determine the user's standing posture mastering level in combination with the center of gravity stability index. Specifically, the server can pre-set the numerical range of multiple standing posture mastering levels corresponding to the center of gravity stability index and the posture symmetry, and the lowest level of the two standing posture mastering levels corresponding to the center of gravity stability index and the posture symmetry of the actual user is the final standing posture mastering level. Since the plantar pressure data cannot effectively reflect the user's sitting state when the user is in the sitting position on the boat, the server only needs to determine the final sitting posture mastering level through the second motion data, which is specifically determined according to the maximum value of the user's center of gravity inclination angle (the larger the maximum inclination angle, the worse the user's sitting balance ability) and the body shaking index (the larger the frequency and angle of the body shaking, the worse the user's mastery of the sitting posture on the boat).

[0045] In a possible embodiment, the boating ability level also includes a step mastery level corresponding to boating steps; determining the boating ability level based on the boating posture data includes: determining the boating step data corresponding to the boating steps based on the boating posture data, including the third motion data collected by the motion capture system and the plantar pressure data collected by the six-axis motion platform; determining, based on the plantar pressure data, the data collection time corresponding to the plantar pressure data of the user's single-leg support when walking on the boat as the target collection time; determining the third motion data corresponding to the target collection data as the target motion data; determining the single-leg support posture based on the target motion data; determining the similarity between the single-leg support posture and the preset stepping posture as the posture similarity; and determining the support change area based on the plantar pressure data; determining the probability of falling based on the support change area and the preset support area threshold; determining the step mastery level based on the posture similarity and the probability of falling.

[0046] Among them, the user's walking posture in the boat scene can be understood as the user walking on a shaking boat. Usually, the user will have a single-leg support posture during the walking process. At this time, if the user's posture is greatly different from the preset walking posture or the foot support change area is large enough, it is easy to fall due to shaking. Therefore, in this embodiment, the server extracts the plantar pressure data when the single leg is supported from the plantar pressure data, and then determines the posture similarity between the user's single-leg support posture and the preset walking posture (i.e., standard walking posture) according to the third motion data of the corresponding time, and determines the user's fall probability according to the support change area and the preset support area threshold. Finally, the user data collected by the motion capture system and the six-axis motion platform determine the user's walking mastery level for the boat walking posture from two levels.

[0047] It can be seen that in this example, the posture data of each preset type of boating posture completed by the user in advance is obtained through data interaction between the motion capture system and the six-axis motion platform, and then the posture mastery level of the user for each boating posture is determined from multiple levels according to the posture characteristics of each boating posture, thereby improving the accuracy of the server's calculation of the boating ability level, and then improving the accuracy of executing different balance training for different users, improving the effectiveness of balance training, and reducing training risks.

[0048] Step S203, determining a target boarding scene and a target training task that are suitable for the boarding ability level.

[0049] The target training task is the training task that the user needs to complete in the current target boat riding scene. The content of the training task includes but is not limited to maintaining a sitting or standing posture in the target boat riding scene, and the distance between the user's final position and the initial position at the end of the target boat riding scene does not exceed a preset centimeter, or the user cannot have a preset number of unbalanced postures.

[0050] In one possible embodiment, a target boarding scene and a target training task adapted to the boarding ability level are determined, including: if a training direction selection instruction is received, determining the boarding training direction in response to the training direction selection instruction; if no training direction selection instruction is received, determining the boarding training direction according to the standing posture mastery level and the sitting posture mastery level; determining a reference training task adapted to the boarding training direction in a preset training task set as a target training task; obtaining a preset boarding scene set; and according to the boarding scene set, determining a reference boarding scene corresponding to the hull rocking data adapted to the posture mastery level corresponding to the target boarding posture as a target boarding scene.

[0051] Among them, the ship riding training direction is used to indicate the target ship riding posture trained and strengthened by the target training task. The task difficulty level of the target training task is determined by the posture mastery level corresponding to the target ship riding posture. Each task difficulty level in each ship riding training direction corresponds to one or more reference training tasks in the training task set. The ship riding scene set includes multiple reference ship riding scenes, and audio and video data and hull shaking data corresponding to each reference ship riding scene. The audio and video data is used to indicate the first-person image of the user in the corresponding reference ship riding scene played by the stereo audio and video system. The hull shaking data is used to indicate the platform motion information corresponding to the hull shaking in the corresponding reference ship riding scene simulated by the six-axis motion platform. Each hull shaking data corresponds to multiple posture mastery levels.

[0052] Among them, the training direction selection instruction can be sent by the user to the server in the following ways: first, the server first controls the stereoscopic audio and video system to display multiple selection controls determined based on the boating ability level, each selection control corresponds to a boating posture, and the user controls the track to rotate in a certain direction by moving or running on the treadmill on the six-axis motion platform. The server will control the selection of the selection control on the stereoscopic audio and video system according to the rotation direction of the track, and then the motion capture system determines the boating posture corresponding to the current corresponding selection control as the target boating posture by capturing the specific posture made by the user; second, the user selects the training direction of the current balance training through the display screen corresponding to the stereoscopic audio and video system preset on the six-axis motion platform or the terminal device pre-bound to the server. The server will respond to the training direction selection and obtain the corresponding training direction selection instruction by default to execute the subsequent data processing.

[0053] Among them, when the server does not receive the training direction selection instruction, the boat training direction of the balance training in the current boating scene is determined according to the user's actual standing posture mastery level and sitting posture mastery level, and then the adapted target training task and the target boating scene corresponding to the target posture mastery level are determined. In this example, the target boating scene and the target training direction are determined by the actual posture mastery level of the user determined by the server, so that the user can adapt to the intensity of the current balance training, and improve the user's boating balance ability with a specific training direction, so as to avoid the user being injured or giving up training halfway due to the large platform shaking intensity corresponding to the hull shaking data in the boating scene, improve the user's training experience and training completion, and by setting the direction of the target training task, the user can significantly improve the balance ability of a boating posture direction. Among them, after selecting the target boating scene, the server will extract the audio and video data and hull shaking data corresponding to the target boating scene, so as to control the stereo audio and video system to play the first-person perspective image and the control six-axis motion platform to perform platform movement according to the hull shaking data when creating the target boating scene later, so as to provide users with an immersive boating simulation experience.

[0054] It can be seen that in this example, the server selects appropriate target boating scenes and target training tasks for the user based on the user's level of mastery of different boating postures, thereby improving the flexibility and richness of the server's personalized balance training for the user, and realizing the user's interactivity in the balance training in the boating scene based on the control of associated devices, thereby improving the training effect and training completion.

[0055] In a possible embodiment, the direction of boat riding training is determined according to the standing posture mastery level and the sitting posture mastery level, including: when the standing posture mastery level is different from the sitting posture mastery level, determining the boat riding posture corresponding to the lower posture mastery level as the target boat riding posture; when the standing posture mastery level is the same as the sitting posture mastery level, obtaining the reference ability level; if only the standing posture mastery level or the sitting posture mastery level is downgraded, determining the boat riding posture corresponding to the downgraded standing posture mastery level or the sitting posture mastery level as the target boat riding posture; if the standing posture mastery level and the sitting posture mastery level have the same level change, determining the boat riding standing posture or the boat riding sitting posture as the target boat riding posture according to the first level number, the second level number and the level change.

[0056] Among them, the reference ability level is the boating ability level determined for the user in the previous balance training, the first level number is the number of levels that the current standing posture mastery level crosses compared to the standing posture mastery level in the reference ability level, and the second level number is the number of levels that the current sitting posture mastery level crosses compared to the sitting posture mastery level in the reference ability level.

[0057] Exemplarily, the division of posture mastery levels is the same, including the first level, the second level, the third level, and the fourth level, wherein the fourth level is higher than the third level, the third level is higher than the second level, and the second level is higher than the first level. If the standing posture mastery level is the first level and the sitting posture mastery level is the second level or the third level, the standing posture mastery level is determined to be the target boating posture. If the standing posture mastery level and the sitting posture mastery level are both the third level, the reference ability level is obtained. Among them, when the standing posture mastery level in the reference ability level is the first level and the sitting posture mastery level is the fourth level, it can be determined that the level change of the standing posture mastery level is downgraded, and the level change of the sitting posture mastery level is upgraded. At this time, the boating standing posture corresponding to the downgrade is determined to be the target boating posture. If the level changes of the two mastery levels are determined to be downgraded according to the reference ability level, the boating posture corresponding to the larger level number of the first level number and the second level number is determined to be the target boating posture; if the level changes of the two mastery levels are determined to be upgraded according to the reference ability level, the boating posture corresponding to the smaller level number of the first level number and the second level number is determined to be the target boating posture. The principle of determining the target boating posture in this embodiment is to select a boating posture in which the user's posture mastery level is lower among multiple boating postures, or the posture mastery level improves slowly, or the posture mastery level deteriorates quickly as the target boating posture, that is, the boating training direction.

[0058] It can be seen that in this example, the server performs targeted balance training based on the user's boating ability level to determine the user's weak points or significant deterioration or small improvement in boating ability. This can improve the practicality and flexibility of the server's targeted training, quickly make up for the user's balance ability shortcomings for boating scenarios, and improve training efficiency and the user's athletic performance.

[0059] Step S204, controlling the stereoscopic audio-visual system and the six-axis motion platform to create a target boat riding scene for balance training, and controlling the stereoscopic audio-visual system to prompt the user to complete the target training task and display guidance information.

[0060] The guidance information is used to guide the user to synchronously imitate the corresponding guidance actions to maintain a balanced state.

[0061] In one possible embodiment, controlling a stereoscopic audio and video system and a six-axis motion platform to create a target boating scene for balance training, and controlling the stereoscopic audio and video system to prompt a user to complete a target training task and display guidance information, includes: controlling the stereoscopic audio and video system to play a first-person perspective image corresponding to the target boating scene, and controlling the six-axis motion platform to move according to the platform motion information corresponding to the target boating scene, so as to perform the current balance training for the user; and obtaining the coordinate information of the user in the target boating scene in real time; determining the real-time shaking information corresponding to the coordinate information according to the platform motion information; determining the guidance action according to the real-time shaking information and a pre-trained adversarial action prediction model; and sending the guidance action and the target training task to the stereoscopic audio and video system in real time, so as to control the stereoscopic audio and video system to display the guidance information and prompt information.

[0062] Among them, the coordinate information includes time coordinates and space coordinates. The time coordinate is the time when the user enters the target boat riding scene, and the space coordinate is the user's current position on the six-axis motion platform. The real-time shaking information is determined by the platform motion information. The adversarial action prediction model is determined by the server based on sample data training obtained by professional balancing personnel for adversarial actions under different reference shaking information. The prompt information is used to prompt the target training task.

[0063] Among them, the process of creating the target boating scene is that the server sends the audio and video data and the hull shaking data obtained when the target boating scene was previously determined to the stereo audio and video system and the six-axis motion platform, so as to control the stereo audio and video system to play the first-person perspective image, and control the six-axis motion platform to move according to the platform motion information. In addition, unlike the common simulated boating scenes, the stereo audio and video system in this application will generate and display guidance information for the user according to the actual movement of the six-axis motion platform. The guidance information is used to allow the user to imitate the guidance action displayed on the screen in the stereo audio and video system to maintain a balanced state. The guidance action is a confrontation action calculated in real time based on the real-time shaking information corresponding to the actual coordinate information of the user and the confrontation action prediction model, so that the user can complete the entire balance training and complete the target training task with goals and prompts during the balance training process, so as to achieve the effect of exercising the corresponding boating ability.

[0064] For example, see Figure 3 , Figure 3 Schematic diagram of a scene for creating a target boating scene provided by an embodiment of the present application. Figure 3As shown, the six-axis motion platform 120, the stereoscopic audio-visual system 130 and the motion capture system 140 in the human motion quantitative training system 100. Among them, in order to ensure the training user's experience, the stereoscopic audio-visual system 130 includes a circular audio-visual display screen and a built-in speaker. The first-person perspective image in the boat scene is played through the display screen and the built-in speaker, so that the user 301 can feel the immersive boat experience. In addition, the motion capture system 140 needs to be worn on the user 301 in advance to collect the boat motion data of the user 301 in the actual balance training. The six-axis motion platform 120 is a training venue provided to the user 301. The user 301 exercises on the six-axis motion platform 120 to achieve balance ability training. The six-axis motion platform 120 is exercised through the device under the base and the pre-set double-track treadmill 121 to enable the user 301 to perform corresponding balance movements for targeted training. Specifically, the device under the base is mainly used to control the spatial position of the six-axis motion platform 120, so as to provide different slopes for the user 301 and assist in creating various training conditions; the pre-set double-track treadmill 121 cooperates with the overall movement of the six-axis motion platform 120, so that the user 301 can make corresponding balance movements, and the two work together to enable the user 301 to carry out targeted balance training on the six-axis motion platform 120 training ground. It should be noted that the user 301 also wears a motion capture system 140 to collect the motion data of the user 301 during the training process, so as to facilitate the server to perform subsequent determination of the balance ability score.

[0065] For further information, see Figure 4 , Figure 4 Schematic diagram of a scene in which a stereoscopic audio-visual system displays guidance information provided by an embodiment of the present application. Figure 4 As shown, the stereoscopic audio-visual system displays the first-person perspective image and also displays the guidance information from the server. The guidance information includes two parts. The first part is a schematic diagram of the guidance action. The schematic diagram of the guidance action can be in the form of a dynamic image or in the form of a Figure 4 The static animation shown can clearly instruct the user on how to make guiding actions to counteract the hull shaking simulated by the six-axis motion platform. The second part is the guiding copy, which is used to guide the user to make corresponding guiding actions. The specific content of the copy can be adaptively adjusted according to the relationship between the guiding action and the standard action. For example, when the six-axis motion platform simulates the boat ride and is pushed by the waves behind, in order to prevent the user from losing balance due to leaning back, the user needs to lean forward 30° to adjust from the standard boat riding posture to the guiding action. Then the specific content of the guiding copy can be "Lean forward about 30° to resist the waves behind you."

[0066] It can be seen that in this example, in addition to creating a target boating scene for the user to perform balance training, the server also provides the user with real-time guidance actions to counteract platform shaking, so as to guide the user to imitate and learn, thereby improving the interactivity and safety of the server's balance training, and improving the user's completion of the balance training and training efficiency by displaying prompt information and guidance information.

[0067] In a possible embodiment, the platform motion information includes platform motion data corresponding to each time coordinate in the target boat boarding scene, and the platform motion data is used to indicate the platform position of the six-axis motion platform at the corresponding time coordinate; according to the platform motion information, the real-time shaking information corresponding to the coordinate information is determined, including: determining the platform motion trajectory of the six-axis motion platform according to the target motion data; determining the shaking direction and shaking amplitude corresponding to the center position of the six-axis motion platform according to the platform motion trajectory; determining the amplitude increment according to the shaking amplitude and the offset distance; updating the shaking amplitude according to the amplitude increment; determining the real-time shaking information according to the updated shaking amplitude and shaking direction.

[0068] The target motion data is the platform motion data corresponding to the time coordinate of the preset duration with the time coordinate being processed as the midpoint. The offset distance is the interval distance between the space coordinate being processed and the center position.

[0069] Among them, the platform motion information is used to indicate the platform position of the six-axis motion platform corresponding to each time coordinate in the target boating scene, so as to realize the movement of the six-axis motion platform to simulate the boating experience on the fluctuating water surface. It should be noted that if the user is in different positions on the six-axis motion platform, the shaking feeling he receives will be different. Based on the movement mode of the six-axis motion platform, the center position will be less shaken than the other positions. Therefore, the server will first determine the shaking direction and amplitude based on the center position of the six-axis motion platform, and then update the shaking amplitude based on the positional relationship between the center position and the spatial coordinates. Among them, the shaking amplitude can be understood as the shaking acceleration of the six-axis motion platform in a specific direction under a single time coordinate.

[0070] For example, see Figure 5 , Figure 5 is a schematic diagram of a scene based on the shaking difference of different spatial coordinates provided by an embodiment of the present application. Figure 5As shown, the six-axis motion platform has 6 degrees of freedom in its motion trajectory, namely three translational degrees of freedom and three rotational degrees of freedom, including forward thrust, lifting, lateral movement, roll, yaw, and pitch, which are displacements in the X-axis, Y-axis, and Z-axis directions, and rotations in the X-axis, Y-axis, and Z-axis directions, respectively. The translational degree of freedom refers to the ability of the platform to move independently in a straight line in space, which usually refers to movement in the X-axis, Y-axis, and Z-axis directions. The rotational degree of freedom refers to the ability of an object to rotate independently around an axis in space. In three-dimensional space, this usually refers to rotation around the X-axis, Y-axis, and Z-axis. The rotational degree of freedom enables an object to rotate at various angles in space, thereby changing its direction or posture. Based on the movement mode of the six-axis motion platform, it can be seen that when the six-axis motion platform is not performing a single translational degree of freedom movement, the center position will be less shaken than the other positions. Figure 5 The two black blocks in the figure are the actual spatial coordinates of the user and the center position of the six-axis motion platform. When the shaking direction is roll, the actual amplitude of the center position is the first amplitude, and the actual amplitude of the spatial coordinate is the second amplitude. Since the shaking amplitude is the shaking acceleration in a specific direction under a single time coordinate. Under the same time coordinate, the shaking acceleration corresponding to the first amplitude will be obviously higher than the shaking acceleration corresponding to the second amplitude. Therefore, during the data processing of the server, when the user's spatial coordinates are not at the center position, the actual shaking amplitude to which the user is subjected needs to be determined by the server based on the shaking amplitude of the center position, combined with the amplitude value-added based on the positional relationship between the center position and the spatial coordinates.

[0071] It can be seen that in this example, the server determines the platform's motion trajectory in real time and combines the positional relationship between the platform's center position and the user's spatial coordinates to determine the actual shaking amplitude and direction experienced by the user, thereby improving the accuracy of determining real-time shaking information, thereby improving the accuracy of guided actions and improving the user's actual training effect.

[0072] Step S205 , after the target boat riding scene is finished, the boat riding training data collected by the motion capture system is obtained to determine the balance ability score of the user in the current balance training.

[0073] In a possible embodiment, the boating training data includes user motion data of the user in the current balance training; after the target boating scene ends, the boating training data collected by the motion capture system is obtained to determine the balance ability score of the user in the current balance training, including: determining a user motion set according to the user motion data; and determining a task completion result according to the user motion data and the target training task; determining a second correspondence between each guiding motion in the current balance training and the time coordinate; determining multiple motion comparison groups according to a preset human reaction time, a first correspondence and a second correspondence; determining the motion similarity between the guiding motion and the user motion in each motion comparison group; and determining the user's balance ability score according to an average value of the motion similarity, the task completion result and a preset score calculation formula.

[0074] Among them, the user action set includes multiple user actions and the first correspondence between each user action and the time coordinate. The task completion result is used to characterize whether the user has completed the target training task. Each action comparison group includes a guide action and a user action. The difference between the time coordinate corresponding to the guide action and the time coordinate corresponding to the user action in the same action comparison group is the human reaction time. The human reaction time is related to the user's age. The score calculation formula includes the correspondence between the first balance ability score and the first weight, and the correspondence between the second balance ability score and the second weight. The first balance ability score is determined by the average value of the action similarity, and the second balance ability score is determined by the task completion result.

[0075] Among them, the server calculates the balance ability score of the user in the boating scene, which consists of two parts, one is the task completion result, and the other is the actual training performance. Among them, if the task completion result is characterized as the user completing the target training task, the corresponding score is obtained. If the task completion result is characterized as the user not completing the target training task, the corresponding score will not be obtained. Among them, the actual training performance is judged according to the action similarity of the user's actual imitation of the guide action. Among them, since the user still needs a certain reaction time to learn to imitate after seeing the guide action. Therefore, in this embodiment, when dividing the action comparison group, the time coordinate corresponding to the guide action will be faster than the time coordinate of the corresponding user action by a human body reaction time, and the length of the human body reaction time is related to the actual age of the user. In addition, in order to ensure that the balance ability scores obtained by different boating scenes can effectively reflect the user's balance ability, the corresponding boating scene with a higher boating ability level has a higher value of the first weight and the second weight.

[0076] It can be seen that in this example, the server determines the balance ability score based on the boat training data and task completion results, which can improve the accuracy and practicality of the server's balance training, quantitatively evaluate the user's balance ability from the training data level, and facilitate the subsequent improvement of the user's balance ability. In addition, the scoring mechanism can increase user participation and stickiness, and improve the user's completion of balance training in the boat scenario.

[0077] visible, Figure 2 This is a flow chart of a method for processing balance training data in a boating simulation scenario provided by an embodiment of the present application. The server determines the user's boating ability level, that is, the boating posture mastery level, based on the boating posture data of the user before the balance training in the boating scenario. Then, the target boating scene and training task adapted to the user are determined to control the six-axis motion platform and the stereo audio-visual system to create a target boating scene for the user, thereby improving the flexibility and practicality of the server in performing balance training for different users and improving the training effect of the user. In addition, guidance information is provided to the user during the training process, and the action guidance during the training process is used to improve the safety and clarity of the user in the training.

[0078] The following is an embodiment of the device of the present application. The embodiment of the device of the present application and the embodiment of the method of the present application are of the same concept and are used to execute the method described in the embodiment of the present application. For the convenience of explanation, the embodiment of the device of the present application only shows the part related to the embodiment of the device of the present application. For the specific technical details not disclosed, please refer to the description of the embodiment of the method of the present application, which will not be repeated here one by one.

[0079] The embodiment of the present application provides a device for processing balance training data in a boating simulation scenario. The device for processing balance training data in a boating simulation scenario is applied to Figure 1 The server 110 in the human motion quantification training system 100 shown in the figure, the human motion quantification training system 100 also includes a six-axis motion platform 120, a stereo audio-visual system 130, and a motion capture system 140. Specifically, the balance training data processing device in the boat simulation scene is used to execute the steps executed by the server in the balance training data processing method in the boat simulation scene above. The balance training data processing device in the boat simulation scene provided in the embodiment of the present application may include modules corresponding to the corresponding steps.

[0080] The embodiment of the present application can divide the functional modules of the balance training data processing device in the boat simulation scenario according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware or in the form of software functional modules. The division of modules in the embodiment of the present application is schematic and is only a logical functional division. There may be other division methods in actual implementation.

[0081] In the case of dividing each functional module into corresponding functional modules, Figure 6 1 is a functional unit composition block diagram of a balance training data processing device in a boating simulation scenario provided by an embodiment of the present application; the balance training data processing device 60 in a boating simulation scenario is applied to a server 110 in a human motion quantification training system 100, and the human motion quantification training system 100 also includes: a six-axis motion platform 120, a stereo audio-visual system 130, and a motion capture system 140; the balance training data processing device 60 in a boating simulation scenario includes: a data acquisition unit 601, which is used to acquire boating posture data, and the boating posture data is the associated data of the user when completing various preset types of boating postures collected by the motion capture system and the six-axis motion platform; a first determination unit 602, which is used to determine the boating ability level according to the boating posture data, and the boating ability level Including the posture mastery level corresponding to each preset type of boating posture; the second determination unit 603 is used to determine the target boating scene and target training task adapted to the boating ability level, and the target training task is the training task that the user needs to complete in the current target boating scene; the training unit 604 is used to control the stereo audio-visual system and the six-axis motion platform to create a target boating scene for balance training, and control the stereo audio-visual system to prompt the user to complete the target training task and display guidance information, and the guidance information is used to guide the user to synchronously imitate the corresponding guidance actions to maintain a balanced state; the third determination unit 605 is used to obtain the boating training data collected by the motion capture system after the target boating scene is completed, so as to determine the balance ability score of the user in the current balance training.

[0082] In a possible embodiment, the boating ability level includes a standing posture mastery level corresponding to the boating standing posture and a sitting posture mastery level corresponding to the boating sitting posture; in terms of determining the boating ability level according to the boating posture data, the first determining unit 602 is specifically used to: determine the boating standing posture data corresponding to the boating standing posture and the boating sitting posture data corresponding to the boating sitting posture according to the boating posture data, the boating standing posture data includes the first motion data collected by the motion capture system and the plantar pressure data collected by the six-axis motion platform, and the boating sitting posture data includes the second motion data collected by the motion capture system; determine the user's position according to the plantar pressure data. The invention relates to a method for determining change trajectory information of the plantar pressure center in a standing posture on a boat, wherein the change trajectory information includes a swing trajectory length, a swing speed, and a covered area; determining a center of gravity stability index according to the swing trajectory length, the swing speed, and the covered area; and determining a posture symmetry of the user in a standing posture on a boat according to the first motion data; and determining a center of gravity inclination angle and a body shaking index of the user in a sitting posture on a boat according to the second motion data; determining a sitting posture mastery level according to the center of gravity inclination angle and the body shaking index; and determining a standing posture mastery level according to the center of gravity stability index and the posture symmetry.

[0083] In one possible embodiment, in terms of determining the target boarding scene and target training task that are adapted to the boarding ability level, the second determination unit 603 is specifically used to: if a training direction selection instruction is received, then respond to the training direction selection instruction to determine the boarding training direction, the boarding training direction is used to indicate the target boarding posture trained and strengthened by the target training task; if no training direction selection instruction is received, then determine the boarding training direction according to the standing posture mastery level and the sitting posture mastery level; determine the reference training task in the preset training task set that is adapted to the boarding training direction as the target training task, the task difficulty level of the target training task is determined by the posture mastery level corresponding to the target boarding posture, and each boarding training direction Each task difficulty level corresponds to one or more reference training tasks in a training task set; a preset ship boarding scene set is obtained, the ship boarding scene set includes multiple reference ship boarding scenes, and audio and video data and hull shaking data corresponding to each reference ship boarding scene, the audio and video data is used to indicate the first-person perspective image of the user in the corresponding reference ship boarding scene played by the stereoscopic audio and video system, the hull shaking data is used to indicate the platform motion information corresponding to the hull shaking in the corresponding reference ship boarding scene simulated by the six-axis motion platform, and each hull shaking data corresponds to multiple posture mastery levels; according to the ship boarding scene set, the reference ship boarding scene corresponding to the hull shaking data adapted to the posture mastery level corresponding to the target ship boarding posture is determined as the target ship boarding scene.

[0084] In a possible embodiment, in terms of determining the boating training direction according to the standing posture mastery level and the sitting posture mastery level, the second determination unit 603 is specifically used for: when the standing posture mastery level is different from the sitting posture mastery level, determining the boating posture corresponding to the lower posture mastery level as the target boating posture; when the standing posture mastery level is the same as the sitting posture mastery level, obtaining the reference ability level, which is the boating ability level determined for the user in the previous balance training; if only the standing posture mastery level or the sitting posture mastery level is downgraded, determining the boating posture corresponding to the downgraded standing posture mastery level or the sitting posture mastery level as the target boating posture; if the standing posture mastery level and the sitting posture mastery level have the same level change, determining the boating standing posture or the boating sitting posture as the target boating posture according to the first level number, the second level number and the level change, the first level number being the number of levels spanned by the current standing posture mastery level compared to the standing posture mastery level in the reference ability level, and the second level number being the number of levels spanned by the current sitting posture mastery level compared to the sitting posture mastery level in the reference ability level.

[0085] In one possible embodiment, in terms of controlling the stereoscopic audio-visual system and the six-axis motion platform to create a target boating scene for balance training, and controlling the stereoscopic audio-visual system to prompt the user to complete the target training task and display guidance information, the training unit 604 is specifically used to: control the stereoscopic audio-visual system to play the first-person perspective image corresponding to the target boating scene, and control the six-axis motion platform to move according to the platform motion information corresponding to the target boating scene, so as to perform the current balance training for the user; and, obtain the coordinate information of the user in the target boating scene in real time, the coordinate information includes time coordinates and space coordinates, the time coordinates are the time when the user enters the target boating scene, and the space coordinates are the current position of the user on the six-axis motion platform; determine the real-time shaking information corresponding to the coordinate information according to the platform motion information, and the real-time shaking information is determined by the platform motion information; determine the guiding action according to the real-time shaking information and the pre-trained confrontation action prediction model, and the confrontation action prediction model is determined by the server based on the sample data obtained by professional balance personnel for confrontation actions under different reference shaking information; send the guiding action and the target training task to the stereoscopic audio-visual system in real time to control the stereoscopic audio-visual system to display the guidance information and prompt information, and the prompt information is used to prompt the target training task.

[0086] In a possible embodiment, the platform motion information includes platform motion data corresponding to each time coordinate in the target boat boarding scene, and the platform motion data is used to indicate the platform position of the six-axis motion platform at the corresponding time coordinate; in terms of determining the real-time shaking information corresponding to the coordinate information according to the platform motion information, the training unit 604 is specifically used to: determine the platform motion trajectory of the six-axis motion platform according to the target motion data, the target motion data is the platform motion data corresponding to the time coordinate of a preset time length with the time coordinate being processed as the midpoint; determine the shaking direction and shaking amplitude corresponding to the center position of the six-axis motion platform according to the platform motion trajectory; determine the amplitude increment according to the shaking amplitude and the offset distance, and the offset distance is the interval distance between the spatial coordinate being processed and the center position; update the shaking amplitude according to the amplitude increment; determine the real-time shaking information according to the updated shaking amplitude and shaking direction.

[0087] In a possible embodiment, the boating training data includes the user action data of the user in the current balance training; after the target boating scene is completed, the boating training data collected by the motion capture system is obtained to determine the balance ability score of the user in the current balance training. In terms of, the third determination unit 605 is specifically used to: determine a user action set according to the user action data, the user action set includes multiple user actions and a first correspondence between each user action and a time coordinate; and determine a task completion result according to the user action data and the target training task, the task completion result is used to characterize whether the user has completed the target training task; determine a second correspondence between each guiding action in the current balance training and the time coordinate; determine the second correspondence between each guiding action and the time coordinate according to a preset human reaction time, a first corresponding relationship between the user action and the time coordinate; determine the second corresponding relationship between each guiding action in the current balance training ...; determine the second corresponding relationship between each guiding action in the current balance training and the time coordinate according to a preset human reaction time, a first corresponding relationship between the user action and the time coordinate; determine the second corresponding relationship between each guiding action in the current balance training and the time coordinate; determine the second corresponding relationship between each guiding action in the current balance training and the time coordinate according to a preset human reaction time, a first corresponding relationship between the user action and the time coordinate A first correspondence relationship and a second correspondence relationship are used to determine multiple action comparison groups, each action comparison group includes a guide action and a user action, the difference between the time coordinate corresponding to the guide action in the same action comparison group and the time coordinate corresponding to the user action is the human reaction time, and the human reaction time is related to the age of the user; the action similarity between the guide action and the user action in each action comparison group is determined; according to the average value of the action similarity, the task completion result and a preset score calculation formula, the user's balance ability score is determined, the score calculation formula includes the correspondence between the first balance ability score and the first weight, and the correspondence between the second balance ability score and the second weight, the first balance ability score is determined by the average value of the action similarity, and the second balance ability score is determined by the task completion result.

[0088] In the case of integrated units, such as Figure 7 As shown, Figure 7 This is a block diagram of the functional units of another balance training data processing device in a boating simulation scenario provided by an embodiment of the present application. Figure 7In the embodiment, the balance training data processing device 60 in the shipboard simulation scenario includes: a processing module 702 and a communication module 701. The processing module 702 is used to control and manage the actions of the balance training data processing device in the shipboard simulation scenario, for example, the steps of the data acquisition unit 601, the first determination unit 602, the second determination unit 603, the training unit 604 and the third determination unit 605, and / or other processes for executing the technology described herein. The communication module 701 is used to support the interaction between the balance training data processing device in the shipboard simulation scenario and other devices. Figure 7 As shown, the device for processing balance training data in a shipboard simulation scenario may include a storage module 703, and the storage module 703 is used to store program codes and data of the device for processing balance training data in a shipboard simulation scenario.

[0089] Among them, the processing module 702 can be a processor or a controller, for example, a central processing unit (CPU), a general processor, a digital signal processor (DSP), an ASIC, an FPGA or other programmable logic device, a transistor logic device, a hardware component or any combination thereof. It can implement or execute various exemplary logic blocks, modules and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements a computing function, for example, a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like. The communication module 701 can be a transceiver, an RF circuit or a communication interface, and the like. The storage module 703 can be a memory.

[0090] All relevant contents of each scenario involved in the above method embodiment can be referred to the functional description of the corresponding functional module, which will not be repeated here. The above balance training data processing device 60 in the boat simulation scenario can execute the above Figure 2 The balanced training data processing method in the boat riding simulation scenario is shown.

[0091] The above embodiments can be implemented in whole or in part by software, hardware, firmware or any other combination. When implemented using software, the above embodiments can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer programs are loaded or executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website site, computer, server or data center to another website site, computer, server or data center by wired or wireless means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that contains one or more available media sets. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium. The semiconductor medium can be a solid-state hard disk.

[0092] Figure 8 is a structural block diagram of a server provided in an embodiment of the present application. Figure 8 As shown, the server 110 may include one or more of the following components: a processor 801, a memory 802 coupled to the processor 801, wherein the memory 802 may store one or more computer programs 803, and the one or more computer programs 803 may be configured to implement the methods described in the above embodiments when executed by one or more processors 801. The server described here is the server 110 in the above embodiments.

[0093] The processor 801 may include one or more processing cores. The processor 801 uses various interfaces and lines to connect various parts of the entire server 110, and executes various functions and processes data of the server 110 by running or executing instructions, programs, code sets or instruction sets stored in the memory 802, and calling data stored in the memory 802. Optionally, the processor 801 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 801 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing display content; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 801, and it can be implemented separately through a communication chip.

[0094] The memory 802 may include a random access memory (RAM) or a read-only memory (ROM). The memory 802 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 802 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc. The data storage area may also store data created by the server 110 during use, etc.

[0095] It is understandable that the server 110 may include more or fewer structural elements than those in the above structural block diagram, which is not limited here.

[0096] An embodiment of the present application also provides a computer storage medium, on which a computer program / instruction is stored. When the computer program / instruction is executed by a processor, part or all of the steps of any method recorded in the above method embodiments are implemented.

[0097] An embodiment of the present application also provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute part or all of the steps of any method recorded in the above method embodiments.

[0098] It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0099] In the several embodiments provided in the present application, it should be understood that the disclosed methods, devices and systems can be implemented in other ways. For example, the device embodiments described above are merely schematic; for example, the division of the units is only a logical function division, and there may be other division methods in actual implementation; for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0100] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0101] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may be physically included separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0102] The above-mentioned integrated unit implemented in the form of a software functional unit can be stored in a computer-readable storage medium. The above-mentioned software functional unit is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform some steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: a USB flash drive, a mobile hard disk, a magnetic disk, an optical disk, a volatile memory or a non-volatile memory. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM) or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of random access memory (RAM) are available, such as static RAM (SRAM), dynamic random access memory (DRAM), synchronous DRAM (SDRAM), double data rate synchronous dynamic random access memory (double data rate SDRAM, DDR SDRAM), enhanced synchronous dynamic random access memory (enhanced SDRAM, ESDRAM), synchronous link dynamic random access memory (synchlink DRAM, SLDRAM) and direct memory bus random access memory (directrambus RAM, DR RAM) and other media that can store program code.

[0103] Although the present invention is disclosed as above, the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions without departing from the spirit and scope of the present invention, and can make various changes and modifications, including the combination of the above-mentioned different functions and implementation steps, including software and hardware implementation methods, all of which are within the scope of protection of the present invention.

Claims

1. A method for processing balance training data in a boating simulation scenario, characterized in that: The server is applied to a human motion quantitative training system, wherein the human motion quantitative training system further comprises: a six-axis motion platform, a stereoscopic audio-visual system, and a motion capture system; the method comprises: Acquire boating posture data, wherein the boating posture data is associated data collected by the motion capture system and the six-axis motion platform when the user completes various preset types of boating postures; Determine a boating ability level according to the boating posture data, wherein the boating ability level includes a posture mastery level corresponding to each of the preset types of boating postures; Determine a target boating scene and a target training task that are adapted to the boating ability level, wherein the target training task is a training task that the user needs to complete in the current target boating scene; Controlling the stereoscopic audio-visual system and the six-axis motion platform to create the target boat riding scene for balance training, and controlling the stereoscopic audio-visual system to prompt the user to complete the target training task and display guidance information, wherein the guidance information is used to guide the user to synchronously imitate corresponding guidance actions to maintain a balanced state; After the target boat riding scene is finished, the boat riding training data collected by the motion capture system is obtained to determine the balance ability score of the user in the current balance training.

2. The method according to claim 1, characterized in that The boating ability level includes the standing posture mastery level corresponding to the boating standing posture and the sitting posture mastery level corresponding to the boating sitting posture; Determining the ship riding ability level according to the ship riding posture data includes: Determine, according to the boating posture data, the boating standing posture data corresponding to the boating standing posture and the boating sitting posture data corresponding to the boating sitting posture, wherein the boating standing posture data includes the first motion data collected by the motion capture system and the plantar pressure data collected by the six-axis motion platform, and the boating sitting posture data includes the second motion data collected by the motion capture system; Determine, according to the plantar pressure data, change track information of the plantar pressure center of the user in the boat standing posture, wherein the change track information includes a swing track length, a swing speed, and a coverage area; Determine a center of gravity stability index according to the swing trajectory length, the swing speed and the coverage area; and determine a posture symmetry of the user in the boat standing posture according to the first motion data; and determine a center of gravity inclination angle and a body shaking index of the user in the boat sitting posture according to the second motion data; The sitting posture mastery level is determined according to the center of gravity inclination angle and the body shaking index; and the standing posture mastery level is determined according to the center of gravity stability index and the posture symmetry.

3. The method according to claim 2, characterized in that The determining of a target boarding scene and a target training task adapted to the boarding ability level includes: If a training direction selection instruction is received, determining a boating training direction in response to the training direction selection instruction, wherein the boating training direction is used to indicate a target boating posture trained and strengthened by the target training task; If the training direction selection instruction is not received, determining the boating training direction according to the standing posture mastering level and the sitting posture mastering level; Determine a reference training task in a preset training task set that is adapted to the boating training direction as the target training task, wherein the task difficulty level of the target training task is determined by the posture mastery level corresponding to the target boating posture, and each of the task difficulty levels in each of the boating training directions corresponds to one or more reference training tasks in the training task set; Acquire a preset boating scene set, the boating scene set comprising a plurality of reference boating scenes, and audio-visual data and ship hull sway data corresponding to each of the reference boating scenes, the audio-visual data being used to indicate a first-person perspective image of the user in the corresponding reference boating scene played by the stereoscopic audio-visual system, the ship hull sway data being used to indicate platform motion information corresponding to the ship hull sway in the corresponding reference boating scene simulated by the six-axis motion platform, and each of the ship hull sway data corresponding to a plurality of the posture mastering levels; According to the set of ship boarding scenes, a reference ship boarding scene corresponding to the hull swaying data adapted to the posture mastering level corresponding to the target ship boarding posture is determined as the target ship boarding scene.

4. The method according to claim 3, characterized in that The step of determining the boat training direction according to the standing posture mastering level and the sitting posture mastering level comprises: When the standing posture mastering level is different from the sitting posture mastering level, determining the boating posture corresponding to the posture mastering level with a lower level as the target boating posture; When the standing posture mastering level is the same as the sitting posture mastering level, obtaining a reference ability level, the reference ability level being a boating ability level determined for the user in a previous balance training; If only the standing posture mastering level or the sitting posture mastering level is downgraded, determining the boating posture corresponding to the downgraded standing posture mastering level or the sitting posture mastering level as the target boating posture; If the standing posture mastering level and the sitting posture mastering level have the same level change, then the standing posture on board or the sitting posture on board is determined to be the target sitting posture on board according to the first level number, the second level number and the level change, the first level number being the number of levels that the current standing posture mastering level crosses compared to the standing posture mastering level in the reference ability level, and the second level number being the number of levels that the current sitting posture mastering level crosses compared to the sitting posture mastering level in the reference ability level.

5. The method according to claim 3, characterized in that: The step of controlling the stereoscopic audio-visual system and the six-axis motion platform to create the target boat riding scene for balance training, and controlling the stereoscopic audio-visual system to prompt the user to complete the target training task and display guidance information, comprises: Controlling the stereoscopic audio-visual system to play the first-person perspective image corresponding to the target boating scene, and controlling the six-axis motion platform to move according to the platform motion information corresponding to the target boating scene, so as to perform the current balance training for the user; and acquiring the coordinate information of the user in the target boating scene in real time, the coordinate information including time coordinate and space coordinate, the time coordinate being the time when the user enters the target boating scene, and the space coordinate being the current position of the user on the six-axis motion platform; Determine, according to the platform motion information, real-time shaking information corresponding to the coordinate information, wherein the real-time shaking information is determined by the platform motion information; Determining the guiding action according to the real-time shaking information and a pre-trained confrontation action prediction model, wherein the confrontation action prediction model is determined by the server based on sample data obtained by professional balance personnel for confrontation actions under different reference shaking information; The guiding action and the target training task are sent to the stereoscopic audio-visual system in real time to control the stereoscopic audio-visual system to display the guiding information and prompt information, wherein the prompt information is used to prompt the target training task.

6. The method according to claim 5, characterized in that The platform motion information includes platform motion data corresponding to each of the time coordinates in the target boating scene, and the platform motion data is used to indicate the platform position of the six-axis motion platform at the corresponding time coordinate; Determining the real-time shaking information corresponding to the coordinate information according to the platform motion information includes: Determine the platform motion trajectory of the six-axis motion platform according to the target motion data, wherein the target motion data is the platform motion data corresponding to the time coordinate of the preset time length with the time coordinate being processed as the midpoint; According to the motion trajectory of the platform, determining the shaking direction and shaking amplitude corresponding to the center position of the six-axis motion platform; Determine the amplitude increment according to the shaking amplitude and the offset distance, wherein the offset distance is the interval distance between the spatial coordinate being processed and the center position; According to the amplitude increment, updating the shaking amplitude; The real-time shake information is determined according to the updated shake amplitude and the shake direction.

7. The method according to claim 5 or 6, characterized in that: The boating training data includes user motion data of the user in the current balance training; after the target boating scene is finished, obtaining the boating training data collected by the motion capture system to determine the balance ability score of the user in the current balance training, including: Determine a user action set according to the user action data, the user action set including a plurality of user actions and a first correspondence between each user action and the time coordinate; and determine a task completion result according to the user action data and the target training task, the task completion result being used to indicate whether the user has completed the target training task; Determining a second corresponding relationship between each of the guiding actions in the current balance training and the time coordinate; According to the preset human body reaction time, the first corresponding relationship and the second corresponding relationship, a plurality of action comparison groups are determined, each action comparison group includes one of the guide actions and the user action, and the difference between the time coordinates corresponding to the guide action and the time coordinates corresponding to the user action in the same action comparison group is the human body reaction time, and the human body reaction time is associated with the age of the user; Determining the action similarity between the guidance action and the user action in each action comparison group; The balance ability score of the user is determined according to the average value of the action similarities, the task completion result and a preset score calculation formula, wherein the score calculation formula includes a correspondence between a first balance ability score and a first weight, and a correspondence between a second balance ability score and a second weight, wherein the first balance ability score is determined by the average value of the action similarities, and the second balance ability score is determined by the task completion result.

8. A device for processing balance training data in a boating simulation scenario, characterized in that: A server used in a human motion quantitative training system, wherein the human motion quantitative training system further comprises: a six-axis motion platform, a stereoscopic audio-visual system, and a motion capture system; the device comprises: A data acquisition unit, used to acquire boating posture data, wherein the boating posture data is associated data collected by the motion capture system and the six-axis motion platform when the user completes various preset types of boating postures; A first determining unit, configured to determine a boating ability level according to the boating posture data, wherein the boating ability level includes a posture mastery level corresponding to each of the preset types of boating postures; A second determining unit is used to determine a target boating scene and a target training task that are adapted to the boating ability level, wherein the target training task is a training task that the user needs to complete in the current target boating scene; A training unit, used to control the stereoscopic audio-visual system and the six-axis motion platform to create the target boat riding scene for balance training, and to control the stereoscopic audio-visual system to prompt the user to complete the target training task and display guidance information, wherein the guidance information is used to guide the user to synchronously imitate corresponding guidance actions to maintain a balance state; The third determining unit is used to obtain the boating training data collected by the motion capture system after the target boating scene ends, so as to determine the balance ability score of the user in the current balance training.

9. A server, characterized in that: The method comprises a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the programs include instructions for executing the steps in the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: A computer program for electronic data exchange is stored, wherein the computer program causes a computer to execute the method according to any one of claims 1 to 7.

Images