A motion assisting method, device and equipment based on virtual reality equipment

Abstract

Embodiments of the present application provide a kind of motion auxiliary method, device and equipment based on virtual reality equipment, it is related to data processing technical field.The specific implementation scheme is: obtain the first type data and the second type data uploaded by user;The first type data is analyzed, to generate the scene data of target virtual reality scene for constructing the reality scene;Based on the second type data, generate the object data for constructing the target virtual image of the companion object;Control virtual reality equipment to construct target virtual reality scene containing the target virtual image according to the scene data and object data;The target virtual reality scene in the target virtual image is controlled by the virtual reality equipment, and the user is followed by action.The scene that can be immersed by user in the process of motion is familiar with insufficient, it leads to the problem that user safety is relatively low, there is certain influence to the user motion effect.

Description

Technical Field

[0001] This invention relates to the field of virtual reality technology, and in particular to a motion assistance method, apparatus, and device based on virtual reality equipment. Background Technology

[0002] Virtual reality devices can simulate virtual reality scenarios, allowing users to experience an immersive feeling of exercising in a virtual reality environment when they wear virtual reality devices.

[0003] Studies show that familiar environments or stimuli reduce the burden on working memory and free up cognitive resources for emotion regulation because they do not require additional cognitive resources to adapt to new information. Soft fascination is a state of gentle attentional immersion naturally triggered by low-threat natural or social stimuli (such as flowing water, greenery, familiar scenes, people, or gentle social interactions), requiring no conscious effort. It effectively reduces stress and restores cognitive resources—this is the attentional recovery theory. Familiar environmental stimuli promote neural mechanisms of emotion regulation by activating the hippocampal-prefrontal neural pathway. Virtual familiar scenes constructed based on individual memory are defined as psychologically safe scenes and can significantly reduce salivary cortisol levels. Simultaneously, relaxation training (such as mindfulness meditation) not only effectively reduces cortisol secretion but also enhances sustained attention and inhibitory control functions. Under chronic stress, persistently elevated cortisol levels impair attentional network function, while reducing cortisol levels through the aforementioned interventions helps restore attentional function. Therefore, enhancing an individual's environmental familiarity in a virtual environment can serve as an effective intervention to promote the recovery of attentional function.

[0004] In existing technologies, the virtual reality scenes simulated by virtual reality devices are of fixed types, and the scene content is also preset by the system. This results in insufficient familiarity with the scene experienced by the user during exercise, leading to a lower sense of security and negatively impacting the user's exercise performance. Summary of the Invention

[0005] The purpose of this invention is to provide a motion assistance method, device, and equipment based on virtual reality devices, to address the problem that insufficient familiarity with the immersive environment experienced by users during exercise leads to a lower sense of security and negatively impacts exercise performance. The specific technical solution is as follows:

[0006] In a first aspect, this application provides a motion-assisted method based on a virtual reality device, applied to a motion-assisted terminal, the method comprising:

[0007] Acquire a first type of data and a second type of data uploaded by the user; wherein, the first type of data is a picture / video with a real scene content; the second type of data is used to describe the companion that the user expects when exercising;

[0008] The first type of data is analyzed to generate scene data for constructing the target virtual reality scene of the real-world scene;

[0009] Based on the second type of data, object data is generated for constructing the target virtual image of the companion object;

[0010] Control the virtual reality device to construct a target virtual reality scene containing the target virtual image according to the scene data and object data, and output the target virtual reality scene to the user;

[0011] During the process of the user performing target movement through the target virtual reality scene, the motion capture device acquires the user's motion movements. Based on the acquired motion movements, the virtual reality device is controlled so that the target virtual image in the target virtual reality scene follows the user's movements.

[0012] Secondly, this application provides a motion assist device based on a virtual reality device, applied to a motion assist end, the device comprising:

[0013] The first acquisition module is used to acquire a first type of data and a second type of data uploaded by the user; wherein, the first type of data is a picture / video with a real scene content; the second type of data is used to describe the companion that the user expects when exercising;

[0014] An analysis module is used to analyze the first type of data to generate scene data for constructing the target virtual reality scene of the real scene;

[0015] The generation module is used to generate object data for constructing the target virtual image of the companion object based on the second type of data;

[0016] A construction module is used to control the virtual reality device to construct a target virtual reality scene containing the target virtual image according to the scene data and object data, and output the target virtual reality scene to the user;

[0017] The first control module is used to acquire the user's motion movements monitored by the motion capture device during the user's target motion movement through the target virtual reality scene, and control the virtual reality device to make the target virtual image in the target virtual reality scene follow the user's movements based on the acquired motion movements.

[0018] Thirdly, this application provides a motion assistance system based on a virtual reality device, the system comprising:

[0019] The motion assist device is used to acquire a first type of data and a second type of data uploaded by the user; analyze the first type of data to generate scene data for constructing a target virtual reality scene of the real scene; based on the second type of data, generate object data for constructing a target virtual image of a companion; and send a first control command to the virtual reality device; wherein, the first type of data is an image / video with real scene content; the second type of data is used to describe the desired companion when the user is exercising; and the first control command carries the scene data and the object data.

[0020] A virtual reality device, configured to respond to a first control command, construct a target virtual reality scene containing the target virtual image according to the scene data and object data, and output the target virtual reality scene to the user;

[0021] A motion capture device is used to monitor the user's motion movements during the process of the user performing target movements through the target virtual reality scene;

[0022] The motion assist terminal is also used to acquire the user's motion movements detected by the motion capture device; based on the acquired motion movements, it generates a second control command and sends it to the virtual reality device;

[0023] The virtual reality device is also configured to respond to a second control command to cause the target virtual image in the target virtual reality scene to follow the user's movements.

[0024] Fourthly, this application provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus;

[0025] Memory, used to store computer programs;

[0026] The processor, when executing a program stored in memory, implements any of the motion assistance methods based on virtual reality devices described above.

[0027] Fifthly, this application provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements any of the motion assistance methods based on virtual reality devices described above.

[0028] This invention also provides a computer program product containing instructions that, when run on a computer, causes the computer to execute any of the motion assistance methods based on virtual reality devices described above.

[0029] Beneficial effects of the embodiments of the present invention:

[0030] The solution of this application analyzes the first type of data to generate scene data for constructing the target virtual reality scene of the real-world scene, and generates object data for constructing the target virtual image of the companion based on the second type of data. It controls the virtual reality device to construct the target virtual reality scene containing the target virtual image according to the scene data and object data, and outputs the target virtual reality scene to the user. Therefore, the solution of this application can generate the target virtual reality scene and target virtual image required by the user according to the user's needs. Furthermore, this application can acquire the user's movement movements monitored by a motion capture device during the user's target movement through the target virtual reality scene, and control the virtual reality device based on the acquired movement movements so that the target virtual image in the target virtual reality scene follows the user's movements. Thus, this application can generate the target virtual reality scene and target virtual image according to the user's needs, and the target virtual image can follow the user's movement during the user's target movement through the target virtual reality scene. Therefore, since both the target virtual reality scene and the following target virtual image are generated according to the user's needs, the user experiences a strong sense of familiarity with the scene during the movement, resulting in a higher sense of security and improving the user's exercise experience.

[0031] In addition, when users use exercise for physical and mental recovery, the familiarity of the scene they are immersed in during the exercise process makes them feel safer and consumes less attentional resources, which helps to improve the recovery effect.

[0032] Of course, implementing any product or method of the present invention does not necessarily require achieving all of the advantages described above at the same time. Attached Figure Description

[0033] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other embodiments can be obtained based on these drawings.

[0034] Figure 1 This is a flowchart illustrating a motion assistance method based on a virtual reality device provided in an embodiment of this application;

[0035] Figure 2 This is a schematic diagram of a clock synchronization method provided in an embodiment of this application;

[0036] Figure 3 This is a flowchart illustrating another motion assistance method based on a virtual reality device provided in an embodiment of this application;

[0037] Figure 4 This is a schematic diagram illustrating a device connection relationship provided in an embodiment of this application;

[0038] Figure 5 This is a schematic diagram of a device signaling interaction provided in an embodiment of this application;

[0039] Figure 6 This is a schematic diagram of the structure of a motion assistance system based on a virtual reality device provided in an embodiment of this application;

[0040] Figure 7 This is a schematic diagram of the structure of a motion assist device based on a virtual reality device provided in an embodiment of this application;

[0041] Figure 8 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0042] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art based on this application are within the scope of protection of the present invention.

[0043] In the technical solution of this application, the operations of obtaining, storing, using, processing, transmitting, providing and disclosing user personal information are all carried out with the user's authorization.

[0044] To address the issue of insufficient familiarity with the immersive environment during exercise, leading to a lower sense of security and negatively impacting exercise performance, this application provides a motion assistance method based on a virtual reality device (VRD) device. This method is applied to a motion assistance terminal. Optionally, the motion assistance terminal can be software, deployed on a management device that interacts with the VRD device, such as a server, host, or mobile phone. Alternatively, it can be deployed on the VRD device itself. Alternatively, the motion assistance terminal can also be hardware, such as an electronic device interacting with the VRD device, like a server, host, or mobile phone. This application's VRD-based motion assistance method corresponds to a VRD-based motion assistance system, which may include at least a motion assistance terminal, a VRD device, and a motion capture device. It is understood that when the motion assistance terminal is a VRD device or deployed on a VRD device, the motion assistance terminal and the VRD device can be considered the same object, and the system may include at least the VRD device and the motion capture device. In addition, the system may include one or more of the following: physiological data monitoring devices, facial expression monitoring devices, designated motion devices, olfactory stimulation devices, and tactile stimulation devices. The motion assistance system based on virtual reality devices may also be referred to as an augmented reality system.

[0045] The method includes:

[0046] Acquire a first type of data and a second type of data uploaded by the user; wherein, the first type of data is a picture / video with a real scene content; the second type of data is used to describe the companion that the user expects when exercising;

[0047] The first type of data is analyzed to generate scene data for constructing the target virtual reality scene of the real-world scene;

[0048] Based on the second type of data, object data is generated for constructing the target virtual image of the companion object;

[0049] Control the virtual reality device to construct a target virtual reality scene containing the target virtual image according to the scene data and object data, and output the target virtual reality scene to the user;

[0050] During the process of the user performing target movement through the target virtual reality scene, the motion capture device acquires the user's motion movements. Based on the acquired motion movements, the virtual reality device is controlled so that the target virtual image in the target virtual reality scene follows the user's movements.

[0051] The solution of this application analyzes the first type of data to generate scene data for constructing the target virtual reality scene of the real-world scene, and generates object data for constructing the target virtual image of the companion based on the second type of data. It controls the virtual reality device to construct the target virtual reality scene containing the target virtual image according to the scene data and object data, and outputs the target virtual reality scene to the user. Therefore, the solution of this application can generate the target virtual reality scene and target virtual image required by the user according to the user's needs. Furthermore, this application can acquire the user's movement movements monitored by a motion capture device during the user's target movement through the target virtual reality scene, and control the virtual reality device based on the acquired movement movements so that the target virtual image in the target virtual reality scene follows the user's movements. Thus, this application can generate the target virtual reality scene and target virtual image according to the user's needs, and the target virtual image can follow the user's movement during the user's target movement through the target virtual reality scene. Therefore, since both the target virtual reality scene and the following target virtual image are generated according to the user's needs, the user experiences a strong sense of familiarity with the scene during the movement, resulting in a higher sense of security and improving the user's exercise experience.

[0052] In addition, when users use exercise for physical and mental recovery, the familiarity of the scene they are immersed in during the exercise process makes them feel safer and consumes less attentional resources, which helps to improve the recovery effect.

[0053] The following description, in conjunction with the accompanying drawings, introduces a motion assistance method based on a virtual reality device provided in an embodiment of this application.

[0054] like Figure 1 As shown in the embodiments of this application, a motion assistance method based on a virtual reality device, applied to a motion assistance terminal, may include the following steps:

[0055] S101, acquire the first type of data and the second type of data uploaded by the user; wherein, the first type of data is a picture / video with a real scene content; the second type of data is used to describe the companion that the user expects when exercising.

[0056] Users can upload images or videos depicting real-world scenes to construct target virtual reality scenes corresponding to those scenes, according to their needs. For example, the real-world scene could be an underwater scene, a sky scene, a forest scene, a park scene, etc. To improve the accuracy of the constructed target virtual reality scene, the images can be multiple images of the real-world scene from multiple angles; the video can be a video including footage of the real-world scene from multiple angles. For example, when capturing images of the real-world scene, the photographer can take pictures from the photographer's center in four directions: east, south, west, and north. When capturing video, the video can be a video taken from the photographer's center, rotating 360° outwards for at least a specified duration, where the specified duration is set according to actual needs.

[0057] In this application, the virtual reality scene can also be referred to as a virtual simulation scene.

[0058] The second type of data, for example, can be unobstructed photos of the desired companion's front, left and right sides, and back, as well as body shape data such as height and weight. The desired companion can be a familiar person such as the user's relatives, friends, pets, or animals. The virtual image of the companion is generated with the consent or authorization of the rights holder of the companion. This application does not limit the specific data content of the second type of data; any specific content that can describe the companion to generate a virtual image of the companion can be used in this application.

[0059] The first and second types of data can be uploaded by users to the motion assist device using devices such as mobile phones and computers.

[0060] S102, the first type of data is analyzed to generate scene data for constructing the target virtual reality scene of the real scene.

[0061] If the first type of data is an image containing a real-world scene, the image can be analyzed in multiple dimensions. This analysis can include: performing object recognition on the image to obtain object data corresponding to the real-world scene, performing spatial structure analysis on the image to obtain spatial data corresponding to the real-world scene, and performing material structure analysis on the objects in the image to obtain material data of the objects in the real-world scene.

[0062] The object data is used to describe various objects in the real-world scene, such as vegetation, ground, rivers, etc. It is understood that the objects can include both dynamic and static objects. The real-world scene can specifically have multiple categories; for example, the category can be a natural scene, which can include objects related to nature such as plants, rivers, and mountains.

[0063] The spatial data is used to describe the spatial relationships between various objects in the real-world scene. For example, in a scene, tree A is located behind river B, and the spatial data can be used to describe that tree A is located behind river B in this scene.

[0064] The material data is used to describe the material of each object in the real-world scene. For example, the real-world scene includes a ground surface, and the material of the ground surface is grass.

[0065] Based on the object data, spatial data, and material data, scene data for the target virtual reality scene of the real-world scene can be constructed. Specifically, the object data, spatial data, and material data can be converted into scene data required by the virtual reality device to generate the virtual reality scene.

[0066] Furthermore, the multi-dimensional analysis may also include: performing illumination recognition on the image to obtain illumination data of the real-world scene. The illumination data is used to describe data such as illumination intensity, color temperature, and illumination direction of the real-world scene. Therefore, scene data for the target virtual reality scene of the real-world scene can be constructed based on the object data, spatial data, material data, and illumination data.

[0067] If the first type of data is a video containing realistic scene content, keyframes can be extracted from the video to obtain multiple frames. These multiple frames are then processed using the image processing method described above to obtain the scene data of the target virtual reality scene. The resolution of the extracted multiple frames can be adjusted to a preset resolution to facilitate subsequent analysis and processing.

[0068] S103, Based on the second type of data, generate object data for constructing the target virtual image of the companion object;

[0069] The second type of data may include photos of the companion, specifically, the photos may be photos of the companion's front, left and right sides, and back; and the second type of data may also include the companion's height, weight, and other body shape data.

[0070] The motion-assisting device can analyze the photo of the companion to obtain the companion's facial and body features. Based on these facial and body features, object data for the target virtual avatar of the companion can be constructed.

[0071] S104, control the virtual reality device to construct a target virtual reality scene containing the target virtual image according to the scene data and object data, and output the target virtual reality scene to the user;

[0072] The virtual reality device is typically a head-mounted virtual reality device. The scene data and object data are in a format that the virtual reality device can use directly, or a format that can be converted to a usable format. The virtual reality device can also be called an augmented reality head-mounted device, augmented reality device, etc.

[0073] If the motion assist terminal is not the virtual reality device or is not deployed on the virtual reality device, the motion assist terminal can send the constructed scene data and object data to the virtual reality device, and send control commands to the virtual reality device to control the virtual reality device to construct a target virtual reality scene containing the target virtual image according to the scene data and object data, and output the target virtual reality scene to the user.

[0074] If the motion assist terminal is the virtual reality device or is deployed on the virtual reality device, then after step S103, the steps of constructing a target virtual reality scene containing the target virtual image according to the scene data and object data, and outputting the target virtual reality scene to the user can be executed directly.

[0075] S105, during the process of the user performing target movement through the target virtual reality scene, the motion capture device acquires the user's motion movements, and based on the acquired motion movements, controls the virtual reality device to make the target virtual image in the target virtual reality scene follow the user's movements.

[0076] The motion capture device can be any device capable of motion capture. For example, the motion capture device can be an optical motion capture device, which achieves sub-meter level motion tracking through infrared markers and a multi-camera array; the motion capture device can also be an inertial motion capture device, which can be based on miniature inertial sensors, biomechanical models, and sensor fusion algorithms. It typically uses an inertial measurement unit (IMU) containing a combination of gyroscopes, magnetometers, and accelerometers to measure rotational speed and convert it into skeletal motion in software. This application does not limit the scope of the motion capture device.

[0077] After acquiring the user's motion movements monitored by the motion capture device, the motion assist device can use these movements to generate motion parameters for controlling the target virtual avatar's movements. This allows the target virtual avatar in the virtual reality scene to move according to the generated motion parameters, thus achieving motion tracking of the user. The motion parameters representing the actions of the target virtual avatar are the same as the acquired actions, and the data format of the motion parameters is a data format that the virtual reality device can directly use to control the target virtual avatar's movements.

[0078] The motion capture device can be connected to the device corresponding to the executing subject via wired or wireless communication. Wired connection can be achieved through a data cable. Wireless connection methods can include Wi-Fi (Wireless Local Area Network), Zigbee (a low-power local area network protocol), and Bluetooth, etc. This application does not limit the communication connection method between devices.

[0079] The solution of this application allows the motion-assisted terminal to analyze the first type of data to generate scene data for constructing the target virtual reality scene of the real-world scene, and based on the second type of data, to generate object data for constructing the target virtual image of the companion. It then controls the virtual reality device to construct the target virtual reality scene containing the target virtual image according to the scene data and object data, and outputs the target virtual reality scene to the user. Therefore, the solution of this application can generate the target virtual reality scene and target virtual image required by the user according to their needs. Furthermore, this application can acquire the user's movement movements monitored by the motion capture device during the user's target movement through the target virtual reality scene, and control the virtual reality device based on the acquired movement movements so that the target virtual image in the target virtual reality scene follows the user's movements. Thus, this application can generate the target virtual reality scene and target virtual image according to the user's needs, and can achieve target virtual image following the user's movement during the user's target movement through the target virtual reality scene. Therefore, since the target virtual reality scene and the target virtual image that follows the movement are generated according to the user's needs, the user has a strong sense of familiarity with the scene during the exercise, the user has a high sense of security, and it helps to improve the user's exercise effect.

[0080] Furthermore, when users use exercise for physical and mental recovery, the familiarity of the environment they experience during exercise provides them with a higher sense of security and less attentional resource consumption, which helps improve their recovery results.

[0081] Furthermore, individuals are better able to detach from stress in familiar environments, and the endorphins produced during exercise effectively help relieve stress. Additionally, when the brain recognizes familiar visual cues, it triggers the "self-reference processing" of the default mode network, releasing oxytocin and reducing amygdala activity. Therefore, recognizing familiar scenes can help lower stress hormone levels. Thus, the solution presented in this application can construct target virtual reality scenes and target virtual avatars according to user needs, improving the user's experience in augmented reality environments, thereby helping users reduce stress hormone levels and restore attention.

[0082] Optionally, before acquiring the user's motion movements monitored by the motion capture device during the user's target motion through the target virtual reality scene, the method further includes:

[0083] Determine the target movement that the user needs to perform.

[0084] In one implementation, a user can input the desired movement through a virtual reality device, thereby determining the target movement the user needs to perform.

[0085] In one implementation, before determining the target movement required by the user, the method further includes steps A1-A3;

[0086] Step A1: Obtain the user's physiological data monitored by the physiological data monitoring device and the user's facial expression data monitored by the facial expression monitoring device;

[0087] The physiological data monitoring device can be one or more devices, such as a physiological data monitoring bracelet, heart rate belt, etc., which can monitor the user's physiological data such as heart rate, body temperature, respiration, blood pressure, and skin conductance signals. The physiological data monitoring device can also be called a physiological signal monitoring device.

[0088] The facial expression monitoring device can be an image acquisition device such as a camera. This device can capture images of the user's face, analyze the user's facial expressions, and obtain facial expression data. Specifically, the facial expression data can be categorized by expression type, such as happy, sad, or angry, and the categorization of expression types can be set according to requirements.

[0089] The communication connection method between the physiological data monitoring device and the facial expression monitoring device and the device corresponding to the execution subject corresponds to the communication connection method between the motion capture device and the device corresponding to the execution subject, and will not be elaborated here.

[0090] Step A2: Based on the acquired physiological and facial expression data, assess the user's physical and mental stress to obtain first stress assessment information;

[0091] The first stress assessment information can be a stress value or a stress level. After acquiring physiological and facial expression data, the stress value can be obtained by weighting the values ​​of each physiological data point and the assessment values ​​of the facial expression data. The assessment values ​​of the facial expression data can be determined based on a pre-defined correspondence between facial expression types and assessment values. If the first stress assessment information is a stress level, the user's stress level can be determined based on the obtained stress value and the pre-defined correspondence between stress values ​​and stress levels.

[0092] Determining the target movement that the user needs to perform includes steps B1-B3;

[0093] Step B1: Based on the first stress assessment information, determine at least one candidate exercise to be recommended to the user;

[0094] When the first pressure assessment information is a pressure value, at least one exercise corresponding to the pressure value range where the first pressure assessment information is located can be determined based on the pre-set correspondence between each pressure value range and exercise, and used as at least one candidate exercise to recommend to the user.

[0095] When the first pressure assessment information is a pressure level, at least one exercise corresponding to the first pressure assessment information can be determined based on the pre-set correspondence between each pressure level and exercise, and recommended as at least one candidate exercise to the user.

[0096] Step B2: Through the virtual reality device, output the option of the at least one candidate motion to the user;

[0097] Specifically, information about at least one candidate sport to be recommended to the user can be sent to the virtual reality device, so that the virtual reality device can display the option of the at least one candidate sport through a corresponding display window.

[0098] Step B3: In response to the user issuing a selection command for an option using the virtual reality device, the candidate motion selected by the user is determined as the target motion to be performed by the user.

[0099] A user can operate the virtual reality device to select an option from the at least one candidate motion options output to the user. After the user issues a selection command for an option using the virtual reality device, the selected motion information can be sent to the execution entity so that the execution entity can determine the target motion that the user wants to perform.

[0100] Optionally, the method further includes:

[0101] During the process of the user performing target movement through the target virtual reality scene, it is determined whether the acquired movement is a standard movement of the target movement. If not, the user is given movement guidance through the virtual reality device.

[0102] The exercise guidance includes:

[0103] Control the virtual reality device to issue voice guidance on movement actions, and / or control the virtual reality device to display a virtual image for teaching standardized movements and conduct movement instruction in the target virtual reality scene.

[0104] The virtual avatar can be any avatar, such as a character, an anthropomorphic animal, etc.

[0105] During the process of the user performing target movement through the target virtual reality scene, the user's movements can be acquired in real time from the motion capture device, and it can be determined whether the acquired movement is a standard movement of the target movement based on the acquired user movements.

[0106] The step of determining whether the acquired user action is a standard action of the target movement can be achieved by calculating the degree of difference between the acquired user action and the standard action of the target movement. If the degree of difference is less than a preset threshold, the acquired action is determined to be a standard action of the target movement; otherwise, the acquired action is determined not to be a standard action of the target movement.

[0107] The solution in this embodiment can identify whether the user's movements are standardized. If the user's movements are found to be non-standard, the solution can guide the user to perform the movements correctly by displaying voice guidance and / or using a virtual image to teach the correct movements, thereby effectively improving the user's exercise results.

[0108] Optionally, the method further includes steps C1-C2;

[0109] Step C1: During the process of the user performing target movement through the target virtual reality scene, acquire the user's physiological data monitored by the physiological data monitoring device and the user's facial expression data monitored by the facial expression monitoring device.

[0110] Step C2: Based on the acquired physiological data, facial expression data, and the user's movement, assess the user's physical and mental stress during exercise to obtain second stress assessment information;

[0111] Step C3: If the physical and mental stress represented by the second stress assessment information belongs to a specified stress level, then control the virtual reality device to output relaxation instructions or exercise instructions corresponding to the specified stress level.

[0112] The second stress assessment information can be calculated as follows: After acquiring physiological data, facial expression data, and the user's movement actions, the values ​​of each physiological data point, the assessment value of the facial expression data, and the assessment value of the movement actions can be weighted and calculated to obtain the stress value. The calculation method for the assessment value of the facial expression data has been described in the above embodiments and will not be repeated here. The assessment value of the movement actions is determined based on the difference between the user's movement and the standard movement; the greater the difference between the user's movement and the standard movement, the greater the assessment value of the movement actions.

[0113] The relaxation instructions may include instructions on breathing rate, etc., and different relaxation instructions may correspond to different pressure levels.

[0114] For example, if the mental and physical stress represented by the second stress assessment information is at a high stress level, the virtual reality device can narrate relaxation instructions corresponding to the specified stress level to guide the target object to practice breathing relaxation and walking meditation.

[0115] If the mental and physical stress represented by the second stress assessment information is at a moderate level, the virtual reality device can determine at least one candidate exercise to be recommended to the user based on the mental and physical stress represented by the second stress assessment information; output the option of the at least one candidate exercise to the user through the virtual reality device; in response to the user issuing a selection instruction for an option using the virtual reality device, the candidate exercise selected by the user is determined as the target exercise to be performed by the user. This implementation method is similar to steps B1-B3 above, except that steps B1-B3 are performed before the user exercises, while this embodiment is performed during the user's exercise. That is, the solution of this application can re-determine an exercise that matches the user's current mental and physical stress and recommend it to the user during the user's exercise. Of course, the user can refuse to re-select an exercise and can continue to perform the target exercise selected in steps B1-B3 above.

[0116] The solution in this embodiment can provide relaxation instructions or exercise instructions to users based on their second stress assessment information, thereby improving the user's exercise experience.

[0117] Optionally, after controlling the virtual reality device to construct a target virtual reality scene containing the target virtual image according to the scene data and object data, and outputting the target virtual reality scene to the user, the method further includes steps D1-D2;

[0118] Step D1: Based on the odorous elements present in the target virtual reality scene, determine the initial parameter values ​​of the olfactory stimulation parameters of the olfactory stimulation device; and based on the scene type to which the target virtual reality scene belongs, determine the initial parameter values ​​of the tactile stimulation parameters of the tactile stimulation device; wherein, the olfactory stimulation parameters are parameters used to adjust the type and / or concentration of the odor emitted by the olfactory stimulation device, and the tactile stimulation parameters are parameters used to adjust the type and / or intensity of the tactile stimulation simulated by the tactile stimulation device;

[0119] The elements with scents can vary in different settings. For example, in a park setting, there might be roses, which are an element with a scent. Of course, multiple elements with scents can exist in the same setting.

[0120] For each element with an odor, an initial parameter value for the corresponding olfactory stimulation parameter is preset. Thus, after identifying the odorous elements in the target virtual reality scene, the initial parameter value of the olfactory stimulation parameter of the required olfactory stimulation device can be determined based on the initial parameter value of the olfactory stimulation parameter corresponding to the element.

[0121] In one implementation, the scene type can be divided into indoor and outdoor scenes. Outdoor scenes may correspond to tactile stimuli such as wind blowing, while indoor scenes do not have tactile stimuli such as wind blowing.

[0122] In one implementation, the scene type can be divided into specific scene types such as park type, seaside type, gym type, etc., and different scenes correspond to different tactile stimuli.

[0123] For example, when the type of tactile stimulation is wind, the intensity of the tactile stimulation may include: wind speed, wind volume, and temperature of the airflow. Furthermore, the tactile stimulation parameters may also include parameters describing the direction of the wind.

[0124] Step D2: Control the olfactory stimulation device to output odor according to the initial parameter values ​​of the olfactory stimulation parameters, and control the tactile stimulation device to output to a specified object according to the initial parameter values ​​of the tactile stimulation parameters, wherein the specified object is the object that generates tactile stimulation for the user.

[0125] In this application, both the olfactory stimulation device and the tactile stimulation device can utilize existing equipment. The tactile stimulation device outputs to a specific object, which means providing tactile stimulation to that object. Different types of tactile stimulation require different output methods from the tactile stimulation device; this application does not impose any limitations on this.

[0126] The solution in this embodiment can determine the initial parameter values ​​of the olfactory stimulation parameters of the olfactory stimulation device and the initial parameter values ​​of the tactile stimulation parameters of the tactile stimulation device corresponding to the target virtual reality scene, thereby effectively simulating the smell and tactile experience in the target virtual reality scene, so that users can feel a more realistic virtual reality experience.

[0127] Optionally, the method further includes:

[0128] During the process of the user performing target movement through the target virtual reality scene, based on the physiological data monitored by the physiological data monitoring device, the facial expression data monitored by the facial expression monitoring device, and the movement movements monitored by the motion capture device, the user's physical and mental stress during the movement is assessed to obtain third stress assessment information.

[0129] Based on the mapping relationship between pressure assessment information and olfactory stimulation intensity, and the third pressure assessment information, the parameter values ​​of the olfactory stimulation parameters are adjusted, and the olfactory stimulation device is controlled to output odors according to the adjusted parameter values ​​of the olfactory stimulation parameters; and / or, based on the mapping relationship between pressure assessment information and tactile stimulation intensity, and the third pressure assessment information, the parameter values ​​of the tactile stimulation parameters are adjusted, and the tactile stimulation device is controlled to output odors to a specified object according to the adjusted parameter values ​​of the tactile stimulation parameters.

[0130] Different people have varying sensitivities to olfactory and tactile stimuli, as well as different tolerances and subjective feelings regarding changes in stimulus intensity. For olfactory stimuli, most people experience varying degrees of comfort depending on the intensity; for example, a pleasant odor at a low intensity may bring comfort, while an excessively high intensity may cause discomfort. However, some individuals with lower olfactory sensitivity may have a weaker perception of changes in stimulus intensity within a certain range, and their subjective comfort may not fluctuate significantly. Similarly, for tactile stimuli, most people experience varying degrees of sensitivity to changes in intensity; some individuals, due to their tactile sensitivity, have a higher tolerance for changes in intensity within a certain range, and their subjective comfort may change only slightly.

[0131] For the user, their olfactory sensitivity and preferences can be pre-determined, thereby establishing a mapping relationship between stress assessment information and the intensity of olfactory stimulation: if the user is more comfortable when the stimulation is close to their preferred level within a reasonable intensity range, then the physical and mental stress represented by the stress assessment information and the intensity of olfactory stimulation can be positively correlated (the higher the stress, the more the stimulation needs to be adjusted to an intensity closer to their preference); if the user is more comfortable when the stimulation is slightly weaker within a reasonable intensity range, then the two can be negatively correlated, and the reasonable intensity range can be a preset range. Therefore, based on real-time stress assessment information and the mapping relationship between stress assessment information and the intensity of olfactory stimulation, olfactory stimulation parameters can be adjusted within a reasonable intensity range to improve user comfort.

[0132] Similarly, the user's tactile sensitivity and preferences can be predetermined to establish a mapping relationship between stress assessment information and the intensity of tactile stimulation. After pre-determining the user's tactile sensitivity and preferences, if they feel more comfortable with stimulation close to their preferred level within a reasonable range, then the stress assessment information and the intensity of tactile stimulation can be positively correlated; if they prefer gentler stimulation, then the two can be negatively correlated. This reasonable intensity range can be a preset range. Then, based on real-time stress assessment information and the mapping relationship between stress assessment information and the intensity of tactile stimulation, the tactile stimulation parameters can be adjusted within the reasonable intensity range to improve user comfort. Thus, based on the third stress assessment information, the parameter values ​​of the tactile stimulation parameters can be adjusted to make the user feel comfortable.

[0133] In this embodiment, adjusting the parameter values ​​of the olfactory stimulation parameters specifically involves adjusting the parameter values ​​of the parameters related to odor concentration within the olfactory stimulation parameters; adjusting the parameter values ​​of the tactile stimulation parameters specifically involves adjusting the parameter values ​​of the parameters related to the intensity of the tactile stimulation within the tactile stimulation parameters. The types of olfactory stimulation parameters and tactile stimulation parameters can maintain the types represented by the initial parameter values ​​described above.

[0134] Optionally, the method further includes:

[0135] During the process of the user performing target movement through the target virtual reality scene, physiological data of the user is acquired by a physiological data monitoring device, and facial expression data of the user is acquired by an facial expression monitoring device.

[0136] Based on the acquired physiological data, facial expression data, and the user's movement, the user's physical and mental stress during exercise is assessed to obtain fourth stress assessment information.

[0137] Based on the fourth stress assessment information, the playback volume and duration of the target music are adjusted and / or the brightness of the target virtual reality scene is adjusted.

[0138] Users can select songs to play in the target virtual reality scene as needed. The playback volume and duration of the songs, as well as the brightness of the target virtual reality scene, will affect the user's exercise experience. Therefore, the playback volume and duration of the target music and / or the brightness of the target virtual reality scene can be adjusted based on the fourth stress assessment information to improve the user's exercise experience.

[0139] It should be emphasized that the second, third, and fourth pressure assessment information can be the same information. Therefore, this information can be used to simultaneously control the virtual reality device to output relaxation instructions or exercise instructions corresponding to the specified pressure level, adjust the parameter values ​​of the olfactory stimulation parameters, and control the olfactory stimulation device to output odors according to the adjusted olfactory stimulation parameter values; and / or adjust the parameter values ​​of the tactile stimulation parameters and control the tactile stimulation device to output odors to a specified object according to the adjusted tactile stimulation parameter values.

[0140] Of course, the second pressure assessment information, the third pressure assessment information, and the fourth pressure assessment information may not be the same information.

[0141] The second, third, and fourth pressure assessment information can be generated in real time during the user's movement. To save computing resources, a generation period can be set for each of the second, third, and fourth pressure assessment information, and they can be generated periodically.

[0142] Optionally, if the target motion is performed using a designated motion device, the method further includes:

[0143] Based on the physiological data obtained from the physiological data monitoring device, the facial expression data obtained from the facial expression monitoring device, and the movement of the user detected by the motion capture device, the physical and mental stress of the user during exercise is assessed.

[0144] Based on the aforementioned physical and mental stress, adjust the exercise parameters of the designated exercise equipment.

[0145] The specified exercise equipment can be a treadmill, elliptical trainer, or smart dumbbells, or other exercise equipment that can adjust exercise parameters.

[0146] Each designated exercise device may have one or more preset exercise parameter adjustment strategies. The exercise parameter adjustment strategy is used to instruct, based on the correspondence between physical and mental stress and the exercise parameters of the designated exercise device, to adjust the exercise parameters of the designated exercise device to the exercise parameters corresponding to the physical and mental stress of the user during exercise.

[0147] The relationship between physical and mental stress and the exercise parameters of the specified exercise equipment is set differently to meet the different needs of users.

[0148] For example, when the target exercise is running on a treadmill, the exercise parameter can be running speed. If the user wants to maintain a comfortable experience during exercise, the relationship between physical and mental stress and the exercise parameters of the designated exercise equipment can be set as follows: running speed and physical and mental stress are negatively correlated; the higher the physical and mental stress, the slower the running speed. Therefore, the higher the user's physical and mental stress during exercise, the slower the treadmill speed should be adjusted to improve the user's comfort level. If the user wants to advance their exercise and break through fitness plateaus, the relationship between physical and mental stress and the exercise parameters of the designated exercise equipment can be set as follows: running speed and physical and mental stress are positively correlated; the higher the physical and mental stress, the higher the running speed. An upper limit threshold can be set for the running speed to help the user overcome fitness plateaus.

[0149] Before engaging in exercise, users can use the virtual reality device to select the appropriate exercise parameter adjustment strategy according to their needs.

[0150] As can be seen, the method of this embodiment can adjust the exercise parameters of the specified exercise equipment according to the user's needs and by taking advantage of the user's physical and mental stress during exercise.

[0151] Optionally, the method further includes:

[0152] If an abnormal message is received from any device, all devices will stop operating.

[0153] If any device malfunctions, it can send an error message to the motion assist device. Upon receiving the error message, the motion assist device can stop all devices from operating to ensure the user's safety. The devices in this embodiment can be one or more of the virtual reality devices, physiological data monitoring devices, facial expression monitoring devices, motion capture devices, tactile stimulation devices, olfactory stimulation devices, and motion devices described in the previous embodiments. For example, when any device malfunctions, the motion assist device can control the virtual reality device to stop presenting the target virtual reality scene and the target virtual image, control the olfactory stimulation device to stop releasing gas, and control the tactile stimulation device to stop tactile stimulation.

[0154] Furthermore, upon receiving abnormal information from any device, a warning signal can be output to remind administrators to check the system status.

[0155] The warning signal may include one or more of various signals such as sound signals, color signals, vibration signals, and text signals. This application does not specifically limit this.

[0156] Optionally, prior to S101, the method further includes:

[0157] The system receives the current time synchronization second pulse signal from the time synchronization device and sends the current time synchronization second pulse signal to each connected device, so that each device, upon receiving the current time synchronization second pulse signal, clears the count of its local high-speed clock oscillator and synchronizes its local clock.

[0158] To improve the time synchronization of various devices in the system, satellite signals transmitted by satellites can be used to synchronize the time of each device. This improves the timeliness of the acquired data.

[0159] For example, such as Figure 2 The diagram shown is a schematic representation of a time synchronization device used in an embodiment of this application. Figure 2 As shown, the specific implementation process of time synchronization using a time synchronization device involves the following modules: time synchronization device 210, Sky satellite constellation satellite 211, local satellite receiver 212, FPGA (Field Programmable Gate Array) chip 2101, local atomic clock 213, virtual reality device 214, fault diagnosis device 215, olfactory stimulation device 216, tactile stimulation device 217, physiological data monitoring device 218, motion capture device 219, physiological signal processing device 220, behavioral signal processing device 221, and information transmission device 222. Among them, the virtual reality device 214, fault diagnosis device 215, olfactory stimulation device 216, tactile stimulation device 217, physiological data monitoring device 218, motion capture device 219, physiological signal processing device 220, behavioral signal processing device 221, and information transmission device 222 all include a local atomic clock 213.

[0160] The aforementioned management equipment may include the physiological signal processing device 220, the behavioral signal processing device 221, and the information transmission device 222.

[0161] The local satellite receiver 212 decodes the original message transmitted by the satellites 211 of the Sky Satellite Constellation to obtain the B-code message. It then outputs the obtained B-code, i.e., IRIG-B code (Inter-Range Instrumentation Group B Code, a serial time code standard widely used in time synchronization), to the FPGA chip 2101 in the time synchronization device 210. The FPGA chip 2101 can then parse the B-code message to obtain the current time synchronization second pulse information. The time synchronization second pulse signal is then sent to the virtual reality device 214, fault diagnosis device 215, olfactory stimulation device 216, tactile stimulation device 217, physiological data monitoring device 218, motion capture device 219, physiological signal processing device 220, behavioral signal processing device 221, and information transmission device 222.

[0162] In this way, after receiving the aforementioned current time synchronization second pulse information, the virtual reality device 214, fault diagnosis device 215, olfactory stimulation device 216, tactile stimulation device 217, physiological data monitoring device 218, motion capture device 219, physiological signal processing device 220, behavioral signal processing device 221, and information transmission device 222 can clear the count of the local high-speed clock oscillator in the local atomic clock 213, synchronize the local clock, and thus complete the time synchronization of the various devices in the system. The local atomic clock can be a high-precision atomic clock.

[0163] The virtual reality device 214 is the aforementioned virtual reality device. The fault diagnosis device 215 is used to diagnose whether any device is malfunctioning. The olfactory stimulation device 216 corresponds to the olfactory stimulation device in the aforementioned embodiment. The tactile stimulation device 217 corresponds to the tactile stimulation device in the aforementioned embodiment. The physiological data monitoring device 218 corresponds to the physiological data monitoring device in the aforementioned embodiment. The motion capture device 219 corresponds to the motion capture device in the aforementioned embodiment. The physiological signal processing device, behavioral signal processing device 221, and information transmission device 222 correspond to the devices corresponding to the motion assist terminal in the aforementioned embodiment, i.e., the devices deployed as motion assist terminals or the devices serving as motion assist terminals. A motion assist method based on a virtual reality device in this application may involve one or more of the aforementioned devices.

[0164] Optionally, the method further includes: generating an exercise report for the exercise in response to an exercise termination command; wherein the exercise report includes: changes in the target user's physiological data and changes in stress parameters during the exercise.

[0165] After a user completes an exercise, an exercise report can be generated, which can support the user's subsequent exercise plans.

[0166] The following describes the motion assistance method based on a virtual reality device according to a specific embodiment. In this embodiment, the management device corresponds to the aforementioned motion assistance terminal. Figure 3 As shown, the method includes:

[0167] S301, Obtain scene information uploaded by the target object; wherein, the scene information is selected or uploaded by the target object itself, and the scene information includes: scene information in the scene library or images or videos of scenes uploaded by the target object; wherein, the images include four images taken from the photographer in the four directions of east, south, west, and north, and the video includes a video of no less than 12 seconds taken from the photographer in a 360° rotation around the photographer;

[0168] When the brain recognizes familiar visual cues through virtual reality devices, it triggers "self-reference processing" in the default mode network, releasing oxytocin and reducing amygdala activity. If augmented reality systems can recreate familiar scenes for users, they can help reduce stress hormone levels.

[0169] Augmented reality systems can also be called motion-assisted systems.

[0170] Optionally, in one specific implementation, step S301 above may include the following steps:

[0171] It acquires or receives scene information uploaded by the target object, processes the scene information, and obtains the desired visual information about the target object.

[0172] In this specific implementation, after the target object uploads the scene information, the scene information can be sent to the management device. After the management device obtains the scene uploaded by the target object, it can process the scene information to generate a scene model that the target object expects.

[0173] Obtaining scene information uploaded by the target object can refer to the executing entity actively acquiring scene information, while receiving scene information uploaded by the target object can refer to the executing entity passively receiving scene information.

[0174] S302, Obtain the family and friends information uploaded by the target object; wherein, the family and friends information is uploaded by the target object itself, and the family and friends information includes: unobstructed photos of the family and friends from the front, left and right sides, and back, as well as body shape data such as height and weight;

[0175] When the brain recognizes familiar features through virtual reality devices, it triggers "self-reference processing" in the default mode network, releasing oxytocin and reducing amygdala activity. If augmented reality systems can recreate familiar figures, they can help reduce stress levels.

[0176] Optionally, in one specific implementation, step S302 above may include the following steps:

[0177] The system acquires or receives information about relatives and friends uploaded by the target object, processes the information, and obtains the desired visual information about the target object.

[0178] In this specific implementation, after the target object uploads the information of its relatives and friends, the information can be sent to the management device. After the management device obtains the information of the relatives and friends uploaded by the target object, it can process the information to generate a person model of the target object.

[0179] Obtaining information about relatives and friends uploaded by the target can refer to the executing entity actively acquiring such information, while receiving such information can refer to the executing entity passively receiving it.

[0180] S301-S302 correspond to S101-S103 mentioned above.

[0181] S303: Obtain the music information selected by the target object and send the music information to the management device.

[0182] S304: The management device receives the scene information selected by the user or the scene information uploaded to generate a target scene model.

[0183] S305: The management device receives information about relatives and friends uploaded by the user and generates a target virtual image model.

[0184] S306: Control the virtual reality device to output the target music, target scene, and target virtual image to the target object.

[0185] Once the management device identifies the target music, target scene, and target virtual avatar, it can send control commands to the virtual reality device. Upon receiving these control commands, the virtual reality device can output the target music, target scene, and target virtual avatar to the target object.

[0186] Optionally, after determining the target music, target scene, and target virtual avatar, the management device can send a control command carrying the corresponding serial number of the target music, target scene, and target virtual avatar to the virtual reality device. Upon receiving the control command, the virtual reality device can then output the target music, target scene, and target virtual avatar corresponding to the aforementioned serial number to the target object.

[0187] S303-S306 correspond to S104 mentioned above.

[0188] S307: Determine the olfactory stimulus parameters corresponding to the target scene as the target olfactory stimulus parameters.

[0189] Among them, the olfactory stimulation parameters include the type of odor of the target stimulus gas.

[0190] Once the target scenario is determined, the management device can identify the type of gas corresponding to that scenario, and then determine the olfactory stimulation parameters corresponding to those gas types as the target stimulation parameters.

[0191] S308: Determine the tactile stimulation parameters corresponding to the target scene as the target tactile stimulation parameters.

[0192] The tactile stimulation parameters include the wind speed, air volume, temperature, and direction of the target airflow tactile stimulation.

[0193] Once the target scene is determined, the management equipment can determine the airflow speed, air volume, temperature, and direction corresponding to the target scene, and thus determine the tactile stimulation parameters corresponding to the airflow as the target tactile stimulation parameters.

[0194] S309: Send a gas release command carrying olfactory stimulation parameters to the olfactory stimulation device, so that the olfactory stimulation device responds to the command and releases the target stimulating gas under the olfactory stimulation parameters.

[0195] After determining the target olfactory stimulation parameters, the management device can send a gas release command carrying the aforementioned olfactory stimulation parameters to the olfactory stimulation device in the augmented reality system. Upon receiving the gas release command, the olfactory stimulation device can respond by releasing the target stimulation gas according to the aforementioned olfactory stimulation parameters.

[0196] S310: Send an airflow release command carrying tactile stimulation parameters to the tactile stimulation device, so that the tactile stimulation device responds to the command and releases the target stimulation airflow under the tactile stimulation parameters.

[0197] After determining the target tactile stimulation parameters, the management device can send an airflow release command carrying the aforementioned tactile stimulation parameters to the tactile stimulation device in the augmented reality system. Upon receiving the airflow release command, the tactile stimulation device can respond by releasing the target stimulation airflow under the aforementioned tactile stimulation parameters.

[0198] S307-S310 correspond to steps D1-D2 in the above embodiments.

[0199] S311: Controls physiological data monitoring equipment to acquire physiological signals; controls motion capture equipment to acquire behavioral signals.

[0200] S312: The augmented reality system acquires physiological signals and behavioral signals, and the management device receives the physiological signals and behavioral signals to generate stress parameters.

[0201] S313: After the management device generates pressure parameters, it compares them with the preset graded pressure standard values ​​and sends a command to the virtual reality device, causing the virtual reality device to respond to the command and read the command.

[0202] For example, if the pressure parameters generated by the management device are in the high range of the preset graded pressure standard value, the virtual reality device responds to the instruction by uttering relaxation instructions to guide the target object to practice breathing relaxation and walking meditation; if the pressure parameters generated by the management device are in the medium range of the preset graded pressure standard value, the virtual reality device responds to the instruction by uttering exercise instructions to recommend a moderate-intensity type of exercise to the target object and provides action guidance based on the behavioral signals.

[0203] S311-S313 correspond to steps C1-C3 above.

[0204] S314: After the management device generates pressure parameters, it compares them with the preset graded pressure standard values ​​and sends a companion command to the virtual reality device, so that the virtual image presented by the virtual reality device responds to the command and moves in accompaniment, following and imitating the action of the target object to generate and output the virtual image action to the target object.

[0205] S314 corresponds to S105 mentioned above.

[0206] S315: The augmented reality system integrates the physiological and behavioral data of the target object, sends a printing command to the printer, and the printer responds to the command to print the training report of the target object.

[0207] S315 corresponds to the step described above that generates a motion report for the current motion in response to the motion end command.

[0208] By applying the solution provided in the embodiments of this application, the physiological and behavioral information of the target object can be used to control the virtual reality device to respond to commands, issue corresponding instructions, and provide corresponding virtual companionship, thereby increasing familiarity and movement in the augmented scene; control the olfactory stimulation device to release the target stimulation gas corresponding to the target scene to increase olfactory stimulation in the virtual scene; control the tactile stimulation device to release the target stimulation airflow corresponding to the target scene to increase tactile stimulation in the virtual scene, thereby increasing multimodal stimulation in the augmented scene.

[0209] like Figure 4 As shown, the motion assistance method based on a virtual reality device in this application may involve a management device 410, a virtual reality device 420, an olfactory stimulation device 430, a tactile stimulation device 440, a physiological data monitoring device 450, and a motion capture device 460. The virtual reality device 420, olfactory stimulation device 430, tactile stimulation device 440, physiological data monitoring device 450, and motion capture device 460 all communicate with the management device 410. The virtual reality device 420 corresponds to the virtual reality device in the above embodiment, and the physiological data monitoring device 450 corresponds to the physiological data detection device described above.

[0210] When the motion assist device is hardware, the management device 410 is the motion assist device; when the motion assist device is software, the management device 410 is the hardware device on which the motion assist device is deployed.

[0211] Figure 5 This is a schematic diagram illustrating the signaling interaction process of the motion assistance method of this application implemented in the aforementioned management equipment, virtual reality equipment, tactile stimulation equipment, olfactory stimulation equipment, physiological data monitoring equipment, and motion capture equipment. Figure 5 The present application provides a detailed description of a motion assistance method provided in its embodiments.

[0212] like Figure 5 As shown, the interaction process of the management device, virtual reality device, olfactory stimulation device, tactile stimulation device, physiological data monitoring device, and motion capture device in the virtual reality system may include the following steps S501-S524.

[0213] S501: The virtual reality device receives the target music information selected by the target object and the uploaded scene and family and friends information;

[0214] S502: The virtual reality device sends the scene and information about family and friends to the management device;

[0215] S501-S502 correspond to S101-S103 mentioned above.

[0216] S503: The management device generates the scene model and family / friends model information expected by the target object;

[0217] S504: The management device sends music information, target scene model information, and target family and friends model information to the virtual reality device;

[0218] S505: Receives music information, target scene model information, and target family and friends model information sent by the management device;

[0219] S506: Virtual reality devices output music, target scenes, and target relatives and friends to the target audience;

[0220] S503-S506 correspond to S104 above.

[0221] S507: Physiological data monitoring equipment acquires physiological signals from the target object;

[0222] S508: The physiological data monitoring device sends physiological signals to the management device;

[0223] S509: Motion capture devices acquire behavioral signals of target objects;

[0224] S510: The motion capture device sends behavioral signals to the management device;

[0225] S511: The management device receives physiological and behavioral signals;

[0226] S512: The management device acquires physiological and behavioral signals to determine physiological and behavioral information;

[0227] S513: Pressure parameters determined by management devices based on physiological and behavioral information;

[0228] S514: The management device transmits pressure parameters to the virtual reality device;

[0229] S515: Virtual reality devices receive pressure parameters and behavioral information sent by management devices;

[0230] S516: Virtual reality devices adjust the output of target auditory and visual stimuli based on pressure parameters and behavioral information;

[0231] S517: Virtual reality devices send information about target visual stimuli to management devices;

[0232] S518: The management device receives visual stimulus information sent by the virtual reality device;

[0233] S519: The management device acquires olfactory and tactile stimulus information based on visual stimulus information;

[0234] S520: The management device determines olfactory stimulation parameters and tactile stimulation parameters based on olfactory stimulation information and tactile stimulation information;

[0235] S521: The management device sends a gas release command carrying olfactory stimulation parameters to the olfactory stimulation device;

[0236] S522: The olfactory stimulation device receives a gas release command from the management device and releases the target gas in response to the command;

[0237] S523: The management device sends an airflow release command carrying tactile stimulation parameters to the tactile stimulation device;

[0238] S524: The tactile stimulation device receives an airflow release command from the management device and releases the target airflow in response to the command.

[0239] S507-S524 correspond to D1-D2 mentioned above.

[0240] Based on this, by applying the solution provided in the embodiments of this application, the physiological and behavioral information of the target object can be used to control the virtual reality device to respond to commands, issue corresponding instructions, and have the virtual image provide corresponding companionship, thereby increasing familiarity and movement in the augmented scene; control the olfactory stimulation device to release the target stimulation gas corresponding to the target scene to increase olfactory stimulation in the virtual scene; control the tactile stimulation device to release the target stimulation airflow corresponding to the target scene to increase tactile stimulation in the virtual scene, thereby increasing multimodal stimulation in the augmented scene.

[0241] This application also provides a motion assistance system based on a virtual reality device, such as Figure 6 As shown, the system includes:

[0242] The motion assist terminal 601 is used to acquire a first type of data and a second type of data uploaded by the user; analyze the first type of data to generate scene data for constructing a target virtual reality scene of the real scene; based on the second type of data, generate object data for constructing a target virtual image of a companion; and send a first control command to the virtual reality device; wherein, the first type of data is an image / video with real scene content; the second type of data is used to describe the companion desired when the user is exercising; and the first control command carries the scene data and the object data.

[0243] Virtual reality device 602 is configured to respond to a first control command, construct a target virtual reality scene containing the target virtual image according to the scene data and object data, and output the target virtual reality scene to the user;

[0244] The motion capture device 603 is used to monitor the user's motion movements during the process of the user performing target movements through the target virtual reality scene;

[0245] The motion assist terminal 601 is also used to acquire the user's motion actions monitored by the motion capture device; and to generate a second control command based on the acquired motion actions and send it to the virtual reality device.

[0246] The virtual reality device 602 is also configured to respond to a second control command to cause the target virtual image in the target virtual reality scene to follow the user's movements.

[0247] Optionally, the motion assist terminal is further configured to determine the target motion that the user needs to perform before acquiring the user's motion movements monitored by the motion capture device;

[0248] The motion assist terminal is also used to determine whether the acquired motion action is a standard motion of the target motion during the process of the user performing target motion through the target virtual reality scene; if not, the user is guided to perform motion actions by controlling the virtual reality device.

[0249] The exercise guidance includes:

[0250] Control the virtual reality device to issue voice guidance on movement actions, and / or control the virtual reality device to display a virtual image for teaching standardized movements and conduct movement instruction in the target virtual reality scene.

[0251] Optionally, the system may further include: physiological data monitoring equipment and facial expression monitoring equipment;

[0252] The physiological data monitoring device is used to monitor the user's physiological data;

[0253] The facial expression monitoring device is used to monitor the user's facial expression data;

[0254] The motion assist terminal is also used to acquire the user's physiological data monitored by the physiological data monitoring device and the user's facial expression data monitored by the facial expression monitoring device before determining the target exercise that the user needs to perform; based on the acquired physiological data and facial expression data, assess the user's physical and mental stress to obtain first stress assessment information;

[0255] Determining the target movement that the user needs to perform includes:

[0256] Based on the first stress assessment information, at least one candidate sport to be recommended to the user is determined;

[0257] The virtual reality device outputs the option of at least one candidate motion to the user.

[0258] In response to the user issuing a selection command for an option using the virtual reality device, the candidate motion selected by the user is determined as the target motion to be performed by the user.

[0259] Optionally, the motion assist terminal is further configured to acquire, during the process of the user performing target motion through the target virtual reality scene, the user's physiological data monitored by the physiological data monitoring device and the user's facial expression data monitored by the facial expression monitoring device;

[0260] Based on the acquired physiological data, facial expression data, and the user's movement, the user's physical and mental stress during exercise is assessed to obtain second stress assessment information. If the physical and mental stress represented by the second stress assessment information belongs to a specified stress level, a third control command is sent to the virtual reality device. And / or, if the target exercise is performed using a specified exercise device, based on the physiological data monitored by the acquired physiological data monitoring device, the user's facial expression data monitored by the facial expression monitoring device, and the user's movement detected by the motion capture device, the user's physical and mental stress during exercise is assessed. Based on the physical and mental stress, an adjustment command is sent to the specified exercise device.

[0261] The virtual reality device is also configured to respond to a third control command to control the virtual reality device to output relaxation instructions or exercise instructions corresponding to the specified pressure level;

[0262] The designated motion device is used to adjust motion parameters in response to the adjustment command.

[0263] Optionally, the system may further include an olfactory stimulation device and a tactile stimulation device;

[0264] The motion assist terminal is further configured to, after controlling the virtual reality device to construct a target virtual reality scene containing the target virtual image according to the scene data and object data, and output the target virtual reality scene to the user, determine the initial parameter values ​​of the olfactory stimulation parameters of the olfactory stimulation device based on the odor-containing elements present in the target virtual reality scene and send them to the olfactory stimulation device; and determine the initial parameter values ​​of the tactile stimulation parameters of the tactile stimulation device based on the scene type to which the target virtual reality scene belongs and send them to the tactile stimulation device; wherein, the olfactory stimulation parameters are parameters used to adjust the type and / or concentration of the odor emitted by the olfactory stimulation device, and the tactile stimulation parameters are parameters used to adjust the type and / or intensity of the tactile stimulation simulated by the tactile stimulation device;

[0265] The olfactory stimulation device is used to output odors according to the initial parameter values ​​of the olfactory stimulation parameters;

[0266] The tactile stimulation device is used to output to a specified object according to the initial parameter values ​​of the tactile stimulation parameters, wherein the specified object is the object that generates tactile stimulation for the user.

[0267] Optionally, the motion assist terminal is further configured to, during the process of the user performing target motion through the target virtual reality scene, assess the user's physical and mental stress during the motion process based on the physiological data monitored by the acquired physiological data monitoring device, the user's facial expression data monitored by the facial expression monitoring device, and the user's motion movements monitored by the motion capture device, to obtain third stress assessment information; adjust the parameter values ​​of the olfactory stimulation parameters based on the mapping relationship between the stress assessment information and the degree of olfactory stimulation and the third stress assessment information, and send the adjusted parameter values ​​of the olfactory stimulation parameters to the olfactory stimulation device; and / or, adjust the parameter values ​​of the tactile stimulation parameters based on the mapping relationship between the stress assessment information and the degree of tactile stimulation and the third stress assessment information, and send the adjusted parameter values ​​of the tactile stimulation parameters to the tactile stimulation device;

[0268] The olfactory stimulation device is also used to output odors according to the parameter values ​​of the adjusted olfactory stimulation parameters;

[0269] The tactile stimulation device is also used to output to a specified object according to the parameter values ​​of the adjusted tactile stimulation parameters.

[0270] In this application, the motion assistance system based on virtual reality equipment may include at least a motion assistance terminal, a virtual reality equipment, and a motion capture device, and may also include one or more of the following: a physiological data monitoring device, an expression monitoring device, a designated motion device, an olfactory stimulation device, and a tactile stimulation device.

[0271] This application also provides a motion assist device based on a virtual reality device, the device being applied to a motion assist end, such as... Figure 7 As shown, the device includes:

[0272] The first acquisition module 701 is used to acquire a first type of data and a second type of data uploaded by the user; wherein, the first type of data is a picture / video with a real scene content; the second type of data is used to describe the companion that the user expects when exercising;

[0273] Analysis module 702 is used to analyze the first type of data to generate scene data for constructing the target virtual reality scene of the real scene;

[0274] The generation module 703 is used to generate object data for constructing the target virtual image of the companion object based on the second type of data;

[0275] The construction module 704 is used to control the virtual reality device to construct a target virtual reality scene containing the target virtual image according to the scene data and object data, and output the target virtual reality scene to the user;

[0276] The first control module 705 is used to acquire the user's motion movements monitored by the motion capture device during the user's target motion movement through the target virtual reality scene, and control the virtual reality device to make the target virtual image in the target virtual reality scene follow the user's movements based on the acquired motion movements.

[0277] Optionally, the device further includes:

[0278] The determination module is used to determine the target movement that the user needs to perform before acquiring the user's movement movements monitored by the motion capture device during the process of the user performing target movement through the target virtual reality scene;

[0279] The device further includes:

[0280] The guidance module is used to determine whether the acquired movement is a standard movement of the target movement during the process of the user performing target movement through the target virtual reality scene; if not, the module provides movement guidance to the user through the virtual reality device.

[0281] The exercise guidance includes:

[0282] Control the virtual reality device to issue voice guidance on movement actions, and / or control the virtual reality device to display a virtual image for teaching standardized movements and conduct movement instruction in the target virtual reality scene.

[0283] Optionally, the device further includes:

[0284] The second acquisition module is used to acquire the physiological data of the user monitored by the physiological data monitoring device and the facial expression data of the user monitored by the facial expression monitoring device before determining the target movement to be performed by the user.

[0285] The first assessment module is used to assess the user's physical and mental stress based on the acquired physiological and facial expression data, and obtain first stress assessment information.

[0286] The first determining module includes:

[0287] The first determining unit is configured to determine at least one candidate exercise to be recommended to the user based on the first stress assessment information.

[0288] An output unit is configured to output the option of the at least one candidate motion to the user via the virtual reality device;

[0289] The second determining unit is configured to, in response to the user issuing a selection instruction for an option using a virtual reality device, determine the candidate motion selected by the user as the target motion to be performed by the user.

[0290] Optionally, the device further includes:

[0291] The third acquisition module is used to acquire the physiological data of the user monitored by the physiological data monitoring device and the facial expression data of the user monitored by the facial expression monitoring device during the process of the user performing target movement through the target virtual reality scene.

[0292] The second assessment module is used to assess the user's physical and mental stress during exercise based on the acquired physiological data, facial expression data, and the user's movement, and to obtain second stress assessment information.

[0293] The second control module is used to control the virtual reality device to output relaxation instructions or exercise instructions corresponding to the specified stress level if the physical and mental stress represented by the second stress assessment information belongs to a specified stress level.

[0294] Optionally, the device further includes:

[0295] The second determining module is used to control the virtual reality device to construct a target virtual reality scene containing the target virtual image according to the scene data and object data, and output the target virtual reality scene to the user. Then, based on the odor-containing elements present in the target virtual reality scene, it determines the initial parameter values ​​of the olfactory stimulation parameters of the olfactory stimulation device, and based on the scene type to which the target virtual reality scene belongs, it determines the initial parameter values ​​of the tactile stimulation parameters of the tactile stimulation device. The olfactory stimulation parameters are parameters used to adjust the type and / or concentration of the odor emitted by the olfactory stimulation device, and the tactile stimulation parameters are parameters used to adjust the type and / or intensity of the tactile stimulation simulated by the tactile stimulation device.

[0296] The third control module is used to control the olfactory stimulation device to output odors according to the initial parameter values ​​of the olfactory stimulation parameters, and to control the tactile stimulation device to output to a specified object according to the initial parameter values ​​of the tactile stimulation parameters, wherein the specified object is an object that generates tactile stimulation for the user.

[0297] Optionally, the device further includes:

[0298] The third evaluation module is used to evaluate the user's physical and mental stress during the exercise process based on the physiological data monitored by the physiological data monitoring device, the facial expression data monitored by the facial expression monitoring device, and the user's movement movements monitored by the motion capture device, and to obtain third stress evaluation information.

[0299] The first adjustment module is used to adjust the parameter values ​​of the olfactory stimulation parameters based on the mapping relationship between pressure assessment information and olfactory stimulation intensity and the third pressure assessment information, and control the olfactory stimulation device to output odors according to the adjusted parameter values ​​of the olfactory stimulation parameters; and / or, based on the mapping relationship between pressure assessment information and tactile stimulation intensity and the third pressure assessment information, adjust the parameter values ​​of the tactile stimulation parameters, and control the tactile stimulation device to output odors to a specified object according to the adjusted parameter values ​​of the tactile stimulation parameters.

[0300] Optionally, if the target motion is performed using a designated motion device, the device further includes:

[0301] The fourth evaluation module is used to evaluate the user's physical and mental stress during exercise based on the physiological data monitored by the physiological data monitoring device, the facial expression data monitored by the facial expression monitoring device, and the user's movement movements monitored by the motion capture device.

[0302] The second adjustment module is used to adjust the exercise parameters of the specified exercise device based on the physical and mental stress.

[0303] This invention also provides an electronic device, such as... Figure 8 As shown, it includes a processor 801, a communication interface 802, a memory 803, and a communication bus 804, wherein the processor 801, the communication interface 802, and the memory 803 communicate with each other through the communication bus 804.

[0304] Memory 803 is used to store computer programs;

[0305] The processor 801, when executing the program stored in the memory 803, implements any of the motion assistance methods described above.

[0306] The communication bus mentioned in the above electronic devices can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. This communication bus can be divided into address bus, data bus, control bus, etc. For ease of illustration, only one thick line is used to represent it in the diagram, but this does not mean that there is only one bus or one type of bus.

[0307] The communication interface is used for communication between the aforementioned electronic devices and other devices.

[0308] The memory may include random access memory (RAM) or non-volatile memory (NVM), such as at least one disk storage device. Optionally, the memory may also be at least one storage device located remotely from the aforementioned processor.

[0309] The processors mentioned above can be general-purpose processors, including central processing units (CPUs), network processors (NPs), etc.; they can also be digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.

[0310] In another embodiment of the present invention, a computer-readable storage medium is also provided, which stores a computer program that, when executed by a processor, implements the steps of any of the above-described motion assistance methods.

[0311] In another embodiment of the present invention, a computer program product containing instructions is also provided, which, when run on a computer, causes the computer to perform any of the motion assistance methods described in the above embodiments.

[0312] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present invention are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid state disk (SSD)).

[0313] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0314] The various embodiments in this specification are described in a related manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on its differences from other embodiments. In particular, the system embodiments are basically similar to the method embodiments, so the description is relatively simple; relevant parts can be referred to the descriptions in the method embodiments. The above descriptions are merely preferred embodiments of the present invention and are not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention are included within the scope of protection of the present invention.

Claims

1. A motion-assisted method based on a virtual reality device, characterized in that, Applied to a motion-assisted device, the method includes: Acquire a first type of data and a second type of data uploaded by the user; wherein, the first type of data is a picture / video with a real scene content; the second type of data is used to describe the companion that the user expects when exercising; The first type of data is analyzed to generate scene data for constructing the target virtual reality scene of the real-world scene; Based on the second type of data, object data is generated for constructing the target virtual image of the companion object; Control the virtual reality device to construct a target virtual reality scene containing the target virtual image according to the scene data and object data, and output the target virtual reality scene to the user; During the process of the user performing target movement through the target virtual reality scene, the motion capture device acquires the user's motion movements. Based on the acquired motion movements, the virtual reality device is controlled so that the target virtual image in the target virtual reality scene follows the user's movements. Based on the odorous elements present in the target virtual reality scene, the initial parameter values ​​of the olfactory stimulation parameters of the olfactory stimulation device are determined, and based on the scene type to which the target virtual reality scene belongs, the initial parameter values ​​of the tactile stimulation parameters of the tactile stimulation device are determined; wherein, the olfactory stimulation parameters are parameters used to adjust the type and / or concentration of the odor emitted by the olfactory stimulation device, and the tactile stimulation parameters are parameters used to adjust the type and / or intensity of the tactile stimulation simulated by the tactile stimulation device; The olfactory stimulation device is controlled to output odors according to the initial parameter values ​​of the olfactory stimulation parameters, and the tactile stimulation device is controlled to output odors to a specified object according to the initial parameter values ​​of the tactile stimulation parameters, wherein the specified object is an object that generates tactile stimulation for the user. During the process of the user performing target movement through the target virtual reality scene, based on the physiological data monitored by the physiological data monitoring device, the facial expression data monitored by the facial expression monitoring device, and the movement movements monitored by the motion capture device, the user's physical and mental stress during the movement is assessed to obtain third stress assessment information. Based on the mapping relationship between pressure assessment information and olfactory stimulation intensity, and the third pressure assessment information, the parameter values ​​of the olfactory stimulation parameters are adjusted, and the olfactory stimulation device is controlled to output odors according to the adjusted parameter values ​​of the olfactory stimulation parameters; and / or, based on the mapping relationship between pressure assessment information and tactile stimulation intensity, and the third pressure assessment information, the parameter values ​​of the tactile stimulation parameters are adjusted, and the tactile stimulation device is controlled to output odors to a specified object according to the adjusted parameter values ​​of the tactile stimulation parameters.

2. The method according to claim 1, characterized in that, Before acquiring the user's motion movements detected by the motion capture device during the user's target motion through the target virtual reality scene, the method further includes: Determine the target movement that the user needs to perform; The method further includes: During the process of the user performing target movement through the target virtual reality scene, it is determined whether the acquired movement is a standard movement of the target movement. If not, the user is given movement guidance through the virtual reality device. The exercise guidance includes: Control the virtual reality device to issue voice guidance on movement actions, and / or control the virtual reality device to display a virtual image for teaching standardized movements and conduct movement instruction in the target virtual reality scene.

3. The method according to claim 2, characterized in that, Before determining the target movement that the user needs to perform, the method further includes: The physiological data of the user obtained by the physiological data monitoring device and the facial expression data of the user obtained by the facial expression monitoring device are acquired. Based on the acquired physiological and facial expression data, the user's physical and mental stress is assessed to obtain first stress assessment information; Determining the target movement that the user needs to perform includes: Based on the first stress assessment information, at least one candidate sport to be recommended to the user is determined; The virtual reality device outputs the option of at least one candidate motion to the user. In response to the user issuing a selection command for an option using the virtual reality device, the candidate motion selected by the user is determined as the target motion to be performed by the user.

4. The method according to claim 1 or 2, characterized in that, The method further includes: During the process of the user performing target movement through the target virtual reality scene, physiological data of the user is acquired by a physiological data monitoring device, and facial expression data of the user is acquired by an facial expression monitoring device. Based on the acquired physiological data, facial expression data, and the user's movement, the user's physical and mental stress during exercise is assessed to obtain second stress assessment information. If the physical and mental stress represented by the second stress assessment information belongs to a specified stress level, the virtual reality device is controlled to output relaxation instructions or exercise instructions corresponding to the specified stress level. And / or, if the target exercise is performed using a specified exercise device, the user's physical and mental stress during exercise is assessed based on the physiological data monitored by the acquired physiological data monitoring device, the facial expression data monitored by the facial expression monitoring device, and the user's movement detected by the motion capture device. Based on the physical and mental stress, the exercise parameters of the specified exercise device are adjusted.

5. A motion assist device based on a virtual reality device, characterized in that, The device, used in motion assistive devices, includes: The first acquisition module is used to acquire a first type of data and a second type of data uploaded by the user; wherein, the first type of data is a picture / video with a real scene content; the second type of data is used to describe the companion that the user expects when exercising; An analysis module is used to analyze the first type of data to generate scene data for constructing the target virtual reality scene of the real scene; The generation module is used to generate object data for constructing the target virtual image of the companion object based on the second type of data; A construction module is used to control the virtual reality device to construct a target virtual reality scene containing the target virtual image according to the scene data and object data, and output the target virtual reality scene to the user; The first control module is used to acquire the user's motion movements monitored by the motion capture device during the user's target motion movement through the target virtual reality scene, and control the virtual reality device to make the target virtual image in the target virtual reality scene follow the user's movements based on the acquired motion movements; The second determining module is used to control the virtual reality device to construct a target virtual reality scene containing the target virtual image according to the scene data and object data, and output the target virtual reality scene to the user. Then, based on the odor-containing elements present in the target virtual reality scene, it determines the initial parameter values ​​of the olfactory stimulation parameters of the olfactory stimulation device, and based on the scene type to which the target virtual reality scene belongs, it determines the initial parameter values ​​of the tactile stimulation parameters of the tactile stimulation device. The olfactory stimulation parameters are parameters used to adjust the type and / or concentration of the odor emitted by the olfactory stimulation device, and the tactile stimulation parameters are parameters used to adjust the type and / or intensity of the tactile stimulation simulated by the tactile stimulation device. The third control module is used to control the olfactory stimulation device to output odor according to the initial parameter values ​​of the olfactory stimulation parameters, and to control the tactile stimulation device to output to a specified object according to the initial parameter values ​​of the tactile stimulation parameters, wherein the specified object is an object that generates tactile stimulation for the user. The third evaluation module is used to evaluate the user's physical and mental stress during the exercise process based on the physiological data monitored by the physiological data monitoring device, the facial expression data monitored by the facial expression monitoring device, and the user's movement movements monitored by the motion capture device, and to obtain third stress evaluation information. The first adjustment module is used to adjust the parameter values ​​of the olfactory stimulation parameters based on the mapping relationship between pressure assessment information and olfactory stimulation intensity and the third pressure assessment information, and control the olfactory stimulation device to output odors according to the adjusted parameter values ​​of the olfactory stimulation parameters; and / or, based on the mapping relationship between pressure assessment information and tactile stimulation intensity and the third pressure assessment information, adjust the parameter values ​​of the tactile stimulation parameters, and control the tactile stimulation device to output odors to a specified object according to the adjusted parameter values ​​of the tactile stimulation parameters.

6. A motion assistance system based on a virtual reality device, characterized in that, The system includes: The motion assist device is used to acquire a first type of data and a second type of data uploaded by the user; analyze the first type of data to generate scene data for constructing a target virtual reality scene of the real scene; based on the second type of data, generate object data for constructing a target virtual image of a companion; and send a first control command to the virtual reality device; wherein, the first type of data is an image / video with real scene content; the second type of data is used to describe the desired companion when the user is exercising; and the first control command carries the scene data and the object data. A virtual reality device, configured to respond to a first control command, construct a target virtual reality scene containing the target virtual image according to the scene data and object data, and output the target virtual reality scene to the user; A motion capture device is used to monitor the user's motion movements during the process of the user performing target movements through the target virtual reality scene; The motion assist terminal is also used to acquire the user's motion movements detected by the motion capture device; based on the acquired motion movements, it generates a second control command and sends it to the virtual reality device; The virtual reality device is also configured to respond to a second control command to cause the target virtual image in the target virtual reality scene to follow the user's movements. The motion assist terminal is further configured to, after controlling the virtual reality device to construct a target virtual reality scene containing the target virtual image according to the scene data and object data, and output the target virtual reality scene to the user, determine the initial parameter values ​​of the olfactory stimulation parameters of the olfactory stimulation device based on the odor-containing elements present in the target virtual reality scene and send them to the olfactory stimulation device; and determine the initial parameter values ​​of the tactile stimulation parameters of the tactile stimulation device based on the scene type to which the target virtual reality scene belongs and send them to the tactile stimulation device; wherein, the olfactory stimulation parameters are parameters used to adjust the type and / or concentration of the odor emitted by the olfactory stimulation device, and the tactile stimulation parameters are parameters used to adjust the type and / or intensity of the tactile stimulation simulated by the tactile stimulation device; The olfactory stimulation device is used to output odors according to the initial parameter values ​​of the olfactory stimulation parameters; The tactile stimulation device is used to output to a specified object according to the initial parameter values ​​of the tactile stimulation parameters, wherein the specified object is the object that generates tactile stimulation for the user; The motion assist terminal is further configured to, during the process of the user performing target motion through the target virtual reality scene, assess the user's physical and mental stress during the motion process based on the physiological data monitored by the acquired physiological data monitoring device, the user's facial expression data monitored by the facial expression monitoring device, and the user's motion movements monitored by the motion capture device, and obtain third stress assessment information; adjust the parameter values ​​of the olfactory stimulation parameters based on the mapping relationship between the stress assessment information and the degree of olfactory stimulation and the third stress assessment information, and send the adjusted parameter values ​​of the olfactory stimulation parameters to the olfactory stimulation device; and / or, adjust the parameter values ​​of the tactile stimulation parameters based on the mapping relationship between the stress assessment information and the degree of tactile stimulation and the third stress assessment information, and send the adjusted parameter values ​​of the tactile stimulation parameters to the tactile stimulation device; The olfactory stimulation device is also used to output odors according to the parameter values ​​of the adjusted olfactory stimulation parameters; The tactile stimulation device is also used to output to a specified object according to the parameter values ​​of the adjusted tactile stimulation parameters.

7. The system according to claim 6, characterized in that, The motion assist terminal is also used to determine the target motion that the user needs to perform before acquiring the user's motion motion monitored by the motion capture device; The motion assist terminal is also used to determine whether the acquired motion action is a standard motion of the target motion during the process of the user performing target motion through the target virtual reality scene; if not, the user is guided to perform motion actions by controlling the virtual reality device. The exercise guidance includes: Control the virtual reality device to issue voice guidance on movement actions, and / or control the virtual reality device to display a virtual image for teaching standardized movements and conduct movement instruction in the target virtual reality scene.

8. The system according to claim 7, characterized in that, The system also includes: physiological data monitoring equipment and facial expression monitoring equipment; The physiological data monitoring device is used to monitor the user's physiological data; The facial expression monitoring device is used to monitor the user's facial expression data; The motion assist terminal is also used to acquire the user's physiological data monitored by the physiological data monitoring device and the user's facial expression data monitored by the facial expression monitoring device before determining the target exercise that the user needs to perform; based on the acquired physiological data and facial expression data, assess the user's physical and mental stress to obtain first stress assessment information; Determining the target movement that the user needs to perform includes: Based on the first stress assessment information, at least one candidate sport to be recommended to the user is determined; The virtual reality device outputs the option of at least one candidate motion to the user. In response to the user issuing a selection command for an option using the virtual reality device, the candidate motion selected by the user is determined as the target motion to be performed by the user.

9. The system according to claim 6, characterized in that, The motion assist terminal is also used to acquire the user's physiological data monitored by the physiological data monitoring device and the user's facial expression data monitored by the facial expression monitoring device during the process of the user performing target motion through the target virtual reality scene; Based on the acquired physiological data, facial expression data, and the user's movement, the user's physical and mental stress during exercise is assessed to obtain second stress assessment information. If the physical and mental stress represented by the second stress assessment information belongs to a specified stress level, a third control command is sent to the virtual reality device. And / or, if the target exercise is performed using a specified exercise device, based on the physiological data monitored by the acquired physiological data monitoring device, the user's facial expression data monitored by the facial expression monitoring device, and the user's movement detected by the motion capture device, the user's physical and mental stress during exercise is assessed. Based on the physical and mental stress, an adjustment command is sent to the specified exercise device. The virtual reality device is also configured to respond to a third control command to control the virtual reality device to output relaxation instructions or exercise instructions corresponding to the specified pressure level; The designated motion device is used to adjust motion parameters in response to the adjustment command.

10. An electronic device, characterized in that, It includes a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus; Memory, used to store computer programs; A processor, when executing a program stored in memory, implements the method described in any one of claims 1-4.

11. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the method described in any one of claims 1-4.

Images