A virtual combat training apparatus and method

Abstract

The application provides a virtual combat training device, and relates to the technical field of interactive devices, and comprises a bionic training robot, a motion data capturing system and a virtual combat analysis system; the bionic training robot is used for recognizing the actions and instructions of a training personnel, controlling the mechanical structure to make corresponding actions according to the recognition result, and performing simulated voice interaction, and is also used for controlling the mechanical structure to make corresponding accompanying training actions according to a user setting mode; the motion data capturing system is used for capturing the posture and physiological change information of the training personnel; the virtual combat analysis system is used for simulating the combat training process and scene, and analyzing and displaying the combat training data according to the posture and physiological change information of the training personnel in different training states; accordingly, a virtual combat training method is also disclosed; the application can perform combat training on the training personnel by the method assisted by the bionic training robot and the user somatosensory data capturing and VR device.

Description

Technical Field

[0001] This invention relates to the field of interactive device technology, and in particular to a virtual combat training device and method. Background Technology

[0002] Real-life combat training is costly and poses significant safety risks. Simple training dummy and punching bags can only provide basic strength and movement training, failing to enable trainees to quickly master combat skills and receive systematic training to address their weaknesses. While existing training robots can assist training according to user-defined parameters, they cannot accurately acquire training data during the process for analysis and movement guidance, nor can they intelligently recognize trainees' movements or provide safety alerts.

[0003] In conclusion, overcoming the aforementioned shortcomings is a problem that urgently needs to be solved by those skilled in the art. Summary of the Invention

[0004] This solution addresses the problems and needs mentioned above by proposing a virtual combat training device and method, which solves the aforementioned technical problems by adopting the following technical solutions.

[0005] To achieve the above objectives, the present invention provides the following technical solution: a virtual combat training device, comprising: a bionic training robot, a motion data capture system, and a virtual combat analysis system;

[0006] The bionic training robot is used to recognize the actions and instructions of trainees, control the mechanical structure to make corresponding actions based on the recognition results, and conduct simulated voice interaction. It is also used to control the mechanical structure to make corresponding training actions according to the user's settings.

[0007] Both the bionic training robot and the motion data capture system are connected to the virtual combat analysis system via wireless communication. The motion data capture system is used to capture the posture and physiological changes of the trainees.

[0008] The virtual combat analysis system is used to simulate the combat training process and scenarios, and to analyze and display combat training data based on the posture and physiological changes of trainees under different training states.

[0009] Furthermore, the bionic training robot includes a main body and robotic arms movably connected to both sides of the main body. Each robotic arm consists of a robotic upper arm and a robotic forearm. Both ends of the robotic upper arm are slidably connected to universal ball joints. The bottoms of the two universal ball joints are connected to the main body through shoulder joints and to the robotic forearm through elbow joints, respectively.

[0010] Furthermore, the bionic training robot also includes an intelligent control module mounted on the main body, the intelligent control module including a motion control module and a controller module;

[0011] The motion control module includes a first motion module, a second motion module, and two sets of pressure sensor modules. The first motion module is located at the shoulder joint, and the second motion module is located at the elbow joint. The first motion module includes a hydraulic cylinder for driving the shoulder and elbow joints to rotate in multiple degrees of freedom, and a first solenoid valve. The first solenoid valve is electrically connected to the hydraulic cylinder and is electrically connected to the controller module through a drive circuit. Both sets of pressure sensor modules are electrically connected to the controller module and are respectively located on the surfaces of the two robotic arms. The two sets of pressure sensor modules are used to acquire training force and effective attack data. The second motion module has the same structure as the first motion module.

[0012] The controller module is used to output control signals to the motion control module based on the simulated combat attack parameters and the trainee's voice and motion recognition results, and to receive feedback signals from the motion control module. The controller module includes a controller, a memory, and a wireless communication module.

[0013] Furthermore, the intelligent control module also includes a voice interaction module and an image recognition module;

[0014] The voice interaction module includes a voice player, a voice synthesizer, a microphone, and an audio recognition module. The voice synthesizer is electrically connected to the controller. The voice synthesizer receives voice control signals from the controller to control the voice player to play preset voice information. The microphone is used to acquire the voice command information of the trainee and transmit the voice command information to the audio recognition module. The audio recognition module filters and performs voice recognition on the voice command information and sends the voice recognition result to the controller.

[0015] The image recognition module includes a camera and an image recognizer. The camera is used to acquire image data of the trainee. The image recognizer is connected to the camera. The image recognizer extracts dynamic posture feature data of the trainee based on the acquired image data using a posture recognition algorithm. The dynamic posture feature data is compared with dynamic posture feature data in the dangerous action database to determine the danger level. The determination result is sent to the controller. When the danger level exceeds the safety threshold, the controller controls the action control module to stop its action and sends an alarm signal to the virtual combat analysis system.

[0016] Furthermore, the motion data capture system is worn by the trainee and includes a protective helmet module and a combat glove module;

[0017] The protective helmet module includes a first posture sensor group, a VR eye conduction device, and a Bluetooth module. The first posture sensor group is used to collect the user's current head posture information and transmit the user's current head posture information to the virtual combat analysis system through the Bluetooth module. The VR eye conduction device is used to receive virtual scene information.

[0018] The combat glove module includes a temperature measurement module, a heart rate measurement module, a vibration alert module, a second posture sensor group, and a microcontroller module. The temperature measurement module, heart rate measurement module, vibration alert module, and second posture sensor group are all electrically connected to the microcontroller module. The temperature measurement module collects information on changes in the trainee's body temperature; the heart rate measurement module collects information on changes in the trainee's heart rate; the vibration alert module records training duration and provides a vibration alert via the vibration sensor after a preset training time; and the second posture sensor group collects the user's current hand posture information and transmits this information to the virtual combat analysis system via the microcontroller module.

[0019] Furthermore, the virtual combat analysis system includes a virtual combat simulation module, a parameter analysis module, and a display module;

[0020] The virtual combat simulation module includes a virtual scene editing module, which is used to edit and manage the camera position points, field of view distance, dynamic elements and environment in the virtual space, and transmit the scene data to the VR eye conduction device.

[0021] The parameter analysis module includes a first analysis module and a second analysis module. The first analysis module is used to receive pressure sensing information uploaded by the controller module and analyze the pressure sensing information to obtain training intensity and effective attack data. It is also used to receive training parameters selected by the user and send the training parameter information to the controller module, which controls the bionic training robot to perform action and image recognition, as well as voice interaction. The second analysis module is used to analyze the posture and physiological changes of the trainee under different training states to obtain a data analysis report of the current training stage of the combat trainee.

[0022] The display module is used to visualize the simulation training process data and data analysis reports.

[0023] Furthermore, the virtual combat analysis system also includes a data storage module and a training report module; the data storage module is used to store interactive data information uploaded and fed back by the bionic training robot and the motion data capture system; the training report module is connected to the parameter analysis module, and the training report module is used to generate a combat training report based on the parameter analysis results of the trainees and the duration of this training.

[0024] A virtual combat training method, based on the aforementioned virtual combat training device, specifically includes:

[0025] Users select training parameters, and the training mode is matched according to the training parameters. The matching information is then sent to the bionic training robot and the VR eye conduction device worn by the trainee.

[0026] During training, the bionic training robot recognizes the trainee's actions and instructions, controls the mechanical structure to perform corresponding actions based on the recognition results, conducts simulated voice interaction, and controls the mechanical structure to perform corresponding training actions according to the user's settings.

[0027] The system captures the trainees' posture and physiological changes through a motion data capture system and sends the information to the virtual combat analysis system.

[0028] The virtual combat analysis system simulates the combat training process and scenarios, and analyzes and displays combat training data based on the posture and physiological changes of trainees under different training states.

[0029] As can be seen from the above technical solution, the beneficial effects of this invention are: This invention can conduct combat training for trainees through a bionic training robot, user motion data capture, and VR device assistance, achieving training effects comparable to real-person combat while reducing training costs. Furthermore, it can accurately acquire the trainee's movement range and force, and by virtually editing the combat scene and simulating combat parameters, analyze the trainee's combat training deficiencies, facilitating targeted training and rapidly improving the trainee's combat skills.

[0030] In addition to the objectives, features, and advantages described above, the preferred embodiments of the invention will be described in more detail below with reference to the accompanying drawings, so as to facilitate a better understanding of the features and advantages of the invention. Attached Figure Description

[0031] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the accompanying drawings used in the description of the embodiments of the present invention or the prior art will be briefly introduced below. The accompanying drawings are only used to illustrate some embodiments of the present invention, and are not intended to limit all embodiments of the present invention to this.

[0032] Figure 1 This is a schematic diagram of the composition of a virtual combat training device according to the present invention.

[0033] Figure 2 This is a schematic diagram of the composition of the intelligent control module in this invention.

[0034] Figure 3 This is a schematic diagram of the composition of the motion data capture system in this invention.

[0035] Figure 4 This is a schematic diagram of the composition of the virtual combat analysis system in this invention.

[0036] Figure 5 This is a schematic diagram illustrating the specific steps of a virtual combat training method according to the present invention. Detailed Implementation

[0037] To make the objectives, technical solutions, and advantages of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. The same reference numerals in the drawings represent the same components. It should be noted that the described embodiments are only some, not all, of the embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the described embodiments of the present invention without creative effort are within the scope of protection of the present invention.

[0038] like Figures 1 to 4 As shown, the present invention provides a virtual combat training device. The device includes: a biomimetic training robot, a motion data capture system, and a virtual combat analysis system.

[0039] The bionic training robot is used to recognize the trainee's actions and instructions, control the mechanical structure to perform corresponding actions based on the recognition results, and conduct simulated voice interaction. It is also used to control the mechanical structure to perform corresponding training actions according to the user's settings.

[0040] Specifically, the bionic training robot includes a main body and robotic arms movably connected to both sides of the main body. Each robotic arm consists of a robotic upper arm and a robotic forearm. Both ends of the robotic upper arm are slidably connected to universal ball joints. The bottoms of the two universal ball joints are connected to the main body through shoulder joints and to the robotic forearm through elbow joints, respectively.

[0041] The biomimetic training robot also includes an intelligent control module mounted on the main body. The intelligent control module includes a motion control module and a controller module. The motion control module includes a first motion module, a second motion module, and two sets of pressure sensor modules. The first motion module is located at the shoulder joint, and the second motion module is located at the elbow joint. The first motion module includes a hydraulic cylinder for driving the shoulder and elbow joints to rotate in multiple degrees of freedom, and a first solenoid valve. The first solenoid valve is electrically connected to the hydraulic cylinder and electrically connected to the controller module via a drive circuit. Both sets of pressure sensor modules are electrically connected to the controller module and are respectively mounted on the surfaces of the two robotic arms. The two sets of pressure sensor modules are used to acquire training force and effective attack data. The second motion module has the same structure as the first motion module. The controller module outputs control signals to the motion control module based on simulated combat attack parameters and the trainee's voice and motion recognition results, and receives feedback signals from the motion control module. The controller module includes a controller, a memory, and a wireless communication module. The control module also includes a voice interaction module and an image recognition module. The voice interaction module includes a voice player, a voice synthesizer, a microphone, and an audio recognition module. The voice synthesizer is electrically connected to the controller and receives voice control signals from the controller to control the voice player to play preset voice information. The microphone is used to acquire the trainee's voice command information and transmit it to the audio recognition module. The audio recognition module filters and performs voice recognition on the voice command information and sends the voice recognition result to the controller. The image recognition module includes a camera and an image recognizer. The camera is used to acquire image data of the trainee, and the image recognizer is connected to the camera. The image recognizer uses a posture recognition algorithm to extract dynamic posture feature data of the trainee from the acquired image data, compares the dynamic posture feature data with dynamic posture feature data in the dangerous action database, determines the danger level, and sends the determination result to the controller. When the danger level exceeds the safety threshold, the controller controls the action control module to stop its action and sends an alarm signal to the virtual combat analysis system.

[0042] In this embodiment, the bionic training robot can provide action coaching based on the parameter information and matching mode selected by the user. It can also provide interactive actions such as encouragement and health reminders to trainees based on preset voice information; the voice content, tone, and timbre can be adjusted according to individual preferences. Furthermore, an image recognition module can identify the trainee's posture during training to prevent safety accidents.

[0043] Both the bionic training robot and the motion data capture system are connected to the virtual combat analysis system via wireless communication. The motion data capture system is used to capture the posture and physiological changes of the trainees.

[0044] The motion data capture system is worn by the trainee and includes a protective helmet module and a combat glove module. The protective helmet module includes a first posture sensor group, a VR eye conduction device, and a Bluetooth module. The first posture sensor group is used to collect the user's current head posture information and transmit it to the virtual combat analysis system via the Bluetooth module. The VR eye conduction device is used to receive virtual scene information. The combat glove module includes a temperature measurement module, a heart rate measurement module, a vibration alert module, a second posture sensor group, and a microcontroller module. The temperature measurement module, the heart rate measurement module, the vibration alert module, and the second posture sensor group are all electrically connected to the microcontroller module. The temperature measurement module is used to collect the trainee's body temperature change information, the heart rate measurement module is used to collect the trainee's heart rate change information, the vibration alert module is used to record training time and provide a vibration alert via a vibration sensor after the training reaches a preset time, and the second posture sensor group is used to collect the user's current hand posture information and transmit it to the virtual combat analysis system via the microcontroller module.

[0045] In this embodiment, two sets of posture sensors collect real-time information on changes in the user's head and hand postures. This information is then sent to a virtual combat analysis system to analyze the user's posture trajectory, movement amplitude, and intensity at different moments, providing targeted guidance for areas needing improvement. Simultaneously, the training duration is recorded and controlled to achieve scientific training objectives.

[0046] The virtual combat analysis system is used to simulate the combat training process and scenarios, and to analyze and display combat training data based on the posture and physiological changes of trainees under different training states.

[0047] The virtual combat analysis system includes a virtual combat simulation module, a parameter analysis module, and a display module. The virtual combat simulation module includes a virtual scene editing module, which manages and edits the camera position, field of view, dynamic elements, and environment in the virtual space, and transmits the scene data to the VR eye-conduction device. The parameter analysis module includes a first analysis module and a second analysis module. The first analysis module receives pressure sensing information uploaded by the controller module and analyzes the pressure sensing information to obtain training intensity and effective attack data. It also receives training parameters selected by the user and sends the training parameter information to the controller module, which controls the bionic training robot to perform motion and image recognition, as well as voice interaction. The second analysis module analyzes the posture and physiological changes of the trainee under different training states to obtain a data analysis report of the current training stage. The display module visualizes the simulation training process data and data analysis report. The virtual combat analysis system also includes a data storage module and a training report module; the data storage module is used to store interactive data information uploaded and fed back by the bionic training robot and the motion data capture system; the training report module is connected to the parameter analysis module, and the training report module is used to generate a combat training report based on the parameter analysis results of the trainees and the duration of this training.

[0048] like Figure 5 As shown, this application also discloses a virtual combat training method, which conducts combat training based on the aforementioned virtual combat training device, specifically including:

[0049] Step A: The user selects training parameters, matches the training mode according to the training parameters, and sends the matching information to the bionic training robot and the VR eye conduction device worn by the trainee;

[0050] Step B: During training, the bionic training robot recognizes the trainee's actions and instructions, controls the mechanical structure to perform corresponding actions based on the recognition results, conducts simulated voice interaction, and controls the mechanical structure to perform corresponding training actions according to the user's settings.

[0051] Step C: Capture the trainee's posture and physiological changes using a motion data capture system, and send the information to the virtual combat analysis system;

[0052] Step D: The virtual combat analysis system simulates the combat training process and scenario, and analyzes and displays the combat training data based on the posture and physiological changes of trainees under different training states.

[0053] It should be noted that the embodiments described in this invention are merely preferred ways of implementing this invention. Any modifications that are merely obvious and belong to the overall concept of this invention should be within the protection scope of this invention.

Claims

1. A virtual combat training apparatus, characterized by, The application relates to a bionic training robot, a motion data capturing system and a virtual combat analysis system. The bionic training robot is used for recognizing the actions and instructions of a training personnel, controlling a mechanical structure to make corresponding actions according to the recognition result, and carrying out simulated voice interaction, and is also used for controlling the mechanical structure to make corresponding accompanying training actions according to a user setting mode. The bionic training robot and the motion data capturing system are connected with the virtual combat analysis system through wireless communication. The virtual combat analysis system is used for simulating a combat training process and scene, and virtually analyzing and displaying combat training data according to the posture and physiological change information of the training personnel under different training states. The bionic training robot comprises a main trunk body and mechanical arms movably connected to the two sides of the main trunk body, each mechanical arm is composed of a mechanical upper arm and a mechanical forearm, universal ball heads are slidably connected to the two ends of the mechanical upper arm, the bottoms of the two universal ball heads are connected with the main trunk body through a shoulder joint and connected with the mechanical forearm through an elbow joint. The bionic training robot further comprises an intelligent control module arranged on the main trunk body, the intelligent control module comprises an action control module and a controller module. The action control module comprises a first action module, a second action module and two groups of pressure sensor modules, the first action module is arranged at the shoulder joint, the second action module is arranged at the elbow joint, the first action module comprises a hydraulic cylinder for driving the shoulder joint and the elbow joint to rotate in multiple degrees of freedom, a first electromagnetic valve, the first electromagnetic valve is electrically connected with the hydraulic cylinder, the first electromagnetic valve is electrically connected with the controller module through a driving circuit, the two groups of pressure sensor modules are electrically connected with the controller module, the two groups of pressure sensor modules are arranged on the surfaces of the two mechanical arms respectively, the two groups of pressure sensor modules are used for acquiring training strength and effective attack data, the second action module is identical in structure with the first action module. The controller module is used for outputting a control signal to the action control module and receiving a feedback signal of the action control module according to simulated combat attack parameters and voice and action recognition results of the training personnel, and the controller module comprises a controller, a memory and a wireless communication module. The intelligent control module further comprises a voice interaction module and an image recognition module. The voice interaction module comprises a voice player, a voice synthesizer, a sound pickup microphone and an audio recognition module, the voice synthesizer is electrically connected with the controller, the voice synthesizer receives a voice control signal sent by the controller to control the voice player to play preset voice information, the sound pickup microphone is used for acquiring voice instruction information of the training personnel and transmitting the voice instruction information to the audio recognition module, the audio recognition module carries out filtering processing and voice recognition on the voice instruction information and sends a voice recognition result to the controller. ​ The image recognition module comprises a camera and an image recognizer, the camera is used to acquire image data of the trainer, the image recognizer is connected with the camera, the image recognizer extracts dynamic posture feature data of the trainer according to the acquired image data based on a posture recognition algorithm, compares the dynamic posture feature data with dynamic posture feature data in a dangerous action database, judges a dangerous level, and sends a judgment result to the controller, when the dangerous level exceeds a safety threshold, the controller controls the action control module to stop action, and sends an alarm signal to the virtual combat analysis system.

2. The virtual combat training device of claim 1, wherein, The motion data capture system is worn on the trainer, and the motion data capture system comprises a protective helmet module and a combat glove module. The protective helmet module comprises a first posture sensor group, a VR eye conduction device and a Bluetooth module, the first posture sensor group is used to acquire current head posture information of the user, and the current head posture information of the user is transmitted to the virtual combat analysis system through the Bluetooth module, and the VR eye conduction device is used to receive virtual scene information. The combat glove module comprises a temperature measurement module, a heart rate measurement module, a vibration reminding module, a second posture sensor group and a micro control module, the temperature measurement module, the heart rate measurement module, the vibration reminding module and the second posture sensor group are electrically connected with the micro control module, the temperature measurement module is used to acquire body temperature change information of the trainer, the heart rate measurement module is used to acquire heart rate change information of the trainer, the vibration reminding module is used to record training time, and vibration reminding is performed through a vibration sensor when the training reaches a preset time, and the second posture sensor group is used to acquire current hand posture information of the user, and the current hand posture information of the user is transmitted to the virtual combat analysis system through the micro control module.

3. The virtual sparring training apparatus of claim 2, wherein, The virtual combat analysis system comprises a virtual combat simulation module, a parameter analysis module and a display module. The virtual combat simulation module comprises a virtual scene editing module, the virtual scene editing module is used to edit and manage camera position points, field of view distance, dynamic elements and environment of a virtual space, and scene data is transmitted to the VR eye conduction device; The parameter analysis module comprises a first analysis module and a second analysis module, the first analysis module is used to receive pressure sensing information uploaded by the controller module, analyze the pressure sensing information to obtain training intensity and effective attack data, receive training parameters selected by the user, and send training parameter information to the controller module, so that the controller module controls the bionic training robot to perform action and image recognition, and voice interaction, and the second analysis module is used to analyze posture and physiological change information of the trainer in different training states to obtain a data analysis report of a current training stage of the training combat trainer; The display module is used to visually display simulation training process data and data analysis reports.

4. The virtual combat training device of claim 3, wherein, The virtual combat analysis system further comprises a data storage module and a training report module; the data storage module is used for storing interactive data information uploaded and fed back by the bionic training robot and the motion data capturing system; the training report module is connected with the parameter analysis module, and the training report module is used for generating a combat training report according to the parameter analysis result of the training personnel and the training duration.

5. A method of virtual combat training, using the virtual combat training device according to any one of claims 1 to 4, wherein Specifically, the method comprises the following steps: A user selects training parameters, matches a training mode according to the training parameters, and sends matching information to the bionic training robot and a VR eye conduction device worn by the training personnel; During training, the bionic training robot recognizes the action and instruction of the training personnel, controls the mechanical structure to make corresponding actions according to the recognition result, carries out simulated voice interaction, and controls the mechanical structure to make corresponding sparring actions according to the user setting mode; The motion data capturing system captures the posture and physiological change information of the training personnel, and sends the change information to the virtual combat analysis system; The virtual combat analysis system simulates the combat training process and scene, and analyzes and displays the combat training data according to the posture and physiological change information of the training personnel in different training states.

Images