A simulation training system based on motion capture

By using image acquisition, data monitoring and image processing units in the simulation training system, the delays and errors in the simulation training process are monitored and adjusted in real time, the problem of low monitoring accuracy in the existing technology is solved, and the accuracy of system response is improved Sex and stability.

CN118540247BActive Publication Date: 2024-11-29BEIJING KINGVCN CENTURY TECH
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202410727421.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-06-06
Publication Date
2024-11-29
Estimated Expiration
2044-06-06

AI Technical Summary

Technical Problem

The existing simulation training system based on motion capture has low monitoring accuracy during operation, resulting in insufficient accuracy of system response.

Method used

By calculating the average delay time, the proportion of the number of image slip marks and the proportion of sensor reading errors in the image information transmission process, real-time monitoring and secondary judgment are carried out to correct the delay time and The packet byte amount is used to ensure the normal operation of the simulation training system.

Benefits of technology

The response accuracy and monitoring accuracy of the simulation training system are improved to ensure that the system is adjusted and calibrated in real time when it does not meet the standards.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118540247B_ABST
    Figure CN118540247B_ABST
Patent Text Reader

Abstract

The present invention relates to the field of simulation training technology, and in particular to a simulation training system based on motion capture, comprising an image acquisition unit for acquiring image data of a training object; a data monitoring unit for collecting information transmission parameter data in real time during the simulation training process; an image processing unit for processing the image data acquired by the image acquisition unit; and a simulation control unit for determining the reason why the operation process of the simulation training system does not meet the standards based on the average delay duration of the image information transmission process, or making a secondary determination based on the proportion of the number of images with image slip marks and the proportion of the number of sensors with reading errors, and correcting a first preset delay duration or compressing a data packet when the reason is that the byte amount of the transmitted data packet does not meet the standards. The present invention improves the monitoring accuracy of the operation process of the simulation training system and improves the accuracy of the system response obtained through motion capture training.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of simulation training, and in particular to a simulation training system based on motion capture. Background Art

[0002] The simulation training system based on motion capture is a highly interactive educational environment that combines computer graphics, virtual reality technology and motion capture technology. With the rapid development of sensor technology, computer graphics technology, virtual reality technology and motion capture technology, these technologies provide strong technical support for the simulation training system. Motion capture technology can track the movement of human body or objects in real time and map it into the virtual world. VR and AR technology can create a highly realistic virtual environment for users to conduct simulation training. At the same time, combined with motion capture technology, the user's movements can be captured in real time and mapped into the virtual environment, achieving a more natural and realistic interactive experience.

[0003] Chinese patent application publication number: CN116663228A discloses a virtual simulation space multi-person collaborative training sharing platform, including a virtual simulation collaborative training system, the virtual simulation collaborative training system includes a PC terminal and a system part, the system part includes a large space positioning system and a multi-person collaborative training system, the large space positioning system includes a transmitting end part and a receiving end part, and the multi-person collaborative training system includes an output part, an input part and a full-body motion capture system. The invention uses multiple positioning points to locate multiple VR head-mounted display devices, which can place multiple sets of VR devices in the same virtual space and expand the user's range of activities. Each person wears a set of VR equipment with their own perspectives, so that multiple people can work together in the same space to complete the operation training work. Each participant can see the real-time synchronized virtual image at hand, and have unimpeded voice communication and operation collaboration, thereby realizing joint communication training in a multi-person remote collaborative mode.

[0004] It can be seen that the virtual simulation space multi-person collaborative training sharing platform has the following problems: although the virtual simulation space multi-person collaborative training sharing platform can enable multiple people to collaborate with each other in the same space to complete operational training work, the monitoring accuracy of the platform system's operation process is low and the smooth operation of the platform system cannot be guaranteed, resulting in insufficient accuracy of the system response obtained through motion capture training. Summary of the invention

[0005] To this end, the present invention provides a simulation training system based on motion capture to overcome the problem that the monitoring accuracy of the operation process of the platform system in the prior art is low and the smooth operation of the platform system cannot be guaranteed, resulting in insufficient accuracy of the system response obtained through motion capture training.

[0006] To achieve the above-mentioned object, the present invention provides a simulation training system based on motion capture, characterized in that it comprises: an image acquisition unit, which is used to acquire image data of a training object;

[0007] A data monitoring unit, which is used to collect information transmission parameter data in real time during the simulation training process;

[0008] An image processing unit, connected to the image acquisition unit, for processing the image data acquired by the image acquisition unit;

[0009] A simulation control unit is connected to the data monitoring unit and the image processing unit respectively, and is used to determine the reason why the operation process of the simulation training system does not meet the standard based on the average delay time of the image information transmission process, or to make a secondary determination based on the proportion of images with image slip marks and the proportion of sensors with reading errors.

[0010] And, when the reason is that the byte amount of the transmitted data packet does not meet the standard, the first preset delay time is modified or the data packet is compressed.

[0011] Furthermore, the simulation control unit includes:

[0012] A delay duration determination module, which is used to determine whether the operation process of the simulation training system does not meet the standard according to the comparison result that the average delay duration is greater than the first preset delay duration and less than or equal to the second preset delay duration;

[0013] A process judgment module is used to correct the first preset delay time based on the byte amount of the transmitted data packet to re-judge whether the operation process of the simulation training system meets the standard.

[0014] Furthermore, the simulation control unit includes:

[0015] A delay duration determination module, which is used to determine whether the operation process of the simulation training system does not meet the standard according to the comparison result that the average delay duration is greater than the second preset delay duration and less than or equal to the third preset duration;

[0016] The process judgment module is used to make a secondary judgment on the image acquisition process according to the proportion of images with image slip marks, wherein:

[0017] The delay duration determination module determines that the operation process of the simulation training system does not meet the standards based on the comparison result that the average delay duration is greater than the third preset delay duration. The process judgment module preliminarily determines that the data monitoring process does not meet the standards, and makes a secondary judgment on the data monitoring process based on the proportion of sensors with reading errors.

[0018] Furthermore, the average delay time calculation formula of the image information transmission process is:

[0019]

[0020] Among them, t0 is the average delay time of the image information transmission process, n is the total number of image information delays in a unit period, and t i is the delay time of the i-th image information in the unit period, i=1,2,3...n.

[0021] Furthermore, the simulation control unit includes:

[0022] A duration correction module is used to correct the first preset delay duration to a corresponding parameter based on the byte amount of the transmitted data packet.

[0023] Furthermore, the simulation control unit process judgment module is used to determine that the operation process of the simulation training system does not meet the standard and compress the data packet based on the comparison result that the average delay time is greater than the corrected first preset delay time.

[0024] Furthermore, the simulation control unit process judgment module is used to determine that the acquisition process of the image acquisition unit does not meet the standard and reduce the image acquisition speed based on the comparison result that the proportion of the number of images with image slip marks is greater than the preset proportion of the number of images.

[0025] Furthermore, the calculation formula for the percentage of images with slip marks is:

[0026]

[0027] Among them, P represents the proportion of images with slip marks, S represents the number of images with slip marks, and S a Indicates the total number of images acquired by the image acquisition unit.

[0028] Furthermore, the simulation control unit process judgment module is used to determine that the monitoring process of the data monitoring unit does not meet the standard and perform sensor calibration based on the comparison result that the proportion of the number of sensors with reading errors is greater than the proportion of the preset number of sensors.

[0029] Furthermore, the calculation formula for the proportion of the number of sensors with reading errors is:

[0030]

[0031] Among them, P1 is the proportion of sensors with reading errors, S1 is the number of sensors with reading errors, and S b is the total number of sensors in the monitoring unit.

[0032] Compared with the prior art, the beneficial effect of the present invention lies in that the present invention determines whether the operation process of the simulation training system meets the standards by calculating the average delay time of the image information transmission process. In the case where the operation process of the simulation training system is determined not to meet the standards, the first preset delay time is corrected based on the byte amount of the transmitted data packet and compared with the average delay time again to determine whether the operation process of the simulation training system meets the standards, and the image acquisition process and the data monitoring process are secondary judged according to the proportion of images with image slip marks and the proportion of sensors with reading errors, so as to monitor the operation process of the simulation training system in real time, determine whether the operation of the simulation training system is normal, and thus determine whether the response of the simulation training system is accurate.

[0033] Furthermore, the simulation control unit of the present invention determines whether the operation process of the simulation training system meets the standards based on the average delay time of the image information transmission process, distinguishes the situations where the operation process of the simulation training system does not meet the standards, and makes secondary judgments on the image acquisition process and the data monitoring process based on the proportion of images with image slip marks and the proportion of sensors with reading errors, thereby monitoring the operation process of the simulation training system in real time and improving the response accuracy of the simulation training system.

[0034] Furthermore, by calculating the average delay duration of the image information transmission process, the present invention can improve the accuracy of determining whether the operation process of the simulation training system meets the standards, thereby improving the accuracy of monitoring the simulation training system and further determining the response accuracy of the simulation training system.

[0035] Furthermore, the present invention uses different correction coefficients to correct the first preset delay time based on the number of bytes of the transmitted data packet, and further determines whether the operation process of the simulation training system meets the standards, thereby improving the accuracy of monitoring the simulation training system and determining the response accuracy of the simulation training system.

[0036] Furthermore, the present invention further determines whether the operation process of the simulation training system meets the standards based on the comparison result between the average delay duration and the corrected first preset delay duration, thereby improving the accuracy of monitoring the simulation training system and determining the response accuracy of the simulation training system.

[0037] Furthermore, the present invention performs a secondary judgment on the image acquisition process according to the proportion of images with image slip marks, and reduces the image acquisition speed when the acquisition process of the image acquisition unit does not meet the standards, thereby improving the accuracy of monitoring the simulation training system and determining the response accuracy of the simulation training system.

[0038] Furthermore, the present invention can improve the accuracy of determining whether the image acquisition process meets the standards by calculating the proportion of the number of images with slip marks, thereby improving the accuracy of monitoring the simulation training system and further determining the response accuracy of the simulation training system.

[0039] Furthermore, the present invention performs a secondary judgment on the data monitoring process according to the proportion of sensors with reading errors, and calibrates the sensors for situations where the data monitoring process does not meet the standards, thereby improving the accuracy of monitoring the simulation training system and determining the response accuracy of the simulation training system.

[0040] Furthermore, the present invention can improve the accuracy of determining whether the data monitoring process meets the standards by calculating the proportion of sensors that have reading errors, thereby improving the accuracy of monitoring the simulation training system and further determining the response accuracy of the simulation training system. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Figure 1 It is a structural block diagram of a simulation training system based on motion capture according to an embodiment of the present invention;

[0042] Figure 2 A flowchart of an embodiment of the present invention for determining whether the operation process of the simulation training system meets the standards;

[0043] Figure 3 This is a flow chart of a second determination of whether the image information acquisition process meets the standard according to an embodiment of the present invention;

[0044] Figure 4 The flowchart of the second determination of whether the data monitoring process meets the standard in the embodiment of the present invention. DETAILED DESCRIPTION

[0045] In order to make the objects and advantages of the present invention more clearly understood, the present invention is further described below in conjunction with embodiments; it should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0046] The preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood by those skilled in the art that these embodiments are only used to explain the technical principles of the present invention and are not intended to limit the protection scope of the present invention.

[0047] It should be noted that, in the description of the present invention, terms such as "up", "down", "left", "right", "inside" and "outside" indicating directions or positional relationships are based on the directions or positional relationships shown in the drawings. This is merely for the convenience of description and does not indicate or imply that the device or element must have a specific orientation, be constructed and operated in a specific orientation. Therefore, it cannot be understood as a limitation on the present invention.

[0048] In addition, it should be noted that in the description of the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For those skilled in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0049] See also Figure 1 As shown, it is a structural block diagram of a simulation training system based on motion capture according to an embodiment of the present invention. The present invention is a simulation training system based on motion capture, characterized in that it includes:

[0050] An image acquisition unit, which is used to acquire image data of a training object;

[0051] A data monitoring unit, which is used to collect information transmission parameter data in real time during the simulation training process;

[0052] An image processing unit, connected to the image acquisition unit, for processing the image data acquired by the image acquisition unit;

[0053] A simulation control unit is connected to the data monitoring unit and the image processing unit respectively, and is used to determine the reason why the operation process of the simulation training system does not meet the standard based on the average delay time of the image information transmission process, or to make a secondary determination based on the proportion of images with image slip marks and the proportion of sensors with reading errors.

[0054] And, when the reason is that the byte amount of the transmitted data packet does not meet the standard, the first preset delay time is modified or the data packet is compressed.

[0055] In the embodiment of the present invention, the image processing unit performs enhancement, denoising, filtering and transformation processing on the image, compresses, segments and tracks the video, and converts complex image information into data that can be recognized by a computer, which helps to improve the self-learning completeness of the simulation training system based on motion capture and improve the response accuracy of the simulation training system.

[0056] In the embodiment of the present invention, the image acquisition unit includes but is not limited to a camera, a video camera, a still camera or other devices with a camera function. The relative position, type and rated working parameters of the shooting device in the image acquisition unit are not limited. Those skilled in the art only need to set each device to fully record the actions of the training object.

[0057] In the embodiment of the present invention, the information transmission parameter data collected by the data monitoring unit includes but is not limited to the speed, strength and angle of the training object.

[0058] In an embodiment of the present invention, the image slip mark is a ghost image caused by jitter of the image acquisition unit during the acquisition process of the training object and / or a ghost image caused by the acquisition resolution of the image acquisition unit failing to meet the current movement or rotation speed requirement of the training object during the acquisition process. An image with the above-mentioned ghost image is determined to have an image slip mark.

[0059] Specifically, the embodiment of the present invention determines whether the operation process of the simulation training system meets the standards by calculating the average delay time of the image information transmission process. In the case where the operation process of the simulation training system is determined not to meet the standards, the first preset delay time is corrected based on the byte amount of the transmitted data packet and compared with the average delay time again to determine whether the operation process of the simulation training system meets the standards, and the image acquisition process and the data monitoring process are secondary judged according to the proportion of images with image slip marks and the proportion of sensors with reading errors, so as to monitor the operation process of the simulation training system in real time, determine whether the operation of the simulation training system is normal, and thus determine whether the response of the simulation training system is accurate.

[0060] See also Figure 2 As shown, it is a flow chart of an embodiment of the present invention for determining whether the operation process of the simulation training system meets the standards.

[0061] Specifically, the simulation control unit of the embodiment of the present invention determines whether the operation process of the simulation training system meets the standard according to the average delay time of the image information transmission process, wherein:

[0062] If the average delay time is less than or equal to the first preset delay time, the simulation control unit determines that the operation process of the simulation training system meets the standard;

[0063] If the average delay time is greater than the first preset delay time and less than or equal to the second preset delay time, the simulation control unit determines that the operation process of the simulation training system does not meet the standard, and corrects the first preset delay time based on the byte amount of the transmitted data packet to re-determine whether the operation process of the simulation training system meets the standard;

[0064] If the average delay time is greater than the second preset delay time and less than or equal to the third preset delay time, it is determined that the operation process of the simulation training system does not meet the standard, and the simulation control unit preliminarily determines that the image acquisition process does not meet the standard, and performs a secondary determination on the image acquisition process according to the proportion of images with image slip marks;

[0065] If the average delay time is greater than the third preset delay time, it is determined that the operation process of the simulation training system does not meet the standards. The simulation control unit preliminarily determines that the data monitoring process does not meet the standards, and performs a secondary judgment on the data monitoring process based on the proportion of sensors with reading errors.

[0066] Specifically, during the actual operation of the simulation training system, the general optional range of the first preset delay time length is [0.01s, 0.2s]; the preferred embodiment of the first preset delay time length of the present invention is 0.15s.

[0067] Specifically, during the actual operation of the simulation training system, the general optional range of the second preset delay time length is [0.2s, 0.4s]; the preferred embodiment of the second preset delay time length of the present invention is 0.3s.

[0068] Specifically, during the actual operation of the simulation training system, the general optional range of the third preset delay time length is [0.4s, 0.6s]; the preferred embodiment of the third preset delay time length of the present invention is 0.5s.

[0069] Specifically, the simulation control unit described in the embodiment of the present invention determines whether the operation process of the simulation training system meets the standards based on the average delay time of the image information transmission process, distinguishes the situations where the operation process of the simulation training system does not meet the standards, and makes secondary judgments on the image acquisition process and the data monitoring process based on the proportion of images with image slip marks and the proportion of sensors with reading errors, thereby monitoring the operation process of the simulation training system in real time and improving the response accuracy of the simulation training system.

[0070] Specifically, the average delay duration calculation formula of the image information transmission process described in the embodiment of the present invention is:

[0071]

[0072] Among them, t0 is the average delay time of the image information transmission process, n is the total number of image information delays in a unit period, and t i is the delay time of the i-th image information in the unit period, i=1,2,3...n.

[0073] Specifically, the embodiment of the present invention can improve the accuracy of determining whether the operation process of the simulation training system meets the standards by calculating the average delay duration of the image information transmission process, thereby improving the accuracy of monitoring the simulation training system and further determining the response accuracy of the simulation training system.

[0074] Specifically, the simulation control unit of the embodiment of the present invention amends the first preset delay time based on the byte amount of the transmitted data packet, wherein:

[0075] If the byte amount of the data packet is less than or equal to the preset byte amount, the first preset delay time is corrected to the corresponding parameter a1 by a first correction coefficient;

[0076] If the byte amount of the data packet is greater than the preset byte amount, the first preset delay time is corrected to the corresponding parameter a2 by a second correction coefficient;

[0077] The second correction parameter is greater than the first correction parameter and is greater than 1.

[0078] Specifically, during the actual operation of the simulation training system, the general optional range of the byte size of the data packet is [50M, 150M], and the preferred embodiment of the byte size of the preset data packet of the present invention is 100M.

[0079] Specifically, the first correction coefficient is 1.2, and the second correction coefficient is 1.4.

[0080] Specifically, the corresponding parameter a1=0.15×1.2=0.18s of the first preset delay time length is corrected by the first correction coefficient, and the corresponding parameter a1=0.3×1.4=0.42s of the first preset delay time length is corrected by the second correction coefficient.

[0081] Specifically, the embodiment of the present invention uses different correction coefficients to correct the first preset delay duration based on the number of bytes of the transmitted data packet, and further determines whether the operation process of the simulation training system meets the standards, thereby improving the accuracy of monitoring the simulation training system and determining the response accuracy of the simulation training system.

[0082] Specifically, the simulation control unit of the embodiment of the present invention determines whether the operation process of the simulation training system meets the standard based on the corrected first preset delay time, wherein:

[0083] If the average delay time is less than or equal to the first preset delay time after correction, the simulation control unit determines that the operation process of the simulation training system meets the standard;

[0084] If the average delay time is greater than the corrected first preset delay time, the simulation control unit determines that the operation process of the simulation training system does not meet the standard and compresses the data packet.

[0085] Specifically, compress the data packet to 50M or less.

[0086] The present invention further determines whether the operation process of the simulation training system meets the standard based on the comparison result of the average delay time and the corrected first preset delay time, thereby improving the accuracy of monitoring the simulation training system and determining the response accuracy of the simulation training system.

[0087] See also Figure 3 As shown, it is a flow chart of a second determination of whether the image information acquisition process meets the standard according to an embodiment of the present invention.

[0088] Specifically, the simulation control unit of the embodiment of the present invention performs a secondary determination on the image acquisition process according to the proportion of images with image slip marks, wherein:

[0089] If the proportion of images with image slip marks is less than or equal to the preset proportion of images, the simulation control unit determines for the second time that the acquisition process of the image acquisition unit meets the standard;

[0090] If the proportion of the number of images with image slip marks is greater than the preset proportion of the number of images, the simulation control unit determines for the second time that the acquisition process of the image acquisition unit does not meet the standard and reduces the image acquisition speed.

[0091] Specifically, the number of preset images with image slip marks accounts for 20%.

[0092] Specifically, during the actual operation of the simulation training system, the reduced image acquisition speed is determined by the difference between the proportion of images with image slip marks and the preset proportion of images. Preferably, for every 1% increase in the proportion of images with image slip marks over the preset proportion of images, the image acquisition speed is reduced by 3% compared to the current acquisition speed.

[0093] Specifically, the embodiment of the present invention performs a secondary judgment on the image acquisition process according to the proportion of images with image slip marks, and reduces the image acquisition speed when the acquisition process of the image acquisition unit does not meet the standards, thereby improving the accuracy of monitoring the simulation training system and determining the response accuracy of the simulation training system.

[0094] Specifically, the calculation formula for the proportion of images with slip marks in the embodiment of the present invention is:

[0095]

[0096] Among them, P represents the proportion of images with slip marks, S represents the number of images with slip marks, and S a Indicates the total number of images acquired by the image acquisition unit.

[0097] Specifically, the embodiment of the present invention can improve the accuracy of determining whether the image acquisition process meets the standards by calculating the proportion of the number of images with slip marks, thereby improving the accuracy of monitoring the simulation training system and further determining the response accuracy of the simulation training system.

[0098] See also Figure 4 As shown, it is a flow chart of the second determination of whether the data monitoring process meets the standard in an embodiment of the present invention.

[0099] Specifically, the simulation control unit of the embodiment of the present invention performs a secondary determination on the data monitoring process according to the proportion of sensors with reading errors, wherein:

[0100] If the proportion of sensors with reading errors is less than or equal to the preset proportion of sensors, the simulation control unit determines for the second time that the monitoring process of the monitoring unit meets the standard;

[0101] If the proportion of sensors with reading errors is greater than the preset proportion of sensors, the simulation control unit determines for the second time that the monitoring process of the monitoring unit does not meet the standard and performs sensor calibration.

[0102] In the embodiment of the present invention, sensors include but are not limited to temperature sensors, pressure sensors, velocity sensors, acceleration sensors, and humidity sensors. The positions and quantities of specific sensors are not limited. The relative positions, types, and rated working parameters of each sensor in the data monitoring unit are not limited. Technical personnel in this field only need to ensure that the settings of each sensor can accurately record the motion parameters of the training object.

[0103] In the embodiment of the present invention, for each sensor, under stable parameter conditions, if the reading of each sensor fluctuates frequently and cannot stabilize near a relatively fixed value, it can be determined that each sensor has a reading error. Those skilled in the art will understand that the error in the sensor reading includes but is not limited to the above-mentioned manifestations, and the accuracy of the sensor reading needs to be analyzed based on the actual usage of the sensor.

[0104] Specifically, the number of preset sensors with reading errors accounts for 10%.

[0105] Specifically, during the actual operation of the simulation training system, the calibration of the sensor first selects the corresponding calibrator according to the type of sensor and adjusts it to the calibration mode, places the sensor in a zero physical quantity environment, and performs setting and calibration while ensuring that the sensor is in a stable state.

[0106] Specifically, the embodiment of the present invention performs a secondary judgment on the data monitoring process according to the proportion of sensors with reading errors, and calibrates the sensors when the data monitoring process does not meet the standards, thereby improving the accuracy of monitoring the simulation training system and determining the response accuracy of the simulation training system.

[0107] Specifically, the calculation formula for the proportion of sensors with reading errors in the embodiment of the present invention is:

[0108]

[0109] Among them, P1 is the proportion of sensors with reading errors, S1 is the number of sensors with reading errors, and S b is the total number of sensors in the monitoring unit.

[0110] Specifically, the present invention can improve the accuracy of determining whether the data monitoring process meets the standards by calculating the proportion of sensors that have reading errors, thereby improving the accuracy of monitoring the simulation training system and further determining the response accuracy of the simulation training system.

[0111] So far, the technical solutions of the present invention have been described in conjunction with the preferred embodiments shown in the accompanying drawings. However, it is easy for those skilled in the art to understand that the protection scope of the present invention is obviously not limited to these specific embodiments. Without departing from the principle of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the protection scope of the present invention.

Claims

1. A simulation training system based on motion capture, characterized in that: include: An image acquisition unit, which is used to acquire image data of a training object; A data monitoring unit, which is used to collect information transmission parameter data in real time during the simulation training process, wherein the information transmission parameter data includes the speed, force and angle of the training object; An image processing unit, connected to the image acquisition unit, for processing the image data acquired by the image acquisition unit; A simulation control unit, which is connected to the data monitoring unit and the image processing unit respectively, and includes a delay duration determination module and a process judgment module; The delay duration determination module is used to determine that the operation process of the simulation training system meets the standard according to the comparison result that the average delay duration of the image information transmission process is less than or equal to the first preset delay duration; The delay duration determination module is used to determine that the byte amount of the transmitted data packet does not meet the standard based on the comparison result that the average delay duration is greater than the first preset delay duration and is less than or equal to the second preset delay duration. The process judgment module corrects the first preset delay duration, and the simulation control unit further determines based on the corrected first preset delay duration. If the average delay duration is greater than the corrected first preset delay duration, the simulation control unit determines that the operation process of the simulation training system does not meet the standard and compresses the data packet. If the average delay duration is less than or equal to the corrected first preset delay duration, the simulation control unit determines that the operation process of the simulation training system meets the standard. The delay duration determination module is used to determine that the operation process of the simulation training system does not meet the standard according to the comparison result that the average delay duration is greater than the second preset delay duration and less than or equal to the third preset delay duration, and the process judgment module preliminarily determines that the image acquisition process does not meet the standard, and performs a secondary judgment on the image acquisition process according to the proportion of the number of images with image slip marks; The delay duration determination module is used to determine that the operation process of the simulation training system does not meet the standards based on the comparison result that the average delay duration is greater than the third preset delay duration. The process judgment module preliminarily determines that the data monitoring process does not meet the standards, and performs a secondary judgment on the data monitoring process based on the proportion of sensors with reading errors.

2. The motion capture-based simulation training system according to claim 1, characterized in that: The process determination module is used to modify the first preset delay time based on the byte amount of the transmitted data packet.

3. The motion capture-based simulation training system according to claim 2, characterized in that: The calculation formula for the average delay duration of the image information transmission process is: , Among them, t0 is the average delay time of the image information transmission process, n is the total number of image information delays in a unit period, and t i is the delay time of the i-th image information in the unit period, i=1,2,3...n.

4. The motion capture-based simulation training system according to claim 3 is characterized in that: The simulation control unit comprises: A duration correction module is used to correct the first preset delay duration to a corresponding parameter based on the byte amount of the transmitted data packet.

5. The motion capture-based simulation training system according to claim 4, characterized in that: The process judgment module is used to determine that the acquisition process of the image acquisition unit does not meet the standard and reduce the image acquisition speed based on the comparison result that the proportion of the number of images with image slip marks is greater than the preset proportion of the number of images.

6. The motion capture-based simulation training system according to claim 5, characterized in that: The calculation formula for the proportion of images with slip marks is: , Among them, P represents the proportion of images with slip marks, S represents the number of images with slip marks, and S a Indicates the total number of images acquired by the image acquisition unit.

7. The motion capture-based simulation training system according to claim 6, characterized in that: The simulation control unit process judgment module is used to determine that the monitoring process of the data monitoring unit does not meet the standard and perform sensor calibration based on the comparison result that the proportion of the number of sensors with reading errors is greater than the proportion of the preset number of sensors.

8. The motion capture-based simulation training system according to claim 7, characterized in that: The calculation formula for the proportion of sensors with reading errors is: , Among them, P1 is the proportion of sensors with reading errors, S1 is the number of sensors with reading errors, and S b is the total number of sensors in the monitoring unit.

Citation Information

Patent Citations

  • Virtual simulation space multi-user collaborative practical training sharing platform

    CN116663228A

  • Virtual reality system testing device and method

    CN106652857A

  • Image processing method and device, electronic equipment and storage medium

    CN113572929A