AR individual soldier and robot hybrid combat system and method based on digital twinning

Abstract

The invention discloses an AR individual soldier and robot hybrid combat system and method based on digital twinning. The system comprises: a ground combat robot; AR display equipment which can construct an AR three-dimensional virtual space, display a real battlefield environment, personnel equipment and a virtual target in a virtual-real fusion manner, perform interactive operation on the virtual 3D ground battle robot, display an AR electronic sand table and display a battlefield situation; wearable equipment which is in real-time communication with the ground combat robot through a data chain and is connected with the AR display equipment; and an AR application system which is used for quickly constructing the ground combat robot and the real battlefield environment into an AR three-dimensional virtual space to realize the 'leading sheep' function of the 3D ground combat robot for one or more real ground combat robots. The wearable AR glasses are used for replacing handheld controlequipment, the two hands of a control hand can be liberated, the control hand can conveniently and rapidly switch task roles, and weapons such as rifles are used for fighting.

Description

technical field [0001] The present invention relates to the technical field of future ground intelligent combat, and more specifically relates to a digital twin-based AR individual and robot mixed combat system and method thereof. Background technique [0002] Future light and high-mobility operations center on advanced combat concepts such as unmanned operations and group operations, and the joint formation and coordinated operations of manned combat systems and unmanned combat systems based on unmanned technology and artificial intelligence technology have become an important part of future warfare. inevitable trend of development. [0003] According to public reports, Six3 Company designs, develops and verifies the system prototype of the "Joint Arms Squad" with human and robot cooperative combat capabilities, "which will integrate human and unmanned equipment, ubiquitous communication and information, and various fields. advanced combat capabilities combined to maximize...

AI Technical Summary

Problems solved by technology

[0005] 1) Portable control equipment has a certain volume and weight, and its carrying and handheld operation occupy the hands of the operator, which is not conducive to the operator's rapid change of task roles, such as using rifles and other weapons to fight;

[0006] 2) Portable control equipment is limited by volume and weight, and its display screen is very small, which is not convenient for the operator to perform image observation, target recognition and tracking, and is not convenient for battlefield situation display and path planning for ground combat robots;

[0007] 3) The display screen of the portable control device can only display two-dimensional images, but cannot display three-dimensional electronic sand table and other three-dimensional images, and cannot construct a virtual three-dimensional space, so as to carry out ground combat robot control skill training, combat plan deduction and combat command training in a three-dimensional virtual environment Wait

Images