Method for synchronizing virtual camera track and real camera track of high-reality augmented reality studio

Abstract

The method for synchronizing the tracks of the virtual camera and the real camera in the high-reality augmented reality studio comprises the following steps: planning a shooting path, adjusting the position relationship between the real camera and an object to be shot, and obtaining the pose information of the real camera; the pose information of the real camera is sent to a client program of the virtual engine in real time, so that the motion mode of the virtual camera is consistent with that of the real camera; the synchronous pose coordinate information is received, and the virtual camera is moved to the received pose coordinate of the real camera; and determining the region and view angle fusion of the video image shot by the real camera and the three-dimensional virtual scene, and ensuring the fluency and immersion of the three-dimensional virtual scene. According to the invention, track synchronization between a real camera and a virtual camera can be completed successfully, data fusion of a real video and a virtual environment is realized, and obtained data information of a real scene is mapped to the virtual environment.

Description

technical field [0001] The invention relates to the technical field of robots and computers, and in particular to a method for synchronizing the trajectory of a virtual and reality camera in a high-fidelity augmented reality studio. Background technique [0002] In the process of industrial production, production automation is the development trend, and the emergence of robots is a big leap in production automation. Robots are complex systems controlled by microprocessors that can perform many different tasks without having to replace the machine, just reprogram it to suit the new task. Among them, the birth of a new type of industrial robot, the collaborative robot, has swept away the obstacles of human-machine collaboration and opened a new chapter for the development of robots. Collaborative robots, as the name suggests, are robots that can cooperate with humans on the production line to give full play to the efficiency of robots and human intelligence. [0003] With th...

AI Technical Summary

Problems solved by technology

At present, the mainstream method of building a virtual 3D scene is to use modeling software (such as 3D Max) to manually build the model according to the drawing information. It requires a lot of manpower and material resources, and the model parameters need to be constantly updated; traditional 3D reconstruction technology generally uses active optical systems or laser systems to measure distances on the spot, but laser measurement equipment is often bulky, expensive, and takes a long time to calculate data. In complex scenes, it is necessary to move constantly, and the operability is poor, and when it is required to take multi-angle and all-round shots of the subject, there may be problems such as bumps in the picture and difficulty in fixing the camera in a specific position when shooting with a hand-held camera

Images