Three-dimensional rendering method based on double viewpoints

Abstract

The invention relates to a three-dimensional rendering method based on double viewpoints, and the method comprises the steps: S1, building a tracking collection system according to the actual environment of an equipment site, enabling the collection range of the tracking collection system to be complementary, determining the moving regions of two actual trackers of the tracking collection system, and creating an actual coordinate system of the data collected by the tracking collection system; s2, the tracking acquisition system transmits the acquired data to a virtual scene establishment system, and the virtual scene establishment system creates a corresponding virtual coordinate system and a virtual tracker according to the actual coordinate systems of the two actual trackers of the data acquired by the tracking acquisition system; each virtual tracker receives corresponding actual tracker data from the tracking acquisition system; s3, the virtual scene establishing system establishes two virtual scenes according to the data acquired by the actual tracker of the tracking acquisition system, and distributes the data of each virtual scene to the corresponding rendering cluster; the rendering cluster corresponding to each virtual scene converts the data and outputs the data to a double-viewpoint display device; and S4, the double-viewpoint display device receives data output by the two rendering clusters and performs double-viewpoint display.

Description

Technical Field

[0001] The present invention relates to the field of virtual reality and simulation technology, and in particular to a stereoscopic rendering method based on dual viewpoints. Background Art

[0002] 1. Virtual Reality

[0003] Virtual reality technology (English name: Virtual Reality, abbreviated as VR), also known as virtual reality or spiritual technology, is a new practical technology developed in the 20th century. Virtual reality technology encompasses computers, electronic information, and simulation technology. Its basic implementation method is based on computer technology, using and integrating the latest developments of various high technologies such as three-dimensional graphics technology, multimedia technology, simulation technology, display technology, and servo technology. With the help of computers and other equipment, a realistic three-dimensional visual, tactile, olfactory and other sensory experiences are generated in the virtual world, so that people in the virtual world have an immersive feeling. With the continuous development of social productivity and science and technology, the demand for VR technology in all walks of life is growing. VR technology has also made great progress and has gradually become a new field of science and technology.

[0004] Virtual reality, as the name implies, is the combination of virtuality and reality. Theoretically, virtual reality technology (VR) is a computer simulation system that can create and experience a virtual world. It uses computers to generate a simulated environment and immerse users in it. Virtual reality technology uses real-life data, electronic signals generated by computer technology, and combines them with various output devices to transform them into phenomena that people can feel. These phenomena can be real objects in reality or substances that are invisible to our naked eyes, expressed through three-dimensional models. Because these phenomena are not what we can see directly, but are simulated in the real world through computer technology, they are called virtual reality.

[0005] Virtual reality technology has been recognized by more and more people. Users can experience the most realistic feelings in the virtual reality world. The authenticity of the simulated environment is difficult to distinguish from the real world, making people feel as if they are in the real world. At the same time, virtual reality has all the perceptual functions that humans have, such as hearing, vision, touch, taste, smell and other perceptual systems. Finally, it has a super simulation system, which truly realizes human-computer interaction, allowing people to operate at will and get the most realistic feedback from the environment during the operation. It is the existence, multi-sensory, and interactive characteristics of virtual reality technology that make it popular with many people.

[0006] 2. Infrared optical positioning technology

[0007] The basic principle of infrared optical positioning technology is to install multiple infrared emitting cameras in the space to cover the entire space. Infrared reflective points are installed on the surface of the object to be located. The infrared light emitted by the camera is reflected by the reflective points and then captured. The spatial coordinates of the located object can be obtained by working with multiple cameras and calculating through subsequent programs.

[0008] 3. Application background

[0009] At present, the tracking and acquisition system used in the digital prototype virtual reality system generally adopts infrared optical positioning technology to realize the positioning tracking and interactive operation of the human head field of view, interactive handles, etc. A virtual reality system is generally equipped with only one tracking and acquisition system, and only one person can wear stereo glasses with a field of view tracker during use. The tracking and acquisition system obtains the position of the field of view tracker and converts it into active viewpoint information. The virtual scene establishment system calculates and outputs the active viewpoint information to the stereo display screen through the rendering cluster for display. The images seen by other people wearing stereo glasses are offset to a certain extent based on the viewpoint image display, and it is impossible to intuitively feel the stereo effect of the real proportion of the digital prototype. Summary of the invention

[0010] Purpose of the present invention:

[0011] The purpose of the present invention is to propose a stereo rendering method based on dual viewpoints, which can convert two field of view tracking nodes into two tracking viewpoint information in one tracking acquisition system, and the two tracking viewpoint information are applied in the same virtual scene, so that the virtual scene establishment system can simultaneously render two active stereo images and push them to the dual viewpoint display device. By using dual viewpoint technology, two tracked viewpoints can exist in the same VR environment at the same time, so that both the operator and the observer have the correct viewpoint, thereby greatly improving the immersion perception and communication and coordination ability of the system.

[0012] The technical solution of the present invention:

[0013] A dual-viewpoint stereo rendering method comprises the following steps:

[0014] Step S1, according to the actual environment of the equipment site, build a tracking and acquisition system, make the acquisition range of the tracking and acquisition system complementary, and determine the moving areas of the two actual trackers of the tracking and acquisition system, and create an actual coordinate system for the tracking and acquisition system to collect data;

[0015] Step S2, the tracking and acquisition system transmits the collected data to the virtual scene establishment system, and the virtual scene establishment system creates a corresponding virtual coordinate system and virtual tracker according to the actual coordinate systems of the two actual trackers collected by the tracking and acquisition system, and each virtual tracker receives the actual tracker data corresponding to the tracking and acquisition system;

[0016] Step S3, the virtual scene establishment system establishes two virtual scenes according to the data collected by the actual tracker of the tracking and acquisition system, and distributes the data of each virtual scene to its corresponding rendering cluster; then the rendering cluster corresponding to each virtual scene converts the data and outputs it to the dual-viewpoint display device;

[0017] Step S4: The dual-viewpoint display device receives data output by two rendering clusters and performs dual-viewpoint display.

[0018] Furthermore, in step S1, the tracking and acquisition system includes two actual trackers and a set of tracking servers; the two actual trackers move within the effective acquisition range of the tracking and acquisition system and transmit the acquired data to the tracking server.

[0019] Furthermore, the tracking server acquires data from two actual trackers and transmits the data to the virtual scene establishment system.

[0020] Furthermore, the tracking and acquisition system is set up, calibrated, monitored and operated on the host computer.

[0021] Furthermore, the virtual tracker receives actual tracker data from the tracking and acquisition system, processes it, obtains and executes valid data, and transmits the valid data to its corresponding rendering cluster.

[0022] Furthermore, the rendering cluster performs image rendering on the motion trajectory collected by the virtual tracker and transmits it to the dual-viewpoint display device.

[0023] Furthermore, the two virtual trackers are bound to two rendering clusters respectively, and the processed data is sent to the corresponding bound rendering clusters. The two rendering clusters render images of the motion trajectories collected by their corresponding virtual trackers and transmit them to the dual-viewpoint display device.

[0024] Furthermore, the dual-viewpoint display device displays the motion trajectory rendering images output by the two rendering clusters in different display frequency bands respectively.

[0025] Furthermore, the dual-viewpoint display device outputs the motion trajectory rendering image output by one rendering cluster at a display frequency of 0-120 Hz, and outputs the motion trajectory rendering image output by another rendering cluster at a display frequency of 120-240 Hz.

[0026] Beneficial effects of the present invention:

[0027] The dual-viewpoint based stereoscopic rendering method of the present invention has the following beneficial effects:

[0028] 1. The present invention can convert two field of view trackers in one tracking and acquisition system into two tracking viewpoint information, and the two tracking viewpoint information are applied in the same virtual reality environment, so that the virtual scene establishment system can render two pictures at the same time; and by grouping the working time periods of the stereo signal transmitter, independent pictures can be seen in two image refresh frequency time periods on one screen through two stereo glasses.

[0029] 2. The present invention allows two users (defined as an operator and an observer) to observe the rendered images based on the position of their own field of view trackers in the same tracking and acquisition system coordinate system in the same virtual reality environment. The observer can watch in real time the operator using the interactive handle tracker to establish real-time roaming and interactive operations of the virtual scene system. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] The above and / or additional aspects and advantages of the present invention will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0031] Figure 1 is a flow chart of the present invention;

[0032] Figure 2 It is a structural block diagram of the present invention;

[0033] Figure 3 It is a structural block diagram of the tracking and acquisition system of the present invention;

[0034] Figure 4 It is a structural block diagram of a stereo signal transmission of the present invention. DETAILED DESCRIPTION

[0035] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0036] An embodiment of the present invention is:

[0037] A dual-viewpoint stereo rendering method comprises the following steps:

[0038] Step S1, according to the actual environment of the equipment site, build a tracking and acquisition system, make the acquisition range of the infrared camera of the tracking and acquisition system complementary, and determine the moving areas of two actual field of view trackers and one interactive handle tracker of the tracking and acquisition system, and create an actual coordinate system for collecting data of the tracking and acquisition system; the tracking and acquisition system includes two actual field of view trackers, a tracking server, an interactive handle tracker and several infrared cameras; the two actual field of view trackers move within the effective acquisition range of the infrared camera of the tracking and acquisition system, and transmit the collected data to the tracking server.

[0039] In addition, the tracking server obtains data from two actual field of view trackers through an infrared camera and transmits the data to the virtual scene establishment system. The tracking acquisition system can be set, calibrated, monitored and operated on the main control computer through the network.

[0040] Step S2, the tracking and acquisition system transmits the acquired data to the virtual scene establishment system, and the virtual scene establishment system creates a corresponding virtual coordinate system and virtual tracker according to the actual coordinate systems of the two actual field of view trackers acquired by the tracking and acquisition system, and each virtual tracker receives the actual field of view tracker data corresponding to the tracking and acquisition system;

[0041] Among them, the virtual scene establishment system receives the actual field of view tracker motion trajectory data from the tracking and acquisition system and processes it, obtains and executes valid data, and transmits the valid data to its corresponding rendering cluster; the rendering cluster renders the image of the motion trajectory collected by the virtual tracker and transmits it to the dual-viewpoint display device.

[0042] Step S3, the virtual scene establishment system establishes two virtual scenes according to the data collected by the actual field of view tracker of the tracking and acquisition system, and distributes the data of each virtual scene to its corresponding rendering cluster; then the rendering cluster corresponding to each virtual scene converts the data and outputs it to the dual-viewpoint display device;

[0043] Among them, two virtual field of view trackers are bound to two rendering clusters respectively, and the processed data is sent to the corresponding bound rendering clusters. The two rendering clusters render images of the motion trajectories collected by their corresponding virtual trackers and transmit them to the dual-viewpoint display device.

[0044] In step S4, the dual-viewpoint display device receives the data output by the two rendering clusters and performs dual-viewpoint display, that is, the dual-viewpoint display device displays the motion trajectory rendering images output by the two rendering clusters in different image refresh frequency time periods. The dual-viewpoint display device outputs the motion trajectory rendering images output by one rendering cluster in the image refresh frequency time period of 0-120 Hz, and outputs the motion trajectory rendering images output by the other rendering cluster in the image refresh frequency time period of 120-240 Hz. Preferably, by grouping the working time periods of the stereo signal transmitter, two pairs of stereo glasses can independently observe the output images of the two rendering clusters, that is, stereo glasses 1 can only see the rendering images of 0-120 Hz, and stereo glasses 2 can only see the rendering images of 120-240 Hz.

[0045] Step S5, by grouping the working time periods of the stereo signal transmitters, two pairs of stereo glasses can independently observe the output images of the two rendering clusters, thereby realizing dual-viewpoint viewing.

[0046] A second embodiment of the present invention is:

[0047] The present invention provides a stereoscopic rendering method based on dual viewpoints, such as Figure 1-3 As shown, the following steps are included:

[0048] Step S1, according to the actual environment of the equipment site, build a tracking and acquisition system, make the acquisition range of the infrared camera of the tracking and acquisition system complementary, and determine the moving area of ​​the two actual field of view trackers of the tracking and acquisition system, and create an actual coordinate system for the tracking and acquisition system to collect data;

[0049] like Figure 3 As shown, the tracking and acquisition system includes two actual field of view trackers, one tracking server, one interactive handle tracker and several infrared cameras; the two actual field of view trackers move within the effective acquisition range of the infrared camera of the tracking and acquisition system, and transmit the acquired data to the tracking server.

[0050] The tracking server obtains the data of the actual tracker from the infrared camera and transmits the data of the actual tracker to the virtual scene establishment system. The tracking server is also responsible for the setting, calibration, monitoring, and operation of the actual tracker, and synchronously sends it to the master computer in the same local area network for the virtual scene establishment system to use its data.

[0051] Step S2, the tracking and acquisition system transmits the acquired data to the virtual scene establishment system, and the virtual scene establishment system creates a corresponding virtual coordinate system and virtual tracker according to the actual coordinate systems of the two actual field of view trackers acquired by the tracking and acquisition system, and each virtual tracker receives the actual field of view tracker data corresponding to the tracking and acquisition system;

[0052] Step S3, the virtual scene establishment system establishes two virtual scenes according to the data collected by the actual field of view tracker of the tracking and acquisition system, and distributes the data of each virtual scene to its corresponding rendering cluster; then the rendering cluster corresponding to each virtual scene converts the data and outputs it to the dual-viewpoint display device;

[0053] Step S4: The dual-viewpoint display device receives data output by two rendering clusters and performs dual-viewpoint display.

[0054] Step S5, by grouping the working time periods of the stereo signal transmitters, two pairs of stereo glasses can independently observe the output images of the two rendering clusters, thereby realizing dual-viewpoint viewing.

[0055] The virtual scene establishment system of the present invention processes the real-time data received by the virtual tracker from the actual field of view tracker of the corresponding tracking and acquisition system, and then outputs it to its corresponding rendering cluster in real time, and then the corresponding rendering cluster outputs it to the dual-viewpoint display device, which can greatly improve its data processing efficiency.

[0056] A third embodiment of the present invention is:

[0057] The difference between the third embodiment and the second embodiment is that the virtual scene establishment system obtains the spatial coordinate motion trajectory and key operation of the interactive handle tracker through the tracking and acquisition system and converts them, driving the virtual scene establishment system to display the overall position and interactive responses such as model actions.

[0058] A fourth embodiment of the present invention is:

[0059] The difference between the fourth embodiment and the third embodiment is that the dual-viewpoint display device outputs the motion trajectory rendering image output by one rendering cluster at a display frequency of 0-120 Hz, and outputs the motion trajectory rendering image output by another rendering cluster at a display frequency of 120-240 Hz.

[0060] The present invention can convert two field of view trackers into two tracking viewpoint information, and the two tracking viewpoint information are applied in the same virtual scene, so that the virtual scene establishment system renders two pictures at the same time; different rendering pictures will be displayed in two different image refresh frequency time periods on one screen.

[0061] A fifth embodiment of the present invention is:

[0062] The difference between the fifth embodiment and the fourth embodiment is that by grouping the working time periods of the stereo signal transmitters, two pairs of stereo glasses can independently observe the output images of the two rendering clusters, that is, the stereo glasses 1 can only see the rendering images of 0-120 Hz, and the stereo glasses 2 can only see the rendering images of 120-240 Hz.

[0063] The present invention can transmit the rendering cluster picture stereo signals corresponding to two visual field trackers to designated stereo glasses respectively, so as to realize dual-viewpoint viewing for two persons in the same virtual reality environment.

[0064] The above is only a specific embodiment of the present invention, and the present invention is described in detail. The unexplained part is a conventional technology. However, the protection scope of the present invention is not limited to this. Any changes or substitutions that can be easily thought of by any technician familiar with the technical field within the technical scope disclosed by the present invention should be included in the protection scope of the present invention. The protection scope of the present invention shall be based on the protection scope of the claims.

Claims

1. A stereoscopic rendering method based on dual viewpoints, characterized in that: The following steps are involved: Step S1, according to the actual environment of the equipment site, build a tracking and acquisition system, make the acquisition range of the tracking and acquisition system complementary, and determine the moving areas of the two actual trackers of the tracking and acquisition system, and create an actual coordinate system for the tracking and acquisition system to collect data; Step S2, the tracking and acquisition system transmits the collected data to the virtual scene establishment system, and the virtual scene establishment system creates a corresponding virtual coordinate system and virtual tracker according to the actual coordinate systems of the two actual trackers collected by the tracking and acquisition system, and each virtual tracker receives the actual tracker data corresponding to the tracking and acquisition system; Step S3, the virtual scene establishment system establishes two virtual scenes according to the data collected by the actual tracker of the tracking and collection system, and distributes the data of each virtual scene to its corresponding rendering cluster; Then the rendering cluster corresponding to each virtual scene converts the data and outputs it to the dual-viewpoint display device; Step S4: The dual-viewpoint display device receives data output by two rendering clusters and performs dual-viewpoint display.

2. The dual-viewpoint based stereoscopic rendering method according to claim 1, characterized in that: In step S1, the tracking and acquisition system includes two actual trackers and a set of tracking servers; the two actual trackers move within the effective acquisition range of the tracking and acquisition system and transmit the collected data to the tracking server.

3. The dual-viewpoint based stereoscopic rendering method according to claim 2, characterized in that: The tracking server acquires data from two actual trackers and transmits the data to the virtual scene establishment system.

4. The dual-viewpoint based stereoscopic rendering method according to claim 2, characterized in that: Set up, calibrate, monitor and run the tracking and acquisition system on the host computer.

5. The dual-viewpoint based stereoscopic rendering method according to claim 2, characterized in that: The virtual tracker receives the actual tracker data from the tracking acquisition system, processes it, obtains and executes the valid data, and transmits the valid data to its corresponding rendering cluster.

6. The dual-viewpoint based stereoscopic rendering method according to claim 2, characterized in that: The rendering cluster renders the motion trajectory collected by the virtual tracker and transmits it to the dual-viewpoint display device.

7. The dual-viewpoint based stereoscopic rendering method according to claim 2, characterized in that: The two virtual trackers are bound to two rendering clusters respectively, and the processed data is sent to the corresponding bound rendering clusters. The two rendering clusters render images based on the motion trajectories collected by their corresponding virtual trackers and transmit them to the dual-viewpoint display device.

8. The dual-viewpoint based stereoscopic rendering method according to claim 7, characterized in that: The dual-viewpoint display device displays the motion trajectory rendering images output by two rendering clusters in different display frequency bands respectively.

9. The dual-viewpoint based stereoscopic rendering method according to claim 8, characterized in that: The dual-viewpoint display device outputs the motion trajectory rendering image output by one rendering cluster at a display frequency of 0-120 Hz, and outputs the motion trajectory rendering image output by another rendering cluster at a display frequency of 120-240 Hz.

Images