VR system manufacturing method and VR system

Abstract

The invention provides a VR system manufacturing method and a VR system, and is applied to the technical field of virtual reality. The method comprises the following steps: acquiring virtual reality VR panoramic video data, wherein the VR panoramic video data comprises static objects, dynamic objects and first interaction data between the dynamic objects; independently making second interaction data between the user and the dynamic object, and performing fusion processing on the VR panoramic video data and the second interaction data to obtain panoramic interaction video data; and carrying out integrated processing on the panoramic interaction video data and hardware equipment.

Description

Technical Field

[0001] The present invention relates to the field of virtual reality technology, and in particular to a VR egg chair system manufacturing method and a VR system. Background Art

[0002] The Virtual Reality (VR) egg chair system is a new type of VR interactive experience system that combines a multi-axis motion platform with VR technology. Generally, there are single-seat, double-seat, and multi-seat egg chair platforms. After the user sits on the motion platform and puts on VR glasses, the motion platform will match the lens movement and orientation in the VR glasses to achieve various operations such as forward, backward, left, right, up and down, vibration and blowing, etc., to achieve a dynamic roaming experience in the VR scene.

[0003] In the production of VR egg chair systems in the prior art, in order to enhance the user's sense of immersion and realism, the producers will add various particle effects and visual effects. Ordinary computer hardware often has difficulty running such high-quality VR scenes smoothly. In order to meet these high-performance requirements, it is usually necessary to equip expensive professional-grade graphics processors, large-capacity high-speed memory and powerful central processing units, which will significantly increase the hardware cost of the entire VR egg chair system. In addition to the high hardware cost, in the actual use of VR scenes, when users want to switch scenes or enter a new VR environment, because the VR scene is large and has many resources to load, the scene jump often requires waiting for tens of seconds or even longer, which not only interrupts the user's immersive experience, but also reduces the overall attractiveness of the system.

[0004] Therefore, although the existing VR egg chair system production process can bring high-quality VR experience, it is highly dependent on high-performance hardware and has problems such as long scene loading time. These problems have become bottlenecks restricting its development, and many potential users choose to give up the experience because they cannot afford the high hardware costs or are dissatisfied with the waiting time. Summary of the invention

[0005] The present invention provides a VR system production method and a VR system, which are used to solve the problems that the VR egg chair system production process in the prior art has a strong dependence on high-performance hardware and a long scene loading time.

[0006] The present invention provides a VR system production method, comprising: obtaining virtual reality VR panoramic video data, wherein the VR panoramic video data includes static objects, dynamic objects, and first interaction data between the dynamic objects; separately producing second interaction data between a user and the dynamic objects, fusing the VR panoramic video data with the second interaction data to obtain panoramic interaction video data; and integrating the panoramic interaction video data with hardware equipment.

[0007] According to a VR system production method provided by the present invention, the acquisition of virtual reality VR panoramic video data includes: collecting real-scene environment data; constructing a three-dimensional virtual object according to the real-scene environment data; using the three-dimensional virtual object to build a VR scene; performing special effects production and animation production on objects in the VR scene; and recording the completed panoramic video to obtain the VR panoramic video data.

[0008] According to a VR system production method provided by the present invention, the special effects production and animation production of objects in the VR scene include: special effects production and animation production for static objects in the VR scene in a non-real-time human-computer interaction state, and for scenes in which dynamic objects interact with each other.

[0009] According to a VR system production method provided by the present invention, the special effect production includes adding particle effects, lens effects and visual effects; the animation production includes animation production of scenes of interaction between the dynamic objects.

[0010] According to a VR system manufacturing method provided by the present invention, the hardware device is a VR egg chair, and the VR egg chair includes a multi-degree-of-freedom platform, a motion control card and an appearance seat; the appearance seat is arranged on the multi-degree-of-freedom platform; the motion control card is used to control the electric cylinders of different axes of the multi-degree-of-freedom platform to perform telescopic movements after receiving motion control instructions, so as to realize multi-directional movement of the appearance seat.

[0011] According to a VR system manufacturing method provided by the present invention, the integrated processing of the panoramic interactive video data and the hardware device includes: docking with the hardware device through a predefined system interface to achieve data interaction and motion control.

[0012] According to a VR system production method provided by the present invention, the interface data of the system interface includes a position point, a time point, a motion type, an execution time, a step ratio, and a special effect type.

[0013] According to a VR system manufacturing method provided by the present invention, the static object includes a VR scene object whose display information in the VR scene does not change with the system running time.

[0014] According to a VR system manufacturing method provided by the present invention, the dynamic object includes a VR scene object whose display information in the VR scene changes with system running time or user triggering.

[0015] The present invention also provides a VR system, which is manufactured by any of the VR system manufacturing methods described above.

[0016] The VR system production method and VR system provided by the present invention can, on the one hand, obtain virtual reality VR panoramic video data and obtain panoramic interactive video data. Since the system transforms the loading process of various three-dimensional resources into the loading process of video resources, it can not only improve the scene loading speed but also reduce the requirements for hardware performance. On the other hand, since the second interactive data between the user and the dynamic object can be separately produced, and then the VR panoramic video data and the second interactive data are fused and processed, the second interactive data can be called separately, thereby improving the system update efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0018] Figure 1 This is one of the flow charts of the VR system manufacturing method provided by the present invention; Figure 2 This is the second flow chart of the VR system manufacturing method provided by the present invention. DETAILED DESCRIPTION

[0019] In order to make the purpose, technical solutions and advantages of this application clearer, the technical solutions in this application will be clearly and completely described below in conjunction with the drawings in this application. Obviously, the described embodiments are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0020] It should be noted that, in the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0021] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0022] In order to facilitate a clear description of the technical solutions of the embodiments of the present application, in the embodiments of the present application, words such as "first" and "second" are used to distinguish between identical or similar items with substantially the same functions and effects. Those skilled in the art can understand that words such as "first" and "second" do not limit the quantity and order of execution.

[0023] The embodiments of the present application describe some exemplary embodiments for the purpose of explanation. It should be understood that the present application can be implemented in other ways that are not specifically shown in the drawings.

[0024] like Figure 1 As shown, the embodiment of the present application provides a VR system manufacturing method, and the VR system manufacturing method may include S101-S103: S101. Acquire virtual reality VR panoramic video data.

[0025] Among them, the above-mentioned VR panoramic video data includes static objects, dynamic objects and first interaction data between dynamic objects.

[0026] Optionally, the static objects include VR scene objects whose display information does not change with the system running time in the VR scene. For example, they can be static VR scene objects such as terrain, buildings, plants, and ornaments. These static objects can provide object material support for the next non-real-time human-computer interaction part.

[0027] Optionally, the dynamic object includes a VR scene object whose display information changes with the system running time or user trigger in the VR scene. For example, it can be a moving vehicle, a flying bird, a crawling insect, a changing lighting, an ambient sound effect heard, a schematic diagram seen, a stone door opened after a collision, and other VR scene objects. These dynamic objects can realize the interaction simulation between scene objects and scene objects, as well as the interaction simulation between users and scene objects. Among them, the interaction between scene objects and scene objects can include frogs preying on insects in VR scenes, the position change of the sun over time, etc., and the interaction between scene objects and scene objects can be used for the non-real-time human-computer interaction part in the next step of interactive production. The interaction between users and scene objects can include a stone door opened after a collision, etc., and the interaction between users and scene objects can be used for the real-time human-computer interaction part in the panoramic interactive system.

[0028] It should be noted that the above display information at least includes information such as position, orientation, rotation, and scaling.

[0029] Optionally, the obtaining of virtual reality VR panoramic video data includes: collecting real-scene environment data; constructing a three-dimensional virtual object according to the real-scene environment data; using the three-dimensional virtual object to build a VR scene; performing special effects production and animation production on objects in the VR scene; and recording the completed panoramic video to obtain the VR panoramic video data.

[0030] Optionally, the performing special effects production and animation production on the objects in the VR scene includes: performing special effects production and animation production on static objects in the VR scene in a non-real-time human-computer interaction state, and on a scene in which dynamic objects interact with each other.

[0031] Specifically, Figure 2As shown, high-definition cameras, panoramic cameras, drones and other equipment can be used to shoot the actual scene from multiple angles and in all directions, and at the same time collect environmental sound effects, lighting and other data to obtain VR panoramic video data. Among them, for real-life panoramic videos shot with panoramic cameras or drones, there is no need to directly add special effects and animation production with VR scenes, and they can be directly used for some real-life VR panoramic roaming experience projects. Afterwards, professional 3D modeling software can be used to build 3D virtual objects based on the collected VR panoramic video data. Then, the VR scene is built using 3D virtual objects, and lights, materials and textures are arranged in the VR scene to simulate the lighting and texture of the real environment. Afterwards, the objects in the VR scene can be divided into static objects and dynamic objects, and then special effects and animation production can be performed on the static objects in the VR scene in the non-real-time human-computer interaction state, and the scenes where dynamic objects interact with each other; special effects and animation production can also be performed directly on the collected VR panoramic video data. After the above steps are completed, the VR panoramic camera can be used in the panoramic recording system to record VR 3D panorama or VR real-life panoramic video. After balancing the video quality and running frame rate, VR panoramic video data can be released to provide panoramic video resources for the panoramic interaction system.

[0032] Optionally, the special effects production includes adding particle effects, lens effects and visual effects, and the visual impact of the VR scene can be enhanced through special effects production. The animation production includes animation production of scenes in which the dynamic objects interact, such as animation of a frog preying on insects in a VR scene, animation of the sun changing position over time, etc.

[0033] S102. Separately generate second interaction data between the user and the dynamic object, and fuse the VR panoramic video data with the second interaction data to obtain panoramic interaction video data.

[0034] Specifically, Figure 2 As shown, the VR panoramic video data generated in the panoramic recording system can be imported into the resource folder of the panoramic interaction system to provide resources for VR panoramic production. In the panoramic interaction system, a panoramic sphere is created to play VR panoramic video data. That is, first create a sphere, usually at the origin. Then create a sphere material and assign the material to the sphere. After completion, add a video playback script to the sphere. Finally, place the VR camera at the center of the sphere. At this point, the VR panoramic sphere is complete.

[0035] By producing the second interactive data, real-time human-computer interaction based on VR panoramic video data can be realized. The second interactive data mainly deals with the real-time interaction between users and scene objects belonging to dynamic objects. The purpose of this design is that when roaming in a VR scene, it is often necessary to trigger some human-computer interaction operations at specific time points or location points. This part of the human-computer interaction operation often needs to be modified and adjusted more according to needs. If it is directly rendered into a VR panoramic video as a whole with the panoramic scene, once the user needs change or the on-site test is adjusted, it needs to be re-recorded and published in the panoramic recording system. If there are many changes and the changes are frequent, it is obviously not conducive to the rapid update and deployment of the system. In addition, the explanation voice, background sound effects, schematic animations, etc. in the VR video are not suitable for direct synthesis into the VR panoramic video.

[0036] For example, if the user is experiencing a VR egg sorting assembly line, the system has background sound, ambient sound, schematic picture animation, etc. When the user experiences a certain device, the roaming camera stops moving, and the device description picture pops up. At this time, the VR panoramic video should stop playing accordingly. If the aforementioned background sound and ambient sound are integrated into a VR video, then the background sound and ambient sound will suddenly pause, or stop before they are fully played. At the same time, if the device description picture animation takes several seconds to play, then the animation will not play or stop after playing part of it. This will seriously affect the user experience. Therefore, this part of the dynamic objects related to real-time user interaction should be independent of the VR panoramic video, and called separately as an independent part at a specific time point or position point. In this way, the stop of the VR video will not affect these dynamic objects, and the user can still get the experience effect of the process.

[0037] S103: Integrate the panoramic interactive video data with hardware devices.

[0038] Alternatively, if Figure 2 As shown, the hardware device is a VR egg chair, which includes a multi-degree-of-freedom platform, a motion control card and an appearance seat; the appearance seat is arranged on the multi-degree-of-freedom platform; the motion control card is used to control the electric cylinders in different axes of the multi-degree-of-freedom platform to perform telescopic movements after receiving motion control instructions, so as to realize multi-directional movement of the appearance seat.

[0039] Optionally, the integrating the panoramic interactive video data with the hardware device includes: docking with the hardware device through a predefined system interface to achieve data interaction and motion control.

[0040] Optionally, the interface data of the system interface includes position point, time point, motion type, execution time, step ratio and special effect type. The position point is the world coordinate position of the camera in the current VR scene. The time point is the current running time in the VR system. The motion type is identified by a series of character string identifiers representing left and right, front and back, up and down. The execution time is the time for the current action to be executed, and the default is linear uniform motion. The step ratio is the ratio of the current motion displacement to the maximum motion displacement allowed by default in the egg chair hardware system. If the maximum motion displacement is 100 units, the 0.5 identifier indicates that the maximum displacement allowed for the current action is 50 units. The special effect type is a special effect control identifier such as blowing, vibration, and spray.

[0041] It should be noted that by dividing the system production process into three parts: VR panoramic video data production, VR panoramic interaction processing, and egg chair hardware control, the relationship constraints between VR video production, VR interaction development, and egg chair hardware equipment selection can be removed. In actual development, they can be synchronized and parallelized, without the need for linear execution step by step like the traditional egg chair system. Not only does it significantly improve production efficiency; it can also achieve the experience effect of matching multiple sets of different actions with one set of VR panorama. The decoupling of the hardware system is also conducive to the connection of software and hardware with different manufacturers.

[0042] In the embodiment of the present application, on the one hand, virtual reality VR panoramic video data can be obtained, and panoramic interactive video data can be obtained. Since the system transforms the loading process of various three-dimensional resources into the loading process of video resources, it can not only improve the scene loading speed but also reduce the requirements for hardware performance. On the other hand, since the second interactive data between the user and the dynamic object can be produced separately, and then the VR panoramic video data and the second interactive data are fused and processed, the second interactive data can be called separately, thereby improving the system update efficiency.

[0043] The above mainly introduces the solution provided by the embodiment of the present application from the perspective of the method. In order to realize the above functions, it includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiment disclosed herein, the embodiment of the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present application.

[0044] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0045] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for producing a VR system, characterized in that: include: Acquire virtual reality (VR) panoramic video data, where the VR panoramic video data includes static objects, dynamic objects, and first interaction data between the dynamic objects; Separately generate second interaction data between the user and the dynamic object, and fuse the VR panoramic video data with the second interaction data to obtain panoramic interaction video data; The panoramic interactive video data is integrated with the hardware device for processing.

2. The VR system manufacturing method according to claim 1, characterized in that: The obtaining of virtual reality VR panoramic video data includes: Collect real-world environment data; Constructing a three-dimensional virtual object according to the real scene environment data; Using the three-dimensional virtual object to build a VR scene; Performing special effects and animation on objects in the VR scene; The completed panoramic video is recorded to obtain the VR panoramic video data.

3. The VR system manufacturing method according to claim 2, characterized in that: The special effects production and animation production of the objects in the VR scene includes: Special effects and animations are produced for static objects in VR scenes under non-real-time human-computer interaction states, as well as for scenes where dynamic objects interact with each other.

4. The VR system manufacturing method according to claim 2 or 3, characterized in that: The special effect production includes adding particle effects, lens effects and visual effects; the animation production includes animation production of scenes of interaction between the dynamic objects.

5. The VR system manufacturing method according to claim 1, characterized in that: The hardware device is a VR egg chair, which includes a multi-degree-of-freedom platform, a motion control card, and an exterior seat; The appearance seat is arranged on the multi-degree-of-freedom platform; the motion control card is used to control the electric cylinders in different axes of the multi-degree-of-freedom platform to perform telescopic motion after receiving the motion control instruction, so as to realize the multi-directional movement of the appearance seat.

6. The VR system manufacturing method according to claim 1 or 5, characterized in that: The integrated processing of the panoramic interactive video data and the hardware device includes: docking with the hardware device through a predefined system interface to achieve data interaction and motion control.

7. The VR system manufacturing method according to claim 6, characterized in that: The interface data of the system interface includes a position point, a time point, a motion type, an execution time, a step ratio, and a special effect type.

8. The VR system manufacturing method according to claim 1, characterized in that: The static object includes a VR scene object whose display information does not change with the system running time in the VR scene.

9. The VR system manufacturing method according to claim 1, characterized in that: The dynamic object includes a VR scene object whose display information changes with system running time or user triggering in the VR scene.

10. A VR system manufactured by the VR system manufacturing method according to any one of claims 1 to 9.

Images