Virtual reality software platform system

Abstract

A virtual reality software platform system disclosed by the present invention comprises a central processing unit and a wearable virtual reality device, the wearable virtual reality device comprises a head-mounted device, a motion capture device and an integrated knapsack, the central processing unit presents a three-dimensional virtual space appearance, and the central processing unit presents a three-dimensional virtual space appearance. The three-dimensional virtual space comprises a user virtual image, a system setting menu, an application store menu and a my application menu, the my application menu comprises a plurality of three-dimensional application software icons, and the icons enter associated three-dimensional application software after being triggered. According to the virtual reality software platform system, the processing module controls the plurality of image generation devices to generate the plurality of video images according to the original image data, so that the plurality of video images and the entity setting generate a virtual reality effect, the sound production device is arranged, and the arrangement positions of the plurality of image generation devices are planned; therefore, a more real overall landscape effect is generated, and the effect of being personally on the scene is achieved.

Description

Technical Field

[0001] The present invention relates to the technical field of virtual reality software platform systems, and in particular to a virtual reality software platform system. Background Art

[0002] Currently, most VR users connect VR glasses to a computer, open a driver platform on the computer, run a VR game or 3D movie, and then put on the glasses to enter the VR experience. A deeper experience requires the use of tactile feedback devices such as data gloves and torque balls. Kinect and other devices capture user motion using optical, electromagnetic, or video methods, providing realistic feedback of user movements in the virtual world. Other methods use motion-sensing devices such as duck eggshells to impart a sense of shaking and vibration to the user. However, this deeper experience is expensive, and thus less popular.

[0003] Virtual reality games primarily utilize software like 3dsMax for basic modeling, followed by VRP or VRML for interactive modeling. C / C++ and Java are the mainstream programming languages. Currently, the Kinect-enabled LaputaVR glasses display supports small-scale networking. There are also games like VR Tennis that can be played with two players using Bluetooth®. However, motion tracking, reducing refresh rate latency, and the difficulty of computing data for large-scale multiplayer networks make large-scale networking difficult. Difficulties in improving display image quality and recognizing subtle movements result in less realistic gaming experiences.

[0004] While current virtual reality experiences are possible, they suffer from several drawbacks. First, virtualization technology is immature, preventing most users from achieving sufficient immersion and experiencing a virtual world fully isolated from the outside world. Furthermore, networking technology is immature, preventing users from engaging in large-scale online gaming, watching movies together in virtual worlds, and holding meetings together, as is possible in real life. Furthermore, the diverse operating platforms for virtual reality glasses lack standardization. Users require different platform drivers to launch different games, and downloading 3D movies requires their own search. There's no unified support system. Finally, operation is cumbersome. For many elderly and children with limited computer skills, even those who can operate a basic computer cannot easily install and access virtual reality drivers. This makes these users unfamiliar with virtual reality or even uninitiated. Or, even if they have heard of it, they're unwilling to invest the time to explore it. Summary of the Invention

[0005] (1) Technical problems solved In view of the deficiencies of the existing technology, the present invention provides a virtual reality software platform system.

[0006] (2) Technical solution To achieve the above objectives, the present invention provides the following technical solutions: a virtual reality software platform system, comprising a central processing unit (CPU) and a wearable virtual reality device, wherein the wearable virtual reality device comprises a head-mounted device (HMD), a motion capture device, and an integrated backpack; the CPU presents a three-dimensional virtual space appearance, wherein the three-dimensional virtual space includes a user avatar, a system settings menu, an app store menu, and a "My Apps" menu, wherein the "My Apps" menu includes a plurality of three-dimensional application software icons, and when an icon is triggered, the associated three-dimensional application software is entered; The head-mounted device includes a head-mounted display for displaying a virtual scene; The motion capture device includes a plurality of motion capture sensors, which are suitable for being arranged at a plurality of parts of the user's body and for respectively sensing the motions of the plurality of parts of the user's body; The integrated backpack includes: a processor, the processor being connected to the motion capture device and the head-mounted display, respectively, for receiving real motion information acquired by the motion capture device, achieving a virtual reality effect based on the real motion information and a preset virtual scene, and sending a corresponding virtual reality image to the head-mounted display; A physical set is disposed in an indoor space; and a plurality of image generating devices are disposed in the indoor space and each generates a video image in the indoor space. The plurality of video images are generated on a projection surface in the indoor space and partially overlap to generate a combined image having a three-dimensional effect. The contents and generated positions of the multiple video images correspond to the physical setting, and the combined image generated by partially overlapping the multiple video images is combined with the corresponding physical setting to create a complete overall landscape effect. Preferably, each of the multiple image generating devices is a projector, and the multiple image generating devices are arranged on the same horizontal line. At the same time, the number and location of the multiple image generating devices are determined according to the size of the indoor space and the effects to be presented by the multiple video images.

[0007] Preferably, it also includes: a processing module, which contains original image data, and the processing module processes the original image data according to the positions of the multiple image generating devices, the size of the indoor space and the desired effect to be presented, thereby generating multiple video image data, and transmitting the multiple video image data to the corresponding multiple image generating devices respectively, so that the multiple image generating devices respectively generate their own video images in the indoor space.

[0008] Preferably, it also includes: a sound-generating device, an odor-generating device, a wind-sensing device or a combination thereof, wherein the sound-generating device produces stereo sound in conjunction with the overall landscape effect, the odor-generating device produces odor in conjunction with the overall landscape effect, and the wind-sensing device makes the air in the indoor space flow in conjunction with the overall landscape effect.

[0009] Preferably, the integrated backpack includes four storage spaces, which are respectively located at the four corners of the integrated backpack corresponding to the user's limbs. Each of the storage spaces is used to store the motion capture device on the corresponding limb. Each of the storage spaces includes a slot, which is connected to the processor and is suitable for inserting the plug of the transmission line of the motion capture device on the corresponding limb. A transmission line connected to a slot connects all the motion capture devices on the limb corresponding to the slot in series.

[0010] Preferably, the head-mounted device also includes a gesture recognition lens for identifying the user's hand image information, and an inertial sensor suitable for being worn on the user's hand for determining the positive and negative posture information of the user's hand. The processor fuses the positive and negative posture information of the hand obtained by the inertial sensor and the hand image information obtained by the gesture recognition lens into complete hand information.

[0011] Preferably, the interface system is connected to the head-mounted display data, and a menu is triggered by clicking or detecting user behavior. An application manager is provided in the system settings menu of the three-dimensional space, and the application manager is used to add, delete, and modify three-dimensional application software. A system status manager is provided in the system settings menu of the three-dimensional virtual space, and the system status manager is used to display system status parameters. An application store website link is provided in the application store menu of the three-dimensional virtual space, and the application store menu is used for users to purchase, download, and install functions.

[0012] Preferably, the system also includes a my application menu, which, when opened, will display the installed three-dimensional application software. The three-dimensional application software can be triggered by clicking or executing a set action. The three-dimensional application software is various three-dimensional commercial software, three-dimensional movies, three-dimensional game software or another three-dimensional virtual space.

[0013] (3) Beneficial effects Compared with the existing technology, the present invention provides a virtual reality software platform system with the following beneficial effects: This virtual reality software platform system controls multiple image generation devices to generate multiple video images based on original image data through a processing module, so that the multiple video images and physical scenery produce a virtual reality effect. A sound device is provided and the placement of multiple image generation devices is planned to produce a more realistic overall landscape effect, achieving an immersive effect. DETAILED DESCRIPTION

[0014] The following will be combined with the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0015] A virtual reality software platform system includes a central processing unit (CPU) and a wearable virtual reality device, wherein the wearable virtual reality device includes a head-mounted device (HMD), a motion capture device, and an integrated backpack. The CPU presents the appearance of a three-dimensional virtual space, which includes a user avatar, a system settings menu, an app store menu, and a "My Apps" menu. The "My Apps" menu includes several three-dimensional application software icons, and when an icon is triggered, the associated three-dimensional application software is entered. The head-mounted device includes a head-mounted display for displaying a virtual scene; The motion capture device includes a plurality of motion capture sensors, which are suitable for being arranged at multiple locations on the user's body and for respectively sensing motions of the multiple locations on the user's body; The integrated backpack includes: a processor, the processor being connected to a motion capture device and a head-mounted display, respectively, for receiving real motion information acquired by the motion capture device, achieving a virtual reality effect based on the real motion information and a preset virtual scene, and sending a corresponding virtual reality image to the head-mounted display; A physical set is disposed in an indoor space; and a plurality of image generating devices are disposed in the indoor space and each generates a video image in the indoor space. The plurality of video images are generated on a projection surface in the indoor space and partially overlap to generate a combined image having a three-dimensional effect. The contents and generated positions of the multiple video images correspond to the physical setting, and the combined image generated by partially overlapping the multiple video images is combined with the corresponding physical setting to create a complete overall landscape effect. Furthermore, in an embodiment of the present invention, the multiple image generating devices are respectively a projector, and the multiple image generating devices are arranged on the same horizontal line. At the same time, the number and location of the multiple image generating devices are determined according to the size of the indoor space and the effects to be presented by the multiple video images.

[0016] Furthermore, in an embodiment of the present invention, it also includes: a processing module, which contains original image data. The processing module processes the original image data according to the positions of the multiple image generating devices, the size of the indoor space and the desired effect to be presented, thereby generating multiple video image data, and transmitting the multiple video image data to the corresponding multiple image generating devices respectively, so that the multiple image generating devices respectively generate their own video images in the indoor space.

[0017] Furthermore, in an embodiment of the present invention, it also includes: a sound-generating device, an odor-generating device, a wind-sensing device or a combination thereof, wherein the sound-generating device produces stereo sound in conjunction with the overall landscape effect, the odor-generating device produces odor in conjunction with the overall landscape effect, and the wind-sensing device makes the air in the indoor space flow in conjunction with the overall landscape effect.

[0018] Furthermore, in an embodiment of the present invention, the integrated backpack includes four storage spaces, which are located at the four corners of the integrated backpack corresponding to the user's limbs. Each storage space is used to store the motion capture device on the corresponding limb. Each storage space includes a slot, which is connected to the processor, and the slot is suitable for inserting the plug of the transmission line of the motion capture device on the corresponding limb. A transmission line connected to a slot connects all the motion capture devices on the limb corresponding to the slot in series.

[0019] Furthermore, in an embodiment of the present invention, the head-mounted device also includes a gesture recognition lens for identifying the user's hand image information, and an inertial sensor suitable for being worn on the user's hand for determining the positive and negative posture information of the user's hand. The processor fuses the positive and negative posture information of the hand obtained by the inertial sensor and the hand image information obtained by the gesture recognition lens into complete hand information.

[0020] Furthermore, in an embodiment of the present invention, a laser positioning base station is fixedly arranged at a predetermined position in space, and is used to scan a positioning beam into space with a predetermined scanning period, and the cross-section of the positioning beam is a straight line segment; a plurality of positioning beam receivers are fixed on the outer surface of the head-mounted device and / or the integrated backpack, and are used to receive the positioning beam scanned by the laser positioning base station with a predetermined scanning period, and the relative spatial position relationship between the plurality of positioning beam receivers is fixed. The processor determines the position of the head-mounted virtual reality device and / or the integrated backpack based on the time, scanning period, relative spatial position relationship of the positioning beams received by the four positioning beam receivers respectively, and the predetermined position of the positioning beam emitting device.

[0021] Specifically, the laser positioning base station includes: a first scanning light source, which rotates around the axis with a scanning period and scans a first positioning beam into the space; a sensor, which is fixedly arranged near the first scanning light source and sends a start signal in response to sensing the first positioning beam; a surface light source, which is connected to the sensor and emits a planar light pulse in response to receiving the start signal.

[0022] Furthermore, in an embodiment of the present invention, the interface system is connected to the head-mounted display data, and the menu is triggered by clicking or detecting user behavior. The system settings menu of the three-dimensional space is provided with an application manager, and the application manager is used to add, delete, and modify three-dimensional application software. The system settings menu of the three-dimensional virtual space is provided with a system status manager, and the system status manager is used to display system status parameters. The application store menu of the three-dimensional virtual space is provided with an application store website link, and the application store menu is used for users to purchase, download, and install functions.

[0023] Furthermore, in an embodiment of the present invention, the system also includes a my application menu. When the system menu is opened, it will display the installed three-dimensional application software. The three-dimensional application software can be triggered by clicking or executing a set action. The three-dimensional application software is various three-dimensional commercial software, three-dimensional movies, three-dimensional game software or another three-dimensional virtual space.

[0024] While embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions, and variations may be made to these embodiments without departing from the principles and spirit of the invention, and that the scope of the invention is defined by the appended claims and their equivalents.

Claims

1. A virtual reality software platform system, comprising a central processing unit and a wearable virtual reality device, characterized in that: The wearable virtual reality device includes a head-mounted device, a motion capture device, and an integrated backpack. The central processing unit presents a three-dimensional virtual space appearance. The three-dimensional virtual space includes a user virtual image, a system settings menu, an application store menu, and a my application menu. The my application menu includes a plurality of three-dimensional application software icons. When the icon is triggered, the associated three-dimensional application software is entered. The head-mounted device includes a head-mounted display for displaying a virtual scene; The motion capture device includes a plurality of motion capture sensors, which are suitable for being arranged at a plurality of parts of the user's body and for respectively sensing the motions of the plurality of parts of the user's body; The integrated backpack includes: a processor, the processor being connected to the motion capture device and the head-mounted display, respectively, and configured to receive real-life motion information acquired by the motion capture device, realize a virtual reality effect based on the real-life motion information and a preset virtual scene, and transmit a corresponding virtual reality image to the head-mounted display; a physical set, disposed in an indoor space; and a plurality of image generating devices, disposed in the indoor space, and respectively generating a respective video image in the indoor space. The plurality of video images are generated on a projection surface in the indoor space and partially overlap to generate a combined image having a three-dimensional effect. The contents and generated positions of the multiple video images correspond to the physical setting, and the combined image generated by partially overlapping the multiple video images is combined with the corresponding physical setting to create a complete overall landscape effect.

2. A virtual reality software platform system according to claim 1, characterized in that: The multiple image generating devices are respectively a projector, and the multiple image generating devices are arranged on the same horizontal line. At the same time, the number and location of the multiple image generating devices are determined according to the size of the indoor space and the effects to be presented by the multiple video images.

3. A virtual reality software platform system according to claim 1, characterized in that: Also includes: A processing module contains raw image data. The processing module processes the raw image data according to the positions of the multiple image generating devices, the size of the indoor space, and the desired effect to generate multiple video image data. The processing module transmits the multiple video image data to the corresponding multiple image generating devices, so that the multiple image generating devices respectively generate their own video images in the indoor space.

4. A virtual reality software platform system according to claim 1, characterized in that: Also includes: A sound-generating device, an odor-generating device, a wind-sensing device, or a combination thereof, wherein the sound-generating device produces stereo sound in conjunction with the overall landscape effect, the odor-generating device produces odor in conjunction with the overall landscape effect, and the wind-sensing device causes air in the indoor space to flow in conjunction with the overall landscape effect.

5. A virtual reality software platform system according to claim 1, characterized in that: The integrated backpack includes four storage spaces, which are located at the four corners of the integrated backpack corresponding to the user's limbs. Each storage space is used to store the motion capture device on the corresponding limb. Each storage space includes a slot, which is connected to the processor and is suitable for inserting the plug of the transmission line of the motion capture device on the corresponding limb. A transmission line connected to a slot connects all the motion capture devices on the limb corresponding to the slot in series.

6. A virtual reality software platform system according to claim 1, characterized in that: The head-mounted device also includes a gesture recognition lens for identifying the user's hand image information, and an inertial sensor suitable for being worn on the user's hand, for determining the forward and reverse gesture information of the user's hand. The processor fuses the forward and reverse gesture information of the hand obtained by the inertial sensor and the hand image information obtained by the gesture recognition lens into complete hand information.

7. A virtual reality software platform system according to claim 1, characterized in that: The interface system is connected to the head-mounted display data and triggers the menu by clicking or detecting user behavior. The system settings menu of the three-dimensional space is provided with an application management program, and the application management program is used to add, delete, and modify three-dimensional application software. The system settings menu of the three-dimensional virtual space is provided with a system status management program, and the system status management program is used to display system status parameters. The application store menu of the three-dimensional virtual space is provided with an application store website link, and the application store menu is used for users to purchase, download, and install functions.

8. A virtual reality software platform system according to claim 7, characterized in that: The system also includes a my application menu, which, when opened, displays installed 3D application software. The 3D application software can be triggered by clicking or executing a set action. The 3D application software includes various 3D commercial software, 3D movies, 3D game software, or another 3D virtual space.