Immersive large-space multi-person interaction system and method

Abstract

The invention discloses an immersive large-space multi-person interaction system and method, and relates to the technical field of virtual reality, the system comprises a data acquisition terminal, a network communication terminal, a virtual reality platform and a security verification terminal; through combination of the optical motion capture module and the wearable motion capture module, motion capture is carried out on a user in an interaction space, motion feature data of the user can be comprehensively and accurately collected, and it is ensured that a virtual character image in a subsequent virtual space can synchronously act with the user in the interaction space; a large-space virtual interaction scene is created through the virtual interaction scene creation unit, and a user virtual character image is created in the large-space virtual interaction scene through the virtual character creation unit, so that the virtual character image can effectively interact with a virtual environment, and in addition, a local area network communication service is provided through the local area network module; and the network environment of the system is monitored through the network monitoring module, so that the user can know the network environment state of the system in real time in the interaction process.

Description

Technical Field

[0001] The present invention relates to the field of virtual reality technology, and in particular to an immersive large-space multi-person interaction system and method. Background Art

[0002] Virtual Reality (VR) is a virtual world that simulates a three-dimensional space through computer technology. It refers to the process in which users interact with artificially constructed three-dimensional scenes in a virtual reality environment through specific hardware devices and software platforms to obtain perceptions and experiences similar to the real world. Virtual reality technology integrates research results in computer graphics, human-computer interface technology, sensor technology, psychology and other fields, aiming to provide users with immersive, interactive and conceptual experience.

[0003] With the development of science and technology and the improvement of people's requirements, more and more people have fallen in love with virtual reality interactive systems. However, with the continuous development of virtual reality technology, people are gradually not satisfied with simply interacting with the virtual reality environment. Immersive large-space multi-person interactive technology has emerged. It combines virtual reality (VR), augmented reality (AR), holographic projection and other interactive technologies to create an immersive experience environment that allows multiple users to participate together in the same physical space.

[0004] Most of the existing immersive large-space multi-person interaction systems have single functions and are unable to comprehensively and accurately collect the user's action characteristics, resulting in the inability to ensure that the virtual character images in the virtual space can synchronize the actions with the users in the interactive space, reducing the user interaction experience. In addition, it is not convenient to monitor the network environment in which the system is located in real time during the interaction process, resulting in the user being unable to know the system's network environment status in real time during the interaction process and unable to make corresponding processing in time, which reduces the interaction stability to a certain extent. Therefore, the present invention proposes an immersive large-space multi-person interaction system and method to solve the problems existing in the prior art. Summary of the invention

[0005] In view of the above problems, the purpose of the present invention is to propose an immersive large-space multi-person interaction system and method to solve the problems that the existing immersive multi-person interaction system cannot ensure that the virtual characters in the virtual space can move synchronously with the users in the interactive space, thereby reducing the user interaction experience, and it is not convenient to monitor the network environment of the system in real time during the interaction process, resulting in the user being unable to know the network environment status of the system in real time during the interaction process.

[0006] In order to achieve the purpose of the present invention, the present invention is implemented by the following technical solutions: an immersive large-space multi-person interaction system, including a data acquisition terminal, a network communication terminal, a virtual reality platform and a security verification terminal;

[0007] The data acquisition terminal includes an optical motion capture module and a wearable motion capture module for capturing the motion of a user in the interactive space, and a data transmission module for sending the captured motion data to the virtual reality platform;

[0008] The network communication terminal includes a local area network module for providing local area network communication services to various devices in the system and a network monitoring module for monitoring the network environment in which the system is located;

[0009] The virtual reality platform includes a data processing module for receiving and processing captured motion data, a data storage module for storing material data for constructing a virtual environment, a virtual environment construction module for constructing a large-space virtual reality environment for multi-person interaction, and a virtual environment feedback module for displaying the constructed virtual reality environment feedback to the user;

[0010] The security verification terminal comprises an identity verification module for verifying user identity information and a data encryption module for encrypting and protecting data generated during multi-person interaction.

[0011] A further improvement is that: the optical motion capture module includes an optical camera arranged in the interactive space and a motion capture suit worn by the user in the interactive space, and the joints of the motion capture suit are equipped with reflective marking points adapted to the optical camera;

[0012] The wearable motion capture module comprises data gloves, wearable waist guards and wearable leg guards worn by users in the interactive space, and the data gloves, wearable waist guards and wearable leg guards are all equipped with inertial sensors.

[0013] A further improvement is that the data transmission module includes a data preprocessing unit for cleaning and preprocessing the captured motion data and a data sending unit for sending the preprocessed motion data to the virtual reality platform, and the data sending unit uses lossless compression technology to compress the preprocessed data and send it to the virtual reality platform through a network communication system.

[0014] Further improvements are: the local area network module uses optical fiber as the physical medium to connect the communication network of each device in the system within the interactive space of the system, and provides local area network communication services between the devices in the system. The network monitoring module includes a network detection unit for detecting the network communication status and a detection notification unit for notifying the user of the network communication status detection result.

[0015] A further improvement is that the data processing module includes a data receiving unit for receiving data transmitted by the data transmission module, a data conversion unit for performing data conversion on the received data, and a feature extraction unit for performing feature extraction on the converted data. After receiving the data, the data receiving unit uses lossless decompression technology to decompress the data compression package, the data conversion unit standardizes the decompressed data to make its format unified, and the feature extraction unit uses principal component analysis to extract feature data from the standardized data.

[0016] A further improvement is that the virtual environment construction module includes a virtual interaction scene creation unit for creating a large-space virtual interaction scene and a virtual character creation unit for creating a user virtual character image in the large-space virtual interaction scene. The virtual character creation unit provides the user with a virtual character image design and creation function, and imports the target action features obtained by the data processing module into the created virtual character, so that the virtual character and the user in the interaction space move synchronously. The virtual interaction scene creation unit uses virtual reality technology to simulate real landscapes, and combines three-dimensional rendering engine technology to generate a virtual space, and at the same time imports the material data stored in the data storage module into the virtual space.

[0017] A further improvement is that the virtual environment feedback module includes a virtual display unit for displaying a large-space virtual reality environment for multi-person interaction and a virtual feedback unit for sending the large-space virtual reality environment for multi-person interaction constructed by the virtual environment construction module to the virtual display unit, and the virtual display unit is a wearable VR helmet.

[0018] Further improvements are: the identity authentication module performs identity authentication and access control on users participating in virtual interactions, and the data encryption module encrypts and protects data generated during user interactions in the system through blockchain technology.

[0019] An interactive method for an immersive large-space multi-person interactive system comprises the following steps: firstly, using a security verification system to authenticate the identities of various users in the interactive space, and after the verification is passed, each user logs into the system, and then using an optical motion capture module and a wearable motion capture module in a data acquisition system to capture the motion of the users in the interactive space, and using a data transmission module to send the captured motion data to a virtual reality platform through a network communication terminal, and then using a data processing module in the virtual reality platform to receive the motion data and extract feature data therein, and then using a virtual environment construction module to construct a virtual interactive scene based on the extracted feature data and in combination with material data stored in a data storage module, and then using a virtual environment feedback module to feed back the constructed virtual interactive scene to the users in the interactive space and display it to the users, so that different users in the interactive space can perform immersive interaction in the same virtual interactive scene.

[0020] The beneficial effects of the present invention are as follows: the present invention performs motion capture of users in an interactive space through a combination of an optical motion capture module and a wearable motion capture module, and can comprehensively and accurately collect the user's motion feature data, thereby ensuring that the virtual character image in the subsequent virtual space can synchronize the movements with the user in the interactive space, thereby improving the user interaction experience; and a large-space virtual interaction scene is created through a virtual interaction scene creation unit, and a user virtual character image is created in the large-space virtual interaction scene through a virtual character creation unit, so that the virtual character image can effectively interact with the virtual environment, thereby bringing a good immersive large-space interaction experience to multiple users; in addition, a local area network module is used to provide local area network communication services for various devices in the system, and a network monitoring module is used to monitor the network environment of the system, so that the user can know the network environment status of the system in real time during the interaction process, and can make corresponding processing in time, thereby improving the stability of the entire interaction process. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0022] Figure 1 It is a structural schematic diagram of the immersive large-space multi-person interaction system of the present invention. DETAILED DESCRIPTION

[0023] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0024] Embodiment 1

[0025] See also Figure 1 This embodiment provides an immersive large-space multi-person interaction system, including a data acquisition terminal for capturing motion data of users in the interaction space, a network communication terminal for providing network communication services, a virtual reality platform for providing a virtual reality environment for users in the interaction space, and a security verification terminal for authenticating the identity of users in the interaction space. The interactive space in this embodiment has an area sufficient for multiple users to interact with multiple people, wherein:

[0026] The data acquisition terminal includes an optical motion capture module, a wearable motion capture module and a data transmission module. The optical motion capture module and the wearable motion capture module are used to capture the motion of the user in the interactive space. The data transmission module is used to send the captured motion data to the virtual reality platform.

[0027] The network communication terminal includes a local area network module and a network monitoring module. The local area network module is used to provide local area network communication services for each device in the system, and the network monitoring module is used to monitor the network environment in which the system is located;

[0028] The virtual reality platform includes a data processing module, a data storage module, a virtual environment construction module and a virtual environment feedback module. The data processing module is used to receive and process the captured action data. The data storage module is used to store the material data for virtual environment construction. Distributed database technology is used to achieve the storage and management of massive data. The data backup and recovery mechanism ensures the security and reliability of data. The virtual environment construction module is used to build a large-space virtual reality environment for multi-person interaction. The virtual environment feedback module is used to display the constructed virtual reality environment feedback to the user.

[0029] The security verification terminal includes an identity authentication module and a data encryption module. The identity authentication module is used to verify user identity information and perform identity authentication and access control on users participating in virtual interactions in the interactive space. The data encryption module uses blockchain technology to encrypt and protect the data generated during user interactions in the system, thereby improving the security of data transmission and storage.

[0030] The optical motion capture module includes an optical camera and a motion capture suit, wherein the optical camera is arranged in the interactive space and can monitor and track target feature points on the user from different angles in the interactive space to achieve motion capture. The motion capture suit is worn by the user in the interactive space, and the joints of the motion capture suit are equipped with reflective marking points (i.e., target feature points) that are compatible with the optical camera, so that the optical camera can capture the motion features of each joint of the user.

[0031] The wearable motion capture module includes data gloves, wearable waist guards and wearable leg guards. The data gloves, wearable waist guards and wearable leg guards are all worn by users in the interactive space, and the data gloves, wearable waist guards and wearable leg guards are all equipped with built-in inertial sensors to facilitate capturing the motion characteristics of the user's hands, waist and legs.

[0032] The data transmission module includes a data preprocessing unit and a data sending unit, wherein the data preprocessing unit is used to clean and preprocess the captured motion data, specifically including missing value processing, outlier processing and duplicate data processing, so as to make the data clearer and more accurate; the data sending unit is used to send the preprocessed motion data to the data sending unit of the virtual reality platform, and the data sending unit uses lossless compression technology to compress the preprocessed data and send it to the virtual reality platform through a network communication system.

[0033] The LAN module uses optical fiber as the physical medium to connect the communication network of each device in the system within the interactive space of the system, providing LAN network communication services between the devices in the system. The LAN module uses a switch to quickly forward data packets. The switch can quickly route data packets to the target device according to the destination address, greatly improving the transmission efficiency.

[0034] The network monitoring module includes a network detection unit and a detection notification unit. The network detection unit is used to detect the network communication status and provide real-time network monitoring. It can quickly implement user offline notification, weak network notification and disconnection reconnection functions. The detection notification unit is used to notify the user of the network communication status detection results so that the user can handle it in time.

[0035] The data processing module includes a data receiving unit, a data conversion unit and a feature extraction unit, wherein the data receiving unit is used to receive data transmitted by the data transmission module, the data conversion unit is used to perform data conversion on the received data, and the feature extraction unit is used to extract features from the converted data. After receiving the data, the data receiving unit uses lossless decompression technology to decompress the data compression package, and the data conversion unit standardizes the decompressed data to make its format unified for subsequent feature extraction. In this embodiment, the feature extraction unit uses principal component analysis to extract feature data from the standardized data so as to subsequently establish the user's virtual character image.

[0036] The virtual environment construction module includes a virtual interaction scene creation unit and a virtual character creation unit, wherein the virtual interaction scene creation unit is used to create a large-space virtual interaction scene, and the virtual character creation unit is used to create a user virtual character image in a large-space virtual interaction scene. The virtual character creation unit provides users with virtual character image design and creation functions, and imports the target action features obtained by the data processing module into the created virtual character, so that the virtual character and the user in the interactive space move synchronously. The virtual interaction scene creation unit uses virtual reality technology to simulate real landscapes, and combines it with three-dimensional rendering engine technology to generate a virtual space. At the same time, the material data stored in the data storage module is imported into the virtual space, so that it interacts with objects in the virtual space to form a virtual interaction scene, bringing an immersive large-space scene experience to users.

[0037] The virtual environment feedback module includes a virtual display unit and a virtual feedback unit, wherein the virtual reality unit is used to display a large-space virtual reality environment for multi-person interaction, and the virtual feedback unit is used to send the large-space virtual reality environment for multi-person interaction constructed by the virtual environment construction module to the virtual display unit. The virtual display unit is a wearable VR helmet. Users in the interactive space wear wearable VR helmets to watch the virtual interactive scene, and use the virtual space as a fixed reference system to allow users to perceive their own displacement and perspective rotation.

[0038] Embodiment 2

[0039] This embodiment provides an interactive method for an immersive large-space multi-person interactive system, comprising the following steps:

[0040] Step 1: First, use the security verification system to authenticate the identities of each user in the interactive space. After the verification, each user logs into the system. Then, use the optical motion capture module and the wearable motion capture module in the data acquisition system to capture the motion of the users in the interactive space. Use the data transmission module to send the captured motion data to the virtual reality platform through the network communication terminal.

[0041] Step 2: The data processing module in the virtual reality platform then receives the action data and extracts the feature data therein, and then uses the virtual environment construction module to construct a virtual interaction scene based on the extracted feature data and in combination with the material data stored in the data storage module. The constructed virtual interaction scene is then fed back to the users in the interaction space using the virtual environment feedback module and displayed to the users, so that different users in the interaction space can conduct immersive large-space multi-person interaction in the same virtual interaction scene.

[0042] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. An immersive large-space multi-person interactive system, characterized by: Including data collection terminals, network communication terminals, virtual reality platforms and security verification terminals; The data acquisition terminal includes an optical motion capture module and a wearable motion capture module for capturing the motion of a user in the interactive space, and a data transmission module for sending the captured motion data to the virtual reality platform; The network communication terminal includes a local area network module for providing local area network communication services to various devices in the system and a network monitoring module for monitoring the network environment in which the system is located; The virtual reality platform includes a data processing module for receiving and processing captured motion data, a data storage module for storing material data for constructing a virtual environment, a virtual environment construction module for constructing a large-space virtual reality environment for multi-person interaction, and a virtual environment feedback module for displaying the constructed virtual reality environment feedback to the user; The security verification terminal comprises an identity verification module for verifying user identity information and a data encryption module for encrypting and protecting data generated during multi-person interaction.

2. An immersive large-space multi-person interaction system according to claim 1, characterized in that: The optical motion capture module includes an optical camera arranged in the interactive space and a motion capture suit worn by the user in the interactive space, wherein the joints of the motion capture suit are equipped with reflective marking points adapted to the optical camera; The wearable motion capture module comprises data gloves, wearable waist guards and wearable leg guards worn by users in the interactive space, and the data gloves, wearable waist guards and wearable leg guards are all equipped with inertial sensors.

3. The immersive large-space multi-person interaction system according to claim 1, characterized in that: The data transmission module includes a data preprocessing unit for cleaning and preprocessing the captured motion data and a data sending unit for sending the preprocessed motion data to the virtual reality platform. The data sending unit uses lossless compression technology to compress the preprocessed data and sends it to the virtual reality platform through a network communication system.

4. The immersive large-space multi-person interaction system according to claim 1, characterized in that: The LAN module uses optical fiber as a physical medium to connect the communication networks of various devices in the system within the interactive space of the system, and provides LAN network communication services between various devices in the system. The network monitoring module includes a network detection unit for detecting the network communication status and a detection notification unit for notifying the user of the network communication status detection result.

5. The immersive large-space multi-person interaction system according to claim 1, characterized in that: The data processing module includes a data receiving unit for receiving data transmitted by the data transmission module, a data conversion unit for performing data conversion on the received data, and a feature extraction unit for performing feature extraction on the converted data. After receiving the data, the data receiving unit uses lossless decompression technology to decompress the data compression package, the data conversion unit standardizes the decompressed data to make its format unified, and the feature extraction unit uses principal component analysis to extract feature data from the standardized data.

6. The immersive large-space multi-person interaction system according to claim 1, characterized in that: The virtual environment construction module includes a virtual interaction scene creation unit for creating a large-space virtual interaction scene and a virtual character creation unit for creating a user virtual character image in the large-space virtual interaction scene. The virtual character creation unit provides the user with a virtual character image design and creation function, and imports the target action features processed by the data processing module into the created virtual character, so that the virtual character and the user in the interaction space move synchronously. The virtual interaction scene creation unit uses virtual reality technology to simulate real landscapes, and combines three-dimensional rendering engine technology to generate a virtual space, and at the same time imports the material data stored in the data storage module into the virtual space.

7. The immersive large-space multi-person interaction system according to claim 1, characterized in that: The virtual environment feedback module includes a virtual display unit for displaying a large-space virtual reality environment for multi-person interaction and a virtual feedback unit for sending the large-space virtual reality environment for multi-person interaction constructed by the virtual environment construction module to the virtual display unit, and the virtual display unit is a wearable VR helmet.

8. The immersive large-space multi-person interactive system according to claim 1, characterized in that: The identity authentication module performs identity authentication and access control on users participating in virtual interactions, and the data encryption module encrypts and protects data generated during user interactions in the system through blockchain technology.

9. The interactive method applied to the immersive large-space multi-person interactive system of claim 1, characterized in that: The method comprises the following steps: firstly, using a security verification system to authenticate the identities of various users in the interactive space, and after the verification is passed, various users log into the system, and then using an optical motion capture module and a wearable motion capture module in a data acquisition system to capture the motions of the users in the interactive space, and using a data transmission module to send the captured motion data to a virtual reality platform through a network communication terminal, and then using a data processing module in the virtual reality platform to receive the motion data and extract feature data therein, and then using a virtual environment construction module to construct a virtual interactive scene based on the extracted feature data and in combination with the material data stored in the data storage module, and then using a virtual environment feedback module to feed back the constructed virtual interactive scene to the users in the interactive space and display it to the users, so that different users in the interactive space can interact immersively in the same virtual interactive scene.

Images