Multi-person interaction method, hardware and application in large-space VR scene

Abstract

The invention relates to a multi-person interaction method, hardware and application in a large-space VR scene, more than one interaction node is accessed, an identification mechanism based on a large space is constructed, and all interaction nodes compete for a central node; based on an identification mechanism, data information is interacted between the cloud and the center node, a dynamic adjustable interaction chain is constructed between the center node and the interaction node based on positioning information, and the data information is interacted based on the relationship of the interaction chain; implementation of hardware is completed based on the method, and the method is applied to interaction experience in a VR scene. According to the method, the center node is selected, postures of other interaction nodes except the center node can be distributed to the VR equipment of a single user one by one according to the interaction chain, multi-user interaction in a virtual environment is realized, and on the basis of reducing the calculation amount and the information uploading amount, by combining with the cooperation of an identification mechanism, the user experience is improved. The positioning information of all interaction nodes can be better and faster obtained, and multi-person interaction is smoother.

Description

Technical Field

[0001] The present invention relates to the technical field of electronic digital data processing, and particularly relates to a multi-person interaction method, hardware and application in a large-space VR scenario. Background Art

[0002] A large-space VR scenario is a scenario that uses VR technology to create an immersive experience in a relatively large space. Through VR technology, it fully utilizes its virtual reality experience and the sense of space endowed by the large space, providing more explorability for diverse VR experiences.

[0003] With the development of research and development, large-space VR scenarios are more and more applied to "on-site visit experience" and "multi-person interaction experience". In the former, by placing the content of the visit experience in the VR scenario, users can be immersed in the virtual world or create a relaxed immersive experience atmosphere, while the latter mostly appears in large-scale multi-player battle games or multi-person interactive scenarios.

[0004] In the face of multi-person interaction experience, the performance in the existing VR scenarios is relatively average, and its main problems are as follows: (1) It is impossible to implement high-precision positioning efficiently and quickly, resulting in incorrect information distributed to the VR environment of users; (2) During the multi-person interaction experience, each thread may send requests or submit data to the server together. In the case of a large degree of sensor diversification and a fast data refresh rate, it is very easy to have a lag situation in the actual application process, resulting in a large time delay in the signal data distributed to the VR environment of users. At the lightest, it affects the immersion of the experience, and at the heaviest, unnecessary collisions or other risks may occur in the user experience.

[0005] In the prior art, in some interaction scenarios, an attempt is made to adopt a cloud-edge-end architecture to solve the above problems, but this architecture still faces the problems of limited computing resources and relatively complex management.

[0006] Therefore, an interaction method suitable for large spaces and multiple users with more guaranteed security is urgently needed to be developed. Summary of the Invention

[0007] To solve the above technical problems, the present invention provides a multi-person interaction method, hardware and application in a large-space VR scenario.

[0008] The technical solution adopted by the present invention is a multi-person interaction method in a large-space VR scenario, which accesses more than one interaction node, constructs an identification mechanism based on the large space, and all the interaction nodes compete for the central node; Based on the recognition mechanism, data information is exchanged between the cloud and the central node. An interaction chain that is dynamically adjustable is constructed between the central node and the interaction nodes based on the positioning information, and data information is exchanged based on the relationship of the interaction chain.

[0009] Preferably, a three-dimensional space model based on the large space is constructed, the rasterized unit three-dimensional grids of the three-dimensional space model are obtained, and the spatial three-dimensional coordinates of the specified corner points and the side lengths of the unit three-dimensional grids are obtained for any unit three-dimensional grid.

[0010] Preferably, one or more recognition components are arranged in the large space.

[0011] Preferably, more than one interaction node enters any large space. The information acquisition device transmits the current spatial position and the images of one or more recognition components collected to the cloud, calculates the matching degree between the spatial position of each interaction node and the transmitted images, and takes the interaction node with the maximum matching degree as the central node.

[0012] Preferably, when there are more than one interaction nodes with the maximum matching degree, the interaction node with the maximum preset distance between the spatial position and the image is taken as the central node.

[0013] Preferably, at least one recognition component is arranged on any interaction node.

[0014] Preferably, the interaction node n1 corresponding to each recognized recognition component exposes its field of view to the interaction node n2 that recognizes the recognition component. Based on the relationship of the exposed field of view, the position information and action information of all interaction nodes are obtained, and are summarized to the central node based on the dynamically adjustable interaction chain, and then distributed by the central node to all interaction nodes.

[0015] A computer-readable storage medium stores a multi-person interaction program in a large space VR scenario. When the program is executed by a processor, the multi-person interaction method in the large space VR scenario is implemented.

[0016] A computer device includes a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, the multi-person interaction method in the large space VR scenario is implemented.

[0017] An application of the multi-person interaction method in the large space VR scenario is applied to interaction-based experiences in VR scenarios.

[0018] The present invention relates to a multi - person interaction method, hardware and application in a large - space VR scenario. More than one interaction node is accessed to construct an identification mechanism based on the large space, and all interaction nodes compete for the central node. Based on the identification mechanism, data information is exchanged between the cloud and the central node, and a dynamically adjustable interaction chain is constructed between the central node and the interaction nodes based on the positioning information, and data information is exchanged based on the relationship of the interaction chain. The hardware implementation is completed based on the method and applied to the interaction experience in the VR scenario.

[0019] The beneficial effect of the present invention is that by selecting the central node, the postures of other interaction nodes except the central node can be distributed one by one to the VR device of a single user according to the interaction chain, realizing multi - person interaction in the virtual environment. On the basis of reducing the calculation amount and the information upload amount, combined with the cooperation of the identification mechanism, the positioning information of all interaction nodes can be obtained better and faster, and the multi - person interaction is more smooth. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 is the flowchart of the method of the present invention; Figure 2 is the schematic diagram of node interaction of the present invention, where the solid arrows are data information interaction and the dashed arrows are interaction information distribution. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0021] The following further describes the present invention in detail with reference to the embodiments, but the protection scope of the present invention is not limited thereto.

[0022] The present invention relates to a multi - person interaction method in a large - space VR scenario. More than one interaction node is accessed to construct an identification mechanism based on the large space, and all the interaction nodes compete for the central node; Based on the identification mechanism, data information is exchanged between the cloud and the central node, and a dynamically adjustable interaction chain is constructed between the central node and the interaction nodes based on the positioning information, and data information is exchanged based on the relationship of the interaction chain.

[0023] In the present invention, a large space is delimited. When and only when there are more than one interaction nodes in the large space, the current method needs to be called. It should be noted that an interaction node refers to a moving individual, and the data obtained through an interaction node is actually a set of data used to integrate the posture of a user.

[0024] In the present invention, first, for multiple interaction nodes, they compete for the central node according to a certain rule. Subsequently, in the subsequent processing process, the central node obtains the positions and postures of all interaction nodes one by one into a network based on the dynamically adjustable interaction chain, and interacts its own position and posture to the cloud. The cloud issues the interaction data information through the central node, and the central node issues the interaction data information one by one through the interaction chain.

[0025] In the present invention, in practical applications, the interaction chain is not necessarily a single chain, and it can be extended into a chain network structure composed of chains.

[0026] Construct a three-dimensional space model based on the large space, obtain the rasterized unit three-dimensional grids of the three-dimensional space model, and construct and obtain the spatial three-dimensional coordinates of the specified corner points and the side lengths of the unit three-dimensional grids corresponding to any unit three-dimensional grid.

[0027] In the present invention, for a large space, it is generally configured as a regular space to facilitate its rasterization process. Similar to planar rasterization, an XYZ coordinate system is constructed, and the three-dimensional space is divided into multiple unit three-dimensional grids. Interaction nodes (including the central node) are located in this network. When positioning, for the convenience of processing, the corresponding positioning data is generally represented by the unified specified corner points and side lengths of the unit three-dimensional grids. For example, if the positioning information of any interaction node is collected as (x1 + a, y1 + b, z1 + c), it means that this interaction node is in the unit three-dimensional grid of (x1, y1, z1) and has offsets of a, b, and c on the x, y, and z axes respectively. When the side length is m, at least one of a, b, and c is less than m.

[0028] In the present invention, the central node problem is solved first.

[0029] One or more identification components are arranged in the large space.

[0030] When more than one interaction node enters any large space, the information collection device transmits the current spatial position and the images of one or more identification components collected to the cloud, calculates the matching degree between the spatial position of each interaction node and the transmitted images, and takes the interaction node with the maximum matching degree as the central node.

[0031] When there are more than one interaction nodes with the maximum matching degree, the interaction node with the maximum preset distance between the spatial position and the image is taken as the central node.

[0032] In this embodiment, identification components are set in the large space, including but not limited to any objects that can play a marking role, including feature parts composed of specific graphics or a certain specific fixed object in the spatial environment, etc. When multiple interaction nodes enter the large space, the information collection device configured for each interaction node, which is generally a VR headset in this application, obtains the images of the collected identification components, and transmits the images and its own spatial position to the cloud together. The spatial position where the VR headset is located represents the actual height of the user individual corresponding to the current interaction node, which is convenient for tracking the dynamics of the individual. After obtaining the image transmitted by the interaction node and its own spatial position, it is possible to infer the true value of the image transmitted by the current interaction node based on the spatial position transmitted by the current interaction node, obtain the feature vector based on this true value, calculate the similarity with the true vector of the actually transmitted image. If the similarity is high, the matching degree is high, indicating that the current network link of the current interaction node is optimal, without deformation, abnormal conditions, etc. Therefore, it is used as the central node.

[0033] In the specific implementation process, of course, there may also be cases where the highest matching degree values are the same. If such a situation occurs, then select the interaction node with the largest distance between the spatial position and the recognition component corresponding to the image under the same similarity, because in the same situation, its accuracy is higher.

[0034] After confirming the central node, the interaction between the large space and the cloud is completed. The present invention deals with the problem of the interaction chain and is used to realize the interaction inside the large space.

[0035] At least one recognition component is arranged on any interaction node.

[0036] The interaction node n1 corresponding to each recognized recognition component exposes its field of view to the interaction node n2 that recognizes the recognition component. Based on the relationship of the exposed field of view, the position information and action information of all interaction nodes are obtained, and are summarized to the central node based on the dynamically adjustable interaction chain, and then distributed by the central node to all interaction nodes.

[0037] In the present invention, a recognition component is set for each interaction node, which can be set in the form of an identification piece or other forms on, including but not limited to, a VR headset. After collecting the image of this identification piece, it means that the field of view is exposed. Since all current interaction nodes are obviously in a local area network, the position and posture of the recognized interaction node are obtained by the recognized interaction node. During the movement of the interaction node, each interaction node will obtain the interaction data information on a certain field of view, and then the associated interaction nodes will transmit these interaction data information one by one, and finally, after being transmitted to the central node, overall distribution is realized to achieve the interaction inside the large space.

[0038] The present invention also relates to a computer-readable storage medium, on which a multi-person interaction program in a large-space VR scenario is stored. When the program is executed by a processor, the multi-person interaction method in the large-space VR scenario described above is realized.

[0039] The present invention also relates to a computer device, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, the multi-person interaction method in the large-space VR scenario described above is realized.

[0040] The present invention also relates to an application of the multi-person interaction method in the large-space VR scenario described above, which is applied to the interaction experience in the VR scenario.

[0041] Interactive experiences include, but are not limited to, VR games, interactive scenario teaching machines, etc. During application, an interactive experience means that when executing, an interactive node needs to obtain information from another interactive node to complete this experience, and the information includes, but is not limited to, position, posture, etc.

[0042] Therefore, in the architecture of the present invention, the central node corresponds to the cloud, and the signals of each other interactive node are fed back to the central node in the form of an interactive chain through in-scene applications and then sent to other interactive nodes, so that interactions can be obtained quickly.

[0043] Those skilled in the art should understand that the embodiments of the present invention can be provided as methods, systems, or computer program products. Therefore, the present invention can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present invention can take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0044] The present invention is described with reference to the flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, and the combination of processes and / or blocks in the flowchart and / or block diagram, can be realized by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing devices generate means for realizing the functions specified in Figure 1 one process or multiple processes and / or blocks Figure 1 one block or multiple blocks.

[0045] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory generate a manufactured product including instruction means, and the instruction means realizes the functions specified in Figure 1 one process or multiple processes and / or blocks Figure 1 one block or multiple blocks.

[0046] These computer program instructions can also be loaded onto a computer or other programmable data processing device, so that a series of operation steps are executed on the computer or other programmable device to generate a computer-implemented process, and thus the instructions executed on the computer or other programmable device provide means for realizing the functions specified in Figure 1steps of one process or multiple processes and / or blocks Figure 1 steps of the functions specified in one block or multiple blocks.

[0047] Although the preferred embodiments of the present invention have been described, those skilled in the art can make additional changes and modifications to these embodiments once they learn the basic creative concept. Therefore, the appended claims are intended to be construed to include the preferred embodiments as well as all changes and modifications falling within the scope of the present invention.

[0048] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalent technologies, the present invention is also intended to include these modifications and variations.

Claims

1. A multi-person interaction method in a large-space VR scene, characterized by: Access more than one interactive node and build a recognition mechanism based on a large space, where all the interactive nodes compete for the central node; Based on the identification mechanism, data information is exchanged between the cloud and the central node, a dynamically adjustable interaction chain is built between the central node and the interaction node based on the positioning information, and data information is exchanged based on the relationship of the interaction chain.

2. The multi-person interaction method in a large space VR scene according to claim 1, characterized in that: A three-dimensional space model based on the large space is constructed, and a rasterized unit three-dimensional grid of the three-dimensional space model is obtained. The spatial three-dimensional coordinates of a specified corner point and the side length of the unit three-dimensional grid are obtained corresponding to any unit three-dimensional grid.

3. The multi-person interaction method in a large space VR scene according to claim 2, characterized in that: One or more identification components are arranged in the large space.

4. The multi-person interaction method in a large space VR scene according to claim 3, characterized in that: When more than one interactive node enters any large space, the information collection device transmits the current spatial location and the collected images of one or more recognition components to the cloud, calculates the matching degree between the spatial location of each interactive node and the transmitted image, and takes the interactive node with the largest matching degree as the central node.

5. The multi-person interaction method in a large space VR scene according to claim 4, characterized in that: When there are more than one interaction node with the largest matching degree, the interaction node whose spatial location has the largest preset distance to the image is taken as the central node.

6. The multi-person interaction method in a large space VR scene according to claim 3, characterized in that: At least one identification component is deployed on any interactive node.

7. The multi-person interaction method in a large space VR scene according to claim 6, characterized in that: The interactive node n1 corresponding to each identified recognition component exposes its field of view to the interactive node n2 that recognizes the recognition component. Based on the relationship of the exposed field of view, the location information and action information of all interactive nodes are obtained, and are summarized to the central node based on the dynamically adjustable interaction chain, and distributed to all interactive nodes by the central node.

8. A computer-readable storage medium, characterized in that: A multi-person interaction program in a large-space VR scene is stored thereon, and when the program is executed by a processor, a multi-person interaction method in a large-space VR scene as described in one of claims 1 to 7 is implemented.

9. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the program, the multi-person interaction method in a large-space VR scene as described in any one of claims 1 to 7 is implemented.

10. An application of the multi-person interaction method in a large space VR scene according to claims 1 to 7, characterized in that: Applied to interactive experience in VR scenarios.

Images