Large-space multi-person VR interactive experience system and method

Abstract

The invention is suitable for the technical field of VR games, and provides a large-space multi-person VR interactive experience system and method, and the method comprises the following steps: receiving VR game data through a VR terminal which is marked with a position direction identifier and a number; receiving an operation gesture viewing instruction, and displaying an operation gesture instruction on the VR terminal; receiving a game selection instruction and a game start instruction; acquiring a real-time image in the VR game area through a camera, and identifying a position direction identifier, a figure gesture and a serial number in the real-time image; determining the orientation and moving state of the corresponding VR terminal according to the position direction identifier, and determining the motion state of a game role corresponding to the VR terminal; and determining an execution command of the corresponding VR terminal according to the character gesture, and sending the execution command to a game role corresponding to the VR terminal. Therefore, the game role can execute various action commands without operating a handle, the operation is more convenient, a user can be more easily personally on the scene, and the experience effect is better.

Description

Technical Field

[0001] The present invention relates to the field of VR game technology, and in particular to a large-space multi-person VR interactive experience system and method. Background Art

[0002] To play virtual reality games, users need to wear VR helmets or VR glasses to enter an interactive virtual live game scene, which can give users an immersive gaming experience and is favored by game enthusiasts. In the prior art, users often need to use devices such as operating handles to achieve the movement of characters in virtual game scenes and game action control. In other words, users need to hold the operating handle to participate in the game. When users wear VR helmets or VR glasses, they cannot see the buttons on the operating handle clearly, which affects the gaming experience. Therefore, it is necessary to provide a large-space multiplayer VR interactive experience system and method to solve the above problems. Summary of the invention

[0003] In view of the deficiencies in the prior art, the purpose of the present invention is to provide a large-space multi-person VR interactive experience system and method to solve the problems existing in the above-mentioned background technology.

[0004] The present invention is implemented as follows: a method for large-space multi-person VR interactive experience, the method comprising the following steps: receiving VR game data through a VR terminal, wherein the VR game data includes an operation gesture description and a plurality of VR game scenes, and the VR terminal is marked with a position direction identifier and a number; Receive the operation gesture viewing instructions input by the control center and display the operation gesture instructions on the VR terminal; Receive game selection instructions and game start instructions input by the control center, display the selected VR game scene on the VR terminal and start the game, so that each VR terminal corresponds to a game character; The real-time image in the VR game area is collected by the camera, and the position and direction marks, character gestures and numbers in the real-time image are identified; Determine the orientation and movement state of the corresponding VR terminal according to the position direction identifier, and determine the movement state of the game character corresponding to the VR terminal; The execution command of the corresponding VR terminal is determined according to the character's gesture, and the execution command is sent to the game character corresponding to the VR terminal.

[0005] As a further solution of the present invention: the step of making each VR terminal correspond to a game character specifically includes: Determine all communicating VR terminals, assign a game character to each communicating VR terminal, and bind the game character to the number on the VR terminal; The birth position corresponding to each game character is retrieved. When the game starts, each game character is displayed at the corresponding birth position.

[0006] As a further solution of the present invention: the step of identifying the position and direction marks, the person's gestures and the numbers in the real-time image specifically includes: Identify position and direction marks, person gestures, and numbers in real-time images based on color and shape features; Determine the number closest to each position direction identifier, and determine the VR terminal corresponding to each position direction identifier; Determine the number closest to each character's gesture, and determine the VR terminal corresponding to each character's gesture.

[0007] As a further solution of the present invention: the step of determining the orientation and movement state of the corresponding VR terminal according to the position direction identifier specifically includes: Determine the direction of the direction indication part in the position direction mark, where the direction is the direction of the corresponding VR terminal; The position and direction mark in the previous frame of real-time image is retrieved, and the positions of the two position and direction marks in the image are compared to determine whether there is movement, and when there is movement, the moving direction is determined.

[0008] As a further solution of the present invention: the step of determining the execution command of the corresponding VR terminal according to the character gesture specifically includes: Matching the character gesture with an operation gesture description, wherein the operation gesture description includes a plurality of gesture postures, each gesture posture corresponding to an execution command; When the character's gesture successfully matches one of the gesture postures, it is determined that the execution command corresponding to the gesture posture is the execution command of the VR terminal.

[0009] Another object of the present invention is to provide a large-space multi-person VR interactive experience system, the system comprising: A game data receiving module, used to receive VR game data through a VR terminal, wherein the VR game data includes operation gesture instructions and multiple VR game scenes, and the VR terminal is marked with a position direction identifier and a number; An operation gesture viewing module is used to receive an operation gesture viewing instruction input by the control center and display the operation gesture description on the VR terminal; A VR game start module is used to receive a game selection instruction and a game start instruction input by a control center, display the selected VR game scene on the VR terminal and start the game, so that each VR terminal corresponds to a game character; The image acquisition and recognition module is used to collect real-time images in the VR game area through the camera and recognize the position and direction marks, character gestures and numbers in the real-time images; A motion state determination module, used to determine the orientation and movement state of the corresponding VR terminal according to the position direction identifier, and determine the motion state of the game character corresponding to the VR terminal; The execution command determination module is used to determine the execution command of the corresponding VR terminal according to the character gesture, and send the execution command to the game character corresponding to the VR terminal.

[0010] As a further solution of the present invention: the VR game start module includes: A game character allocation unit, used to determine all communicating VR terminals, allocate a game character to each communicating VR terminal, and bind the game character to the number on the VR terminal; The birth position determination unit is used to retrieve the birth position corresponding to each game character. When the game starts, each game character is displayed at the corresponding birth position.

[0011] As a further solution of the present invention: the image acquisition and recognition module includes: A feature element recognition unit is used to recognize position and direction marks, person gestures, and numbers in real-time images based on color features and shape features; The first corresponding terminal unit is used to determine the number closest to each position direction identifier and determine the VR terminal corresponding to each position direction identifier; The second corresponding terminal unit is used to determine the number closest to each character's gesture and determine the VR terminal corresponding to each character's gesture.

[0012] As a further solution of the present invention: the motion state determination module includes: A character orientation determining unit, used to determine the orientation of a direction indicating portion in the position direction identifier, wherein the orientation is the orientation of the corresponding VR terminal; The moving state determination unit is used to retrieve the position direction mark in the previous frame of real-time image, compare the positions of the two position direction marks in the image, determine whether it moves, and when moving, determine the moving direction.

[0013] As a further solution of the present invention: the execution command determination module includes: An operation gesture matching unit, used to match the character's gesture with an operation gesture description, wherein the operation gesture description includes a plurality of gesture postures, each gesture posture corresponds to an execution command; The execution command determination unit is used to determine that the execution command corresponding to the gesture is the execution command of the VR terminal when the character gesture successfully matches one of the gesture postures.

[0014] Compared with the prior art, the present invention has the following beneficial effects: The present invention collects real-time images in the VR game area through a camera, identifies the position direction mark, character gestures and numbers in the real-time image; then determines the direction and movement state of the corresponding VR terminal according to the position direction mark, determines the movement state of the game character corresponding to the VR terminal; and determines the execution command of the corresponding VR terminal according to the character gesture, and sends the execution command to the game character corresponding to the VR terminal. In this way, the game character can execute various action commands without operating the handle, which is more convenient and makes it easier for users to be immersed in the game and experience better. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 The figure is a flow chart of a large-space multi-person VR interactive experience method.

[0016] Figure 2 The present invention is a flow chart of a method for large-space multi-person VR interactive experience, in which each VR terminal corresponds to a game character.

[0017] Figure 3 The present invention is a flow chart for identifying position and direction identifiers in real-time images in a large-space multi-person VR interactive experience method.

[0018] Figure 4 The present invention is a flowchart for determining the orientation and movement state of a VR terminal in a method for large-space multi-person VR interactive experience.

[0019] Figure 5 The present invention is a flowchart for determining execution commands of a VR terminal in a method for large-space multi-person VR interactive experience.

[0020] Figure 6 This is a structural diagram of a large-space multi-person VR interactive experience system.

[0021] Figure 7 This is a structural diagram of a VR game start module in a large-space multiplayer VR interactive experience system.

[0022] Figure 8 This is a structural diagram of an image acquisition and recognition module in a large-space multi-person VR interactive experience system.

[0023] Fig. 9 This is a structural diagram of a motion state determination module in a large-space multi-person VR interactive experience system.

[0024] Fig.10 This is a structural diagram of an execution command determination module in a large-space multi-person VR interactive experience system. DETAILED DESCRIPTION

[0025] In order to make the purpose, technical solution and advantages of the present invention clearer, the present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0026] The specific implementation of the present invention is described in detail below in conjunction with specific embodiments.

[0027] like Figure 1 As shown, an embodiment of the present invention provides a large-space multi-person VR interactive experience method, the method comprising the following steps: S100, receiving VR game data through a VR terminal, the VR game data including operation gesture instructions and multiple VR game scenes, the VR terminal being marked with a position direction identifier and a number; S200, receiving an operation gesture viewing instruction input by the control center, and displaying an operation gesture description on the VR terminal; S300, receiving a game selection instruction and a game start instruction input by the control center, displaying the selected VR game scene on the VR terminal and starting the game, so that each VR terminal corresponds to a game character; S400, collects real-time images in the VR game area through a camera, and identifies position and direction marks, character gestures, and numbers in the real-time images; S500, determining the orientation and movement state of the corresponding VR terminal according to the position direction identifier, and determining the movement state of the game character corresponding to the VR terminal; S600, determining an execution command of a corresponding VR terminal according to the character's gesture, and sending the execution command to a game character corresponding to the VR terminal.

[0028] It should be noted that in the prior art, users often need to use devices such as operating handles to realize the movement of characters in virtual game scenes and control game actions. That is to say, users need to hold the operating handles to participate in the game. When the user wears a VR helmet or VR glasses, the buttons on the operating handles cannot be seen clearly, which affects the gaming experience. The embodiments of the present invention aim to solve the above problem.

[0029] In the embodiment of the present invention, a VR game area needs to be provided first, and the VR game area can accommodate multiple users participating in the game at the same time, and a camera is installed above the VR game area. When the user is ready to participate in the game, he needs to wear a VR terminal, which is a VR helmet or VR glasses, and receive VR game data through the VR terminal. The VR game data includes operation gesture instructions and multiple VR game scenes. The VR terminal is marked with a position direction identifier and a number. Before the game is officially started, the staff needs to input the operation gesture to view the instruction through the control center. At this time, the operation gesture description will be displayed on the VR terminal so that each user knows the correspondence between the gesture and the execution command. Then the staff also needs to input the game selection instruction and the game start instruction through the control center. At this time, the selected VR game scene will be displayed on the VR terminal and the game will start, so that each VR terminal corresponds to a game character, and each participating user views the game scene from the first-person perspective of the corresponding game character; after the game is officially started, the camera will automatically collect the real-time image in the VR game area, and identify all the position direction identifiers, character gestures and numbers in the real-time image. The embodiment of the present invention will determine the direction and movement state of the corresponding VR terminal according to the position direction identifier, and determine the motion state of the game character corresponding to the VR terminal, so that the direction of the game character is consistent with the direction of the VR terminal, and the motion state is also consistent; and the execution command of the corresponding VR terminal will be determined according to the character gesture, and the execution command will be sent to the game character corresponding to the VR terminal. In this way, the game character can execute various action commands without operating the handle, which is more convenient and easier for users to be immersed in the game and experience better.

[0030] like Figure 2 As shown, as a preferred embodiment of the present invention, the step of making each VR terminal correspond to a game character specifically includes: S301, determine all communicating VR terminals, assign a game character to each communicating VR terminal, and bind the game character to the number on the VR terminal; S302, retrieve the birth position corresponding to each game character, and when the game starts, each game character is displayed at the corresponding birth position.

[0031] Further, the step of determining all communicating VR terminals and assigning a game character to each communicating VR terminal specifically includes: An XOR operation is performed on the VR terminal number to perform an initial transformation with the first offset constant to obtain an initial transformation result. The corresponding process has the following relationship: ; in, Indicates z The number of the VR terminal. represents the first offset constant, represents the exclusive OR operation, represents the initial transformation result; The initial transformation result is linearly transformed using the weight coefficient and the second offset constant to obtain a linear transformation result. The corresponding process has the following relationship: ; in, represents the linear transformation result, represents the weight coefficient, represents the second offset constant; The linear transformation result is modulo-operated to obtain the modulo result. The corresponding process has the following relationship: ; in, Indicates the modulo result, the result is in the range of 0 to δ-1; represents the modulo operation, Indicates the modulo range, which is the total number of game characters.

[0032] In the embodiment of the present invention, only the VR terminal that is worn by the user and turned on the power switch will communicate with the control center, and a game character will be automatically assigned to each VR terminal that can communicate. The diversity and a certain randomness of the game character assignment are ensured through linear changes, which increases the fun of the game experience, and then the game character is bound to the number on the VR terminal; in the embodiment of the present invention, each game character corresponds to a birth position, and when the game starts, the game character will be displayed at the corresponding birth position.

[0033] like Figure 3 As shown, as a preferred embodiment of the present invention, the step of identifying the position and direction mark, the person's gesture and the number in the real-time image specifically includes: S401, identifying position and direction marks, person gestures, and numbers in a real-time image according to color features and shape features; S402, determining the number closest to each position direction identifier, and determining the VR terminal corresponding to each position direction identifier; S403, determining the number closest to each character's gesture, and determining the VR terminal corresponding to each character's gesture.

[0034] Further, the steps of determining the number closest to each position direction identifier and determining the VR terminal corresponding to each position direction identifier specifically include: Calculate the distance between the position direction mark and all numbers. The corresponding process has the following relationship: ; in, Indicates m The coordinates of the position direction markers, Indicates n The coordinates of the numbers, Respectively represent the weight coefficients used to adjust the distance influence in the x-axis and y-axis directions, represents the first adjustment coefficient, Indicates m The position direction mark and n The distance between numbers; From the distances between the position direction identifier and all the numbers, select the number with the smallest distance as the corresponding number. The corresponding process has the following relationship: ; in, Indicates n The index of the number that is closest to the position direction.

[0035] In the embodiment of the present invention, the position and direction mark has exclusive color characteristics and shape characteristics, for example, the position and direction mark is red, the shape of the position and direction mark is an arrow, and the number also has exclusive color characteristics, for example, the number is yellow with blue characters, so that the direction mark, the character gesture and the number can be automatically identified with the help of computer vision technology. Then, the number closest to each position and direction mark is determined, and the VR terminal corresponding to the number corresponds to the position and direction mark; and the number closest to each character gesture is determined, and the VR terminal corresponding to the number corresponds to the character gesture.

[0036] like Figure 4 As shown, as a preferred embodiment of the present invention, the step of determining the orientation and movement state of the corresponding VR terminal according to the position direction identifier specifically includes: S501, determining the direction of the direction indication part in the position direction identifier, where the direction is the direction of the corresponding VR terminal; S502, retrieve the position and direction identifier in the previous frame of real-time image, compare the positions of the two position and direction identifiers in the image, determine whether there is movement, and if there is movement, determine the moving direction.

[0037] Further, the step of retrieving the position and direction mark in the previous frame of real-time image, comparing the positions of the two position and direction marks in the image, determining whether there is movement, and when there is movement, determining the direction of movement specifically includes: Calculate the moving distance of the position direction marker between the current frame and the previous frame. The corresponding process has the following relationship: ; in, Indicates the moving distance of the position direction marker between the current frame and the previous frame; Indicates that in the current frame v The coordinates of the position direction markers; Indicates that in the previous frame v The coordinates of the position direction markers; They represent the weight coefficients used to adjust the movement influence in the x-axis and y-axis directions respectively. represents the second adjustment coefficient; Set a movement threshold, compare the movement distance between the current frame and the previous frame with the movement threshold, and when the movement distance is greater than the movement threshold, it is confirmed that the position direction mark has moved; Subtract the position distance of the position direction mark in the coordinate system of the previous frame from the position distance of the position direction mark in the coordinate system of the current frame to obtain the moving direction of the position direction mark in the coordinate system of the current frame. The corresponding process has the following relationship: ; ; in, Indicates the moving distance of the position direction mark on the x-axis. Indicates the moving distance of the position direction marker on the y-axis.

[0038] In an embodiment of the present invention, each position and direction identifier includes a direction indicating part, for example, the tip of an arrow shape is the direction indicating part, and the direction of the direction indicating part is determined, and the direction is the direction of the corresponding VR terminal; then the position and direction identifier in the previous frame of real-time image is retrieved, and the positions of the two position and direction identifiers in the image are compared to determine whether to move. When moving, the moving direction can be determined by the relative position, and the corresponding game character will move in the moving direction.

[0039] In the above calculation process of moving distance, the weight coefficient is introduced , so that the present invention can adjust the corresponding weight according to the error of the corresponding axis to improve the accuracy, and introduce the absolute value of the adjustment coefficient and the cross product , which results in some nonlinear movement, mutation or jump or noise influence when calculating the movement state of the position direction mark. A single Euclidean distance calculation may not accurately describe the movement situation in this special case, thereby improving the adaptability of the present invention.

[0040] like Figure 5 As shown, as a preferred embodiment of the present invention, the step of determining the orientation and movement state of the corresponding VR terminal according to the position direction identifier specifically includes: S601, matching a character gesture with an operation gesture description, wherein the operation gesture description includes a plurality of gesture postures, each gesture posture corresponding to an execution command; S602: When the character's gesture successfully matches one of the gesture postures, it is determined that the execution command corresponding to the gesture posture is the execution command of the VR terminal.

[0041] Furthermore, the step of matching the character gesture with the operation gesture description specifically includes: Calculate the matching degree between the gesture in each current frame and the gesture posture in each operation gesture description. The corresponding process has the following relationship: ; in, Indicates the matching degree, Indicates the current frame i The feature vector of the gesture, Indicates the first j The feature vector of the hand gesture, Indicates the current frame i The feature vector of the gesture k Quantity, Indicates the first j The feature vector of the hand gesture k Quantity, Represents a positive number that prevents the denominator from being zero, Represents the weight coefficient used to control the influence of Euclidean distance in the matching calculation. Represents the weight coefficient used to control the influence of cosine similarity in the matching calculation. Represents the weight coefficient used to control the influence of the relative difference of each component of the feature vector in the matching calculation. Indicates the Euclidean distance between the current gesture and the gesture posture in the operation gesture description. Respectively represent the gesture model of the current gesture and the gesture operation description. Represents the relative differences of each component of the gesture feature vector; Set the matching threshold. When the matching degree of the gesture reaches the maximum value and exceeds the preset matching threshold, it is determined to be a successful match. The corresponding process has the following relationship: ; in, represents the index of the best match; When the match is successful, it is determined that the execution command corresponding to the gesture posture is the execution command of the VR terminal.

[0042] In the above gesture posture matching calculation process, the It is used to measure the distance between the current gesture and the gesture in the operation gesture description. Through the exponential function and Euclidean distance, the smaller the distance, the higher the matching degree. Cosine similarity is used. , which is used to measure the similarity of the angle and direction between two vectors. The larger the value, the more similar the two gestures are. By measuring the relative differences of each component of the feature vector and calculating and summing the relative differences of each component, more subtle differences can be captured. This allows the present invention to comprehensively consider multiple features of gestures, thereby more accurately matching gestures in various special situations and improving the response accuracy and flexibility of the VR terminal.

[0043] In an embodiment of the present invention, after a character gesture is recognized, the character gesture will be matched with several gesture postures in the operation gesture description. When the character gesture successfully matches one of the gesture postures, the execution command corresponding to the gesture posture is determined to be the execution command of the VR terminal; when the character gesture fails to match all the gesture postures, the corresponding game character does not perform an execution action.

[0044] like Figure 6 As shown, the embodiment of the present invention also provides a large-space multi-person VR interactive experience system, the system comprising: A game data receiving module 100 is used to receive VR game data through a VR terminal, wherein the VR game data includes operation gesture instructions and multiple VR game scenes, and the VR terminal is marked with a position direction identifier and a number; The operation gesture viewing module 200 is used to receive the operation gesture viewing instruction input by the control center and display the operation gesture description on the VR terminal; The VR game start module 300 is used to receive a game selection instruction and a game start instruction input by the control center, display the selected VR game scene on the VR terminal and start the game, so that each VR terminal corresponds to a game character; The image acquisition and recognition module 400 is used to acquire real-time images in the VR game area through a camera, and recognize position and direction marks, character gestures, and numbers in the real-time images; The motion state determination module 500 is used to determine the orientation and movement state of the corresponding VR terminal according to the position direction identifier, and determine the motion state of the game character corresponding to the VR terminal; The execution command determination module 600 is used to determine the execution command of the corresponding VR terminal according to the character gesture, and send the execution command to the game character corresponding to the VR terminal.

[0045] In the embodiment of the present invention, a VR game area needs to be provided first, and the VR game area can accommodate multiple users participating in the game at the same time, and a camera is installed above the VR game area. When the user is ready to participate in the game, he needs to wear a VR terminal, which is a VR helmet or VR glasses, and receive VR game data through the VR terminal. The VR game data includes operation gesture instructions and multiple VR game scenes. The VR terminal is marked with a position direction identifier and a number. Before the game is officially started, the staff needs to input the operation gesture to view the instruction through the control center. At this time, the operation gesture description will be displayed on the VR terminal so that each user knows the correspondence between the gesture and the execution command. Then the staff also needs to input the game selection instruction and the game start instruction through the control center. At this time, the selected VR game scene will be displayed on the VR terminal and the game will start, so that each VR terminal corresponds to a game character, and each participating user views the game scene from the first-person perspective of the corresponding game character; after the game is officially started, the camera will automatically collect the real-time image in the VR game area, and identify all the position direction identifiers, character gestures and numbers in the real-time image. The embodiment of the present invention will determine the direction and movement state of the corresponding VR terminal according to the position direction identifier, and determine the motion state of the game character corresponding to the VR terminal, so that the direction of the game character is consistent with the direction of the VR terminal, and the motion state is also consistent; and the execution command of the corresponding VR terminal will be determined according to the character gesture, and the execution command will be sent to the game character corresponding to the VR terminal. In this way, the game character can execute various action commands without operating the handle, which is more convenient and easier for users to be immersed in the game and experience better.

[0046] like Figure 7 As shown, as a preferred embodiment of the present invention, the VR game start module 300 includes: The game character allocation unit 301 is used to determine all communicating VR terminals, allocate a game character to each communicating VR terminal, and bind the game character to the number on the VR terminal; The birth position determination unit 302 is used to retrieve the birth position corresponding to each game character. When the game starts, each game character is displayed at the corresponding birth position.

[0047] like Figure 8 As shown, as a preferred embodiment of the present invention, the image acquisition and recognition module 400 includes: The feature element recognition unit 401 is used to recognize the position and direction mark, the person's gesture and the number in the real-time image according to the color feature and the shape feature; The first corresponding terminal unit 402 is used to determine the number closest to each position direction identifier and determine the VR terminal corresponding to each position direction identifier; The second corresponding terminal unit 403 is used to determine the number closest to each character gesture and determine the VR terminal corresponding to each character gesture.

[0048] like Fig. 9 As shown, as a preferred embodiment of the present invention, the motion state determination module 500 includes: A character orientation determining unit 501 is used to determine the orientation of the direction indicating part in the position direction identifier, where the orientation is the orientation of the corresponding VR terminal; The moving state determining unit 502 is used to retrieve the position and direction identifier in the previous frame of real-time image, compare the positions of the two position and direction identifiers in the image, determine whether there is movement, and if there is movement, determine the moving direction.

[0049] like Fig.10 As shown, as a preferred embodiment of the present invention, the execution command determination module 600 includes: The operation gesture matching unit 601 is used to match the character gesture with the operation gesture description, wherein the operation gesture description includes a plurality of gesture postures, each gesture posture corresponds to an execution command; The execution command determining unit 602 is used to determine that the execution command corresponding to the gesture is the execution command of the VR terminal when the character gesture successfully matches one of the gesture postures.

[0050] The above only describes in detail the preferred embodiments of the present invention, which is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

[0051] It should be understood that, although each step in the flow chart of each embodiment of the present invention is shown in sequence according to the indication of the arrow, these steps are not necessarily performed in sequence according to the order indicated by the arrow. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be performed in other orders. Moreover, at least a portion of the steps in each embodiment may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and the execution order of these sub-steps or stages is not necessarily performed in sequence, but can be performed in turn or alternately with at least a portion of other steps or sub-steps or stages of other steps.

[0052] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a non-volatile computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0053] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the disclosure in the specification and examples. This application is intended to cover any variations, uses or adaptations of the present disclosure, which follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present disclosure are indicated by the claims.

Claims

1. A large-space multi-person VR interactive experience method, characterized in that: The method comprises the following steps: receiving VR game data through a VR terminal, wherein the VR game data includes an operation gesture description and a plurality of VR game scenes, and the VR terminal is marked with a position direction identifier and a number; Receive the operation gesture viewing instructions input by the control center and display the operation gesture instructions on the VR terminal; Receive game selection instructions and game start instructions input by the control center, display the selected VR game scene on the VR terminal and start the game, so that each VR terminal corresponds to a game character; The real-time image in the VR game area is collected by the camera, and the position and direction marks, character gestures and numbers in the real-time image are identified; Determine the orientation and movement state of the corresponding VR terminal according to the position direction identifier, and determine the movement state of the game character corresponding to the VR terminal; Determine the execution command of the corresponding VR terminal according to the character gesture, and send the execution command to the game character corresponding to the VR terminal; The step of making each VR terminal correspond to a game character specifically includes: Determine all communicating VR terminals, assign a game character to each communicating VR terminal, and bind the game character to the number on the VR terminal; The birth position corresponding to each game character is retrieved. When the game starts, each game character is displayed at the corresponding birth position.

2. A large-space multi-person VR interactive experience method according to claim 1, characterized in that: The steps of determining all communicating VR terminals and assigning a game character to each communicating VR terminal specifically include: An XOR operation is performed on the VR terminal number to perform an initial transformation with the first offset constant to obtain an initial transformation result. The corresponding process has the following relationship: ； in, Indicates z The number of the VR terminal. represents the first offset constant, represents the exclusive OR operation, represents the initial transformation result; The initial transformation result is linearly transformed using the weight coefficient and the second offset constant to obtain a linear transformation result. The corresponding process has the following relationship: ； in, represents the linear transformation result, represents the weight coefficient, represents the second offset constant; The linear transformation result is modulo-operated to obtain the modulo result. The corresponding process has the following relationship: ； in, Indicates the modulo result, the result is in the range of 0 to δ-1; represents the modulo operation, Indicates the modulo range.

3. A large-space multi-person VR interactive experience method according to claim 2, characterized in that: The step of identifying the position and direction marks, the person's gestures and the numbers in the real-time image specifically includes: Identify location and direction marks, person gestures, and numbers in real-time images based on color and shape features; Determine the number closest to each position direction identifier, and determine the VR terminal corresponding to each position direction identifier; Determine the number closest to each character's gesture, and determine the VR terminal corresponding to each character's gesture.

4. A large-space multi-person VR interactive experience method according to claim 3, characterized in that: The steps of determining the number closest to each position direction identifier and determining the VR terminal corresponding to each position direction identifier specifically include: Calculate the distance between the position direction mark and all numbers. The corresponding process has the following relationship: ； in, Indicates m The coordinates of the position direction markers, Indicates n The coordinates of the numbers, Respectively represent the weight coefficients used to adjust the distance influence in the x-axis and y-axis directions, represents the first adjustment coefficient, Indicates m The position direction mark and n The distance between numbers; From the distances between the position direction identifier and all the numbers, select the number with the smallest distance as the corresponding number. The corresponding process has the following relationship: ； in, Indicates n The index of the number that is closest to the position direction.

5. A large-space multi-person VR interactive experience method according to claim 4, characterized in that: The step of determining the orientation and movement state of the corresponding VR terminal according to the position direction identifier specifically includes: Determine the direction of the direction indication part in the position direction mark, where the direction is the direction of the corresponding VR terminal; The position and direction mark in the previous real-time image is retrieved, and the positions of the two position and direction marks in the image are compared to determine whether there is movement, and if there is movement, the direction of movement is determined.

6. A large-space multi-person VR interactive experience method according to claim 5, characterized in that: The step of retrieving the position direction mark in the previous frame of real-time image, comparing the positions of the two position direction marks in the image, determining whether there is movement, and when there is movement, determining the moving direction, specifically includes: Calculate the moving distance of the position direction marker between the current frame and the previous frame. The corresponding process has the following relationship: ； in, Indicates the moving distance of the position direction marker between the current frame and the previous frame; Indicates that in the current frame v The coordinates of the position direction markers; Indicates that in the previous frame v The coordinates of the position direction markers; They represent the weight coefficients used to adjust the movement influence in the x-axis and y-axis directions respectively. represents the second adjustment coefficient; Set a movement threshold, compare the movement distance between the current frame and the previous frame with the movement threshold, and when the movement distance is greater than the movement threshold, it is confirmed that the position direction mark has moved; The position distance of the current frame position direction mark in the coordinate system is subtracted from the position distance of the previous frame position direction mark in the coordinate system to obtain the moving direction of the current frame position direction mark in the coordinate system. The corresponding process has the following relationship: ； ； in, Indicates the moving distance of the position direction mark on the x-axis. Indicates the moving distance of the position direction marker on the y-axis.

7. A large-space multi-person VR interactive experience method according to claim 6, characterized in that: The step of determining the execution command of the corresponding VR terminal according to the character gesture specifically includes: Matching the character gesture with an operation gesture description, wherein the operation gesture description includes a plurality of gesture postures, each gesture posture corresponding to an execution command; When the character's gesture successfully matches one of the gesture postures, it is determined that the execution command corresponding to the gesture posture is the execution command of the VR terminal.

8. A large-space multi-person VR interactive experience method according to claim 7, characterized in that: The steps of matching the character gesture with the operation gesture description specifically include: Calculate the matching degree between the gesture in each current frame and the gesture posture in each operation gesture description. The corresponding process has the following relationship: ； in, Indicates the matching degree, Indicates the current frame i The feature vector of the gesture, Indicates the first j The feature vector of the hand gesture, Indicates the current frame i The feature vector of the gesture k Quantity, Indicates the first j The feature vector of the hand gesture k Quantity, Represents a positive number that prevents the denominator from being zero, Represents the weight coefficient used to control the influence of Euclidean distance in the matching calculation. Represents the weight coefficient used to control the influence of cosine similarity in the matching calculation. Represents the weight coefficient used to control the influence of the relative difference of each component of the feature vector in the matching calculation. Indicates the Euclidean distance between the current gesture and the gesture posture in the operation gesture description. Respectively represent the gesture model of the current gesture and the gesture operation description. Represents the relative differences of each component of the gesture feature vector; Set the matching threshold. When the matching degree of the gesture reaches the maximum value and exceeds the preset matching threshold, it is determined to be a successful match. The corresponding process has the following relationship: ； in, represents the index of the best match; When the match is successful, it is determined that the execution command corresponding to the gesture posture is the execution command of the VR terminal.

9. A large-space multi-person VR interactive experience system, characterized in that: The system applies the large-space multi-person VR interactive experience method as described in any one of claims 1 to 8 above, and the system includes: A game data receiving module, used to receive VR game data through a VR terminal, wherein the VR game data includes operation gesture instructions and multiple VR game scenes, and the VR terminal is marked with a position direction identifier and a number; An operation gesture viewing module is used to receive an operation gesture viewing instruction input by the control center and display the operation gesture description on the VR terminal; A VR game start module is used to receive a game selection instruction and a game start instruction input by a control center, display the selected VR game scene on the VR terminal and start the game, so that each VR terminal corresponds to a game character; The image acquisition and recognition module is used to collect real-time images in the VR game area through the camera and recognize the position and direction marks, character gestures and numbers in the real-time images; A motion state determination module, used to determine the orientation and movement state of the corresponding VR terminal according to the position direction identifier, and determine the motion state of the game character corresponding to the VR terminal; The execution command determination module is used to determine the execution command of the corresponding VR terminal according to the character gesture, and send the execution command to the game character corresponding to the VR terminal.

Images