Game device, multi-player interactive game system, and control method for interactive game

Abstract

The application provides a game device, a multi-person interactive game system and a control method of interactive games, and solves the technical problem of poor experience effect of a multi-person interactive scene in the prior art. The game device provided by the application determines the spatial position information of the control handle by arranging a camera on the game host to capture the light spot image of the infrared sensor on the control handle, and determines the 6DOF data of the control handle in combination with the IMU data of the control handle, thereby improving the accurate positioning of the control handle, improving the human-computer interaction based on the spatial positioning information and improving the game experience. Therefore, when multiple game devices experience a multi-person interactive game in the same physical living room environment, not only can multiple game devices (multiple handheld game consoles and handheld game consoles and VR devices) experience a multi-person interactive game in the same physical living room environment, but also real-time dynamic tracking can be realized, and the experience effect of the multi-person interactive scene is improved.

Description

Technical Field

[0001] This invention relates to the field of game technology, specifically to game devices, multiplayer interactive game systems, and control methods for interactive games. Background Technology

[0002] In recent years, with the development of gaming technology, gaming devices have included handheld consoles and virtual reality (VR) devices. Currently, handheld consoles consist of a main unit and a controller, using the controller to input commands for the gaming experience. However, handheld consoles cannot achieve real-time dynamic tracking and positioning. Virtual reality (VR) devices utilize and integrate the latest advancements in 3D graphics, multimedia, simulation, display, and servo technologies to create a realistic 3D virtual world with multiple sensory experiences, including visual, tactile, and olfactory sensations, using computers and other equipment. This allows users to feel as if they are actually in the virtual world.

[0003] When multiple users experience an interactive game together, the interaction between VR device users and handheld device users, or between multiple handheld devices, cannot achieve real-time dynamic status tracking in the same scene, resulting in a poor experience in multi-user interactive scenarios. Summary of the Invention

[0004] In view of this, the present invention provides a game device, a multi-player interactive game system, and a control method for interactive games, which solves the technical problem in the prior art that when multiple users experience an interactive game together, VR device users and handheld device users, or multiple handheld devices, cannot achieve real-time dynamic state tracking interaction in the same scene, resulting in poor experience in multi-player interactive scenarios.

[0005] As a first aspect of the present invention, the present invention provides a control method for a multiplayer interactive game, applicable to multiple users experiencing interactive games through a game device in a living room scene. The game device comprises: a game console and a console mounting device, the game console being fixed to the console mounting device; a controller, the controller comprising: a control handle; N infrared sensors disposed on the control handle, wherein N is an integer greater than 1; a first inertial sensor mounted on the control handle; a second inertial sensor disposed on the game console; and a camera device disposed on the game console; wherein the control method comprises: constructing a living room scene model corresponding to the physical living room scene where the user is located, and sending the physical interactive scene model to the game console of the game device used by the user and the relevant user's... The following steps are taken: 1. Using a game console with the relevant gaming device; 2. Projecting an interactive avatar corresponding to the user onto the living room scene model; 3. Determining the 6DOF data of the game console based on the spatial image of the game console captured by the camera device and the IMU data of the game console detected by the second sensor; 4. Determining the 6DOF data of the control handle based on the light spot image of the infrared sensor on the control handle captured by the camera device and the IMU data of the control handle detected by the first inertial sensor; 5. Determining the spatial positioning information of the control handle based on the 6DOF data of the control handle and the 6DOF data of the game console; 6. Determining the motion information of the user's interactive avatar based on the spatial positioning information of the control handle; and 7. Sending the spatial positioning information of the control handle to the relevant user's game console.

[0006] In one embodiment of the present invention, the handle further includes: a handle controller disposed within the control handle; and an instruction input device disposed on the control handle, the instruction input device being communicatively connected to the handle controller, through which the user inputs a virtual accessory of the user's interactive avatar; wherein, the handle controller is used to control the illumination of M infrared sensors corresponding to the virtual accessory according to the input instruction information input by the user; the illumination of the M infrared sensors corresponds to one type of virtual accessory, wherein M is an integer greater than 1, and N is greater than or equal to M; determining the motion information of the user's interactive avatar based on the spatial positioning information of the control handle includes: acquiring a data correspondence information table, the data correspondence information table including a one-to-one correspondence between the illuminated infrared sensors and the virtual accessory; acquiring a light spot image of the infrared sensor on the control handle captured by the camera device; determining the information of the illuminated infrared sensor based on the light spot image of the infrared sensor; determining the virtual accessory based on the information of the illuminated infrared sensor and the data correspondence information table; and determining the motion information of the user's virtual accessory based on the spatial positioning information of the control handle.

[0007] In one embodiment of the present invention, after determining the virtual accessory based on the information of the illuminated infrared sensor and the data correspondence information table, the step of determining the motion information of the user's interactive avatar based on the spatial positioning information of the control handle further includes: acquiring the input virtual accessory sent by the control handle controller; when the virtual accessory determined based on the information of the illuminated infrared sensor and the data correspondence information table is consistent with the input virtual accessory, the virtual accessory determined based on the information of the illuminated infrared sensor and the data correspondence information table is determined to be the user's virtual accessory.

[0008] In one embodiment of the present invention, determining the motion information of the user's interactive avatar based on the spatial positioning information of the control handle further includes: when the virtual accessory determined based on the information of the illuminated infrared sensor and the data correspondence information table is inconsistent with the input virtual accessory, determining that the input virtual accessory is the user's virtual accessory.

[0009] In one embodiment of the present invention, the gaming device includes a virtual reality device; the gaming device further includes a head-mounted device; and a third inertial sensor disposed on the head-mounted device, the third inertial sensor being used to detect IMU data of the head-mounted device; wherein, the control method further includes: acquiring the IMU data of the head-mounted device detected by the third inertial sensor; acquiring a spatial image of the head-mounted device captured by the camera device; determining the spatial positioning information of the head-mounted device based on the IMU data of the head-mounted device and the spatial image of the head-mounted device; and sending the spatial positioning information of the head-mounted device to the game console of the relevant user; wherein, determining the motion information of the user's interactive avatar based on the spatial positioning information of the control handle includes: determining the motion information of the interactive avatar based on the spatial positioning information of the control handle and the spatial positioning information of the head-mounted device.

[0010] In one embodiment of the present invention, after determining the motion information of the user's interactive avatar based on the spatial positioning information of the control handle, the control method further includes: receiving the spatial positioning information of the control handle of the relevant user sent by the relevant user, and determining the motion information of the interactive avatar of the relevant user based on the spatial positioning information of the control handle of the relevant user; and updating the display screen based on the motion information of the user's interactive avatar and the motion information of the interactive avatar of the relevant user.

[0011] In one embodiment of the present invention, constructing a physical interaction scene model corresponding to the physical environment in which the user is located includes: acquiring a spatial image of the game console captured by a camera device on the game console; determining the physical environment information of the physical environment in which the user is located based on the spatial image of the game console; and rendering the physical environment information of the actual environment in which the user is located to generate a physical interaction scene model corresponding to the physical environment in which the user is located.

[0012] As a second aspect of the present invention, the present invention also provides a multi-user interactive system suitable for multiple users to experience interactive games through gaming devices in a real living room scene. The multi-user interactive system includes: multiple gaming devices and a multi-user interactive game controller, the multi-user interactive game controller being communicatively connected to each of the multiple gaming devices; wherein each gaming device includes: a game console and a console mounting device, the game console being fixed to the console mounting device; a gamepad, the gamepad including: a control handle; N infrared sensors disposed on the control handle, where N is an integer greater than 1; a first inertial sensor mounted on the control handle; a second inertial sensor disposed on the game console; and a camera device disposed on the game console; wherein the multi-user interactive game controller includes: a model building unit, used to build a living room scene model corresponding to the physical living room scene where the user is located, and to send the physical interactive scene model to the user's device. The system includes: a game console for gaming devices and the game console for gaming devices used by relevant users; a first spatial positioning unit, used to determine the 6DOF data of the game console based on the spatial image of the game console captured by the camera device and the IMU data of the game console detected by the second sensor; to determine the 6DOF data of the control handle based on the light spot image of the infrared sensor on the control handle captured by the camera device and the IMU data of the control handle detected by the first inertial sensor; and to determine the spatial positioning information of the control handle based on the 6DOF data of the control handle and the 6DOF data of the game console; an interactive avatar control unit, used to project the interactive avatar corresponding to the user onto the living room scene model; to determine the motion information of the user's interactive avatar based on the spatial positioning information of the control handle; and a data transmission unit, used to send the spatial positioning information of the control handle to the game console of the relevant user.

[0013] In one embodiment of the present invention, the handle further includes: a handle controller disposed within the control handle; and an instruction input device disposed on the control handle, the instruction input device being communicatively connected to the handle controller, through which the user inputs virtual accessories of the user's interactive avatar; wherein, the handle controller is used to control the illumination of M infrared sensors corresponding to the virtual accessories according to the input instruction information input by the user; the illumination of the M infrared sensors corresponds to one type of virtual accessory, wherein M is an integer greater than 1, and N is greater than or equal to M; wherein, the interactive avatar control unit includes: an interactive avatar projection module, used to project... An interactive avatar corresponding to the user is projected onto the living room scene model; a data acquisition module, which is communicatively connected to the camera device and the controller, acquires a data correspondence information table sent by the controller, the data correspondence information table including a one-to-one correspondence between the illuminated infrared sensors and virtual accessories; acquires the light spot image of the infrared sensor on the controller taken by the camera device; determines the information of the illuminated infrared sensor based on the light spot image of the infrared sensor; and determines the virtual accessory based on the information of the illuminated infrared sensor and the data correspondence information table; and

[0014] The control module is communicatively connected to the virtual accessory determination module. The control module is used to determine the motion information of the user's virtual accessory based on the spatial positioning information of the control handle.

[0015] In one embodiment of the present invention, the interactive avatar control unit further includes: a judgment module, which is communicatively connected to the virtual accessory determination module and the control module, respectively. The judgment module is used to acquire the input virtual accessory sent by the controller; and when the virtual accessory determined based on the information of the illuminated infrared sensor and the data correspondence information table matches the input virtual accessory, it determines that the virtual accessory determined based on the information of the illuminated infrared sensor and the data correspondence information table is the user's virtual accessory; and when the virtual accessory determined based on the information of the illuminated infrared sensor and the data correspondence information table does not match the input virtual accessory, it determines that the input virtual accessory is the user's virtual accessory.

[0016] In one embodiment of the present invention, the gaming device includes a virtual reality device, an augmented reality device, or a mixed reality device; the gaming device further includes a head-mounted device; and a third inertial sensor disposed on the head-mounted device, the third inertial sensor being used to detect IMU data of the head-mounted device; wherein, the multiplayer interactive game controller further includes a second spatial positioning unit, used to acquire the IMU data of the head-mounted device detected by the third inertial sensor; acquire a spatial image of the head-mounted device captured by the camera device; determine the spatial positioning information of the head-mounted device based on the IMU data of the head-mounted device and the spatial image of the head-mounted device; and send the spatial positioning information of the head-mounted device to the game console of the relevant user; the interactive avatar control unit is further used to determine the motion information of the interactive avatar based on the spatial positioning information of the control handle and the spatial positioning information of the head-mounted device.

[0017] In one embodiment of the present invention, the handle controller includes: an input command acquisition module, which is used to acquire input command information input by a user in the command input device; a judgment module, which is communicatively connected to the input command acquisition module, and is used to determine M infrared sensors corresponding to the input command information based on the input command information input by the user; and a control module, which is communicatively connected to the judgment module, and is used to illuminate the M infrared sensors corresponding to the input command information.

[0018] In one embodiment of the present invention, the multiple game hosts of the multiple game devices are the same game host.

[0019] The gaming device provided by this invention uses a camera device on the game console to capture images of the light spots from the infrared sensors on the controller, thereby determining the spatial position information of the controller. Combined with the controller's IMU data, the 6DOF data of the controller is determined. The environment image captured by the camera device and the game console's IMU data determine the game console's 6DOF data. Based on the game console's 6DOF data and the controller's 6DOF data, the spatial positioning information of the controller is determined, thus improving the controller's accurate positioning. This enhances the human-computer interaction based on spatial positioning information, improving the gaming experience. Therefore, when multiple gaming devices experience multiplayer interactive games in the same physical environment, not only can multiple gaming devices (between multiple handheld consoles, or between a handheld console and a VR device) experience multiplayer interactive games in the same physical environment, but real-time dynamic tracking can also be achieved, improving the experience of multiplayer interactive scenarios. Attached Figure Description

[0020] The above and other objects, features, and advantages of the present invention will become more apparent from the more detailed description of the embodiments of the invention in conjunction with the accompanying drawings. The drawings are provided to further illustrate the embodiments of the invention and form part of the specification. They are used together with the embodiments of the invention to explain the invention and do not constitute a limitation thereof. In the drawings, the same reference numerals generally represent the same parts or steps.

[0021] Figure 1 The diagram shown is a schematic diagram illustrating the working principle of a gaming device according to an embodiment of the present invention.

[0022] Figure 2 The diagram shown illustrates the working principle of a multiplayer interactive game system according to an embodiment of the present invention.

[0023] Figure 3 The diagram shown is a flowchart illustrating a control method for a multiplayer interactive game according to an embodiment of the present invention.

[0024] Figure 4 The diagram shown illustrates the working principle of a game device (handheld console) according to another embodiment of the present invention.

[0025] Figure 5 The diagram shown is a schematic diagram illustrating the working principle of a multiplayer interactive game system provided in another embodiment of the present invention.

[0026] Figure 6 The diagram shown is a schematic diagram illustrating the working principle of a multiplayer interactive game system provided in another embodiment of the present invention.

[0027] Figure 7 The diagram shown is a schematic diagram illustrating the working principle of a gaming device (VR device) according to another embodiment.

[0028] Figure 8 The diagram shown is a flowchart illustrating a control method for a multiplayer interactive game according to another embodiment of the present invention.

[0029] Figure 9 The diagram shown is a schematic diagram of the working principle of a game device provided in another embodiment of the present invention;

[0030] Figure 10 The diagram shown is a schematic diagram of the working principle of a game device provided in another embodiment of the present invention;

[0031] Figure 11 The diagram shown is a distribution diagram of infrared sensors on a control handle provided in an embodiment of the present invention;

[0032] Figure 12 The diagram shown is a schematic diagram of the working principle of a game device provided in another embodiment of the present invention;

[0033] Figure 13The diagram shown is a flowchart illustrating a control method for a multiplayer interactive game according to another embodiment of the present invention.

[0034] Figure 14 The diagram shown is a flowchart illustrating a control method for a multiplayer interactive game according to another embodiment of the present invention.

[0035] Figure 15 The diagram shown is a flowchart illustrating a control method for a multiplayer interactive game according to another embodiment of the present invention.

[0036] Figure 16 The diagram shown is a flowchart illustrating a control method for a multiplayer interactive game according to another embodiment of the present invention.

[0037] Figure 17 The diagram shown is a schematic diagram of the working principle of an electronic device provided in an embodiment of the present invention.

[0038] Explanation of reference numerals in the attached figures:

[0039] 1-Gaming equipment;

[0040] 10-Game console; 100-Interactive controller; 101-Second inertial sensor; 102-Camera device; 103-Display screen; 104-Base; 106-Connector; 107-Television set;

[0041] 20-Handle; 200-Control handle; 201-Infrared sensor; 202-First inertial sensor; 203-Command input device; 204-Handle controller; 2041-Input command acquisition module; 2042-Judgment module; 2043-Control module;

[0042] 30 - Head-mounted device; 301 - Third inertial sensor; Detailed Implementation

[0043] In the description of this invention, "a plurality of" means at least two, such as two, three, etc., unless otherwise explicitly specified. All directional indications (such as up, down, left, right, front, back, top, bottom, etc.) in the embodiments of this invention are only used to explain the relative positional relationships and movement of the components in a specific orientation (as shown in the accompanying drawings). If the specific orientation changes, the directional indication will also change accordingly. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or devices.

[0044] Furthermore, the reference to "embodiment" herein means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of the invention. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0045] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0046] As a first aspect of the present invention, the present invention provides a gaming device. Figure 1 The diagram shown is a schematic diagram illustrating the working principle of a gaming device 1 provided in an embodiment of the present invention. Figure 1 As shown, the gaming device 1 includes:

[0047] Game console 10 includes an interactive controller 100, which is used to control the user of game device 1 and the related game device 1 used by the user to complete interactive games, with the user and the related user located in the same physical environment;

[0048] Handle 20 includes: a control handle 200; N infrared sensors 201 disposed on the control handle 200, wherein N is an integer greater than 1; and a first inertial sensor 202 mounted on the control handle 200, the first inertial sensor 202 being used to detect IMU data of the control handle 200 and transmit the IMU data of the control handle 200 to the interactive controller 100.

[0049] A second inertial sensor 101 is installed on the game console 10. The second inertial sensor 101 is used to detect the IMU data of the game console 10 and transmit the IMU data of the game console 10 to the interactive controller 100.

[0050] A camera device 102 mounted on the game console 10 is used to capture images of the space in which the game console 10 is located and the light spot images from the infrared sensor 201 mounted on the controller 200. The camera device 102 transmits these images to the interactive controller 100. Specifically, when the game console 10 is a mobile terminal, the camera device 102 can be a rear-facing camera. Optionally, there can be one or more camera devices 102. When there are multiple camera devices 102, they can be evenly distributed across the mobile terminal.

[0051] Display screen 103 can display the game interface;

[0052] The display screen 103, the first inertial sensor 202, the second inertial sensor 101, and the camera device 102 are all communicatively connected to the interactive controller 100.

[0053] Specifically, an inertial measurement unit (IMU) is a device that measures the three-axis attitude angles (or angular rates) and acceleration of an object. Generally, an IMU contains three single-axis accelerometers and three single-axis gyroscopes. The accelerometers detect the acceleration signals of the object along the three independent axes of the carrier coordinate system, while the gyroscopes detect the angular velocity signals of the carrier relative to the navigation coordinate system. Therefore, an inertial sensor can measure the angular velocity and acceleration of an object in three-dimensional space and use this to calculate the object's attitude, such as the rotational degrees of freedom (DOF), which refer to the degrees of freedom related to the three positions of up / down, forward / backward, and left / right. IMU data is the result data of the inertial sensor detecting the object, that is, the angular velocity and acceleration data of an object in three-dimensional space detected by the inertial sensor. Therefore, the first inertial sensor 202 can detect the IMU data of the control handle 200, so that the attitude of the control handle 200 can be calculated based on the IMU data of the control handle 200, such as the rotational degrees of freedom of the control handle 200, which refer to the degrees of freedom related to the three positions of up / down, forward / backward, and left / right.

[0054] When multiple gaming devices 1 can work together to form a multiplayer interactive gaming system, that is, multiple users interact in the same physical environment, the interactive controller 100 in the game host 10 controls the gaming devices 1 of the relevant users to complete the interactive game, such as... Figure 2 As shown, Figure 2 The diagram shown illustrates the working principle of a multiplayer interactive game system. Figure 2 As shown, the multiplayer interactive game system includes multiple game devices 1, and multiple game consoles 10 within the multiple game devices 1 are connected via communication with interactive controllers 100. Specifically, Figure 3The diagram shown is a flowchart illustrating the control method for a multiplayer interactive game. Figure 3 As shown, when game device 1 and related game devices 1 engage in multiplayer interactive games, the control method specifically executed by the interactive controller 100 in the game host 10 of each game device 1 includes the following steps:

[0055] Step S10: Construct a living room scene model corresponding to the physical living room environment where the user is located, and send the living room scene model to the interactive controller 100 of the game console 10 of the relevant game device 1 used by the relevant user;

[0056] When multiple people experience interactive games in a physical living room environment, step S10 can be executed by the interactive controller 100 in the game console 10 of multiple game devices 1. After the interactive controller 100 of the game device 1 used by one user constructs the living room scene model, it sends the living room scene model to the relevant user. For example, when users A, B, C, and D experience interactive games in a physical living room environment, user A is the user, and users B, C, and D are the relevant users. In step S10, when the game device 1 used by user A can construct the living room scene model, it is then sent to the interactive controller 100 of the game console 10 of the game device 1 used by the relevant user. Similarly, when user A is a relevant user in step S10, the user receives the living room scene model sent by the user.

[0057] It should be noted that the game device 1 used in step S10 to construct the living room scene model can be the game device 1 corresponding to any user in the multiplayer interactive game.

[0058] Step S20: Project the interactive avatar corresponding to the user onto the living room scene model;

[0059] Step S30: Determine the 6DOF data of the game console 10 based on the spatial image of the game console 10 captured by the camera device 102 and the IMU data of the game console 10 detected by the second sensor;

[0060] Step S40: Determine the 6DOF data of the control handle 200 based on the spot image of the infrared sensor 201 on the control handle 200 captured by the camera device 102 and the IMU data of the control handle 200 detected by the first inertial sensor 202.

[0061] Specifically, the infrared sensor 201 contains a miniature infrared sensor 201 that emits infrared light. When the miniature infrared sensor 201 is in the active state, the camera can capture an image of the light spot of the miniature infrared sensor 201, thus determining the position of the light spot as the position of the corresponding infrared emitter. Generally, each infrared sensor 201 contains several miniature infrared sensors 201, and the multiple lights of the infrared sensor 201 form a light ring. The camera can capture the light spot image of the infrared sensor 201, thus obtaining the light spot image of the infrared sensor 201 from the camera. Therefore, the spatial position information of the control handle 200 can be determined by the light spot image of the infrared sensor 201 on the control handle 200 captured by the camera device 102. Then, combined with the IMU data of the control handle 200, the six degrees of freedom (6DOF) data of the control handle 200 can be calculated, i.e., the 6DOF data of the control handle 200.

[0062] Step S50: Determine the spatial positioning information of the controller 200 based on the 6DOF data of the controller 200 and the 6DOF data of the game console 10;

[0063] Step S60: Determine the motion information of the user's interactive avatar based on the spatial positioning information of the control handle 200;

[0064] The controller 200 is used by the user when experiencing interactive games on the gaming device 1. The user controls the controller 200 by manipulating the buttons on the controller 200 (e.g., by pressing the command buttons or waving the controller 200) to generate action control commands for the interactive avatar in the game. These action control commands include forward, backward, left, right, rotation, and jump. The user can view the game interface on the display screen 103 to see the specific game actions of the interactive avatar.

[0065] Step S70: Send the spatial positioning information of the controller 200 to the game console 10 of the relevant user.

[0066] At the same time, the spatial positioning information of the control handle 200 determined in step S50 also needs to be sent to the interactive controller 100 in the game console 10 of the game device 1 of the relevant user, so that the interactive controller 100 in the game device 1 of the relevant user can control the game actions of the interactive avatar of the user on the display interface 103 of the relevant user according to the spatial positioning information of the control handle 200, so as to achieve the purpose of multiplayer interactive games.

[0067] The game device 1 provided by the present invention determines the spatial position information of the control handle 200 by setting a camera device 102 on the game console 10 to capture the light spot image of the infrared sensor 201 on the control handle 200. Combined with the IMU data of the control handle 200, the 6DOF data of the control handle 200 is determined. The environmental image of the game console 10 captured by the camera device 102 and the IMU data of the game console 10 determine the 6DOF data of the game console 10. Based on the 6DOF data of the game console 10 and the 6DOF data of the control handle 200, the spatial positioning information of the control handle 200 is determined, thereby improving the accurate positioning of the control handle 200. This improves the human-computer interaction based on spatial positioning information and enhances the gaming experience. Therefore, when multiple game devices 1 experience multiplayer interactive games in the same physical environment, not only can multiple game devices 1 (between multiple handheld consoles, between handheld consoles and VR devices) experience multiplayer interactive games in the same physical living room environment, but also real-time dynamic tracking can be achieved, improving the experience effect of multiplayer interactive scenes.

[0068] Optionally, the gaming device 1 can be a handheld console, a virtual reality (VR) device, an augmented reality (AR) device, or a mixed reality (MR) device. When multiple users use multiple gaming devices 1 to experience interactive games in a living room setting, the types of gaming devices 1 used by the multiple users can be the same or different. For example, three users can use a handheld console, a virtual reality (VR) device, and an augmented reality (AR) device to experience interactive games respectively; three users can use a handheld console, a handheld console, and a mixed reality (MR) device to experience interactive games respectively; three users can all use a handheld console to experience interactive games; or three users can use a virtual reality (VR) device, an augmented reality (AR) device, and a mixed reality (MR) device to experience interactive games respectively.

[0069] When multiple users use multiple gaming devices 1 to experience interactive games in a living room setting, the host for these multiple gaming devices can be the same gaming host 10, meaning multiple gaming devices share one gaming host 10. For example, if three users can use virtual reality (VR) devices, augmented reality (AR) devices, and mixed reality (MR) devices respectively to experience interactive games, these devices can share one gaming host 10.

[0070] In one embodiment of the present invention, the game device 1 can be a handheld console or a virtual reality device (hereinafter referred to as VR device). When the game device 1 is a handheld console, Figure 4 The diagram shown illustrates the working principle of a game device 1 (handheld console) according to another embodiment of the invention. Figure 4 As shown, gaming device 1 (handheld) also includes:

[0071] The game console 10 is fixed to the host mounting device, which is set in a physical living room environment.

[0072] Specifically, when the game device 1 is a handheld console, the game host 10 can be a mobile terminal, such as a mobile phone or tablet. When the game host 10 is a mobile terminal, a host fixing device is set up in the physical living room environment where the multiplayer interactive game is played to fix the mobile terminal. The host fixing device can be a base 104, which is equipped with a connector 106. When the mobile terminal is inserted into the base 104, it can communicate with the control handle 200 and the display screen 103 through the connector 106.

[0073] Optional, such as Figure 5 As shown, the physical living room environment can be a living room scene, which includes a television 107 and a fixing device for fixing the television 107. In this case, the content originally displayed on the display screen 103 of the game device 1 (handheld console) can be directly displayed on the television 107 in the living room scene. That is, the interactive controller 100 in the game console 10 is directly connected to the television 107 through the connector 106 on the base 104. In other words, when multiple people are experiencing multiplayer interactive games in the living room scene, the display screen of the handheld console can be directly displayed on the television 107, making full use of the existing electrical appliances in the physical environment. In addition, the screen area of ​​the display screen 103 of the television 107 is much larger than the display screen area of ​​the display screen 103 of the mobile terminal. Therefore, displaying the display screen of the handheld console on the television 107 allows users to see the game interface better, improving the user experience.

[0074] It should be noted that, as Figure 6 As shown, the display screen 103 in the game device 1 (handheld console) can be directly connected to the television 107. The display screen 103 is still connected to the interactive controller 100 in the game console 10 via the dock 104. The display screen 103 is then connected to the television 107. The interactive controller 100 transmits the display screen of the interactive game to the display screen 103, and the display screen 103 transmits the display screen of the interactive game to the television 107. The television 107 displays the display screen of the interactive game.

[0075] Optional, such as Figure 5As shown, when multiple people are playing a multiplayer interactive game in a living room setting, and they use handheld consoles to play the game, the display screens of the game devices 1 (handheld consoles) used by these multiple people can all be displayed on the television 107. At this time, the game consoles 10 of multiple handheld consoles are all connected to the television 107, and interactive games between multiple users using handheld consoles can be realized through a single television 107, improving the user experience.

[0076] In one embodiment of the present invention, the game device 1 is a virtual reality device, i.e., a VR device, such as... Figure 7 As shown, gaming device 1 also includes:

[0077] Head-mounted device 30, the head-mounted device 30 having a display screen 103; and

[0078] A third inertial sensor 301 is installed on the head-mounted device 30. The third inertial sensor 301 is used to detect the IMU data of the head-mounted device 30. The third inertial sensor 301 is communicatively connected to the interactive controller 100 and transmits the detected IMU data of the head-mounted device 30 to the interactive controller 100.

[0079] Optionally, the display screen 103 can be integrated into the game console 10, and the game console 10 is fixed to the head-mounted device 30, that is, the virtual reality device is an all-in-one machine.

[0080] The controller 20, head-mounted device 30, and display screen 103 together constitute a virtual system. Users can experience interactive games by wearing the head-mounted device 30 and controlling the controller 200. Figure 8 As shown, when the game device 1 is a virtual reality device, the interactive controller 100 in the game console 10 on the virtual reality device controls the virtual reality device to complete the interactive game. Figure 3 Based on the control method shown, the control method executed by the interactive controller 100 in the game console 10 of the virtual reality device further includes the following steps:

[0081] Step S80: Acquire IMU data of head-mounted device 30 detected by third inertial sensor 301;

[0082] Step S81: Acquire the spatial image of the head-mounted device 30 captured by the camera device 102;

[0083] Step S82: Determine the spatial positioning information of the head-mounted device 30 based on the IMU data of the head-mounted device 30 and the spatial image of the location of the head-mounted device 30; and

[0084] Step S83: Send the spatial positioning information of the head-mounted device 30 to the game console 10 of the relevant user;

[0085] at this time, Figure 3Step S60 in the control method shown (determining the motion information of the user's interactive avatar based on the spatial positioning information of the handle 20) specifically includes the following steps:

[0086] Step S61: Determine the motion information of the interactive avatar based on the spatial positioning information of the handle 20 and the spatial positioning information of the head-mounted device 30.

[0087] That is, when a user uses a virtual reality device to experience an interactive game, in addition to the controller 200 controlling the movement of the interactive avatar, the spatial positioning information of the head-mounted device 30 can also control the movement of the interactive avatar. In multiplayer interactive games, when the user's gaming device 1 is a virtual reality device, the interactive controller 100 in the game console 10 of the virtual reality device executes... Figure 8 The control method shown enables game interaction between handheld console users and virtual reality users.

[0088] In one embodiment of the present invention, during multiplayer interactive games, regardless of whether the game device 1 is a handheld console or a virtual reality device, the game device 1 includes a controller 20, and the user controls the movement of the interactive avatar by manipulating the control handle 200 on the controller 20. In practical applications, interactive avatars often have accessories (such as swords, guns, boxing gloves, ping-pong paddles, etc.), and the user experiences the actions of the interactive avatar in the game by controlling the movement of the accessories. At this time, such as Figures 9-10 As shown, the handle 20 also includes:

[0089] Handle controller 204 disposed within control handle 200; and

[0090] A command input device 203 is installed on the control handle 200. The command input device 203 is communicatively connected to the handle controller 204. The user inputs virtual accessories of the user's interactive avatar through the command input device 203.

[0091] The handle controller 204 is used to control the lighting of M infrared sensors 201 corresponding to virtual accessories according to the input command information input by the user; wherein the lighting of M infrared sensors 201 corresponds to one virtual accessory, and M is an integer greater than 1, and N is greater than or equal to M.

[0092] The infrared sensor 201 can be activated based on the virtual accessory input by the user, and the interactive controller 100 can determine the type of virtual accessory used by the user based on the activated infrared sensor 201 during the game.

[0093] Specifically, the correspondence between M illuminated infrared sensors 201 and one virtual accessory can be achieved in the following two ways:

[0094] (1) The number of infrared sensors 201 determines the virtual accessories. A data correspondence information table can be used to record the correspondence between the virtual accessories and the corresponding number of infrared sensors 201.

[0095] For example, the control handle 200 is equipped with eight infrared sensors 201. Two infrared sensors 201 illuminated correspond to virtual accessory one, three infrared sensors 201 illuminated correspond to virtual accessory two, four infrared sensors 201 illuminated correspond to virtual accessory three, five infrared sensors 201 illuminated correspond to virtual accessory four, six infrared sensors 201 illuminated correspond to virtual accessory five, seven infrared sensors 201 illuminated correspond to virtual accessory six, and eight infrared sensors 201 illuminated correspond to virtual accessory seven. When five infrared sensors 201 are illuminated, the camera device 102 captures an image of the light spots when the five infrared sensors 201 are illuminated. From this image, the number of illuminated infrared sensors 201 can be determined to be five, and thus the corresponding virtual accessory, virtual accessory four, can be found in the data correspondence information table.

[0096] The number of illuminated infrared sensors 201 is used to determine virtual accessories, meaning the correspondence between the number of illuminated infrared sensors 201 and virtual accessories is simple. Determining virtual accessories based on the light spot images of the illuminated infrared sensors 201 captured by the camera device 102 is a simple method that reduces computational load. However, due to the limited area of ​​the control handle 200, the number of infrared sensors 201 that can be installed is also limited. This method is only suitable for game devices 1 with a relatively small number of virtual accessories.

[0097] (2) Virtual accessories are determined based on the number of M infrared sensors 201 that are lit and the pattern formed by the lit infrared sensors 201. A data correspondence information table can be used to record the correspondence between virtual accessories and the corresponding number of infrared sensors 201 that are lit and the pattern formed by the lit infrared sensors 201.

[0098] For example, the control handle 200 is equipped with 8 infrared sensors 201 and 2 infrared sensors 201. The 8 infrared sensors 201 are installed on the control handle 200 in the following manner: Figure 11 As shown, eight infrared sensors 201 are evenly mounted on a circle, forming a circle. When three of the eight infrared sensors 201 are lit, the light spot images of the three lit sensors 201 captured by the camera device 102 will inevitably be different, such as... Figure 11 As shown.

[0099] Since the image formed by the illuminated infrared sensors 201 is used as a second condition in addition to the number of illuminated infrared sensors 201, a larger number of virtual accessories can be accommodated. However, due to the added limiting conditions, the computational difficulty is increased when analyzing the light spot image to determine the virtual accessories after the camera device 102 captures the light spot image.

[0100] Optional, such as Figure 12 As shown, the handle controller 204 includes:

[0101] Input instruction acquisition module 2041 is used to acquire input instruction information entered by the user in instruction input device 203;

[0102] The judgment module 2042 is communicatively connected to the input command acquisition module 2041. The judgment module 2042 is used to determine the M infrared sensors 201 corresponding to the input command information based on the user's input command information; and

[0103] The control module 2043 is communicatively connected to the judgment module 2042. The control module 2043 is used to light up the M infrared sensors 201 corresponding to the input command information.

[0104] Specifically, as mentioned above, when interactive avatars often have accessories (such as swords, guns, boxing gloves, ping-pong paddles, etc.), and the player experiences the interactive avatar's actions in the game by controlling the movement of these accessories, based on... Figure 3 Based on the control method shown, step S60 (determining the motion information of the user's interactive avatar based on the spatial positioning information of the controller 20) of the control method specifically executed by the interactive controller 100 in the game console 10 of the game device 1 may specifically include the following steps, such as... Figure 13 As shown:

[0105] Step S601: Obtain the data correspondence information table, which includes the one-to-one correspondence between the lit infrared sensor 201 and the virtual accessory;

[0106] Step S602: Acquire the light spot image of the infrared sensor 201 on the control handle 200 captured by the camera device 102;

[0107] Step S603: Determine the information of the illuminated infrared sensor 201 based on the spot image of the infrared sensor 201;

[0108] Step S604: Determine the virtual accessory based on the information from the illuminated infrared sensor 201 and the data correspondence information table;

[0109] Specifically, the data correspondence information table refers to the one-to-one correspondence between the information of the illuminated infrared sensor 201 and the virtual accessories. This data correspondence information table can be stored in the interactive controller 100 at the factory, or it can be sent to the interactive controller 100 by the handheld controller 204 during actual application.

[0110] Step S605: Determine the motion information of the user's virtual accessory based on the spatial positioning information of the control handle 200.

[0111] For example, the control handle 200 is equipped with eight infrared sensors 201. Two infrared sensors 201 illuminate corresponding to virtual accessory one, three infrared sensors 201 illuminate corresponding to virtual accessory two, four infrared sensors 201 illuminate corresponding to virtual accessory three, five infrared sensors 201 illuminate corresponding to virtual accessory four, six infrared sensors 201 illuminate corresponding to virtual accessory five, seven infrared sensors 201 illuminate corresponding to virtual accessory six, and eight infrared sensors 201 illuminate corresponding to virtual accessory seven. When five infrared sensors 201 are illuminated, the camera device 102 captures an image of the light spots when the five infrared sensors 201 are illuminated. From this image, the number of illuminated infrared sensors 201 can be determined to be five. Therefore, the corresponding virtual accessory, virtual accessory four, can be found in the data correspondence information table. Based on the spatial positioning information of the control handle 200, the movement information of virtual accessory four can be determined, i.e., the movement of virtual accessory four can be controlled.

[0112] In one embodiment of the present invention, such as Figure 10 As shown, the gamepad controller 204 is communicatively connected to the interactive controller 100 in the game console 10. The gamepad controller 204 can directly send the virtual accessories of the interactive avatar input by the user to the interactive controller 100. The interactive controller 100 can then directly control the movement of the virtual accessories based on the spatial positioning information of the gamepad 200. The interactive controller 100 can also determine the virtual accessories based on the light spot image. That is, the interactive controller 100 has two ways to determine the virtual accessories, which reduces the probability of being unable to determine the user's virtual accessories due to the failure of the command input device 203 or the infrared sensor 201, thereby improving the user's gaming experience.

[0113] At this time, when game device 1 is Figure 10 When the game device 1 is shown, the control method specifically executed by the interactive controller 100 in the game console 10 of the game device 1 is as follows: Figure 13 Based on the method shown, between step S604 and step S605, the control method further includes the following steps, such as... Figure 14 As shown:

[0114] Step S606: Obtain the input virtual accessory sent by the handle controller 204;

[0115] Optional, such as Figure 12 As shown, the virtual accessories can be obtained from the judgment module 2042 in the controller 204.

[0116] Step S607: Determine whether the input virtual accessory matches the virtual accessory determined based on the information from the illuminated infrared sensor 201 and the data correspondence information table.

[0117] When the judgment result of step S607 is yes, it means that the judgment module 2042 in the interactive controller 100 determines that the virtual accessory is consistent with the input virtual accessory of the user based on the information of the lit infrared sensor 201 and the data correspondence information table. That is, in the actual working process, the communication between the interactive controller 100 and the handle controller 204 and the infrared sensor 201 are working normally. It directly determines that the virtual accessory determined by the information of the lit infrared sensor 201 and the data correspondence information table is the user's virtual accessory, that is, it executes step S608, which further increases the accuracy of the virtual accessory.

[0118] Step S608: Determine that the virtual accessory identified based on the information from the illuminated infrared sensor 201 and the data correspondence information table is the user's virtual accessory.

[0119] Step S609: Confirm that the input virtual accessory is the user's virtual accessory.

[0120] If the judgment result of step S607 is negative, it means that the judgment module 2042 in the interactive controller 100 determines that the virtual accessory is inconsistent with the input virtual accessory of the user based on the information of the lit infrared sensor 201 and the data correspondence information table. That is, in the actual working process, at least one of the communication between the interactive controller 100 and the handle controller 204 and the infrared sensor 201 has failed. Therefore, it is directly determined that the input virtual accessory is the user's virtual accessory.

[0121] In one embodiment of the present invention, since it is a multiplayer interactive game, in addition to sending the spatial positioning information of the user's control handle 200 to the game host 10 of the relevant user (step S70), the user of the game device 1 also needs to receive the spatial positioning information of the control handle 200 of the relevant user sent by the relevant user, that is, to execute step S80, such as... Figure 15 As shown, the control method for multiplayer interactive games also includes the following steps:

[0122] Step S80: Receive spatial positioning information of the controller 20 sent by the relevant user, and determine the motion information of the interactive avatar of the relevant user based on the spatial positioning information of the controller 20; and

[0123] Step S90: Update the display screen based on the motion information of the user's interactive avatar and the motion information of the interactive avatars of related users.

[0124] This enables multiplayer interactive games and enhances the user experience.

[0125] Optionally, when the physical environment of the multiplayer interactive game is a living room scene, such as Figure 5 or Figure 6 As shown, when the display screen in the game device 1 (handheld console) can be directly displayed on the television 107 in the living room scene, step S90 (updating the display screen based on the motion information of the user's interactive avatar and related user interactive avatars) includes:

[0126] Step S91: Update the display screen on the TV 107 based on the motion information of the user's interactive avatar and the motion information of the relevant user's interactive avatar.

[0127] In one embodiment of the present invention, such as Figure 16 As shown, step S10 (constructing the entity interaction scene model corresponding to the user's physical environment) specifically includes the following steps:

[0128] Step S101: Obtain the spatial image of the game console 10 as captured by the camera device 102 on the game console 10;

[0129] Step S102: Determine the physical living room environment information of the user's physical living room environment based on the spatial image of the game console 10; and

[0130] Step S103: Render the physical living room environment information of the user's physical living room environment to generate a living room scene model corresponding to the user's physical living room environment.

[0131] As a third aspect of the invention, the invention also provides an electronic device, such as... Figure 17 As shown, the electronic device 900 includes one or more processors 901 and memory 902.

[0132] The processor 901 may be a central processing unit (CPU) or other form of processing unit with data processing and / or information execution capabilities, and may control other components in the electronic device 900 to perform desired functions.

[0133] The memory 901 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, random access memory (RAM) and / or cache memory. The non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program information may be stored on the computer-readable storage medium, and the processor 901 may run the program information to implement the interactive game control methods or other desired functions described in the various embodiments of the present invention above.

[0134] In one example, the electronic device 900 may also include an input device 903 and an output device 904, which are interconnected via a bus system and / or other forms of connection mechanism (not shown).

[0135] The input device 903 may include, for example, a keyboard, a mouse, etc.

[0136] The output device 904 can output various information to the outside. The output device 904 may include, for example, a display, a communication network, and remote output devices connected thereto.

[0137] Of course, for the sake of simplicity, Figure 17 Only some of the components of the electronic device 900 relevant to the present invention are shown, omitting components such as buses, input / output interfaces, etc. In addition, the electronic device 900 may include any other suitable components depending on the specific application.

[0138] In addition to the methods and devices described above, embodiments of the present invention may also be computer program products, which include computer program information that, when run by a processor, causes the processor to perform the steps in the control methods for interactive games according to various embodiments of the present invention as described in this specification.

[0139] The computer program product can be written in any combination of one or more programming languages ​​to perform the operations of the embodiments of the present invention. The programming languages ​​include object-oriented programming languages ​​such as Java and C++, as well as conventional procedural programming languages ​​such as C or similar languages. The program code can be executed entirely on the user's computing device, partially on the user's computing device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0140] Furthermore, embodiments of the present invention may also be computer-readable storage media storing computer program information thereon, which, when run by a processor, causes the processor to execute the steps in the interactive game control method according to various embodiments of the present invention.

[0141] The computer-readable storage medium may be any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may, for example, include, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatuses, or devices, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: communication connections having one or more wires, portable disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0142] The basic principles of the present invention have been described above with reference to specific embodiments. However, it should be noted that the advantages, benefits, and effects mentioned in the present invention are merely examples and not limitations, and should not be considered as essential features of each embodiment of the present invention. Furthermore, the specific details disclosed above are for illustrative and facilitative purposes only, and are not limitations. These details do not limit the present invention to the necessity of employing the aforementioned specific details.

[0143] The block diagrams of devices, apparatuses, devices, and systems involved in this invention are merely illustrative examples and are not intended to require or imply that they must be connected, arranged, or configured in the manner shown in the block diagrams. As those skilled in the art will recognize, these devices, apparatuses, devices, and systems can be connected, arranged, and configured in any manner. Words such as “comprising,” “including,” “having,” etc., are open-ended terms meaning “including but not limited to,” and are used interchangeably with them. The terms “or” and “and” as used herein refer to the terms “and / or,” and are used interchangeably with them unless the context clearly indicates otherwise. The term “such as” as used herein refers to the phrase “such as but not limited to,” and is used interchangeably with it.

[0144] It should also be noted that in the apparatus, device, and method of the present invention, the components or steps can be disassembled and / or recombined. These disassemblies and / or recombinations should be considered as equivalent solutions of the present invention.

[0145] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use the invention. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein can be applied to other aspects without departing from the scope of the invention. Therefore, the invention is not intended to be limited to the aspects shown herein, but rather to be carried out within the widest scope consistent with the principles and novel features of the invention herein.

[0146] The above description is merely a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications or equivalent substitutions made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

Claims

1. A control method for a multiplayer interactive game, applicable to multiple users experiencing interactive games through gaming devices in a living room setting, characterized in that, The gaming device includes: A game console and a console mounting device, wherein the game console is fixed to the console mounting device; The handle includes: a control handle; N infrared sensors disposed on the control handle, wherein N is an integer greater than 1; and a first inertial sensor mounted on the control handle; A second inertial sensor is installed on the game console; and A camera device installed on the game console; The control method includes: Construct a living room scene model corresponding to the physical living room scene where the user is located, and send the living room scene model to the game console of the game device used by the user and the game console of the relevant game device used by the user; The interactive avatar corresponding to the user will be projected onto the living room scene model; The 6DOF data of the game console is determined based on the spatial image of the game console captured by the camera device and the IMU data of the game console detected by the second inertial sensor. The 6DOF data of the control handle is determined based on the light spot image of the infrared sensor on the control handle captured by the camera device and the IMU data of the control handle detected by the first inertial sensor. The spatial positioning information of the control controller is determined based on the 6DOF data of the control controller and the 6DOF data of the game console. The motion information of the user's interactive avatar is determined based on the spatial positioning information of the control handle; and Send the spatial positioning information of the control handle to the relevant user's game console; The handle further includes: a handle controller disposed within the control handle; and an instruction input device disposed on the control handle, the instruction input device being communicatively connected to the handle controller, through which the user inputs a virtual accessory of the user's interactive avatar; wherein, the handle controller is used to control the illumination of M infrared sensors corresponding to the virtual accessory according to the input instruction information input by the user; the illumination of M infrared sensors corresponds to one type of virtual accessory, where M is an integer greater than 1, and N is greater than or equal to M; The motion information of the user's interactive avatar is determined based on the spatial positioning information of the control handle, including: Obtain the data correspondence information table, which includes a one-to-one correspondence between the illuminated infrared sensors and virtual accessories; Acquire the light spot image of the infrared sensor on the control handle captured by the camera device; The information of the illuminated infrared sensor is determined based on the spot image of the infrared sensor; The virtual accessory is determined based on the information from the illuminated infrared sensor and the corresponding data information table; and The motion information of the user's virtual accessory is determined based on the spatial positioning information of the control handle.

2. The control method for a multiplayer interactive game according to claim 1, characterized in that, After determining the virtual accessory based on the information from the illuminated infrared sensor and the data correspondence information table, the step of determining the motion information of the user's interactive avatar based on the spatial positioning information of the control handle further includes: Receive the virtual accessory input sent by the controller; When the virtual accessory determined based on the information from the illuminated infrared sensor and the data correspondence information table matches the input virtual accessory, the virtual accessory determined based on the information from the illuminated infrared sensor and the data correspondence information table is determined to be the user's virtual accessory.

3. The control method for a multiplayer interactive game according to claim 2, characterized in that, The step of determining the motion information of the user's interactive avatar based on the spatial positioning information of the control handle further includes: When the virtual accessory determined based on the information from the illuminated infrared sensor and the corresponding data information table is inconsistent with the input virtual accessory, the input virtual accessory is determined to be the user's virtual accessory.

4. The control method for a multiplayer interactive game according to claim 1, characterized in that, The gaming device includes a virtual reality device; The gaming device further includes: a head-mounted device; and a third inertial sensor disposed on the head-mounted device, the third inertial sensor being used to detect IMU data of the head-mounted device; The control method further includes: Acquire the IMU data of the head-mounted device detected by the third inertial sensor; Acquire spatial images of the head-mounted device captured by the camera device; The spatial positioning information of the head-mounted device is determined based on the IMU data of the head-mounted device and the spatial image of the head-mounted device; and The spatial positioning information of the head-mounted device is sent to the relevant user's game console; The determination of the motion information of the user's interactive avatar based on the spatial positioning information of the control handle includes: The motion information of the interactive avatar is determined based on the spatial positioning information of the control handle and the spatial positioning information of the head-mounted device.

5. The control method for a multiplayer interactive game according to claim 1, characterized in that, After determining the motion information of the user's interactive avatar based on the spatial positioning information of the control handle, the control method further includes: Receive spatial positioning information of the control handle sent by the relevant user, and determine the motion information of the interactive avatar of the relevant user based on the spatial positioning information of the control handle; and The display screen is updated based on the motion information of the user's interactive avatar and the motion information of the related user's interactive avatar.

6. The control method for a multiplayer interactive game according to claim 1, characterized in that, Constructing a living room scene model corresponding to the physical environment where the user is located includes: Acquire spatial images of the game console as captured by the camera device on the game console; Based on the spatial image of the game console, determine the physical environment information of the user's physical environment; and The entity environment information of the user's actual environment is rendered to generate a living room scene model corresponding to the user's actual environment.

7. A multi-user interactive system, suitable for multiple users to experience interactive games through gaming devices in a real living room setting, characterized in that, The multiplayer interactive system includes: multiple gaming devices and a multiplayer interactive game controller, wherein the multiplayer interactive game controller is communicatively connected to the multiple gaming devices respectively; The gaming device includes: A game console and a console mounting device, wherein the game console is fixed to the console mounting device; The handle includes: a control handle; N infrared sensors disposed on the control handle, wherein N is an integer greater than 1; and a first inertial sensor mounted on the control handle; A second inertial sensor is installed on the game console; A camera device installed on the game console; The multiplayer interactive game controller includes: The model building unit is used to build a living room scene model corresponding to the physical living room scene where the user is located, and send the living room scene model to the game console of the game device used by the user and the game console of the relevant game device used by the user. The first spatial positioning unit is used to determine the 6DOF data of the game console based on the spatial image of the game console captured by the camera device and the IMU data of the game console detected by the second inertial sensor; to determine the 6DOF data of the control handle based on the light spot image of the infrared sensor on the control handle captured by the camera device and the IMU data of the control handle detected by the first inertial sensor; and to determine the spatial positioning information of the control handle based on the 6DOF data of the control handle and the 6DOF data of the game console. An interactive avatar control unit is used to project the user's corresponding interactive avatar onto the living room scene model; determine the motion information of the user's interactive avatar based on the spatial positioning information of the control handle; and A data transmission unit is used to send the spatial positioning information of the control handle to the game console of the relevant user. The handle further includes: a handle controller disposed within the control handle; and an instruction input device disposed on the control handle, the instruction input device being communicatively connected to the handle controller, through which the user inputs a virtual accessory of the user's interactive avatar; wherein, the handle controller is used to control the illumination of M infrared sensors corresponding to the virtual accessory according to the input instruction information input by the user; the illumination of M infrared sensors corresponds to one type of virtual accessory, where M is an integer greater than 1, and N is greater than or equal to M; The interactive avatar control unit includes: The interactive avatar projection module is used to project the interactive avatar corresponding to the user onto the living room scene model; The data acquisition module, which is communicatively connected to the camera device and the controller, and the virtual accessory determination module, acquires a data correspondence information table sent by the controller. This data correspondence information table includes a one-to-one correspondence between illuminated infrared sensors and virtual accessories. It also acquires a light spot image of the infrared sensor on the controller taken by the camera device; determines the information of the illuminated infrared sensor based on the light spot image; and determines the virtual accessory based on the information of the illuminated infrared sensor and the data correspondence information table. The control module is communicatively connected to the virtual accessory determination module. The control module is used to determine the motion information of the user's virtual accessory based on the spatial positioning information of the control handle.

8. The multi-user interactive system according to claim 7, characterized in that, The interactive avatar control unit also includes: The judgment module is communicatively connected to both the virtual accessory determination module and the control module. The judgment module is used to acquire the input virtual accessory sent by the controller; and when the virtual accessory determined based on the information from the illuminated infrared sensor and the data correspondence information table matches the input virtual accessory, the virtual accessory determined based on the information from the illuminated infrared sensor and the data correspondence information table is determined to be the user's virtual accessory; and when the virtual accessory determined based on the information from the illuminated infrared sensor and the data correspondence information table does not match the input virtual accessory, the input virtual accessory is determined to be the user's virtual accessory.

9. The multi-user interactive system according to claim 7, characterized in that, The gaming device includes a virtual reality device, an augmented reality device, or a mixed reality device; the gaming device further includes: a head-mounted device; and a third inertial sensor disposed on the head-mounted device, the third inertial sensor being used to detect IMU data of the head-mounted device; The multiplayer interactive game controller further includes: The second spatial positioning unit is used to acquire the IMU data of the head-mounted device detected by the third inertial sensor; acquire the spatial image of the head-mounted device captured by the camera device; determine the spatial positioning information of the head-mounted device based on the IMU data of the head-mounted device and the spatial image of the head-mounted device; and send the spatial positioning information of the head-mounted device to the game console of the relevant user. The interactive avatar control unit is also used to determine the motion information of the interactive avatar based on the spatial positioning information of the control handle and the spatial positioning information of the head-mounted device.

10. The multi-user interactive system according to claim 7, characterized in that, The handle controller includes: An input instruction acquisition module is used to acquire input instruction information entered by the user in the instruction input device; A judgment module, communicatively connected to the input instruction acquisition module, is used to determine M infrared sensors corresponding to the input instruction information input by the user; and A control module, which is communicatively connected to the judgment module, is used to illuminate M infrared sensors corresponding to the input command information.

11. The multi-user interactive system according to claim 7, characterized in that, The multiple game consoles of the multiple gaming devices mentioned above are the same game console.

Images