Game system, wireless capture device, and game control method

Abstract

To provide a game system that can increase a degree of freedom in a position of a user who plays a game and eliminates the need for mounting a battery in a controller regarding the game system.SOLUTION: A game system includes: a first radio device having two or more antennas; a second radio device performing radio communication with the first radio device; a radio capturing device that captures a radio signal among the radio devices and detects a user's operation within a radio communication area or movement of a controller; and a game machine. The radio capturing device captures a radio frame including information on a radio propagation path, extracts information on the radio propagation path, and performs a process determining game operation that a user performs within the radio communication area, or the operation of the controller. Determined operation contents are transmitted to a game machine as label data. The game machine controls a game on the basis of the label data transmitted from the radio capturing device.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a technology for controlling a game machine by detecting the actions of a user or the movement of a controller within a communication area from propagation path information of a wireless signal communicated between wireless devices. [Background technology]

[0002] Known methods for controlling a game console include a method using a controller connected to the game console by wire, a method using a controller connected to the game console wirelessly, etc. Furthermore, Non-Patent Document 1 discloses a method for controlling the game console by connecting a camera to the game console and having the user make gestures in front of the camera. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Kinect Mechanism and Natural User Interface, Journal of the Institute of Image Information and Television Engineers, Vol. 66, No. 9, pp. 755-759 (2012). Summary of the Invention [Problem to be solved by the invention]

[0004] However, the method of using a controller connected to the game console via a wired connection and the method of the user making gestures in front of the camera require the user to be within a certain range of the game console, which limits the degree of freedom in positioning.

[0005] Furthermore, although the method of using a controller wirelessly connected to a game console allows the user greater freedom in positioning, it has the problem of requiring a battery for the controller.

[0006] The present disclosure has been made to solve the above-mentioned problems, and its primary objective is to provide a game system that allows users to have greater freedom in their position while playing the game and does not require the controller to be equipped with a battery.

[0007] Furthermore, a second object of the present disclosure is to provide a wireless capture device that allows a user playing a game with a high degree of freedom in terms of position and does not require a battery to be installed in the controller.

[0008] Furthermore, a third object of the present disclosure is to provide a game control method that allows a user playing a game greater freedom in terms of their position and eliminates the need to install a battery in the controller. [Means for solving the problem]

[0009] A first aspect of the present disclosure is a game system that detects a user's action or a controller's movement using wireless communication, comprising: a first wireless device having two or more antennas; a second wireless device that wirelessly communicates with the first wireless device; a wireless capture device that captures the wireless communication signal and detects the user's actions or the movement of the controller within the area of ​​the wireless communication; a game machine that controls a game based on label data indicating game operations transmitted from the wireless capture device; Equipped with the first wireless device is configured to perform a process of transmitting a wireless signal including a known wireless frame from the antenna; The second wireless device a process of calculating information of a wireless propagation path between the first wireless device and the second wireless device from the known wireless frame; a process of returning a wireless frame including information on the wireless propagation path to the first wireless device; configured to run The wireless capture device capturing a wireless frame including information about the wireless propagation path; A process of extracting information about the wireless propagation path; an operation determination process for determining a game operation or a controller operation performed by a user within the wireless communication area based on the information on the wireless propagation path; a process of transmitting the game operation or the controller operation performed by the user to the game machine as label data; configured to run The game machine is preferably configured to execute a process for controlling a game based on the label data transmitted from the wireless capture device.

[0010] In addition, the second aspect is transmitted from the second wireless device to the first wireless device A process of capturing a wireless frame including information on a wireless propagation path; A process of extracting information about the wireless propagation path; From the information on the wireless propagation path, Within the area of ​​wireless communication between the first wireless device and the second wireless device A process for determining a game operation or a controller operation performed by a user; a process of transmitting the game operation or the controller operation performed by the user to the game machine as label data; Preferably, the wireless capture device is configured to perform the following:

[0011] A third aspect is a game control method that detects a user's action or a controller movement using wireless communication, comprising: the first wireless device has two or more antennas and performs a process of transmitting a wireless signal including a known wireless frame from the antennas; The second wireless device a process of calculating information on a wireless propagation path between the first wireless device and the second wireless device from the known wireless frame transmitted from the first wireless device; a process of returning a wireless frame including information on the wireless propagation path to the first wireless device; Run The wireless capture device capturing a wireless frame including information about the wireless propagation path; A process of extracting information about the wireless propagation path; determining, from the information on the wireless propagation path, a game operation or a controller operation performed by a user within a wireless communication area between the first wireless device and the second wireless device; a process of transmitting the game operation or the controller operation performed by the user to the game machine as label data; Run It is desirable that the game machine executes a process for controlling the game based on the label data transmitted from the wireless capture device. [Effects of the Invention]

[0012] According to the first to third aspects of the present disclosure, it is possible to provide a game system, a wireless capture device, and a game control method that can increase the degree of freedom of the position of the user playing the game and eliminate the need to install a battery in the controller. [Brief explanation of the drawings]

[0013] [Figure 1] 1 illustrates an example configuration of a game system according to a first embodiment of the present disclosure. [Figure 2] 1 illustrates an example configuration of a wireless sensing device and a game machine according to a first embodiment of the present disclosure. [Figure 3] 10 is a diagram illustrating an example of a sequence of wireless communication between an AP and a STA according to the first embodiment of the present disclosure. [Figure 4] 1 is a flowchart for creating training data used in machine learning by a wireless sensing device according to the first embodiment of the present disclosure. [Figure 5] 10 is a flowchart showing how the game machine controls a game based on the user's actions or the movement of the controller according to the first embodiment of the present disclosure. [Figure 6] 10 is a configuration example of a game system according to a second embodiment of the present disclosure. [Figure 7] 10 illustrates an example configuration of a game system according to a third embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0014] Embodiment 1 FIG. 1 is a configuration example of a game system according to the first embodiment of the present disclosure.

[0015] A wireless LAN AP (hereinafter referred to as AP) 101 performs wireless LAN communication based on the wireless LAN standard IEEE802.11ac / ax. The AP 101 is equipped with two or more antennas 105(1), 105(2), ... 105(n). The AP 101 simultaneously uses these antennas to perform MIMO (Multi-Input Multi-Output) communication with a wireless LAN station (hereinafter referred to as STA) 102.

[0016] The AP 101 transmits a wireless signal including a known frame to the STA 102. The AP 101 also receives a wireless signal returned from the STA 102 via the antenna 105.

[0017] The STA 102 receives a wireless signal from the AP 101. Based on the received wireless signal, the STA 102 calculates the difference from a known frame and derives compressed channel state information. The compressed channel state information (CSI) refers to information about the wireless propagation path. Furthermore, the STA 102 stores the compressed CSI information in a Compressed Beamforming Report (CBFR) frame and feeds it back to the antenna 105 of the AP 101.

[0018] The wireless sensing device 103 captures wireless packets fed back from the STA 102 to the AP 101. The wireless sensing device 103 then extracts compressed CSI from the captured packets based on the IEEE 802.11ac / ax standard. The wireless sensing device 103 then analyzes the game operation content based on the compressed CSI and outputs label data indicating the operation content to the game console 104.

[0019] The game machine 104 controls the game based on the label data output from the wireless sensing device 103.

[0020] In the example of FIG. 1, the wireless sensing device 103 is placed in a position between the AP 101 and the STA 102, but it may be placed anywhere as long as it can capture wireless packets transmitted from the STA 102.

[0021] In the example of FIG. 1, the game machine 104 may be equipped with a display or the like.

[0022] Within the range where the AP 101 and the STA 102 communicate wirelessly, the user 106 operates the game using gestures, changes in position, changes in posture, and other actions, or by pressing buttons on the controller 107 of the game console 104. However, when the user 106 operates the game using gestures or the like, the controller 107 does not have to be used.

[0023] Within the wireless communication area between the AP 101 and the STA 102, actions and the like performed by the user 106 are measured using compressed CSI transmitted and received between the AP 101 and the STA 102. The wireless sensing device 103 captures wireless packets containing this compressed CSI information, thereby detecting the actions and the like of the user 106.

[0024] FIG. 2 illustrates an example configuration of a wireless sensing device and a game machine according to the first embodiment of the present disclosure.

[0025] The wireless interface unit 110 transmits and receives wireless frames in accordance with the IEEE802.11ac / ax (Wi-Fi5 / Wi-Fi6) standard specifications. The capture unit 111 acquires frames received by the wireless interface unit 110 and outputs them to the filtering unit 112.

[0026] The filtering unit 112 outputs only those wireless frames that meet predetermined conditions among the wireless frames acquired by the capture unit 111 to the extraction unit 113. Note that the predetermined conditions are, for example, that the source wireless terminal station is the target STA 102 and that the destination wireless terminal station is the target AP 101. The predetermined conditions also include the type of wireless frame being a frame that includes the target CSI, i.e., a CBFR frame, and the like.

[0027] Extraction section 113 extracts compressed CSI from the CBFR frame output from filtering section 112. Preprocessing section 114 calculates the compressed CSI and detects its variation over time. If a variation over time is detected in the compressed CSI, preprocessing section 114 outputs the compressed CSI data to allocation section 115.

[0028] The allocating unit 115 outputs the compressed CSI data to the teacher data creating unit 117 or the determining unit 118 in the machine learning unit 116, depending on the phase of the machine learning. The phase of the machine learning is determined by whether or not label data has been input to the allocating unit 115 from the game console 104. If label data has been input, the allocating unit 115 allocates the compressed CSI information to the teacher data creating unit 117. On the other hand, if label data has not been input, the allocating unit 115 allocates the compressed CSI information to the determining unit 118.

[0029] The machine learning unit 116 performs machine learning using training data. When the machine learning unit 116 is in the learning phase, the training data creation unit 117 creates training data to be used in the machine learning. Specifically, the training data is created by associating the compressed CSI data output from the sorting unit 115 with the label data output from the game console 104.

[0030] On the other hand, when the machine learning unit 116 is in the judgment phase, the teacher data creation unit 117 provides the judgment unit 118 with teacher data to be used in machine learning.

[0031] When the machine learning unit 116 is in the judgment phase, the judgment unit 118 performs machine learning judgment on the compressed CSI data output from the allocation unit 115. Specifically, the judgment unit 118 uses the compressed CSI training data provided by the training data creation unit 117 to judge the game operation or operation of the controller 107 performed by the user 106. Furthermore, the judgment unit 118 transmits label data indicating the determined operation content to the game machine 104.

[0032] The sensor result input unit 119 in the game console 104 is an interface that receives label data output from the determination unit 118 of the wireless sensing device 103. Label data corresponding to, for example, the position, gesture, and posture of the user 106, the state of buttons pressed on the controller 107, and the state of the fingers of the user 106 are input to the sensor result input unit 119.

[0033] The controller communication unit 120 converts the label data output from the sensor result input unit 119 into a movement of the controller 107 of the game console 104 and outputs it to the game control unit 121. The movement of the controller 107 is, for example, a movement such as pressing a specific button. The game control unit 121 is a block within the game console 104 that controls the input signal of the controller 107. The game main unit 122 is a normal game console. The label creation unit 123 outputs, as label data, to the wireless sensing device 103, an action that the user 106 is to perform in order for the teacher data creation unit 117 to create teacher data.

[0034] With the above configuration, the wireless sensing device 103 can extract compressed CSI information from captured wireless packets and detect changes over time in the actions of the user 106. Furthermore, machine learning can be used to determine the game operations or operations of the controller 107 performed by the user 106. Furthermore, the operation details determined by the wireless sensing device 103 can be transmitted to the game console 104 as label data, allowing the game console 104 to control the game.

[0035] 3 illustrates an example sequence of wireless communication between an AP and a STA according to the first embodiment of the present disclosure. AP 101 transmits known NDP (Null Data Packet) frames 130(1), 130(2), . . . 130(n) from antennas 105(1), 105(2), . . . 105(n), respectively.

[0036] Here, it is assumed that the NDP frame 130 is transmitted periodically, but the data volume of the NDP frame 130 is not large, so there is little possibility that it will interfere with the original communication between the AP 101 and the STA 102. Furthermore, for example, Wi-Fi supports multiple frequencies, so by transmitting the NDP frame 130 using a frequency band or frequency channel different from the original communication, it is possible to avoid affecting the original communication. Wi-Fi supports three frequencies: the 2.4 GHz band, the 5 GHz band, and the 6 GHz band, which is expected to be used in the future. Furthermore, a maximum of three channels are available in the 2.4 GHz band, a maximum of 20 channels in the 5 GHz band, and a maximum of 25 channels in the 6 GHz band.

[0037] When the STA 102 receives the NDP frames 130(1), 130(2), ..., 130(n) from all the antennas 105, it calculates compressed CSI from the NDP frames 130 according to the method specified in IEEE 802.11ac / ax.

[0038] The STA 102 stores the calculated compressed CSI information in a CBFR frame 131 and feeds it back to the AP 101.

[0039] Based on the compressed CSI information fed back from the STA 102, the AP 101 acquires information about the wireless propagation paths between each of the antennas 105(1), 105(2), ..., 105(n) and the STA 102. The AP 101 controls the antenna 105 based on this information, adjusting the amplitude and phase of the wireless signal transmitted by the antenna 105, thereby further improving the efficiency of wireless communication.

[0040] In this way, by using the wireless communication sequence between AP101 and STA102 based on the IEEE802.11ac / ax standard, it is possible to efficiently transmit the wireless signals required to measure the actions of a user or a controller within the communication area.

[0041] 2 and 3, actions and the like performed by the user 106 are measured using compressed CSI in the wireless communication area covered by the AP 101 and the STA 102. The wireless sensing device 103 captures the CBFR frame 131 in the wireless communication area and extracts the compressed CSI, thereby enabling analysis of game operations and the like performed by the user 106.

[0042] FIG. 4 is a flowchart illustrating a process for generating training data used in machine learning by a wireless sensing device according to the first embodiment of the present disclosure.

[0043] First, the user 106 starts the in-game tutorial (step 140). The tutorial is a mode or the like that is run in the game to help the user 106 learn how to operate the game before the main game begins.

[0044] Next, the game machine 104 outputs information about the action that the game machine 104 wants the user 106 to perform as label data to the wireless sensing device 103 (step 141). The game machine 104 then instructs the user 106 to perform the action (step 142). The user 106 performs the action in accordance with the instruction in step 142 (step 143).

[0045] Furthermore, the behavior of the user 106 is measured using the compressed CSI included in the wireless signal between the AP 101 and the STA 102 (step 144). Furthermore, the wireless sensing device 103 captures a packet including a CBFR frame 131 in which the compressed CSI is stored (step 145).

[0046] The wireless sensing device 103 extracts the compressed CSI data (step 146). In addition, it determines whether label data has been input from the game console 104 (step 147). If label data has been input, training data is created using the extracted CSI information and label data (step 148). Finally, the user 106 finishes the in-game tutorial (step 149).

[0047] In this way, by having the user 106 perform predetermined actions as a tutorial, training data can be created that matches compressed CSI information corresponding to those actions with label data indicating the game operations.

[0048] FIG. 5 is a flowchart showing a process in which a game machine controls a game based on a user's action or a controller movement according to the first embodiment of the present disclosure.

[0049] First, the user 106 starts the main part of the game (step 150), and then the user 106 performs an arbitrary action (step 151).

[0050] Next, the behavior of the user 106 is measured using the compressed CSI included in the wireless signal between the AP 101 and the STA 102 (step 152). Furthermore, the wireless sensing device 103 captures a packet including a CBFR frame 131 in which the compressed CSI is stored (step 153).

[0051] The wireless sensing device 103 extracts the compressed CSI data (step 154). Furthermore, the wireless sensing device 103 determines the game operation performed by the user 106 from the compressed CSI data using machine learning (step 155). Furthermore, the determined game operation is transmitted to the game machine 104 as label data (step 156). The game machine 104 controls the game based on the label data (step 157). As a result, the user 106 can further perform step 151 and progress through the game.

[0052] In this way, any action taken by the user 106 allows the game console 104 to take control of the game.

[0053] As described above, in the game system 100 of this embodiment, gestures and other actions made by the user 106, or button presses on the controller 107, etc., are measured by wireless communication between the AP 101 and the STA 102 and analyzed by the wireless sensing device 103. Therefore, the user 106 can play the game anywhere within the range covered by the wireless communication between the AP 101 and the STA 102.

[0054] Additionally, in the game system 100 according to this embodiment, there is no need to connect the controller 107 to the game console 104 by wire or wirelessly. Therefore, there is no need to install a battery in the controller 107.

[0055] In the present disclosure, the processing performed by the wireless sensing device 103 may be executed by a program using a computer equipped with a CPU and memory and storing a program in the memory. Alternatively, the processing may be executed by a program using an integrated circuit such as an FPGA (Field Programmable Gate Array). The program may be provided by being recorded on a storage medium or via a network. This point is common to all of the following embodiments.

[0056] [Explanation of correspondence with terms used in claims] In this embodiment, the wireless LAN AP 101 is referred to as a first wireless device. Similarly, the wireless LAN terminal 102 is referred to as a second wireless device. Furthermore, the wireless sensing device 103 is referred to as a wireless acquisition device.

[0057] Embodiment 2 6 shows an example of the configuration of a game system according to embodiment 2 of the present disclosure. Game system 200 has the same configuration as the game system according to embodiment 1, but has a plurality of STAs.

[0058] In the example of Fig. 6, multiple STAs 202(1) and 202(2) are installed so that the behavior of multiple users 106(1), 106(2), and 106(3) can be measured via wireless communication. Note that although there are two STAs in the example of Fig. 6, the more the number, the better.

[0059] By arranging multiple STAs 202 in this way, the wireless coverage area can be expanded, which enables simultaneous game operation by multiple users 106 or game operation with more dynamic movements, such as walking and stopping, of the users 106.

[0060] Embodiment 3 7 is a configuration example of a game system according to embodiment 3 of the present disclosure. Game system 300 has a configuration in which obstacle 308 is added to the configuration example of embodiment 2. Obstacle 308 is placed so that multiple users 106(1), 106(2) cannot see each other's actions.

[0061] By placing multiple wireless LAN terminals 202(1) and 202(2) on either side of obstacle 308, it is possible to measure the movements of users 106(1) and 106(2) on either side of obstacle 308. This allows users 106 to operate the game without disclosing each other's movements. [Explanation of symbols]

[0062] 100···Gaming system; 101···Wireless LAN AP; 102... Wireless LAN terminal; 103... Wireless sensing device; 104... Game console; 105... Antenna; 106... User; 107... Controller; 110... Wireless interface unit; 111... Capture unit; 112... Filtering unit; 113... Extraction unit; 114... Preprocessing unit; 115... Allocation unit; 116... Machine learning unit; 117... Training data creation unit; 118... Judgment unit; 119... Sensor result input unit; 120... Controller communication unit; 121... Game control unit; 122... Game console; 123... Label creation unit; 130... NDP frame; 131... CBFR frame; 200... Game system; 202... Wireless LAN terminal; 300... Game system; 308... Obstacle

Claims

1. A game system that detects a user's actions or a controller's movements using wireless communication, a first wireless device having two or more antennas; a second wireless device that wirelessly communicates with the first wireless device; a wireless capture device that captures the wireless communication signal and detects the user's actions or the movement of the controller within the area of ​​the wireless communication; a game machine that controls a game based on label data indicating game operations transmitted from the wireless capture device; Equipped with the first wireless device is configured to perform a process of transmitting a wireless signal including a known wireless frame from the antenna; The second wireless device a process of calculating information of a wireless propagation path between the first wireless device and the second wireless device from the known wireless frame; a process of returning a wireless frame including information on the wireless propagation path to the first wireless device; configured to run The wireless capture device capturing a wireless frame including information about the wireless propagation path; A process of extracting information about the wireless propagation path; an operation determination process for determining a game operation or a controller operation performed by a user within the wireless communication area based on the information on the wireless propagation path; a process of transmitting the game operation or the controller operation performed by the user to the game machine as label data; configured to run The gaming system is configured such that the gaming machine executes a process for controlling a game based on the label data transmitted from the wireless capturing device.

2. The game machine includes: A process of instructing a user to perform an action; a process of transmitting label data indicating the operation instructed by the user to the wireless capture device; configured to run 2. The game system according to claim 1, wherein the wireless capturing device is configured to, when the label data is input from the game machine, execute a process of creating training data that corresponds information about the wireless propagation path with the label data.

3. The game system according to claim 2 , wherein the operation determination process in the wireless capturing device includes a process of making a determination by machine learning using the training data.

4. The game system according to claim 1 , comprising a plurality of the second wireless devices.

5. The game system according to claim 4 , further comprising an obstacle within a wireless communication area covered by the first wireless device and the second wireless device.

6. A process of capturing a wireless frame including information on a wireless propagation path transmitted from a second wireless device to a first wireless device; A process of extracting information about the wireless propagation path; determining, from the information on the wireless propagation path, a game operation or a controller operation performed by a user within an area of ​​wireless communication between the first wireless device and the second wireless device; a process of transmitting the game operation or the controller operation performed by the user to the game machine as label data; 10. A wireless capture device configured to perform the steps of:

7. A game control method for detecting a user's action or a controller's movement using wireless communication, comprising: the first wireless device has two or more antennas and performs a process of transmitting a wireless signal including a known wireless frame from the antennas; The second wireless device a process of calculating information on a wireless propagation path between the first wireless device and the second wireless device from the known wireless frame transmitted from the first wireless device; a process of returning a wireless frame including information on the wireless propagation path to the first wireless device; Run The wireless capture device capturing a wireless frame including information about the wireless propagation path; A process of extracting information about the wireless propagation path; determining, from the information on the wireless propagation path, a game operation or a controller operation performed by a user within a wireless communication area between the first wireless device and the second wireless device; a process of transmitting the game operation or the controller operation performed by the user to the game machine as label data; Run The game machine executes a process for controlling the game based on the label data transmitted from the wireless capture device.

Images