Force plate and information processing system

Abstract

To provide a technology for easily continuing operation that depends on a user's load for making a video program progress.SOLUTION: A force plate (20) functions as a controller for controlling a game machine (10). The force plate (20) is provided with a transmission part for transmitting an alert signal to an HM display (30) for outputting a video from the game machine (10) in the case that a foot pressure center of a user enters to a peripheral edge part of the force plate (20).SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a force plate and an information processing system.

Background Art

[0002] Conventionally, in the fields of rehabilitation medical devices and games, a load detection device having a load sensor has been used. For example, in the field of games, a technique is known in which a user rides on a load detection device and executes a game program using the load value detected by the load detection device as operation data (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003] [[ID=Z2]]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the conventional technology as described above, the user may become engrossed in the game operation and fall from the load detection device. In particular, in a game in which the user wears a head-mounted display and uses virtual reality images, the user is more likely to fall from the load detection device. When the user falls from the load detection device, the operation data of the game is interrupted, and the progress of the game stops. It is difficult for the user to prevent falling from the load detection device, and the fun of the game may be impaired from such an operation aspect.

[0005] One aspect of the present invention aims to provide a technique for facilitating the continuation of an operation by the load of a user who advances a video program.

Means for Solving the Problems

[0006] To solve the above problems, a force plate according to one aspect of the present invention functions as a controller for controlling a video generation device. This force plate includes a transmitting unit. The transmitting unit transmits an alert signal to a display. The alert signal is transmitted to the video generation device or the display (which outputs the video generated by the video generation device). The alert signal is transmitted when the user's center of pressure enters the peripheral edge of the force plate.

[0007] Furthermore, in order to solve the above problems, an information processing system according to one aspect of the present invention comprises a force plate and a display that displays an image corresponding to a signal from the force plate. [Effects of the Invention]

[0008] According to one aspect of the present invention, it is possible to make it easier to continue operations performed by the user's weight to advance the video program. [Brief explanation of the drawing]

[0009] [Figure 1] This figure schematically shows the configuration of an information processing system according to Embodiment 1 of the present invention. [Figure 2] This is a schematic plan view showing a force plate according to Embodiment 1 of the present invention. [Figure 3] This figure schematically shows a cross-section of the force plate cut along line AA in Figure 2. [Figure 4] This is a schematic block diagram showing the functional configuration of an information processing system according to Embodiment 1 of the present invention. [Figure 5] This figure shows an example of an image from a video program displayed to the user. [Figure 6] Figure 5 shows an example of an image where an alert image is displayed. [Modes for carrying out the invention]

[0010] [Summary of the embodiments of this disclosure] First, an overview of embodiments of the present disclosure will be described.

[0011] (Clause 1) A force plate that functions as a controller for controlling a video generation device, and includes a transmission unit that transmits an alert signal to the video generation device or a display that outputs a video generated by the video generation device when the center of the user's foot pressure enters the peripheral portion of the force plate.

[0012] The aspect of Clause 1 can facilitate the continuation of the operation by the user's load that advances the video program because the input signal from the user via the force plate is likely to continue.

[0013] (Clause 2) The force plate according to Clause 1, wherein the display is a head-mounted display.

[0014] The aspect of Clause 2 is more effective from the viewpoint of enhancing the user's sense of presence because the video due to the progress of the video program is displayed as a video in a direction corresponding to the user's orientation among all directions.

[0015] (Clause 3) The force plate according to Clause 1 or 2, wherein the transmission unit transmits a signal instructing to output an alert sound as an alert signal to the video generation device or the display.

[0016] The aspect of Clause 3 is more effective from the viewpoint of promoting the return of the user to a preferable position on the force plate while advancing the video program.

[0017] (Clause 4) The force plate according to Clauses 1 to 3, wherein the transmission unit transmits a signal instructing to display an image covering at least a part of the video as an alert signal to the video generation device or the display.

[0018] The aspect of Clause 4 is more effective from the viewpoint of facilitating the return of the user to a preferred position on the force plate when viewing the video of a running video program.

[0019] (Clause 5) The force plate according to any one of Clauses 1 to 4, having a step on the peripheral portion.

[0020] The aspect of Clause 5 is more effective from the viewpoint of facilitating the return of the user to a preferred position on the force plate when the user recognizes the step during the progress of the video program.

[0021] (Clause 6) An information processing system including any one of the force plates of Clauses 1 to 5 and a display for displaying an image according to a signal from the force plate.

[0022] The aspect of Clause 6 can facilitate the continuation of the operation by the load of the user who advances the video program because the input signal from the user via the force plate is likely to continue.

[0023] Also, according to the aspects of Clauses 1 to 6, the sense of presence of the experience obtained by the user moving his or her own body is enhanced, and such an experience is suppressed from being interrupted by the user's actions. Therefore, the above aspects are expected to contribute to the amplification of health in people's physical and mental aspects and, for example, to contribute to the achievement of Goal 3 of the Sustainable Development Goals (SDGs) advocated by the United Nations.

[0024] 〔Exemplification of Embodiments of the Present Disclosure〕 Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In the description of the drawings, the same reference numerals are assigned to the same elements, and duplicate descriptions are omitted.

[0025] In each of the following embodiments, a form applied to a game using virtual reality images will be described as an example.

[0026] [Embodiment] One embodiment of the present invention will be described in detail below. Hereinafter, an example of the information processing system of the present invention will be described in which it is applied to a game utilizing virtual reality images.

[0027] [Specific structure] Figure 1 is a schematic diagram showing the configuration of an information processing system according to Embodiment 1 of the present invention. As shown in Figure 1, the information processing system 1 comprises a game console 10, a force plate 20, a head-mounted display 30, and a controller 40. These are configured to communicate wirelessly. Wireless communication can be performed according to known standards such as Bluetooth®, infrared communication, or wireless LAN.

[0028] <Game console> The game console 10 is a device that advances a game program in response to signals from the force plate 20, head-mounted display 30, and controller 40, and outputs the generated video and audio signals to the head-mounted display 30. The game console 10 can be configured as a known game console that uses virtual reality images, and can be implemented, for example, by a personal computer (PC) or a PLC (programmable logic controller). The game console 10 corresponds to a video generation device.

[0029] <Force Plate> Figure 2 is a schematic plan view showing a force plate according to Embodiment 1 of the present invention, and Figure 3 is a schematic diagram showing a cross-section of the force plate cut along line AA in Figure 2.

[0030] As shown in Figures 2 and 3, the force plate 20 has a plate body 21 and a protruding portion 22 arranged around it. The plate body 21 is configured to detect the user's load by force sensors. For example, the plate body 21 has a rectangular planar top plate, and this top plate is supported by force sensors arranged in a square. The force sensors are 6-axis force sensors that detect the force FX in the X-axis direction, the force FY in the Y-axis direction, the force FZ in the Z-axis direction, the moment MX around the X-axis, the moment MY around the Y-axis, and the moment MZ around the Z-axis acting on the top plate. With this configuration, the plate body 21 can detect the user's center of pressure (COP), ground reaction force, and free moment.

[0031] The protruding portion 22 is provided around the edge of the plate body 21, forming a step that protrudes from the plate body 21 in the vertical direction (Z direction). The protruding portion 22 is, for example, an elastic member made of polyurethane. Thus, the force plate 20 has a step at its peripheral edge.

[0032] Furthermore, the plate body 21 has a warning area 211 that extends around its entire edge. The warning area 211 will be described later. The force plate 20 also has a transmitting unit. This transmitting unit will also be described later.

[0033] <Head-mounted display> The head-mounted display 30 is a display device worn on the user's head and is a type of display in the information processing system 1. The head-mounted display 30 is configured to display an image in response to a signal from the transmitter of the game console 10 or the force plate 20. The head-mounted display 30 is equipped with a sensor that detects the head movements of the user wearing it. This sensor is, for example, a gyroscope or an accelerometer, and in this embodiment, an accelerometer is used. Furthermore, the head-mounted display 30 has a built-in speaker that provides sound to the user wearing it.

[0034] <Controller> The controller 40 is a device that the user can hold and operate. The controller 40 has a configuration for the user to play the game. For example, the controller 40 has operation keys such as buttons for inputting signals. Also, for example, the controller 40 is equipped with a sensor such as a gyroscope or an accelerometer for detecting the user's hand movements. In this embodiment, an accelerometer is used.

[0035] [Functional configuration] Next, the functional configuration of the information processing system will be described. Figure 4 is a schematic block diagram showing the functional configuration of the information processing system according to Embodiment 1 of the present invention. In Figure 4, "HM display" refers to a head-mounted display. As shown in Figure 4, in the information processing system 1, the game machine 10, force plate 20, head-mounted display 30, and controller 40 are configured to communicate with each other.

[0036] The game console 10, although not shown in the diagram, consists of a processor such as a CPU (Central Processing Unit) or GPU (Graphics Processing Unit), memory such as ROM (Read Only Memory) or RAM (Random Access Memory), and interfaces for communicating with various devices.

[0037] The force plate 20 includes a first processor 201, a force sensor 202, and a communication IF 203. These are interconnected via a bus. Similarly, the head-mounted display 30 includes a second processor 301, an accelerometer 302, and a communication IF 303, which are interconnected via a bus. The controller 40 also includes a third processor 401, an accelerometer 402, and a communication IF 403, which are interconnected via a bus.

[0038] The first processor 201, the second processor 301, and the third processor 401 are, respectively, a CPU or a GPU. The communication interfaces 203, 303, and 403 are interfaces for communicating with the game console 10, and could be, for example, various known networks.

[0039] [Example of game program progression] Next, we will explain an example of how a game program progresses using Information Processing System 1.

[0040] First, the user stands on the force plate 20, puts on the head-mounted display 30, and is equipped with the controller 40.

[0041] <Example of normal game program progression> The force sensor 202 on the force plate 20 detects the user's center of pressure, ground reaction force, and free moment. Based on the values ​​detected by the force sensor 202, the first processor 201 acquires information such as the user's posture (standing or crouching), orientation (the orientation of the user's body in the XY plane), and movement (stillness, walking, jumping) on ​​the force plate 20. Information on the user's posture includes, for example, whether the user is standing or crouching. Information on the user's orientation includes, for example, the orientation of the user's body in the XY plane. Information on the user's movement includes stillness, walking (including forward and backward movement), and jumping. The first processor 201 outputs the acquired information about the user to the game machine 10 via the communication IF 203.

[0042] The accelerometer 302 of the head-mounted display 30 detects the position and orientation of the user's head relative to a reference position. The reference position, in this context, is, for example, the position of the user's head when the user is standing still and facing forward on the force plate 20. The second processor 301 acquires information, for example, the orientation of the user's face (the direction the user is looking), based on the values ​​detected from the accelerometer 302. The second processor 301 outputs the acquired information regarding the orientation of the user's face to the game console 10 via the communication IF 303.

[0043] The accelerometer 402 of the controller 40 detects the position of the user's hand and the direction of hand movement relative to a reference position. The reference position here refers to, for example, the position of the user's hand (the position of the controller 40 equipped on the user's hand) when the user is standing still facing forward on the force plate 20. The third processor 401 acquires information, for example, about the position and movement of the user's hand based on the values ​​detected from the accelerometer 402. The third processor 401 outputs the acquired information about the position and movement of the user's hand to the game machine 10 via the communication IF 403.

[0044] The game console 10 generates video information to be displayed on the head-mounted display 30 based on information obtained from the force plate 20, head-mounted display 30, and controller 40, as well as the game program, and outputs it to the head-mounted display 30. The game console 10 also outputs audio information to be output from the speakers to the head-mounted display 30, according to the game program. The head-mounted display 30 displays video on the screen and generates audio from the speakers based on the video and audio information from the game console 10.

[0045] <Example of alert signal generation> The first processor 201 determines whether the detected position of the user's center of pressure is within the alert area 211 on the force plate 20. If the detected position of the user's center of pressure is within the alert area 211, the first processor 201 generates an alert signal. The alert signal is a signal to inform the user that the user is located on the force plate 20 up to the alert area 211, i.e., near the edge. The first processor 201 transmits the generated alert signal to the head-mounted display 30 via the communication IF 203. Thus, the force plate 20 includes a transmitting unit that transmits an alert signal to the head-mounted display 30, which outputs images generated by the game machine 10, when the user's center of pressure enters the peripheral edge of the force plate. In this embodiment, the first processor 201 corresponds to this transmitting unit.

[0046] When the head-mounted display 30 receives an alert signal from the force plate 20, it overwrites the video from the game console 10 with an image corresponding to the alert signal and displays it.

[0047] Here, we will explain with a specific image example. Figure 5 is a diagram showing an example of an image from a video program displayed to the user. Image 310 shown in Figure 5 is a scene from a game in progress, based on information from the game console 10. Figure 6 is a diagram showing an example of an image in which an alert image is displayed on the image in Figure 5. In response to the alert signal, the head-mounted display 30 displays an image 320 that is like a wall covering the top of image 310. In this way, the first processor 201 of the force plate 20 sends a signal to the head-mounted display 30 instructing it to display image 320 that covers at least a part of image 310 as an alert signal.

[0048] When the display of image 320 causes the user to move inward (towards the center) of the force plate 20 beyond the attention area 211, the first processor 201 stops generating an alert signal. As a result, the display of image 320 also stops, and only image 310 is displayed to the user. In this way, the user can continue playing the game, although the display of image 320 partially restricts their game progress.

[0049] Even if image 320 is displayed, if the user moves further outward on the force plate 20, the user's feet will touch the raised ridges 22 on the periphery of the force plate 20. This allows the user to recognize that they are in a position where they are about to fall off the force plate 20. In this way, the raised ridges 22 prompt the user to return to the center of the force plate 20. As a result, the user moves inward (closer to the center) than the attention area 211 on the force plate 20. In this way, the user can continue to progress through the game.

[0050] [Main effects and benefits] The information processing system 1 can detect the user's body orientation and balance using the force plate 20. Therefore, even with the user's stepping motion, it is possible to distinguish between forward and backward movement in the forward and backward direction based on the user's weight distribution. As a result, it is possible to display an image to the user that more closely matches their sense of movement.

[0051] Furthermore, in the information processing system 1, the user's orientation can be detected not only by the force plate 20 but also by the head-mounted display 30. For example, when a user turns their head to the side with their body slightly turned to the side, the latter results in a wider field of view than when the user turns their head to the side with only their head turned. Therefore, compared to determining the image of the user's field of view using only the head-mounted display 30, it is possible to determine the image of the user's field of view that better matches the user's actions.

[0052] [Other Embodiments] In the aforementioned information processing system 1, some or all of the above-described components of the information processing system 1 may be connected by wires to enable wired communication. Furthermore, the information processing system 1 does not need to have a controller 40. In this case, signals from the controller 40 regarding the progress of the game can be replaced with specific signals (such as the position and number of detections of the load) regarding the user's load detected by the force plate 20.

[0053] In an embodiment of the present invention, the transmission unit (first processor) in the force plate 20 may transmit an alert signal to the game machine 10 when the user's foot pressure center enters the alert area 211. This embodiment is advantageous in terms of simplifying the configuration and control related to communication. In this embodiment, the game machine 10 may output the game video and the image from the alert signal independently to the head-mounted display 30. Alternatively, the game machine 10 may generate information of a composite image by combining the game video with the image from the alert signal and output this to the head-mounted display 30.

[0054] The display on the game console 10 may be a regular display device, such as an LCD panel or an OLED panel, that allows people other than the user to see the image, in addition to the head-mounted display 30. Similarly, the speaker may be an external speaker attached to the game console 10 or a regular display device, in addition to the speaker built into the head-mounted display 30, that allows people other than the user to hear the sound.

[0055] The transmission unit (first processor) in the force plate 20 may transmit a signal to the game console 10 or head-mounted display 30 as an alert signal, instructing it to output an alert sound.

[0056] The images or sounds from the alert signals may be generated to restrict the user's movement in a specific direction. For example, image 320 may be an image that covers only the portion of the game image 310 in the specific direction from which the user has entered the attention area 211. For example, if the user moves to the right and enters the attention area 211, the image 320 may be an image such as a wall covering the right-hand portion of image 310. Also, the portion of image 320 that covers image 310 may expand as the user approaches the edge of the force plate 20. For example, the image 320 may be an image in which the wall displayed in the direction of the user's movement becomes higher or appears to be closing in as the user approaches the edge.

[0057] The force plate 20 does not have to have the protruding portion 22. Alternatively, the protruding portion 22 may have a configuration that further attracts the user's attention. For example, the protruding portion 22 may have a structure that generates sound when the user touches it. Alternatively, the protruding portion 22 can be replaced with other configurations that can attract the user's attention. Such configurations may be, for example, recessed portions that are located on the edge of the plate body 21 and are recessed from the top surface of the plate body 21, or a group of protrusions formed on the edge of the top surface of the plate body 21 (e.g., attention-grabbing region 211).

[0058] The force plate 20 only needs to be configured to detect the user's center of pressure using force sensors. There is no limit to the number of force sensors installed on the force plate 20. Also, there may be two or more plate bodies 21 per force plate 20. For example, one force plate 20 may be composed of two plate bodies 21 arranged in the Y direction. Configuring the force plate 20 with multiple independent plate bodies in this way makes it possible to determine the difference in detected values ​​and the change in detected amounts over time from each of the independent plate bodies. Therefore, it is more advantageous from the viewpoint of more precisely estimating the user's posture and movement.

[0059] The information processing system of the embodiment of the present invention can be applied not only to games but also to other applications that detect the user's body movements and generate images based on a specific program. Examples of such other applications include training to improve the user's physical abilities, rehabilitation to restore the user's physical abilities, and lessons to improve the user's skills or techniques.

[0060] The present invention is not limited to the embodiments described above, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention. [Explanation of Symbols]

[0061] 1. Information Processing System 10 game consoles 20 Force Plate 21 Plate body 22 Convex part 30 Head-mounted displays 40 controllers 211 Alert area 201 First Processor 202 Force Sensor 203 Communication Interface (IF) 301 Second Processor 302, 402 Accelerometer 310, 320 images 401 Third Processor

Claims

1. A force plate that functions as a controller for controlling a video generation device, The system includes a force sensor capable of detecting the user's load, and a transmission unit that transmits an alert signal to the video generation device or a display that outputs the video generated by the video generation device when the user's foot pressure center detected by the force sensor enters the peripheral edge of the force plate. A force plate characterized by the following features.

2. The force plate according to claim 1, wherein the display is a head-mounted display.

3. The force plate according to claim 1, wherein the transmitting unit transmits a signal to the video generation device or the display instructing it to output an alert sound as the alert signal.

4. The force plate according to claim 1, wherein the transmitting unit transmits a signal to the video generating device or the display as an alert signal, instructing the display to display an image that obscures at least a portion of the video.

5. The force plate according to claim 1, having a step at its peripheral edge.

6. An information processing system comprising a force plate according to any one of claims 1 to 5, and a display that displays an image corresponding to a signal from the force plate.

Images