Augmented reality game and software for it

Abstract

System (1) for playing an augmented reality (AR) game, comprising an image capture unit (5) for capturing images of a player's (4) environment, a data processing unit (2) for calculating the computer game including its AR content as a superimposition of the captured images with virtual content (6), and data glasses (3) for displaying the calculated AR content, characterized in that the system (1) also includes at least one trampoline (7) which can be used by the player (4) wearing the data glasses (3) for the purpose of and during playing the AR game, so that the changes in position resulting from its use, accompanied by a change in the visual impressions of the player (4), can be detected by means of the image capture unit (5), superimposed with virtual content (6) by the data processing unit (2), and reproduced by means of the data glasses (3).

Description

Introduction

[0001] The invention relates to an augmented reality game and associated software. In particular, the invention relates to such a game in the field of sports. State of the art and disadvantages

[0002] Games that utilize digital systems are well known. For many years, computer systems have been used to play digital games in which the player(s) sit in front of a screen and interact with the game alternately or together using a controller in the form of a keyboard or a joystick.

[0003] For several years now, so-called "virtual reality" glasses (VR glasses) have been gaining popularity in the gaming scene. Instead of a screen, a VR headset is worn, which displays a three-dimensional image to the player. Interaction is achieved either via a manual controller or through a gesture-recognizing camera that detects the player's finger or body movements and projects them into the game, allowing the player to control the character's movements or perform other interactions with the game by using their body.

[0004] Also known for some time are computer-assisted games in which a camera captures an image of the real world and overlays it with virtual elements on a screen in real time (augmented reality, hereinafter referred to as "AR"). The increasing computing power of modern smartphones allows the mobile device's screen to be used to display virtual content in front of or over the device's live camera feed. In this way, virtual characters or objects can be displayed on a playing field, which can be a prepared environment (e.g., a hall with architectural elements) or the normal outside world (e.g., urban space), and the player(s) can then interact with them.

[0005] Finally, AR games are also well-known, in which a corresponding AR headset with a front camera is used instead of a mobile device, allowing the player a more immersive way of playing. Problem of the invention and solution

[0006] The invention is based on the task of specifying an AR game that offers the player a new kind of gaming experience.

[0007] The problem is solved by a system according to claim 1 and a computer program product according to claim 7. Advantageous embodiments can be found in the respective dependent claims, the following description, and the figure. Description

[0008] The system according to the invention is used for playing an augmented reality (AR) game.

[0009] It includes an image capture unit for recording images of a player's surroundings, for example one or more cameras, which are particularly suitable for providing a continuous stream of (moving) images.

[0010] It further includes a data processing unit (computer) for performing the calculations of the computer game, including its AR content, which is created by overlaying the captured images with virtual content. This means that both the base game (the actual game, e.g., calculating the score, the physical models, etc.) and the calculations required for the overlay (AR effect) should be manageable by the data processing unit. It is also possible that this unit is actually composed of various sub-units, each responsible for different computational tasks.

[0011] The invention also includes smart glasses for displaying the calculated AR content (AR glasses). These preferably allow stereo vision, so that three-dimensional content can be displayed realistically. They can also include further components such as a sound system, which is particularly surround-capable, as well as wireless interfaces, etc.

[0012] The invention is characterized in that the system also comprises at least one trampoline which can be used by the player wearing the smart glasses for the purpose of and during playing the AR game, so that the changes in the player's position resulting from its use, accompanied by a change in their visual impressions, can be detected by the image capture unit, superimposed with virtual content by the data processing unit, and reproduced by the smart glasses. In other words, the player wears AR (or VR) glasses while jumping on the trampoline. These then represent the real world surrounding them (or a simplification thereof, for example without the walls of a trampoline park, or a distortion, for example by replacing the walls with a forest).It also presents virtual content superimposed on the real world, such as fixed switches, rising balloons, or rolling stones. The player sees this content and can then interact with it passively or actively. "Passive" interaction means, for example, jumping over or dodging obstacles; "active" interaction means, for example, "touching" objects, such as popping a balloon or pressing a switch.

[0013] The invention thus provides an AR game that offers the player a new kind of gaming experience. Combining VR or AR hardware with a trampoline, or rather trampoline jumping, is a completely new area within this type of game and goes significantly beyond the possibilities of known AR games, as will be explained below.

[0014] Various embodiments of the invention are described in more detail below.

[0015] In one embodiment, the data processing unit is separate from the smart glasses. It could, for example, be a computer located at the edge of the playing field or even entirely outside the immediate playing environment (e.g., in a data center). The advantage of such a configuration is the considerable computing power that can be provided in this way. The connection to the AR glasses is then preferably wireless. The smart glasses can then also be smaller and lighter.

[0016] In another embodiment, the data processing unit is integrated with the smart glasses. The advantage of this embodiment is the elimination of the need to transmit large amounts of data wirelessly, thus enabling, for example, very high resolutions, regardless of the number of players, since each player wears their own smart glasses.

[0017] In another embodiment, the image capture unit differs from the data glasses. Accordingly, one or more cameras can be positioned at the edge of the playing field, above and / or below the player. These cameras capture the player; from this determined position, the data processing unit can calculate how the environment appears from the player's perspective and thus place the virtual objects accordingly.

[0018] In all cases, motion data from the smart glasses, such as data from a gyroscope integrated into the glasses, can also be used.

[0019] In another embodiment, the image capture unit is integrated into the smart glasses. This makes it particularly easy to use the real environment as the game background, since the camera is located very close to the player's actual eye position and also moves with the player; its live image thus essentially corresponds to the image the player would see even without the glasses. Therefore, only the virtual content needs to be positioned and displayed appropriately.

[0020] The invention may further comprise a computer program product (software). This is designed to perform at least one of the following routines when executed: - Setting up a virtual space in the physical world: When the software is launched on the smart glasses, a virtual room must first be set up to define the playing area. This virtual room is defined in the real world using the augmented reality features of the smart glasses on the trampoline. The room can then be saved and, ideally, remains permanently stored on the device after the initial setup. - Providing a selection menu with information for a player, allowing a selection, and calculating the steps associated with that selection: This menu contains information about available games and tickets (see “Ticketing System”). If tickets are available, the player can use them to start a game. The player can therefore make a selection, The program then performs the corresponding calculations in the background. - Providing a selection menu with information for an administrator, allowing a selection, and calculating the steps associated with that selection: The administrator menu introduces further options, such as recalibrating a room. Dividing the menus ensures that a player only has access to the options necessary to use the software for its intended purpose (playing games). Operators of amusement parks, on the other hand, have the option of managing further settings in the administrator menu, which are unimportant to the player but relevant to the operator.

[0021] The administrator menu can be accessed particularly conveniently via a conventional browser using a link to a designated website. - Ticketing system for managing purchasable tickets and assigning them to specific smart glasses: Operators of smart glasses can add "tickets," preferably via a linked website. For example, the smart glasses can be selected from a menu, and then the number of tickets purchased for them is entered. The tickets are assigned to the glasses and ideally also displayed on the glasses themselves. To start a game, the player must insert a ticket. If no tickets are available, no game can be started. This allows the operator to collect a fee per game and ensures that the player does not play more than they have paid for. - Calculation and rendering of the actual AR game: The computer program can optionally also calculate the actual game. A game preferably lasts a fixed amount of time. The goal can be to score as many points as possible. This requires specific actions to be performed. These actions necessitate movement by the player. The games use jumping on a trampoline as the basic mechanic. The player's movements are recorded and integrated into the game; the resulting situation is continuously calculated and displayed in the data glasses.

[0022] For example, balloons can appear and float towards the player at varying heights and speeds. To score points, the player must pop the balloons with a virtual "needle" located at the end of a controller. If they pop a balloon instead, they lose points. To reach all the balloons and score as many points as possible, the player must jump on the trampoline, as otherwise they won't reach the necessary height.

[0023] The sports equipment "trampoline" is thus integrated into the AR environment and is also an indispensable component of the system according to the invention, since otherwise the tasks provided for in the games would be impossible to solve. This is a key difference between the system according to the invention and conventional games, which are played in a "normal" environment and without such sports equipment. - Park management for managing the user(s) of one or more game parks, each game park comprising a plurality of data glasses: Parks and users can preferably be created via a website. Users can be assigned to one or more parks. An operator can receive login credentials, granting them access to the website. They can then use the website to configure settings for their assigned park and the smart glasses assigned to that park, as well as create the aforementioned tickets and assign them to specific smart glasses. The system can also allow users to grant and revoke permissions, activate and deactivate parks, and activate or deactivate smart glasses.

[0024] The invention also relates to a computer program product as described above, to which reference is made to avoid repetition. The computer program product can be stored in whole or in part on a storage medium such as a CD or a USB data storage device, or downloaded from an internet server as needed.

[0025] The following describes the use of a system for playing an augmented reality (AR) game. An image capture unit records images of the player's surroundings. A data processing unit calculates the computer game, including its AR content, by superimposing the recorded images with virtual content. The calculated AR content is then displayed in smart glasses worn by the player. The system is characterized by the player using a trampoline during the game. The resulting changes in position, accompanied by changes in the player's visual perception, are captured by the image capture unit, superimposed with virtual content by the data processing unit, and displayed via the smart glasses.

[0026] The other embodiments already mentioned above can also be combined with this; therefore, reference is made to the passages above to avoid repetition.

[0027] The player can interact with the game using a manual controller and / or gesture recognition. The controller can be a game console or another object, such as a stick, one or more rings, or similar items, which can be held in the hand or attached to the fingers. The position and orientation of the limbs can also be used for interaction (gestures).

[0028] It is also conceivable, and preferred, that virtual content intended for player interaction is virtually placed at a height above the trampoline that exceeds the player's height, including outstretched arms. This forces the player to actually use the trampoline, as they would otherwise be unable to reach the objects. These objects could be, for example, virtual balloons floating above the player's head, or switches placed high up that must be touched to progress in the game.

[0029] Virtual content can also be placed on the trampoline, which the player can only jump over using the trampoline; this could be, for example, stones or tree trunks that roll towards the player at leg height, and which he can only jump over with the help of the trampoline without touching them, which could lead to a point deduction.

[0030] The trampoline thus becomes an integral part of the AR game, without which the game would not be possible. Application example

[0031] The following is an application example.

[0032] First, the smart glasses are sent to the trampoline parks or similar facilities that have purchased or rented them. A monthly license fee allows the trampoline parks to unlock and use the associated software. The glasses are then set up at the respective trampoline park, and the virtual reality environments are created.

[0033] To play, customers of the trampoline park purchase tickets for a price determined by the operator – free tickets may also be distributed at the operator's discretion and responsibility. An employee accesses the aforementioned website and assigns the number of purchased / received tickets to the glasses.

[0034] The player puts on the data glasses and enters the set up virtual room. The player sees in the (player) menu how many tickets they have available and can select the game they want to play and then begin playing it.

[0035] Once the game is over and no ticket remains, the player cannot start another game. They return the data glasses to the staff member.

[0036] If a room needs to be reconfigured or a new room needs to be set up, the operator can activate the administrator menu for the smart glasses via the aforementioned website. This menu allows, for example, starting a routine to calibrate the glasses. If this is selected, the operator can set up a new room. Once this is complete, they deactivate the administrator menu again. The players will then only be able to start a new game and will no longer be able to make any further adjustments. Character description The invention is explained below using a figure as an example. The only figure shown is... Fig.Figure 1 shows a schematic representation of the system 1 according to the invention. This system comprises, in addition to the symbolically shown data processing unit 2, which is arranged outside the playing field, a pair of smart glasses 3, which are worn by player 4. The image acquisition unit 5 (not shown separately) is integrated into the smart glasses 3. The smart glasses 3 and the data processing unit 2 communicate wirelessly with each other.

[0037] Virtual content 6, depicted as a floating balloon, is displayed in the data glasses 3. This balloon is positioned so high that player 4 is not tall enough to touch it. To reach the balloon, player 4 must use the trampoline 7, which is an integral part of system 1.

[0038] The position changes of player 4 and the images from the image capture unit 5 are recorded by the smart glasses 3, sent to the data processing unit 2, where they are integrated into the current game situation. The overlay of the real environment with the virtual content 6 is then generated and finally sent back to the smart glasses 3. Player 4 can then see the visual AR environment corresponding to their current position and direction of view and act accordingly, for example, by touching the virtual balloon with their outstretched arm. This "touch" is also "recognized" by the data processing unit 2, which can then trigger a predefined action, such as the balloon bursting and player 4's score increasing. Reference symbol list 1 system 2 Data processing unit 3 Data glasses 4 players 5 Image acquisition unit 6 virtual items 7 trampoline

Claims

[1] System (1) for playing an augmented reality (AR) game, comprising an image capture unit (5) for capturing images of a player's environment (4), a data processing unit (2) for calculating the computer game including its AR content as a superimposition of the captured images with virtual content (6), and data glasses (3) for displaying the calculated AR content, characterized by , that the system (1) also includes at least one trampoline (7) which can be used by the player (4) wearing the data glasses (3) for the purpose of and during playing the AR game, so that the changes in position resulting from its use, accompanied by a change in the visual impressions of the player (4), can be detected by means of the image capture unit (5), can be superimposed with virtual content (6) by the data processing unit (2), and can be reproduced by means of the data glasses (3). [2] System (1) according to claim 1, wherein the data processing unit (2) is different from the data glasses (3). [3] System (1) according to claim 1, wherein the data processing unit (2) is integrated with the data glasses (3). [4] System (1) according to any one of claims 1 to 3, wherein the image acquisition unit (5) is different from the data glasses (3). [5] System (1) according to one of claims 1 to 3, wherein the image acquisition unit (5) is integrated into the data glasses (3). [6] System (1) according to any of the preceding claims, further comprising a computer program product which, when executed, is designed to perform at least one of the following routines: - Setting up a virtual space in the physical world; - Providing a selection menu with information for a player (4), allowing a selection, and calculating the steps associated with that selection; - Providing a selection menu with information for an administrator, allowing a selection, and calculating the steps associated with that selection; - Ticketing system for managing purchasable tickets and assigning them to specific smart glasses; - Calculation and rendering of the actual AR game; - Park management for managing the user(s) of one or more game parks, each game park comprising a plurality of data glasses (3). [7] Computer program product as defined in claim 6.

Images