Augmented reality game and software for same

Abstract

The invention relates to an augmented reality game and associated software in the field of sports. The system (1) for playing an augmented reality (AR) game comprises an image recording unit (5), a data processing unit (2) for calculating the computer game, and data glasses (3), and is characterised in that the system additionally comprises at least one trampoline (7) which can be used by the player (4) wearing the data glasses (3) for the purpose of and during playing of the AR game. The invention also relates to an associated computer program product and to the use of the system according to the invention.

Description

[0001] Augmented reality game and software for it

[0002] Introduction

[0003] The invention relates to an augmented reality game and associated software. In particular, the invention relates to such a game in the field of sports.

[0004] State of the art and disadvantages

[0005] Games that utilize digital systems are well known. For many years, computer systems have been used to play digital games, in which the player(s) sit in front of a screen and interact with the game alternately or together using a controller in the form of a keyboard or a joystick.

[0006] For several years now, so-called "virtual reality" glasses (VR glasses) have been gaining popularity in the gaming scene. Instead of a screen, a VR headset is worn, which displays a three-dimensional image to the player. Interaction is achieved either via a manual controller or through a gesture-recognizing camera that detects the player's finger or body movements and projects them into the game, allowing the player to control the game character's movements or perform other interactions by using their body.

[0007] Also known for some time are computer-assisted games in which the image of the real world is captured by a camera and displayed in real time overlaid with virtual elements on a screen ("Augmented Reality," hereinafter referred to as "AR"). The increasing computing power of modern smartphones thus makes it possible to use the mobile device's screen to display virtual content in front of or over the device's live camera image. In this way, on a P. Bury 2 isipat

[0008] AR app BUOIWO-P

[0009] The playing field, which can be a prepared environment (e.g., a hall with structural elements) but also the normal outside world (e.g., urban space), depicts virtual figures or objects with which the player(s) can then interact.

[0010] Finally, AR games are also well-known, in which a corresponding AR headset with a front camera is used instead of a mobile device, allowing the player a more immersive way of playing.

[0011] Problem of the invention and solution

[0012] The invention is based on the task of specifying an AR game that offers the player a new kind of gaming experience.

[0013] The problem is solved by a system according to claim 1, a computer program product according to claim 7, and a method according to dependent claim 8. Advantageous embodiments can be found in the respective dependent claims, the following description, and the figure.

[0014] Description

[0015] The system according to the invention is used for playing an augmented reality (AR) game.

[0016] It includes an image capture unit for recording images of a player's surroundings, for example one or more cameras, which are particularly suitable for providing a continuous stream of (moving) images.

[0017] It further includes a data processing unit (computer) for performing the calculations of the computer game, including its AR content as a superimposition of the captured images with virtual content. This means that both the base (the actual game, e.g., calculating the score, the physical models, etc.) and the superimposed (AR) content are integrated.

[0018] The calculations required by the data processing unit P (effect) were performed by Bury 3 isipat.

[0019] The AR app BUO IWO-P should be able to handle this. It is also possible that this unit is actually composed of different sub-units, each with different computational tasks.

[0020] The invention also includes data glasses for displaying the calculated AR content (AR glasses). These preferably allow stereo vision, so that three-dimensional content can be displayed realistically. They can also include further components such as a sound system, which is particularly surround-capable, as well as wireless interfaces, etc.

[0021] The invention is characterized in that the system also comprises at least one trampoline, which can be used by the player wearing the smart glasses for the purpose of and during playing the AR game, so that the changes in the player's position resulting from its use, accompanied by a change in their visual impressions, can be detected by the image capture unit, superimposed with virtual content by the data processing unit, and reproduced by the smart glasses. In other words, the player wears AR (or VR) glasses while jumping on the trampoline. These then represent the real world surrounding them (or a simplification thereof, for example without the walls of a trampoline park, or a distortion, for example by replacing the walls with a forest).It also presents virtual content superimposed on the real world, such as permanently installed switches, rising balloons, or rolling stones. The player sees this content and can then interact with it passively or actively. "Passive" interaction means, for example, jumping over or dodging obstacles; "active" interaction means, for example, "touching" objects, such as popping one.

[0022] Balloons or pressing a switch. P. Bury 4 isipat

[0023] AR app BUO IWO-P

[0024] The invention thus provides an AR game that offers the player a new kind of gaming experience. Combining VR or AR hardware with a trampoline, or trampoline jumping, is a completely new area of ​​this type of game and goes significantly beyond the possibilities of known AR games, as will be explained below.

[0025] The following section describes various embodiments of the invention in more detail.

[0026] Depending on the implementation, the data processing unit differs from the smart glasses. It could, for example, be a computer located at the edge of the playing field or even entirely outside the immediate playing environment (e.g., in a data center). The advantage of such a configuration is the significant computing power that can be provided in this way. The connection to the AR glasses is then preferably wireless. The smart glasses can then also be smaller and lighter.

[0027] In another implementation, the data processing unit is integrated into the smart glasses. The advantage of this implementation is the elimination of the need to transmit large amounts of data wirelessly, thus enabling, for example, very high resolutions, regardless of the number of players, since each player wears their own smart glasses.

[0028] In another implementation, the image capture unit differs from the data glasses. Accordingly, one or more cameras can be positioned at the edge of the playing field, above and / or below the player. These cameras record the player; from this determined position, the data processing unit can calculate how the environment appears from the player's perspective and thus place the virtual objects accordingly. P. Bury 5 isipat

[0029] AR app BUO IWO-P

[0030] In all cases, motion data from the smart glasses, for example data from a gyroscope integrated into the glasses, can also be used.

[0031] In another implementation, the image capture unit is integrated into the smart glasses. This makes it particularly easy to use the real environment as the game background, since the camera is located very close to the player's actual eye position and also moves with the player; its live image thus essentially corresponds to the image the player would see even without the glasses. Therefore, only the virtual content needs to be positioned and displayed appropriately.

[0032] The invention may further comprise a computer program product (software). This is designed to perform at least one of the following routines when executed:

[0033] - Setting up a virtual space in the physical world:

[0034] When the software is launched on the smart glasses, a virtual room must first be set up to define the playing area. This virtual room is defined in the real world using the augmented reality features of the smart glasses on the trampoline. The room can then be saved and, ideally, remains permanently stored on the device after initial setup.

[0035] - Providing a selection menu with information for a player, allowing a selection, and calculating the steps associated with that selection:

[0036] This menu contains information about available games and tickets (see "Ticketing System"). If tickets are available, the player can use them to start a game. The player can therefore make a selection, P. Bury 6 isipat

[0037] The AR app BUO IWO-P then performs the corresponding calculations in the background.

[0038] - Providing a selection menu with information for an administrator, allowing a selection, and calculating the steps associated with that selection:

[0039] The administrator menu introduces further options, such as recalibrating a room. Dividing the menus ensures that a player only has access to the options necessary to use the software for its intended purpose (playing games). Operators of an amusement park, on the other hand, have the option to manage additional settings in the administrator menu that are irrelevant to the player but relevant to the operator.

[0040] The administrator menu can be accessed particularly conveniently via a conventional browser using a link to a designated website.

[0041] - Ticketing system for managing purchasable tickets and assigning them to specific smart glasses:

[0042] Operators of smart glasses can add "tickets," preferably via a linked website. For example, the smart glasses can be selected from a menu, and then the number of tickets purchased for them is entered. The tickets are assigned to the glasses and ideally also displayed on the glasses themselves. To start a game, the player must insert a ticket. If no tickets are available, no game can be started. This allows the operator to collect a fee per game and ensures that the player does not play more than they have paid for.

[0043] - Calculation and rendering of the actual AR game: P. Bury 7 isipat

[0044] AR app BUO IWO-P

[0045] The computer program can optionally also calculate the actual game. A game preferably lasts a fixed amount of time. The goal can be to score as many points as possible. This requires performing specific actions. These actions require movement by the player. The basic mechanic used in the games is jumping on a trampoline. The player's movements are recorded and integrated into the game; the resulting situation is continuously calculated and displayed in the data glasses.

[0046] For example, balloons can appear and float towards the player at different heights and speeds. To score points, the player must pop the balloons with a virtual "needle" located at the end of a controller. If they pop a balloon instead, they lose points. To reach all the balloons and score as many points as possible, the player must jump on the trampoline, as otherwise they won't reach the necessary height.

[0047] The sports equipment "trampoline" is thus integrated into the AR environment and is also an indispensable component of the system according to the invention, since otherwise the tasks provided for it in the games would be impossible to solve. This is another key difference between the system according to the invention and conventional games, which are played in a "normal" environment and without such sports equipment.

[0048] - Park management for managing the user(s) of one or more game parks, each game park comprising a plurality of data glasses:

[0049] Parks and users can preferably be created via a website. Users can be assigned to one or more parks. An operator can receive a login and thus gain access to the website. They can then use the website to configure settings for their assigned park and the park's P. Bury 8 isipat.

[0050] The AR app BUO IWO-P allows users to create and assign tickets to specific smart glasses, including creating and assigning the aforementioned tickets. It may also be possible to grant and remove user rights, activate and deactivate parks, and activate or deactivate smart glasses.

[0051] According to one implementation, the computer program product is designed to perform several of the routines described above. This applies in particular to the execution of the steps "Setting up a virtual room," "Providing a selection menu with information for a player," and "Calculation and display," or the execution of the steps "Providing a selection menu with information for an administrator," "Ticketing system for administration," and "Park management." Any other combination of the steps, insofar as technically possible, also constitutes an implementation according to the invention.

[0052] The invention also relates to a computer program product as described above, to which reference is made to avoid repetition. The computer program product can be stored in whole or in part on a storage medium such as a CD or a USB data storage device, or downloaded from an internet server as needed.

[0053] The invention also relates to the use of a system for playing an augmented reality (AR) game, wherein images of a player's environment are captured by means of an image capture unit, the computer game including its AR content is calculated by means of a data processing unit as a superimposition of the captured images with virtual content, and subsequently the calculated AR content is displayed in data glasses worn by the player. The system is characterized in that the player uses a trampoline during the game, wherein the changes in position resulting from its use, accompanied by a change in the visual P. Bury 9 isipat

[0054] AR app BUO IWO-P

[0055] The player's impressions are captured by the image capture unit, overlaid with virtual content by the data processing unit, and reproduced using the data glasses.

[0056] The other forms of execution mentioned above can also be combined with this; therefore, reference is made to the passages above to avoid repetition.

[0057] The player can interact with the game using a manual controller and / or gesture recognition. The controller can be a game console or another object, such as a stick, one or more rings, or similar items, which can be held in the hand or attached to the fingers. The position and orientation of the limbs can also be used for interaction (gestures).

[0058] It is also conceivable, and preferred, that virtual content intended for player interaction is virtually placed at a height above the trampoline that exceeds the player's height, including outstretched arms. This forces the player to actually use the trampoline, as they would otherwise be unable to reach the objects. These objects could be, for example, virtual balloons floating above the player's head, or switches placed high up that must be touched to progress in the game.

[0059] Virtual content can also be placed on the trampoline, which the player can only jump over using the trampoline; this could be, for example, stones or tree trunks that roll onto the player at leg height, and which he can only jump over with the help of the trampoline without touching them, which could lead to a point deduction.

[0060] The trampoline thus becomes an integral part of the AR game, without which the game would not be possible. P. Bury 10 isipat

[0061] AR App BU01WO-P

[0062] Application example

[0063] The following is an example of how to use the product.

[0064] First, the smart glasses are sent to the trampoline parks or similar facilities that have purchased or rented them. A monthly license fee allows the trampoline parks to activate and use the associated software. The glasses are then set up in the respective trampoline park, and the virtual rooms are created.

[0065] To play, customers of the trampoline park purchase tickets for a price determined by the operator – free tickets may also be distributed at the operator's discretion and responsibility. An employee accesses the aforementioned website and assigns the number of purchased / received tickets to the glasses.

[0066] The player puts on the data glasses and enters the set up virtual room. The player sees in the (player) menu how many tickets he has available and can select the game he wants to play and then play it.

[0067] If the game ends and no tickets remain, the player cannot start another game. They must either return the data glasses to the staff member or purchase additional tickets.

[0068] If a room needs to be reconfigured or a new room needs to be set up, the operator can activate the administrator menu for the smart glasses via the aforementioned website. This menu allows, for example, starting a routine to calibrate the glasses. If this is selected, the operator can set up a new room. Once this is complete, they deactivate the administrator menu again. The players will then only be able to start a new game and will no longer be able to make any further adjustments. P. Bury 11 isipat

[0069] AR app BUO IWO-P

[0070] Character description

[0071] The invention is explained below by way of example with reference to a figure. The single figure 1 shows a schematic representation of the system 1 according to the invention. This system comprises, in addition to the symbolically shown data processing unit 2, which is arranged outside the playing field, a pair of smart glasses 3, which are worn by player 4. The image acquisition unit 5 (not shown separately) is integrated into the smart glasses 3. The smart glasses 3 and the data processing unit 2 communicate wirelessly with each other.

[0072] Virtual content 6, depicted as a floating balloon, is displayed in the data glasses 3. This balloon is positioned so high that player 4 is not tall enough to touch it. To reach the balloon, player 4 must use the trampoline 7, which is an integral part of system 1.

[0073] The player's (4) position changes and the images from the image capture unit (5) are recorded by the smart glasses (3), sent to the data processing unit (2), where they are integrated into the current game situation. The overlay of the real environment with the virtual content (6) is then generated and finally sent back to the smart glasses (3). In these glasses, the player (4) can see the visual AR environment corresponding to their current position and direction of view and act accordingly, for example, by touching the virtual balloon with their outstretched arm. This "touch" is also "recognized" by the data processing unit (2), which can then lead to a predefined action, such as the balloon bursting and the player (4) increasing their score. (P. Bury 12 isipat)

[0074] AR app BUO IWO-P

[0075] Reference character list

[0076] 1 system

[0077] 2 Data processing unit

[0078] 3 Data glasses

[0079] 4 players

[0080] 5 Image acquisition unit

[0081] 6 virtual items

[0082] 7 trampoline

Claims

P. Bury - 13 - isipat AR-App BUOIWO-P Patentansprüche 1. System (1) for playing an augmented reality (AR) game, comprising an image capture unit (5) for capturing images of a player's (4) environment, a data processing unit (2) for calculating the computer game including its AR content as a superimposition of the captured images with virtual content (6), and data glasses (3) for displaying the calculated AR content, characterized in that the system (1) also includes at least one trampoline (7) which can be used by the player (4) wearing the data glasses (3) for the purpose of and during playing the AR game, so that the changes in position resulting from its use, accompanied by a change in the visual impressions of the player (4), can be detected by means of the image capture unit (5), superimposed with virtual content (6) by the data processing unit (2), and reproduced by means of the data glasses (3).

2. System (1) according to claim 1, wherein the data processing unit (2) is different from the data glasses (3).

3. System (1) according to claim 1, wherein the data processing unit (2) is integrated with the data glasses (3).

4. System (1) according to one of claims 1 to 3, wherein the image acquisition unit (5) is different from the data glasses (3).

5. System (1) according to one of claims 1 to 3, wherein the image acquisition unit (5) is integrated into the data glasses (3).

6. System (1) according to any of the preceding claims, further comprising a computer program product which, when executed, is designed to perform at least one of the following routines: Establishing a virtual space in the physical world; P. Bury 14 isipat AR app BUOIWO-P - Providing a selection menu with information for a player (4), allowing a selection, and calculating the steps associated with that selection; - Providing a selection menu with information for an administrator, allowing a selection, and calculating the steps associated with that selection; - Ticketing system for managing purchasable tickets and assigning them to specific smart glasses; - Calculation and rendering of the actual AR game; - Park management for managing the user(s) of one or more game parks, each game park comprising a plurality of data glasses (3) .

7. Computer program product as defined in claim 6.

8. Use of a system (1) to play an augmented- Reality (AR) game, wherein images of the environment of a player (4) are captured by means of an image capture unit (5), the computer game including its AR content is calculated by means of a data processing unit (2) as a superimposition of the captured images with virtual content (6), and subsequently the calculated AR content is displayed in data glasses (3) worn by the player (4), characterized in that the player (4) uses a trampoline (7) during the game, wherein the changes in position resulting from its use, accompanied by a change in the visual impressions of the player (4), are captured by means of the image capture unit (5), by the Data processing unit (2) overlaid with virtual content (6), and displayed using the data glasses (3).

9. Use according to claim 8, wherein the player (4) interacts with the game by means of a manual controller and / or by means of gesture recognition. P. Bury 15 isipat AR app BUOIWO-P 10. Use according to claim 8 or 9, wherein virtual content (6) intended for interaction with the player (4) is virtually placed at a height above the trampoline (7) which exceeds the body height including outstretched arms of the player (4), and / or wherein virtual content (6) is placed on the trampoline (7) which the player (4) can only jump over using the trampoline (7).

Images