Device and method for generating a virtual reality for at least one user

Abstract

Device (100) for generating a virtual reality for at least one user, comprising: an output means (110) with an output surface (111) that is at least partially arc-shaped, wherein the output means (110) is designed to output at least one three-dimensional object on the output surface (111) to the at least one user; a plurality of camera sensors (120) for recording the user at a first time and outputting respective first recording images, wherein the respective camera sensors (120) are arranged at different sensor positions; a controller (130) that is trained to: Determining an initial head position of the user's head relative to the output surface (111) based on the initial capture images and a predetermined arrangement of the output surface (111) relative to the plurality of camera sensors (120); Determining an output command to output the object based on the determined first head position, wherein the output command includes at least one object orientation of the object relative to the first head position, wherein the output device (110) is configured to output the object based on the output command, wherein the control (130) is designed to calibrate the output device (110) based on the first head position.

Description

[0001] The invention relates to a device and a method for generating a virtual reality for at least one user, as well as an associated computer program product.

[0002] Virtual reality (VR), that is, a computer-generated reality with images and sound, can be realized today using various technologies. Currently, VR headsets or room-sized CAVEs ("Cave Automatic Virtual Environments") are used for this purpose. In both cases, additional hardware is currently required, which the user wears. This hardware serves to display image content on head-mounted displays, to detect viewing angle and position using tracking glasses, to output sound via headphones, and to interact with controllers in virtual worlds.

[0003] However, the use of additional hardware makes the long-term use of the technology very inconvenient, tiring, and, in the case of VR glasses, also socially isolating.

[0004] In addition to these disadvantages, some users experience complaints such as motion sickness from wearing the hardware, especially the glasses. Further disadvantages include the lack of hygiene associated with hardware worn on the body, particularly when used by multiple users.

[0005] The state of the art is known from US 2014 / 0 192 087 A1 and CN 1 14 035 682 A.

[0006] It is an object of the present invention to improve upon or even eliminate one or more of the aforementioned disadvantages. In particular, it is an object of the present invention to provide a virtual reality to a user without the use of hardware that the user has to wear on their body.

[0007] The problem is solved, according to a first aspect, by a device for generating a virtual reality for at least one user according to claim 1. The device comprises an output means with an output surface that is at least partially arcuate. The output means is configured to output at least one three-dimensional object on the output surface to the at least one user. Furthermore, the device comprises a plurality of camera sensors for capturing the user at a first time and outputting respective first images, wherein the respective camera sensors are arranged at different sensor positions. The device further comprises a controller configured to: - Determining an initial head position of the user's head relative to the output surface based on the initial captured images and a predetermined arrangement of the output surface relative to the multitude of camera sensors; - Determining an output command to output the object based on the determined first head position, wherein the output command includes at least one object orientation of the object relative to the first head position.

[0008] The output device is designed to output the object based on the output command.

[0009] The proposed device enables an immersive experience (visual and optionally acoustic) and interaction with digital 3D worlds without requiring the user to wear any device or hardware. The device can be configured for VR. The VR environment can be extended reality and / or mixed reality. When the user moves their body, particularly their head, the object's position and / or orientation can be adjusted based on the head position or changes in head position. This allows the user to interact with the displayed three-dimensional object and, for example, view it from different angles. The user can experience this virtual reality without additional hardware on their body, thus avoiding the hygiene issues associated with wearing such hardware. Furthermore, the effects of motion sickness can be reduced or even prevented.Motion sickness can be reduced or even prevented, in particular, because the user can see their own body while using the device. This is not possible when wearing VR glasses.

[0010] The device can be used for simulations, digital product configurations and / or presentations, digital training, games, digital business meetings, entertainment, relaxation and wellness, edutainment (knowledge transfer), the metaverse, and social media. The object can be selected according to the application area.

[0011] The device can generate virtual reality for two or more users. To do this, only one three-dimensional object can be adjusted for one of the users using the output command. It can be determined which of the two or more users in the spatial segment will be designated for interaction with the device, in particular the VR. Consequently, a single user can be selected from the two or more users, and their head position can be determined. Alternatively or additionally, two or more objects can be output for the single user or for the two or more users. Thus, the invention is not limited to one object per user; rather, multiple objects can be output per user, and respective output commands and the audio commands mentioned below can be defined.The following description refers to one object and one user, but the invention is not limited to this single user and object. Features described in relation to the object or the user can be applied to other objects and other users.

[0012] Recording the user can involve at least a partial recording of the user's body, capturing at least the user's head or exclusively the head. Recording the user's body can also include recording other body parts and / or sections. For the VR experience, determining the user's head position is initially sufficient.

[0013] The object is three-dimensional. The output surface is two-dimensional. Consequently, image information used to represent the object can be designed in such a way that the user perceives the three-dimensional object, even though it is displayed on the two-dimensional output surface. The image information can include corresponding depth information.

[0014] The output surface can be designed to incorporate Fresnel lenses on its reverse side to reduce stray light. This can be particularly beneficial when using the projector mentioned below, as it reduces stray light emitted by the projector.

[0015] The multitude of camera sensors can include two, three, four or more camera sensors.

[0016] The output device can be designed to output at least one object to a section of space in which the user can be positioned and / or is positioned. For example, the user can stand or sit in front of the output device, such as on a chair. The multiple camera sensors can be designed and arranged to capture and record the section of space. Furthermore, the camera sensors can be arranged in such a way that the respective images complement each other, so that the section of space is covered and / or recorded using the images.

[0017] The captured images may show or include a partial and / or complete image of at least one user.

[0018] The control system can be further configured to determine body movement and / or posture based on the initial recording images and / or subsequent recording images. Furthermore, the control system can be configured to determine the output command and / or a subsequent audio command based on the body movement and / or posture. This enables tracking and allows the object's output to be adjusted according to the changing relative spatial relationship between the user and the object.

[0019] The object can have a predetermined position and / or orientation on the output surface. Consequently, an initial position and / or orientation of the object can be predefined. After determining the head position, a spatial relationship between the head position and the predetermined object position and / or orientation can be established, such that the initial position is linked, for example, to a standing user's head position facing forward (towards the output surface). If the user subsequently moves, the object position and / or orientation can be adjusted accordingly. Alternatively, the predetermined object position and / or orientation can be predefined for a predetermined head position, for example, for a seated user. If the user is standing, the initial head position would therefore be higher, and the object position and / or orientation would be adjusted accordingly.For example, if the object is a cube, the predetermined head position would mean that the user is looking at a front face of the cube. The head position in the standing position would result in the user looking at a top face of the cube.

[0020] The output command can further include the object position of the object on the output surface relative to the head position.

[0021] The output surface, which is at least partially curved, can provide a viewing angle of 180 degrees or more, preferably 220 degrees or 240 degrees or more, along a horizontal and / or vertical viewing axis of the user. An adult's field of vision is approximately 214 degrees. The output surface can be designed such that it provides a viewing angle along the horizontal and / or vertical viewing axis with an associated output viewing area for the user that is larger than the user's field of vision. Consequently, no edge of the output surface is visible in the user's field of vision, and the VR experience is enhanced. Alternatively, the output surface can provide a viewing angle of 90 degrees or more, 120 degrees or more, 150 degrees or more, 210 degrees or more, 240 degrees or more, 270 degrees or more, 300 degrees or more, or 330 degrees or more for the user.

[0022] The user can be located and / or positioned on a planar surface of the device. The output surface can extend perpendicular to the surface along a vertical direction. The horizontal viewing axis can be perpendicular to the vertical viewing axis, which in turn is parallel to the vertical direction.

[0023] The output surface can be cylindrical, partially cylindrical, or in particular, semi-cylindrical. Alternatively or additionally, the output surface can be oval, round, or hemispherical. Alternatively or additionally, the output surface can be arc-shaped such that the arc-shaped section has a predetermined radius.

[0024] The present invention relates to a virtual reality, such that the output of images by means of the output means can preferably be carried out in such a way that the output area is larger than a viewing angle of the user, in particular in the horizontal viewing axis.

[0025] The object can be displayed as a three-dimensional image and / or video. The three-dimensional image can be a snapshot, so that the object's position does not change if the user's head position changes.

[0026] Only the view or object orientation of the object can be adjusted to the changed head position. Alternatively, the object can move and / or change its position and / or orientation. Consequently, moving the object can change the view for the user.

[0027] The output surface can be designed to display the object. In particular, the output surface can be a screen. In this case, a projector mentioned below is not required. The output surface can be an LED screen. The output surface can be curved. Consequently, it can be a curved LED screen. A curved output surface can be advantageous for transport or storage, as it can be transported / stored in a flat state. For this application, the output surface can then be curved. Furthermore, the curvature can be adapted to the local and / or spatial conditions.

[0028] Alternatively, the output device can comprise at least one, preferably two, three or more projectors. The projector(s) can be, in particular, short-throw laser projectors to save space. The projector(s) can be designed and arranged to project the object onto the output surface.

[0029] The position(s) of one or more projectors can be predetermined and / or determinable. The projector position(s) can be further considered by the controller when determining the output command and / or a subsequent audio command.

[0030] The multitude of camera sensors can include at least one infrared-sensitive camera, or at least one camera sensor within the multitude can be an infrared-sensitive camera. Preferably, all camera sensors within the multitude are infrared-sensitive cameras. Infrared-sensitive cameras have the advantage of being relatively inexpensive. A camera sensor can be a camera. The infrared-sensitive camera can be configured to receive and / or image at least partially from the infrared range. Furthermore, the infrared-sensitive camera can be configured to receive and / or image light outside the infrared spectrum. Commercially available cameras often have an infrared filter, so the resulting images contain little or no infrared radiation. If the infrared filter is removed, the resulting images can contain infrared radiation.Thus, the infrared-sensitive camera could be a standard camera with the infrared filter removed, which are less expensive than standard infrared cameras. Alternatively, the infrared-sensitive camera could be a dedicated infrared camera. An infrared camera differs from a standard camera with the infrared filter removed in that it is exclusively focused on the infrared spectrum.

[0031] The device and / or individual units of the device may be designed to be remotely controllable.

[0032] The device can further comprise a plurality of audio units for outputting audio to the user and / or the room, wherein the audio units are arranged at different audio positions. The control system can further be configured to determine an audio command based on the first head position relative to the audio positions, wherein the audio command comprises an arrangement of the plurality of audio units relative to the first head position. The plurality of audio units can be configured to output audio based on the audio command. By determining the head position, a so-called audio sweet spot can be determined, particularly in real time for the user. The plurality of audio units can comprise two, three, four, or more audio units. One or more of the audio units can be an audio array or be combined into one.The large number of audio units allows for a three-dimensional listening experience to be provided to the user.

[0033] The audio output via the multiple audio units can be related to at least one object. For example, the object could be a vehicle, and the corresponding audio could be engine noise, the opening and / or closing of vehicle doors, or similar sounds. By using the multiple audio units, a three-dimensional listening experience can be provided, allowing the user, for example, to acoustically determine whether the engine noise is being generated by an engine located at the front or rear of the vehicle.

[0034] A spatial audio system can be provided using the large number of audio units.

[0035] The control system can be further configured to determine the audio command based on the object's position and / or orientation. The audio command can further include the arrangement of the multiple audio units relative to the object's position and / or orientation.

[0036] The controller can be configured to switch at least one camera sensor of a plurality of camera sensors and / or at least one audio unit of a plurality of audio units on and / or off. Switching on and / or off can be configured based on user access rights. For example, a user may have restricted access rights to the device, such that only the plurality of camera sensors are activated, while the plurality of audio units are deactivated. Based on the access rights, a specific number of on and / or off camera sensors and / or audio units can be defined.

[0037] The multiple camera sensors can be configured to capture the user at a second point in time and output corresponding second images. This second point in time can differ from the first; in particular, it can occur after the first. The control system can further determine a second head position of the user relative to the output surface based on the second images and the predetermined arrangement of the output surface relative to the multiple camera sensors. The control system can further adjust the output command and / or audio command based on this second head position. Alternatively, a second output command and / or audio command can be issued based on the second head position. The second head position can be at least partially different from or identical to the first head position.This allows for real-time adjustment of both the object output and the audio to the user's current head position. The first and second time points can be predetermined, separated by a predetermined time interval. This makes it possible to generate the captured images and determine the head positions within predetermined time intervals and / or at a predetermined frequency.

[0038] The numerous camera sensors, the projector, and / or the numerous audio units may be height-adjustable, in particular electrically extendable. The numerous camera sensors, the projector, and / or the numerous audio units may also be remotely controllable.

[0039] The multiple camera sensors and the projector can be arranged such that the sensors capture the projector and output the first and / or second images. These first and / or second images can at least partially include and / or depict the projector. The control system can further determine and calibrate the projector's position based on these first and / or second images. This enables camera sensor-based alignment of the projector, allowing for precise adjustment of the projector's location, orientation, and / or position. Calibration can be performed with respect to the virtual reality displayed to the user, specifically ensuring that the displayed object is free of distortion.

[0040] Alternatively or additionally, the device can comprise a plurality of detector sensors. These plurality of detector sensors can be configured to capture the projector, output the first and / or second images, and provide detector images. The plurality of detector sensors can at least partially comprise or be cameras. The plurality of detector sensors can be arranged and / or arrangable at predetermined positions. Furthermore, the plurality of detector sensors can be height-adjustable and / or position-adjustable. The control system can additionally or alternatively be configured to control the device units based on the detector images from the plurality of detector sensors. In particular, the projector position can be determined and calibrated based on the detector images from the plurality of detector sensors.

[0041] The device can be calibrated using the numerous camera sensors and / or detector sensors. Calibration can involve determining and / or verifying the positions of one or more units within the device. Due to thermal influences, the positions of these units can vary. To provide an optimal user experience, calibration can counteract such thermal influences. Calibration can be performed at one or more predetermined times. One of these times can be when the device is in use, specifically when the user enters the CAVE. Another time can be during and / or after the user has used the device.

[0042] Furthermore, the multitude of camera sensors, the multitude of detector sensors and / or the projector can be designed to swivel.

[0043] The output area or output device can further comprise a floor surface and / or a ceiling surface that adjoins the arc-shaped section of the output area. The output area can have a door. If the output area is designed as a 360-degree output area, for example, the user can enter the room section via the door. In this case, the 360-degree output area can therefore form a cylinder, with the interior volume of the cylinder defining the room section. The floor surface and / or the ceiling surface can, in particular, be planar, at least in part. The floor surface and / or the ceiling surface can be designed for outputting the object and / or other visual content. The output area can be designed for outputting other visual content.

[0044] The control system can be further configured to determine at least one finger position, at least one hand position, at least one arm position, one torso position, at least one leg position, and / or at least one foot position based on the first and / or second captured images. The control system can also be configured to determine the output command and / or the audio command based on the finger position, hand position, arm position, torso position, leg position, and / or foot position. The output command can further include the object orientation and / or position relative to the hand position, arm position, torso position, leg position, and / or foot position.The audio command can further include the arrangement of the multiple audio units relative to the finger position, hand position, arm position, torso position, leg position, and / or foot position. Preferably, several body parts of the user and their positions can be determined, for example, both hand positions and the corresponding finger positions.

[0045] The controller is designed to calibrate the output device based on the first and / or second head position. Alternatively or additionally, the controller can be designed to calibrate multiple audio units based on the first and / or second head position. Furthermore, calibration can be performed based on finger position, hand position, arm position, torso position, leg position, and / or foot position.

[0046] The device can further be configured as a communication unit for communicating with one or more units of the device and / or external units. Consequently, calibration can be performed remotely, for example, via remote maintenance.

[0047] The controller can be further configured to determine the user's facial expression based on the first and / or second captured images, and further configured to determine the output command and / or audio command based on that facial expression. The controller can also be further configured to control other units of the device based on the facial expression.

[0048] The device may further include at least one microphone sensor designed to receive a voice command from the user. The controller may further be designed to determine the output command and / or the audio command based on the voice command.

[0049] The device may further include: - a fragrance device designed to produce a fragrance; - a ventilation device designed to generate an airflow and, in particular, to adjust the temperature of the airflow; - a seating device for providing a seat for the user; - a treadmill; - a Playseat; - an authentication unit designed to query user authentication for the device; and / or - one or more ultrasound units designed to provide haptic feedback.

[0050] The controller can be configured to determine the output error and / or audio command based on user input via the aforementioned units. Furthermore, the controller can be configured to control the aforementioned units based on the output command and / or the audio command.

[0051] The control system can be further configured to identify the user based on the first and / or second captured images. For this purpose, a user profile characterizing the user can be pre-stored in the device's memory. Furthermore, the control system can be configured to output an avatar, particularly a three-dimensional avatar, via the output device, where the avatar is linked to the user and / or the user profile. The control system can also be configured to issue an avatar command based on the specific first and / or second head position, finger position, hand position, arm position, torso position, leg position, and / or foot position.Alternatively or additionally, the avatar can be controlled based on movements of the head, finger, hand, arm, torso, leg, and / or foot, using controls based on the first and / or second captured images. The avatar command can characterize and / or mimic the user's position, orientation of the respective body part, and / or facial expression.

[0052] If two or more people are present in the recorded images, the device can be configured to identify the user. The user can be identified as the person issuing a predetermined input. The input can be a voice command and / or a specific movement. The specific movement can be a hand gesture, such as raising a hand. Alternatively or additionally, the user can be identified as the person located in a predetermined position. For this purpose, the device can have a corresponding marker on the floor surface indicating the predetermined position. Alternatively, the user can be the person closest to the output surface. Alternatively, the user can be the person on the seating device, the Playseat, or the treadmill.

[0053] The device may include an energy storage device configured to supply energy to the device. The energy storage device can store energy. Alternatively or additionally, the energy storage device may be connectable to a power grid and / or another energy-supplying device to supply energy to the energy storage device.

[0054] The device can be modular in design, arrangement, assembly, and / or configuration. The device can be designed to incorporate a click system for easy and quick assembly and / or disassembly.

[0055] The device can be a Cave Automatic Virtual Environment (CAVE).

[0056] The device may comprise a housing and / or a container in which at least some of the device units are arranged. The housing and / or container may have predetermined arrangement and / or slots for the device units to enable easy and quick assembly and / or disassembly. Furthermore, the device may be transportable when assembled in the housing or container.

[0057] The device may further include storage, a server, a battery, a power supply and / or the communication unit.

[0058] According to a second aspect, the problem is solved by a computer-implemented method for generating a virtual reality for at least one user according to claim 18, comprising the steps: - Outputting at least one three-dimensional object to at least one user on an output surface that is at least partially arc-shaped; - Recording, using a multitude of camera sensors, of the user at a first time and outputting each first captured image, wherein the respective camera sensors are arranged at different sensor positions; - Determining an initial head position of the user's head relative to the output surface based on the initial captured images and a predetermined arrangement of the output surface relative to the multitude of camera sensors; - Determining an output command to output the object based on the determined first head position, wherein the output command includes at least one object orientation of the object relative to the first head position, - Outputting the object based on the output command.

[0059] Features that were implemented with respect to the device according to the first aspect can also be implemented as process features of the process according to the second aspect.

[0060] The task is solved according to a third aspect by a computer program product comprising instructions that cause the device according to the first aspect to perform the process steps of the procedure according to the second aspect.

[0061] The computer program product can be stored on a computer-readable medium, such as memory. The device's control system, as described in the first aspect, can be configured to execute the computer program product.

[0062] Preferred embodiments are explained by way of example with reference to the accompanying figures. These show: Fig. 1 a schematic representation of a device for generating a virtual reality for at least one user; Fig. 2. A schematic representation of the device with the user; and Fig. 3 A schematic representation of a computer-implemented method for creating a virtual reality.

[0063] In the figures, identical or essentially functionally equivalent or similar elements are designated with the same reference symbols.

[0064] Fig. Figure 1 shows a schematic representation of a device 100 for generating a virtual reality for at least one user. The device 100 comprises an output means 110 with an output surface 111 that is at least partially arcuate (see Figure 1). Fig. 2), wherein the output means 110 is designed to output at least one three-dimensional object onto the output surface 111 to the at least one user.

[0065] Furthermore, the device 100 includes a large number of camera sensors 120 (see Fig. 2) to capture the user at a first time and output each first captured image, wherein the respective camera sensors are arranged at different sensor positions.

[0066] The device 100 further comprises a controller 130 configured to determine a first head position of the user's head relative to the output surface 111 based on the first captured images and a predetermined arrangement of the output surface 111 relative to the plurality of camera sensors 120. The controller 130 is further configured to determine an output command for outputting the object based on the determined first head position, wherein the output command includes at least one object orientation of the object relative to the first head position. The output means 110 is configured to output the object based on the output command.

[0067] Device 100 is demonstrated using the following as an example: Fig. 2 explained. According to the Fig. Figure 2 shows that the output device 110 has an output surface 111 and several projectors 112, the projectors 112 being designed to project at least one object onto the output surface 111. The user is located in front of the output surface 111. The output surface 111 is semi-cylindrical in this case.

[0068] Device 100 is in the Fig. 2 in the form of a Cave Automatic Virtual Environment, CAVEs. In other words, with the exception of one server 140 of the device 100, all other units are arranged within a space, for example formed by an enclosure or a container. The user can enter the space by means of a door 150 of the device 100. The output surface 111 in conjunction with the projectors 112 is designed such that the object can be seen by the user when the user is positioned within a predetermined section of the space. According to the Fig. 2 is the section of space between door 150 and dispensing area 111.

[0069] Furthermore, several camera sensors 120, in particular infrared-sensitive cameras, are arranged on an upper section of the output surface 111, which are designed to capture the room section. Using the camera sensors 120, the room section and thus also the user can be captured, and the first captured images can be provided to the control unit 130.

[0070] The one in Fig. The two projectors 112 shown are height-adjustable and remotely controllable, for example by means of the control unit 130. Alternatively or additionally, the camera sensors 120 are height-adjustable and / or remotely controllable. Alternatively or additionally, the projectors 112 and / or the camera sensors 120 can be swiveled to scan the room section and / or to align the projectors 112 and / or the camera sensors 120.

[0071] To allow the user to enter the CAVE, a 160 mm touch display can be provided, which is located on one of the CAVE's exterior walls. Using the 160 mm touch display, the user can authenticate themselves, and the door 150 can be switched from a locked to an unlocked state. Additionally or alternatively, the VR can be configured using the 160 mm touch display. For example, the object to be displayed and / or its surrounding environment can be set.

[0072] After entering the CAVE, the user can, for example, take a seat in the CAVE. The invention is not limited to this, and a chair may not even be provided. The controller 130 detects the user in the first recorded images and determines at least one head position. Based on the head position, a predetermined arrangement of the display surface 111, and the camera sensors 120, the controller 130 determines a relative arrangement of the head to the display surface 111.

[0073] The three-dimensional object can be initially displayed on output surface 111 before or upon entering the CAVE. Alternatively, this can occur only after the head position has been determined. The object can have a predetermined position and / or arrangement on output surface 111.

[0074] Based on the determined head position, a spatial relationship between the head and the displayed or to-be-displayed object can be established, in particular the object's position and / or orientation. For example, the object can only be displayed after this relationship has been determined. The object could be, for instance, a die. The object's position and orientation can be determined such that the user, in a seated position, sees the die from the front. If the user moves or swivels their head left, right, forward, and / or backward, a changed second head position can be determined through live tracking or re-recording by the camera sensors 120. Based on this second head position, the object's position and / or orientation can be adjusted.For example, the user can lean to the left so that the cube is turned to the right, allowing the user to view the cube on its left side.

[0075] Furthermore, the device 100 can include a variety of audio units for outputting audio, in particular three-dimensional audio. Based on the head position, an audio command can be determined by the controller 130, which includes the head position relative to the audio units. The audio units are arranged at different positions in the CAVE to enable a three-dimensional listening experience. By determining the head position, the three-dimensional listening experience can be tailored to the user.

[0076] Fig.Figure 3 schematically shows a computer-implemented method 200 for generating a virtual reality for at least one user. The method 200 can be stored in the form of a computer program, for example, on a memory of the device 100, and be executable by the controller 130. The controller 130 can include one or more processors for this purpose. The method 200 comprises the following steps: - Output 210 of at least one three-dimensional object on an output surface 111 that is at least partially arc-shaped to at least one user; - Recording 220, by means of a plurality of camera sensors 120, of the user at a first time and outputting respective first recording images, wherein the respective camera sensors 120 are arranged at different sensor positions; - Determine 230 a first head position of a user's head relative to the output surface 111 based on the first captured images and a predetermined arrangement of the output surface 111 relative to the multitude of camera sensors; - Determining an output command to output the object based on the determined first head position, wherein the output command includes at least one object orientation of the object relative to the first head position, and - Outputting the object based on the output command.

[0077] Method 200 can be carried out using device 100.

[0078] By means of the proposed device 100 and the proposed method 200, a user can experience and interact with virtual reality without wearing hardware. REFERENCE MARK 100 Device 110 expenditure funds 111 Output area 112 projector 120 camera sensors 130 Control 140 servers 150 door 160 Touch Display 200 computer-implemented methods 210 Output at least one three-dimensional object 220 Capture, using a multitude of camera sensors, of the user at a first time and output each first captured image. 230 Determining an initial head position of the user's head 240 Determining an output command 250 Outputting the object based on the output command

Claims

[1] Device (100) for generating a virtual reality for at least one user, comprising: an output means (110) with an output surface (111) that is at least partially arc-shaped, wherein the output means (110) is designed to output at least one three-dimensional object on the output surface (111) to the at least one user; a plurality of camera sensors (120) for recording the user at a first time and outputting respective first recording images, wherein the respective camera sensors (120) are arranged at different sensor positions; a controller (130) that is trained to: Determining an initial head position of the user's head relative to the output surface (111) based on the initial capture images and a predetermined arrangement of the output surface (111) relative to the plurality of camera sensors (120); Determining an output command to output the object based on the determined first head position, wherein the output command includes at least one object orientation of the object relative to the first head position, wherein the output device (110) is configured to output the object based on the output command, wherein the control (130) is designed to calibrate the output device (110) based on the first head position. [2] Device (100) according to claim 1, wherein the output command further comprises an object position of the object on the output surface (111) relative to the first head position. [3] Device (100) according to claim 1 or 2, wherein the output surface (111) which is at least partially arc-shaped forms a viewing angle of 180 degrees or more, preferably 220 or 240 degrees in a horizontal and / or a vertical viewing axis of the user. [4] Device (100) according to any one of the preceding claims, wherein the multiple camera sensors (120) are designed to capture the user at a second time and output respective second images, wherein the control (130) is further configured to determine a second head position of the user's head relative to the output surface (111) based on the second recording images and the predetermined arrangement of the output surface (111) relative to the plurality of camera sensors (120), wherein the control (130) is further configured to adapt the output command based on the second head position. [5] Device (100) according to any one of the preceding claims, wherein the control (130) is further configured to determine at least one finger position of a finger, at least one hand position of a hand, at least one arm position of an arm, one upper body position of an upper body, at least one leg position of a leg and / or at least one foot position of a foot based on the first and / or second recording images, wherein the control (130) for determining the output command is further configured based on the finger position, hand position, arm position, upper body position, leg position and / or foot position, where the output command further includes the object orientation of the object relative to the hand position, arm position, upper body position, leg position and / or foot position. [6] Device (100) according to any one of the preceding claims, further comprising: at least one microphone sensor designed to record a voice command from the user, wherein the control (130) is further trained to determine the output command based on the recorded voice command. [7] Device (100) according to any one of the preceding claims, wherein the output area (111) is designed to output the object, or wherein the output means (110) comprises at least one projector (112), in particular a laser short-throw projector (112) designed to project the object onto the output surface (111). [8] Device (100) according to claim 7, wherein the output means (110) comprises at least one projector (112), wherein the projector (112) is height-adjustable, in particular electrically extendable, wherein the projector (112) is designed to be remotely controllable. [9] Device (100) according to claim 7 or 8, wherein the output means (110) comprises at least one projector (112), wherein the plurality of camera sensors (120) and the projector (112) are arranged such that the plurality of camera sensors (120) are configured to receive the projector (112) and output the first and / or second recording images, wherein the control (130) is further configured to determine a projector position of the projector (112) based on the first and / or second recording images and to calibrate the projector position. [10] Device (100) according to one of the preceding claims, wherein the plurality of camera sensors (120) comprises at least one infrared-sensitive camera or at least one camera sensor of the plurality of camera sensors (120) is an infrared-sensitive camera. [11] Device (100) according to any one of the preceding claims, wherein the control (130) is further configured to determine a user's facial expression based on the first and / or second captured images, wherein the control (130) is further configured to determine the output command based on the specific facial expression. [12] Device (100) according to any one of the preceding claims, further comprising: a variety of audio units for outputting audio to the user, where the audio units are arranged at different audio positions, wherein the control (130) is further configured to determine an audio command based on the first head position relative to the audio positions, wherein the audio command comprises an arrangement of the plurality of audio units relative to the first head position, the multitude of audio units are designed to output audio based on the audio command. [13] Device (100) according to claim 12 in combination with claim 4, wherein the control (130) is further configured to adapt the audio command based on the second head position. [14] Device (100) according to 12 or 13, where the numerous audio units are height-adjustable, in particular electrically extendable, where the numerous audio units are designed to be remotely controllable. [15] Device (100) according to one of claims 12 to 14 in combination with claim 5, wherein the control (130) for determining the audio command is further configured based on the finger position, hand position, arm position, upper body position, leg position and / or foot position, the audio command further includes the arrangement of the multitude of audio units relative to the finger position, hand position, arm position, upper body position, leg position and / or foot position. [16] Device (100) according to one of claims 12 to 15, wherein the control (130) is configured to calibrate the plurality of audio units based on the first and / or second head position. [17] Device (100) according to one of claims 12 to 16 in combination with claim 11, wherein the control (130) is further configured to determine the audio command based on the determined facial expression. [18] Device (100) according to one of claims 12 to 17 in combination with claim 6, wherein the control (130) is further configured to determine the audio command based on the recorded voice command [19] Device (100) according to any one of the preceding claims, wherein the multitude of camera sensors (120) are height-adjustable, in particular electrically extendable, the large number of camera sensors (120) are designed to be remotely controllable. [20] Device (100) according to any one of the preceding claims, wherein the output area (111) further comprises a floor area and / or a ceiling area which adjoin the arc-shaped section of the output area (111), wherein the floor surface and / or the ceiling surface are, in particular, at least partially planar. [21] Device (100) according to any one of the preceding claims, further comprising: a fragrance device designed to produce a fragrance; a ventilation device designed to generate an airflow and, in particular, to adjust the temperature of the airflow; a seating device for providing a seat for the user; a treadmill; a Playseat; an authentication unit designed to query user authentication for the device; and / or one or more ultrasound units designed to provide haptic feedback. [22] Device (100) according to one of the preceding claims, wherein the device (100) is modular in design and / or modular in design. [23] Device (100) according to any of the preceding claims, wherein the device (100) is a Cave Automatic Virtual Environment, CAVE. [24] Computer-implemented method (200) for creating a virtual reality for at least one user, comprising the steps: Output (210) of at least one three-dimensional object on an output surface (111) of an output device (110) that is at least partially arc-shaped to the at least one user; Recording (220) of the user at a first time by means of a plurality of camera sensors (120) and outputting each first recording images, wherein the respective camera sensors (120) are arranged at different sensor positions; Determining (230) a first head position of a user's head relative to the output surface (111) based on the first captured images and a predetermined arrangement of the output surface (111) relative to the plurality of camera sensors (120); Determining (240) an output command to output the object based on the determined first head position, wherein the output command includes at least one object orientation of the object relative to the first head position, Output (250) the object based on the output command; Calibrating the output device (110) based on the first head position. [25] Computer program product comprising instructions that cause a device (100) according to any one of claims 1 to 23 to perform the method according to claim 24. [26] Computer program product according to claim 25, wherein the computer program product is stored on a computer-readable medium.

Images