Methods for operating a virtual reality system and virtual reality system

Abstract

Method for operating a virtual reality system (10), comprising the steps: - Assigning a real walking area (22) to a virtual sub-area (40) which is arranged within a virtual walking area (28); - Detecting the position (30) of a person (20) positioned on the real walking area (22) who is wearing virtual reality glasses (12), using a detection device (16); - Assigning the captured viewpoint (30) of the person (20) to a virtual viewpoint (42) on the virtual sub-area (40); - Displaying a virtual object (26) from the virtual viewpoint (42) using the virtual reality glasses (12); - as soon as it has been detected that the position (30) of the person (20) lies on a given boundary surface (32, 34, 36, 38) of the real walking surface (22) and a given trigger criterion is met: Shifting of the virtual sub-area (40) relative to the virtual walking surface (28), whereby the virtual position (42) relative to the virtual sub-area (40) is kept unchanged during the shift; - Displaying the virtual object (26) using the virtual reality glasses (12) from the virtual viewpoint (42) after the virtual sub-area (40) has been moved relative to the virtual walk-through area (28), - characterized by the fact that - the shift occurs abruptly and the virtual reality glasses (12) are controlled for the shift in such a way that a virtual environment (24) is briefly hidden and then shown again after the abrupt shift has occurred.

Description

[0001] The invention relates to a method for operating a virtual reality system and a virtual reality system.

[0002] A virtual reality system can be used to represent a virtual reality, whereby virtual reality is usually defined as the representation and simultaneous perception of reality in its physical properties in a real-time computer-generated, interactive virtual environment.

[0003] Virtual reality systems can include virtual reality glasses for displaying a virtual environment. Virtual reality glasses are a specific type of head-mounted display, a visual output device worn on the head. They present images on a screen close to the eyes or project them directly onto the retina. Virtual reality glasses also have sensors for tracking head movements. This allows the display of rendered graphics to adapt to the wearer's movements. Due to the close proximity, the displayed image areas of head-mounted displays appear significantly larger than those of freestanding screens and, in extreme cases, can even cover the user's entire field of vision.Because the displays of virtual reality glasses follow all head movements of the wearer, he gets the feeling of moving directly in a computer-generated landscape.

[0004] Such virtual reality systems can include a detection device that can record the position of a virtual reality headset and / or a person wearing it, located within a detection area. Depending on the detected position of the headset and / or the person, the content displayed by the headset can be adjusted so that the person wearing the headset can move within a displayed virtual environment relative to a virtual object. Due to technical and / or cost constraints, the detection area within which the position of the headset and / or the person can be recorded may be relatively small.This can lead to the problem that a wearer of virtual reality glasses can only move virtually within a limited area of ​​the virtual environment and, consequently, cannot arbitrarily change their distance to the virtual object.

[0005] EP 2 048 557 A1 discloses an optoelectronic sensor for monitoring a room area. Using electronic data glasses, the room area to be monitored can be displayed from a selectable perspective.

[0006] US Patent 2001 / 0045978A1 discloses a head-mounted display device. A camera is mounted on a remote-controlled toy vehicle, and a video signal provided by the camera is transmitted to and displayed on the head-mounted display device. Multiple cameras can also be mounted on different toy vehicles, and a person wearing the display device can switch between the different cameras to view different images from the respective vehicle perspectives.

[0007] US patent 2008 / 0 198 230 A1 describes an observation system for sporting events. Using electronic data glasses, a person can display information about a sporting event. For example, a person can watch a car race and use the electronic data glasses to display information about the participating vehicles, such as lap times, current speeds, and the like.

[0008] Furthermore, the publication Gabriel Cirio et al, “The magic barrier Tape”, Proceedings of the 16th ACM Symposium on Virtual Reality Software and Technology, Kyoto, Japan (2009) describes a new interaction metaphor for navigation in a potentially infinite virtual scene with a limited range of motion, and the publication US 2015 / 070 263 A1 describes dynamic displays based on user interaction states.

[0009] The object of the present invention is to provide a solution by which a wearer of virtual reality glasses is enabled to change his virtual distance to a virtual object within a virtual environment essentially arbitrarily, independent of the size of a detection area of ​​a detection device by which the position of the virtual reality glasses and / or the wearer of the virtual reality glasses can be detected.

[0010] This problem is solved by a method for operating a virtual reality system and by a virtual reality system with the features of the independent claims. Advantageous embodiments with expedient and non-trivial further developments of the invention are specified in the dependent claims.

[0011] In the inventive method for operating a virtual reality system, a real walking area is assigned to a virtual sub-area located within that virtual walking area. The position of a person positioned on the real walking area, wearing virtual reality glasses, is detected. This position is captured by a detection device. The detected position of the person is then assigned to a virtual position on the virtual sub-area. A virtual object is then displayed from this virtual position using the virtual reality glasses.Once it has been detected that the person's position lies on a predefined boundary of the real-world walking area and a predefined trigger criterion is met, the virtual sub-area is shifted relative to the virtual walking area, while the virtual position relative to the virtual sub-area remains unchanged during the shift. After the virtual sub-area has been shifted relative to the virtual walking area, the virtual object is displayed from the virtual position using the virtual reality headset. Furthermore, the shift occurs abruptly, and the virtual reality headset is controlled in such a way that a virtual environment is briefly hidden and then redisplayed after the abrupt shift.

[0012] Determining the current position of the person wearing the virtual reality headset can be achieved, for example, by continuously tracking the headset's position using a detection device. Alternatively or additionally, the detection device could also include a camera system that records the person's position and any changes in it.

[0013] The invention provides for the continuous detection of the position of the person wearing the virtual reality glasses by means of the detection device. A real change in the person's position causes the virtual position on the virtual sub-area to change accordingly. As a result, the virtual perspective of the virtual object displayed by the virtual reality glasses also changes. As soon as it is detected that the person wearing the virtual reality glasses has moved onto the aforementioned predefined edge of the real walking surface and the predefined trigger criterion is met, the virtual sub-area is shifted relative to the virtual walking surface. The virtual position itself does not change relative to the virtual sub-area.However, due to the relative displacement of the virtual sub-area relative to the virtual walking surface, the relative positioning of the virtual standpoint relative to the virtual walking surface changes. This can be visualized as if, for example, a pin were attached to a carpet, and then the carpet, along with the attached pin, were moved across a tiled floor. The positioning of the pin relative to the carpet does not change, but the relative position of the pin to the floor does change, since the carpet is being moved relative to the floor. The method according to the invention proceeds analogously once it has been detected that the person's standpoint lies on the predetermined edge of the real walking surface and the predetermined trigger criterion is met.

[0014] If the person wearing the virtual reality headset moves within the real-world area in such a way that further movement would cause them to leave the real-world area, the virtual area can be shifted relative to the virtual area. As a result, the virtual observation position from which the virtual object is displayed changes accordingly. Despite the limited real-world area, this allows the person wearing the virtual reality headset to essentially change their virtual distance to the virtual object at will.

[0015] An advantageous embodiment of the invention provides that the virtual sub-area is shifted relative to the virtual walk-through area in such a way that the distance between the virtual viewpoint and the virtual object increases. In other words, it is preferably provided that when the virtual sub-area is shifted relative to the virtual walk-through area, the virtual distance of the person wearing the virtual reality glasses to the displayed virtual object increases. For this to occur, the person simply needs to enter the predefined boundary area, and the predefined trigger criterion must be met. Then, without actually moving, the person can change their virtual observation position with respect to the displayed virtual object.Furthermore, it is also possible that the virtual sub-area is shifted relative to the virtual walking area in such a way that the distance between the virtual viewpoint and the virtual object decreases.

[0016] Another advantageous embodiment of the invention provides that the virtual sub-area is shifted relative to the virtual walking surface by a distance corresponding to the length or width of the real walking surface. In other words, it is preferably provided that the virtual sub-area is shifted relative to the virtual walking surface by the same amount as the real walking surface is, for example, long or wide. This allows the virtual distance to the displayed virtual object to be increased significantly without the person having to move.

[0017] According to a further advantageous embodiment of the invention, the trigger criterion is that the person has remained on the edge surface for a predetermined duration after entering it. In this context, it may be provided, for example, that a countdown timer is displayed using the virtual reality glasses, indicating how long the person must remain on the edge surface after entering it until the aforementioned relative displacement and thus the change in the virtual observation position occurs.

[0018] According to a further advantageous embodiment of the invention, the trigger criterion is defined as the activation of a predetermined control element, preferably in a remote control, while the person is positioned on the edge surface. For example, the person can hold a remote control and activate the control element, thereby initiating the virtual displacement. This allows the person to easily determine and control whether and when the relative displacement between the virtual sub-area and the walking surface should occur.

[0019] Another advantageous embodiment of the invention provides that a virtual edge area corresponding to the edge area is displayed on the virtual sub-surface by means of the virtual reality glasses. This is because the person's field of vision of the real environment is usually blocked by the virtual reality glasses. By displaying the virtual edge area on the virtual sub-surface, the person can nevertheless easily and intuitively recognize in which direction they need to move if they wish to achieve the aforementioned relative displacement of the virtual sub-surface relative to the virtual walking surface.

[0020] In a further advantageous embodiment of the invention, the virtual sub-area is also shifted relative to the virtual walkable area as soon as it is detected that the person has directed their gaze toward the virtual edge area and performed a predefined operating action. In this context, it may be provided, for example, that a marker indicating the person's direction of gaze, such as a crosshair or the like, is displayed by means of the virtual reality glasses. Thus, the person can recognize in a particularly simple way whether they are currently directing their gaze toward the virtual edge area.The person can therefore, even without moving onto the real edge area, simply by focusing their gaze on the displayed virtual edge area in combination with the specified operating action, cause the relative displacement of the virtual sub-area to the virtual walking area to occur.

[0021] According to a further advantageous embodiment of the invention, the dimensions of the virtual sub-area are specified to be exactly the same as the dimensions of the real walking area. This makes it particularly easy and intuitive for the person wearing the virtual reality glasses to move virtually around the displayed virtual object, especially without leaving the real walking area and thus the detection range of the detection device.

[0022] Furthermore, another advantageous embodiment of the invention provides that a detected change in the person's position relative to the real walking surface, with respect to a direction of movement and a distance traveled, leads to the same change in the virtual position relative to the virtual sub-area. In other words, it is preferably provided that real positional changes of the person lead one-to-one to corresponding virtual positional changes with respect to the virtual sub-area.

[0023] The virtual reality system according to the invention comprises virtual reality glasses, a detection device, and a control device, which are designed to carry out the method according to the invention or an advantageous embodiment thereof. Advantageous embodiments of the method according to the invention are to be regarded as advantageous embodiments of the virtual reality system according to the invention, wherein the virtual reality system in particular includes means for carrying out the method steps.

[0024] Further advantages, features, and details of the invention will become apparent from the following description of a preferred embodiment and from the drawing. The features and combinations of features mentioned above in the description, as well as those subsequently mentioned in the figure description and / or shown in the figures alone, can be used not only in the combinations specified, but also in other combinations or individually, without departing from the scope of the invention.

[0025] The drawing shows in: Fig. 1 a schematic representation of a virtual reality system comprising a virtual reality headset for displaying a virtual environment, a detection device for detecting the position of the virtual reality headset and a control device for controlling the virtual reality headset; Fig. 2 a schematic representation of a recording space with a walking area on which a person is positioned who has put on the virtual reality glasses; Fig. 3 a schematic representation of the virtual environment within which a virtual motor vehicle is arranged, which is displayed using virtual reality glasses; Fig. 4 a schematic representation in which an assignment between the real walking area of ​​the recording space and a virtual sub-area of ​​a virtual walking area of ​​the virtual environment is indicated; Fig. 5 another schematic representation showing the mapping between the real walking area and the virtual sub-area, where the virtual sub-area has just been shifted relative to the virtual walking area; Fig. 6. Another schematic representation showing an assignment between the real walking area and the virtual sub-area, where the virtual sub-area is oriented in a different direction relative to the virtual walking area than in Fig. 5 shown has been postponed; and in Fig. 7 a schematic representation of the virtual walk-on area and the virtual sub-area, wherein four virtual boundary areas are marked within the virtual sub-area.

[0026] In the figures, identical or functionally equivalent elements are given the same reference symbols.

[0027] A virtual reality system 10 is shown in a schematic representation in Fig. Figure 1 shows the virtual reality system 10, which comprises virtual reality glasses 12, a control unit 14, and a detection unit 16. The virtual reality glasses 12 are designed to display at least one virtual object within a virtual environment. For example, the virtual reality glasses 12 can be used to display a virtual motor vehicle located in a virtual showroom. The control unit 14 is designed to control the virtual reality glasses 12, among other things, based on signals provided by the detection unit 16. The detection unit 16 is designed to detect the position and thus also any changes in the position of the virtual reality glasses 12.The detection device 16 is designed to additionally detect the position of a person who is wearing the virtual reality glasses 12; alternatively, it is also possible for the detection device 16 to determine the position of the person who is wearing the virtual reality glasses 12 based on the determined position of the virtual reality glasses 12.

[0028] In Fig. Figure 2 schematically represents a detection space 18. A person 20, wearing virtual reality glasses 12, is located within the detection space 18 and can move around on a real walking surface 22. As long as the virtual reality glasses 12 remain within the detection space 18, the detection device 16 can reliably determine the position of the virtual reality glasses 12 and thus also the position of the person 20. x1 and y1 are the respective axes of a fixed coordinate system, where "fixed" means that the two coordinate axes x1 and y1 are fixed with respect to the detection space 18 and therefore also fixed with respect to the real walking surface 22.

[0029] In Fig. Figure 3 schematically shows a virtual environment 24, which is displayed using virtual reality glasses 12. The virtual reality glasses 12 display a virtual motor vehicle 26, which is located within the virtual environment 24. Person 20 is shown in this illustration only for illustrative purposes, to indicate a virtual observation position from which person 20 sees the virtual environment 24 and thus the virtual motor vehicle 26 through the virtual reality glasses 12. Person 20 can move virtually on a virtual walking surface 28 within the virtual environment 24.

[0030] A real change in position of person 20 on the real walking surface 22 causes a corresponding virtual change in position of person 20 within the virtual environment 24, i.e. also with respect to the virtual walking surface 28.

[0031] As through the two Fig. 2 and Fig. As indicated in Figure 3, the virtual walking area 28 is significantly larger than the real walking area 22, which the person 20 should not leave in order to enable reliable position tracking of the person 20 and the virtual reality glasses 12.

[0032] In Fig. Figure 4 shows the real walking area 22 and the virtual walking area 28 side by side in a schematic top view. A viewpoint 30 of person 20, i.e., their position, on the real walking area 22 is marked. Furthermore, the real walking area 22 has several boundary areas 32, 34, 36, 38.

[0033] Within the virtual walking area 28, a virtual sub-area 40 is marked. The configuration shown here can be a kind of default setting, in which the control unit 14 assigns the real walking area 22 to the virtual sub-area 40, which is located within the virtual walking area 28. In this default setting, the virtual sub-area 40 may be positioned centrally to the virtual walking area 24. Within the virtual sub-area 40, a virtual viewpoint 42 is marked, from which the person 20 can see the virtual vehicle 26 and the rest of the virtual environment 24 through the virtual reality glasses 12. The coordinate axes x2 and y2 denote a fixed coordinate system relative to the virtual sub-area 40.

[0034] If the real position 30 of person 20 changes, the virtual position 42 also changes automatically with respect to the virtual sub-area 40. The dimensions of the real walking area 22 and the dimensions of the virtual sub-area 40 correspond to each other. Person 20 cannot move virtually out of the virtual sub-area 40, as this would cause them to leave the real walking area 22 and thus the detection space 18. Consequently, the detection device 16 would no longer be able to reliably detect the position of the virtual reality glasses 12 and therefore the position of person 20. Therefore, the control device 16 is designed to be able to move the virtual sub-area 40 relative to the virtual walking area 28. The coordinate axes x3 and y3 denote a further coordinate system that is fixed in position relative to the virtual walking area 28.

[0035] In Fig. Figure 5 schematically illustrates this relative displacement of the virtual sub-area 40 with respect to the virtual walking surface 28. As can be seen, person 20 has moved their position to the upper edge area 32. If person 20 remains standing on the edge area 32 for a predetermined duration, for example, a few seconds, the virtual sub-area 40 is displaced in the direction of axis y3 relative to the virtual walking surface 24. The virtual sub-area 40 can be displaced relative to the virtual walking surface 28, for example, by the distance that the real walking surface 22 extends in the direction of axis y1. As can be seen, however, the relative positioning of the virtual standpoint 42 with respect to the virtual sub-area 40 does not change. However, the virtual distance between the virtual standpoint 42 and the virtual vehicle 26 changes due to the relative displacement of the virtual sub-area 40.

[0036] If person 20 moves in such a way that they reach the edge area 32 of the real walking area 22 and remains there long enough, their virtual observation position relative to the virtual vehicle 26 changes without person 20 having to move accordingly in reality. This shift can preferably occur abruptly. For example, the virtual reality glasses 12 are controlled in such a way that they briefly hide the virtual environment 24 and then show it again after the abrupt relative shift has taken place. After the relative shift, person 20 can view the virtual vehicle 26 from a greater distance. Even with relatively small dimensions of the real walking area 22, person 20 can thus explore the virtual environment 24 extensively without leaving the detection range of the detection device 16.

[0037] In Fig. Figure 6 shows another virtual relative displacement of the virtual sub-area 40. In the example shown, person 20 has moved to the edge area 34, so that their real standpoint 30 is located on the edge area 34. If person 20 remains on this edge area 34 long enough, the virtual sub-area 40 is again displaced relative to the virtual walking surface 28. In this case, the virtual sub-area 40 is displaced to the right, i.e., in the direction of axis x3, because person 20 has moved to the rightmost edge area 34. Again, the virtual sub-area 40 is displaced relative to the virtual walking surface 28 such that the virtual observation position, which corresponds to the virtual standpoint 42, is moved away from the virtual vehicle 26. In the example shown, person 20 is therefore virtually standing relatively far to the right of the virtual vehicle 26.

[0038] The direction of the relative displacement of the virtual sub-area 40 to the real walking area 28 therefore depends on which of the boundary areas 32, 34, 36, 38 the person 20 has moved onto. In general, the direction of the relative displacement depends on how the respective boundary area 32, 34, 36, 38 is positioned relative to a center point of the real walking area 22. The direction of the relative displacement of the virtual sub-area 40 to the virtual walking area 40 thus corresponds to the relative positioning of the respective boundary area 32, 34, 36, 38 to the center point of the real walking area 22. If the person is standing to the right of the center point, i.e., on boundary area 34, the virtual sub-area 40 is virtually displaced to the right. If the person is standing to the left of the center point, i.e., on boundary area 36, ​​the virtual sub-area 40 is virtually displaced to the left. The same applies to positioning on the edge areas 32, 38.

[0039] If person 20 moves in the opposite direction to x1, person 20 virtually approaches the virtual vehicle 26 again. As soon as the person has moved to the far left edge surface 38 of the real walking surface 22 and remains there long enough, the virtual sub-surface 40 is shifted in the opposite direction to the axis x3, as a result of which person 20 is virtually to the left of the virtual vehicle 26.

[0040] In Fig.Figure 7 shows the virtual walking area 28 in a further schematic representation. Here, the virtual sub-area 40 is again positioned centrally within the virtual walking area 24. As can be seen from the marking of the virtual viewpoint 42, the person 20 is indeed located within the real walking area 22, but not on any of the outer edge areas 32, 34, 36, 38. Using the virtual reality glasses 12, virtual edge areas 44, 46, 48, 50 corresponding to the real edge areas 32, 34, 36, 38 are displayed. The person 20, who is wearing the virtual reality glasses 12, is thus shown in the displayed virtual environment 24 where they must go to effect the aforementioned virtual relative displacement of the virtual sub-area 40 to the virtual walking area 28.Furthermore, it can also be provided that the virtual sub-area 28 is shifted relative to the virtual walking area 28 in the manner described, as soon as it is detected that person 20 has directed their gaze towards one of the virtual edge areas 44, 46, 48, 50 and has performed a predefined operating action, for example by pressing a button on a remote control, performing a predefined gesture, executing a predefined voice command, or the like. Person 20 can thus control these virtual position jumps due to the relative shift of the virtual sub-area 40 depending on their direction of gaze, without having to stand on the real edge areas 32, 34, 36, 38.

Claims

[1] Method for operating a virtual reality system (10), comprising the steps: - Assigning a real walking area (22) to a virtual sub-area (40) which is arranged within a virtual walking area (28); - Detecting the position (30) of a person (20) positioned on the real walking area (22) who is wearing virtual reality glasses (12), using a detection device (16); - Assigning the captured viewpoint (30) of the person (20) to a virtual viewpoint (42) on the virtual sub-area (40); - Displaying a virtual object (26) from the virtual viewpoint (42) using the virtual reality glasses (12); - as soon as it has been detected that the position (30) of the person (20) lies on a given boundary surface (32, 34, 36, 38) of the real walking surface (22) and a given trigger criterion is met: Shifting of the virtual sub-area (40) relative to the virtual walking surface (28), whereby the virtual position (42) relative to the virtual sub-area (40) is kept unchanged during the shift; - Displaying the virtual object (26) using the virtual reality glasses (12) from the virtual viewpoint (42) after the virtual sub-area (40) has been moved relative to the virtual walk-through area (28), - characterized by , that - the shift occurs abruptly and the virtual reality glasses (12) are controlled for the shift in such a way that a virtual environment (24) is briefly hidden and then shown again after the abrupt shift has occurred. [2] Method according to claim 1, characterized by , that the virtual sub-area (40) is shifted relative to the virtual walking area (28) in such a way that the distance between the virtual standpoint (42) and the virtual object (26) increases. [3] Method according to claim 1 or 2, characterized by , that the virtual sub-area (40) is shifted relative to the virtual walking area (28) by a distance which corresponds to the length or width of the real walking area (22). [4] Method according to any one of the preceding claims, characterized by , that the trigger criterion is specified as the person (20) remaining on the edge area (32, 34, 36, 38) for a specified duration after entering the edge area (32, 34, 36, 38). [5] Method according to any one of the preceding claims, characterized by, that the trigger criterion is specified as that a specified control element, preferably by a remote control, has been actuated while the person (20) is positioned on the edge surface (32, 34, 36, 38). [6] Method according to any one of the preceding claims, characterized by , that by means of the virtual reality glasses (12) a virtual border area (44, 46, 48, 50) corresponding to the border area (32, 34, 36, 38) is displayed on the virtual sub-area (40). [7] Method according to claim 6, characterized by , that the virtual sub-area (40) is also moved relative to the virtual walking area (28) as soon as it is detected that the person (20) has directed their gaze towards the virtual edge area (44, 46, 48, 50) and has performed a predefined operating action. [8] Method according to any one of the preceding claims, characterized by, that the dimensions of the virtual sub-area (40) are specified to be exactly the same size as the dimensions of the real walking area (22). [9] Method according to any one of the preceding claims, characterized by , that a detected change in the position (30) of the person (20) relative to the real walking area (22) with respect to a direction of movement and a distance traveled leads to the same change in the virtual position (42) relative to the virtual sub-area (40). [10] Virtual reality system (10), comprising a virtual reality headset (12), a detection device (16) and a control device (14), which are designed to perform a method according to any of the preceding claims.

Images