Method for operating a virtual reality system and virtual reality system

Abstract

Method for operating a virtual reality system (10), comprising the steps: - detecting a position and head orientation of a person (20) who has put on virtual reality glasses (12) and is located in a detection area (18) by means of a detection device (16); - Displaying a virtual object (24) arranged in a virtual environment (22) by means of the virtual reality glasses (12) from a virtual perspective which is predetermined according to the detected position and head orientation; - Determining, based on the detected position, whether the person (20) has fallen below a predetermined distance from a boundary of the detection area (18); - as long as it is determined that the person (20) has fallen below the predetermined distance: displaying an effect (26, 28) characterising the falling below the predetermined distance by means of the virtual reality glasses (12), wherein the type of display of the effect (26, 28) is predetermined depending on the determined head orientation; wherein - based on the detected head orientation, it is determined whether the head of the person (20) is directed frontally or backwards towards the boundary of the detection area (18) when the predetermined distance is undershot; - when the head is aligned frontally to the boundary by means of the virtual reality glasses (12), only a virtual boundary (28) arranged in the virtual environment (22) in front of the person (20) is displayed as the effect; - when the head is aligned backwards towards the boundary by means of the virtual reality glasses (12), a grid (26) corresponding to the detection area (18) is displayed in the virtual environment (22) as the effect and / or the virtual object (24) is at least partially hidden and / or darkened and / or the virtual environment (22) is at least partially hidden and / or darkened.

Description

[0001] The invention relates to a method for operating a virtual reality system and a virtual reality system.

[0002] A virtual reality system can be used to represent a virtual reality, whereby virtual reality is usually defined as the representation and simultaneous perception of reality in its physical properties in a real-time computer-generated, interactive virtual environment.

[0003] Virtual reality systems can include virtual reality glasses for displaying a virtual environment. Virtual reality glasses are a specific type of head-mounted display, a visual output device worn on the head. They present images on a screen close to the eyes or project them directly onto the retina. Virtual reality glasses also have sensors for detecting head movements. This allows the display of a calculated graphic to be adapted to the movements of the wearer of the virtual reality glasses. Due to the physical proximity, the image areas displayed on head-mounted displays appear considerably larger than those of freestanding screens and, in extreme cases, even cover the user's entire field of vision.Since the respective displays of virtual reality glasses follow all head movements of a wearer through the head position, the wearer gets the feeling of moving directly in an image landscape generated by a computer.

[0004] Such virtual reality systems can have a detection device by means of which a position of a pair of virtual reality glasses arranged in a detection area and / or a person wearing the virtual reality glasses can be detected. Depending on the detected position of the virtual reality glasses and / or the person, the content displayed by the virtual reality glasses can be adapted such that the person wearing the virtual reality glasses can move relative to a virtual object within a displayed virtual environment. Due to technical and / or cost constraints, it may happen that the detection area within which a position of the virtual reality glasses and / or the person can be reliably detected is relatively small compared to the size of the displayed virtual environment.In such a case, the problem can arise that a wearer of the virtual reality glasses moves outside the detection range, within which only reliable position detection of the virtual reality glasses and / or the person wearing the virtual reality glasses is possible. As a result, it can no longer be guaranteed that real changes in the person's position will also be translated into corresponding virtual changes in the virtual environment when displaying the virtual environment.

[0005] GB 2 524 269 A describes a method in which a wearer of virtual reality glasses is notified when they are about to leave a specified area in their real environment. A camera is attached to the virtual reality glasses, which records the real environment. As soon as the wearer of the virtual reality glasses approaches the edge of the specified area, the real environment recorded by the camera is displayed on the virtual reality glasses.

[0006] US 2015 / 0092015 A1 describes a camera-based safety system for users of virtual reality headsets. To prevent users from colliding with real objects while wearing the virtual reality headset, the safety system provides timely warnings, including by swiveling away the respective displays of the headset while it is being worn. As a result, the user can see the real environment.

[0007] It is the object of the present invention to provide a solution by means of which a wearer of virtual reality glasses can be warned in a reliable manner as soon as he is about to leave a detection range of a detection device which serves to detect the position of the wearer and / or the virtual reality glasses.

[0008] This object is achieved by a method for operating a virtual reality system and by a virtual reality system having the features of the independent patent claims. Advantageous embodiments with expedient and non-trivial refinements of the invention are specified in the dependent claims.

[0009] In the method according to the invention for operating a virtual reality system, a detection device continuously detects the position and head orientation of a person wearing virtual reality glasses and located within a detection range of the detection device. Based on the detected position and head orientation, a virtual object arranged in a virtual environment is displayed from a virtual perspective using the virtual reality glasses. Furthermore, based on the continuously detected position, it is determined whether the person has moved below a predetermined distance from a boundary of the detection range.As long as it is determined that the person has fallen below the specified distance, an effect indicating that the specified distance has been exceeded is displayed using the virtual reality glasses, whereby the type of display of the effect is determined depending on the determined head orientation of the person.

[0010] The invention is based on the recognition that in virtual reality applications, in which a user can move freely toward an object displayed in the virtual environment, for example, a virtual vehicle, it can repeatedly happen that the user moves out of the detection zone, within which only reliable position detection of the person is possible using the relevant detection device. Furthermore, the invention is based on the recognition that it makes a difference whether the person moves backward or forward out of the detection zone, for example, since the perspective of the displayed virtual environment is usually also adjusted depending on the head orientation.

[0011] By means of the method according to the invention, it is therefore firstly possible to reliably inform the person who has put on the virtual reality glasses when they are about to leave the detection range of the detection device. Secondly, the head orientation-dependent display of the effect, by means of which the person is indicated that the predetermined distance to the corresponding boundary of the detection range has been exceeded, makes it particularly reliable to indicate that the person is about to leave the detection range of the detection device. Furthermore, the head orientation-dependent manner in which the effect is displayed makes it possible to particularly effectively minimize the disruptive influence on the perception of the displayed virtual environment without excessively reducing the informative nature of the displayed effect.For example, if the person wearing the virtual reality headset moves backward toward the edge of the detection area, they will also move backward away from the displayed virtual object. Typically, the person will be looking at the displayed virtual object, so a different form of displaying the effect is more helpful in warning the person than if the person were walking forward toward the edge of the detection area without looking at the displayed virtual object.

[0012] Furthermore, the invention provides that, based on the detected head orientation, it is determined whether the person's head is directed frontally or backward toward the edge of the detection zone when the specified distance is exceeded. By distinguishing between frontal and backward orientation of the person's head, the display of the identifying effect can be selected with particular precision, so that, on the one hand, the person can be reliably informed that they are about to leave the detection zone, and, on the other hand, the display of the effect adapted to the head orientation can disrupt the person's perception of the displayed virtual environment as little as possible.

[0013] A further advantageous embodiment of the invention provides that a binocular field of view is specified for the person and a frontal orientation is assumed if the boundary of the detection range lies within the binocular field of view, and otherwise a rearward orientation is assumed. The binocular field of view is understood to be the space that can still be seen when fixating on an object with the head held still and without eye movements. For example, the binocular field of view, i.e. the space that can be seen with both eyes simultaneously, can be specified at approximately 220° in the horizontal direction. This corresponds to a typical average value for a person. Since the person has put on the virtual reality glasses, they cannot actually see their real surroundings and therefore cannot see the boundary of the detection range.However, the specified binocular field of view is assigned to the virtual reality glasses, so that, for example, based on the detected orientation of the virtual reality glasses, it is possible to determine both the head orientation and whether the relevant boundary of the detection area would lie within the binocular field of view if the virtual reality glasses were removed. This makes it particularly simple and reliable to determine whether the person's head is oriented frontally or backward toward the boundary of the detection area when the specified distance is exceeded.

[0014] Furthermore, the invention provides that when the head is directed frontally toward the boundary using the virtual reality glasses, only a virtual boundary located in front of the person in the virtual environment is displayed as the effect. For example, a type of virtual barrier or barrier can be displayed that is severely limited in its extent in the virtual environment. This has the least possible impact on the realistic perception of the virtual environment and the virtual object displayed therein, while still reliably informing the person that they are about to leave the detection range of the detection device.

[0015] Furthermore, the invention provides that when the head is oriented backwards towards the boundary using the virtual reality glasses, a grid corresponding to the detection area is displayed as the effect in the virtual environment. If, for example, the person walks backwards towards a boundary of the detection area in reality and has their head pointed straight forward, they would not be able to see the area behind them in the virtual environment. Because in such a case, and also more generally when the head is oriented backwards towards the boundary, a grid corresponding to the detection area is displayed in the virtual environment as an effect, the person is nevertheless reliably informed that they are about to leave the detection area of ​​the detection device.

[0016] Alternatively or additionally, the invention provides that when the head is directed backward toward the boundary using the virtual reality glasses, the virtual object is at least partially hidden and / or obscured. This is because when the head is directed backward toward the boundary, the person will typically be looking at the displayed virtual object. By at least partially hiding and / or obscuring the virtual object in such a case, the person is simply and reliably informed that they are about to leave the detection range of the detection device.

[0017] Alternatively or additionally, the invention provides that when the head is directed backward toward the boundary, the virtual environment is at least partially masked and / or darkened. This approach also provides a particularly simple and reliable way for the person to be notified that they are about to leave the detection range of the detection device.

[0018] According to a further advantageous embodiment of the invention, the virtual perspective from which the virtual object arranged in the virtual environment is displayed is predetermined such that a virtual viewing direction corresponds to the detected head orientation and a virtual observation position corresponds to the detected position of the person. To detect the head orientation and to detect the position of the person, the orientation and positioning of the virtual reality glasses can be continuously detected, for example, using the detection device. A real change in the person's position is therefore preferably converted one-to-one into a corresponding change in position within the displayed virtual environment. Likewise, a real change in the head orientation is converted into a corresponding change in the virtual viewing direction of the displayed virtual object.The person can therefore move virtually and naturally within the displayed virtual environment and examine the displayed virtual object from a variety of virtual viewing directions and virtual observation positions. Furthermore, they are reliably warned as soon as they are in danger of leaving the detection range of the detection device. Even if the detection range is relatively small compared to the size of the displayed virtual environment, the person is not in danger of leaving the detection range, as they are promptly alerted by the display of the head orientation-dependent effect.

[0019] The virtual reality system according to the invention comprises virtual reality glasses and a detection device designed to detect the position and head orientation of a person who has put on the virtual reality glasses and is located within a detection zone. Furthermore, the virtual reality system comprises a control device designed to control the virtual reality glasses to display a virtual object arranged in a virtual environment from a virtual perspective that is predetermined according to the detected position and head orientation. Furthermore, the control device is designed to determine, based on the detected position, whether the person has fallen below a predetermined distance from a boundary of the detection zone.Furthermore, the control device is designed to control the virtual reality glasses to display an effect characterizing the undershoot of the predetermined distance as long as it is determined that the person has undershot the predetermined distance, wherein the type of display of the effect is specified depending on the determined head orientation.The control device is also designed to determine, on the basis of the detected head orientation, whether the person's head is directed frontally or backwards towards the boundary of the detection area when the predetermined distance is undershot; if the head is directed frontally towards the boundary, to use the virtual reality glasses to display exclusively a virtual boundary arranged in front of the person in the virtual environment as the effect; if the head is directed backwards towards the boundary, to display a grid in the virtual environment corresponding to the detection area as the effect and / or to at least partially hide and / or darken the virtual object and / or to at least partially hide and / or darken the virtual environment.Advantageous embodiments of the method according to the invention are to be regarded as advantageous embodiments of the virtual reality system according to the invention, wherein the virtual reality system in particular has means for carrying out the method steps.

[0020] Further advantages, features, and details of the invention will become apparent from the following description of a preferred embodiment and from the drawings. The features and combinations of features mentioned above in the description, as well as the features and combinations of features mentioned below in the description of the figures and / or shown alone in the figures, can be used not only in the respective specified combinations, but also in other combinations or on their own, without departing from the scope of the invention.

[0021] The drawing shows: Fig. 1 a schematic representation of a virtual reality system comprising virtual reality glasses, a control device for controlling the virtual reality glasses and a detection device for detecting the position and for detecting the orientation of the virtual reality glasses; Fig. 2 a perspective view of a schematically illustrated detection area of ​​the detection device, in which a person is arranged who has put on the virtual reality glasses; Fig. 3 a schematic perspective view of a virtual environment displayed by means of the virtual reality glasses, within which a virtual motor vehicle is displayed; Fig. 4 shows a further perspective view of the schematically illustrated virtual environment, wherein a grid identifying the detection area of ​​the detection device is displayed within the virtual environment by means of the virtual reality glasses; and in Fig. 5 a further perspective view of the schematically represented environment, with a virtual boundary being displayed using the virtual reality glasses.

[0022] In the figures, identical or functionally identical elements are provided with the same reference symbols.

[0023] A virtual reality system designated 10 is shown in a schematic representation in Fig. 1. The virtual reality system 10 comprises virtual reality glasses 12, a control device 14 for controlling the virtual reality glasses 12, and a detection device 16 designed to detect a position and orientation of the virtual reality glasses 12.

[0024] In Fig. 2, a detection area 18 of the detection device 16 is shown in a schematic perspective view, wherein a person 20 who has put on the virtual reality glasses 12 is located within the detection area 18. As long as the virtual reality glasses 12 are located within the detection area 18, the detection device 16 can reliably determine the position and orientation of the virtual reality glasses 12. Based on the detected position and orientation data of the virtual reality glasses 12, the control device 14 can determine a position and head orientation of the person 20. As long as the person 20 does not move away from the detection area 18 and thus the virtual reality glasses 12 are located within the detection area 18, changes in the position of the person 20 and changes in the head orientation of the person 20 can be reliably detected or recorded by means of the detection device 16 in combination with the control device 14.be determined.

[0025] In Fig. 3 shows a schematic perspective view of a virtual environment 22 within which a virtual motor vehicle 24 is arranged. The virtual environment 22, together with the virtual motor vehicle 24, is displayed by means of the virtual reality glasses 12. The virtual motor vehicle 24 is displayed by means of the virtual reality glasses 12 from a virtual perspective, which is predetermined according to the detected position and head orientation of the person 20. The person 20 is in Fig. 3 is shown only for illustrative purposes in order to clarify the virtual perspective from which the virtual motor vehicle 24 is currently displayed by means of the virtual reality glasses 12. The virtual perspective from which the virtual motor vehicle 24 arranged in the virtual environment 22 is displayed is predetermined in such a way that a virtual viewing direction corresponds to the detected head orientation and a virtual observation position corresponds to the detected position of the person 20. If the person 20 turns their head, the virtual reality glasses 12 are controlled accordingly, so that the person 20 changes their virtual head orientation within the virtual environment 22 and thus also their virtual viewing direction of the virtual motor vehicle 24.If the person 20 moves in reality, the person 20 also moves accordingly within the virtual environment 22, so that, for example, the person virtually increases or decreases their distance from the virtual motor vehicle 24.

[0026] As through the two Fig. 2 and Fig. As indicated in Figure 3, the virtual environment 22 is significantly larger than the detection range 18, within which a reliable detection of the position and orientation of the virtual reality glasses 12 and thus also a reliable determination of the head orientation and position of the person 20 can be determined. As a result, the person 20 may be at risk of inadvertently leaving the detection range 18, for example, if the person 20 wishes to increase their virtual distance from the virtual motor vehicle 24. However, as soon as the person 20 leaves the detection range 18, it can no longer be reliably ensured that changes in position and changes in the head orientation of the person 20 are implemented one-to-one within the virtual environment 22.

[0027] In Fig. 4, the virtual environment 22 together with the virtual motor vehicle 24 is shown in a further schematic perspective view. Based on the continuously determined position of the person 20, the control device 14 determines whether the person 20 has fallen below a predetermined distance from a boundary of the detection area 18. In a Fig. 2, the respective boundaries of the detection area 18 are defined by the four side walls and a kind of ceiling. Since leaving the detection area 18 upwards is rather unlikely, it may also be sufficient to continuously check whether the person 20 has left the detection area 18 horizontally.

[0028] As soon as it is determined that person 20 has fallen below the specified distance from one of the boundaries of the detection area 18, an effect characterizing the falling below the specified distance is displayed using the virtual reality glasses 12. The type of display of this effect is selected depending on the determined head orientation of person 20. Based on the detected head orientation of person 20, it is determined whether the head of person 20 is oriented frontally or backwards towards the corresponding boundary of the detection area 18 when the specified distance to the respective boundary is fallen below. For this purpose, for example, a binocular field of view can be specified for person 20, whereby a frontal orientation is assumed if the respective boundary of the detection area 18 lies in the binocular field of view of person 20 and otherwise a backward orientation of the head of person 20 is assumed.

[0029] In Fig. 4 now shows the case that the person 20 - according to the representation in Fig. 2 - threatens to step backwards to the left out of the detection area 18 because the person 20 is currently moving backwards. Due to the head orientation of the person 20, the virtual motor vehicle 24 is thus shown in a frontal view by means of the virtual reality glasses 12, whereby the person 20 virtually moves further and further away from the virtual motor vehicle 24 due to their actual backward movement. If the person 20 approaches the left boundary of the detection area 18 too closely in reality, a grid 26 corresponding to the actual detection area 18 is displayed within the virtual environment 22 as an effect to alert the person 20 that they are about to leave the detection area 18. The grid 26 is selected to be the same size as the actual detection area 18.By displaying the grid 26, the person 20 within the virtual environment 22 can easily recognize that he or she is about to step backward out of the detection area 18.

[0030] Alternatively or additionally, if the head of the person 20 is directed backwards towards the relevant boundary of the detection zone 18, it can also be provided that the virtual motor vehicle 24 is at least partially hidden and / or darkened by means of the virtual reality glasses 12. If the person 20 is moving backwards towards one of the boundaries of the detection zone 18 and has pointed their head more or less straight ahead, they continue to look at the virtual motor vehicle 24 within the virtual environment 22. By at least partially hiding and / or darkening the virtual motor vehicle 24 when the predetermined distance to the relevant boundary of the detection zone 18 is undershot, the person 20 is easily encouraged not to leave the detection zone 18.Alternatively or additionally, it can also be provided that in such a case, the virtual environment 22, which may be, for example, a type of virtual showroom or the like, is at least partially hidden and / or darkened. This also reliably alerts the person 20 that they are about to back out of the detection area 18.

[0031] In Fig. 5, the virtual environment 22 together with the virtual motor vehicle 24 is shown in a further perspective view. In the present case, the person 20 is just about to enter the detection area 18 - again based on the representation in Fig.2 - walking forward to the left. Since the person 20 has their head pointed straight ahead, they are looking away from the virtual motor vehicle 24 within the virtual environment 22. Should the person 20 fall below the specified distance to the relevant boundary of the detection area 18, a virtual boundary 28 arranged in the virtual environment 22 in front of the person 20 is displayed by means of the virtual reality glasses 12 due to the frontal orientation of the person 20's head relative to the boundary of the detection area 18, in order to alert the person 20 that they are about to step out of the detection area 18. In this case, a very limited local effect is displayed within the virtual environment 22 in order to alert the person 20 that they are about to leave the detection area 18.Because of their actual head orientation and the resulting virtual viewing direction, it is sufficient to display the relatively small boundary 28 within the virtual environment 22 to alert the person 20 that they are about to leave the detection area 18. Due to the frontal head orientation, the boundary 28 also has a directional character for the person 20. The person 20 realizes that they are currently heading head-on toward one of the boundaries of the detection area 18, with the boundary 28 indicating the approaching boundary of the detection area 18 within the displayed virtual environment 22.

[0032] By displaying a corresponding effect dependent on the head orientation, by means of which the person 20 is informed that he or she is about to leave the detection area 18, it is possible, on the one hand, to relatively effectively prevent the person 20 from actually leaving the detection area 18 and, on the other hand, to impair the perception of the displayed virtual environment 22 as little as possible.

Claims

[1] Method for operating a virtual reality system (10), comprising the steps: - detecting a position and head orientation of a person (20) who has put on virtual reality glasses (12) and is located in a detection area (18) by means of a detection device (16); - Displaying a virtual object (24) arranged in a virtual environment (22) by means of the virtual reality glasses (12) from a virtual perspective which is predetermined according to the detected position and head orientation; - Determining, based on the detected position, whether the person (20) has fallen below a predetermined distance from a boundary of the detection area (18); - as long as it is determined that the person (20) has fallen below the predetermined distance: displaying an effect (26, 28) characterising the falling below the predetermined distance by means of the virtual reality glasses (12), wherein the type of display of the effect (26, 28) is predetermined depending on the determined head orientation; wherein - based on the detected head orientation, it is determined whether the head of the person (20) is directed frontally or backwards towards the boundary of the detection area (18) when the predetermined distance is undershot; - when the head is aligned frontally to the boundary by means of the virtual reality glasses (12), only a virtual boundary (28) arranged in the virtual environment (22) in front of the person (20) is displayed as the effect; - when the head is aligned backwards towards the boundary by means of the virtual reality glasses (12), a grid (26) corresponding to the detection area (18) is displayed in the virtual environment (22) as the effect and / or the virtual object (24) is at least partially hidden and / or darkened and / or the virtual environment (22) is at least partially hidden and / or darkened. [2] Method according to claim 1, characterized by that a binocular field of view is specified for the person (20) and a frontal orientation is assumed if the boundary of the detection area (18) lies in the binocular field of view and otherwise a rearward orientation is assumed. [3] Method according to one of the preceding claims, characterized bythat the virtual perspective from which the virtual object (24) arranged in the virtual environment (22) is displayed is predetermined in such a way that a virtual viewing direction corresponds to the detected head orientation and a virtual observation position corresponds to the detected position of the person (20). [4] Virtual reality system (10), with - virtual reality glasses (12); - a detection device (16) which is designed to detect a position and head orientation of a person (20) who has put on the virtual reality glasses (12) and is located in a detection area (18); - a control device (14) which is designed to . to control the virtual reality glasses (12) to display a virtual object (24) arranged in a virtual environment (22) from a virtual perspective which is predetermined according to the detected position and head orientation; . to determine, based on the detected position, whether the person (20) has fallen below a predetermined distance from a boundary of the detection area (16); - to control the virtual reality glasses (12) to display an effect (26, 28) characterising the undershoot of the predetermined distance as long as it is determined that the person (20) has undershot the predetermined distance, wherein the type of display of the effect (26, 28) is predetermined depending on the determined head orientation; . to determine, based on the detected head orientation, whether the head of the person (20) is directed frontally or backwards towards the boundary of the detection area (18) when the predetermined distance is exceeded; . when the head is aligned frontally to the boundary by means of the virtual reality glasses (12), to display exclusively a virtual boundary (28) arranged in the virtual environment (22) in front of the person (20) as the effect; . when the head is aligned backwards towards the boundary, using the virtual reality glasses (12) to display a grid (26) corresponding to the detection area (18) in the virtual environment (22) as the effect and / or to at least partially hide and / or darken the virtual object (24) and / or to at least partially hide and / or darken the virtual environment (22).

Images