Methods for operating a virtual reality system and virtual reality system

Abstract

Method for operating a virtual reality system (10), comprising the steps: - Displaying a virtual object (24) arranged in a virtual environment (26) using virtual reality glasses (12); - Moving a selection symbol (28) displayed by means of the virtual reality glasses (12) according to a detected change in the orientation of the virtual reality glasses (12) and / or a detected change in the viewing direction of a wearer (20) of the virtual reality glasses (12); characterized by the steps: - Displaying a configuration menu (34) comprising several equipment options (36) for a function group of the displayed virtual object (24) using the virtual reality glasses (12), if the selection symbol (28) is in overlap with at least one component (30) of the function group (34); - Moving the selection symbol (28) within the displayed configuration menu (34) according to a detected change in the orientation of the virtual reality glasses (12) and / or a detected change in the viewing direction of the wearer (20) of the virtual reality glasses (12); - Selecting one of the displayed equipment options (36), if the selection symbol (28) is at least partially overlapping with the relevant equipment option (36), and changing the display of the virtual object (24) according to the selection made, - wherein the configuration menu (34) is displayed in such a way that the virtual distance between the configuration menu (34) and a virtual observation position of the wearer (20) of the virtual reality glasses (12) is chosen to be smaller the smaller the distance between the virtual observation position and the component (30) is.

Description

[0001] The invention relates to a method for operating a virtual reality system and a virtual reality system.

[0002] A virtual reality system can be used to represent a virtual reality, whereby virtual reality is usually defined as the representation and simultaneous perception of reality in its physical properties in a real-time computer-generated, interactive virtual environment.

[0003] Virtual reality systems can include virtual reality glasses for displaying a virtual environment. Virtual reality glasses are a specific type of head-mounted display, a visual output device worn on the head. They present images on a screen close to the eyes or project them directly onto the retina. Virtual reality glasses also have sensors for detecting head movements. This allows the display of a calculated graphic to be adapted to the movements of the wearer of the virtual reality glasses. Due to the physical proximity, the image areas displayed on head-mounted displays appear considerably larger than those of freestanding screens and, in extreme cases, even cover the user's entire field of vision.Since the respective displays of virtual reality glasses follow all head movements of a wearer through the head position, the wearer gets the feeling of moving directly in an image landscape generated by a computer.

[0004] Modern motor vehicles in particular often have a multitude of different equipment options, which can make customer-specific configuration very complex and difficult.

[0005] US Patent No. 9,035,878 B1 describes a method for operating electronic data glasses. The data glasses display a cursor that is controlled based on the wearer's eye movements, as detected by the data glasses. As soon as the cursor is moved into an activation region surrounding an object displayed by the data glasses, such as an icon, an options menu is displayed. Various options related to the object can be selected using the cursor. For example, the object can be copied, deleted, or printed.

[0006] US 2004 / 0143481 A1 describes a business method for surveying customer preferences regarding motorcycles. A user can participate in a survey via a website that queries customer preferences. The website displays a base model of a motorcycle. A menu with optional extras is also displayed, e.g., selectable fenders, exhaust systems, fairings, etc. The user can move a cursor over the optional extras displayed in the menu and select the desired optional extras to build their dream motorcycle.

[0007] It is the object of the present invention to provide a method for operating a virtual reality system and a virtual reality system by means of which a product can be virtually configured in a particularly simple manner.

[0008] This object is achieved by a method for operating a virtual reality system and by a virtual reality system having the features of the independent patent claims. Advantageous embodiments with expedient and non-trivial refinements of the invention are specified in the dependent claims.

[0009] In the method according to the invention for operating a virtual reality system, a virtual object arranged in a virtual environment is displayed using virtual reality glasses. For example, a virtual motor vehicle is displayed using the virtual reality glasses. A selection symbol displayed using the virtual reality glasses is moved according to a detected change in the orientation of the virtual reality glasses and / or a detected change in the viewing direction of a wearer of the virtual reality glasses. A configuration menu comprising several equipment options for a functional group of the displayed virtual object is displayed using the virtual reality glasses if the selection symbol overlaps with at least one component of the functional group. Different components of the virtual object can be combined to form different functional groups.For example, all of the wheels of a virtual motor vehicle displayed using virtual reality glasses are grouped together into a functional group. As soon as the selection symbol overlaps with one of the wheels of the displayed virtual motor vehicle, a configuration menu can be displayed, for example, which has various rims and / or rim-tire combinations as equipment options. The displayed selection symbol is moved within the displayed configuration menu according to a detected change in the orientation of the virtual reality glasses and / or a detected change in the viewing direction of the wearer of the virtual reality glasses. One of the displayed equipment options is selected if the selection symbol is at least partially overlapped with the equipment option in question, with the representation of the virtual object changing according to the selection made.

[0010] By means of the method according to the invention, it is particularly simple to configure a displayed virtual object, for example a virtual motor vehicle. By changing the orientation of their head and / or by changing the direction of view, the wearer of the virtual reality glasses can easily move the displayed selection symbol. This allows them to easily bring the selection symbol into alignment with a wide variety of components of the displayed virtual object. As a result, depending on the part or component with which the selection symbol has been brought into alignment, a corresponding configuration menu comprising several equipment options is displayed by means of the virtual reality glasses. Again by changing the orientation of their head and / or by changing the direction of viewBy changing their viewing direction, the wearer of the virtual reality headset can easily move the displayed selection icon within the configuration menu and thereby select one of the configuration options displayed as part of the configuration menu. Once one of the displayed configuration options has been selected, the virtual reality headset is controlled in such a way that the displayed virtual object is updated according to the selection made.

[0011] For example, the wearer of the virtual reality glasses, while sitting virtually in a motor vehicle displayed by the virtual reality glasses, can, for example, shift the displayed selection symbol by changing the orientation of the virtual reality glasses and / or by changing their viewing direction so that it overlaps with an instrument cluster of the virtual vehicle. Various equipment options for the instrument cluster are then displayed in the form of the aforementioned configuration menu using the virtual reality glasses. For example, the wearer of the virtual reality glasses can then choose between a conventional instrument cluster with analog instruments, an instrument cluster with partially analog instruments and partially digital display options, and a fully digital instrument cluster.The various equipment options are visualized, for example, by various icons or other representations in the configuration menu. If the wearer of the virtual reality glasses now lets their gaze wander over the displayed configuration menu and thus over the various equipment options, the selection symbol moves accordingly. Likewise, the wearer of the virtual reality glasses can also tilt their head, which changes the orientation of the virtual reality glasses and also causes the selection symbol to move within the displayed configuration menu. As soon as the selection symbol is at least partially aligned with one of the equipment options, the corresponding equipment option is selected and the representation of the virtual vehicle – in the example explained above, the representation of the instrument cluster – is updated accordingly.

[0012] Using the method according to the invention, the wearer of the virtual reality glasses can easily and conveniently view and select various configuration options for the virtual object currently displayed by the virtual reality glasses. This allows the virtual object to be redesigned very easily and intuitively.

[0013] An advantageous embodiment of the invention provides that the selection symbol is only displayed once a configuration mode has been activated. This prevents the selection symbol from being permanently displayed via the virtual reality glasses. The perception of the displayed virtual object is thus not unnecessarily impaired. If necessary, the wearer of the virtual reality glasses can activate the configuration mode and thereby cause the selection symbol to be displayed, allowing them to change various functional groups with regard to the available equipment options by changing their head position or by changing their viewing direction in the manner already described.

[0014] A further advantageous embodiment of the invention provides that the configuration mode is only activated when an actuating element, in particular on a remote control held by the wearer of the virtual reality glasses, has been actuated. For example, it can be provided that the wearer of the virtual reality glasses is provided with a remote control having a single mechanically actuated button. By pressing this mechanical button, the wearer of the virtual reality glasses can activate the configuration mode and, as a result, display the selection symbol via the virtual reality glasses. Alternatively, it is also possible for the remote control to have a sensory button, for example a capacitive control panel or the like, instead of the mechanically actuated button.In this case, it may be sufficient for the wearer of the virtual reality headset to simply touch the control panel, which activates configuration mode and displays the selection symbol. The wearer of the virtual reality headset can therefore activate configuration mode very easily by pressing the control element.

[0015] According to a further advantageous embodiment of the invention, the configuration menu is only displayed when a selection mode has been activated, in particular by a renewed actuation of the actuating element. For example, the selection symbol is initially brought into alignment with a specific component of the virtual object due to a detected pivoting of the virtual reality glasses and / or due to a detected change in the viewing direction of the wearer of the virtual reality glasses. The configuration menu is only displayed when the wearer of the virtual reality glasses subsequently actuates the actuating element. This prevents the configuration menu from being displayed unintentionally or unnecessary.

[0016] A further advantageous embodiment of the invention provides that the relevant equipment option is only selected once a predetermined confirmation action, in particular a repeated actuation of the actuating element, has been detected. After the configuration menu has been displayed, the wearer of the virtual reality glasses can move the selection symbol within the displayed configuration menu based on their line of sight or by changing their head orientation. As soon as they have brought the selection symbol into alignment with the desired equipment option, they can, for example, actuate the actuating element on the remote control held in their hand once more. This confirms the selection, as a result of which the equipment option selected by the wearer of the virtual reality glasses is now actually selected. The displayed virtual object is then updated according to the selection made.The wearer of the virtual reality glasses can therefore easily determine whether he actually wants to select the desired equipment option, simply by performing the specified confirmation action.

[0017] In a further advantageous embodiment of the invention, it is provided that the component is optically marked as soon as the selection symbol overlaps with the component of the functional group. It is preferably provided that the component is optically marked only when the selection symbol overlaps with the component of the functional group and several equipment options are available for the component and / or for the functional group. The wearer of the virtual reality glasses therefore receives optical feedback as to whether different equipment options exist for the component with which they have brought the selection symbol into alignment and whether a corresponding configuration menu can be displayed. For example, the component in question can be optically marked by framing it, highlighting it in color, or visually identifying it in any other way.The wearer of the virtual reality glasses can therefore easily see which component or functional group of the virtual object he can configure with regard to various equipment options.

[0018] According to the invention, the configuration menu is displayed in such a way that the virtual distance between the configuration menu and a virtual observation position of the wearer of the virtual reality glasses is selected to be smaller, the smaller the distance between the virtual observation position and the component. Preferably, the position of the virtual reality glasses is continuously detected, with the virtual observation position within the virtual environment being determined depending on the detected position of the virtual reality glasses. The wearer of the virtual reality glasses can thus change their virtual observation position by walking around, so that they can, for example, increase or decrease their virtual distance from the displayed virtual object.The configuration menu, which is displayed, for example, in the form of an additional window within the virtual reality environment, is dynamically adjusted to the virtual observation position of the wearer of the virtual reality glasses with regard to its positioning within the virtual reality environment. For example, if the wearer of the virtual reality glasses is sitting virtually in a displayed virtual vehicle and wants to configure a virtual vehicle's infotainment system, the corresponding configuration menu is displayed relatively close to a central display in the interior of the virtual vehicle.However, if the wearer of the virtual reality glasses views the virtual vehicle from a somewhat greater virtual distance from the outside, for example, to select a wheel rim, the configuration menu will be displayed somewhat farther away from the virtual observation position than in the previous example, in which the wearer of the virtual reality glasses is located inside the virtual vehicle. However, the virtual distance between the displayed configuration menu and the virtual observation position of the wearer of the virtual reality glasses is preferably limited to a predetermined value. For example, the configuration menu can be displayed approximately 90 cm from the virtual observation position of the wearer of the virtual reality glasses by default.This virtual distance is only selected to be smaller if the wearer of the virtual reality headset is particularly close to a specific component of the vehicle being configured within the virtual environment, i.e., if the virtual observation position is very close to the component in question. By dynamically adjusting the distance between the displayed configuration menu and the virtual observation position, the wearer of the virtual reality headset can easily view and select the various configuration options at any time.

[0019] A further advantageous embodiment of the invention provides for the part of the virtual environment and / or the virtual object that is covered by the displayed configuration menu to be hidden. This prevents a visual conflict from occurring when the configuration menu is displayed, for example, because the configuration menu that has just been displayed overlaps with a part of the virtual object.

[0020] The virtual reality system according to the invention comprises virtual reality glasses, a detection device designed to detect an orientation of the virtual reality glasses and / or a viewing direction of a wearer of the virtual reality glasses, and a control device designed to control the virtual reality glasses to carry out the method according to the invention or to carry out an advantageous embodiment of the method according to the invention. Advantageous embodiments of the method according to the invention are to be regarded as advantageous embodiments of the virtual reality system, wherein the virtual reality system in particular has means for carrying out the method steps.

[0021] Further advantages, features, and details of the invention will become apparent from the following description of a preferred embodiment and from the drawings. The features and combinations of features mentioned above in the description, as well as the features and combinations of features mentioned below in the description of the figures and / or shown alone in the figures, can be used not only in the respective specified combinations, but also in other combinations or on their own, without departing from the scope of the invention.

[0022] The drawing shows: Fig. 1 a schematic representation of a virtual reality system comprising virtual reality glasses, a control device for controlling the virtual reality glasses, a detection device for detecting the orientation of the virtual reality glasses and a viewing direction of the wearer of the virtual reality glasses, and a remote control for controlling the virtual reality glasses; Fig. 2 a schematic perspective view of a person wearing the virtual reality glasses; and in Fig. 3 a side view of a virtual motor vehicle displayed using virtual reality glasses.

[0023] A virtual reality system 10 with virtual reality glasses 12 is shown in a schematic representation in Fig. 1. The virtual reality system 10 serves, in particular, to display and configure a virtual motor vehicle. The virtual reality system 10 further comprises a control device 14, which serves to control the virtual reality glasses 12. Furthermore, the virtual reality system 10 comprises a detection device 16, which is designed to detect an orientation of the virtual reality glasses 12. In addition, the detection device 16 comprises means for detecting the viewing direction of a wearer of the virtual reality glasses 12. Finally, the virtual reality system 10 also has a remote control 18, by means of which a wearer of the virtual reality glasses 12 can control them.

[0024] In Fig. 2 shows a person 20 who is located in a detection room 22. As can be seen, the person 20 has put on the virtual reality glasses 12 and is holding the remote control 18 in his hand.

[0025] In Fig.3 shows a virtual motor vehicle 24 arranged within a virtual environment 26, for example, in the form of a virtual showroom or the like. The virtual motor vehicle 24 arranged within the virtual environment 26 is displayed using the virtual reality glasses 12. By moving around within the detection space 22, the person 20 wearing the virtual reality glasses 12 can change their virtual observation position within the virtual environment 26, allowing them to, for example, walk around the virtual motor vehicle 24 within the displayed virtual environment 26 and view it from a variety of virtual perspectives.

[0026] As soon as the wearer 20 presses a button (not shown in detail) on the remote control 18, a configuration mode is activated, resulting in a selection symbol 28 being displayed via the virtual reality glasses 12. In this case, the selection symbol 28 is represented as a type of cross. In principle, the selection symbol 28 can have a variety of shapes, for example, the shape of a mouse pointer or the like. Thus, if the person 20 presses the said button on the remote control 18 for the first time, the selection symbol 28 is displayed, as the said configuration mode is activated.

[0027] The detection device 16 continuously detects the orientation of the virtual reality glasses 12 and / or the viewing direction of the wearer 20 of the virtual reality glasses 12. If, for example, the person 20 swivels their head back and forth, the displayed selection symbol 28 is moved within the displayed virtual environment 26 in accordance with the swiveling of the virtual reality glasses 12. Likewise, the person 20 can cause the displayed selection symbol 28 to move through eye movements.

[0028] In the present case, the person 20 has brought the displayed selection symbol 28 into alignment with the right front wheel 30 of the virtual motor vehicle 24 by means of a corresponding head or eye movement. As a result, the right front wheel 30 is provided with an optical marking 32. If the person 20 then presses the said button on the remote control 18 a second time, a configuration menu 34 comprising several equipment options is displayed via the virtual reality glasses 12. Since the wearer 20 of the virtual reality glasses 12 had focused on the right front wheel 30 in the present case, or brought the selection symbol 28 into alignment with the right front wheel 30, the displayed configuration menu 34 has a multitude of different rims 36, which represent various equipment options for the tires of the virtual motor vehicle 24.

[0029] It can be provided that the selection symbol 28 is automatically relocated into the configuration menu 30 as soon as it is displayed. In the present case, this has been done, with the selection symbol 28 being displayed as a rectangle and no longer in the shape of a cross as soon as the selection symbol 28 has been relocated into the displayed configuration menu 34.

[0030] By changing the orientation of the virtual reality glasses 12 and / or by changing his viewing direction, the wearer 20 can in turn move the selection symbol 28 so that he can select the various rims 36 by means of the displayed selection symbol 28.

[0031] Once he has selected the desired rim 36, i.e., has positioned the now rectangular selection symbol 28 accordingly on one of the displayed rims 36, the wearer 20 of the virtual reality glasses 12 can confirm his selection by pressing the said button on the remote control 18 again.

[0032] In the present case, the wearer 20 of the virtual reality glasses 12 has selected the lower left displayed rim 36, as a result of which the display of the virtual motor vehicle 24 has been adjusted accordingly.

[0033] In the same way, the wearer 20 of the virtual reality glasses 12 can proceed further to adapt or configure various functional groups or components of the displayed virtual motor vehicle 24 as desired. In this case, the wearer 20 of the virtual reality glasses 12 can also virtually enter the interior of the virtual motor vehicle 24, for example, to select various materials for the interior of the virtual motor vehicle 24 or, for example, to select various equipment options for an infotainment system of the motor vehicle 24. Using the virtual reality system 10 explained above, the wearer 20 of the virtual reality glasses 12 can thus select and change equipment options for the displayed virtual motor vehicle 24 in a particularly simple and convenient manner.

Claims

[1] Method for operating a virtual reality system (10), comprising the steps: - displaying a virtual object (24) arranged in a virtual environment (26) by means of virtual reality glasses (12); - moving a selection symbol (28) displayed by means of the virtual reality glasses (12) in accordance with a detected change in an orientation of the virtual reality glasses (12) and / or a detected change in a viewing direction of a wearer (20) of the virtual reality glasses (12); characterized by the steps: - Displaying a configuration menu (34) comprising a plurality of equipment options (36) for a functional group of the displayed virtual object (24) by means of the virtual reality glasses (12) if the selection symbol (28) overlaps with at least one component (30) of the functional group (34); - Moving the selection symbol (28) within the displayed configuration menu (34) in accordance with a detected change in the orientation of the virtual reality glasses (12) and / or a detected change in the viewing direction of the wearer (20) of the virtual reality glasses (12); - selecting one of the displayed equipment options (36) if the selection symbol (28) is at least partially overlapped with the relevant equipment option (36), and changing the display of the virtual object (24) according to the selection made, - wherein the configuration menu (34) is displayed in such a way that a virtual distance between the configuration menu (34) and a virtual observation position of the wearer (20) of the virtual reality glasses (12) is selected to be smaller, the smaller the distance between the virtual observation position and the component (30). [2] Method according to claim 1, characterized bythat the selection symbol (28) is only displayed when a configuration mode has been activated. [3] Method according to claim 2, characterized by that the configuration mode is only activated when an actuating element, in particular on a remote control (18) held by the wearer (20) of the virtual reality glasses (12), has been actuated. [4] Method according to one of the preceding claims, characterized by that the configuration menu (34) is only displayed when a selection mode has been activated. [5] Method according to one of the preceding claims, characterized by that the relevant equipment option (36) is only selected once a predetermined confirmation action has been recorded. [6] Method according to one of the preceding claims, characterized by that the component (30) is optically marked as soon as the selection symbol (28) overlaps with the component (30) of the functional group. [7] Method according to one of the preceding claims, characterized by , however, the virtual distance is limited to a specified value. [8] Method according to one of the preceding claims, characterized by that part of the virtual environment (26) and / or the virtual object (24) which is covered by the displayed configuration menu (34) is hidden. [9] Virtual reality system (10), comprising virtual reality glasses (12), a detection device (16) which is designed to detect an orientation of the virtual reality glasses (12) and / or a viewing direction of a wearer (20) of the virtual reality glasses (12), and a control device (14) which is designed to control the virtual reality glasses (12) to carry out a method according to one of the preceding claims.

Images