Method and system for conducting a virtual meeting between at least one first person and one second person

Abstract

Method for conducting a virtual meeting between at least one first person (4) and a second person (6), wherein the virtual meeting is displayed by means of a first display device (2) assigned to the first person (4) in the form of a first virtual environment (8) and by means of a second display device (3) assigned to the second person (6) in the form of a second virtual environment (11), wherein - the first person (4) is in reality located in a moving vehicle (5), whose vehicle movement is detected and the representation of the first virtual environment (8) is selected according to the detected vehicle movement; - the second person (6) is in reality in a reference system (7) that differs from the vehicle (5), whose movement is detected and the representation of the second virtual environment (11) is chosen according to the detected movement of the reference system (7).

Description

[0001] The invention relates to a method and system for conducting a virtual meeting between at least one first person and a second person.

[0002] It's already well-established to use video conferencing and similar technologies to allow people in different locations to communicate. In the future, more and more people are expected to use immersive technologies, such as virtual reality systems, in their vehicles, both to enhance their perception of driving and for entertainment. However, the use of virtual reality in vehicles is not always without its problems, as the dissonance between what is seen and the vehicle's movement can cause nausea in many users. In other words, it's quite possible for so-called motion sickness to occur when using virtual reality in vehicles.

[0003] The use of virtual reality systems is already known. For example, DE 10 2015 011 590 A1 discloses a method for operating a virtual reality system in which a person wears virtual reality glasses, and an external person, who is not wearing the virtual reality glasses, is shown on a separate display where the person wearing the virtual reality glasses is currently looking.

[0004] Another virtual reality system is shown in DE 10 2014 009 298 A1. With this system, a wearer of virtual reality glasses and headphones can hear another person in the room with precise directionality through the headphones. If the wearer of the virtual reality glasses moves around within a virtual environment, the other person's speech is always played back through the headphones in such a way that the relative positioning between the two people is taken into account.

[0005] Finally, DE 101 06 072 A1 discloses a method for displaying visual information in a telecommunications device. A conversation partner is displayed as an avatar within a virtual environment.

[0006] DE 10 2017 001 787 A1, published after the filing date of this application, describes a method in which communication with a conversation partner located in an external unit is established in a virtual space via a vehicle.

[0007] The object of the present invention is to provide a method and a system for conducting a virtual meeting between at least two persons, by means of which the risk of the persons becoming ill during the conduct of the virtual meeting can be reduced.

[0008] This problem is solved by a method and a system for conducting a virtual meeting between at least one first person and a second person, with the features of the independent claims. Advantageous embodiments with expedient and non-trivial further developments of the invention are specified in the dependent claims.

[0009] In the inventive method for conducting a virtual meeting between at least one first person and a second person, the virtual meeting is displayed by means of a first display device assigned to the first person in the form of a first virtual environment and by means of a second display device assigned to the second person in the form of a second virtual environment. The first person is actually located in a moving vehicle, the vehicle's movement is detected, and the display of the first virtual environment is selected according to the detected vehicle movement. The second person is actually located in a reference frame different from the vehicle, the movement of which is detected, and the display of the second virtual environment is selected according to the detected movement of the reference frame.

[0010] Using the method according to the invention, it is therefore possible to bring two people together in the form of a virtual meeting, even if they are in different locations. The first person is in a moving vehicle, while the other person is not. The invention provides that the two people are shown the appropriate virtual environment based on their real-world positions, ensuring they do not experience motion sickness. This is achieved by taking the movement of the vehicle into account for the first person and selecting the appropriate display of the first virtual environment for the virtual meeting. The vehicle's movement can be detected, for example, using vehicle-mounted sensors, which can then provide corresponding data relating to the vehicle's movement.For example, accelerometers or velocity sensors can be used. This data is then provided to the first display unit, which processes and considers this data and designs the display of the first virtual environment accordingly.

[0011] The second person could be located in reality, for example, in a room or in another vehicle. In principle, the second person can be in any frame of reference while the virtual meeting takes place. The movement of the second person's frame of reference is also tracked, and the rendering of the second virtual environment for displaying the virtual meeting is adjusted according to this tracked movement.

[0012] This allows both people to hold a virtual meeting without either person feeling ill due to a discrepancy between the perceived actual movement based on their respective real reference system and the representation of the respective virtual environment.

[0013] An advantageous embodiment of the invention provides that in the first virtual environment, an image of the second person is displayed from the virtual perspective of the first person, and in the second virtual environment, an image of the first person is displayed from the virtual perspective of the second person. In other words, the image is an avatar, i.e., a digital representation of the respective individuals. The images of the individuals can be photorealistic. For example, it is possible that the respective image data of the individuals is stored in an address book, and this image data is used during the creation of the virtual meeting. Furthermore, it is possible that sensors detect the respective movements of the two individuals; for example, it is also possible to perform so-called motion capture.Motion capture is a general term for a method that tracks real-world movements and translates them into mathematical formulas. These formulas are then used to move a virtual figure or its virtual skeleton—in this case, the respective virtual representations within the virtual environment of the two people. This allows for a particularly realistic virtual encounter between the two individuals. Preferably, relative movements of the two people to the vehicle or to reference frames other than the vehicle are translated into corresponding movements within the virtual environment. For example, if the first person leans forward inside the vehicle, this movement is translated into both virtual environments. The same applies to the second person.For example, if the second person is in a room in reality and moves around in that room, their movement in reality will be translated into a corresponding movement within the two displayed virtual environments.

[0014] Another advantageous embodiment of the invention provides that the relative orientation of the first person to the vehicle is detected, and the display of the first virtual environment is selected according to this detected relative orientation. For example, the first person may be seated in a vehicle seat that can be rotated 180 degrees around its vertical axis. Thus, the person might initially sit facing forward in the direction of travel and then rotate the seat so that they are facing backward, as if traveling in reverse. By taking into account the relative orientation of the person to the vehicle and adjusting the display of the first virtual environment accordingly, it can be ensured that the first person does not experience motion sickness during the virtual encounter.Because there is definitely a difference between accelerating backwards and forwards, and how the virtual environment is then displayed as a result.

[0015] In a further advantageous embodiment of the invention, the first virtual environment is a virtual platform that moves through a virtual environment in accordance with the detected vehicle movement. The virtual encounter thus takes place on this virtual platform from the first person's virtual environment, with the virtual environment moving past the first person from their virtual perspective, as the virtual platform appears to move through the virtual environment in accordance with the detected vehicle movement. The visual stimuli perceived by the first person therefore correspond to the information provided by their vestibular system due to the vehicle's movement. This can prevent or minimize motion sickness.

[0016] According to an alternative advantageous embodiment of the invention, the first virtual environment is a virtual office, past whose windows a virtual environment moves in accordance with the detected vehicle movement. By virtually moving the virtual environment past the windows of the virtual office, it can also be ensured that the first person, from their virtual perspective, receives or can perceive at least certain visual stimuli that correspond to the information from their vestibular system. This also makes it possible to significantly reduce or completely prevent the phenomenon of motion sickness.In principle, any design of the respective virtual environments is possible and useful, provided that it provides both people with visual feedback appropriate to their relative movement of their reference system, i.e., either the moving vehicle or the other reference system of the second person.

[0017] Another advantageous embodiment of the invention provides that if the reference system in which the second person is located in reality is a stationary environment, the second virtual environment is displayed as a stationary virtual environment. In this case, the second person's visual perception of the virtual environment coincides with the perception provided by their vestibular system. This makes it possible for the second person not to experience nausea during the virtual encounter, i.e., so-called motion sickness does not occur or is at least reduced to a minimum.

[0018] In a further advantageous embodiment of the invention, it is provided that if the reference system in which the second person is located in reality is also a moving vehicle, its vehicle movement is detected, and the representation of the second virtual environment is selected according to the detected second vehicle movement. In this case as well, care is taken to ensure that the phenomenon of motion sickness does not occur or is reduced to a minimum for the second person. It is therefore also possible for both persons to be traveling in different vehicles, with the two persons holding a virtual meeting, and the respective virtual environments being adapted to the respective vehicle movements.

[0019] According to a further advantageous embodiment of the invention, the display devices are virtual reality glasses, through which the respective virtual environments are displayed. This allows the virtual meeting to be perceived as particularly realistic by both people, since the two virtual reality glasses cover the entire field of vision of each person, so that both people feel completely immersed in their respective virtual environments. However, instead of virtual reality glasses, any other display devices can also be used, so that, for example, only the first person wears virtual reality glasses while sitting in the vehicle, while the other person, if they are sitting in an office, for example, looks at a monitor instead of virtual reality glasses, on which the appropriate virtual environment is displayed.

[0020] The system according to the invention for conducting a virtual meeting between at least one first person and a second person comprises a first display device assigned to the first person for displaying the virtual meeting in the form of a first virtual environment, wherein the first display device is configured to select the representation of the first virtual environment according to the detected vehicle movement, depending on a detected vehicle movement of a vehicle in which the first person is arranged.Furthermore, the system according to the invention comprises a second display device assigned to the second person for displaying the virtual meeting in the form of a second virtual environment. This second display device is configured to select the display of the second virtual environment depending on the detected movement of a reference system that differs from the vehicle and in which the second person is positioned. Both display devices preferably include respective control devices that can adjust the respective virtual environments. Preferably, the display devices also have respective data interfaces through which various data describing the movement of the vehicle or the movement of the second person's reference system can be received.Advantageous embodiments of the method according to the invention are to be regarded as advantageous embodiments of the system according to the invention and vice versa, wherein the system in particular includes means for carrying out the method steps.

[0021] Further advantages, features, and details of the invention will become apparent from the following description of a preferred embodiment and from the drawing. The features and combinations of features mentioned above in the description, as well as those mentioned below in the figure description and / or shown in the figures alone, can be used not only in the combinations specified, but also in other combinations or individually, without departing from the scope of the invention.

[0022] The drawing shows in: Fig. 1. A highly schematic representation of a system for conducting a virtual meeting between two people; Fig. 2. A schematic representation of a person sitting at a desk and a person sitting in a vehicle, who are using a monitor or virtual reality glasses respectively, taking advantage of the in Fig. 1. Hold a virtual meeting using a schematically represented system; Fig. 3. A highly schematic representation of the virtual meeting between the two persons, which is displayed using virtual reality glasses in the form of an initial virtual environment; and in Fig. 4 Another highly schematic representation of the virtual meeting, which is displayed on the screen in the form of a second virtual environment.

[0023] Identical or functionally equivalent elements have been given the same reference symbols.

[0024] A system 1 for conducting a virtual meeting between at least two people is shown in a highly schematic representation in Fig. Figure 1 shows that System 1 comprises two display devices 2, 3, which can be used by individuals wishing to conduct a virtual meeting. System 1 is particularly designed to enable virtual meetings between people located in very different places.

[0025] In Fig. Figure 2 illustrates a scenario in which such a virtual meeting can be conducted using System 1. In this example, the display devices 2 and 3 of System 1 consist of a virtual reality headset 2 and a screen 3. A first person 4, wearing the virtual reality headset 2, is currently sitting in a moving vehicle 5. For example, the vehicle 5 may be driving fully autonomously, so the person 4 can safely wear the virtual reality headset 2, even if they are the driver. Of course, the person 4 could also be a passenger.

[0026] A second person 6 is currently sitting in their office 7, which represents person 6's frame of reference, and is looking at screen 3. Both persons 4 and 6 can hold a virtual meeting with each other using system 1.

[0027] In Fig. Figure 3 shows a highly schematic representation of a virtual environment 8, in which the virtual meeting between the two persons 4 and 6 is depicted using virtual reality glasses 2. Images 9 and 10 of the two persons 4 and 6 are shown schematically for illustrative purposes. Image 9 corresponds to person 4 sitting in vehicle 5 within the virtual environment 8, while image 10 corresponds to person 6 sitting in their office 7. Person 4, sitting in vehicle 5, sees image 10 of person 6 sitting in their office 7 through their virtual reality glasses 2, starting from the virtual position marked by image 9.

[0028] In Fig.Figure 4 shows a second virtual environment 11, in which the virtual meeting between the two persons 4 and 6 is depicted via screen 3. The two images 9 and 10 of the two persons 4 and 6 are again shown schematically for purely illustrative purposes. Person 6, sitting in their office 7, looks through screen 3, or rather via screen 3, at the virtual environment 11 from the virtual perspective characterized by the positioning of image 10.

[0029] For example, it is also possible to use motion capture methods so that during the virtual meeting the two persons 4, 6 can see particularly realistic movements of the images 9, 10 within the respective virtual environment 8, 11, for example also the movement of their own virtual limbs and the like.

[0030] A particular challenge in holding such virtual meetings in the following example is that person 4 is traveling with vehicle 5, while person 6 is located in their office 7, meaning that person 6's frame of reference is not moving, unlike person 4's frame of reference, which is vehicle 5.

[0031] To prevent the two persons 4, 6 from feeling ill during the virtual meeting, i.e., from experiencing so-called motion sickness, the virtual reality glasses 2 and the screen 3 are designed to each display the different virtual environments 8, 11, appropriately adjusted to how the respective reference systems of persons 4, 6, i.e. the moving vehicle 5 and the stationary office 7 respectively, move or do not move.

[0032] Various data regarding the movement of vehicle 5 are recorded, whereby the display of the first virtual environment 8 using the virtual reality glasses 2 is selected according to the recorded vehicle movement. Similarly, the movement of the reference system of the second person 6, i.e., office 7, is recorded, whereby the display of the second virtual environment 11, which is shown on screen 3, is selected according to the recorded movement of office 7, in this example, that office 7 is not moving.

[0033] The virtual environment 8 for representing the virtual meeting is chosen, for example, such that the virtual reality glasses 2 are a platform not further specified here, on which the two images 9, 10 of the two real persons 4, 6 are located, and this platform moves through a virtual environment according to the recorded vehicle movement of the vehicle 5.

[0034] The virtual environment 11, on the other hand, can be chosen such that the second person 6 simply sees a virtual office space through screen 3 that does not move at all. Both persons 4 and 6 thus see such virtual environments 8 and 11 respectively, which are adapted to the movement of their respective reference frames, i.e., the vehicle 5 and the office 7. This prevents so-called motion sickness from occurring in both persons 4 and 6 during the virtual meeting.

[0035] Similarly, instead of being in office 7, person 6 could also be sitting in a vehicle (not shown here). In that case, the vehicle's movement would be tracked and adjusted accordingly when displaying the virtual meeting for person 6. Person 6 could also be wearing virtual reality glasses (also not shown here), with the display being handled analogously to the process described above.

[0036] The two persons 4, 6 can therefore be located in any place and any frame of reference, whereby the movement of the respective frames of reference is taken into account when rendering the virtual environments 8, 11 adapted to the person. Of course, such virtual meetings can also take place between more than two persons, in which case the respective movement or lack thereof of the respective frames of reference in which the persons are located in reality is preferably also taken into account when rendering the virtual meetings in the form of the respective virtual environment.

Claims

[1] Method for conducting a virtual meeting between at least one first person (4) and a second person (6), wherein the virtual meeting is displayed by means of a first display device (2) assigned to the first person (4) in the form of a first virtual environment (8) and by means of a second display device (3) assigned to the second person (6) in the form of a second virtual environment (11), wherein - the first person (4) is in reality located in a moving vehicle (5), whose vehicle movement is detected and the representation of the first virtual environment (8) is selected according to the detected vehicle movement; - the second person (6) is in reality in a reference system (7) that differs from the vehicle (5), whose movement is detected and the representation of the second virtual environment (11) is chosen according to the detected movement of the reference system (7). [2] Method according to claim 1, characterized by , that in the first virtual environment (8) an image (10) of the second person (6) is displayed from a virtual perspective of the first person (4) and in the second virtual environment (11) an image (9) of the first person (4) is displayed from a virtual perspective of the second person (6). [3] Method according to claim 1 or 2, characterized by , that a relative orientation of the first person (4) to the vehicle (5) is detected and the representation of the first virtual environment (8) is selected according to the detected relative orientation of the first person (4) to the vehicle (5). [4] Method according to any one of the preceding claims, characterized by , that the first virtual environment (8) is displayed is a virtual platform which moves through a virtual environment according to the detected vehicle movement. [5] Method according to any one of claims 1 to 3, characterized by, that the first virtual environment (8) is displayed is a virtual office, at whose windows a virtual environment passes according to the detected vehicle movement. [6] Method according to any one of the preceding claims, characterized by , that if the reference frame (7) in which the second person (6) is located in reality is a stationary environment, the second virtual environment (11) is displayed in the form of a stationary virtual environment. [7] Method according to any one of the preceding claims, characterized by , that if the reference system (7) in which the second person (6) is located in reality is also a moving vehicle, its vehicle movement is detected and the representation of the second virtual environment (11) is chosen according to the detected second vehicle movement. [8] Method according to any one of the preceding claims, characterized by, that the display devices (2, 3) are respective virtual reality glasses, by means of which the respective virtual environments (8, 11) are displayed. [9] System (1) for conducting a virtual meeting between at least one first person (4) and a second person (6), comprising - a first display device (2) assigned to the first person (4) for displaying the virtual meeting in the form of a first virtual environment (8), wherein the first display device (2) is configured to select the display of the first virtual environment (8) according to the detected vehicle movement of a vehicle (5) in which the first person (4) is located; - a second display device (3) assigned to the second person (6) for displaying the virtual meeting in the form of a second virtual environment (11), wherein the second display device (3) is configured to select the display of the second virtual environment (11) depending on a detected movement of a reference system (7) that differs from the vehicle (5) in which the second person (6) is located.

Images