Method and system for displaying at least one spatial section displayed according to eye position of person

Abstract

The invention relates to a method for displaying at least one space section (13, 15) of at least one space (8, 10) on a first display surface (5) of a first display device (2) of a first person (12), a second space section (13) of a second space (10) in which a second display device (3) is located is recorded by means of at least one second camera (9), the second space section (13) is displayed as a first image (14) on the first display surface (5), the second space (10) is recorded by means of a second camera (9), and an eye position (11) of the first person (12) is detected by means of at least one first detection device (7 '), a second space section (13) of the captured second space (10), which is dependent on the detected eye position (11), is displayed as a first image (14) on the first display surface (5). The invention further relates to a system (1).

Description

[0001] This application is a divisional application of the patent application with application number 201880061799.1 and name “Method and system for displaying at least one spatial segment based on the eye position of a person” filed with the China Patent Office on July 31, 2018. Technical Field

[0002] The invention relates to a method for displaying at least one room section of at least one room on a first display surface of a first display device of a first person. Background Art

[0003] Methods are already known from the prior art, in which, for example, two persons can communicate with each other by means of a video phone and in this process an image of the first person is transmitted to the second person and an image of the second person is transmitted to the first person. The images are displayed on the corresponding display devices of the respective persons. In this case, in particular, the corresponding spatial segments are detected using the corresponding cameras of the display devices and the image information is transmitted via a network to the corresponding display devices of the other party and displayed on the imaging device of the corresponding display devices. In the prior art, a fixed image of the spatial segment is displayed. If, for example, a person approaches the camera, the displayed spatial segment remains unchanged for the person on the display device. In other words, the displayed spatial segment from the prior art does not change with the direction of sight of the corresponding person. Summary of the invention

[0004] The object of the present invention is to provide a method and a system by means of which a spatially modified representation can be displayed as a person image on a display device.

[0005] This object is achieved by a method and a system according to the independent claims.

[0006] One aspect of the present invention relates to a method for displaying at least one spatial segment of at least one room on a first display surface of a first display device of a first person. A second spatial segment of a second room in which a second display device is located is captured by means of at least one second camera, and the second spatial segment is displayed as a first image on the first display surface.

[0007] A second room is recorded by means of a second camera, an eye position of the first person is detected by means of at least one detection device, and a second room section of the second room associated with the detected eye position is displayed as a first image on the first display surface.

[0008] This enables the first person to obtain an image of the second space, in particular a spatial segment, displayed on the first display surface according to the eye position of the first person. In other words, the first person can look at the second space from different perspectives, for example, by looking around in the second space through the first display device. Similar to looking through a window, the second space behind the window can be viewed accordingly by the first person. By changing the position of the first person, in particular by changing the eye position of the first person, the second space "behind the window" can be displayed accordingly. In particular, this makes it possible to achieve particularly realistic communication between the first display device and the second display device. In addition, this makes it possible, for example, to observe an object that is covered by another object in the second space in the first viewing angle by changing the viewing angle. This makes it possible to better display the second space for the first person.

[0009] In other words, the second space is photographed by means of the second camera. The eye position of the first person arranged outside the second space is detected by means of a detection device. According to the detected eye position of the person, a second spatial segment of the second space is selected by means of a control device. The first display device is controlled by means of the control device to display the selected second spatial segment.

[0010] It is also possible that, in addition to pure image information for displaying an image, other information relating to, for example, the temperature or movement in the room can also be transmitted. In addition, sound information can also be detected and transmitted. The transmission is carried out in particular in real time and with real content.

[0011] The detection device can detect the eye position by means of image processing of the image captured by the camera, for example. In addition, the eye position can be detected by detecting the temperature of the space where the first person is located. It is also possible to detect the eye position based on a mark at the first person.

[0012] Furthermore, the first and / or second display device can also communicate with at least one further third display device, so that the displayed spatial segment in which the third display device is located is also correspondingly adapted at least to the detected first person viewing angle and can be displayed on the first and / or second display device. For example, the third image and / or the first image and / or the second image can then be displayed on the first and / or second display surface.

[0013] According to an advantageous embodiment, a person and a first space in which the first person is located can be recorded at least by means of a first camera of the detection device, and the first space segment can be displayed as a second image on a second display surface of the second display device. In this embodiment, for example, the first space segment can be displayed accordingly on the second display surface of the second display device for a second person located in the second space. As a result, the second person can also obtain a display of the first person on the display surface of the second display device, for example, thereby enabling improved communication between the first person and the second person.

[0014] Furthermore, it has proven to be advantageous to detect the second eye position of a second person located in the second room by means of at least a second camera of the second display device, and to adapt the second image of the first room segment on the second display surface according to the second eye position. In other words, the second image can also be adapted on the second display surface according to the second eye position of the second person, so that a kind of window view / window observation image is also generated for the second person. Thus, for the second person, the second image can also be adapted according to the position of the second person or the perspective of the second person, which second image shows the first room and, for example, also the first person. This makes it possible to achieve a particularly realistic communication between the first person and the second person according to the corresponding perspective.

[0015] In another advantageous embodiment, the first person and the first room segment can be displayed as a three-dimensional second image on the second display surface, and / or the second person and the second room segment can be displayed as a three-dimensional first image on the first display surface. This allows particularly realistic communication between the persons.

[0016] It is also advantageous to provide at least a first display surface designed to be semi-transparent and to display at least the first image as augmented reality on the first display surface. In particular, it can also be provided that the second image is displayed as augmented reality on the second display surface. In augmented reality, when the image is projected onto the first display surface, the person can continue to view the environment / background behind the first display surface. It can be said that the person can see through the first image and continue to view the environment behind the first display surface. Communication can thus be carried out in which the person can still view the environment of the display device. For example, a window glass can be used as the first display surface in a motor vehicle, and the vehicle occupant as a person can continue to view the environment of the motor vehicle and still obtain the display of the first image on the first display surface.

[0017] Furthermore, it has proven to be advantageous to record the second room at least by means of at least two second cameras, in particular by means of three second cameras. In particular, it can also be provided that the first room and / or the person is recorded alternatively or additionally by means of at least two first cameras, in particular by means of three first cameras of the first display device. In particular, a particularly reliable recording of the room can be achieved by means of at least two cameras, in particular by means of three cameras, so that in particular a particularly advantageous display of the room section can be achieved depending on the eye position of the person. In particular, different perspectives can be displayed particularly realistically, because the at least two cameras can record the room from different directions and can thus display the room in an improved manner. In this way, the display possibility of holograms or three-dimensional images can also be achieved.

[0018] According to another advantageous embodiment, at least one first camera and / or a second camera of the first detection device can be designed as an image capturing film and / or at least the first display surface can be designed as an imaging film. As a result, a display device having both an image capturing film and an imaging film can be provided in a particularly space-saving manner. For example, a motor vehicle window pane or a mirror can be used as a display or a camera. As a result, such a display device can be installed in a space-saving manner and in a simple manner in a plurality of carrier media of the film, so that communication between a person and a room or between a person and another person can be carried out particularly simply and comfortably.

[0019] It is also advantageous if the image recording film and / or the imaging film is formed on a first carrier element of the first display device. For example, a window glass or a mirror can be used as a carrier element. In particular, a motor vehicle window glass or a motor vehicle mirror can be used as a carrier element in the interior of a motor vehicle. This makes it possible to use a single carrier element to not only record images but also to display them. This is particularly comfortable and saves construction space.

[0020] Furthermore, it can preferably be provided that a pixel-wise dimming LCD film is also arranged on the first carrier element so that the depth information of the imaging film can be better seen by a person. In particular, only those areas in which the image or parts of the image are also shown can be dimmed by the LCD film, while areas in which no image is shown can still be seen by a person.

[0021] In another advantageous embodiment, the image capturing film and the imaging film can be provided as a single integrated film element. In other words, a single film element can be arranged on the carrier element, which is designed not only for capturing images but also for imaging. This makes it particularly easy to arrange a film element that can not only capture images but also display images on the carrier element, thereby saving not only installation costs but also structural space.

[0022] Another aspect of the present invention relates to a system having a first display device and a second display device, wherein the first display device and the second display device are configured to perform the method according to any of the above aspects. The first display device is connected to at least the second display device via a network to exchange information. The network can be constructed not only in a wired manner but also in a wireless manner.

[0023] Advantageous embodiments of the method are considered to be advantageous embodiments of the system, wherein the system has specific features for this purpose, which enable the execution of the method. For this reason, the corresponding developments of the system are not described again here. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] The following describes an embodiment of the present invention. To this end, it is shown that:

[0025] Figure 1 A schematic diagram showing one embodiment of a system having two display devices for communication between two persons;

[0026] Figure 2 A schematic perspective view showing one embodiment of a system having a first and a second space;

[0027] FIG. 3 shows a further schematic perspective illustration of a system in a motor vehicle for communication between two persons. DETAILED DESCRIPTION

[0028] The embodiment described below is a preferred embodiment of the present invention. However, in this embodiment, the described parts of the embodiment are individual features of the present invention that can be regarded as independent of each other, and the features also improve the present invention independently of each other and can also be regarded as components of the present invention individually or in other combinations different from the illustrated combination. In addition, the embodiment can also be supplemented by other features of the present invention.

[0029] In the figures, functionally identical elements are respectively provided with the same reference symbols.

[0030] Figure 1 A schematic diagram of an embodiment of a system 1 is shown. The system 1 has at least one first display device 2 and at least one second display device 3. The first display device 2 is connected to the second display device 3 via a network 4 to exchange information. The network 4 can be designed as either wired or wireless.

[0031] The first display device 2 has a first display surface 5 and the second display device 3 has a second display surface 6. Furthermore, the first display device 2 has at least one first camera 7, in this case three first cameras 7. The first room 8 can be recorded by means of the camera 7.

[0032] The corresponding recording areas E1 , E2 , E3 can be recorded by means of the camera 7 , so that the first room 8 can be recorded—in particular completely.

[0033] The second display device 3 has at least one second camera 9, in particular three second cameras 9. The second room 10 can be recorded by the second camera 9. In particular, the corresponding recording areas E4, E5, E6 can be recorded by the corresponding camera 9, whereby the room 10 can be recorded completely.

[0034] Provision is made to record a second room 10 by means of a second camera 9 and to detect an eye position 11 of a first person 12 by means of a first camera 7 of a first display device 2. A second room section 13 showing the second room 10 at least partially is displayed as a first image 14 on the first display surface 5 according to the detected eye position 11.

[0035] In particular, it is provided that if the first person 12, in particular the eye position 11 of the first person 12, changes, the second spatial section 13 is adapted in accordance with the eye position 11 of the first person 12. This results in a kind of "window view" for the first person 12, so that the first person 12 can observe through the window with the aid of the first display device 2 and thus observe the correspondingly displayed second room 10 as if through a window. Therefore, when the eye position 11 changes, the view through the window also changes.

[0036] In particular, it can be provided that, in addition to the image 14, further information about the second room 10 is also provided on the first display device 2. For example, the temperature and / or surface properties and / or movements can also be displayed on the display device 2.

[0037] Furthermore, it can be provided that a first spatial section 15 of the first room 8 is displayed on the second display surface 6 of the second display device 3. In particular, a second eye position 16 of a second person 17 located in the second room 16 can be detected by means of the second camera 9, and a second image 18 of the first spatial section 15 can be adapted accordingly on the second display surface 6 as a function of the second eye position 16. In particular, a window view can also be provided to the second person 17, so that the second person 17 can also look through the “window” via the second display device 3 and can observe the first room 8 accordingly as a function of the second eye position 16.

[0038] In particular, it can be provided that a first display surface 5 and / or a second display surface 6 designed to be translucent are provided, and at least the first image 14 and / or the second image 18 are displayed as augmented reality on the first display surface 5 and / or the second display surface 6. In other words, the first person 12 can look through the translucent display surface 5 and can see the environment 19 of the first display device 2. At the same time, the first image 14 can be projected onto the first display surface 5 and be viewed as augmented reality. It is also possible that the second person 17 looks through the second display surface 6 and sees the second environment 20 of the second display device 3, with the second image 18 being displayed on the display surface 6 as augmented reality.

[0039] Furthermore, it can be provided that at least the first camera 7 and / or the second camera 9 are designed as respective image recording films 21 and / or at least the first display surface 5 and / or the second display surface 6 are designed as imaging films 22 .

[0040] Figure 2 A schematic perspective view of a system 1 is shown. A first person 12 looks through a first display device 2, for example through a window, and can see a second person 17 in a second room 10. A second person 17 looks through a second display device 3 and can see the first person 12 in a first room 8 as if through a window. In particular, in the case of a change in perspective or a change in position of the persons 12, 17, the corresponding display of the spatial segments 13, 15 can be adapted, so that a particularly close-to-reality communication can be performed between the first person 12 and the second person 17. In particular, it is possible here to transmit, for example, sound information in addition to the image. Further communication with at least one further third display device can also be achieved, wherein a third image can then be displayed additionally or alternatively on the respective display surfaces 5, 6.

[0041] FIG. 3 shows another schematic perspective view of the system 1. FIG. 3 schematically shows a perspective change. A first person 12 looks through the first display device 2, in particular through the first display surface 5, and can see a second person 17, which is represented here as a child. In this example, for example, the first person 12 can sit in the front seat of the motor vehicle and, for example, look through the front window with the display device 2. The child 17 can, for example, sit on a seat in the back seat area and the second display device 3 can, for example, be placed in the seat of the front seat. In other words, the first person 12 looks through the windshield and can observe, for example, a second person 17 who is staying in the back seat area through the windshield or on the display devices 2, 3 arranged on the windshield.

[0042] In particular, it may be provided that the first person 12 and the first spatial section 15 are displayed as a three-dimensional second image 18 on the second display surface 6 and / or that the second person 17 and the second spatial section 13 are displayed as a three-dimensional first image 14 on the first display surface 6 .

[0043] Furthermore, it can be provided that the image capturing film 21 and / or the imaging film 22 are formed on a first carrier element 23 of the first display device 2 and / or the second display device 3. In particular, the image capturing film 21 and the imaging film 22 are provided as a single integral film element.

[0044] Furthermore, it can preferably be provided that an LCD film which can be dimmed pixel by pixel is also arranged on the first carrier element 23, so that the depth information of the imaging film 22 can be better seen by the persons 12, 17. In particular, only the areas in which the images 14, 18 or parts of the images 14, 18 are also shown can be dimmed by the LCD film, so that the areas in which the images 14, 18 are not shown can still be seen by the persons 12, 17.

[0045] In addition, Figure 3 Figure 3a to Figure 3c Different perspectives are shown in FIG. Figure 3a In FIG. 5 , the first person 12 is looking exactly through the first display surface 5 and thus sees the second person 17 in a front view.

[0046] exist Figure 3b In FIG. 5 , the first person 17 has changed the eye position 11 , in particular in this case the line of sight is directed to the right, so that the second person 17 is now displayed on the first display surface 5 in a correspondingly rotated manner.

[0047] exist Figure 3c In FIG. 5 , the first person 12 has turned his sight direction to the left, so that the second person 17 is displayed on the first display surface 5 corresponding to the left perspective of the first person 12 .

[0048] In summary, these examples demonstrate how the invention can use volume holograms for capturing and transmitting spatial content in a moving virtual space.

Claims

1. A method for displaying at least one spatial segment (13, 15) of at least one space (8, 10) on a first display surface (5) of a first display device (2) of a first person (12), wherein a second spatial segment (13) of a second space (10) associated with a detected eye position (11) of the first person (12) is recorded by means of at least one second camera (9), a second display device (3) being located in the second space, the second spatial segment (13) being displayed as a first image (14) on the first display surface (5), the second space (10) being recorded by means of the second camera (9), the eye position (11) of the first person (12) being detected by means of at least one first detection device (7'), in, At least a first display surface (5) designed to be semi-transparent is provided, at least a first image (14) is displayed as augmented reality on the first display surface (5), wherein the first display device (2) is provided for a motor vehicle, the first display surface (5) is provided as a window glass of the motor vehicle, wherein the first display surface is designed as an imaging film (22), wherein the imaging film (22) is arranged on a first carrier element (23), wherein an LCD film is arranged together on the first carrier element (23), wherein the LCD film can be dimmed pixel by pixel, and wherein only the area showing the image or the image part is dimmed, and the area not showing the image is not dimmed.

2. The method according to claim 1, characterized in that A first person (12) and a first space (8) in which the first person (12) is located are detected by means of at least one first camera (7) of a first detection device (7'), and a first spatial segment (15) of the first space (8) is displayed as a second image (18) on a second display surface (6) of a second display device (3).

3. The method according to claim 2, characterized in that A second eye position (16) of a second person (17) located in the second room (10) is detected by means of a second camera (9) of the second display device (3), and a second image (18) of the first room section (15) is perspectively adapted on the second display surface (6) according to the second eye position (16).

4. The method according to any one of the preceding claims, characterized in that The first person (12) and the first spatial section (8) are displayed as a three-dimensional second image (18) on a second display surface (6).

5. The method according to any one of the preceding claims, characterized in that The second person (17) and the second spatial section (13) are displayed as a three-dimensional first image (14) on the first display surface (5).

6. The method according to any one of the preceding claims, characterized in that The second room (10) is detected at least by means of at least two second cameras (9).

7. A system (1) comprising a first display device (2) and a second display device (3), the first display device having a first display surface (5) and a first detection device (7'), the second display device having a second camera (9) and a second display surface (6), the first display device and the second display device being designed to perform the method according to any one of claims 1 to 6, wherein: The first display device (2) is connected to at least a second display device (3) via a network (4) to exchange information, wherein the first display device (2) is designed in a motor vehicle and the first display surface (5) is designed as a window glass of the motor vehicle.

Images