Method and display device for generating a depth effect in the perspective of an observer on a flat display medium, as well as motor vehicle

Abstract

A method for generating a depth effect in the perspective of an observer (B) on a display medium by means of a spatial displacement of several planes according to a parallax effect, wherein the display medium provides a two-dimensional display surface (D), the planes are provided as virtual planes (VE1, VE2, VE3), and for generating the parallax upon detection of a change in the position of the eyes (A1, A2) of an observer (B) by means of a camera and / or a sensor (S) configured to detect movements of the observer (B), the virtual planes (VE1, VE2, VE3) are then displaced relative to each other depending on the detected change in position of the observer (B) on the two-dimensional display surface (D), characterized in that three virtual planes (VE1, VE2, VE3) have virtual distances (d12, d23) and depth parameters are not only the distances (d12, d23) of the virtual planes (VE1, VE2, VE3) VE3) to each other,but also include an intensity of the movements and a reaction of the virtual planes (VE1, VE2, VE3) to the position changes of the observer (B), wherein the intensity of the displacement (Δd2, Δd3) of the virtual planes (VE1, VE2, VE3) in a virtual world is adjustable to generate the parallax on the two-dimensional display surface (D), and the distances (d12, d23) of the virtual planes (VE1, VE2, VE3) to each other in the virtual world for display on the two-dimensional display surface (D) are adjustable via a user interface, and wherein the depth parameters determine a trigger threshold above which a displacement of the virtual planes (VE1, VE2, VE3) to each other is caused when the position of the observer (B) changes.

Description

[0001] The invention relates to a method for generating a depth effect in the perspective or perception of an observer when viewing a display content on a display medium.

[0002] From DE 10 2014 019 122 A1, a display system for a motor vehicle is known in which several image planes are arranged one behind the other using three different displays, creating a three-dimensional display of content. This system has a camera that detects the movements of an observer and compensates for a parallax effect by shifting the respective display planes, so that all objects are displayed in line with the observer's line of sight. This device uses three different displays, which are transparent and partially transparent, to generate these different display planes. This system therefore requires a correspondingly large amount of installation space.

[0003] From DE 10 2017 203 173 A1, a display arrangement for a motor vehicle is known which has two display devices arranged one behind the other, between which a virtual display plane is generated, wherein at least one of the display devices is controlled depending on the eye position of an observer in order to compensate for a parallax effect. This thus eliminates the depth impression caused by the parallax effect.

[0004] From DE 10 2017 208 339 A1, a projection display device for displaying an image in different display planes is known. Furthermore, this document also presents a method for operating this projection display device. In this system, the display is provided via a projection device. This projection display device generates a virtual display image corresponding to a projection image in one or more display planes, which are also perceptible as multiple display planes. The position of an adjustable display element is set along an optical axis of the projection unit to provide the projection image to be displayed, so that the distance of the display plane for displaying the virtual display image can be variably adjusted. A control unit serves to set the position of one of the display planes depending on the angle of the driver's viewing direction.

[0005] The invention is based on the objective of creating a depth effect in a motor vehicle on a display medium that is only two-dimensional, from the perspective of an observer.

[0006] The problem is solved by the subject matter of the independent patent claims. Advantageous embodiments of the invention are described by the dependent patent claims, the following description, and the figures.

[0007] The invention provides a method for generating a depth effect in the perspective or perception of an observer when viewing displayed content on a display medium. The depth effect is generated by spatially shifting multiple planes according to a parallax effect, wherein the display medium provides a two-dimensional display surface and the planes are provided or managed as virtual or digital planes. To generate the parallax upon detecting a change in the position of the observer's eyes, the virtual planes are shifted relative to each other on the two-dimensional display surface using a camera and / or a sensor configured to detect the observer's movements.In other words, to create a parallax effect on a two-dimensional display medium, such as a monitor, display, or head-up display, several virtual planes in a virtual world, where objects are arranged in these planes, are shifted relative to each other. The display device performing this process, equipped with a camera and / or a motion-sensing sensor, detects the head or eye movement of an observer and moves the virtual planes in the virtual world accordingly. The parallax effect is visible, for example, when an observer stands in front of a colonnade consisting of two parallel rows of columns. Along the colonnade, there are always pairs of columns, each the same distance from the viewer, with each pair belonging to one of the rows.If an observer standing in the center of this colonnade, looking between the two rows of columns, moves to the left, for example, so that they no longer see the columns on the left but only the foremost column, behind which all the other columns of the left row disappear, then the columns on the right, viewed from the front, simultaneously appear to move further to the left, as if they were spreading apart. It becomes apparent that the multiple planes located at the height or distance of each individual pair of columns in this example colonnade shift to the left, and the greater the distance from the observer, the further they shift. This effect is achieved on a two-dimensional display medium by artificially shifting virtual planes, each corresponding to the planes at the height of each individual pair of columns in the colonnade.This allows the display device executing the procedure to simulate a parallax effect by means of a camera and / or a sensor when position changes of the observer are detected.

[0008] The invention offers the advantage that, unlike the prior art, a three-dimensional effect, achieved by creating a sense of depth, is produced on a simple two-dimensional display. The invention requires only a single two-dimensional or flat display medium on which a parallax effect is generated virtually or simulated. This is achieved by simulating parallax in a virtual world using virtually spaced planes arranged at different distances from one another, as the viewer's position changes. This is accomplished by virtually shifting the planes relative to each other to create a parallax effect in response to a change in the observer's position. The observer views the display head-on. The parallax effect is thus generated using a simple two-dimensional display unit and a corresponding control circuit.

[0009] The invention also includes embodiments that offer additional advantages.

[0010] One embodiment provides that the display medium represents a virtual world with multiple virtual layers. When the observer's eye position relative to the display medium changes, parallax is generated by a computer-based displacement of the respective virtual layers relative to each other within the virtual world. The magnitude of this displacement is determined by the respective virtual distance of each layer from the observer. In other words, the distances between the individual virtual layers can be variable and adjusted as needed. This has the advantage that different information media with a specific priority can be presented more effectively in a three-dimensional spatial representation within a single virtual world.For example, if an information display is shown far in the background on one plane and a speedometer is located far in the foreground, this large distance in the virtual world will also be reflected accordingly when the observer's position changes relative to the virtual planes. This makes the virtual world appear even more realistic. A similar effect occurs when, as in the example above, an observer looking at a colonnade moves from the center of the colonnade to the left, perceiving the columns differently depending on whether they are spaced five meters, ten meters, or twenty meters apart. This effect can be simulated, offering the advantage of making the virtual world even more realistic.

[0011] One embodiment provides that the change in the observer's eye position results from a movement of the observer's eyes alone, a movement of the observer's head alone, or a combined movement of both the eyes and the head. In other words, the system can detect whether the observer is moving only their head, only their eyes, or both, and generate the parallax effect accordingly. This makes the system appear more realistic.

[0012] One embodiment provides for the number of virtual layers in the virtual world on the two-dimensional display medium to be two or more. In other words, the display can represent a virtual world with any number of virtual layers. This corresponds, for example, to a colonnade with at least two pairs of columns or any number of pairs, allowing for greater flexibility in the display of media such as icons. This offers the advantage that any virtual world with any number of adjustable information displays can be represented in the system. The user can then perceive this world as realistically as possible, and a greater range of display and information options can be realized.This allows for the creation of various user interfaces within a three-dimensional world, whereby the division and assignment of display elements and objects of the virtual world to a virtual layer reduces the computational effort. This is because, by rasterizing the virtual world into discrete layers, the computational effort for the displacement range is limited to the discrete number of layers, as the displacement range only needs to be calculated once per layer.

[0013] One embodiment provides that in the two-dimensional display medium, one or more display elements can be shown in a staggered depth according to priority data that specifies the relative priority of the respective display elements. In other words, a user interface contains multiple information displays that are staggered according to a certain priority. This priority hierarchy is recorded in a priority list that tabulates the respective display and information medium and its respective priority. Using this list, a system can then determine at which level a particular display element is shown. This opens up new possibilities for displaying a user interface with a three-dimensional effect.

[0014] One embodiment provides that the distances between the virtual layers in the virtual world, for display on the two-dimensional display medium, can be adjusted via a user interface, both retrospectively and during operation. In other words, the distances between the individual virtual layers can be set either during the programming of the user interface or during operation by the observer, such as the driver of a vehicle. This offers the advantage that a user, such as the driver of a vehicle, can adjust the display according to their preferences, thus perceiving a comfortable 3D effect.

[0015] One embodiment provides that the intensity of the displacement of the virtual planes relative to each other in the virtual world, used to generate parallax on the two-dimensional display medium, is adjustable. Intensity here refers to the functional relationship between the change in position or movement of the observer and the displacement of the planes relative to each other. For example, the system might allow a certain degree of movement tolerance for the observer before it begins to shift the virtual planes relative to each other to create the parallax effect. The method then essentially provides a trigger threshold that can be set as desired, either by the programmer or by the observer, so that the effect can be individually adjusted for each observer and thus avoids becoming unpleasant.This offers the advantage that the system can be adjusted to the individual preferences of observers, such as motor vehicle drivers.

[0016] One embodiment provides that the trigger threshold for detecting changes in the observer's eye position can be adjusted via a configuration interface. In other words, the observer can subsequently, even during operation, set this trigger threshold according to their needs, before the system shifts the virtual planes relative to each other, thus creating a certain range of movement tolerance for the observer. This makes the system suitable for use by multiple people, each with their own preferences.

[0017] One embodiment provides that a display device is configured to carry out an embodiment of the method. Another embodiment provides a display device with a control circuit configured to carry out an embodiment of the method. In other words, the method is carried out in a display device, such as a screen, and by a control circuit, with the screen displaying the results of the method. This offers the advantage that three-dimensionality can be represented on a two-dimensional display without additional aids. A control circuit can include one or more processors that carry out the method for generating the parallax effect.The single processor or multiple processors can be coupled to a data memory in which program instructions can be stored which, when executed by the control circuit, cause it to carry out the said embodiment of the method.

[0018] One embodiment provides for a motor vehicle in which the aforementioned display device and the corresponding control circuit are installed. In other words, a virtual 3D image is displayed on a simple two-dimensional display in the motor vehicle, such as in an instrument cluster for displaying driving data to the driver. The corresponding control circuit that performs the process can be installed in the display or elsewhere in the motor vehicle. This offers the advantage that the installation space required for conventional three-dimensional displays in motor vehicles, which usually consist of several displays, can be reduced to a single display. This is easier to install in the motor vehicle and also more cost-effective.

[0019] The motor vehicle according to the invention is preferably designed as a motor vehicle, in particular as a passenger car or truck, or as a passenger bus or motorcycle.

[0020] The invention also includes combinations of the features of the described embodiments.

[0021] The following are exemplary embodiments of the invention described. This is illustrated by: Fig. 1. An overview of the system comprising an observer with two eyes looking centrally at a two-dimensional display medium; Fig. 2. The representation of a virtual world with three virtual levels depicted in a line of sight to the observer; and Fig. 3. The shift of the virtual planes when the observer's position shifts to the left.

[0022] The exemplary embodiments described below are preferred embodiments of the invention. In these exemplary embodiments, the described components each represent individual features of the invention, which can be considered independently of one another and each further develops the invention independently. Therefore, the disclosure is intended to include combinations of features of the embodiments other than those shown. Furthermore, the described embodiments can also be supplemented by further features of the invention already described.

[0023] In the figures, identical reference symbols denote functionally equivalent elements.

[0024] Fig. Figure 1 shows a two-dimensional display medium on the left. D The two-dimensional display medium D is in Fig. Figure 1 is shown at the very top in a frontal view. The two-dimensional display medium shows... D a colonnade consisting of three pairs of columns 1 , 2 and 3 The first pair of columns is marked with 1, the second pair with 2, and the third pair with 3. For clarity, the column pairs are 2 and 3 The colonnade is shown in black. Beneath the two-dimensional display medium. D It shows a top-down view of the two-dimensional display medium. D This two-dimensional display medium D Opposite is an observer B, who has two eyes A1 and A2 possesses. With the eyes A1 and A2 The user now sees in the lines of sight L1 and L2 on the two-dimensional display medium D and recognizes the colonnade 1 , 2 and 3The position of observer B is detected by the detection device S, which could be, for example, a camera or a sensor that detects movement. Observer B now looks at the center of the two-dimensional display medium. D In the two-dimensional display medium D There are now three virtual levels VE1, VE2 and VE3, located on the right side of the Fig. Figure 1 is shown. A pair of columns is now located on each of these virtual levels VE1, VE2, and VE3. 1 , 2 and 3 arranged. The order of arrangement is that on the virtual level VE1 the pair of columns 1 , on the virtual level VE2 the pair of columns 2 and on the virtual level VE3 the pair of columns 3 is shown. If the observer B now places himself in the center of the two-dimensional display medium. D Look, he sees the colonnade 1 , 2 and 3in a flight, so that he could see all six columns of the colonnade 1 , 2 and 3 This can be recognized. If the position of observer B changes, the virtual planes VE2 and VE3 can now be shifted relative to the virtual plane VE1 in such a way that a parallax effect is perceived by the eyes. A1 and A2 The simulation is performed as if observer B were actually moving his position from the middle of the colonnade. 1 , 2 and 3 changed and this view along the sight lines L1 and L2 on the columns of the colonnade 1 , 2 and 3 would now perceive it in a genuine way.

[0025] The one in Fig. The embodiment shown in Figure 1 corresponds exactly to the case where an observer B is in the middle in front of a colonnade. 1 , 2 and 3with three columns, and now looking from the front at all six columns of the colonnade 1 , 2 and 3 looks. Every movement of observer B along a plane horizontal to that of the colonnade. 1 , 2 and 3 This is now being simulated.

[0026] Fig. Figure 2 now shows on the left the case where observer B is looking at the colonnade 1 , 2 and 3 with the eyes A1 and A2 Look. These pairs of columns 1 , 2 and 3 are now depicted in a frontal view, analogous to the real colonnade. The pair of columns has... 1 from the pair of columns 2 the distance d12 and the pair of columns 2 from the pair of columns 3 the distance d23. Further up is the view of observer B on the pairs of columns. 1 , 2 and 3now displayed on the two-dimensional display medium in a front view. The respective pairs of columns are shown. 1 , 2 and 3 Numbered analogously. If the user now looks at the pairs of columns from the front. 1 , 2 and 3 Looking at the colonnade, one sees all the columns in line with the respective line of sight. L1 and L2 Further down in the frontal view are the respective lines of sight. L1 of the eye A1 of observer B to the pairs of columns 1 , 2 and 3 along the line of sight L1 The lines of sight are shown analogously. L1 and L2 to the pairs of columns 1 , 2 and 3 of the colonnade along the line of sight L2 On the right side of the Fig. 2 is now the two-dimensional display medium Drepresented in the virtual world. This virtual world comprises three virtual levels VE1, VE2, and VE3, with each level containing a pair of columns. 1 , 2 and 3 of the colonnade. These virtual levels VE1, VE2, and VE3 are now the first virtual level VE1, the second virtual level VE2, and the third virtual level VE3. Each of these virtual levels now contains a pair of columns. 1 , 2 and 3 The colonnade is depicted. The pair of columns is shown on the first virtual level VE1. 1 The column pair is shown on the second virtual level VE2. 2 The column pair is shown on the third virtual level VE3. 3 These virtual planes now also have the analogous distance d12 of the column pair. 1 to the pair of columns 2to each other. This also corresponds in the virtual world to the virtual distance d12 between virtual level VE1 and virtual level VE2. Furthermore, the distance d23 of the column pair forms 2 to the pair of columns 3 The same distance d23 between virtual plane VE2 and virtual plane VE3 is also maintained. This real world is then represented analogously in the virtual world. The observer's viewing direction is also depicted, including the perspective along the line of sight. L1 and also the line of sight L2 Observer B is positioned in front of the colonnade and is looking directly at the pairs of columns. 1 , 2 and 3 of the colonnade.

[0027] Fig. Figure 3 now shows the example on the left, that the observer B, who is in front of the colonnade 1 , 2 and 3The observer B is now moving to the left. This is represented by the second head, which is located to the left of head B. This also changes the direction of view of observer B. For example, on the left side in the line of sight... L1 the pillars 2 and 3 behind the pillar 1 hidden. The distances Δd2 and Δd3 of the columns 1 , 2 and 3 have positioned themselves in the line of sight L2 magnified. This effect is now displayed in a front view on the two-dimensional display medium. D As shown above. Analogous to this change in field of vision, the following now appear on the right side in Fig. 3. The virtual planes VE2 and VE3 are shifted relative to the virtual plane VE1 by distances Δd2 and Δd3, respectively. The virtual plane VE1 remains fixed, as does the view along the sight lines. L1 and L2 to the pair of columns 1has not changed. Thus, the columns of the pair of columns remain unchanged. 1 For observer B, it remains normally visible. The virtual plane VE2 is now shifted to the left by the distance Δd2 relative to the virtual plane VE1. This changes the column. 2 in the line of sight L1 from the pillar 1 concealed. This shift also moves the column. 2 further to the left opposite the line of sight L2 Furthermore, the virtual plane VE3 is shifted relative to the virtual plane VE2 by the distance Δd3. This causes the column to 3 behind the pillar 2 in the line of sight L1 is hidden and the pillar 3 opposite the column 2 it is shifted further to the left by the distance Δd3. This gradual shifting of the virtual planes represents the actual change in viewing angle along the viewing axes. L1 and L2in the colonnade. Analogously, depending on changes in position, the virtual planes VE2 and VE3 are shifted relative to the virtual plane VE1 along the direction of movement of observer B, either to the left or to the right. The intensity of the shift also represents the intensity of the change in position of observer B. If, in the example, observer B were now to move to the left side of the Fig. If 3 were moved even further to the left, the virtual planes VE3 and VE2 would be on the right side of the Fig. 3. Move further to the left so that the columns 2 and 3 back behind the pillar 1 become visible. The distance between the respective pairs of columns. 1 , 2 and 3 The distances between the virtual levels VE1, VE2 and VE3, which exist in the real world, are simulated in the virtual world.

[0028] The example of the colonnade is an embodiment of how the method works. The two-dimensional display medium D It can also represent any other virtual world.

[0029] The virtual generation of the parallax effect eliminates the need for a display medium with multiple two-dimensional elements. This allows for a three-dimensional representation of display elements on a two-dimensional screen. Furthermore, generating the depth effect through parallax means that the user does not need 3D glasses to experience a 3D effect.

[0030] The display medium can be a screen or monitor in a vehicle (for example, instrument cluster / center screen, virtual side mirror). This displays images that lie on a single image plane. However, these images on this single image plane have no depth effect, and therefore no spatial depth. The image in a display can be composed of several virtual layers. In a real three-dimensional world, this spatial depth is experienced through the two eyes ( A1 , A2) and during movement through spatial displacement across multiple planes. Now, a virtual 3D image is to be generated on the display. The 3D effect of the image on the display allows information to be layered in depth and prioritized. This prioritization can be determined by the design of the virtual world. The image on the display is constructed from several virtual layers. A camera captures the position of the head and eyes. The observer's movements are lateral or perpendicular to the display medium. When the position of the head and eyes changes, this is factored into the display so that the new image is modified, shifting the virtual layers and thus creating the impression of three-dimensionality, similar to a real image. The three virtual layers are digital depth projections.These three levels can each have individually defined virtual distances, determined by parameters. These depth parameters can then be modified by the programmer or the user via digital depth input. Furthermore, these depth parameters encompass not only the distances between the virtual levels but also the intensity of their movements and their response to changes in the user's position, thus determining sensitivity to small or large movements. Additionally, the depth parameters can define a trigger threshold, above which the system initiates a shift of the virtual levels relative to each other when the user's position changes. This provides a degree of tolerance before the system reacts to changes in the observer's position, allowing for adjustable sensitivity of the system to small movements by the observer.This allows both the depth and sensitivity of the system to be adjusted even during operation. The system's alignment can also be adapted. The camera can detect either the observer's eye position or specific head features, such as the eye socket or nose, which it uses as markers to detect changes in the observer's position.

[0031] Overall, the example shows how the invention can produce a three-dimensional effect on a two-dimensional display medium by generating a parallax effect.

[0032] Overall, the examples show how the invention can provide a virtual 3D display. QUOTES INCLUDED IN THE DESCRIPTION

[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature

[0000] DE 102014019122 A1

[0002] DE 102017203173 A1

[0003] DE 102017208339 A1

[0004]

Claims

[1] Method for generating a depth effect in the perspective of an observer (B) on a display medium by means of a spatial displacement of several planes according to an effect of parallax, characterized in that the display medium provides a two-dimensional display surface (D), the planes are provided as virtual planes (VE1, VE2, VE3) and, to generate the parallax when a change in the position of the eyes (A1, A2) of an observer (B) is detected by means of a camera and / or a sensor (S) configured to detect movements of the observer (B), the virtual planes (VE1, VE2, VE3) are then shifted relative to each other depending on the detected change in the position of the observer (B) on the two-dimensional display surface (D). [2] Method according to claim 1, wherein a two-dimensional display surface (D) displays a virtual world with several virtual planes (VE1, VE2, VE3) which, when the position of the eyes (A1, A2) of the observer (B) changes relative to the two-dimensional display surface (D), generates parallax by a computer-based displacement of the respective virtual planes (VE1, VE2, VE3) relative to each other in the virtual world, wherein an amount of displacement (Δd2, Δd3) is determined depending on a respective virtual distance of the respective plane to the observer (B). [3] Method according to any of the preceding claims, wherein the change in position of the eyes (A1, A2) of the observer (B) is based on a movement of the eyes (A1, A2) of the observer (B) alone, or a movement of the head of the observer (B) alone, or a mixed movement of the eyes (A1, A2) and the head of the observer (B). [4] Method according to any of the preceding claims, wherein the number of virtual levels (VE1, VE2, VE3) in the virtual world on the two-dimensional display medium (D) is two levels or more than two levels. [5] Method according to one of the preceding claims, wherein in the two-dimensional display medium (D) one or more display elements are displayed in a staggered depth according to priority data which specifies a priority of the respective display elements among themselves. [6] Method according to one of the preceding claims, wherein distances (d12, d23) of the virtual planes (VE1, VE2, VE3) to each other in the virtual world for display on the two-dimensional display medium (D) are adjustable via a user interface. [7] Method according to one of the preceding claims, wherein the intensity of the displacement (Δd2, Δd3) of the virtual planes (VE1, VE2, VE3) in the virtual world for generating the parallax on the two-dimensional display medium (D) is adjustable. [8] Method according to one of the preceding claims, wherein a trigger threshold for detecting the change in position of the eyes (A1, A2) of the observer (B) is adjustable via a configuration interface. [9] Device configured as a display device and / or as a control circuit and configured to carry out an embodiment of the method according to any one of claims 1 to 8. [10] Motor vehicle comprising a display device and / or a control circuit according to claim 9.

Images