Apparatus and method for displaying image according to line-of-sight direction

Abstract

A device (102) for displaying an image according to a line-of-sight direction comprises: a display layer (322) designed to generate different images at different points in time; an illumination device (320) designed to illuminate the display layer (322) with light having different directions at different points in time in order to project images generated by the display layer in different directions; the lighting device (320) comprises a display layer (322) and, optionally, a touch-sensitive surface (324) designed to provide a position signal indicative of a position in response to a touch at the position, where the display layer (322) is arranged between the touch-sensitive surface (324) and the lighting device (320).

Description

Technical Field

[0001] The starting point of this invention is an apparatus or method as described in the preamble of an independent claim. The subject matter of this invention is also a computer program. Background Technology

[0002] Today, various display devices are used everywhere to present information to viewers, such as mobile phones, computers, medical monitoring equipment, car dashboards, and so on. At the same time, much effort has been made to improve display performance. On the one hand, many technologies are being developed to improve the pure image quality of displays, such as pixel density, color gamut, brightness, and contrast. On the other hand, consumers expect screens to have more additional functions for human-machine interfaces (HMIs), such as privacy modes, split-view displays, and 3D perception. Summary of the Invention

[0003] Against this backdrop, utilizing the solutions proposed herein, an apparatus and method for displaying images according to the direction of gaze are proposed according to the independent claim, and finally, a corresponding computer program according to the independent claim is proposed. Advantageous extensions and improvements to the apparatus described in the independent claim are possible through the measures mentioned in the dependent claims.

[0004] Advantageously, the scheme can combine the input possibilities through the touch-sensitive surface to achieve image display based on the direction of the gaze.

[0005] A device for displaying images based on the direction of gaze (e.g., for use in vehicles or consumer applications) has the following characteristics: A display layer designed to: generate a first image at a first time point using a first image signal, and generate a second image extending across the entire display layer at a second time point using a second image signal; An illumination device designed to: at a first time point, using a first direction signal, illuminate a display layer with light having a first direction assigned to the first direction signal, so as to project a first image generated by the display layer toward a first viewer; and at a second time point, using a second direction signal, illuminate the display layer with light having a second direction assigned to the second direction signal, so as to project a second image generated by the display layer at least toward a second viewer; and Optionally, a touch-sensitive surface is designed to provide a position signal indicating a location in response to a touch at a certain location, wherein a display layer is disposed between the touch-sensitive surface and the lighting device.

[0006] Instead of touch-sensitive surfaces, other technologies can be used for interaction. These other technologies do not necessarily have to be touch-sensitive, such as touch panels, pressure-sensitive surfaces, proximity sensing, IR detection, camera tracking of fingers, gesture control, and indirect operation via other devices (touchpads, mice, etc.). The corresponding elements for detecting finger positions can be placed at any suitable location on the device. The sole purpose is to be able to divide the display into different sections and then assign corresponding functions to these sections.

[0007] The device can be implemented, for example, as a display in a vehicle, a display in a mobile device, or a television. Advantageously, two or more people can view the device from different perspectives, and different images are displayed. The display layer, lighting device, and touch-sensitive surface can be implemented in separate layers and arranged in a stacked manner. Here, the touch-sensitive surface can be arranged on the surface of the device visible to the viewer. Corresponding to known displays, the display layer can include a field composed of image dots, which can be manipulated in a suitable manner to generate images. For example, the display layer can be molded as a liquid crystal display. Here, the display layer can always be used entirely at any given time. Therefore, the entire display layer can always be driven. Here, different images can be presented in various frames or segments, and the corresponding radiation direction can be set by manipulating the backlight unit and the barrier. When using a continuous first image signal, images of a first image sequence can be generated, and these images can be viewed by a first viewer from a first perspective. Correspondingly, when using a continuous second image signal, images of a second image sequence can be generated, and these images can be viewed by a second viewer from a second perspective. In one implementation, the first viewer cannot see the images of the second image sequence, and the first viewer cannot see the images of the first image sequence. For the lighting device, suitable techniques can be used that enable the display layer to be illuminated with light of different orientations. Thus, for example, at a first time point, light can be directed to the back of the display layer at a first angle, and at a second time point, light can be directed to the back of the display layer at a second angle different from the first angle. Here, these directional signals can be designed to: control the lighting device so that the display layer is always entirely backlit, wherein the backlight direction is adjusted to align with the viewing direction of different viewers or their eyes (for 3D). The direction in which the image is projected can define the angle value of the light leaving the display layer, or it can define the projection target that the light leaving the display layer is directed towards. Such a projection target could be, for example, one of the viewers' eyes.

[0008] The touch-sensitive surface can extend across the entire display area of ​​the display layer. For the touch-sensitive surface, technologies known from so-called touchscreens or touch panels can be utilized. Therefore, the device can realize a touchscreen through which images visible from different viewing angles can be displayed. This, for example, enables HMI applications based on an autostereoscopic 3D display with additional privacy and split-screen display capabilities.

[0009] The device may include a control unit designed to determine a first image signal and a second image signal using first image data assigned to a first image and second image data assigned to a second image. The first image signal may be provided to the interface of the display layer at a first time point, and the second image signal may be provided to the interface of the display layer at a second time point. In this way, the image content to be displayed can be converted into image signals suitable for manipulating the display layer when using the control unit. The control unit may also be designed to determine at least a first direction signal and a second direction signal, and to provide the first direction signal to the interface of the lighting device at a first time point and the second direction signal to the interface of the lighting device at a second time point. In this way, the display layer can be illuminated at different time points, such that the image generated by the display layer at each time point is only visible to a viewer viewing the display layer from a specific angle. This scheme can also be extended to other viewers and directions accordingly.

[0010] In one embodiment, for direction control, not only the backlight unit but also the blocking layer is manipulated. The signal to the backlight unit is designed as two different signals to align in two directions. The corresponding approach applies to the blocking layer and also to the display layer used to display the image.

[0011] However, as described in the claims, the direction signal can also be sent to the entire lighting device 320 without specifying which layer.

[0012] We should consider more directions.

[0013] In one embodiment, the control device can be designed to determine an image signal using position signals, and additionally or alternatively, to determine a direction signal. In this way, a user can intervene in the display of the image by touching a touch-sensitive surface. Here, the control device can be designed to determine the image signal and / or direction signal using either the currently read position signal or a stored position signal. Temporally continuous position signals can also be used to determine the image signal and additionally or alternatively determine the direction signal. For example, a first sequence of position signals can be used to divide the display layer into segments, and a second sequence of position signals can be used to assign projection directions to each segment. Accordingly, multiple position signals can be used for the embodiments described herein and below, even if an embodiment is described based on only one position signal.

[0014] For example, the control device can be designed to: during the segmentation phase, define the orientation of a first segment and the orientation of at least one second segment using position signals. Accordingly, the control device can be designed to: determine a first image signal using first image data and the orientation of the first segment; and determine a second image signal using second image data and the orientation of the second segment. In this way, a user can specify, for example, the size and / or position of the image by touching a touch-sensitive surface. The orientations of these segments can be maintained after the segmentation phase ends.

[0015] The control device can be designed to: during the segmentation phase, determine a dividing line extending on the display layer using positions indicated by time-sequential position signals, defining the orientation of the first segment as the surface of the display layer located on a first side of the dividing line, and defining the orientation of at least one second segment as the surface of the display layer located on a second side of the dividing line. This allows a user, for example, to slide their finger across a touch-sensitive surface, where a series of continuous position signals depicts the temporal progression of this continuous touch. This series of position signals can be used by the control device for segmenting the display layer.

[0016] Additionally or alternatively, the control device can be designed to: define a first direction and a second direction during the function assignment phase, and assign the first direction signal to the first direction and the second direction signal to the second direction. To assign these direction signals to the blocking layer and the backlight unit, the direction of the viewer's or the eye to be aligned (position signal), the segmentation of the display, and the function assignment to each segment (2D / 3D, public / private, etc.) are required as information. In this way, the user can specify the projection direction of the image by touching a touch-sensitive surface in an appropriate manner. The same position signal can be used in both the segmentation and assignment phases, or different position signals can be used. For example, at least one position signal can be used first to segment the display layer, and then at least one additional position signal can be used to define the projection direction for at least one segment.

[0017] According to one embodiment, for 3D generation, the following image and orientation are generated: Frame 1: An image, such as navigation, overlaid with a frame representing a call or message (user 1's privacy information). This image is displayed across the entire frame. The backlight unit emits light towards user 1 (e.g., the driver); Frame 2: Image, such as navigation, is the same as Frame 1, but without overlaid "privacy information". Backlit towards User 2. Therefore, User 1 will receive navigation with overlaid private information. User 2 will only receive public information (navigation).

[0018] During the function assignment phase, functions (2D / 3D, public / private) are assigned to each segment. This is done by selecting the corresponding button, which appears immediately after the segmentation phase and segment selection. If necessary, more or fewer than three buttons can be selected here.

[0019] For example, the control device could be designed to define these directions during the assignment phase, using position signals that can be assigned to predefined selection areas. The selection areas could be presented to the user graphically, such as as button boxes, when using a display layer. In this way, the user can touch a specific selection area, and the control device could be designed to specify the user's desired projection direction using position signals indicating that the selection area has been touched. For example, in each of these segments, a corresponding selection area could be presented, allowing the user to specify the desired projection direction for each segment by touching the corresponding selection area.

[0020] The control device can be designed to: determine a first direction signal when using a first positioning signal indicating the position of a first viewer; and determine a second direction signal when using a second positioning signal indicating the position of a second viewer. These positioning signals can indicate the position of the respective viewer relative to the device, such as the position of one of the viewer's eyes relative to the device. Known methods, such as eye-tracking methods, can be used to determine the position and provide the corresponding positioning signal. Advantageously, when using these positioning signals, a response can be made to changes in the viewer's gaze direction.

[0021] According to one embodiment, the device can be used to alternately present images to a viewer's right and left eyes. This achieves a 3D effect. For this purpose, the display layer can be designed to: at a further first time point, using a further first image signal, generate a further first image extending onto the display layer; and at a further second time point, using a further second image signal, generate a further second image extending onto the display layer. The illumination device can be designed to: at the further first time point, using a further first direction signal, illuminate the display layer with light having a further first direction assigned to the further first direction signal, so as to project the further first image generated by the display layer toward the other eye of a first viewer; and at a further second time point, using a further second direction signal, illuminate the display layer with light having a further second direction assigned to the further second direction signal, so as to project the further second image generated by the display layer toward the other eye of a second viewer. The control device can be designed to: provide an additional first image signal to the interface of the display layer at a further first time point and provide an additional second image signal to the interface of the display layer at a further second time point; and can be designed to: determine the additional first direction signal and the additional second direction signal, and provide the additional first direction signal to the interface of the lighting device at a further first time point and provide the additional second direction signal to the interface of the lighting device at a further second time point. The first image and the additional first image can be modified to produce a 3D effect for a first viewer. Correspondingly, the second image and the additional second image can be modified to produce a 3D effect for a second viewer.

[0022] For 3D, slightly different images are sent to each eye. The images / scenes are consistent in size and overall, but slightly shifted, just as a person's left and right eyes always view a scene from two slightly different directions.

[0023] The image will, of course, be displayed on the entire surface. Only the backlight will radiate in a slightly different direction.

[0024] If one segment is displayed in 3D and another in 2D, an image will be generated in the first frame containing content for the left eye in the 3D segment and the corresponding content in the 2D segment. Then, in the second frame, the content for the right eye will be in the 3D segment, and the same content as in frame 1 will be in the 2D segment. In this way, one part of the display will be 3D and the other part will be 2D.

[0025] Accordingly, for two users, four images must be used to work.

[0026] According to one embodiment, the illumination device may include: a planar backlight unit for emitting non-directional background light; a lens having an array of plano-convex cylindrical lenses, wherein each of these cylindrical lenses is designed to: converge the background light rays into directional light and deflect them onto the display layer in a ray direction, wherein the ray direction depends on the relative position between the cylindrical lens and the starting point of the light rays on the backlight unit that are allocated to the cylindrical lens; and a blocking layer disposed between the backlight unit and the lens. Here, the blocking layer may have a grating composed of regions that can be switched between a light-transmitting state and a light-blocking state, wherein the blocking layer is designed to: switch to the light-blocking state by selecting these regions through a selection of one of these directional signals when using these directional signals.

[0027] Corresponding to known displays, the backlight unit can provide backlight for the image generator layer. A lens can be used to converge the diffused light of the backlight and guide directional light to image points on the image generator layer. If the backlight light strikes the lens from different directions, the lens can deflect the light along different ray directions. When using a blocking layer, the backlight light can be filtered so that the light rays passing through the blocking layer strike the lens only from a defined direction, and are therefore deflected by the lens only along the defined direction. For this purpose, the area of ​​the blocking layer can be switched in an appropriate manner. For example, a defined pattern of areas in an opaque state can be formed. Advantageously, the corresponding pattern can be changed using an adjustment device to change the projection direction of the image generated by the image generator layer.

[0028] If images belonging to different image sequences (e.g., two different television programs) are generated from the projection direction using time-division multiplexing, the adjustment device can be designed to cause the region of the blocking layer to switch between the first pattern and the second pattern synchronously with the generation of these different image sequences.

[0029] A method for displaying an image based on the direction of gaze when using the device includes the following steps: A first image extending onto the display layer is generated at a first time point using a first image signal, and a second image extending onto the display layer is generated at a second time point using a second image signal. At a first time point, when using a first direction signal, the display layer is illuminated with light having a first direction assigned to the first direction signal, so as to project a first image generated by the display layer toward a first viewer; and at a second time point, when using a second direction signal, the display layer is illuminated with light having a second direction assigned to the second direction signal, so as to project a second image generated by the display layer toward a second viewer; and In response to touching the touch-sensitive surface at a certain location, a position signal indicating that location is provided.

[0030] This method can be implemented, for example, in software, hardware, or a hybrid of software and hardware, such as in a control device.

[0031] The proposed solution also provides a control device designed to perform, manipulate, or implement steps of variations of the proposed method within a corresponding apparatus. This device-based embodiment of the invention also allows for the rapid and efficient resolution of the task on which the invention is based.

[0032] Therefore, the control device may include: at least one computing unit for processing signals or data; at least one storage unit for storing signals or data; at least one interface to a sensor or actuator for reading sensor signals from the sensor or outputting data signals or control signals to the actuator; and / or at least one communication interface for reading or outputting data embedded in a communication protocol. The computing unit may be, for example, a signal processor, a microcontroller, or the like, and the storage unit may be a flash memory or a magnetic storage unit. The communication interface may be designed to read or output data wirelessly and / or wiredly, wherein the communication interface for reading or outputting wired data may, for example, electrically or optically read such data from a corresponding data transmission line or output such data to a corresponding data transmission line, for example, electrically or optically.

[0033] The vehicle's device for displaying images based on the direction of the gaze has the following characteristics: A display layer is designed to: generate a first image extending over a first segment of the display layer at a first time point using a first image signal, and generate a second image extending over a second segment of the display layer at a second time point using a second image signal; An illumination device designed to: at a first time point, using a first direction signal, illuminate a display layer with light having a first direction assigned to the first direction signal to project a first image generated by the display layer toward a first viewer; and at a second time point, using a second direction signal, illuminate the display layer with light having a second direction assigned to the second direction signal to project a second image generated by the display layer toward a second viewer; and A touch-sensitive surface is designed to provide a position signal indicating a location in response to a touch at a location, wherein a display layer is disposed between the touch-sensitive surface and the lighting device.

[0034] The device can be implemented, for example, as a display in a vehicle, a display in a mobile device, or a television. Advantageously, two people can view the device from different perspectives, and different images are displayed. The display layer, lighting device, and touch-sensitive surface can be implemented in separate layers and arranged in a stacked manner. Here, the touch-sensitive surface can be arranged on the surface of the device visible to the viewer. Corresponding to known displays, the display layer can include a field composed of image dots that can be manipulated in a suitable manner to generate images. For example, the display layer can be molded as a liquid crystal display. Here, images may not be generated over the entire display area of ​​the display layer, but only in a portion of the display area, i.e., a so-called segment. When using a continuous first image signal, images of a first image sequence can be generated in the first segment, and these images can be seen by a first viewer from a first perspective. Correspondingly, when using a continuous second image signal, images of a second image sequence can be generated in the second segment, and these images can be seen by a second viewer from a second perspective. According to one embodiment, the first viewer cannot see the images of the second image sequence, and the first viewer cannot see the images of the first image sequence. For the lighting device, suitable techniques can be used that enable the display layer to be illuminated using light with different orientations. Thus, for example, at a first time point, light can be directed to the back of the display layer at a first angle, and at a second time point, light can be directed to the back of the display layer at a second angle different from the first angle. Here, a first direction signal can be designed to control the lighting device so that only a first segment of the display layer is illuminated at the first time point. Correspondingly, a second direction signal can be designed to control the lighting device so that only a second segment of the display layer is illuminated at the second time point. The direction in which the image is projected can define the angle at which the light leaves the display layer, or it can define the projection target that the light leaving the display layer is aimed at. Such a projection target could, for example, be one of the eyes of a viewer.

[0035] The touch-sensitive surface can extend across the entire display area of ​​the display layer. For the touch-sensitive surface, technologies known from so-called touchscreens or touch panels can be utilized. Therefore, the device can realize a touchscreen through which images visible from different viewing angles can be displayed. This, for example, enables HMI applications based on an autostereoscopic 3D display with additional privacy and split-screen display capabilities.

[0036] The device may include a control unit designed to determine a first image signal and a second image signal using first image data assigned to a first image and second image data assigned to a second image. The first image signal may be provided to the interface of the display layer at a first time point, and the second image signal may be provided to the interface of the display layer at a second time point. In this way, the image content to be displayed can be converted into image signals suitable for manipulating the display layer when using the control unit. The control unit may also be designed to determine a first direction signal and a second direction signal, and to provide the first direction signal to the interface of the lighting device at a first time point and the second direction signal to the interface of the lighting device at a second time point. In this way, the display layer can be illuminated at different time points, such that the image generated by the display layer at each time point is only visible to a viewer viewing the display layer from a specific angle.

[0037] In one embodiment, the control device can be designed to determine an image signal using position signals, and additionally or alternatively, to determine a direction signal. In this way, a user can intervene in the display of the image by touching a touch-sensitive surface. Here, the control device can be designed to determine the image signal and / or direction signal using either the currently read position signal or a stored position signal. Temporally continuous position signals can also be used to determine the image signal and additionally or alternatively determine the direction signal. For example, a first sequence of position signals can be used to divide the display layer into segments, and a second sequence of position signals can be used to assign projection directions to each segment. Accordingly, multiple position signals can be used for the embodiments described herein and below, even if an embodiment is described based on only one position signal.

[0038] For example, the control device can be designed to define the orientation of a first segment and a second segment during the segmentation phase, using position signals. Correspondingly, the control device can be designed to determine a first image signal using first image data and the orientation of the first segment; and to determine a second image signal using second image data and the orientation of the second segment. In this way, the user can specify, for example, the size and / or position of the image by touching a touch-sensitive surface. After the segmentation phase ends, the orientation of these segments can be maintained such that, following the segmentation phase, the first image to be displayed is continuously generated in the first segment, and the second image to be displayed is continuously generated in the second segment.

[0039] The control device can be designed to: during the segmentation phase, determine a dividing line extending on the display layer using positions indicated by time-sequential position signals, defining the orientation of the first segment as the surface of the display layer located on a first side of the dividing line, and defining the orientation of the second segment as the surface of the display layer located on a second side of the dividing line. This allows a user, for example, to slide their finger across a touch-sensitive surface, where a series of continuous position signals depicts the temporal progression of this continuous touch. This series of position signals can be used by the control device for segmenting the display layer.

[0040] Additionally or alternatively, the control device may be designed to: define a first direction and a second direction using the position signal during the assignment phase, and assign the first direction to the first direction signal and the second direction to the second direction signal. In this way, the user can specify the projection direction of the image by touching the touch-sensitive surface in an appropriate manner. The same position signal may be used in both the segmentation and assignment phases, or different position signals may be used. For example, at least one position signal may be used first to segment the display layer, and then at least one additional position signal may be used to define the projection direction for at least one segment.

[0041] During this assignment phase, the control device can be designed to: define a third direction when using the position signal, and also assign the third direction to the first direction signal. The illumination device can be designed to: at a first time point, when using the first direction signal, illuminate the display layer with light that also has a third direction assigned to the first direction signal, so as to project a first image generated by the display layer towards the direction of the first viewer. In this way, the first image can be seen not only by the first viewer but also by a second viewer, while the second image can only be seen by the second viewer.

[0042] For example, the control device could be designed to define these directions during the assignment phase, using position signals that can be assigned to predefined selection areas. The selection areas could be presented to the user graphically, such as as button boxes, when using a display layer. In this way, the user can touch a specific selection area, and the control device could be designed to specify the user's desired projection direction using position signals indicating that the selection area has been touched. For example, in each of these segments, a corresponding selection area could be presented, allowing the user to specify the desired projection direction for each segment by touching the corresponding selection area.

[0043] The control device can be designed to: determine a first direction signal when using a first positioning signal indicating the position of a first viewer; and determine a second direction signal when using a second positioning signal indicating the position of a second viewer. These positioning signals can indicate the position of the respective viewer relative to the device, such as the position of one of the viewer's eyes relative to the device. Known methods, such as eye-tracking methods, can be used to determine the position and provide the corresponding positioning signal. Advantageously, when using these positioning signals, a response can be made to changes in the viewer's gaze direction.

[0044] According to one embodiment, the device can be used to alternately present images to a viewer's right and left eyes. This achieves a 3D effect. For this purpose, the display layer can be designed to: at a further first time point, using a further first image signal, generate a further first image extending over a first segment of the display layer; and at a further second time point, using a further second image signal, generate a further second image extending over a second segment of the display layer. The illumination device can be designed to: at the further first time point, using a further first direction signal, illuminate the display layer with light having a further first direction assigned to the further first direction signal, so as to project the further first image generated by the display layer toward the other eye of a first viewer; and at a further second time point, using a further second direction signal, illuminate the display layer with light having a further second direction assigned to the further second direction signal, so as to project the further second image generated by the display layer toward the other eye of a second viewer. The control device can be designed to: provide an additional first image signal to the interface of the display layer at a further first time point and provide an additional second image signal to the interface of the display layer at a further second time point; and can be designed to: determine the additional first direction signal and the additional second direction signal, and provide the additional first direction signal to the interface of the lighting device at a further first time point and provide the additional second direction signal to the interface of the lighting device at a further second time point. The first image and the additional first image can be modified to produce a 3D effect for a first viewer. Correspondingly, the second image and the additional second image can be modified to produce a 3D effect for a second viewer.

[0045] According to one embodiment, the illumination device may include: a planar backlight unit for emitting non-directional background light; a lens having an array of plano-convex cylindrical lenses, wherein each of these cylindrical lenses is designed to: converge the background light rays into directional light and deflect them onto the display layer in a ray direction, wherein the ray direction depends on the relative position between the cylindrical lens and the starting point of the light rays on the backlight unit that are allocated to the cylindrical lens; and a blocking layer disposed between the backlight unit and the lens. Here, the blocking layer may have a grating composed of regions that can be switched between a light-transmitting state and a light-blocking state, wherein the blocking layer is designed to: switch to the light-blocking state by selecting these regions through a selection of one of these directional signals when using these directional signals.

[0046] Corresponding to known displays, the backlight unit can provide backlight for the image generator layer. A lens can be used to converge the diffused light of the backlight and guide directional light to image points on the image generator layer. If the backlight light strikes the lens from different directions, the lens can deflect the light in different directions. When using a blocking layer, the backlight light can be filtered so that the light passing through the blocking layer strikes the lens only from a defined direction and is therefore deflected by the lens only along the defined direction. For this purpose, the area of ​​the blocking layer can be switched in an appropriate manner. For example, a defined pattern of areas in an opaque state can be formed. Advantageously, the corresponding pattern can be changed using an adjustment device to change the projection direction of the image generated by the image generator layer.

[0047] If images belonging to different image sequences (e.g., two different television programs) are generated from the projection direction using time-division multiplexing, the adjustment device can be designed to cause the region of the blocking layer to switch between the first pattern and the second pattern synchronously with the generation of these different image sequences.

[0048] A method for displaying an image in a vehicle based on the direction of gaze when using the device includes the following steps: A first image extending over a first segment of the display layer is generated at a first time point using a first image signal, and a second image extending over a second segment of the display layer is generated at a second time point using a second image signal. At a first time point, when using a first direction signal, the display layer is illuminated with light having a first direction assigned to the first direction signal, so as to project a first image generated by the display layer toward a first viewer; and at a second time point, when using a second direction signal, the display layer is illuminated with light having a second direction assigned to the second direction signal, so as to project a second image generated by the display layer toward a second viewer; and In response to touching the touch-sensitive surface at a certain location, a position signal indicating that location is provided. Attached Figure Description

[0049] Embodiments of the proposed solution are shown in the accompanying drawings and will be described in more detail in the following description. Wherein: Figure 1 A schematic diagram of a cockpit is shown, which includes an embodiment of a device for displaying images according to the direction of the line of sight; Figure 2 The device according to an embodiment is shown; Figure 3A schematic diagram of a device for displaying an image according to a viewing direction, according to an embodiment, is shown; Figure 4 A block diagram of an embodiment of a device for displaying images according to the direction of gaze is shown; Figure 5 The system configuration of the first subframe rendered by the device is shown; Figure 6 The system configuration of the second subframe presented by the device is shown; Figure 7 The system configuration of the third subframe presented by the device is shown; Figure 8 The system configuration of the fourth subframe presented by the device is shown; Figure 9 The arrangement of sub-images is shown when using the device according to the embodiment; Figure 10 A diagram illustrating the methods used to define elements at different levels is shown; Figure 11 A diagram illustrating the images required as input information for HMI design is shown. Figure 12 Touch control of the device according to an embodiment is shown; Figure 13a , Figure 13b , Figure 13c The device according to an embodiment is shown to assign functions via touch control; Figure 14a , Figure 14b , Figure 14c This illustrates another application of the HMI solution for the device according to the embodiment; Figure 15 A backlight device based on parallax barrier 3D technology is shown; and Figure 16 A flowchart of a method for displaying an image according to a viewing direction, according to an embodiment, is shown. Detailed Implementation

[0050] In the following description of advantageous embodiments of the invention, the same or similar reference numerals are used for elements shown in different figures and serving similar functions, wherein repeated descriptions of these elements are omitted.

[0051] Figure 1A schematic diagram of a vehicle 100 is shown, which has an embodiment of a device 102 for displaying images according to the direction of gaze. Exemplarily, device 102 is part of a display panel 104, which optionally also includes a central display 106 and a display 108. Exemplarily, device 102 is implemented as a passenger information display (PID), also known as a passenger information display with switchable privacy features, or simply a display. Vehicle 100 is, for example, a passenger vehicle in which both the driver and passengers can view device 102. Advantageously, device 104 can be operated to display different images to different viewers.

[0052] Figure 2 The basis is shown Figure 1 This is a schematic diagram of an embodiment of a device 102 for displaying images based on the direction of gaze. To illustrate the operation of switchable privacy, a first viewer 210 and a second viewer 212 are shown. The device 102 is designed to present images in both a public mode and a privacy mode. Exemplarily, the device 102 is designed to project a first image toward the first viewer 210 (e.g., the driver) in public mode, and a second image toward the second viewer 212 (e.g., the passenger) in privacy mode.

[0053] According to one embodiment, the display of device 102 can switch between two different modes depending on the type of content displayed. In public mode, the driver and passengers can see the same display content, which requires a wide viewing angle of the display. In privacy mode, the display is switched to a narrow viewing angle so that only passengers can see the displayed content, while the driver cannot receive the image. Privacy mode is designed to reduce the risk of driver distraction when certain entertainment content is displayed on the PID display.

[0054] Furthermore, according to one embodiment, device 102 can be used as an automated stereoscopic 3D display for vehicle displays. Advantageously, it can display not only two-dimensional (2D) planar images lacking depth information. On a 2D display, the viewer sees the same image from any viewing position. Therefore, in conventional 2D displays, two important depth information elements are missing: motion parallax and binocular parallax. Consequently, spatial relationships or depth information cannot be correctly and effectively presented on a 2D display. Using the scheme described herein, device 102 can be used as an automated stereoscopic 3D display that can provide the missing depth information to the driver or passenger without requiring them to wear special glasses. Thus, not only can 3D scenes be clearly presented, such as for navigation, but depth information can also be provided to warning signals to emphasize their effect. For example, using device 102, two vehicles traveling in front and behind each other and a triangular warning sign in front, as seen from the driver's perspective, can be presented in three dimensions to alert the driver to the danger of a rear-end collision.

[0055] In conjunction with device 102, according to one embodiment, eye-tracking technology is employed, enabling numerous novel display applications for self-emissive displays. The use of eye-tracking methods allows for specific image processing based on the user's position. Compared to currently prevalent liquid crystal display (LCD) technologies, self-emissive displays, such as OLED and micro-LED, offer better response times and energy efficiency. This enables time-division multiplexing methods to improve image quality. Based on the eye-tracking device and the self-emissive display, autostereoscopic displays with specially developed directional backlighting can be realized, providing viewers with the full resolution of the display. According to one embodiment, device 102 utilizes a novel autostereoscopic 3D display design also based on these two technologies. This novel display design allows for the creation of numerous new and practical HMI applications.

[0056] Taking current switchable privacy technology as an example, several limitations exist. First, there might be a limitation on viewing direction. Here, privacy mode is not only applicable to side viewers outside the axis, but also ensures that viewers in the center viewing area always see the displayed content. Reverse application is not allowed. Furthermore, there are content limitations. Side viewers outside the center area either see the same screen content as those in the center area, or they see a black screen. It's impossible to send two different images to two viewers. Additionally, there are area limitations. Privacy mode always applies to the entire display area. More precisely, privacy mode cannot be applied to only a portion of the screen.

[0057] Such limitations can be circumvented using the device 102 described herein. Here, a novel HMI solution can be implemented, which can be based on a novel 3D display design.

[0058] Figure 3 A schematic diagram of a device 102 for displaying images according to a viewing direction, according to an embodiment, is shown. Device 102 can be used, for example, as a screen in a vehicle, as described above. Figure 1 The above, or used in multimedia devices, such as televisions or any other display applications (smartphones, laptops, etc.).

[0059] Device 102 has a stack consisting of an illumination device 320, a display layer 322, and a touch-sensitive surface 324. The touch-sensitive surface 324 can be implemented as a so-called touch panel, and represents the screen surface visible to the viewer. In one embodiment, the touch-sensitive surface 324 completely covers the display layer 322. In another embodiment, the touch-sensitive surface 324 and the display layer 322 are directly adjacent to each other.

[0060] According to one embodiment, the illumination device 320 has a backlight unit 326, a blocking layer 328, and a lens 330. The backlight unit 326 is implemented as a flat surface and is designed to emit non-directional background light. By way of example only, the backlight unit 326 includes multiple light sources for emitting diffuse light toward the display layer 322. The blocking layer 328 is disposed between the backlight unit 326 and the lens 330. The blocking layer 328 has a grating composed of regions that can switch between a light-transmitting state and a light-blocking state. By way of example only, the blocking layer 328 is molded as a liquid crystal display, wherein each of these regions can, for example, be formed as a pixel or a group of pixels of the liquid crystal display. Alternatively, the blocking layer 328 can be micromechanically molded, wherein each of these regions is formed, for example, by a foldable light-blocking sheet manufactured using microsystems technology.

[0061] For example, the blocking layer 328 can be manipulated using at least one direction signal to define the direction in which light emitted by the backlight unit 326 strikes the display layer 322. According to one embodiment, for this purpose, the direction signal defines selections from regions of the blocking layer 328 that have been switched to or are currently switched to a transparent state, or alternatively switched to or are currently switched to an opaque state. The blocking layer 328 is designed to accordingly switch the region selection defined by the direction signal, for example, switching it to an opaque state.

[0062] Lens sheet 330 includes an array of plano-convex cylindrical lenses. Lens sheet 330 is implemented, for example, as a lens film. In one embodiment, these cylindrical lenses are arranged parallel to each other in a plane. In another embodiment, adjacent cylindrical lenses are abutted each other without gaps. In another embodiment, on the blocking layer 328 side, these cylindrical lenses each have a flat bottom surface, and on the display layer 322 side, these cylindrical lenses each have an outwardly convex surface. Each of these cylindrical lenses is designed to converge the background light emitted by the backlight unit 326, which has passed through the blocking layer 328, into a directional light and deflect it onto the display layer 322 in a ray direction. Here, the ray direction of the directional light leaving the cylindrical lens depends on the relative position between the respective cylindrical lens and the starting point of the light on the backlight unit 326 that is assigned to the cylindrical lens.

[0063] For the lens array of lens element 330, using glass or plastic to construct the lens structure is a convenient solution. It should be noted that some newer optical technologies can also achieve this function. For example, liquid crystals or other special liquid materials can be used to refract light.

[0064] Display layer 322 is designed to generate temporally continuous images. Here, the projection direction of the image currently generated by display layer 322 depends on the direction of light rays oriented by lens 330 and incident on display layer 322 from one side of lens 330. For illustrative purposes only, display layer 322 is shaped as a liquid crystal display. The image points of display layer 322 are manipulated, for example, in a manner controlled by image signals, to generate the currently projected image. Ultimately, all solutions using any technique capable of rapidly and sequentially projecting images are applicable. The specific implementation is secondary. Our solution with segmented backlighting, a blocking layer, and a lens array is only one possible solution. In an alternative embodiment, if two directions are defined, collimated backlights in both directions are used, which can be switched in a rapid temporal sequence.

[0065] According to one embodiment, the structure of the device 102, which is implemented as a 3D display, includes a touch-sensitive surface 324, such as a so-called touch panel layer, which is added to the display layer 322.

[0066] According to one embodiment, the device 102, implemented as a display, is configured in... Figure 3 The diagram illustrates an improvement to the display structure without a touch-sensitive surface 324. For example, the touch-sensitive surface 324, implemented as a touch panel, is used to detect the user's finger touch. Therefore, for device 102, a total of five key components are required to construct the display system, such as... Figure 3As shown in the diagram. Different backlight components can be used for the backlight unit 326, such as LCD, Mikro-LED, Mini-LED, LED array, or OLED. According to one embodiment, the response time of the backlight unit 326, as well as the display layer 322 and the blocking layer 328, is faster than 240 Hz (4.2 ms).

[0067] Device 102 enables switchable privacy methods to introduce new HMI options, such as additional degrees of freedom, allowing for privacy modes not only for the driver but also for passengers. Furthermore, it enables split-screen display, where the driver and passenger can see different images on the display. It also enables 3D perception, where the user can receive 3D content with depth information. Additionally, it allows for the free definition of so-called Region of Interest (ROI). Therefore, special functions, such as privacy mode, split-screen display, and 3D perception, can be defined on specific areas of the screen. An interactive human-machine interface (HMI) is implemented via touch-sensitive surface 324. The user can determine the area on the display where special functions should be displayed.

[0068] Figure 4 A block diagram of an embodiment of a device 102 for displaying images according to the direction of gaze is shown. An illumination device 320, a display layer 322, and optional control devices 440 for image preparation and system synchronization, as well as an optional tracking device 442 designed to track the eyes of viewers 210, 212 of the device 102, are schematically shown.

[0069] In one embodiment, the tracking device 442 is designed to provide positioning signals 444, 446 that indicate the position of viewers 210, 212 relative to the display layer 322. For example, the first positioning signal 444 indicates the position of the first viewer 210 or the position of the eyes of the first viewer 210, and the second positioning signal 446 indicates the position of the second viewer 212 or the position of the eyes of the second viewer 212.

[0070] The control device 440 is designed to manipulate the lighting device 320 and the display layer 322 such that the image generated by the display layer 322 is projected in a currently desired direction, for example, projected onto the two viewers 210, 212, projected onto only one of the viewers 210, 212, or, for example, projected onto only one eye of one of the viewers 210, 212. According to one embodiment, the control device 440 is designed to use positioning signals 444, 446 for this purpose.

[0071] According to one embodiment, the control device 440 is designed to manipulate the display layer 322 when using image signals 448 and 450. For example, the display layer 322 is designed to: at a first time point, when using the first image signal 448, generate a first image extending onto the display layer 322; and at a second time point, when using the second image signal 450, generate a second image extending onto the display layer 322. For example, the control device 440 is designed to: determine the first image signal 448 and the second image signal 450 using first image data assigned to the first image and second image data assigned to the second image; and provide the first image signal 448 to the interface of the display layer 322 at the first time point and provide the second image signal 450 to the interface of the display layer at the second time point.

[0072] According to one embodiment, the control device 440 is designed to operate the lighting device 320 when using direction signals 452, 454. For example, the lighting device 320 is designed to: at a first time point, when using the first direction signal 452, illuminate the display layer 322 with light having a first direction assigned to the first direction signal 452, so as to project a first image generated by the display layer 322 toward the direction of the first viewer 210 or toward only one eye of the first viewer 210; and at a second time point, when using the second direction signal 454, illuminate the display layer with light having a second direction assigned to the second direction signal 454, so as to project a second image generated by the display layer toward the direction of the second viewer 212 or toward only one eye of the second viewer 212. For example, control device 440 is designed to: determine a first direction signal 452 when using a first positioning signal 444 and determine a second direction signal 454 when using a second positioning signal 446; and provide these direction signals 452, 454 to the interface of the lighting device 320, and in the illustrated embodiment, to the interface of the blocking layer 328. Alternatively, according to the illustrated embodiment, control device 440 is designed to: provide a backlight signal 456 for manipulating the backlight unit 326 to emit non-directional background light to the interface of the lighting device 320, here provided to the interface of the backlight unit 326.

[0073] The touch-sensitive surface 324 is designed to provide a position signal 458 indicating a location in response to a touch of a location, such as by the finger of one of the viewers 210, 212. According to an embodiment, the position signal 458 can be understood as a single signal indicating the presence of a touch, or as a time series of signals indicating touches occurring at different points in time, such as touches at different locations.

[0074] According to one embodiment, the control device 440 is designed to: determine image signals 448, 450 when using position signal 458, and additionally or alternatively, determine direction signals 452, 454 when using position signal 458.

[0075] In one embodiment, the control device 440 is designed to define the orientation of at least one segment during the segmentation phase, using position signal 458. In another embodiment, segments are selected via touch interaction, and then different functions can be assigned to these segments. Segments with specific functions such as 3D or public / private are achieved by having consecutive images differ only in relation to the selected segments, and then setting the backlight direction accordingly to obtain the desired function.

[0076] According to an embodiment, the touch-sensitive surface 324 can be clicked once or multiple times, or swiped over, to segment, for example, the display layer 322. Accordingly, according to one embodiment, the control device 440 is designed to: during the segmentation phase, determine a dividing line extending on the display layer 322 using positions indicated by time-sequential position signals 458, and define the orientation of the first segment as the surface of the display layer 322 located on a first side of the dividing line, and define the orientation of the second segment as the surface of the display layer 322 located on a second side of the dividing line.

[0077] According to one embodiment, the control device 440 is designed to: during the assignment phase, using the position signal 458, define a first direction for illuminating the display layer 322 with the light from the illumination device 320 at a first time point and a second direction for illuminating the display layer 322 with the light from the illumination device 320 at a second time point; and assign the first direction to the first direction signal 452 and assign the second direction to the second direction signal 454.

[0078] Optionally, the control device 440 is designed to: during the assignment phase, provide image signals on the display layer 322 to represent predefined selection areas (e.g., in the form of buttons). Each selection area can be assigned a direction in which the image displayed by the display layer 322 is projected, and thus a corresponding direction in which the display layer 322 is illuminated by the illumination device 320. According to one embodiment, a touch on the corresponding selection area is indicated by a position signal 458, and the control device 440 uses this touch to determine at least one of the direction signals 448, 450.

[0079] Advantageously, using device 102, four different images can be projected, more precisely, one image can be projected for each eye of viewers 210, 212. Here, according to one embodiment, each image can only be seen by one eye.

[0080] According to one embodiment, in order to display different images to the right and left eyes of viewers 210 and 212 respectively, the display layer 322 is designed to: generate a further first image extending on the display layer 322 at a further first time point, using a further first image signal; and generate a further second image extending on the display layer 322 at a further second time point, using a further second image signal. Accordingly, the illumination device 320 is designed to: illuminate the display layer 322 with light having a further first direction assigned to the further first direction signal at the further first time point, so as to project the further first image generated by the display layer 322 toward, for example, the right eye of the first viewer 210; and illuminate the display layer with light having a further second direction assigned to the further second direction signal at the second time point, so as to project the further second image generated by the display layer toward, for example, the right eye of the second viewer 212. Accordingly, the control device 440 is designed to: provide an additional first image signal to the interface of the display layer 322 at an additional first time point and provide an additional second image signal to the interface of the display layer at an additional second time point; and determine the additional first direction signal and the additional second direction signal; and provide the additional first direction signal to the interface of the lighting device 320 at an additional first time point and provide the additional second direction signal to the interface of the lighting device at an additional second time point. Therefore, in this case, exemplarily, the first image is projected only towards the left eye of the first viewer 210, the additional first image is projected only towards the right eye of the first viewer 210, the second image is projected only towards the left eye of the second viewer 212, and the additional second image is projected only towards the left eye of the second viewer 212.

[0081] In the following text, firstly, based on... Figure 4 The device 102 shown below illustrates the working principle of the proposed display. Then, the implementation of the novel HMI application is demonstrated. Finally, some alternative system configurations are discussed.

[0082] First, the basic workflow is described: According to one embodiment, a device 102, implemented as a display, can send four different images in four different directions.

[0083] to this end, Figure 4 The illustration in the diagram is considered a working diagram of the proposed automated stereoscopic display system with five steps. In the first step, the tracking device 442, here an eye-tracking device, identifies the position of the eyes of viewers 210 and 212. Figure 4 The diagram schematically illustrates the left and right eyes of viewers 210 and 212, respectively. In the second step, the control device 440, for example in the form of a processing unit, prepares the image to be projected and synchronizes the signals required for the projection. In the third step, the backlight unit 326 provides the necessary illumination. In the fourth step, the blocking layer 328 restricts light propagation. In the fifth step, the display layer 322 displays the desired image content.

[0084] Therefore, in Figure 4 The functional diagram of device 102 shown consists of five parts. The eye positions of viewers 210 and 212 are detected by the first part, namely the tracking device 442 in the form of an eye-tracking device, and forwarded to the second part, namely the control device 440 in the form of a processing unit, where the image and backlight control for different viewers 210 and 212 are synchronized. Then, the processed information is transmitted to: the third part, namely the backlight unit 326; the fourth part, namely the blocking layer 328 in the form of an LCD without color filters for limiting light propagation; and the fifth part, namely the display layer 322 in the form of an LCD for displaying images, in order to achieve the desired display effect. This configuration can be combined with time-division multiplexing methods to enable new applications.

[0085] In order to use the time-division multiplexing method, the entire display frame lasts for 1 / 60 s and is divided into four subframes, each lasting for 1 / 240 s (4.2 ms).

[0086] Figure 5The system configuration for a first subframe (also called a sub-image) presented by device 102 is shown, in which the left eye of a first viewer 210 (e.g., a vehicle driver) receives an image intended for display layer 322. Exemplarily, based on the identified eye position, only backlight pixels corresponding to the desired direction are turned on to ensure the required illumination, while all other pixels are turned off. The backlight pixel plane is configured such that it lies at the focal plane of the lens grating (here, lens 330), so that light from the pixels is collimated in the desired direction. A special pixel pattern (black and white stripes) is then formed on blocking layer 328 to limit light propagation. For a suitable pattern, light converges only toward the left eye of the first viewer 210, illuminating display layer 322 only in the desired direction. Therefore, during this subframe, only the left eye of the first viewer 210 can perceive the image displayed on display layer 322.

[0087] In other words, in the system configuration of the first subframe, the image determined for the left eye of the first viewer 210 is to be displayed on the display layer 322. Only selected pixels of the backlight unit 326, which acts as a backlight, are turned on to ensure the necessary illumination. All other pixels are turned off. Furthermore, a special pixel pattern is set on the blocking layer 328 so that only the left eye of the first viewer 210 can perceive the image from the display layer 322.

[0088] The system configurations for the other three subframes or sub-images are set in a similar manner, such as... Figures 6 to 8 As shown in the image.

[0089] Corresponding to Figure 5 , Figure 6 The system configuration shown is a second subframe or sub-image presented by device 102, wherein the right eye of a first viewer 210 (e.g., a driver of a vehicle) receives the image displayed on display layer 322. Only the right eye of the first viewer 210 can see the image displayed on display layer 322.

[0090] Corresponding to Figure 5 , Figure 7 A system configuration is shown for a third subframe or sub-image presented by device 102, wherein the left eye of a second viewer 212 (e.g., a passenger in a vehicle) receives the image presented on display layer 322. Only the left eye of the second viewer 212 can see the image displayed on display layer 322.

[0091] Corresponding to Figure 5 , Figure 8The system configuration shown is the last, here fourth, subframe or sub-image presented by device 102, in which the right eye of a second viewer 212 (e.g., a passenger in a vehicle) receives the image presented on display layer 322. Only the right eye of the second viewer 212 can see the image shown on display layer 322.

[0092] According to Figures 5 to 8 As shown, four different images are sent to the four eyes of two viewers, 210 and 212, in four subframes. Since the entire image frame repeats at a frequency of 60 Hz, the human eye perceives the images as continuous due to the duration of afterglow. Assume: L1 and R1 represent the images seen by the left and right eyes of the first viewer 210; then L2 and R2 represent the images seen by the left and right eyes of the second viewer 212. Different combinations of L1, R1, L2, and R2 will produce different applications. Possible applications of the image arrangement in the four subframes are mentioned below.

[0093] For privacy mode 1, L1 is black, R1 is black, L2 is random image A and R2 is random image A.

[0094] For privacy mode 2, L1 is random image B, R1 is random image B, L2 is black and R2 is black.

[0095] For split-screen display, L1 is a random image C, R1 is a random image C, L2 is a random image D and R2 is a random image D.

[0096] For 3D perception, L1 is a stereo random image E (left eye), R1 is a stereo random image E (right eye), L2 is a stereo random image F (left eye) and R2 is a stereo random image F (right eye).

[0097] Therefore, privacy modes, split-screen displays, and 3D perception can be achieved. Compared to current switchable privacy technologies, this display design offers more expanded functionality.

[0098] In some cases, special display features (privacy mode, split-screen display, 3D perception) do not need to be applied to the entire display surface. The central information display (CID) in a car can serve as an example. Assume a navigation map is displayed on the CID. In normal mode, both the driver and passengers should be able to see the navigation content across the entire CID. Then, a message field fades in, which should only be visible to the driver (e.g., phone call, text message, private notification). Ideally, passengers can continue viewing the navigation map without seeing the message field. This can be achieved by arranging sub-images appropriately.

[0099] Figure 9The possibility of arranging sub-images L1, R1, L2, R2 when using the device 102 according to the embodiment is illustrated. The navigation map 950 is visible not only to the driver (first user) but also to the passenger (second user). However, the telephone message 952 located in the upper area of ​​the display is only displayed in sub-images L1 and R1. Therefore, only the driver can see this message.

[0100] Therefore, the configuration of sub-images L1, R1, L2, R2 for generating local privacy content is shown. A navigation map 950 is displayed for both users, and a phone call message 952 is displayed only for the first user (driver).

[0101] To properly configure these sub-images, the HMI design should have additional degrees of freedom to define regions with privacy modes. Various methods can be implemented to achieve this; two of these methods will be illustrated below as examples.

[0102] Figure 10 The first method is illustrated, in which elements can be defined on different layers and equipped with corresponding characteristics. Telephone messages 952 are drawn on a privacy layer 1060 for the first user, and navigation maps 950 should be defined on a public layer 1062.

[0103] In this first HMI design method for configuring sub-images, elements are defined on different layers 1060 and 1062, and these elements are equipped with corresponding characteristics. Elements visible to both users are drawn on the public layer 1062. Elements visible only to the first user are defined on the privacy layer 1060.

[0104] Figure 11 Two images, 1170 and 1172, are shown. According to one embodiment, these two images are required as input information for a second HMI design. The first image 1170 contains image content, and the second image 1172 defines region segments, here a protected area 1174 and a public area 1176 for a first viewer. Elements located in the protected area 1174, here telephone message 952, should only be visible to the corresponding user. The system processes these two input images and then generates the correct sub-image.

[0105] Therefore, in the second HMI design method for configuring sub-images, this application requires two images, 1170 and 1172. The first image 1170 provides image content, here a navigation map 950 and a telephone message 952, and the second image 1172 defines area segments.

[0106] Similarly, split-screen display and 3D perception can be configured within the defined display area. Using the proposed method, local applications with specific functions can be implemented through HMI design.

[0107] The following describes an embodiment of implementing special functions for a specific display area of ​​the device via touch control.

[0108] Touchscreens are increasingly used in current display devices to enable users to interact with the display and issue commands. For example... Figure 3 As shown in the diagram, the device described here also incorporates a touch panel in the form of a touch-sensitive surface. Because the proposed system can recognize finger position and movement, users can customize the display area to show specific functions.

[0109] Figure 12 Touch control of the device 102 according to an embodiment is explained. Specifically, a privacy mode can be defined for a specific display area via touch control. Users can divide the screen, which is a stack of a display layer and a touch-sensitive surface, into multiple areas by moving their fingers, such as by... Figure 12 As shown by the dotted line in the image. Then, the user can apply privacy mode to the upper area.

[0110] According to the illustrated embodiment, touch controls are used to define a privacy mode in the upper area of ​​the screen, similar to the local privacy mode already discussed. A finger swiping across the screen divides the display into two areas, which the user can then assign appropriate functions to. For example... Figure 12 As shown, the privacy mode for the first user is set in the upper area of ​​the screen, thus representing the protected area 1174, and the public mode is set in the lower area, thus representing the public area 1176. In this way, it is possible to achieve [something related to privacy mode]. Figure 11 The HMI design shown in the figure has the same effect.

[0111] To enable users to assign corresponding functions to defined areas via touch control, there are several possible HMI solutions.

[0112] Figures 13a-13c An example method for assigning functions via touch control as a device according to an embodiment is shown.

[0113] like Figure 13a As shown, users can first divide the screen into two horizontal segments 1380 and 1382, also known as sections, along the dividing line 1300.

[0114] like Figure 13bAs shown, on the left side of the screen, specifically segment 1380, three possible special functions that the user can select are displayed: selection area 1384 for public mode, selection area 1385 for privacy mode, and selection area 1386 for split-screen mode. To this end, when using a display layer, corresponding predefined selection areas 1384, 1385, and 1386 are generated, for example, in the form of three button boxes for these three selectable modes.

[0115] like Figure 13c As shown, optionally, in touch Figure 13b After selecting one of the selection areas 1384, 1385, or 1386 shown, other selection areas appear. Assuming a common mode is selected, such as... Figure 13b As shown, two icons will appear: selection area 1388 for 2D mode and selection area 1389 for 3D mode. Users can use these icons to select between 2D and 3D modes. If 3D mode is selected by touching the corresponding selection area 1389, the left screen configuration is complete, and a public viewing area with 3D effects is formed. The right screen can be set up in the same way.

[0116] Therefore, in Figures 13a-13c The HMI solution shown allows users to assign different characteristics to defined areas, in this case segment 1380, via touch control. First, the user can divide the entire screen into two segments, 1380 and 1382. Then, the left screen displays three special functions that the user can choose from. Assuming the common mode is selected, two icons appear, allowing the user to switch between 2D and 3D modes. The right screen, segment 1382, can be configured in the same way.

[0117] Figures 14a-14c Another application of the HMI solution of the device according to the embodiment is shown. The user can divide the screen into two horizontal sections 1380 and 1382 via touch control.

[0118] like Figure 14a As shown, regarding the CID in the vehicle, the left segment 1380 can be used as a public viewing area with a 3D effect. The right segment 1382 is set up as a split-screen viewing area, in which the driver and passengers will continuously receive different images from this area.

[0119] like Figure 14bAs shown, then, for example, a navigation map 950 is displayed in the left-hand segment 1380, which should be visible not only to the driver but also to the passengers. The right-hand portion is used, for example, to display vehicle information 1450 (vehicle status, driver assistance) for the driver in a split-screen viewing area. This is in Figure 14b As shown in the image. Vehicle information 1450 is not visible to passengers.

[0120] like Figure 14c As shown, for passengers, for example, media library 1452 is placed on the split-screen viewing area, here segment 1382, so that the content does not distract the driver.

[0121] According to Figures 14a to 14c As shown, users can divide the screen into two sections and assign different functions to them. (a) Use touch controls to divide the screen into two sections 1380 and 1382. (b) The first user sees a 3D navigation map 950 on the left and vehicle information 1450 on the right. (c) The second user also sees a 3D navigation map 950 on the left, but a media center 1452 on the right.

[0122] This example illustrates two applications to demonstrate how touch control can be used to define specific functions on a particular display area. Introducing a touch panel enables a significant improvement: the free arrangement of these functions within the provided display area. This improvement allows users to highly flexibly adjust HMI designs, which is impossible with traditional display designs.

[0123] To implement the aforementioned HMI application, the following three components are essential for building the system: a display with specially developed directional backlighting, a touch panel, and an eye-tracking device. The touch panel and eye-tracking device are standard components and do not require further analysis. The primary focus is on other directional backlighting technologies to examine possible alternative configurations.

[0124] The directional backlight used in the aforementioned device is based on lens 3D technology.

[0125] Figure 15An embodiment of device 102 is shown, which has another possible structure of an illumination device 320 in the form of backlighting based on parallax barrier 3D technology, wherein the blocking layer 328 is implemented, for example, as an LCD and represents an active barrier layer. However, the barrier technology is always affected by a significant reduction in light intensity, which leads to low energy efficiency. Instead of a lens, another LCD layer 1530 is used to limit light propagation. This alternative system configuration with another improved directional backlighting based on parallax barrier 3D technology is based on: an LCD layer, here the blocking layer 328, acting as an active barrier, and a target image displayed on another LCD layer, here the display layer 322.

[0126] The two directional backlighting methods described above may achieve the proposed HMI function. However, it should be noted that the described HMI function can be applied to any display with directional backlighting that can send different images in different directions.

[0127] The solution described here enables the creation of novel interactive HMI applications based on a new display design. The proposed display system consists of a touch panel, an eye-tracking device, and a 3D display with specially developed directional backlighting, i.e., the physical components.

[0128] Advantageously, the proposed solution can be used in high-end display products where special features are required for multiple users, namely 3D effects, privacy mode, split-screen display mode, and interactive HMI design. The optimal application for this solution is in automotive displays, such as dashboards, central information displays, and passenger information displays. In one embodiment, the number of users is limited to two (driver and passenger), and the user positions are restricted. Therefore, special design and calibration of the entire system can be performed to achieve a better viewing experience.

[0129] Figure 16 A flowchart of a method for displaying an image according to a viewing direction, according to an embodiment, is shown. This method can be performed using the device described with reference to the foregoing figures.

[0130] In step 1601, a first image extending onto the display layer is generated at a first time point. This is achieved, for example, by controlling a first image signal. Furthermore, a second image extending onto the display layer is generated at a second time point. This is achieved, for example, by controlling a second image signal. Possible segments are shown, for example, in Figure 14, as sections 1380 and 1382.

[0131] In step 1603, at a first time point, the display layer is illuminated using light having a first direction. This allows a first image generated by the display layer at the first time point to be projected toward a first viewer. This is achieved, for example, by controlling a first direction signal. Furthermore, at a second time point, the display layer is illuminated using light having a second direction. This allows a second image generated by the display layer at the second time point to be projected toward a second viewer. This is also achieved, for example, by controlling a second direction signal.

[0132] In step 1605, in response to a touch-sensitive surface, a position signal is provided indicating the location where the touch occurs. This touch may, for example, be performed by a finger of one of the viewers. Optionally, the position signal, and if necessary, a sequence of position signals, is used to define segments of the image to be presented for different viewers. For this purpose, the method may include step 1607, which represents a segmentation phase, as in, for example, in… Figure 13a As shown in the diagram. Additionally or alternatively, the position signal, and if necessary, a sequence of position signals, is used to define the direction in which the image is projected. Here, for example, it can be specified whether the image presented in a segment can be seen by only one viewer or by multiple viewer. For this purpose, the method may include step 1609, which represents the dispatching phase, as shown in the diagram. Figure 13b As shown in the image.

[0133] In order to enable the projection direction of the image to track the moving viewer, according to one embodiment, a positioning signal is additionally processed, which is provided, for example, by a tracking device, using which the position of the viewer's eyes can be determined.

[0134] The steps of this method can be repeated in a suitable manner so as to continuously project the image, and if necessary, sub-images, to the eyes of the corresponding viewer.

Claims

1. A device (102) for displaying an image according to the direction of the gaze, wherein, The device (102) has the following characteristics: Display layer (322), the display layer being designed to: generate a first image on the display layer (322) at a first time point using a first image signal (448), and generate a second image on the display layer at a second time point using a second image signal (450); An illumination device (320) is designed to: at a first time point, using a first direction signal (452), illuminate the display layer (322) with light having a first direction assigned to the first direction signal (452) so as to project a first image generated by the display layer (322) toward a first viewer (210); and at a second time point, using a second direction signal (454), illuminate the display layer with light having a second direction assigned to the second direction signal (454) so ​​as to project a second image generated by the display layer (322) toward a second viewer (212).

2. The device (102) according to claim 1, wherein the device has a touch-sensitive surface (324) designed to: provide a position signal (458) indicating the position in response to a touch at a certain location, wherein, The display layer (322) is disposed between the touch-sensitive surface (324) and the lighting device (320).

3. The device (102) according to claim 1 or 2, the device having a control device (440) designed to: determine a first image signal (448) and a second image signal (450) using first image data assigned to the first image and second image data assigned to the second image, and provide the first image signal (448) to an interface of the display layer (322) at a first time point, and provide the second image signal (450) to the interface of the display layer at a second time point; and designed to: determine a first direction signal (452) and a second direction signal (454), and provide the first direction signal (452) to an interface of the lighting device (320) at the first time point, and provide the second direction signal (454) to the interface of the lighting device at the second time point.

4. The device (102) according to claim 2, wherein, The control device (440) is designed to: determine the first image signal (448) and the second image signal (450) when using the position signal (458); and / or determine at least the first direction signal (452) and the second direction signal (454) when using the position signal (458).

5. The device (102) according to claim 2 or 4, wherein, The control device (440) is designed to: define the orientation of a first segment (1380) and the orientation of at least one second segment (1382) using the position signal (458) during the segmentation stage; determine the first image signal (448) using the first image data and the orientation of the first segment (1380); and determine at least the second image signal (450) using the second image data and the orientation of the second segment (1382).

6. The device (102) according to claim 5, wherein, The control device (440) is designed to: determine, in the segmentation phase, using the position indicated by the time-continuous position signal (458), a dividing line (1300) extending on the display layer (322), and define the orientation of the first segment (1380) as the surface of the display layer (322) located on the first side of the dividing line (1300), and define the orientation of the at least one second segment (1382) as the surface of the display layer (322) located on the second side of the dividing line (1300).

7. The device (102) according to any one of claims 3 to 6, wherein, The control device (440) is designed to: define the first direction and the second direction during the function assignment phase, and assign the first direction to the first direction signal (452) and assign the second direction to the second direction signal (454).

8. The device (102) according to any one of the preceding claims, wherein, The lighting device (320) includes: a planar backlight unit (326) for emitting non-directional background light; a lens (330) having an array of plano-convex cylindrical lenses, wherein each of the cylindrical lenses is designed to: converge the light rays of the background light into directional light and deflect them onto the display layer (322) in a ray direction, wherein the ray direction depends on the relative position between the cylindrical lens and the starting point of the light rays on the backlight unit (326) assigned to the cylindrical lens; and a blocking layer (328) disposed between the backlight unit (326) and the lens (330), wherein the blocking layer (328) has a grating consisting of regions that can be switched between a light-transmitting state and a light-blocking state, wherein the blocking layer (328) is designed to: switch the region to the light-blocking state by selection of one of the directional signals (452, 454) when using the directional signals (452, 454).

9. A method for displaying an image according to the direction of gaze when using the device (102) according to any one of the preceding claims, wherein, The method includes the following steps: A first image extending on the display layer (322) is generated (1601) using a first image signal (448) at a first time point, and a second image extending on the display layer (322) is generated using a second image signal (450) at a second time point; At the first time point, the display layer (322) is illuminated (1603) with light having a first direction so as to project the first image generated by the display layer (322) toward the direction of the first viewer (210), and at the second time point, the display layer (322) is illuminated with light having a second direction so as to project the second image generated by the display layer (322) toward the direction of the second viewer (212); as well as In response to touching a touch-sensitive surface or the touch-sensitive surface (324) at a certain location, a position signal (458) indicating the location is provided (1605).

10. A computer program configured to perform and / or manipulate the steps of the method according to claim 9.

11. A machine-readable storage medium having a computer program as claimed in claim 10 stored thereon.

Images