Method and operating device for operating a display device, for example for a vehicle, method and generating device for generating a filter function, and display system for a vehicle

Abstract

The invention relates to a method for operating a display device (110) comprising a plurality of pixel groups (A, B, C, D), in particular more than four pixel groups (A, B, C, D), and an optical unit, in particular a lens plate, for example a lenticular lens unit (125), having the following steps: reading an eye position signal (145) which represents the position of an eye (150) of a viewer viewing the display device (110) on a viewing plane (155) with respect to the display device (110), selecting the pixel groups which are visible from the position of the eye (150), for example pixel group (A) of the plurality of pixel groups (A, B, C, D), using the position of the eye (150), and activating the visible pixel groups, for example pixel group (A), using the position and a filter function (fA) assigned to the pixel group (A).

Description

[0001] Description

[0002] title

[0003] Method and operating device for operating a display device, for example for a vehicle, method and generating device for generating a filter function and display system for a vehicle

[0004] State of the art

[0005] The approach is based on a device or method according to the class of the independent claims. The present approach also relates to a computer program.

[0006] Autostereoscopic displays based on lenticular lenses can be used to display three-dimensional images.

[0007] Disclosure of the invention

[0008] Against this background, the approach presented here provides a method for operating a display device, for example for a vehicle, furthermore an operating device that uses this method, a corresponding computer program, a method for generating a filter function, furthermore a generating device that uses this method, a corresponding computer program and finally a display system for a vehicle according to the main claims. The measures listed in the dependent claims enable advantageous further developments and improvements of the method specified in the independent claim. The advantages achievable with the approach presented are that, during operation of a display device, a uniformly perceptible light distribution is generated for an observer of the display device when viewed.

[0009] A method for operating a display device for a vehicle is presented. The display device has a plurality of pixel groups, in particular more than four pixel groups, and an optical unit, for example a lenticular lens unit arranged obliquely with respect to an arrangement structure of the plurality of pixel groups. The method has a reading step, a selection step, and an adjustment step. In the reading step, an eye position signal is read in, which represents a position of an eye of a viewer viewing the display device in an observation plane with respect to the display device. In the selecting step, the pixel groups visible from the position of the eye are selected from the plurality of pixel groups using the position of the eye.In the activation step, the visible pixel groups are adjusted using the position of the eye and filter functions assigned to the visible pixel groups.

[0010] A filter function assigned to a visible pixel group is applied to all pixels belonging to the visible pixel group. The filter function can, for example, adjust the intensity of all pixels in the visible pixel group. A filter function assigned to another pixel group can then, for example, adjust a different intensity for all pixels in the other pixel group, and so on. Which pixel group is switched on or off depends on the eye position. The assignment of pixels to a particular pixel group is not determined by the filter function, but is specified by the system design. The filter function assigned to a pixel group is then applied to all pixels in this group and, for example, changes their intensity. The filter functions are determined once (e.g. in the laboratory) by measuring the intensity in one viewing plane. This viewing plane results from the application. E.g.In a vehicle, the viewing plane might be 70 cm from the display. From these measurements, the filter functions are calculated to achieve a homogeneous intensity distribution in this plane. The position of the eyes in real-life operation does not subsequently influence the filter functions. The filter functions could generally also change something other than the intensity, such as colors or grayscale. This allows system errors to be corrected.

[0011] This method can be implemented, for example, in software or hardware or in a mixed form of software and hardware, for example in a control unit.

[0012] The display device can have a 2D display comprising at least one backlight pixel or multiple backlight pixels, which becomes an autostereoscopic 3D display due to the lenticular lens unit. The backlight pixel can be an emitter. Each of the pixels of the display device can have its own associated backlight pixel. A "pixel matrix" is understood to mean a matrix-like arrangement of the pixels, in which the pixels and / or backlight pixels are arranged, for example, in columns and rows. The lenticular lens unit can have a plurality of adjacent lenticular lenses in the form of lens strips, each of which can be semi-cylindrical in shape. These lenticular lenses can be arranged on a film. The lenticular lens unit can also be referred to as a lenticular lens array or lens grid.For example, the lens strips of the lenticular lens unit are each arranged parallel to one another and obliquely to the columns and rows of the pixel matrix. Each of the pixel groups represents a pixel group necessary for viewing an image. For example, the display area can be divided into a plurality of display regions, and in each of the display regions at least one pixel from each of the pixel groups can be arranged. The display regions can be identical in terms of their shape and the number and composition of the pixels they contain. A lenticular lens of the lenticular lens unit can be assigned to each of the display regions. For example, at least one pixel of each of the plurality of pixel groups is visible laterally through one of the lenticular lenses of the lenticular lens unit, depending on the viewer's observation position.Light emitted by the pixels of a selected pixel group is directed toward the position of the eye thanks to the lenticular lens unit. Light from pixels in non-selected pixel groups, on the other hand, would be directed to positions different from the position of the eye. During the reading step, the eye position signal can be read, for example, by an eye-tracking device. Such a process enables optimization of the perceivable illumination intensity for the viewer of the display device. For example, a constant intensity is perceivable by the observer when the eye moves laterally within the observation plane.

[0013] In the step of reading, the eye position signal can be read, which further indicates a further position of another eye of the observer viewing the display device in the

[0014] Observation plane with respect to the display device, wherein in the step of selecting, the further pixel groups visible from the further position of the further eye are selected from the plurality of pixel groups using the further position of the further eye, and wherein in the step of activating, the visible further pixel groups are activated using the further position and the further filter functions assigned to the further pixel group

[0015] Furthermore, if the further position of the further eye is detected and the intensity of the associated backlight pixel is adjusted for this using the further filter function assigned for the further position, this enables, for example, the observer to generate a uniform intensity perception for both eyes when viewing the display device.

[0016] The selection and adjustment steps can be performed repeatedly if, during the reading step, an eye position signal is read in for the eye, representing a second position of the eye that differs from the current position. This allows for continuous adjustment of the illumination intensity when the eye changes position, so that, for example, the illumination intensity remains constant when the eye moves laterally in the observation plane.

[0017] The pixel groups can, but do not have to, be activated or deactivated depending on the position of the eyes. This would also work if all pixel groups remained activated.

[0018] According to one embodiment, the method may further comprise a step of detecting the eye using an eye-tracking device and providing the eye position signal. Thus, the position of the eye can be detected and provided quickly and easily using an eye-tracking device, which may, for example, have at least one camera for tracking the eye.

[0019] The approach presented here further provides an operating device configured to perform, control, or implement the steps of a variant of a method presented here in corresponding devices. This variant of the approach in the form of a device also allows the underlying problem to be solved quickly and efficiently.

[0020] For this purpose, the operating device can have at least one computing unit for processing signals or data, at least one memory unit for storing signals or data, at least one interface to a sensor or an actuator for reading sensor signals from the sensor or for outputting data or control signals to the actuator, and / or at least one communication interface for reading or outputting data embedded in a communication protocol. The computing unit can be, for example, a signal processor, a microcontroller, or the like, wherein the memory unit can be a flash memory, an EEPROM, or a magnetic storage unit.The communication interface can be designed to read in or output data wirelessly and / or wired, wherein a communication interface that can read in or output wired data can read this data, for example, electrically or optically from a corresponding data transmission line or output it to a corresponding data transmission line.

[0021] In the present case, an operating device can be understood as an electrical device that processes sensor signals and outputs control and / or data signals depending on them. The operating device can have an interface that can be embodied in hardware and / or software. In a hardware embodiment, the interfaces can, for example, be part of a so-called system ASIC, which contains a wide variety of functions of the operating device. However, it is also possible for the interfaces to be separate integrated circuits or to consist at least partially of discrete components. In a software embodiment, the interfaces can be software modules that are present, for example, on a microcontroller alongside other software modules.

[0022] Furthermore, a method for generating filter functions for use with the previously described method for operating the display device in one of the described variants is presented. The method for generating the filter function comprises a detection step and an optimization step. In the detection step, a plurality of intensities of the pixel group are detected at a plurality of measurement positions in the observation plane in order to obtain an intensity distribution of the pixel group using the intensities. In the optimization step, the intensity distribution is optimized such that a desired, for example constant, synthetic distribution of the plurality of intensities in the observation plane is achieved in order to obtain the filter functions for the pixel groups.

[0023] In the detection step, the first intensity of the illuminated pixel group at the first measurement position and the second intensity of the illuminated pixel group at the second measurement position can be detected using a camera. The second measurement position can be a measurement position shifted laterally to the first measurement position within the observation plane. The approach presented here further provides a generating device configured to perform, control, or implement the steps of a variant of a method presented here in corresponding devices. This embodiment of the approach in the form of a device also allows the problem underlying the approach to be solved quickly and efficiently.

[0024] For this purpose, the generating device can have at least one computing unit for processing signals or data, at least one memory unit for storing signals or data, at least one interface to a sensor or an actuator for reading sensor signals from the sensor or for outputting data or control signals to the actuator, and / or at least one communication interface for reading or outputting data embedded in a communication protocol. The computing unit can be, for example, a signal processor, a microcontroller, or the like, wherein the memory unit can be a flash memory, an EEPROM, or a magnetic storage unit.The communication interface can be designed to read in or output data wirelessly and / or wired, wherein a communication interface that can read in or output wired data can read this data, for example, electrically or optically from a corresponding data transmission line or output it to a corresponding data transmission line.

[0025] In this case, a generating device can be understood as an electrical device that processes sensor signals and outputs control and / or data signals depending on them. The generating device can have an interface that can be implemented in hardware and / or software. In a hardware implementation, the interfaces can, for example, be part of a so-called system ASIC, which contains a wide variety of functions of the generating device. However, it is also possible for the interfaces to be separate integrated circuits or to consist at least partially of discrete components. In a software implementation, the interfaces can be software modules that are present, for example, on a microcontroller alongside other software modules. A display system has the operating device described above and / or the generating device and the display device described above.A pixel matrix of the plurality of pixel groups can be arranged obliquely with respect to the lenticular lens unit. For example, the pixel matrix can be arranged rotated with respect to the lenticular lens unit. In this case, the pixel matrix of the plurality of pixel groups can be arranged obliquely / rotated with respect to an alignment of the lens strips of semi-cylindrical lenticular lenses of the lenticular lens unit, for example.

[0026] Also advantageous is a computer program product or computer program with program code that can be stored on a machine-readable carrier or storage medium such as a semiconductor memory, a hard disk memory or an optical memory and is used to carry out, implement and / or control the steps of the method according to one of the embodiments described above, in particular when the program product or program is executed on a computer or a device.

[0027] Examples of the approach presented here are shown in the drawings and explained in more detail in the following description. It shows:

[0028] Fig. 1 is a schematic representation of a vehicle with an operating device according to an embodiment for operating a display device of the vehicle;

[0029] Fig. 2 is a perspective view of a display device for use with an operating device according to an embodiment;

[0030] Fig. 3 is a schematic representation of a display device for use with an operating device according to an embodiment;

[0031] Fig. 4 is a schematic representation of a lenticular lens for controlling a light emission direction; Fig. 5 is a top view of a 3D display;

[0032] Fig. 6 a side view of a 3D display;

[0033] Fig. 7 is a plan view of a display device for use with an operating device according to an embodiment;

[0034] Fig. 8 is a plan view of a display device for use with an operating device according to an embodiment;

[0035] Fig. 9 is a schematic representation of a generating device according to an embodiment for generating at least one filter function for use for an operating device according to an embodiment;

[0036] Fig. 10 shows an intensity distribution generated using a generating device according to an embodiment;

[0037] Fig. 11 shows intensity distributions measured using a generating device according to an embodiment;

[0038] Fig. 12 original intensity distribution of a plurality of pixel groups;

[0039] Fig. 13 is a flowchart of a method according to an embodiment for operating a display device;

[0040] Fig. 14 is a flowchart of a method according to an embodiment for generating a filter function.

[0041] In the following description of advantageous embodiments of the present approach, the same or similar reference numerals are used for the elements shown in the various figures and having a similar effect, whereby a repeated description of these elements is omitted. Fig. 1 shows a schematic representation of a vehicle 100 with an operating device 105 according to an embodiment for operating a display device 110 of the vehicle 100. The use of the display device 110 in the vehicle 100 is merely exemplary.

[0042] For example only, the operating device 105 according to this exemplary embodiment is arranged on or in the vehicle 100, for example, implemented in a control unit of the vehicle 100 or on the display device 110. According to an alternative exemplary embodiment, the operating device 105 can be used in conjunction with a mobile phone, computer, or medical monitoring device. It can be used in any area where displays are used. The vehicle 100 or the display device 110 further comprises, according to this exemplary embodiment, an eye-tracking device 112, which here, for example, comprises a personal monitoring camera directed towards a driver's seat of the vehicle 100. The display device 110 has a plurality of pixel groups A and a lenticular lens unit 125 arranged obliquely with respect to a pixel matrix of the plurality of pixel groups A. For reasons of clarity, FIG.1 shows only one pixel group A of the plurality of pixel groups A. Further pixel groups are shown, for example, in Figures 3, 7, and 9.

[0043] The operating device 105 has a read-in interface 130, a selection device 135, and an adjustment device 140. The read-in interface 130 is designed to read in an eye position signal 145, which represents a position of an eye 150 of a viewer viewing the display device 110 in an observation plane 155 with respect to the display device 110, wherein a filter function fA is predetermined for the observation plane 155 and the pixel group A. The selection device 135 is designed to select a pixel group A visible from the position of the eye 150 from the plurality of pixel groups A using the position of the eye 150. The adjustment device 140 is designed to activate the visible pixel group A using the position and the filter function fA.According to this exemplary embodiment, the display device 110 has a 2D display 158, which becomes an autostereoscopic 3D display thanks to the lenticular lens unit 125. According to this exemplary embodiment, the lenticular lens unit 125 has a plurality of adjacently arranged lenticular lenses 160 in the form of lens strips, each of which is semi-cylindrical in shape. According to one exemplary embodiment, these lenticular lenses 160 are arranged on a film. For example, the individual lenticular lenses 160 of the lenticular lens unit 125 are each arranged parallel to one another and obliquely to the columns and rows of the pixel matrix; see also Figs. 2 and 7 to 9. Each of the pixel groups A represents a pixel group A required for viewing an image.For example, depending on an observation position in the observation plane 155, at least one pixel 120 of each of the plurality of pixel groups A is visible laterally through one of the lenticular lenses 160 of the lenticular lens unit 125.

[0044] According to this embodiment, the read-in interface 130 is configured to read the eye position signal 145 from the eye-tracking device 112. To activate the pixel group A, the adjustment device 140 is configured according to this embodiment to output an adjustment signal 165 to the visible pixel group A.

[0045] Together with the display device 110 and / or a generating device 170, the operating device 105 can also be referred to as a display system 175. The generating device 170 is configured to generate a plurality of filter functions fA, fß. A function of the generating device 170 is described in more detail in Figure 9.

[0046] According to this exemplary embodiment, the read-in interface 130 is designed to read in the eye position signal 145, which further represents a further position of a further eye 180 of the observer viewing the display device 110 in the observation plane 155 with respect to the display device 110, wherein at least one further filter function fß is predetermined for a further pixel group of the observation plane 155. According to one exemplary embodiment, the selection device 135 is designed to select the further pixel groups visible from the further position of the further eye 180 from the plurality of pixel groups using the further position of the further eye 180. According to one exemplary embodiment, the setting device 140 is designed to activate the visible further pixel group using the further position and the further filter function fß.

[0047] According to one embodiment, the selection device 135 is designed to select the pixel groups visible from the position of the eye 150 and / or one from the further position of the further eye 180 from the plurality of pixel groups using the position of the eye 150 and / or using the further position of the further eye and to deactivate at least one backlight pixel for illuminating the invisible pixel group.

[0048] According to this embodiment, the selection device 135 is designed to further select a second pixel group visible from the position of the eye 150 from the plurality of pixel groups using the position of the eye 150, wherein the setting device 140 is designed according to this embodiment to activate the visible second pixel group using the position.

[0049] According to one embodiment, the operating device 105 comprises the eye tracking device 112 for detecting the eye 150 and / or another eye 180 and providing the eye position signal 145.

[0050] The operating device 105 presented here enables calibration of display devices 110 in the form of autostereoscopic screens based on lenticular lenses in the form of lenticular lenses 160 for uniform light distribution.

[0051] Nowadays, various display devices are used everywhere to present information to the viewer, such as mobile phones, computers, medical monitoring devices, automotive instrument clusters, etc. Conventional displays can only display two-dimensional (2D) flat images that lack depth information. The viewer sees the same image on a 2D display at any viewing position. Two important depth information, motion parallax and binocular disparity, are therefore missing in the conventional 2D display. Motion parallax refers to the different relative motions of the various elements in a three-dimensional (3D) scene. When the viewer moves their head, objects closer to the viewer appear to move faster than objects farther away.Binocular disparity refers to the differences in the images perceived by the right and left eyes of the same 3D scene, which is due to the interpupillary distance between the two eyes. Due to the lack of both depth information, the spatial relationships or depth information cannot be represented accurately and efficiently on a 2D display.

[0052] Various 3D technologies have been developed to provide depth cues to the viewer, which can generally be divided into stereoscopic display technologies and autostereoscopic display technologies. Stereoscopic displays require the viewer to wear special glasses so that the left and right eyes can receive different images on the display. Autostereoscopic displays, on the other hand, provide the viewer with depth information without the need for special glasses, greatly expanding the application range of 3D displays. Among autostereoscopic technologies, volumetric and holographic displays can provide the most realistic and true-to-life 3D perception. However, the complex system design and technical challenges of 3D image processing have limited the application range of volumetric and holographic displays.Regarding implementation difficulties, display devices 110 in the form of autostereoscopic displays based on lenticular lenses 160 are widely used because they are easy to design and offer high brightness. By adding the lenticular lens unit 125 in the form of a lenticular array representing an array of lenses to the original 2D display 158, multiple images, i.e., multiple views, can be sent from the display 158 to different viewing positions. An example with four views, i.e., four different pixel groups, is shown in Figure 3. The 3D perception is induced in the viewer when the left eye 150 and the right eye 180 are in different viewing zones and receive different images from the display 158.

[0053] To improve the 3D perception of the display device 110 shown here in the form of an autostereoscopic lenticular display, an inclined structure of the lenticular lens unit 125 in the form of a lenticular screen is used to balance the horizontal and vertical resolution and create a smooth boundary between the views. However, the multi-view display device 110, which can also be referred to as a "3D display," suffers from low resolution and crosstalk issues that significantly impair the 3D image quality. Therefore, further improving 3D perception based on lenticular lenses 160 is crucial.

[0054] Autostereoscopic displays based on lenticular lenses have some disadvantages regarding their illumination properties. Figures 4 to 6 explain the basic principles of lenticular technology. Figures 2 and 7 to 8 further explain improvements based on oblique alignment.

[0055] Advantageously, the operating device 105 presented here implements a combination of a calibration process with the eye-tracking device 112. The eye positions of the viewer are detected by the eye-tracking device 112, and the pixel intensity is adjusted accordingly by the operating device 105 to achieve better 3D perception.

[0056] According to one embodiment, this method leads to two improvements:

[0057] Firstly, a uniform intensity perception is achieved. Due to the calibration process that can be carried out by the operating device 105, the viewer's eye 150 perceives a homogeneous intensity distribution when the viewer moves in front of the display device 110. Secondly, improved energy efficiency can be achieved for the display device 110 in the form of a self-emitting display. If, as in this exemplary embodiment, a self-emitting display is used for the display device 110, the display has, for example, pixel-by-pixel performance. If the eye positions are known, according to one exemplary embodiment, only the pixels 120 corresponding to the eye positions are switched on in the backlight to ensure the necessary illumination. Other pixels are switched off to save energy.

[0058] According to one embodiment, the entire calibration process is performed in at least three steps: a recording of the intensity distribution of each view using the generating device 170, as described in Fig. 9, an optimization of the registered distribution using the generating device 170, as also described in Fig. 9, and a real-time adjustment of the pixel values ​​based on the eye positions, as described here in Fig. 1, which is performed using the operating device 105.

[0059] A core idea of ​​the approach presented here is an eye position-dependent calibration and a subsequent eye position-dependent control of the pixel intensities in order to achieve a uniform intensity impression at the current eye position.

[0060] The real-time adjustment of the pixel values ​​based on the eye positions is carried out according to one embodiment as follows: First, the eye positions of the observer are determined by the eye-tracking device 112. Based on the determined eye positions, images are processed in a software unit of the operating device 105 based on an optimization result explained in Figures 9 to 12. The processed image is then sent to the display device 110 in order to set the pixels 120 to the desired intensity value. In Fig. 1, the left eye 150 is located, for example, at 20 mm and the right eye 180 is located, for example, at 80 mm. According to the figures shown in Fig.According to this exemplary embodiment, the calculated filter functions fA, fβ, fc shown in Figures 9 to 12 set the pixel group A and an additional pixel group C to the maximum pixel values, i.e., fA = 1, fc = 1, and the further pixel group B is completely switched off, i.e., fβ = 0. In this way, both eyes 150, 180 can perceive the intended intensity on the screen. As the viewer moves, the pixel values ​​are adjusted in real time so that the eyes 150, 180 can perceive a constant intensity distribution. If, according to one exemplary embodiment, self-emitting displays are used for the display device 110, only the required backlight pixels are activated, and other unused backlight pixels are switched off to save energy.

[0061] In summary, this proposed calibration method consists of an optimization process based on intensity measurements and real-time adjustment using the eye-tracking device 112. This calibration method is applicable to autostereoscopic displays with lenticular lenses 160 to achieve homogeneous intensity perception and improve energy efficiency.

[0062] Fig. 2 shows a perspective view of a display device 110 for use with an operating device according to one embodiment. This may be the display device 110 and operating device described in Fig. 1.

[0063] A pixel matrix of pixels 120 of the plurality of pixel groups is arranged obliquely or rotated relative to the lenticular lens unit. According to this embodiment, the orientation of the lenticular lenses 160 is arranged obliquely / rotated relative to the pixel matrix of pixels 120 of the plurality of pixel groups.

[0064] To overcome the intensity fluctuations described in Figures 4 to 6, the display device 110 has an oblique structure of the lenticular screen. This oblique orientation achieves a smooth transition between two views, since the magnification of only one black matrix does not occur (see also Figure 7). In other words, the display device 110 has an oblique orientation of the lenticular lenses 160 to the 2D display in the form of a scoreboard.

[0065] Fig. 3 shows a schematic representation of a display device 110 for use with an operating device according to an exemplary embodiment. This may be the display device 110 described in Fig. 1 or 2.

[0066] The display device 110 is shown in the form of an autostereoscopic multiview display based on lenticular lenses 160. According to this exemplary embodiment, a lens 160 covers four pixels of different pixel groups A, B, C, D and refracts the light from different pixels, i.e. pixels of the different pixel groups A, B, C, D, to the intended positions 300, 305, 310, 315 in the observation plane. The eye at a specific position can only see one of four pixels on the display. At a first position 300, according to this exemplary embodiment, only the pixels of pixel group A are visible to the eye. At a second position 305, according to this exemplary embodiment, only the pixels of the further pixel group B are visible to the eye. At a third position 310, according to this exemplary embodiment, only the pixels of an additional pixel group C are visible to the eye.At a fourth position 315, according to this embodiment, only the pixels of another pixel group D are visible to the eye.

[0067] It can be seen schematically in Fig. 3 that each lenticular lens covers at least one pixel of each of the pixel groups A, B, C, D. The number of pixel groups A, B, C, D is chosen merely as an example; more or fewer than four pixel groups A, B, C, D can also be used. Each of the lenticular lenses can cover exclusively one pixel of each of the pixel groups A, B, C, D or a plurality of pixels of each of the pixel groups A, B, C, D. Fig. 4 shows a schematic representation of a lenticular lens 160 for controlling a light emission direction. This can be one of the lenticular lenses 160 of the lenticular lens unit described in Fig. 1.

[0068] With reference to Fig. 4, an optical function of the lenticular lens 160 and an introduction to the basic lenticular technologies are described below.

[0069] A pixel plane of the screen is located near the focal plane of the lenticular lens 160, as shown in the center section of the image 400. Instead of the original wide beam angle 410 shown in the left section of the image 405, the light coming from a sample pixel 415 is now focused in a specific direction using the lenticular lens 160. Therefore, the entire sample pixel 415 is projected only into a limited angular range, which forms a viewing zone. A black matrix is ​​provided between the pixel areas in the backlight unit, as shown in Fig. 5.

[0070] Fig. 5 shows a plan view of a 3D display 500. This can be the display device described in Fig. 1 or 2, but unlike in Fig.

[0071] 1 or 2, the lenticular lens 160 of the lenticular lens unit is not arranged obliquely with respect to an arrangement structure of the plurality of pixel groups 502, but parallel with respect to an arrangement structure of the plurality of pixel groups 502.

[0072] A black matrix 505 is arranged between the pixel areas in the backlight unit. A line indicates a center line 510 of the lenticular lens 160. Squares represent some backlight pixels 515 with a black matrix 505 in between, and both the pixels and the black matrix 505 are magnified by the lenticular lens 160. At the lenticular lens 160, which can also be referred to as a cylindrical lens, an incident light beam is refracted in the same direction if the light beam is parallel to the center line 510 of the lenticular lens 160. In Figure 5, two example lines L1, L2 are selected to describe the property of the output light. A first position is highlighted by a first line L1, which mostly runs through the bright backlight pixels 515. Such first lines L1 are magnified and form a bright area on the observation plane.The second line L2 illustrates a second situation in which only the black matrix 505 is magnified and directed in a specific direction. If the viewer's eye happens to be in this direction, the eye cannot receive any light from the display, even if all backlight pixels 515 of the backlight are activated. This is the case when the lenticular lenses 160 are aligned parallel to the display / display panel. In the display device presented in Figs. 1 to 3, this effect is successfully avoided by the oblique arrangement of the lenticular lens unit with respect to the arrangement structure of the plurality of pixel groups 502.

[0073] Fig. 6 shows a side view of a 3D display 500. This may be the 3D display 500 described in Fig. 5.

[0074] A discontinuity in the intensity distribution 600 with parallel alignment, also described in Figures 4 and 5, is further analyzed in Figure 6 shown here. When all backlight pixels 515 in the backlight are switched on, the bright pixels and the black matrix 505 are all magnified, resulting in an alternating arrangement of black and bright zones on the observation plane 155. When the observer moves in the lateral direction 602 in the observation plane 155, the eye 150 experiences a large fluctuation in the light intensity 610, as shown in the intensity distribution 600 on the right. This large intensity fluctuation significantly impairs correct 3D perception and the visual experience.

[0075] In summary, Fig. 6 shows a discontinuous intensity distribution 600 in the parallel alignment. The bright pixels and the black matrix 505 in the backlight are all magnified by the lenticular lens 160, resulting in an alternating magnified arrangement of the black and bright areas on the observation plane 155. As a result, there is a large variation in the intensity distribution 600 of the intensities 610 across the observation plane 155.

[0076] Fig. 7 shows a top view of a display device 110 for use with an operating device according to an embodiment. This may be the display device 110 described in Fig. 1, 2, or 3.

[0077] In Fig. 7, three lines L1, L2, L3 are highlighted on the left to demonstrate the illumination characteristics of the output. The three lines L1, L2, L3 all run parallel to the center line of the lenticular lens unit 125, which may be an objective lens, so that the light from each individual line L1, L2, L3 is refracted in the same direction. A first line L1 indicates the light coming from pixel group A, a third line L3 that from the further pixel group B. A second line L2 illustrates a transition from pixel group A to pixel group B. Instead of the enlargement of only the black matrix 505 in the parallel orientation described in Figs. 4 to 6, a mixture of pixels 120 from both pixel group A and pixel group B is now projected onto the viewer, which is represented by the second line L2.In this way, a relatively soft transition between two pixel groups A, B can be created, whereby a more homogeneous intensity distribution 700 of the intensities 610 is achieved compared to the intensity distribution described in Fig. 6, shown here on the right.

[0078] The lenticular lens unit 125 / lens is thus arranged at an angle to the pixel matrix. There is a smooth transition between two adjacent pixel groups A, B, and the magnification of only the black matrix 505 will not appear upon viewing. Instead, a mixture of pixels from both pixel groups A, B is projected onto the viewer. This allows for a relatively homogeneous intensity distribution to be created.

[0079] Nevertheless, this display device 110, which according to this embodiment is designed as an autostereoscopic display based on lens-shaped lenticular lenses, suffers from a non-uniform, more homogeneous intensity distribution 700. Even with the oblique alignment of the lenses, a significant deviation in the distribution can occur, as can be seen here. Therefore, the operating device described in Figure 1 is advantageously designed to compensate for this still non-uniform, more homogeneous intensity distribution 700.

[0080] Fig. 8 shows a top view of a display device 110 for use with an operating device according to an embodiment. This may be the display device 110 described in Fig. 1, 2, 3, or 7.

[0081] Shown is activation of pixel group A for view A on the display device 110 / display panel and switching off the other pixels during the intensity measurement of view A described in Fig. 9.

[0082] Fig. 9 shows a schematic representation of a generating device 170 according to an embodiment for generating at least one filter function fA for use with an operating device according to an embodiment. This can be the generating device 170 and operating device described in Fig. 1. Also shown is the display device 110, in which, as described in Fig. 8, only pixel group A is activated.

[0083] The generation device 170 has a detection device 900 and an optimization device 905. The detection device 900 is designed to detect a first intensity h of the pixel group A illuminated using a first measurement position Mi in the observation plane 155 and at least a second intensity L of the background illumination pixel at a second measurement position M2 in the observation plane 155 that differs from the first measurement position Mi, in order to obtain an intensity distribution dA of the pixel group A using the first intensity h and the second intensity L. According to this exemplary embodiment, the intensity distribution dA is generated in an evaluation unit 915 of the generation device 170.The optimization device 905 is designed to optimize the intensity distribution dA such that a constant synthetic distribution of the intensities h, L is achieved in the observation plane 155 in order to obtain the filter function A for the pixel group A.

[0084] According to this exemplary embodiment, the detection device 900 is embodied as a camera. According to various exemplary embodiments, the optimization device 905 and / or evaluation unit 915 are part of the camera or arranged externally of the camera.

[0085] According to this exemplary embodiment, the second measuring position M2 is a measuring position shifted laterally to the first measuring position Mi within the observation plane 155. According to this exemplary embodiment, the detection device 900 is designed to further detect a third intensity h of the pixel group A at a third measuring position M3 in the observation plane 155, which differs from the first measuring position Mi and the second measuring position M2, and / or at least a fourth intensity I4 of the pixel group A at a fourth measuring position MJn of the observation plane 155, which differs from the third measuring position M3, in order to obtain the intensity distribution dA of the pixel group A using the third intensity I3 and / or the fourth intensity k.

[0086] According to this exemplary embodiment, the detection device 900 is designed to detect a further first intensity of a further pixel group B at the first measuring position Mi in the observation plane 155 and at least one further second intensity of the further pixel group B at the second measuring position M2 in the observation plane 155, which is shifted laterally to the first measuring position Mi, in order to obtain a further intensity distribution dß of the further pixel group B using the further first intensity and the further second intensity. The optimization device 905 is designed according to this exemplary embodiment to optimize the further intensity distribution dß such that a constant synthetic distribution of the further intensities in the observation plane 155 is achieved in order to obtain a further filter function fß for the further pixel group B.

[0087] In other words, Fig. 9 shows the use of a camera to record the intensity distribution dA of view A. View A is activated across the entire display field of the display device 110. The camera moves through the observation plane 155, and the intensity value h, h, Is, k at each lateral position M1, M2, M3, M4 is measured. The four positions are mentioned only as an example. In reality, the intensity must be recorded at significantly more points, e.g., from 1 to n.

[0088] The following describes the recording of the intensity distribution dA, dß of each view A, B, C using the generating device 170:

[0089] In one application example, each view / pixel group A, B, C is switched on sequentially, and the respective intensity distribution dA, dβ, dc on the designated observation plane 155 is recorded. An example is shown here in Fig. 10, where only view A is switched on and all other views are switched off. Then, the camera is placed on the observation plane 155 to measure the intensity. The camera is moved along the observation plane 155, and the intensity value h, h, I3, k at each lateral position M1, M2, M3, M4 is recorded. After the measurement, according to this embodiment, the intensity distribution dA, dβ, dc is determined; an example of such a distribution is shown in Fig. 10. According to one embodiment, the measurement is carried out accordingly for all views / pixel groups A, B, C.

[0090] Subsequently, optimization is performed in the optimization device 905 based on the recorded intensity distribution dA. To simplify the explanation, only three views / pixel groups A, B, and C are analyzed here and in the following figures to describe the optimization process. Figure 11 shows the intensity distributions dA, dB, and dC of view / pixel group A, view / pixel group B, and view / pixel group C.

[0091] Fig. 10 shows an intensity distribution dA of a pixel group A measured using a generating device according to an embodiment. This can be the pixel group A described in Fig. 9 for view A. Fig. 11 shows intensity distributions ΔA, dβ, dc measured using a generating device according to an embodiment. These can be the intensity distributions dA, dβ, dc of the pixel groups A, B, C described in Fig. 9.

[0092] If all pixels are simply switched on, the black dotted line 1105 results with an obvious variation in the intensity distribution.

[0093] Shown are the intensity distribution dA of view / pixel group A, the further intensity distribution dß of view / pixel group B, and an additional intensity distribution dc of view / pixel group C. When all pixels of the screen are switched on, the synthetic intensity approaches the black dashed line 1105, with the distribution varying significantly. The optimization, which can be performed using the optimization facility described in Fig. 9, aims to achieve a constant synthetic intensity distribution by adjusting the pixel values ​​of the individual views A, B, C.

[0094] According to this embodiment, three intensity distributions dA, dß, dc can be derived from the measurement, namely dA, dß, dc- 4. 1

[0095] Then, the generating device creates three filter functions to modify the original intensity distribution, namely fA, fß, fc- 4. 2

[0096] The filter function, shown in Fig. 12, is composed of the three filtered intensity distributions and can be expressed as follows g = fA'dA + fß-dß + fcdc 4. 3

[0097] The goal of the optimization is to achieve a constant synthetic distribution in the observation plane, so that the objective can be described as follows: t / x, g(x) = const, 4. 4 where x represents the lateral position in the observation plane 155. Using equation 4. 4 as the objective, the optimization process can be carried out to determine the filter functions fA, fß, fc. Figure 12 shows an example of the calculated filter functions fA, fß, fc stored in the generating device and / or the operating device for the real-time adaptation process described in Fig. 1.

[0098] Fig. 12 shows the original intensity distribution of pixel group A, B and C using a generating device according to an embodiment.

[0099] Shown are the calculated filter functions fA, fß, fc of three selected views / pixel groups A, B, C. The three filter functions fA, fß, fc were determined by the optimization process described in Figs. 9 to 11 using the optimizer and provided to the operating device.

[0100] Fig. 13 shows a flowchart of a method 1300 according to an embodiment for operating a display device. This may be a method 1300 that can be executed and / or controlled by one of the operating devices described with reference to the preceding figures in connection with the display device described in one of the preceding figures.

[0101] The method 1300 comprises a reading step 1305, a selecting step 1310, and an activating step 1315. In reading step 1305, an eye position signal is read, which represents a position of an eye of a viewer viewing the display device in an observation plane relative to the display device. In selecting step 1310, at least one pixel group visible from the position of the eye is selected from the plurality of pixel groups using the position of the eye. In activating step 1315, the at least one visible pixel group is activated using the position and the filter function of the at least one visible pixel group.According to one embodiment, the step 1310 of selecting and the step 1315 of activating are repeatedly executed when, in the step 1305 of reading for the eye, an eye position signal is read in, which represents a second position of the eye that differs from the position.

[0102] For example, a filter function fA is applied to all pixels belonging to a pixel group A, as described in the previous figures. The filter function fA is used, for example, to adjust the intensity of all pixels in group A. A filter function fß is then used, for example, to adjust a different intensity for all pixels in group B, and so on. In this way, different intensities can be assigned to the pixels in different groups using the different filter functions. Which pixel group is switched on or off depends on the eye position. The membership of pixels in group A, B, C, etc. is not determined by the filter function, but is specified by the system design. The filter function fA is then applied to all pixels in group A and changes, for example, their intensity. The filter functions of the pixels in the other groups are used accordingly.

[0103] According to one embodiment, method 1300 optionally includes a deactivation step 1320, in which at least one invisible pixel group is deactivated if, in the selection step 1310, at least one pixel group invisible from the position of the eye is selected from the plurality of pixel groups using the position of the eye and the filter function. According to one embodiment, method 1300 includes a detection step 1325, in which the eye is detected using an eye-tracking device, and the eye position signal is provided.

[0104] The procedural steps presented here can be repeated and carried out in a different order than described.

[0105] Fig. 14 shows a flowchart of a method 1400 according to a

[0106] Embodiment for generating filter functions. These can be the filter functions described in one of the preceding figures. Method 1400 can be carried out and / or controlled by the generating device described in one of the preceding figures.

[0107] The method 1400 comprises a detection step 1405 and an optimization step 1410. In detection step 1405, the intensities of the pixel groups are detected at measurement positions in the observation plane in order to obtain intensity distributions of the pixel groups using the intensities. In optimization step 1410, the intensity distributions are optimized such that a constant synthetic distribution of the intensities in the observation plane is achieved in order to obtain the filter functions for the pixel groups.

[0108] According to one embodiment, the filter functions are determined once, e.g. in the laboratory, where the intensity in a viewing plane is measured. This viewing plane results from the application. In a vehicle, for example, the viewing plane could be 70 cm from the display. The filter functions are calculated from these measurements in order to achieve a homogeneous intensity distribution in this plane. The position of the eyes in real operation does not later influence the filter functions. This means that no filter function fA or fß is adjusted with regard to the position of the first or second eye. In general, the filter functions could also change something other than the intensity, e.g. colors or grayscale. This way, errors in the system can be corrected.

[0109] In step 1405 of detecting, the intensities at the measurement positions are detected using a camera according to one embodiment.

[0110] Such measurements are performed to obtain the filter functions. In practice, this is done, for example, in the laboratory, and the filter functions are determined. These are then stored in the system and subsequently applied accordingly during normal operation. Thus, the approach described here is based on such a measurement method. To achieve the complete intensity distribution across the entire observation plane, the intensity should be measured at several locations, from position 1, 2, 3, 4... Ideally, one obtains an intensity curve over the position. By measuring intensity distributions of the majority of pixel groups, a constant synthetic distribution can be optimized. The neighboring

[0111] According to one embodiment, pixel groups are considered simultaneously. For example, the intensity distribution for pixel group B is to be determined. The superimposed total intensity from the individual pixel groups is then to be kept constant across the position. This is done accordingly for all pixel groups. If you have four pixel groups, you would also have four filter functions that allow you to achieve a constant intensity distribution when all four pixel groups are activated.

Claims

Claims 1. A method (1300) for operating a display device (110), for example for a vehicle (100), wherein the display device (110) has a plurality of pixel groups (A, B, C, D), in particular more than four pixel groups (A, B, C, D), and an optical unit, in particular a lens plate, for example a lenticular lens unit (125), wherein the method (1300) comprises the following steps: Reading (1305) an eye position signal (145) representing a position of an eye (150) of a viewer viewing the display device (110) in an observation plane (155) with respect to the display device (110); Selecting (1310) pixel groups visible from the position of the eye (150) from the plurality of pixel groups (A, B, C, D) using the position of the eye (150); and Activating (1315) the visible pixel groups using the position of the eye (150) and the visible Filter functions assigned to pixel groups, wherein the filter functions represent filter functions generated according to a method (1400) for generating filter functions for all pixel groups, for example filter functions (fA, fβ, fc, fd), wherein the method for generating filter functions for all pixel groups comprises a step of detecting (1405) a plurality of intensities (h, h, h, L, ...) of all pixel groups, for example pixel group (A, B, C, D) at a plurality of measurement positions (M1, M2, M3, M4, ...) in the observation plane (155) in order to determine intensity distributions (dA, dβ, dc, d0) of the pixel groups (A, B, C, D), and a step of optimizing (1410) the intensity distributions (dA, dß, dc, do) such that a desired synthetic distribution of the plurality of intensities (h, h, h, k, •••) is achieved in the observation plane (155) in order to obtain the filter functions (A, fß.fc.fo) for the pixel groups (A, B, C, D).

2. Method (1300) according to claim 1, wherein in step (1305) of reading in the eye position signal (145) is read in, which further represents a further position of a further eye (180) of the observer viewing the display device (110) in the observation plane (155) with respect to the display device (110), wherein in step (1310) of selecting pixel groups visible from the further position of the further eye (180) are selected from the plurality of pixel groups (A, B, C, D) using the further position of the further eye (180), and wherein in step (1315) of activating the visible pixel groups, the pixel groups visible from the further position of the further eye (180) are activated using the further position of the further eye (180) and the further filter functions associated with the pixel groups visible from the further position of the further eye (180).

3. Method (1300) according to one of the preceding claims, wherein the step (1310) of selecting and the step (1315) of activating are optionally carried out repeatedly if, in the step (1305) of activating for the eye (150), an eye position signal (145) is read in which represents a second position of the eye (150) different from the position.

4. The method (1300) according to any one of the preceding claims, comprising a step (1325) of detecting the eye (150) using an eye tracking device (112) and providing the eye position signal (145).

5. A method (1400) for generating filter functions for all pixel groups, for example filter functions (fA, fß, fc, fd), for use in a method (1300) according to any one of claims 1 to 4, wherein the method (1400) comprises the following steps: Detecting (1405) a plurality of intensities (h, h, Is, k, •••) of all pixel groups, for example pixel group (A, B, C, D) at a plurality of measuring positions (Mi, M2, M3, M4, ...) in the Observation plane (155) to obtain intensity distributions (dA, dß, dc, do) of the pixel groups (A, B, C, D) using the plurality of intensities (h, h, I3, k); and Optimizing (1410) the intensity distributions (dA, dß, dc, do) such that a desired synthetic distribution of the majority of intensities (h, h, I3, k, ...) in the observation plane (155) in order to obtain the filter functions (fA, fß, fc, fo) for the pixel groups (A, B, C, D).

6. A generating device (170) configured to execute and / or control the steps (1405, 1410) of the method (1400) according to claim 5 in corresponding units (900, 905, 915).

7. Operating device (105) which is configured to execute and / or control the steps (1305, 1310, 1315, 1320, 1325) of the method (1300) according to one of claims 1 to 6 in corresponding units (130, 135, 140).

8. Display system (175) with an operating device (105) according to claim 7 and / or a generating device (170) according to claim 6 and the display device (110).

9. The display system (175) according to claim 8, wherein a pixel matrix of the plurality of pixel groups (A, B, C, D) is arranged obliquely with respect to the lenticular lens unit (125).

10. A computer program configured to execute and / or control the steps (1305, 1310, 1315, 1320, 1325; 1405, 1410) of one of the methods (1300; 1400) according to one of claims 1 to 4 or 5.

11. A machine-readable storage medium on which the computer program according to claim 10 is stored.

Images