Method and operating device for operating display device, for example for vehicle, method and generating device for generating filter function, and display system for vehicle
By combining eye-tracking equipment and calibration processes, the intensity distribution of pixel groups is adjusted in real time, solving the problems of uneven intensity distribution and low energy efficiency in lenticular lens autostereoscopic display devices, and achieving uniform light distribution and energy-saving effects.
Patent Information
- Application Number
- CN202480020477.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-03-23
- Filing Date
- 2024-03-21
- Publication Date
- 2025-11-21
AI Technical Summary
Traditional autostereoscopic display devices based on lenticular lenses suffer from uneven intensity distribution and low energy efficiency in terms of illumination characteristics, especially when the viewer moves, resulting in a decrease in 3D image quality and energy waste.
By combining eye-tracking devices and calibration processes, the intensity distribution of pixel groups is adjusted in real time. The eye-tracking devices identify the viewer's eye position and adapt the filtering function of the pixel groups in real time according to the position to achieve uniform light distribution and energy-saving effects.
It achieves uniform intensity perception and improved energy efficiency as the viewer moves, ensuring the stability of 3D image quality and energy-efficient operation of display devices.
Smart Images

Figure CN121002844A_ABST
Abstract
Description
Technical Field
[0001] This solution is based on an apparatus or method according to the type of independent claim. The subject matter of this solution is also a computer program. Background Technology
[0002] To display three-dimensional images, an automated stereoscopic display based on lenticular lenses can be used. Summary of the Invention
[0003] Against this backdrop, the present invention, based on the main claim, proposes a method for operating a display device, for example, for a vehicle; an operating device using the method; a corresponding computer program; a method for generating a filtering function; a generating device using the method; a corresponding computer program; and finally, a display system for a vehicle. The measures listed in the dependent claims enable beneficial extensions and improvements to the method described in the independent claim.
[0004] The advantage of the proposed method is that, during the operation of the display device, a uniformly perceptible light distribution is generated for the observer of the display device when viewing it.
[0005] A method for operating a display device for a vehicle is proposed. The display device has multiple pixel groups, particularly more than four pixel groups, and optical units, such as lenticular lens units arranged obliquely relative to the arrangement of the multiple pixel groups. The method includes a reading step, a selection step, and an adjustment step. In the reading step, an eye position signal is read, representing the position of a viewer's eye relative to the display device in the viewing plane. In the selection step, a pixel group visible from the multiple pixel groups is selected using the eye position. In the activation step, the visible pixel group is adjusted using the eye position and a filtering function assigned to the visible pixel group.
[0006] The filtering function assigned to a visible pixel group is applied to all pixels belonging to that visible pixel group. For example, the filtering function can adapt the intensity of all pixels in the visible pixel group. The filtering function assigned to another pixel group can then adapt, for example, a different intensity for all pixels in that other pixel group, and so on. The eye position determines which pixel group is on or off. The attribution of pixels to their respective pixel groups is not determined by the filtering function but is pre-defined by the system design. The filtering function assigned to a pixel group is then applied to all pixels in that group and changes, for example, their intensity. These filtering functions are determined once by measuring the intensity in the viewing plane (e.g., in a laboratory setting). This viewing plane is determined by the application. For example, in a vehicle, the viewing plane might be 70 cm from the display. The filtering function is calculated based on these measurements to achieve a uniform intensity distribution on that plane. In practice, the eye position does not subsequently affect the filtering function. The filtering function can also typically change other things besides intensity, such as color or grayscale. Therefore, system errors can be corrected.
[0007] This method can be implemented, for example, in software, hardware, or a hybrid of software and hardware, such as in a control device.
[0008] The display device may have: a 2D display comprising at least one or more backlight pixels, the 2D display becoming an autostereoscopic 3D display due to the lenticular lens unit. The backlight pixels may be emitters. Each pixel of the display device may have its own assigned backlight pixel. The term "pixel matrix" should be understood as a matrix arrangement of pixels, wherein the pixels and / or backlight pixels are arranged, for example, by columns and by rows. The lenticular lens unit may have a plurality of adjacently arranged lenticular lenses in the form of lens strips, these lenticular lenses being each shaped as a semi-cylindrical shape. These lenticular lenses may be arranged on a thin film. The lenticular lens unit may also be referred to as a lenticular lens array or a lenticular lens grid. For example, these lens strips of the lenticular lens unit are arranged parallel to each other and obliquely to the columns and rows of the pixel matrix. Each pixel group represents the pixel group required for viewing an image. For example, the display surface may be divided into multiple display areas, and at least one pixel from each pixel group may be arranged in each display area. These display areas may be shaped identically in terms of their shape and the number and composition of pixels they each contain. Each display area can be equipped with a lenticular lens unit. For example, depending on the viewer's observation position, at least one pixel in each of the multiple pixel groups can be laterally visible through the lenticular lens unit. Therefore, due to the lenticular lens unit, the light emitted by the pixels of the selected pixel group is aligned with the eye position. Conversely, the light from pixels of the unselected pixel group is aligned to a position offset from the eye position. In the reading step, the eye position signal can be read, for example, by an eye-tracking device. This method allows for optimization of the illumination intensity perceived by the viewer of the display device. For example, a constant intensity is perceived by the viewer when the eye moves laterally within the viewing plane.
[0009] In the reading step, an eye position signal can be read, which also represents and assigns another position of the viewer's other eye relative to the display device in the viewing plane. In the selection step, other pixel groups visible from the other position of the other eye are selected from the plurality of pixel groups using the other position of the other eye. In the activation step, the other visible pixel groups are activated using the other position and other filtering functions assigned to the other pixel groups.
[0010] If another location of the other eye is further identified, and the intensity of the assigned background lighting pixels is adjusted for that other location using a different filtering function assigned to that other location, then this achieves, for example, that the two eyes produce a uniform intensity perception when viewing a display device.
[0011] If a position signal is read for the eye during the reading step, and this position signal represents a second position of the eye different from the previously mentioned position, the selection and adjustment steps can be repeated. This allows for continuous adaptation of the illumination intensity as the eye position changes, thereby keeping the illumination intensity constant, for example, as the eye moves laterally within the viewing plane.
[0012] These pixel groups can be activated or deactivated depending on the eye's position, but they don't have to. It would also be equally useful if all pixel groups remained active.
[0013] According to one embodiment, the method may further include the step of detecting the eyes and providing an eye position signal when using an eye-tracking device. Therefore, eye position can be detected and provided quickly and easily when using an eye-tracking device, which may, for example, have at least one camera for tracking the eyes.
[0014] The proposed solution also provides an operating device designed to perform, manipulate, or implement variations of the proposed method within a corresponding apparatus. This implementation of the solution in the form of an apparatus also enables the task on which the solution is based to be solved quickly and efficiently.
[0015] Therefore, the operating device may have: at least one computing unit for processing signals or data; at least one storage unit for storing signals or data; at least one interface for a sensor or actuator, used to read sensor signals from the sensor or output data or control signals to the actuator; and / or at least one communication interface for reading or outputting data embedded in a communication protocol. The computing unit may be, for example, a signal processor, a microcontroller, etc., and the storage unit may be a flash memory, EEPROM, or magnetic storage unit. The communication interface may be designed to read or output data wirelessly and / or via a wired connection, wherein a communication interface capable of reading or outputting wired data may, for example, read the data from a corresponding data transmission line electrically or optically, or output it to a corresponding data transmission line.
[0016] In this example, the operating device can be understood as an electrical device that processes sensor signals and outputs control and / or data signals based on these sensor signals. The operating device may have an interface, which can be designed in hardware and / or software. In a hardware design, these interfaces may, for example, be part of a so-called ASIC system that contains various functions of the operating device. However, the interface may also be a standalone integrated circuit, or at least partially composed of discrete devices. In a software design, these interfaces may be software modules, which, for example, exist on a microcontroller along with other software modules.
[0017] Furthermore, the present invention also proposes a method for generating a filtering function, which is used for the aforementioned method for operating the display device in one of the variations. The method for generating the filtering function includes a detection step and an optimization step. In the detection step, multiple intensities of the pixel group are detected at multiple measurement locations in the observation plane to obtain an intensity distribution of the pixel group using these intensities. In the optimization step, the intensity distribution is optimized such that a desired, for example, constant, composite distribution of the multiple intensities is achieved in the observation plane to obtain a filtering function for these pixel groups.
[0018] In the detection step, a first intensity of the luminescent pixel group at a first measurement position and a second intensity of the luminescent pixel group at a second measurement position can be detected using a camera. The second measurement position can be a measurement position laterally offset relative to the first measurement position within the observation plane.
[0019] The proposed solution also provides a generation device designed to perform, manipulate, or implement variations of the proposed method within a suitable apparatus. This embodiment of the solution in the form of an apparatus also enables the task on which the solution is based to be solved quickly and efficiently.
[0020] To this end, the generating device may include: at least one computing unit for processing signals or data; at least one storage unit for storing signals or data; at least one interface for a sensor or actuator, used to read sensor signals from the sensor or output data or control signals to the actuator; and / or at least one communication interface for reading or outputting data embedded in a communication protocol. The computing unit may be, for example, a signal processor, a microcontroller, etc., and the storage unit may be a flash memory, EEPROM, or magnetic storage unit. The communication interface may be designed to read or output data wirelessly and / or via a wired connection, wherein a communication interface capable of reading or outputting wired data may, for example, read the data from a corresponding data transmission line electrically or optically, or output it to a corresponding data transmission line.
[0021] In this example, the generating device can be understood as an electrical device that processes sensor signals and outputs control and / or data signals based on these sensor signals. The generating device may have interfaces, which can be designed in hardware and / or software. In a hardware design, these interfaces may, for example, be part of a so-called ASIC system that contains various functions of the generating device. However, the interface may also be a standalone integrated circuit, or at least partially composed of discrete devices. In a software design, these interfaces may be software modules, which, for example, exist on a microcontroller along with other software modules.
[0022] A display system includes the aforementioned operating device and / or the aforementioned generating device and a display device. A pixel matrix of multiple pixel groups can be arranged obliquely relative to a lenticular lens unit. For example, the pixel matrix can be arranged rotatably relative to the lenticular lens unit. In this case, the pixel matrix of multiple pixel groups can be arranged obliquely / rotatably, for example, relative to the orientation of the lens strip of the semi-cylindrical lenticular lens of the lenticular lens unit.
[0023] It is also advantageous to have a computer program product or computer program with program code, which can be stored on a machine-readable carrier or storage medium, such as semiconductor memory, hard disk memory or optical memory, and particularly for performing, implementing and / or manipulating the steps of the method according to one of the above embodiments when the program product or program is executed on a computer or device. Attached Figure Description
[0024] Embodiments of the proposed solution are shown in the accompanying drawings and explained in more detail in the following description. Wherein:
[0025] Figure 1 A schematic diagram of a vehicle having an operating device according to an embodiment of a display device for operating a vehicle is shown;
[0026] Figure 2 A perspective view of a display device used with an operating device according to an embodiment is shown;
[0027] Figure 3 A schematic diagram of a display device used with an operating device according to an embodiment is shown;
[0028] Figure 4 A schematic diagram of a cylindrical lens used to control the direction of light emission is shown;
[0029] Figure 5 A top view of the 3D display is shown;
[0030] Figure 6 A side view of the 3D display is shown;
[0031] Figure 7 A top view of a display device used with an operating device according to an embodiment is shown.
[0032] Figure 8 A top view of a display device used with an operating device according to an embodiment is shown.
[0033] Figure 9 A schematic diagram of a generation apparatus according to an embodiment is shown for generating at least one filtering function for use by an operating apparatus according to an embodiment.
[0034] Figure 10 An intensity distribution generated using the generating apparatus according to an embodiment is shown;
[0035] Figure 11 The intensity distribution measured using the generating apparatus according to the embodiment is shown;
[0036] Figure 12 The original intensity distribution of multiple pixel groups is shown;
[0037] Figure 13 A flowchart of a method for operating a display device according to an embodiment is shown;
[0038] Figure 14 A flowchart of a method for generating a filter function according to an embodiment is shown. Detailed Implementation
[0039] In the following description of advantageous embodiments of this solution, the same or similar reference numerals are used for elements shown in different figures and having similar functions, wherein repeated descriptions of these elements are omitted.
[0040] Figure 1 A schematic diagram of a vehicle 100 is shown, having an operating device 105 according to an embodiment of a display device 110 for operating the vehicle 100. The use of the display device 110 in the vehicle 100 is merely exemplary herein.
[0041] By way of example only, the operating device 105 according to the described embodiment is arranged on or within the vehicle 100, for example, implemented in the control equipment of the vehicle 100 or on the display device 110. According to alternative embodiments, the operating device 105 can be used in conjunction with a mobile phone, computer, or medical monitoring equipment. The application can be performed in any field that uses a display. According to this embodiment, the vehicle 100 or display device 110 also includes an eye-tracking device 112, for example, which includes a personal monitoring camera facing the driver's seat of the vehicle 100. The display device 110 has a plurality of pixel groups A and lenticular lens units 125 arranged obliquely relative to the pixel matrix of the plurality of pixel groups A. For clarity, in Figure 1 Only one pixel group A from the plurality of pixel groups A is shown in the image. Other pixel groups are, for example, in... Figure 3 , 7 As shown in Figure 9.
[0042] The operating device 105 has a reading interface 130, a selection device 135, and an adjustment device 140. The reading interface 130 is designed to read an eye position signal 145, which indicates the position of the viewer's eye 150 relative to the display device 110 in the viewing plane 155, wherein a filtering function f is pre-determined for the viewing plane 155 and the pixel group A. A The selection device 135 is designed to select, from the plurality of pixel groups A, the pixel group A visible from the position of the eye 150, using the position of the eye 150. The adjustment device 140 is designed to, using the position and the filtering function f A In this case, the visible pixel group A is activated.
[0043] According to this embodiment, the display device 110 has a 2D display 158, which becomes an autostereoscopic 3D display due to the lenticular lens unit 125. According to this embodiment, the lenticular lens unit 125 has a plurality of adjacently arranged lenticular lenses 160 in the form of lens strips, each of which can be formed in a semi-cylindrical shape. According to one embodiment, these lenticular lenses 160 are arranged on a thin film. For example, the individual lenticular lenses 160 of the lenticular lens unit 125 are arranged parallel to each other and obliquely with respect to the columns and rows of the pixel matrix, see also... Figure 2 and Figures 7 to 9 Each pixel group A represents the pixel group A required to view the image. For example, depending on the viewing position in the viewing plane 155, at least one pixel 120 in each of the plurality of pixel groups A can be laterally visible through one of the cylindrical lenses 160 of the cylindrical lens unit 125.
[0044] According to this embodiment, the reading interface 130 is designed to read eye position signals 145 from the eye-tracking device 112. In order to activate pixel group A, according to this embodiment, the adjustment device 140 is designed to output an adjustment signal 165 to the visible pixel group A.
[0045] The operating device 105, in conjunction with the display device 110 and / or the generating device 170, may also be referred to as a display system 175. The generating device 170 is designed to generate multiple filtering functions f. A f B The function of the generating device 170 is as follows: Figure 9 It is described in more detail.
[0046] According to this embodiment, the readout interface 130 is designed to read an eye position signal 145, which also indicates another position of another eye 180 of a viewer viewing the display device 110 relative to the display device 110 in the viewing plane 155, wherein at least one additional filtering function f is pre-determined for other pixel groups of the viewing plane 155. B According to one embodiment, the selection device 135 is designed to select, from the plurality of pixel groups A, other pixel groups visible from the other position of the other eye 180 when using the other position of the other eye 180. According to one embodiment, the adjustment device 140 is designed to, when using the other position and the other filtering function f B In this case, the other visible pixel groups are activated.
[0047] According to one embodiment, the selection device 135 is designed to select, when using the position of eye 150 and / or the position of another eye 180, a pixel group visible from the position of said eye 150 and / or the pixel group visible from the position of said other eye 180, and to deactivate at least one background lighting pixel for illuminating the invisible pixel group.
[0048] According to this embodiment, the selection device 135 is designed to select a second pixel group visible from the position of the eye 150 when the position of the eye 150 is used, wherein the adjustment device 140 is designed to activate the visible second pixel group when the position is used.
[0049] According to one embodiment, the operating device 105 includes an eye-tracking device 112 for detecting eye 150 and / or another eye 180 and providing eye position signals 145.
[0050] The operating device 105 presented herein enables the calibration of an autostereoscopic screen display device 110 based on a lenticular lens 160 to achieve uniform light distribution.
[0051] Today, various display devices are widely used to present information to viewers, such as mobile phones, computers, medical monitoring equipment, and car dashboards. Traditional display devices can only display two-dimensional (2D) planar images lacking depth information. Viewers see the same image on a 2D display regardless of their viewing position. Therefore, traditional 2D display devices lack two important depth information elements: motion parallax and binocular parallax. Motion parallax refers to the different relative motions between different elements in a three-dimensional (3D) scene. When a viewer moves their head, objects closer to the viewer appear to move faster than those farther away. Binocular parallax refers to the difference in how the left and right eyes perceive the same 3D scene, caused by the interpupillary distance between the two eyes. Due to the lack of these two depth information elements, spatial relationships or depth information cannot be accurately and effectively represented on 2D display devices.
[0052] Various 3D technologies have been developed to provide viewers with depth cues; these technologies can generally be categorized into stereoscopic display technologies and autostereoscopic display technologies. In the case of stereoscopic displays, viewers must wear special glasses so that their left and right eyes can receive different images on the display. Autostereoscopic displays, however, provide depth information to viewers without special glasses, greatly expanding the application range of 3D displays. Among autostereoscopic technologies, volumetric displays and holographic displays can provide the most realistic and lifelike 3D perception. However, the complex system design and technical challenges of 3D image processing limit the application range of volumetric displays and holographic displays. In terms of implementation difficulty, display devices 110 based on autostereoscopic displays with lenticular lenses 160 are widely used due to their ease of design and the high brightness they provide. By adding lenticular lens units 125 in the form of a lens array (which represents an arrangement of lenses) to the original 2D display 158, multiple images (i.e., multiple views) can be sent from the display 158 to different viewing positions. Figure 3 The example shown has four views, that is, four different groups of pixels. When the left eye 150 and the right eye 180 are located in different visual areas and receive different images from the display 158, a 3D perception is generated for the viewer.
[0053] To improve 3D perception of the display device 110 in the form of an autostereoscopic lenticular lens display shown here, a tilted structure of the lenticular lens unit 125 in the form of a lens array thin film is used to balance horizontal and vertical resolution and create smooth boundaries between views. However, the display device 110 (also referred to as a "3D display") encounters low resolution and crosstalk problems when viewing multiple views, which severely affect the quality of 3D images. Therefore, further improvements to 3D perception based on the lenticular lens 160 are crucial.
[0054] Automatic stereoscopic screens based on lenticular lenses have some drawbacks in terms of illumination characteristics. Figures 4 to 6 The text explains the basic understanding of cylindrical lens technology. Figure 2 and Figures 7 to 8 The text further explains the improved scheme based on oblique orientation.
[0055] Advantageously, the operating device 105 proposed herein integrates the calibration process with the eye-tracking device 112. The eye-tracking device 112 identifies the viewer's eye position, and the operating device 105 accordingly adapts the pixel intensity to achieve better 3D perception.
[0056] According to one embodiment, the method brings two improvements:
[0057] On the one hand, uniform intensity perception is achieved. Due to the calibration process that can be performed by the operating device 105, the viewer's eyes 150 will perceive a uniform intensity distribution when the viewer moves in front of the display device 110.
[0058] On the other hand, improved energy efficiency can be achieved for the display device 110 in the form of a self-emissive display. If a self-emissive display is used in the display device 110 as according to this embodiment, the display will, for example, have per-pixel power. If the eye position is known, according to one embodiment, only the pixel 120 corresponding to the eye position is turned on in the background lighting to ensure necessary illumination. Other pixels are turned off to save energy.
[0059] According to one embodiment, the entire calibration process is performed in at least three steps: (e.g., when using generation device 170) Figure 9 The intensity distribution of each view is recorded; the same applies when using the generating device 170. Figure 9 The aforementioned optimization of the recorded distribution; and based on eye position, as in this case... Figure 1 The real-time adaptation of pixel values is performed when the operating device 105 is used.
[0060] The core idea of the proposed scheme is to achieve a uniform intensity impression at the current eye position through eye position-related calibration and subsequent eye position-related pixel intensity control.
[0061] According to one embodiment, real-time adaptation of pixel values based on eye position is performed as follows: First, the viewer's eye position is determined by eye-tracking device 112. Based on the determined eye position, based on... Figures 9 to 12 The optimization results explained herein are used to preprocess the image in the software unit of operating device 105. The processed image is then sent to display device 110 to adjust pixels 120 to the desired intensity values. Figure 1 In the image, the left eye 150 is located, for example, at 20 mm, while the other right eye 180 is located, for example, at 80 mm. According to... Figures 9 to 12 The calculated filtering function f shown in the figure A f B f C According to this embodiment, pixel group A and the additional pixel group C are adjusted to the maximum pixel value, i.e., f. A =1, f C =1, and the other pixel group B is completely turned off, i.e., f B =0. In this way, both eyes 150 and 180 can perceive the preset intensity on the screen. As the viewer moves, the pixel values are adapted in real time, allowing eyes 150 and 180 to perceive a constant intensity distribution. According to one embodiment, if a self-emissive display is used for the display device 110, only the required backlight pixels are activated, while other unused backlight pixels are turned off to save energy.
[0062] In summary, the proposed calibration method includes an optimization process based on intensity measurements and real-time adaptation via an eye-tracking device 112. This calibration method can be applied to autostereoscopic displays with lenticular lenses 160 to achieve uniform intensity perception and improve energy efficiency.
[0063] Figure 2 A perspective view of a display device 110 used with an operating device according to an embodiment is shown. Here, the display device 110 may be... Figure 1 The display device 110 and the operating device described herein.
[0064] The pixel matrix of pixels 120 in multiple pixel groups is arranged tilted or rotated relative to the lenticular lens unit. According to this embodiment, the orientation of the lenticular lens 160 is tilted / rotated relative to the pixel matrix of the pixels 120 in the multiple pixel groups.
[0065] In order to overcome Figures 4 to 6The intensity fluctuations described herein indicate that the display device 110 includes a tilted structure of a lens array film. This prevents magnification from occurring on only one black matrix (see also...). Figure 7 This tilted orientation allows for a smooth transition between the two views.
[0066] In other words, the display device 110 has a tilt orientation of the cylindrical lens 160 aligned with the 2D display in the form of a display panel.
[0067] Figure 3 A schematic diagram of a display device 110 used with an operating device according to an embodiment is shown. The display device may be... Figure 1 or Figure 2 The display device 110 described herein.
[0068] The display device 110 is shown as an automated stereoscopic multi-view display device based on a lenticular lens 160. According to this embodiment, the lens 160 covers four pixels from different pixel groups A, B, C, and D, and refracts light from these different pixels, i.e., pixels from different pixel groups A, B, C, and D, onto preset positions 300, 305, 310, and 315 in the viewing plane. The eye at a specific position can only see one of the four pixels on the display. According to this embodiment, at the first position 300, only pixels from pixel group A are visible to the eye. According to this embodiment, at the second position 305, only pixels from another pixel group B are visible to the eye. According to this embodiment, at the third position 310, only pixels from an additional pixel group C are visible to the eye. According to this embodiment, at the fourth position 315, only pixels from another pixel group D are visible to the eye.
[0069] Figure 3 As schematically shown, each lenticular lens covers at least one pixel in each of pixel groups A, B, C, and D. The number of pixel groups A, B, C, and D is merely illustrative here, and more or fewer than four pixel groups A, B, C, and D may also be used. Each lenticular lens may cover only one pixel in each of pixel groups A, B, C, and D, or it may cover multiple pixels in each of pixel groups A, B, C, and D.
[0070] Figure 4 A schematic diagram of a cylindrical lens 160 for controlling the direction of light emission is shown. Here, the cylindrical lens can be part of a cylindrical lens unit. Figure 1 One of the cylindrical lenses described in the text is 160.
[0071] The following is for reference. Figure 4 Describes the optical function of the cylindrical lens 160 and introduces the basic cylindrical lens technology.
[0072] The pixel plane of the screen is located near the focal plane of the lenticular lens 160, as shown in the middle image segment 400. Unlike the original wide emission angle 410 shown in the left image segment 405, with the lenticular lens 160, the light from the example pixel 415 is now focused in a specific direction. Therefore, the entire example pixel 415 is projected only within a limited angular range that forms the visible area. A black matrix exists between the pixel areas in this background illumination unit, as... Figure 5 As shown.
[0073] Figure 5 A top view of a 3D display 500 is shown. This 3D display can be... Figure 1 or Figure 2 The display device described herein, wherein, with Figure 1 or Figure 2 Unlike the previous arrangement, the cylindrical lens 160 of the cylindrical lens unit is not arranged at an angle relative to the arrangement structure of the multiple pixel groups 502, but is arranged parallel to the arrangement structure of the multiple pixel groups 502.
[0074] A black matrix 505 is arranged between the pixel areas in the background illumination unit. The line marks the center line 510 of the cylindrical lens 160. The squares represent background illumination pixels 515, which are separated by the black matrix 505, and both the pixels and the black matrix 505 are magnified by the cylindrical lens 160. At the cylindrical lens 160 (also called a cylindrical lens), if an incident light beam extends parallel to the center line 510 of the cylindrical lens 160, the beam will be refracted in the same direction. Figure 5 In this example, two example lines, L1 and L2, are selected to describe the characteristics of the output light. The first position is highlighted by the first line L1, which extends primarily through the bright backlight pixels 515. These first lines L1 are magnified and form a bright area on the viewing plane. The second line L2 illustrates a second case where only the black matrix 505 is magnified and sent in a specific direction. If the viewer's eye happens to be in this direction, even if all the backlight pixels 515 are activated, the eye cannot receive any light from the display device. This occurs when the lenticular lens 160 is oriented parallel to the display / display panel. Figures 1 to 3 In the display device proposed in the paper, this effect is successfully avoided by tilting the cylindrical lens unit relative to the arrangement structure of the multiple pixel groups 502.
[0075] Figure 6 A side view of a 3D display 500 is shown. This 3D display can be... Figure 5 The 3D display 500 described in the text.
[0076] Shown here Figure 6 Further analysis was also conducted in the middle. Figure 4 and Figure 5 The discontinuity of the intensity distribution 600 in the parallel orientation case is described. When all background illumination pixels 515 are turned on, both bright pixels and the black matrix 505 are magnified, resulting in an alternating arrangement of dark and bright areas on the viewing plane 155. As the viewer moves laterally 602 within the viewing plane 155, the eye 150 perceives large fluctuations in light intensity 610, as shown in the intensity distribution 600 on the right. These large intensity fluctuations severely impair accurate 3D perception and visual experience.
[0077] In summary, Figure 6 The discontinuous intensity distribution 600 is shown in the parallel orientation case. Both the bright pixels and the black matrix 505 in the background illumination are magnified by the cylindrical lens 160, resulting in an alternating magnified arrangement of black and bright areas on the viewing plane 155. Therefore, the intensity distribution 600 of intensity 610 exhibits significant variation on the viewing plane 155.
[0078] Figure 7 A top view of a display device 110 used with an operating device according to an embodiment is shown. Here, the display device may be... Figure 1 , Figure 2 or Figure 3 The display device 110 described herein.
[0079] exist Figure 7 In the image, three lines L1, L2, and L3 are highlighted on the left to illustrate the output illumination characteristics. These three lines L1, L2, and L3 are all parallel to the center line of the cylindrical lens unit 125 (which can be an objective lens), ensuring that light from each individual line L1, L2, and L3 is refracted in the same direction. The first line L1 represents light from pixel group A, and the third line L3 represents light from another pixel group B. The second line L2 represents the transition from pixel group A to pixel group B. Figures 4 to 6 Unlike the description which only magnifies the black matrix 505 in a parallel orientation, this time the mixture of pixels 120 from pixel group A and pixel group B is projected onto the viewer, represented by the second line L2. In this way, a relatively smooth transition can be created between the two pixel groups A and B, thus... Figure 6 Compared to the intensity distribution described in the figure, a more uniform intensity distribution 700 is achieved for intensity 610 (as shown on the right).
[0080] Therefore, the cylindrical lens unit 125 / objective is arranged at an angle relative to the pixel matrix. The transition between two adjacent pixel groups A and B is smooth, and there is no situation where only the black matrix 505 is magnified during viewing. Instead, the mixture of these two pixel groups A and B is projected onto the viewer. This produces a relatively uniform intensity distribution.
[0081] However, the display device 110, which is an autostereoscopic display based on a lens-shaped cylindrical lens according to this embodiment, still encounters the problem of uneven, but relatively more uniform, intensity distribution 700. Even when the lens is tilted, significant deviations in the distribution may occur, as shown in the figure. Therefore, Figure 1 The operating device described herein is advantageously designed to equalize this still uneven, but relatively more uniform, intensity distribution 700.
[0082] Figure 8 A top view of a display device 110 used with an operating device according to an embodiment is shown. Here, the display device may be... Figure 1 , Figure 2 , Figure 3 or Figure 7 The display device 110 described herein.
[0083] It shows that: In Figure 9 During the intensity measurement of view A as described in the text, pixel group A for view A on display device 110 / display panel is activated and other pixels are turned off.
[0084] Figure 9 A schematic diagram of a generation apparatus 170 according to one embodiment is shown. This generation apparatus is used to generate at least one filtering function f for operating the apparatus according to one embodiment. A Here, it can be Figure 1 The generating device 170 and the operating device are described in the text. A display device 110 is also shown, wherein, as... Figure 8 As shown, only pixel group A is activated.
[0085] The generation device 170 includes a detection device 900 and an optimization device 905. The detection device 900 is designed to detect a first intensity I1 of pixel group A illuminated using a first measurement position M1 in the observation plane 155, and at least one second intensity I2 of pixel group A illuminated using background lighting pixels at a second measurement position M2 in the observation plane 155 different from the first measurement position M1, so as to obtain the intensity distribution d of pixel group A using both the first intensity I1 and the second intensity I2. A According to this embodiment, the intensity distribution d A It is generated in the evaluation unit 915 of the generation device 170. The optimization device 905 is designed to optimize the intensity distribution d in this way. A This ensures a constant composite distribution of intensities I1 and I2 in the observation plane 155, thereby obtaining the filtering function f for pixel group A. A .
[0086] According to this embodiment, the detection device 900 is shaped like a camera. According to different embodiments, the optimization device 905 and / or the evaluation unit 915 are part of the camera or arranged outside the camera.
[0087] According to this embodiment, the second measurement position M2 is a measurement position laterally offset relative to the first measurement position M1 within the observation plane 155. According to this embodiment, the detection device 900 is designed to further detect a third intensity I3 at a third measurement position M3 in the observation plane 155 that differs from the first measurement position M1 and the second measurement position M2, and / or at least one fourth intensity I4 at a fourth measurement position M4 in the observation plane 155 that differs from the third measurement position M3, so as to obtain the intensity distribution d of pixel group A while also using the third intensity I3 and / or the fourth intensity I4. A .
[0088] According to this embodiment, the detection device 900 is designed to detect another first intensity of the other pixel group B at a first measurement position M1 in the observation plane 155, and at least one other second intensity of the other pixel group B at a second measurement position M2 in the observation plane 155 that is laterally offset relative to the first measurement position M1, so as to obtain another intensity distribution d of the other pixel group B using the other first intensity and the other second intensity. B According to this embodiment, the optimization device 905 is designed to optimize the other intensity distribution d in this way. B This enables a constant composite distribution of another intensity in observation plane 155, in order to obtain additional filtering functions f for the other pixel group B. B .
[0089] in other words, Figure 9 The image shows: using a camera to record the intensity distribution d of view A. A View A is activated over the entire display area of display device 110. The camera moves across the viewing plane 155, and intensity values I1, I2, I3, I4 are measured at each lateral position M1, M2, M3, M4. These four positions are listed only as examples. In practice, the intensity must be recorded at significantly more points, for example, from 1 to n.
[0090] The following describes the intensity distribution d of each view A, B, and C recorded using the generating device 170. A d B :
[0091] In one application example, each view / pixel group A, B, and C is opened sequentially, and the corresponding intensity distribution d on the set observation plane 155 is recorded. A dB d C Here, Figure 10 An example is shown where only view A is open, while all other views are closed. A camera is then placed on the observation plane 155 to measure intensity. The camera is moved along the observation plane 155, and intensity values I1, I2, I3, and I4 are recorded at each lateral position M1, M2, M3, and M4. After measurement, the intensity distribution d is determined according to this embodiment. A d B dC; Figure 10 An example for this distribution is shown. According to one embodiment, the measurement is performed accordingly for all view / pixel groups A, B, and C.
[0092] Subsequently, in the optimization device 905, based on the recorded intensity distribution d A Optimization is then performed. For simplicity, only three views / pixel groups A, B, and C will be analyzed here and in the following figures to describe the optimization process. Figure 11 The diagram shows the intensity distribution d of view / pixel group A, view / pixel group B, and view / pixel group C. A d B d C .
[0093] Figure 10 The following is shown: the intensity distribution d of pixel group A as measured using the generation device according to the embodiment. A Here, pixel group A could be... Figure 9 The pixel group A described in the text refers to view A.
[0094] Figure 11 The following is shown: the intensity distribution d measured using the generating apparatus according to the embodiment. A d B d C These can be Figure 9 The intensity distribution d of pixel groups A, B, and C described in the figure A d B d C .
[0095] If all pixels are turned on, a black dashed line 1105 with a significant change in intensity distribution is obtained.
[0096] The following is shown: Intensity distribution d of view / pixel group A A Another intensity distribution d of view / pixel group B B And the additional intensity distribution d of view / pixel group C C When all pixels on the screen are enabled, the composite intensity approaches the black dashed line 1105, where the distribution changes significantly. When using... Figure 9 The optimization goal that can be performed in the case of the optimization device described herein is to achieve a constant composite intensity distribution by adapting the pixel values of each view A, B, and C.
[0097] According to this embodiment, three intensity distributions d can be derived from the measurements. A d B d C ,Right now:
[0098] d A ,d B ,d C 4.1
[0099] Then, the generating device creates three filtering functions to modify the original intensity distribution, and more precisely...
[0100] f A f B f C 4.2
[0101] like Figure 12 As shown, the filtering function consists of three filtered intensity distributions and can be expressed as follows:
[0102] g = f A ·d A +f B ·d B +f C ·d C 4.3
[0103] The optimization objective is to achieve a constant composite distribution in the observation plane, such that the objective can be described as follows:
[0104]
[0105] Where x represents the lateral position in the observation plane 155. Using Equation 4.4 as the target preset, an optimization process can be performed to determine the filtering function f. A f B f C . Figure 12 This shows the purpose of storing data in the production device and / or operating device for use with Figure 1 The calculated filtering function f in the real-time adaptation process described in the text A f B f C Examples.
[0106] Figure 12 The original intensity distribution of pixel groups A, B, and C is shown when using the generation device according to the embodiment.
[0107] The diagram shows the calculated filtering function f for three selected views / pixel groups A, B, and C. A f B f C These three filtering functions f A f B f C Through Figures 9 to 11 The optimization process described herein is determined when using an optimization device and is provided to the operating equipment.
[0108] Figure 13 A flowchart of a method 1300 for operating a display device according to an embodiment is shown. Here, the method may be a method 1300 that can be performed and / or manipulated by one of the operating devices described with reference to the foregoing drawings in conjunction with the display device described in one of the foregoing drawings.
[0109] Method 1300 includes a reading step 1305, a selection step 1310, and an activation step 1315. In the reading step 1305, an eye position signal is read, representing the position of a viewer's eye relative to the display device in the viewing plane. In the selection step 1310, at least one pixel group visible from the plurality of pixel groups is selected using the eye position. In the activation step 1315, the at least one visible pixel group is activated using the position and a filtering function of the at least one visible pixel group.
[0110] According to one embodiment, when the eye position signal read for the eye in reading step 1305 indicates a second eye position different from that position, the selection step 1310 and the activation step 1315 are repeated.
[0111] For example, as described in the diagram above, the filtering function f A It applies to all pixels belonging to pixel group A. For example, the filtering function f can be used. A This is used to adapt the intensity of all pixels in group A. Then, the filtering function f is used. B This is to adapt, for example, different intensities for all pixels in group B, and so on. In this way, different intensities can be assigned to pixels in different groups, for example, using different filtering functions. From the eye position, it is determined which pixel group is turned on or off. The attribution of pixels to groups A, B, C, etc., is not determined by the filtering function, but is pre-defined by the system design. Then, the filtering function f... A The filter is applied to all pixels in group A, and their intensity is changed, for example. Filtering functions for pixels in other groups are applied accordingly.
[0112] According to one embodiment, the method 1300 optionally includes a deactivation step 1320, wherein if at least one pixel group that is not visible from the eye's position is selected from a plurality of pixel groups in the selection step 1310 using eye position and a filtering function, then at least one invisible pixel group is deactivated. According to one embodiment, the method 1300 includes a detection step 1325, wherein the eye is detected using an eye-tracking device, and the eye position signal is provided.
[0113] The steps presented here can be repeated and performed in a different order than described.
[0114] Figure 14 A flowchart of a method 1400 for generating a filter function according to one embodiment is shown. Here, the filter function may be the filter function described in one of the foregoing figures. The method 1400 may be performed and / or manipulated by the generating device described in one of the foregoing figures.
[0115] The method 1400 includes a detection step 1405 and an optimization step 1410. In the detection step 1405, the intensity of a pixel group is detected at a measurement location in the observation plane to obtain an intensity distribution of the pixel group using these intensities. In the optimization step 1410, the intensity distribution is optimized to achieve a constant composite intensity distribution in the observation plane to obtain a filtering function for the pixel group.
[0116] According to one embodiment, these filtering functions are determined once by measuring the intensity in the viewing plane (e.g., in a laboratory setting). This viewing plane is determined by the application. For example, in a vehicle, the viewing plane might be 70 cm from the display. The filtering functions are calculated based on these measurements to achieve a uniform intensity distribution in this plane. In practice, the eye position does not subsequently affect the filtering functions. That is, the filtering function f is not adapted with respect to the position of the first or second eye. A or f B Typically, filtering functions can also modify factors other than intensity, such as color or grayscale. Therefore, system errors can be corrected.
[0117] In detection step 1405, according to one embodiment, the intensity at the measurement location is detected using a camera.
[0118] Such measurements are performed to obtain the filtering function. In practice, this is done, for example, in a laboratory setting, and the filtering function is determined. These filtering functions are then stored in the system and are always applied accordingly during subsequent normal operation. Therefore, the scheme described in this paper is based on this measurement method.
[0119] To achieve a complete intensity distribution across the entire observation plane, the intensity should be measured at multiple locations, such as positions 1, 2, 3, 4, etc. Ideally, an intensity curve will be obtained for each location. A constant composite distribution can be optimized through the intensity distribution of multiple pixel groups. According to one embodiment, adjacent pixel groups are considered simultaneously. For example, to determine the intensity distribution for pixel group B, the total intensity of the superposition of all pixel groups should then be kept constant across the locations. This is performed accordingly for all pixel groups. If there are four pixel groups, there will also be four filtering functions, which achieve a constant intensity distribution when all four pixel groups are enabled.
Claims
1. A method (1300) for operating, for example, a display device (110) for a vehicle (100), wherein, The display device (110) has multiple pixel groups (A, B, C, D), particularly more than four pixel groups (A, B, C, D) and optical units, particularly lens plates, such as lenticular lens units (125), wherein the method (1300) includes the following steps: Read (1305) eye position signal (145), the eye position signal representing the position of the eye (150) of the viewer viewing the display device (110) relative to the display device (110) in the viewing plane (155); Using the position of the eye (150), select (1310) from the plurality of pixel groups (A, B, C, D) the pixel group visible from the position of the eye (150); and The visible pixel group is activated (1315) using the position of the eye (150) and the filtering function assigned to the visible pixel group, wherein the filtering function represents a filtering function generated for all pixel groups, such as a filtering function (f). a f b f c f d The filtering function generated by the method (1400) for generating the filtering function for all pixel groups includes the steps of: detecting (1405) multiple intensities (I1, I2, I3, I4...) of all pixel groups, such as pixel groups (A, B, C, D), at multiple measurement locations (M1, M2, M3, M4...) in the observation plane (155), so as to obtain the intensity distribution (d) of the pixel groups (A, B, C, D) using the multiple intensities (I1, I2, I3, I4). A d B d C d D ); and thus optimize the intensity distribution (d) described in (1410) A d B d C d D This allows for the desired composite distribution of multiple intensities (I1, I2, I3, I4...) in the observation plane (155) to obtain a filtering function (f) for the pixel group (A, B, C, D). A f B f C f D ).
2. The method (1300) according to claim 1, wherein in the reading step (1305), the eye position signal (145) is read, the eye position signal further indicating and assigning another position of another eye (180) of a viewer viewing the display device (110) relative to the display device (110) in the viewing plane (155), wherein in the selection step (1310), a pixel group visible from the other position of the other eye (180) is selected from the plurality of pixel groups (A, B, C, D) when using the other position of the other eye (180), and wherein in the step of activating the visible pixel group (1315), the pixel group visible from the other position of the other eye (180) is activated when using the other position of the other eye (180) and other filtering functions assigned to the pixel group visible from the other position of the other eye (180).
3. The method (1300) according to any one of the preceding claims, wherein, When the eye position signal (145) read for the eye (150) in the activation step (1305) indicates a second position of the eye (150) that is different from the position, the selection step (1310) and the activation step (1315) may be repeated.
4. The method (1300) according to any one of the preceding claims, the method comprising the steps (1325) of detecting the eye (150) and providing the eye position signal (145) using an eye-tracking device (112).
5. Used to generate filtering functions for all pixel groups, such as filtering function (f A f B f C f D The method (1400) wherein the filtering function is used in the method (1300) according to any one of claims 1 to 4, wherein, The method (1400) includes the following steps: At multiple measurement locations (M1, M2, M3, M4...) in the observation plane (155), multiple intensities (I1, I2, I3, I4...) of all pixel groups, such as pixel groups (A, B, C, D), are detected (1405) to obtain the intensity distribution (d) of the pixel groups (A, B, C, D) using the multiple intensities (I1, I2, I3, I4). A d B d C d D );as well as This optimizes the intensity distribution (d) described in (1410). A d B d C d D This allows for the desired composite distribution of multiple intensities (I1, I2, I3, I4...) in the observation plane (155) to obtain a filtering function (f) for the pixel group (A, B, C, D). A f B f C f D ).
6. A generating device (170) configured to perform and / or manipulate the steps (1405, 1410) of the method (1400) according to claim 5 in the respective units (900, 905, 915).
7. An operating device (105) configured to perform and / or manipulate the steps (1305, 1310, 1315, 1320, 1325) of the method (1300) according to any one of claims 1 to 6 in the respective units (130, 135, 140).
8. A display system (175) having an operating device (105) according to claim 7 and / or a generating device (170) according to claim 6 and a display device (110).
9. The display system (175) according to claim 8, wherein the pixel matrix of the plurality of pixel groups (A, B, C, D) is arranged obliquely relative to the lenticular lens unit (125).
10. A computer program configured to perform and / or manipulate one of the steps (1305, 1310, 1315, 1320, 1325; 1405, 1410) of the method (1300; 1400) according to any one of claims 1 to 4 or 5.
11. A machine-readable storage medium having a computer program as claimed in claim 10 stored thereon.