Display module and method for detecting an object
Integrating a sensor with the display screen in vehicles improves accuracy and reduces complexity by minimizing the distance between the object and the sensor, addressing errors in occupant position calculation.
Patent Information
- Application Number
- DE102015204790
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2014-04-11
- Filing Date
- 2015-03-17
- Publication Date
- 2024-12-19
- Estimated Expiration
- 2035-03-17
AI Technical Summary
Existing display modules in vehicles face errors in calculating occupant position due to sensors being spaced from the display, leading to inaccuracies in distance measurement.
Integrate a sensor adjacent to or within the electronic display screen to detect radiation reflected from an object, improving accuracy by reducing the distance between the object and the sensor.
Enhances the accuracy of calculating the location and distance of an object relative to the display screen, reducing the number of sensors required and lowering mechanical complexity and costs.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[0001] The present disclosure relates to display modules, in particular a display module with distance measurement, and methods for detecting an object.
[0002] Modern vehicles typically include numerous displays within the vehicle interior, such as the instrument cluster, that communicate information to an occupant. The displays may include an electronic display screen that provides information to the driver or a passenger in the form of one or more graphics, such as one or more vehicle statuses or media. These displays can update the information based on the occupant's proximity to the display.
[0003] Some displays, commonly known as "multi-quadrant systems," use multiple sensors to determine the occupant's distance from the display and achieve appropriate resolution. These sensors are separate and distinct from the display, often positioned at a distance from the display. However, the fact that the sensors are spaced apart from the display can lead to an error in the calculation of the occupant's position relative to the display.
[0004] From US 2009 / 0 295 760 A1 and US 2013 / 0 135 219 A1, display modules are known which have an electronic screen, a radiation source for emitting radiation and a sensor for detecting radiation. Summary
[0005] A display module according to the invention is specified in claim 1. It comprises, among other things, a panel with an electronic display screen, at least one radiation source operable to emit radiation, and a sensor positioned adjacent to the panel. The sensor is operable to detect radiation reflected onto a surface of the panel.
[0006] An additional display module according to the invention is specified in claim 13. It comprises, among other things, a housing, an electronic display screen attached to the housing, and a sensor operable to detect radiation reflected to a surface of the electronic display screen. The electronic display screen is receptive to radiation detected by the sensor.
[0007] A method for detecting an object according to the invention is defined in claim 15. It comprises, inter alia, providing a plate including an electronic display screen, emitting radiation toward an object, and detecting radiation reflected from the object to a surface of the electronic display screen.
[0008] Although the various examples include the specific components shown in the illustrations, embodiments of this disclosure are not limited to these particular combinations. It is possible to use some of the components or features of one of the examples in combination with features or components of another of the examples.
[0009] The various features and advantages of this disclosure will become apparent to those skilled in the art from the following detailed description. The drawings that support the detailed description may be briefly described as follows. Short description of the drawings Fig. 1 shows a schematic view of a vehicle with a display module. Fig. 2 shows a schematic illustration of an exemplary display module. Fig. 3 is a schematic cross-sectional view of the display module of Fig. 2. Fig. 3A is a schematic exploded side view of an electronic display screen of the display module on Fig. 3. Fig. 4 is a schematic cross-sectional view of a second embodiment of a display module. Fig. 5 is a schematic cross-sectional view of a third embodiment of a display module. Fig. Figure 6 is a flowchart of a distance measurement algorithm. Detailed description
[0010] Fig. 1 schematically illustrates a vehicle 10 that may include a display module 12 for providing information to an occupant. Throughout this disclosure, where appropriate, like reference numerals identify like elements, and reference numerals in increments of one hundred or multiples thereof identify modified elements that are believed to incorporate the same features and benefits of the corresponding original elements. The display module 12 may, for example, be positioned within a passenger compartment 14 of the vehicle 10.
[0011] The display module 12 is operable to display information to the driver or a passenger in the form of one or more graphics. For example, the information may include one or more conditions of the vehicle, such as fuel level or speed. In other examples, the display module 12 is a multimedia device operable to display or play back information in the form of navigation data, image data, or voice data (e.g., radio), or to provide an interface to other digital systems onboard the vehicle 12. The display module 12 may be in electrical communication with another system, such as a vehicle controller 16, which is operable to perform various system functions.Other systems may benefit from the teachings herein, including ground-based systems, aircraft systems, portable mobile devices, and other computing devices. In still further examples, the display module 12 is a so-called stand-alone system.
[0012] Fig. 2 and Fig. 3 schematically illustrate an exemplary display module 12 with a sensor for distance measurement integrated into the display module 12. The display module 12 includes a plate 22 and a housing 24 for attaching the plate 22 thereto. The housing 24 may define a space 25 for receiving a portion of the plate 22.
[0013] The panel 22 includes an electronic display screen 26 for displaying information to the user or an occupant of the vehicle 10. In some examples, the electronic display screen 26 is a thin film transistor (TFT) display, such as a liquid crystal display (LCD). The panel 22 may include a light guide or amplifier 28 (shown in Fig. 3) positioned adjacent to the electronic display screen 26 for illuminating the electronic display screen, as is known in the art. The light guide 28 may be made of an acrylic material, an acrylic composite, or other suitable material. A conventional backlighting device 30 may be provided for illuminating the light guide 28, such as disposed at a perimeter of the light guide 28. The backlighting device 30 may include one or more light-emitting diodes (LEDs) 32, lamps, or other conventional means for providing illumination. In further examples, the electronic display screen 26 is an organic light-emitting diode (OLED) display. Of course, other suitable display screens may be used or modified in light of the teachings disclosed herein.
[0014] The display module 12 is operable to detect a distance of an object 34 with respect to the panel 22, and in particular with respect to the electronic display screen 26. The object 34 may be a body part of the occupant, such as a hand, a finger, a body, or another part of the occupant. As explained in detail below, the display module 12 is operable to update the information of the electronic display screen 26 in response to detecting the distance of the object 34. For example, the display module 12 may be operable to display first information to an occupant of the vehicle 10 when the occupant is at a first position relative to the electronic display screen 26, and may be operable to display a second, different piece of information when the occupant is at a second position.The first information could consist of navigation data, and the second information could be a program menu, for example, for interacting with another system or function of the display module 12 when the occupant is in relatively close proximity to the electronic display screen 26. The information may also be based on the distance of the object 34 with respect to a portion of the electronic display screen 26. It is preferred that the information and its arrangement can be determined based on design parameters defined by one skilled in the art.
[0015] The display module 12 includes at least one radiation source 36 positioned adjacent to the plate 22 and preferably in close proximity thereto, and more particularly, close to the electronic display screen 26. The radiation source 36 is operable to emit radiation 38 toward the object 34. In further examples, the radiation source 36 is an LED operable to emit infrared radiation. In further examples, the radiation source 36 includes four LEDs positioned around a perimeter of the plate 22. Positioning the radiation source 36 in close proximity to the electronic display screen 26 can improve the overall emission of the radiation 38 away from the object 34, thereby improving the resolution of the display module 12. This also accommodates other radiation sources, frequencies or ranges of frequencies or spectra, quantities, and arrangements.
[0016] The display module 12 includes at least one sensor 40 operable to detect radiation, for example, infrared radiation. The sensor 40 is positioned with respect to the plate 22 to be operable to detect radiation communicated to a surface 42 of the plate 22, including radiation 38 reflected from the object 34. In some examples, the sensor 40 is positioned with respect to a forward-facing surface 44 of the electronic display screen 26 to detect radiation 38 communicated to the forward-facing surface 44. In further examples, the display module 12 is a multi-quadrant system including two or more sensors 40 to determine the spatial location of the object 34 as the object moves relative to the display module 12.In one example, four sensors 40 are located at the corners of the housing 24 (shown in . Fig. 2). The sensor 40 may be positioned within an area extending from, projecting from, or defined by a perimeter of the plate 22 or the electronic display screen 26. In further examples, the sensor 40 is positioned at a distance from the center of the plate 22 or the electronic display screen 26 and within the perimeter of either the plate 22 or the electronic display screen 26. However, other locations of the sensor 40 are contemplated.
[0017] With reference to Fig. 3, the sensor 40 may be integrated into a portion of the electronic display screen 26. As in Fig. 3A, which is a highly schematic view of an electronic display screen, such as the one shown in Fig. 3, the electronic display screen 26 is comprised of multiple layers. The layers of the electronic display screen 26 may include a display glass or composite 41, one or more layers of polarizing layers 43 and filters 45, a liquid crystal layer 47, and, for example, a pair of electrodes 49. In some examples, the electronic display screen 26 includes at least one filter 45 operable to selectively transmit or filter radiation 38 emitted by the radiation source 36 and / or reflected from the object 34. In further examples, at least one filter 45 is an IR filter operable to selectively transmit or filter radiation in the infrared spectrum. It is preferred that the electronic display screen 26 include fewer or more layers.Layers of the same or different materials. In some examples, the electronic display screen 26 is manufactured using a so-called low-temperature polysilicon (LTPS) process. However, the electronic display screen 26 may be manufactured using any other technique known in the art.
[0018] The sensor 40, or any number of sensors, may be arranged in various positions, exemplified as sensors 40a-40k with a dashed line. In some examples, the sensor 40 is positioned on a surface of the display glass, such as in the center of the forward-facing surface 44 of the electronic display screen 26. In other examples, the sensor 40 is disposed between or integrated with one of the layers of the electronic display screen 26. In still other examples, the sensor 40 is positioned on or in close proximity to a rear-facing surface 46 of the electronic display screen 26. However, other positions, quantities, and arrangements of the sensor 40 with respect to the electronic display screen 26 are contemplated.Integrating the sensor 40 with the electronic display screen 26 can improve the accuracy of calculating the location and distance of the object 34 by being able to receive radiation 38 with stronger relative amplitudes and by reducing a distance between the object 34 and the sensor 40, as compared to the positioning or arrangement of the sensor(s) in conventional systems.
[0019] The display module 12 may include a controller 48 (shown schematically) electrically coupled to each sensor 40 and a radiation source 36. The controller 48 may be disposed within, attached to, or formed with the housing 24. In other examples, the controller 48 may be disposed remotely from the housing 24. In some examples, the controller 48 is electrically coupled to the vehicle controller 16 or another system operable to update or provide information to the electronic display screen 26, such as navigation data, voice data (e.g., radio), and vehicle status, such as fuel levels and the like. In other examples, the controller 48 provides this functionality. The functionality of the controller 48 may also be incorporated into the vehicle controller 16 or another system.
[0020] The controller 48 is operable to control each radiation source 36 to emit radiation toward the object 34. The controller 48 is also operable to receive data from the sensor 40 in response to radiation detected by the sensor 40, such as radiation reflected from the object 34. In some examples, the controller 48 is also electrically coupled to the backlight device 30 to adjust the amount of illumination provided to the light guide 28.
[0021] Fig. 4 shows a schematic cross-sectional view of a second exemplary display module 112. In this example, a sensor 140 is disposed within, attached to, or formed with a space 125 of a housing 124, wherein the sensor is positioned behind an electronic display screen 126 relative to the user or occupant. The display module 112 may include a light guide 128 positioned on a rearward-facing surface 146 of the electronic display screen 126 such that the light guide 128 is disposed between the electronic display screen 126 and the sensor 140. The light guide 128 is configured to illuminate the electronic display screen 126 and also to communicate radiation 138 to the sensor 140, wherein the radiation is reflected from the object 134 to the electronic display screen 126.Placing the sensor 140 improves accuracy in detecting the distance of the object 134 and also reduces the cost of integration compared to conventional systems.
[0022] Fig. 5 shows a schematic cross-sectional view of a third exemplary display module 212. A sensor 240 is positioned at a perimeter of a light guide 228 within a housing 224. In some examples, the sensor 240 is disposed adjacent to a backlight device 230, which is also disposed at the perimeter of the light guide 228. The radiation source 236 is configured to emit radiation 238 toward the object 234. The object 234 reflects the radiation 238 back toward the display module 212, which radiation is then communicated through the electronic display screen 226 and to the light guide 228. The light guide 228 is configured to communicate the radiation 238 to the sensor 240.In some examples, the light guide 228 is optimized not only for communicating light provided by the backlight device 230 through the light guide 228, but also for communicating the radiation 238 through the light guide 228 and onto the sensor 240 using techniques known in the art.
[0023] With reference to Fig.6, operation of a display module 12, 112, 212 may be performed by a distance measurement algorithm 50, which, for example, controls the emission of radiation 38 by a radiation source 36, and also controls receiving data from a sensor 40 in response to detection of radiation 38 by the sensor 40. The functions of the distance measurement algorithm 50 are disclosed using functional block diagrams; it should be apparent to those skilled in the art, based on this disclosure, that these functions may be embodied either in dedicated hardware circuitry or in programmed software routines, which may be executed in an embodiment of a microprocessor-based electronic controller, such as a controller 48, or a combination thereof.
[0024] In the illustrated example, the distance measurement algorithm 50 controls functions 52 through 62. Upon initialization of the display module 12 at step 52, a controller 48 causes a radiation source 36 to emit radiation 38 toward an object 34 at step 54. The object 34 reflects the radiation 38 onto a surface 42 of the display module 12, and more particularly onto an electronic display screen 26. In some examples, the radiation 38 is communicated through the electronic display screen 26 and / or through a light guide 28. At step 56, a sensor 40 detects the radiation 38 and provides data to the controller 48 corresponding to a spatial position of the object 34.
[0025] At step 58, the controller 48 or other device calculates the distance of the object 34, and in some examples, its position, with respect to the plate 22 or the electronic display screen 26. The calculations may be performed based on known techniques using various graphics libraries such as Open GL. In some examples, where the display module 12 is a multi-quadrant system, the steps of emitting 54 and detecting 56 are repeated sequentially at least twice, and more particularly at least four times, to determine the distance of the object 34 from the plate 22 or the electronic display screen 26. However, the steps of emitting 54 and detecting 56 may be repeated any number of times based on system requirements.At step 60, a system providing information to the electronic display screen 26 is instructed to update the information in response to the radiation 38 detected by the sensor 40. Thereafter, steps 54-60 are repeated until the display module 12 is deactivated or placed in standby mode at step 62.
[0026] The controller 48 typically includes a processor, a memory, and an interface. The processor may, by way of example only, be any type of known microprocessor with desired performance characteristics. The memory may, by way of example only, include UVPROM, EEPROM, FLASH, RAM, ROM, DVD, CD, a hard disk, or other computer-readable medium capable of storing data and storing the distance measurement algorithm 50 for operating the display module 12, 112, 212 as described herein. The interface enables communication with other systems or components of the vehicle 10.
[0027] In some examples, the controller 48 may be a portion of the vehicle controller 16, another system, or a stand-alone system.
[0028] The display module 12, 112, 212 disclosed herein provides many advantages. For example, positioning each sensor 40 in close proximity to the panel 22 and the electronic display screen 26, or integrating each sensor 40 therein, can improve the resolution or accuracy in determining the location or distance of the object 34 relative to the panel 22 or the electronic display screen 26. Positioning the sensor 40 in accordance with the teachings of the present disclosure can also reduce the number of sensors for multi-quadrant systems while still achieving suitable resolution. Another advantage of integrating the sensor 40 into the display module 12 reduces layout and mechanical requirements.In addition, the display module 12, 112, 212 requires a smaller number of electronic components, thereby reducing costs and improving accuracy due to signal, system and / or calculation errors.
[0029] Although the various examples include specific components shown in the illustrations, embodiments of this disclosure are not limited to these particular combinations. It is possible to use some of the components or features of one of the examples in combination with features or components of another of the examples.
[0030] Furthermore, the foregoing description should be interpreted as illustrative and not limiting in any way. One skilled in the art will recognize that certain modifications could fall within the scope of this disclosure. For these reasons, the following claims should be considered to determine the true scope and content of this disclosure.
Claims
[1] Display module, comprising: a plate with an electronic display screen; at least one radiation source operable to emit radiation; a sensor disposed adjacent to the plate, the sensor operable to detect radiation reflected from a surface of the plate; wherein the at least one radiation source comprises four light-emitting diodes arranged on a circumference of the plate; wherein the sensor is arranged within an area defined by a circumference of the plate; and the sensor is located centrally on the electronic display screen. [2] The display module of claim 1, wherein the electronic display screen is a thin film transistor display. [3] A display module according to any one of the preceding claims, wherein the radiation source is a light-emitting diode operable to emit infrared radiation, and wherein the sensor is operable to detect infrared radiation. [4] A display module according to any one of the preceding claims, wherein the plate comprises a light guide operable to illuminate the electronic display screen. [5] The display module of claim 4, wherein the light guide is disposed between the electronic display screen and the sensor, the light guide being operable to communicate radiation from the electronic display screen to the sensor. [6] The display module of claim 4, wherein the sensor is arranged on a circumference of the light guide. [7] The display module of claim 6, wherein the sensor is disposed adjacent to a backlight device disposed at the periphery of the light guide. [8] The display module of claim 4, wherein the sensor is disposed adjacent a forward-facing surface of the electronic display screen, and wherein the light guide is disposed adjacent a rearward-facing surface of the electronic display screen opposite the forward-facing surface. [9] A display module according to any one of the preceding claims, wherein the sensor is integrated into a layer of the electronic display screen. [10] A display module according to any one of the preceding claims, wherein the sensor is arranged on a layer within the electronic display screen. [11] A display module according to any one of the preceding claims, comprising a housing adapted to mount the plate and to receive the sensor in a chamber defined by the housing. [12] A display module according to any one of the preceding claims, comprising a controller electrically coupled to the radiation source and the sensor. [13] Display module, comprising: a housing; an electronic display screen attached to the housing; a sensor operable to detect radiation reflected onto a surface of the electronic display screen, the electronic display screen being receptive to radiation detected by the sensor; wherein the sensor is arranged within an area defined by a perimeter of the electronic display screen; and the sensor is located centrally on the electronic display screen. [14] The display module of claim 13, wherein the electronic display screen is operable to communicate radiation to the sensor. [15] A method for detecting an object, comprising: Providing a plate including an electronic display screen; Emission of radiation towards an object; Detecting radiation reflected from the object to a surface of the electronic display screen; wherein the steps of emitting and detecting are repeated successively at least twice to determine the presence of the object at the plate; wherein the sensor is arranged within an area defined by a perimeter of the electronic display screen; and the sensor is located centrally on the electronic display screen. [16] The method of claim 15, wherein the step of detecting comprises communicating radiation using the electronic display screen. [17] A method according to any one of claims 15-16, wherein the plate comprises a light guide operable to illuminate the electronic display and to communicate radiation from the electronic display to a sensor. [18] A method according to any one of claims 15-17, wherein the radiation is infrared radiation. [19] A method according to any one of claims 15-18, wherein the electronic display screen is receptive to detected radiation. [20] A method according to any one of claims 15-19, wherein the sensor is arranged on a layer within the electronic display screen. [21] A method according to any one of claims 15-20, wherein the sensor is integrated into a layer of the electronic display screen.
Citation Information
Patent Citations
Touch screen display
US20090295760A1
Touchscreen Having A Color Coded 2-D Space
US20130135219A1
