VEHICLE DISPLAY SYSTEM

Abstract

A vehicle system includes a display unit and a computer communicatively coupled to the camera. The display unit includes a display panel, a circuit board fixed relative to the display panel, a plurality of visible light emitting diodes (LEDs) mounted to the circuit board, and a plurality of infrared LEDs mounted to the circuit board and interspersed with the visible light LEDs. The circuit board is arranged to direct emissions from the visible light LEDs and the infrared LEDs to the display panel. The computer is programmed to actuate a component based on an infrared image from a camera depicting an occupant illuminated by the infrared LEDs and to adjust a brightness of the infrared LEDs based on an ambient brightness.

Description

FIELD OF TECHNOLOGYThis disclosure relates to a display system in vehicles.GENERAL STATE OF THE ARTModern vehicles often include display screens. The display screens may be of various types suitable for displaying content readable by occupants of a vehicle, e.g., light emitting diode (LED), organic light emitting diode (OLED), liquid crystal display (LCD), plasma, digital light processing technology (DLPT), etc. A display screen may be mounted on the dashboard where the display screen is visible to the occupants of the vehicle.SUMMARYThis disclosure describes a vehicle system in which a display unit of a vehicle may assist in imaging an occupant of the vehicle. The display unit includes a plurality of visible light emitting diodes (LEDs) for displaying information on a display panel and a plurality of infrared LEDs for illuminating the occupant. The infrared LEDs are interspersed with the visible light LEDs on a printed circuit board of the display unit. By arranging the infrared LEDs together with the visible light LEDs, power consumption, packaging space and wiring complexity can be reduced compared to separate infrared lighting devices in the passenger compartment. The location of the infrared LEDs and the distribution of the infrared LEDs among the visible light LEDs may also provide a larger, more diffuse source of infrared illumination than separate infrared illumination devices, thereby providing more complete illumination to the occupant.Illuminating the occupant with infrared illumination may assist in the operation of components of the vehicle, e.g., a driver condition monitoring system. The vehicle may include a camera capable of detecting infrared and a computer communicatively coupled to the camera and the infrared LEDs. The computer is programmed to actuate a component based on an infrared image from the camera that images the occupant illuminated by the infrared LEDs, e.g., output a message to the occupant if it is determined from the infrared image that the occupant is attracting attention away from the road. The computer is also programmed to adjust a brightness of the infrared LEDs based on an ambient brightness. For example, the infrared LEDs may be brighter during the day so that the infrared image is not over-exposed by daylight, and the infrared LEDs may be darker at night to conserve energy.A vehicle system includes a display unit and a computer communicatively coupled to the display unit. The display unit includes a display panel, a board fixed relative to the display panel, a plurality of visible light emitting diodes (LEDs) mounted on the board, and a plurality of infrared LEDs mounted on the board and penetrated with the visible light LEDs. The board is arranged to direct emissions from the visible light LEDs and the infrared LEDs to the display panel. The computer is programmed to actuate a component based on an infrared image from a camera that images an occupant illuminated by the infrared LEDs and adjust a brightness of the infrared LEDs based on an ambient brightness.In one example, the computer may be programmed to increase the brightness of the infrared LEDs in response to an increase in ambient brightness.In one example, the vehicle system may further include the camera, the camera may be configured to detect visible light and infrared light, and the computer may be programmed to actuate the component based on a visible light image from the camera that images the occupant.In one example, the vehicle system may further include the camera, the camera may be configured to detect visible light and infrared light, and the computer may be programmed to, responsive to the ambient brightness exceeding a threshold, actuate the component based on a visible light image from the camera that images the occupant. In another example, the computer may be programmed to actuate the component based on the infrared image when the ambient brightness is below the threshold. In yet another example, the computer may be programmed to actuate the component based on the infrared image when the ambient brightness is above the threshold.In another further example, the computer may be programmed to, responsive to the ambient brightness being below the threshold, refrain from actuating the component based on the visible light image. In yet another example, the computer may be programmed to adjust the brightness of the infrared LEDs by changing a pulse width modulation of the infrared LEDs.In one example, the display unit may include a light guide plate fixed behind the display plate, and the board may be arranged to guide the emissions from the visible light LEDs and the infrared LEDs at an edge of the light guide plate into the light guide plate. In another example, the visible light LEDs and the infrared LEDs may be arranged in a row along the edge of the light guide plate.In an example, a number of the visible light LEDs may be greater than a number of the infrared LEDs.In an example, the board may be fixed behind the display panel and disposed parallel to the display panel. In another example, the display unit may include a plurality of optical domes including the respective visible light LEDs, and the infrared LEDs may be included in respective ones of the optical domes. In yet another example, a subset of the optical domes may include the respective infrared LEDs.In another further example, the visible light LEDs and the infrared LEDs may be arranged in a two-dimensional pattern on the board.In one example, the vehicle system may further include a dashboard and the display unit may be mounted on the dashboard.In one example, the vehicle system may further include the camera and the camera may be spaced apart from the display unit.A display unit includes a display panel, a light guide plate fixed behind the display panel, a board fixed relative to the display panel, a plurality of visible light emitting diodes (LEDs) mounted on the board, and a plurality of infrared LEDs mounted on the board and penetrated with the visible light LEDs. The board may be arranged to direct emissions from the visible light LEDs and the infrared LEDs at an edge of the light guide plate into the light guide plate.In one example, the visible light LEDs and the infrared LEDs may be arranged in a row along the edge of the light guide plate.In an example, a number of the visible light LEDs may be greater than a number of the infrared LEDs.BRIEF DESCRIPTION OF THE DRAWINGSFIG. 1 is a rear perspective view of an example vehicle having an illustratively exposed passenger compartment. FIG. 2 is a schematic exploded side cross-sectional view of an exemplary display unit of the vehicle. FIG. 3 is a schematic plan view of the display unit of FIG. 2. FIG. 4 is a schematic exploded side cross-sectional view of another exemplary display unit of the vehicle. FIG. 5A is a schematic top view of an example display unit consistent with FIG. 4. FIG. 5B is a schematic top view of another example display unit consistent with FIG. 4. FIG. 6 is a block diagram of an example control system of the vehicle. FIG. 7 is a flow diagram of an example process for determining when to issue a message to an occupant of the vehicle.DETAILED DESCRIPTIONReferring to the figures, wherein like reference numerals indicate like parts throughout the several views, a vehicle system 105 of a vehicle 100 includes a display unit 110 and a computer 600 communicatively coupled to the display unit 110. The display unit 110 includes a display panel 205, a board 210 fixed relative to the display panel 205, a plurality of visible light emitting diodes (LEDs) 215 mounted on the board 210, and a plurality of infrared LEDs 220 mounted on the board 210 and penetrated with the visible light LEDs 215. The board 210 is arranged to conduct emissions from the visible light LEDs 215 and the infrared LEDs 220 to the display panel 205. The computer 600 is programmed to actuate a component based on an infrared image from a camera 115 that images an occupant illuminated by the infrared LEDs 220, and adjust a brightness of the infrared LEDs 220 based on an ambient brightness.Referring to FIG. 1, the vehicle 100 may be any passenger or utility vehicle, such as a car, truck, sport utility vehicle, crossover, van, minivan, taxi, bus, etc.The vehicle 100 includes a passenger compartment 125 for housing occupants, if any, of the vehicle 100. The passenger compartment 125 may include a plurality of seats 130. One or more of the seats 130 may be disposed in a front row of the passenger compartment 125 and one or more of the seats 130 may be disposed in a second row behind the front row. The passenger compartment 125 may also include seats 130 in a third row (not shown) in a rear portion of the passenger compartment 125. The seats 130 are shown as bucket seats in the front row and bench seats in the second row, but the seats 130 may be other types. The position and orientation of the seats 130 and components thereof may be adjustable by an occupant. Each seat 130 may define a respective occupant seating area 120, i.e., a space occupied by an occupant seated on the seat 130.The passenger compartment 125 includes an instrument panel 135. The instrument panel 135 may be disposed at a front end of the passenger compartment 125 and face the front seats 130. The dashboard 135 may include vehicle controls such as a steering wheel 145; gauges, dials, and information indicators; heating and ventilation equipment; a radio and other electronics; etc.The vehicle 100 includes a user interface 140. The user interface 140 presents information to and receives information from an operator of the vehicle 100. The user interface 140 may include dials, digital displays, screens such as the display unit 110, speakers, and so forth for providing information to the operator, e.g., human machine interface (HMI) elements such as are known. The user interface 140 may include buttons, buttons, keypads, a microphone, and so forth for receiving information from the operator. Components of the user interface 140 may be mounted to the dashboard 135 or at other locations in the passenger compartment 125.The user interface 140 includes the display unit 110. The display unit 110 is mounted on the instrument panel 135. The display unit 110 may be positioned to be visible to an operator of the vehicle 100 while the head of the operator faces forward in the traveling direction of the vehicle 100, which means that the operator may be able to view the display unit 110 by moving the eyes without moving the head. The display unit 110 may also be positioned to illuminate an occupant, e.g., the operator, of the vehicle 100 with the infrared LEDs 220, described below. For example, the display unit 110 may be positioned above and in front of the steering wheel 145 to serve as an instrument panel, for example. As another example, the display unit 110 may be positioned on a center console of the dashboard 135 and visible to the operator as well as other occupants.The display unit 110 may transmit information to the occupant. For example, the display unit 110 may display information about the operation of the vehicle such as speed, engine revolutions per minute, engine temperature, fuel or battery level, etc.; cabin status such as open doors, seating positions, climate control settings, etc.; infotainment information such as radio stations, media sources, volume, connections to user devices, etc.; and other information.The camera 115 can detect electromagnetic radiation in a certain wavelength range. For example, the camera 115 may be configured to detect both visible light and infrared radiation. For example, camera 115 may be a charge-coupled device (CCD), a complementary metal oxide semiconductor (CMOS), or any other suitable type.The camera 115 is arranged such that a field of view of the camera 115 encloses at least one of the occupant seating areas 120, e.g., the occupant seating area 120 for the operator of the vehicle 100, i.e., the occupant seating area 120 defined by the seat 130 directly behind the steering wheel 145. The camera 115 may be spaced apart from the display unit 110. For example, the camera 115 may be mounted on a rearview mirror, mounted on the instrument panel 135 at the center console, or positioned at a left or right lateral end of the instrument panel 135 below a front pillar of the vehicle 100.Referring to FIGS. 2-5, the display unit 110 includes, as a general overview of the display unit 110, the board 210, the visible light LEDs 215, the infrared LEDs 220, a reflector 225, the display panel 205, and other layers. (For clarity, only some of the visible light LEDs 215 and the infrared LEDs 220 are labeled.) The components of the display unit 110 may be fixed relative to each other and fixed relative to the instrument panel 135; that is, the display unit 110 may not have movable parts. FIGS. 2-3 show an example of an edge-illuminated arrangement of the visible light LEDs 215 and the infrared LEDs 220, and FIGS. 4-5 show an example of a directly backlighting arrangement of the visible light LEDs 215 and the infrared LEDs 220. Generally, and in both examples, the other layers may be sandwiched between the reflector 225 and the display panel 205. Generally, and in both examples, the visible light LEDs 215 and the infrared LEDs 220 are mounted to the board 210, the infrared LEDs 220 are interspersed with the visible light LEDs 215, and the board 210 is arranged to direct emissions from the visible light LEDs 215 and the infrared LEDs 220 to the display panel 205.The board 210 serves as a substrate for physically mounting and electrically connecting the visible light LEDs 215 and the infrared LEDs 220. The board 210 may be rigid. The board 210 may have a generally flat shape, e.g., rectangular. The board 210 may include a plurality of electrical connections to the respective visible light LEDs 215 and infrared LEDs 220, such that the visible light LEDs 215 and the infrared LEDs 220 may be independently controlled.Each LED 215, 220 is a semiconductor device that emits electromagnetic radiation via the phenomenon of electroluminescence when electric current flows therethrough. Each LED 215, 220 includes a leadframe having an anvil and a post (not shown). The leadframe is connected to an anode and a cathode pin. The anvil includes a semiconductor die that generates the electromagnetic radiation within a reflective cavity. The leadframe may be housed in a lens or a housing of epoxy resin. Each LED 215, 220 may emit electromagnetic radiation having a wavelength defined by the structure and / or material of the semiconductor chip. The visible light LEDs 215 may include multiple wavelengths, e.g., red visible light LEDs 215, green visible light LEDs 215, and blue visible light LEDs 215 arranged in a regular pattern over the board 210. The infrared LEDs 220 may have a wavelength in the near infrared spectrum, e.g., 940 nanometers. The number of visible light LEDs 215 may be larger than the number of infrared LEDs 220. This relative proportion may allow the visible light LEDs 215 to have sufficient density to fill the available space of the display panel 205, while the infrared LEDs 220 may still generate sufficient infrared radiation to illuminate the occupant for the camera 115.The display panel 205 may be an outermost rigid layer of the display unit 110, may be, for example, the outermost layer, or may have one or more films thereon. The display panel 205 may have a generally flat shape, e.g., rectangular. The display panel 205 is transparent to the wavelengths of the electromagnetic radiation emitted by the visible light LEDs 215 and the infrared LEDs 220, for example, the display panel 205 may be made of polycarbonate. The display panel 205 may protect the internal components of the display unit 110 from the environment.Referring to FIGS. 2-3, the display unit 110 may have an edge-illuminated arrangement. As shown in FIG. 2, the display unit 110 may include a stack of layers stacked on each other in a direction from inside the instrument panel 135 to outside the instrument panel 135, for example: the reflector 225, a light guide plate 230, a diffuser sheet 235, a vertical prism sheet 240, a horizontal prism sheet 245, and the display panel 205. In other words, the reflector 225, the light guide plate 230, the diffuser sheet 235, the vertical prism sheet 240, and the horizontal prism sheet 245 are fixed behind the display panel 205. The layers may have rectangular shapes with approximately the same length and width (but not necessarily thickness), and the rectangular shapes may be aligned with each other. The layers are parallel to each other and abut each other. The board 210 is located outside the stack of layers, i.e., it is not one of the layers of the stack.With continued reference to FIG. 2, the board 210 is fixed relative to the display panel 205 and the other layers of the stack, and the board 210 is arranged to direct emissions from the visible light LEDs 215 and the infrared LEDs 220 to the display panel 205. Specifically, the board 210 is arranged to guide the emissions from the visible light LEDs 215 and the infrared LEDs 220 at an edge of the light guide plate 230 into the light guide plate 230. The visible light LEDs 215 and the infrared LEDs 220 are arranged on the board 210 along the edge of the light guide plate 230. The light guide plate 230 is configured to reflect the visible light and the infrared radiation from the edge to which the board 210 is attached to the opposite edge along the entire length or width of the light guide plate 230. For example, the light guide plate 230 may be made of poly(methyl methacrylate) (PMMA).Referring to FIG. 3, the visible light LEDs 215 and the infrared LEDs 220 are arranged in a row along the edge of the light guide plate 230. The infrared LEDs 220 are interspersed along the row with the visible light LEDs 215. For example, the visible light LEDs 215 and the infrared LEDs 220 may be arranged in a repeating linear pattern, e.g., alternately between three visible light LEDs 215 and one infrared LED 220.Referring to FIGS. 4-5B, the display unit 110 may include a direct backlighting arrangement. As shown in FIG. 4, the display unit 110 may include a stack of layers stacked on each other in a direction from inside the instrument panel 135 to outside the instrument panel 135, for example: the board 210, the reflector 225, a diffuser 405, a diffuser sheet 410, a prism 415, and the display panel 205. In other words, the circuit board 210, the reflector 225, the diffuser 405, the diffuser sheet 410, and the prism 415 are fixed behind the display panel 205. The layers including the circuit board 210 may have rectangular shapes with approximately the same length and width (but not necessarily thickness), and the rectangular shapes may be aligned with each other. The layers are parallel to each other and abut each other.With continued reference to FIG. 4, the board 210 is fixed relative to the display panel 205 and the other layers of the stack, and the board 210 is arranged to direct emissions from the visible light LEDs 215 and the infrared LEDs 220 to the display panel 205. Specifically, the board 210 is fixed behind the display panel 205 and arranged in parallel to the display panel 205. The visible light LEDs 215 and the infrared LEDs 220 are mounted on the side of the board 210 facing the display panel 205, and are directed perpendicularly to the board 210 and the display panel 205.Referring to FIGS. 5A-B, the visible light LEDs 215 and the infrared LEDs 220 may be arranged in a two-dimensional pattern on the board 210. The infrared LEDs 220 are interspersed with the visible light LEDs 215 along the length and width of the board 210. For example, the visible light LEDs 215 and the infrared LEDs 220 may be arranged in a repeating two-dimensional pattern, e.g., the visible light LEDs 215 in a grid with an infrared LED 220 adjacent to each other visible light LED 215 along the length and width of the board 210 as shown in FIG. 5.Referring again to FIG. 4, the display unit 110 may include a plurality of optical domes 420 including the respective visible light LEDs 215. The optical domes 420 may be mounted to the board 210 or the reflector 225 via the visible light LEDs 215 and the infrared LEDs 220. The optical domes 420 may be transparent with respect to the wavelengths of electromagnetic radiation emitted by the visible light LEDs 215 and the infrared LEDs 220. The optical domes 420 may protect the LEDs 215, 220 and may distribute and conduct the light emitted by the visible light LEDs 215 to fully cover the display panel 205.Referring to FIG. 5A, each optical dome 420 may include one of the visible light LEDs 215 and each visible light LED 215 may be housed in one of the optical domes 420; i.e., the visible light LEDs 215 and the optical domes 420 may have a one-to-one relationship. The infrared LEDs 220 may also be included in respective ones of the optical domes 420 in addition to the visible light LEDs 215. For example, a subset of the optical domes 420 may include the respective infrared LEDs 220. In other words, some of the optical domes 420 each include a visible light LED 215 and an infrared LED 220, and the remaining optical domes 420 each include a visible light LED 215 and no infrared LEDs 220.Alternatively, referring to FIG. 5B, each optical dome 420 may include a single LED 215, 220, i.e., either a visible light LED 215 or an infrared LED 220. The visible light LEDs 215 and the optical domes 420 housing the visible light LEDs 215 may be arranged in a two-dimensional pattern such as a rectangular grid, and the infrared LEDs 220 and the optical domes 420 housing the infrared LEDs 220 may be positioned adjacent to respective visible light LEDs 215 in the same slits of the two-dimensional pattern as these visible light LEDs 215.Referring to FIG. 6, the vehicle system 105 includes the computer 600 onboard the vehicle 100. The computer 600 is a microprocessor-based computing device, e.g., a generic computing device including a processor and memory, an electronic controller, or the like, a field-programmable gate array (FPGA), an application-specific integrated circuit (ASIC), a combination of the foregoing, etc. Typically, a hardware description language such as a very high speed integrated circuit (VHDL (VHSIC) hardware description language (very high speed integrated circuit hardware description language) is used in electronic design automation to describe digital and mixed signal systems such as FPGA and ASIC. For example, a VHDL programming-based ASIC provided prior to manufacture may be manufactured, whereas logic components may be configured within a VHDL programming-based FPGA stored, e.g., in a memory electrically connected to the FPGA circuit. The computer 600 may thus include a processor, memory, etc. The memory of the computer 600 may include media for storing instructions executable by the processor as well as for electronically storing data and / or databases, and / or the computer 600 may include structures such as the foregoing by which programming is provided. The computer 600 may be a plurality of computers coupled together.The vehicle system 105 may include a communication network 605. The computer 600 may transmit and receive data through the communication network 605. The communication network 605 may be, for example, a controller area network (CAN) bus, Ethernet, WiFi, a local interconnect network (LIN), an onboard diagnostics connector (OBD-II), and / or any other wired or wireless communication network. The computer 600 may be communicatively coupled to the visible light LEDs 215 and the infrared LEDs 220 of the display unit 110, the camera 115, the user interface 140, an ambient light sensor 610, and other components via the communication network 605.The vehicle system 105 may include the ambient light sensor 610. The ambient light sensor 610 is a photodetector that detects an amount of ambient light present, i.e., a total light level from surrounding sources. The ambient light sensor 610 may be any suitable type, e.g., phototransistor, photodiode, photonic integrated circuit, etc.The computer 600 is programmed to receive visible light images from the camera 115. The visible light images are images of the field of view of the camera 115, and the visible light images image the occupant in the occupant seating area 120. Each visible light image is a two-dimensional pixel array. Each pixel has a brightness or color represented as one or more numerical values, e.g., a scalar unitless value of photometric light intensity between 0 (black) and 1 (white), or values for red, green, and blue, e.g., on an 8-bit scale (0 to 255), or a 12-bit or 16-bit scale, respectively. The pixels may be a mixture of representations, e.g., a repeating pattern of scalar intensity values for three pixels and a fourth pixel with three numerical color values or any other pattern. The position in a visible light image, i.e., the position in the field of view of the camera 115 at the time the visible light image was recorded, may be specified in pixel dimensions or coordinates, e.g., an ordered pair of pixel distances, such as a number of pixels from an upper edge and a number of pixels from a left edge of the visible light image.The computer 600 is programmed to receive infrared images from the camera 115. The infrared images are images of the field of view of the camera 115 and the infrared images image the occupant illuminated by the infrared LEDs 220 in the occupant seating area 120. Each infrared image is a two-dimensional pixel array. Each pixel has a brightness in the infrared wavelength represented as a numerical value, e.g., a scalar unitless value of the light intensity in the infrared wavelength between 0 (black) and 1 (white), or a value on an 8-bit scale (0 to 255) or a 12-bit or 16-bit scale. The position in an infrared image, i.e., the position in the field of view of the camera 115 at the time the infrared image was recorded, may be specified in pixel dimensions or coordinates, e.g., an ordered pair of pixel distances, such as a number of pixels from an upper edge and a number of pixels from a left edge of the infrared image.The computer 600 is programmed to adjust a brightness of the infrared LEDs 220. The computer 600 may control the brightness of the infrared LEDs 220 by changing a pulse width modulation of the infrared LEDs 220; that is, the computer 600 may increase the brightness by increasing a proportion of the time that an infrared LED 220 is turned on, thereby increasing the average current that the infrared LED 220 receives, and the computer 600 may decrease the brightness by decreasing the proportion of the time that the infrared LED 220 is turned on, thereby decreasing the average current that the infrared LED 220 receives. With the pulse width modulation, the average current can be changed even when the voltage across the infrared LED 220 is constant.The computer 600 is programmed to adjust the brightness of the infrared LEDs 220 based on ambient brightness. The computer 600 may receive the ambient brightness from the ambient light sensor 610. The computer 600 may increase the brightness of the infrared LEDs 220 in response to an increase in the ambient brightness and decrease the brightness of the infrared LEDs 220 in response to a decrease in the ambient brightness. In other words, the ambient brightness and the brightness of the infrared LEDs 220 may have a positive relationship. For example, the brightness of the infrared LEDs 220 may be a mathematical function of the ambient brightness, i.e., I inf= f(I amb), where I inf is the brightness of the infrared LEDs 220, and I amb is the ambient brightness, e.g., a positive linear relationship, i.e., I inf= mI amb, where m is a slope that is experimentally selected such that the infrared images have high contrast at different ambient brightnesses. As another example, the brightness of the infrared LED 220 may be selected from a number of preset brightnesses, e.g., two, based on the ambient brightness. In the example with two preset brightnesses, the computer 600 may select the greater preset brightness in response to the ambient brightness being greater than a threshold, and the computer 600 may select the lower preset brightness in response to the ambient brightness being less than the threshold. The threshold may be selected to correspond to the transition between day and night.The computer 600 may be programmed to determine a condition of the occupant based on the visible light image or the infrared image. The condition may be categorization of the occupant's apparent vigor, e.g., attention to the road, attention elsewhere, no recognizable attention, etc. The computer 600 may identify the occupant's condition using conventional image recognition techniques, e.g., a convolutional neural network programmed to accept images of occupants as input and output an identified condition. A convolutional neural network includes a series of layers, each layer using the previous layer as input. Each layer includes a plurality of neurons that receives as input data generated by a subset of the neurons of the previous layers and generates an output that is sent to neurons in the next layer. Types of layers include convolutional layers that calculate a dot product of a weight and a small region of input data; pooling layers that perform a down-sampling operation along spatial dimensions; and fully connected layers that generate based on the output of all neurons of the previous layer. The last layer of the convolutional neural network generates a score for each potential state of the occupant, and the final output is the state with the highest score.The computer 600 is programmed to actuate a component that images the occupant based on the visible light image or the infrared image from the camera 115. For example, the computer 600 may output a message to the occupant based on the visible light image or the infrared image from the camera 115 imaging the occupant. The computer 600 may output the message in response to the occupant's condition being in a first set of conditions, e.g., attention elsewhere or no recognizable attention, as determined from the visible light image or the infrared image. The possible states of the occupant may be sorted into one of the first set or a second set, the first set including the possible states for which the message should be outputted and the second set including the possible states for which the message should not be outputted. If the computer 600 determines different conditions of the occupant from the visible light image and the infrared image, the computer 600 may output the message in response to at least one of the determined conditions being in the first set of conditions (e.g., attention elsewhere or no recognizable attention) even if the other determined condition is in the second set of conditions (e.g., attention to the road). The computer 600 may instruct the user interface 140 to output the message. The message may be visual, audible, and / or haptic. As an example, the message may be a signal tone and text displayed on the display unit 110 or other screen of the user interface 140. As another example, the computer 600 may determine a gaze direction of the occupant based on the visible light image or the infrared image from the camera 115 imaging the occupant, e.g., by executing a machine learning program trained to recognize the gaze direction and using the visible light image or the infrared image as input. The location of gaze at the user interface 140 or display unit 110 may be treated as input provided by the occupant to control a component of the vehicle 100.The computer 600 may be programmed to actuate the component, e.g., output the message, based on one of the visible light image and the infrared image according to the ambient brightness, e.g., based on the visible light image in response to the ambient brightness being above a threshold, and based on the infrared image when the ambient brightness is below the threshold. For example, the computer 600 may be programmed to output the message to the occupant based on the infrared image when the ambient brightness is below the threshold, and the computer 600 may be programmed to output the message based on the visible light image in response to the ambient brightness exceeding the threshold, and to refrain from outputting the message to the occupant based on the visible light image in response to the ambient brightness being below the threshold. In other words, if the ambient brightness is above the threshold, the computer 600 may rely on either the visible light image or the infrared image to determine the state of the occupant and output the message in response to the state being in the first set, and if the ambient brightness is below the threshold, the computer 600 may rely on only the infrared image and not the visible light image to determine the state of the occupant and output the message in response to the state being in the first set. Thus, the infrared image provides data for determining the condition of the occupant when the ambient light is too dark to use a visible light image, and the infrared image provides additional data when the visible light image is available.FIG. 7 is a flow diagram illustrating an example process 700 for determining when to output the message to the occupant. The memory of the computer 600 stores executable instructions for performing the steps of the process 700 and / or programming may be implemented in structures such as those mentioned above. As a general overview of the process 700, the computer 600 receives the ambient brightness and adjusts the brightness of the infrared LEDs 220 based on the ambient brightness. In response to the ambient brightness exceeding the threshold, the computer 600 receives the visible light image and the infrared image and determines the state of the occupant from the images. In response to the ambient brightness being below the threshold, the computer 600 receives the infrared image and determines the condition of the occupant from the infrared image. In response to the particular state being in the first set of states, the computer 600 outputs the message to the occupant. The process 700 continues as long as the vehicle 100 remains on.The process 700 begins in a block 705, in which the computer 600 receives the ambient brightness from the ambient light sensor 610 via the communication network 605, as described above.Next, in a block 710, the computer 600 adjusts the brightness of the infrared LEDs 220 based on the ambient brightness, as described above.Next, in a decision block 715, the computer 600 determines whether the ambient brightness exceeds the threshold. In response to the ambient brightness exceeding the threshold, the process 700 proceeds to a block 720. In response to the ambient brightness being below the threshold, the process 700 proceeds to a block 730.In the block 720, the computer 600 receives the visible light image and the infrared image from the camera 115 via the communication network 605, as described above.Next, in a block 725, the computer 600 determines the condition of the occupant based on the visible light image and the infrared image as described above. After the block 725, the process 700 proceeds to a decision block 740.In the block 730, the computer 600 receives the infrared image from the camera 115 via the communication network 605, as described above.Next, in a block 735, the computer 600 determines the condition of the occupant based on the infrared image as described above. After the block 735, the process 700 proceeds to the decision block 740.In decision block 740, the computer 600 determines whether the determined state of the occupant is in the first set of states, as described above. In response to the determined state being in the first set of states, the process 700 proceeds to a block 745. In response to the determined state being in the second set of states, the process 700 proceeds to a decision block 750.In the block 745, the computer 600 outputs the message to the occupant by instructing the user interface 140 to output the message via the communication network 605, as described above. After the block 745, the process 700 proceeds to the decision block 750.In decision block 750, the computer 600 determines whether the vehicle 100 is still on. In response to the vehicle 100 still being on, the process 700 returns to the block 705 to continue assessing the state of the occupant. In response to the vehicle 100 being deactivated, the process 700 ends.In general, the computing systems and / or devices described may employ any of a number of computer operating systems, including, but not limited to, versions and / or varieties of the Ford Sync® application, the Middleware AppLink / Smart Device Link, the Microsoft Automotive® operating system, the Microsoft Windows® operating system, the Unix operating system (e.g., the Solaris® operating system sold by Oracle Corporation of Redwood Shores, California), the AIX UNIX operating system sold by International Business Machines of Armonk, New York, the Linux operating system, the operating systems include Mac OSX and iOS sold by Apple Inc. of Cupertino, California, the BlackBerry OS sold by Blackberry, Ltd. of Waterloo, Canada, and the operating system Android developed by Google, Inc. and the Open Handset Alliance, or the QNX® CAR platform for Infotainment offered by QNX software systems. Examples of computing devices include, without limitation, an on-board vehicle computer, a computer workstation, a server, a desktop, notebook, laptop, or handheld computer, or other computing system and / or device.Computing devices generally include computer-executable instructions, where the instructions may be executable by one or more computing devices, such as those listed above. Computer-executable instructions may be compiled or interpreted from computer programs created using a variety of programming languages and / or technologies, including, without limitation, and either alone or in combination, Java™ C, C++, Matlab, Simulink, Stateflow, Visual Basic, Java Script, Perl, HTML, etc. Some of these applications may be compiled and executed on a virtual machine, such as the Java virtual machine, the Dalvik virtual machine, or the like. Generally, a processor (e.g., a microprocessor) receives instructions from, e.g., a memory, a computer readable medium, etc., and executes these instructions, thereby performing one or more processes including one or more of the processes described herein. Such instructions and other data may be stored and transmitted using a variety of computer readable media. A file in a computing device is generally a collection of data stored on a computer readable medium such as a storage medium, random access memory, etc.A computer readable medium (also identified as a processor readable medium) includes any non-transitory (e.g., tangible) medium that participates in providing data (e.g., instructions) that may be read by a computer (e.g., by a processor of a computer). Such a medium may take many forms including, without limitation, non-volatile media and volatile media. Instructions may be transmitted by one or more transmission media including optical fibers, wires, wireless communication, including internal structures comprising a system bus coupled to a processor of a computer. Common forms of computer readable media include, for example, RAM, a PROM, an EPROM, a FLASH EEPROM, any other memory chip or cartridge, or any other medium from which a computer can read.Databases, data depots, or other data stores described herein may include various types of mechanisms for storing, accessing, and retrieving various types of data, including a hierarchical database, a set of files in a file system, an application database in a proprietary format, a relational database management system (RDBMS), a non-relational database (NoSQL), a graph database (GDB), etc. Each such data store is generally included within a computing device that uses a computer operating system such as one of those listed above, and is accessed via a network in one or more of a variety of ways. A file system may be accessed by a computer operating system and may include files stored in various formats. An RDBMS generally employs the Structured Query Language (SQL) in addition to a language for creating, storing, editing, and executing stored procedures, such as the PL / SQL language mentioned above.In some examples, system elements may be implemented as computer readable instructions (e.g., software) on one or more computing devices (e.g., servers, personal computers, etc.) stored on computer readable media (e.g., disks, memories, etc.) associated with the computing devices. A computer program product may include such instructions stored on computer readable media for performing the functions described herein.In the drawings, the same reference numerals indicate the same elements. Further, some or all of these elements could be changed. With regard to the media, processes, systems, methods, heuristics, etc. described herein, it should be understood that, although the steps of such processes, etc. have been described as occurring according to a certain ordered sequence, such processes could be practiced with the described steps performed in an order that differs from the order described herein. further, it should be understood that certain steps could be performed simultaneously, that other steps could be added, or that certain steps described herein could be omitted. Operations, systems, and methods described herein should always be implemented and / or performed in accordance with applicable owner / user and / or security policy control instructions.The disclosure has been described in an illustrative manner, and it is to be understood that the terminology which has been used is intended to be in a descriptive and non-limiting nature. The use of "responsive to" and "upon determination" indicates a causal relationship, not just a temporal relationship. In view of the above teachings, many modifications and variations are possible to the present disclosure and the disclosure may be practiced other than as specifically described.According to the present invention, there is provided a vehicle system including: a display unit including: a display panel; a board fixed relative to the display panel; a plurality of visible light emitting diodes (LEDs) mounted on the board; and a plurality of infrared LEDs mounted on the board and interspersed with the visible light LEDs; the board being arranged to direct emissions from the visible light LEDs and the infrared LEDs to the display panel; and a computer communicatively coupled to the display unit; wherein the computer is programmed to: actuate a component based on an infrared image from a camera imaging an occupant illuminated by the infrared LEDs; and adjusting a brightness of the infrared LEDs based on an ambient brightness.According to an embodiment, the computer is programmed to increase the brightness of the infrared LEDs in response to an increase in ambient brightness.According to an embodiment, the invention is further characterized by the camera, wherein: the camera is configured to detect visible light and infrared light; and the computer is programmed to actuate the component based on a visible light image from the camera that images the occupant.According to an embodiment, the invention is further characterized by the camera, wherein: the camera is configured to detect visible light and infrared light; and the computer is programmed to, in response to the ambient brightness exceeding a threshold, actuate the component based on a visible light image from the camera that images the occupant.According to an embodiment, the computer is programmed to actuate the component based on the infrared image when the ambient brightness is below the threshold.According to an embodiment, the computer is programmed to actuate the component based on the infrared image when the ambient brightness is above the threshold.According to one embodiment, the computer is programmed to, responsive to the ambient brightness being below the threshold, refrain from actuating the component based on the visible light image.According to an embodiment, the computer is programmed to adjust the brightness of the infrared LEDs by changing a pulse width modulation of the infrared LEDs.According to an embodiment, the display unit includes a light guide plate fixed behind the display panel; and the board is arranged to guide the emissions from the visible light LEDs and the infrared LEDs at an edge of the light guide plate into the light guide plate.According to an embodiment, the visible light LEDs and the infrared LEDs are arranged in a row along the edge of the light guide plate.According to an embodiment, a number of the visible light LEDs is greater than a number of the infrared LEDs.According to an embodiment, the board is fixed behind the display panel and arranged parallel to the display panel.According to an embodiment, the display unit includes a plurality of optical domes including the respective visible light LEDs, and the infrared LEDs are included in respective ones of the optical domes.According to one embodiment, a subset of the optical couplings includes the respective infrared LEDs.According to an embodiment, the visible light LEDs and the infrared LEDs are arranged in a two-dimensional pattern on the board.According to an embodiment, the invention is further characterized by an instrument panel, wherein the display unit is mounted on the instrument panel.According to one embodiment, the invention is further characterized by a camera, wherein the camera is spaced apart from the display unit.According to the present invention, there is provided a display unit including: a display panel; a light guide plate fixed behind the display panel; a board fixed relative to the display panel; a plurality of visible light emitting diodes (LEDs) mounted on the board; and a plurality of infrared LEDs mounted on the board and penetrated with the visible light LEDs; wherein the board is arranged to guide emissions from the visible light LEDs and the infrared LEDs at an edge of the light guide plate into the light guide plate.According to an embodiment, the visible light LEDs and the infrared LEDs are arranged in a row along the edge of the light guide plate.According to an embodiment, a number of the visible light LEDs is greater than a number of the infrared LEDs.

Claims

A vehicle system, comprising: a display unit including: a display panel; a board fixed relative to the display panel; a plurality of visible light emitting diodes (LEDs) mounted on the board; and a plurality of infrared LEDs mounted on the board and interspersed with the visible light LEDs; wherein the board is arranged to direct emissions from the visible light LEDs and the infrared LEDs to the display panel; and a computer communicatively coupled to the display unit; wherein the computer is programmed to: actuate a component based on an infrared image from a camera that images an occupant illuminated by the infrared LEDs; and adjusting a brightness of the infrared LEDs based on an ambient brightness.The vehicle system of claim 1, wherein the computer is programmed to increase the brightness of the infrared LEDs in response to an increase in ambient brightness.The vehicle system of claim 1, further comprising the camera, wherein: the camera is configured to detect visible light and infrared light; and the computer is programmed to actuate the component based on a visible light image from the camera that images the occupant.The vehicle system of claim 1, further comprising the camera, wherein: the camera is configured to detect visible light and infrared light; and the computer is programmed to, responsive to the ambient brightness exceeding a threshold, actuate the component based on a visible light image from the camera that images the occupant.The vehicle system of claim 4, wherein the computer is programmed to actuate the component based on the infrared image when the ambient brightness is below the threshold.The vehicle system of claim 5, wherein the computer is programmed to actuate the component based on the infrared image when the ambient brightness is above the threshold.The vehicle system of claim 4, wherein the computer is programmed to, responsive to the ambient brightness being below the threshold, refrain from actuating the component based on the visible light image.The vehicle system of claim 1, wherein: the display unit includes a light guide plate fixed behind the display plate; and the board is arranged to guide the emissions from the visible light LEDs and the infrared LEDs into the light guide plate at an edge of the light guide plate.The vehicle system of claim 8, wherein the visible light LEDs and the infrared LEDs are arranged in a row along the edge of the light guide plate.The vehicle system of claim 1, wherein a number of the visible light LEDs is greater than a number of the infrared LEDs.The vehicle system of claim 1, wherein the board is fixed behind the display panel and is disposed parallel to the display panel.The vehicle system of claim 11, wherein the display unit includes a plurality of optical domes including the respective visible light LEDs, and the infrared LEDs are included in respective ones of the optical domes.The vehicle system of claim 12, wherein a subset of the optical couplings includes the respective infrared LEDs.The vehicle system of any of claims 1-13, further comprising an instrument panel, wherein the display unit is mounted on the instrument panel.A display unit comprising: a display panel; a light guide plate fixed behind the display panel; a board fixed relative to the display panel; a plurality of visible light emitting diodes (LEDs) mounted on the board; and a plurality of infrared LEDs mounted on the board and penetrated by the visible light LEDs; wherein the board is arranged to guide emissions from the visible light LEDs and the infrared LEDs at an edge of the light guide plate into the light guide plate.

Images