Hybrid projector system with self-test

Abstract

A projector system for a head-up display in a vehicle comprises a vehicle vector graphics projector suitable for projecting a second graphic image onto the inner surface of the vehicle's windscreen, wherein the second graphic image has a higher brightness than the first graphic image and includes at least one vehicle warning light, and a calibration system suitable for checking and calibrating a displayed warning light within the second graphic image.

Description

[0001] The present disclosure relates to systems and methods for displaying graphics in a vehicle and in particular to graphics projectors for use in a vehicle.

[0002] To enhance occupant awareness and comfort, vehicles can be configured or equipped with display systems that provide occupants with information about the vehicle's surroundings. These systems can utilize devices with a human interface, such as touchscreens, to deliver this information. Head-up displays (HUDs) can also be used.

[0003] Vehicles typically have several warning lights that illuminate independently. A warning light (or tell-tale), sometimes called a tell-tale, indicates a malfunction or operation of a system, represented by a binary (on / off) illuminated light, symbol, or text legend. Warning lights are generally not part of a reconfigurable display or instrument cluster / combination because, for cost reasons, they need to be replaced, and bulb and reliability checks are required.

[0004] Although current vehicle systems fulfill their intended purpose, there is a need for a new and improved graphic projection system that provides a cost-effective and highly reliable solution for displaying such warning lights and replaces the individual, special or dedicated illumination of warning lights. Summary

[0005] According to several aspects of the present disclosure, a system for a head-up display in a vehicle comprises a vehicle vector graphics projector capable of projecting a second graphic image onto the inner surface of the vehicle's windscreen, wherein the second graphic image has a higher brightness than the first graphic image and includes at least one vehicle indicator light, and a calibration system capable of checking and calibrating a displayed indicator light within the second graphic image.

[0006] According to another aspect, the calibration system includes a reference calibration system comprising a reference windshield, a reference vector graphics projector (the reference vector graphics projector includes a reference vector graphics projector camera), a reference camera, and a reference controller electrically connected to the reference vector graphics projector and the reference camera, wherein the reference controller is programmed to project a reference graphic onto the reference windshield using the reference vector graphics projector, the reference graphic being a vehicle display or...vehicle warning light and contains a plurality of projected points arranged in a two-dimensional array, wherein an intended x-coordinate and an intended y-coordinate of each of the plurality of projected points is defined by an intended reference graphic matrix, takes a first reference image of the reference graphic using the reference camera, and computes at least one reference calibration matrix based at least partially on the first reference image of the reference graphic.

[0007] According to another aspect, when at least one reference calibration matrix is ​​computed, the reference controller is further programmed to determine a reference camera deviation matrix, wherein the reference camera deviation matrix encodes deviations in the reference graphics due to properties of the reference windscreen, and determines a transformation matrix for the reference vector graphics projector camera or reference vector graphics projector camera transformation matrix based at least partially on the reference camera deviation matrix.

[0008] According to another aspect, when the reference camera deviation matrix is ​​determined, the reference controller is further programmed to identify a plurality of perceived points of the reference graphic in the first reference image, determine an actual x-coordinate and an actual y-coordinate of each of the plurality of perceived points of the reference graphic in the first reference image, generate an actual reference graphic matrix, wherein each element of the actual reference graphic matrix contains the actual x-coordinate and the actual y-coordinate of one of the plurality of perceived points of the reference graphic in the first reference image, and compute the reference camera deviation matrix by subtracting the actual reference graphic matrix from the intended reference graphic matrix.

[0009] According to another aspect, when the reference vector graphics projector camera transformation matrix is ​​determined, the reference controller is further programmed to generate a deviation-compensated reference graphics matrix by summing the intended reference graphics matrix and the reference camera deviation matrix, to project a deviation-compensated reference graphic onto the reference windshield using the reference vector graphics projector, wherein a location or position of each of a plurality of projected points of the deviation-compensated reference graphic is defined by the deviation-compensated reference graphics matrix, to capture a second reference image of the deviation-compensated reference graphic using the reference vector graphics projector camera, and to identify a plurality of perceived points of the deviation-compensated reference graphic in the second reference image.Determines an actual x-coordinate and an actual y-coordinate of each of the plurality of perceived points of the deviation-compensated reference graphic in the second reference image, generates a reference vector graphics projector camera matrix, wherein each element of the reference vector graphics projector camera matrix contains the actual x-coordinate and the actual y-coordinate of one of the plurality of perceived points of the deviation-compensated reference graphic in the second reference image, and generates the reference vector graphics projector camera transformation matrix by subtracting the reference vector graphics projector camera matrix from the reference camera deviation matrix.

[0010] According to another aspect, the vehicle vector graphics projector comprises a vehicle vector graphics projector camera, and the hybrid projector system comprises a vehicle controller in electrical connection with the vehicle vector graphics projector, wherein the vehicle controller is programmed to project the reference graphic onto the vehicle windshield using the vehicle vector graphics projector, capture a calibration image of the reference graphic using the vehicle vector graphics projector camera, calculate a vehicle vector graphics projector calibration matrix based at least partially on the at least one reference calibration matrix and the calibration image of the reference graphic, and apply the vehicle vector graphics projector calibration matrix to each frame projected using the vehicle vector graphics projector.

[0011] According to another aspect, when the vehicle vector graphics projector calibration matrix is ​​calculated, the vehicle controller is further programmed to determine a deviation matrix for the vehicle vector graphics projector or vehicle vector graphics projector deviation matrix based at least partially on the at least one reference calibration matrix and the calibration image of the reference graphics, and to calculate the vehicle vector graphics projector calibration matrix by subtracting the vehicle vector graphics projector deviation matrix from the reference TWD camera transformation matrix.

[0012] According to another aspect, when the vehicle vector graphics projector deviation matrix is ​​determined, the vehicle controller is further programmed to identify a plurality of perceived points of the reference graphic in the calibration image, determine an actual x-coordinate and an actual y-coordinate of each of the plurality of perceived points of the reference graphic in the calibration image, generate an actual vehicle vector graphics projector matrix, wherein each element of the actual vehicle vector graphics projector matrix contains the actual x-coordinate and the actual y-coordinate of one of the plurality of perceived points of the reference graphic in the calibration image, and calculate the vehicle vector graphics projector deviation matrix by subtracting the actual vehicle vector graphics projector matrix from the reference vector graphics projector camera matrix.

[0013] According to another aspect, the reference camera is fixed at a reference position for the occupant's eye ellipses, and the reference position for the occupant's eye ellipses is a predetermined position in space relative to the reference windscreen.

[0014] According to another aspect, the vehicle vector graphics projector includes a light source module comprising an array of light-emitting diodes (LEDs) configured to generate source light, an optical filter in optical connection with the LED array, the optical filter being configured to receive the source light and transmit filtered light, respectively.transmits, and comprises a focusing lens in optical connection with the optical filter, wherein the focusing lens is configured to receive the filtered light and transmit a narrow beam of light, an optical collimator in optical connection with the light source module, wherein the optical collimator is configured to receive the narrow beam of light and transmit collimated light, and an optoelectric mirror in optical connection with the optical collimator, wherein the optoelectric mirror is configured to direct the collimated light to form a graphic.

[0015] According to another aspect, the optical filter is an optical bandpass filter configured to filter the source light and pass through the filtered light, with the filtered light containing only light with a wavelength within a passband of the optical bandpass filter.

[0016] According to another aspect, the system also includes a variety of light source modules in optical connection with the optical collimator.

[0017] According to another aspect, the system further comprises an optical waveguide in optical connection with the plurality of light source modules and the optical collimator, wherein the optical waveguide is configured to transmit the narrow-beam light from each of the plurality of light source modules to the optical collimator.

[0018] According to another aspect, the optical waveguide is a fiber optic cable that is optically connected to the focusing lens of each of the multitude of light source modules using a fiber optic coupler.

[0019] According to another aspect, the system further comprises a plurality of dichroic mirrors, each of the plurality of dichroic mirrors being optically connected to one of the plurality of light source modules, and each of the plurality of dichroic mirrors being configured to transmit the narrow-beam light from one of the plurality of light source modules to the optical collimator.

[0020] According to another aspect, each of the multitude of dichroic mirrors is configured to reflect a predetermined wavelength of narrow-beam light and to transmit all other wavelengths of narrow-beam light.

[0021] According to several aspects of the present disclosure, a method for displaying graphics with a projector system for a head-up display in a vehicle comprises projecting, using a vehicle vector graphics projector, a second graphic image onto the inner surface of the vehicle's windscreen, wherein the second graphic image has a higher brightness than the first graphic image and includes at least one vehicle indicator light, and checking and calibrating, with a calibration system, a vehicle indicator light displayed in the second graphic image.

[0022] According to another aspect, the testing and calibration, with the calibration system, of the displayed vehicle warning light within the second graphic image further comprises projecting a reference graphic onto a reference windshield using a reference vector graphics projector, wherein the reference graphic is a vehicle warning light, capturing a first reference image of the reference graphic using a reference camera, determining a reference camera deviation matrix, wherein the reference camera deviation matrix encodes deviations in the reference graphic due to properties of the reference windshield by identifying a plurality of perceived points of the reference graphic in the first reference image, and determining an actual x-coordinate and an actual y-coordinate of each of the plurality of perceived points of the reference graphic in the first reference image.an actual reference graphics matrix is ​​generated, wherein each element of the actual reference graphics matrix contains the actual x-coordinate and the actual y-coordinate of one of the plurality of perceived points of the reference graphic in the first reference image; and the reference camera deviation matrix is ​​calculated by subtracting the actual reference graphics matrix from an intended reference graphics matrix, wherein the intended reference graphics matrix is ​​a two-dimensional array containing an intended x-coordinate and an intended y-coordinate of each of a plurality of projected points; determining a reference vector graphics projector camera transformation matrix based at least partially on the reference camera deviation matrix by generating a deviation-compensated reference graphics matrix by summing the intended reference graphics matrix and the reference camera deviation matrix.Using a reference vector graphics projector, a deviation-compensated reference graphic is projected onto the reference windshield, wherein a position of each of a plurality of projected points of the deviation-compensated reference graphic is defined by the deviation-compensated reference graphic matrix; using a reference vector graphics projector camera, a second reference image of the deviation-compensated reference graphic is captured; a plurality of perceived points of the deviation-compensated reference graphic are identified in the second reference image; an actual x-coordinate and an actual y-coordinate of each of the plurality of perceived points of the deviation-compensated reference graphic in the second reference image are determined; a reference vector graphics projector camera matrix is ​​generated.wherein each element of the reference vector graphics projector camera matrix contains the actual x-coordinate and the actual y-coordinate of one of the plurality of perceived points of the deviation-compensated reference graphic in the second reference image, and the reference vector graphics projector camera transformation matrix is ​​determined by subtracting the reference vector graphics projector camera matrix from the reference camera deviation matrix, the reference graphic is projected onto the vehicle windshield using the vehicle vector graphics projector, a calibration image of the reference graphic is captured using a vehicle vector graphics projector camera, and a vehicle vector graphics projector calibration matrix is ​​calculated based at least partially on the reference camera deviation matrix, the reference TWD camera transformation matrix, and the calibration image.by determining a vehicle vector graphics projector deviation matrix based at least partially on the reference vector graphics projector camera matrix and the reference graphic calibration image, by identifying a plurality of perceived points of the reference graphic in the calibration image, determining an actual x-coordinate and an actual y-coordinate of each of the plurality of perceived points of the reference graphic in the calibration image, generating an actual vehicle vector graphics projector matrix, wherein each element of the actual vehicle vector graphics projector matrix contains the actual x-coordinate and the actual y-coordinate of one of the plurality of perceived points of the reference graphic in the calibration image, and calculating the vehicle vector graphics projector deviation matrix by subtracting the actual vehicle vector graphics projector matrix from the reference vector graphics projector camera matrix.and calculating the vehicle vector graphics projector calibration matrix based at least partially on the vehicle vector graphics projector deviation matrix by subtracting the vector graphics projector deviation matrix from the vector graphics projector camera transformation matrix, and applying the vehicle vector graphics projector calibration matrix to each frame projected using the vehicle vector graphics projector.

[0023] According to another aspect, projecting a second graphic image onto the inner surface of the vehicle's windshield using a vector graphics projector further includes generating source light with an array of light-emitting diodes (LEDs) in a light source module; receiving the source light with an optical bandpass filter of the light source module in optical connection with the LED array; filtering the source light with the optical bandpass filter; transmitting the filtered light with a wavelength within a passband of the optical bandpass filter; receiving the filtered light with a focusing lens of the light source module in optical connection with the optical filter; transmitting a narrow beam of light with the focusing lens; and receiving the narrow beam of light with an optical collimator in optical connection with the light source module and transmitting it.with the optical collimator, a collimated light and direction, with an optoelectric mirror in optical connection with the optical collimator, the collimated light, to form a graphic.

[0024] Further areas of application will become apparent from the description provided herein. It should be understood that the description and specific examples serve only for illustrative purposes and are not intended to limit the scope of this disclosure. Brief description of the drawings

[0025] The drawings described herein are for illustrative purposes only and are not intended to limit the scope of the present disclosure in any way. Fig. Figure 1 is a schematic representation of a vehicle with a system according to an exemplary embodiment of the present disclosure; Fig. Figure 2 is a schematic representation of a system according to an exemplary embodiment, wherein a second graphic image is displayed by a vector graphics projector next to a first graphic image by a digital light projector; Fig. 3 is a schematic side view of the in Fig. 1 of the vehicle shown; Fig. Figure 4 is a schematic representation of a substrate for the windshield of the vehicle according to an exemplary embodiment; Fig. 5 is an enlarged part of Fig. 4, as described by the one with “ Fig. 5” designated circle in Fig. 4 is indicated; Fig. Figure 6 is a schematic representation of a vector graphics projector containing a waveguide with fiber optic cable; Fig. Figure 7 is a schematic representation of a vector graphics projector containing dichroic mirrors; Fig. Figure 8 is a schematic representation of a system according to an exemplary embodiment, wherein a second graphic image is displayed by a vector graphics projector over a first graphic image by a digital light projector; Fig. Figure 9 is a schematic representation of a reference calibration system according to an exemplary embodiment; Fig. Figure 10 is a flowchart illustrating a process according to an exemplary embodiment of the present disclosure; Fig. Figure 11 is a flowchart of an exemplary embodiment of a method for calculating at least one reference calibration matrix according to an exemplary embodiment; Fig. Figure 12A is a first exemplary view of a projection field of the reference calibration system according to an exemplary embodiment; Fig. Figure 12B is a second exemplary view of a projection field of the reference calibration system according to an exemplary embodiment; and Fig. Figure 13 is a flowchart of an exemplary embodiment of a method for calculating a vehicle TWD calibration matrix according to an exemplary embodiment.

[0026] The figures are not necessarily to scale, and some features may be exaggerated or reduced in size, for example, to show details of certain components. In some cases, known components, systems, materials, or processes have not been described in detail to avoid obscuring the present disclosure. Therefore, specific structural and functional details disclosed here are not to be interpreted as limiting, but merely as a basis for the claims and as a representative basis for showing the person skilled in the art how the present disclosure can be applied in various ways. Detailed description

[0027] The following description is by its very nature merely exemplary and is not intended to limit the present disclosure, application, or uses. Furthermore, no obligation is intended to be attached to any express or implied theory presented in the preceding technical section, background, summary, or detailed description below. It should be understood that throughout the drawings, corresponding reference numerals denote identical or corresponding parts and features.As used herein, the term "module" refers to any hardware, software, firmware, electronic control component, processing logic, and / or processor device, individually or in any combination, including, without limitation: an application-specific integrated circuit (ASIC), an electronic circuit, a processor (shared, dedicated, or grouped) and memory executing one or more software or firmware programs, a combinational logic circuit, and / or other suitable components providing the described functionality. Although the figures shown herein represent an example with specific arrangements of elements, actual embodiments may include additional intervening elements, devices, features, or components. It should also be understood that the figures are for illustrative purposes only and are not necessarily drawn to scale.

[0028] As used herein, the term "vehicle" is not limited to automobiles. Although the technology presented here is primarily described in connection with automobiles, it is not limited to automobiles. The concepts can be used in a wide variety of applications, such as in connection with aircraft, watercraft, other vehicles, and consumer electronics components.

[0029] According to an exemplary embodiment, Fig. 1 A vehicle 10 with an associated hybrid projector system for a head-up display 11 within the vehicle 10 according to various embodiments. In general, the hybrid projector system 11 works in conjunction with other systems within the vehicle 10 to display various information and infotainment content for the passenger. The vehicle 10 generally comprises a chassis 12, a body 14, front wheels 16, and rear wheels 18. The body 14 is mounted on the chassis 12 and substantially encloses the components of the vehicle 10. The body 14 and the chassis 12 may together form a frame. The front wheels 16 and the rear wheels 18 are each rotatably coupled to the chassis 12 near a corner of the body 14.

[0030] In various embodiments, the vehicle 10 is an autonomous vehicle, and the system 11 is integrated into the autonomous vehicle 10. An autonomous vehicle 10 is, for example, a vehicle 10 that is automatically controlled to transport passengers from one place to another. In the embodiment shown, the vehicle 10 is depicted as a passenger car; however, it should be understood that any other vehicle, including motorcycles, trucks, sport utility vehicles (SUVs), motorhomes (RVs), etc., can also be used. In one exemplary embodiment, the vehicle 10 is equipped with a so-called Level Four or Level Five automation system. A Level Four system represents a "high level of automation," which refers to the performance specific to a driving mode.Level Five refers to the execution of all aspects of the dynamic driving task by an automated driving system, even if a human driver does not respond appropriately to a request for intervention. A Level Five system represents "full automation," which refers to full-time execution by an automated driving system for all aspects of the dynamic driving task under all road and environmental conditions that a human driver could handle.

[0031] As shown, the vehicle 10 generally comprises a drive system 20, a transmission system 22, a steering system 24, a braking system 26, a sensor system 28, an actuator system 30, at least one data storage device 32, a vehicle controller 34, and a communication system 36. In an embodiment in which the vehicle 10 is an electric vehicle, a transmission system 22 is not required. The drive system 20 may, in various embodiments, comprise an internal combustion engine, an electric machine such as a traction motor, and / or a fuel cell drive system. The transmission system 22 is configured to transmit power from the drive system 20 to the front wheels 16 and the rear wheels 18 of the vehicle according to selectable gear ratios. According to various embodiments, the transmission system 22 may comprise a stepped automatic transmission, a continuously variable transmission, or another suitable transmission.The braking system 26 is configured to provide a braking torque to the front wheels 16 and the rear wheels 18 of the vehicle. The braking system 26 may, in various embodiments, comprise friction brakes, cable brakes, a regenerative braking system such as an electric motor, and / or other suitable braking systems. The steering system 24 influences the position of the front wheels 16 and the rear wheels 18. Although the steering system 24 is depicted as comprising a steering wheel, in some embodiments considered within the scope of this disclosure, it may not include a steering wheel.

[0032] The sensor system 28 comprises one or more measuring or sensing devices 40a-40n that detect observable conditions of the external and / or internal environment of the autonomous vehicle 10. The sensing devices 40a-40n may include, but are not limited to, radar systems, lidar systems, global positioning systems, optical cameras, thermal cameras, ultrasonic sensors, and / or other sensors. The cameras may include two or more digital cameras spaced at a selected distance from one another, the two or more digital cameras being used to obtain stereoscopic images of the environment in order to create a three-dimensional image. The plurality of sensing devices 40a-40n is used to determine information about the environment around the vehicle 10.In one exemplary embodiment, the plurality of sensing devices 40a-40n comprises at least one engine speed sensor, one engine torque sensor, one voltage and / or current sensor for the electric drive motor, one accelerator pedal position sensor, one coolant temperature sensor, one cooling fan speed sensor, and one transmission oil temperature sensor. In another exemplary embodiment, the plurality of sensing devices 40a-40n further comprises sensors for determining information about the environment around the vehicle 10, for example, an ambient air temperature sensor, an air pressure sensor, and / or a photo and / or video camera positioned to view the environment in front of the vehicle 10. In another exemplary embodiment, at least one of the multiple sensing devices 40a-40n is capable of measuring distances in the environment around the vehicle 10.In a non-restrictive example, where the plurality of sensing devices 40a-40n includes a camera, the plurality of sensing devices 40a-40n measures distances using an image processing algorithm configured to process images from the camera and determine distances between objects. In another non-restrictive example, the plurality of vehicle sensors 40a-40n includes a stereoscopic camera with distance-measuring capabilities. In one example, at least one of the plurality of sensing devices 40a-40n is located inside the vehicle 10, for example, on the headliner of the vehicle 10, with a view through the windshield of the vehicle 10. In another example, at least one of the plurality of sensing devices 40a-40n is located outside the vehicle 10, for example, on the roof of the vehicle 10, with a view of the surroundings around the vehicle 10.It should be understood that various additional types of detection devices, such as LiDAR sensors, ultrasonic distance sensors, radar sensors, and / or time-of-flight sensors, are within the scope of this disclosure. The actuator system 30 comprises one or more actuator devices 42a-42n that control, but are not limited to, one or more features or functions of the vehicle 10, such as the drive system 20, the transmission system 22, the steering system 24, and the braking system 26.

[0033] The vehicle controller 34 comprises at least one processor 44 and a computer-readable memory device or computer-readable storage media 46. The at least one data processor 44 can be any custom or commercially available processor, a central processing unit (CPU), a graphics processing unit (GPU), an auxiliary processor among several processors connected to the vehicle controller 34, a semiconductor-based microprocessor (in the form of a microchip or chipset), a macroprocessor, any combination thereof, or generally any device for executing instructions. The computer-readable memory device or computer-readable storage media 46 can comprise volatile and non-volatile memory, for example, in a read-only or read-only memory (ROM), a random-access memory (RAM), and keep-alive memory (KAM). KAM is a persistent orPersistent or non-volatile memory that can be used to store various operating variables while at least one data processor 44 is switched off or shut down. The computer-readable storage device or computer-readable storage media 46 can be implemented using any number of known storage devices such as PROMs (programmable read-only memory), EPROMs (electrical PROMs), EEPROMs (electrically erasable PROMs), flash memory, or other electrical, magnetic, optical, or combined storage devices capable of storing data, some of which represent executable instructions used by the controller 34 in controlling the vehicle 10.

[0034] The instructions can comprise one or more separate programs, each containing an ordered list of executable instructions for implementing logical functions. When executed by the at least one processor 44, the instructions receive and process signals from the sensor system 28, perform logic, calculations, procedures, and / or algorithms to automatically control the components of the vehicle 10, and generate control signals for the actuator system 30 to automatically control the components of the vehicle 10 based on the logic, calculations, procedures, and / or algorithms. Although in Fig. Where only one controller 34 is shown, embodiments of the vehicle 10 may include any number of controllers 34 which communicate via any suitable communication medium or combination of communication media and which cooperate to process the sensor signals, perform logic, calculations, procedures and / or algorithms and generate control signals to automatically control features or functions of the autonomous vehicle 10.

[0035] In various embodiments, one or more instructions from the vehicle controller 34 are contained in a trajectory planning system and, when executed by the at least one data processor 44, generate a trajectory output that addresses or takes into account kinematic and dynamic constraints of the environment. For example, the instructions receive process sensor and map data as input. The instructions implement a graph-based approach with a tailored effort or cost function to handle various road scenarios in both urban and highway environments.

[0036] The communication system 36 is configured to wirelessly transmit or communicate information to and from other remote units 48, such as other vehicles (“V2V” communication), infrastructure (“V2I” communication), remote systems, remote servers, cloud computers, and / or personal devices. In one exemplary embodiment, the communication system 36 is a wireless communication system configured to communicate via a wireless local area network (WLAN) using IEEE 802.11 standards or via cellular data communication. However, additional or alternative communication methods, such as a dedicated short-range communication channel (DSRC), are also considered within the scope of this disclosure.DSRC channels refer to short- to medium-range, one-way or two-way wireless communication channels specifically designed for use in motor vehicles, and to a corresponding set of protocols and standards.

[0037] The vehicle controller 34 is a non-generalized electronic control device comprising a pre-programmed digital computer or processor, memory or non-transitory computer-readable medium used to store data such as control logic, software applications, instructions, computer code, data, lookup tables, etc., and a transmit / receiver or transceiver [or input / output terminals or input / output ports]. A computer-readable medium includes any type of medium that a computer can access, such as read-only or read-only memory (ROM), random-access memory (RAM), a hard disk drive, a compact disc (CD), a digital video disc (DVD), or any other type of storage. A "non-transitory" computer-readable medium includes wired orWired, wireless, optical, or other communication links that carry transient electrical or other signals. Non-transient computer-readable media includes media on which data can be permanently stored and media on which data can be stored and later overwritten, such as a rewritable optical disc or an erasable storage device. Computer code includes any type of program code, including source code, object code, and executable code.

[0038] Referring to Fig. In an exemplary embodiment, the system 11 is a hybrid projector system 11 comprising a digital light projector (DLP) 50, which is capable of projecting a first graphic image 52 onto an inner surface 54 of a windshield 56 of the vehicle 10, and a vector graphics projector (VGP) 58, which is capable of projecting a second graphic image 60 onto the inner surface 54 of the windshield 56 of the vehicle 10. It should be understood that the system 11 can be used without a DLP 50 without deviating from the novel features of the present disclosure.

[0039] The DLP 50 projects a first graphic image 52, which contains various information / infotainment applications. The DLP 50 is capable of projecting two-dimensional and three-dimensional images depicting objects such as pedestrians, buildings, and other vehicles in the vicinity of the vehicle 10.In an exemplary embodiment, the DLP 50 comprises a light source 62 suitable for projecting an excitation light 64, a converging lens 66 suitable for focusing the excitation light 64 from the light source 62, a color filter 68 (color wheel) suitable for splitting the focused excitation light 64 into red, green, and blue light, a shaping lens 70 suitable for focusing the excitation light 64 passing through the color filter 68, a digital micromirror device (DMD) 72 suitable for deflecting the excitation light 64, and a projection lens 74 suitable for receiving the excitation light 64 from the digital micromirror device (DMD) 72 and projecting the excitation light 64 onto the inner surface 54 of the windshield 56.

[0040] Referring to Fig. The vehicle controller 34 includes a DLP engine 76. The DLP engine 76 contains a programmable processor that has programming to monitor various inputs and determine which information is suitable for display. The DLP engine 76 can communicate directly with various systems and components, or alternatively or additionally, the DLP engine 76 can communicate via a LAN / CAN system. The DLP engine 76 uses information relating to the operating environment of the vehicle 10, which is derived from a series of inputs. Various acquisition devices 40a-40n collect and provide information. The acquisition devices 40a-40n include a camera or an image capture device that takes periodic or sequential images representing a view from the vehicle 10.The windshield 56 is equipped with features that allow it to display a projected image while remaining transparent or substantially transparent, so that occupants of the vehicle 10 can clearly see the vehicle's external surroundings through the windshield 56. It should be understood that the windshield 56, as shown, is located at the front of the vehicle 10, but other surfaces inside the vehicle 10, including side windows and a rear window, can be used for the projection. Furthermore, the view on the front windshield 56 could be continued as a continuous image onto the front A-pillars of the vehicle and the side windows.

[0041] The DLP machine 76 contains display software or programming that translates requests for information from the DLP machine 76 into graphical representations describing the information. The DLP machine 76 is programmed to compensate for the curved and inclined surface of the windshield 56 and any other surfaces onto which the first graphical image 52 is to be projected. The DLP machine 76 controls the light source 62, which includes a laser or projector device that generates an excitation light 64 to project the first graphical image 52.

[0042] An occupant monitoring system 78 comprises sensors known in engineering for approximating the position of an occupant's head and, furthermore, the orientation or gaze position of the occupant's eyes. Based on the output of the occupant monitoring system 78 and the input data, which tracks the location information in relation to the environment around the vehicle 10, the DLP machine 76 can accurately position the first graphic image 52 so that the occupant sees the first graphic image 52 superimposed with visual images through the windshield 56.

[0043] The system 11 described above comprises eye and head detection devices that enable an estimation of the eye position, allowing the registration or capture of images on the windshield 56 so that the images correspond to the operator's view. However, it is clear that the estimation of the head and eye position can be achieved through a number of methods. For example, in one process similar to adjusting rearview mirrors, an operator can use a calibration routine upon entering a vehicle to align the graphics with a detected object. In another embodiment, the seat position in the longitudinal direction of the vehicle 10 can be used to estimate the position of the driver's head. In yet another embodiment, the manual adjustment of a rearview mirror or mirrors can be used to estimate the position of the driver's eyes.It is understood that a combination of methods, such as seat position and mirror adjustment angle, can be used to determine the driver's head position with improved accuracy. Many methods for accurately capturing graphics on the windscreen 56 are conceivable or are under consideration, and the disclosure is not intended to be limited to the particular embodiments described herein.

[0044] The windshield 56 functions as a medium through which relevant features can be observed, while serving as a display device on which the first graphic image 52 can be shown. The windshield 56 is both transparent and capable of displaying projected images by means of an excitation light 64. Referring to Fig. 4 and Fig. In this case, an occupant 80 can see any object (e.g., a cube 82) through a substrate 84 arranged or positioned on the windshield 56. The substrate 84 can be transparent or substantially transparent. While the occupant 80 sees the object 82 through the substrate 84, the occupant 80 can also see images (e.g., a circle 86 and a triangle 88) generated on the substrate 84. The substrate 84 can be part of the windshield 56, a glass substrate, a plastic substrate, a polymer substrate, or any other transparent (or substantially transparent) medium conceivable by a person skilled in the art. Other substrates can complement the substrate 84 to provide tinting, protection of the substrate, light filtering (e.g., filtering of external ultraviolet light), and other functions.

[0045] Fig. Figure 5 represents the illumination of transparent displays illuminated by excitation light 64 (e.g., ultraviolet or infrared light) from a light source 62. The substrate 84 receives excitation light 64 from the light source 62. The received excitation light 64 can be absorbed by the light-emitting material 90 on the substrate 84. When the light-emitting material receives the excitation light 64, it emits visible light. Accordingly, images (e.g., a circle 86 and a triangle 88) can be produced on the substrate 84 by selectively illuminating the substrate 84 with excitation light 64.

[0046] In an exemplary embodiment, the light-emitting material 90 comprises transparent phosphors embedded in the substrate 84. The transparent phosphors are light-emitting particles that fluoresce in response to excitation by the excitation light 64. In an exemplary embodiment, the transparent phosphors are red, green, and blue (RGB) phosphors, enabling full colors. The use of monochromatic and / or bichromatic phosphors is also within the scope of this disclosure. When the excitation light 64 is absorbed by the transparent phosphors, visible light is emitted by the transparent phosphors. The excitation light 64 is provided by the light source 62. The use of the substrate 84 and the light-emitting material 90 to display graphics is described in U.S. Application No. 1, filed on May 20, 2022.: 17 / 749,464 entitled “HYBRID AUGMENTED REALITY HEAD-UP DISPLAY FOR CREATING AN EDGE-TO-EDGE AUGMENTED REALITY VIEW”, the entire contents of which are hereby incorporated by reference.

[0047] According to the embodiments of the present disclosure, the excitation light 64 can be ultraviolet light. If the excitation light 64 is ultraviolet light, a physical phenomenon of down-conversion occurs when the light-emitting material 90 emits visible light in response to the ultraviolet light. Specifically, ultraviolet light has a shorter wavelength and higher energy than visible light. When the light-emitting material 90 absorbs the ultraviolet light and emits lower-energy visible light, the ultraviolet light is accordingly down-converted into visible light, since the energy level of the ultraviolet light decreases when it is converted into visible light.

[0048] It should be understood that the excitation wavelengths described herein are specifically for use with a particular fluorescent film. Other technologies could also be used, such as those based on holographic diffraction gratings or gratings (Bragg gratings), which utilize visible light projectors and RGB LEDs to create a vector graphics projector and an RGB DLP projector.

[0049] As in Fig. 2 and Fig. As shown in Figure 3, the excitation light 64 is emitted by the light source 62 of the DLP 50. In one exemplary embodiment, the light source 62 is a projector with a micromirror array (MMA) (e.g., a digital light processing (DLP) projector 50). In the DLP 50, the first graphic image 52 is generated by means of microscopically small mirrors arranged in a matrix on a semiconductor chip within the DMD 72. An MMA projector emitting ultraviolet light can be similar to an MMA projector emitting visible light, except that the color filter 68 has light filters tailored to the ultraviolet light spectrum. In other embodiments, the DLP 50 is a liquid crystal display (LCD) projector. In some embodiments, the DLP 50 can be a liquid crystal on silicon (LCOS) projector. In some embodiments, the DLP 50 can be an analog projector (e.g.a slide projector or a film projector). For the expert, other types of projectors could also be conceivable that could be used to project ultraviolet light onto substrate 84.

[0050] Referring to Fig. Figure 6 shows a schematic representation of an exemplary embodiment of the VGP 58. The VGP 58 generally comprises a first light source module 92a, a second light source module 92b, a third light source module 92c, a fiber optic coupler 94, and an output module 96.

[0051] The components of the VGP 58 (i.e., the first light source module 92a, a second light source module 92b, a third light source module 92c, a fiber optic coupler 94, and an output module 96) are optically connected to one another. Within the context of this disclosure, optical communication or connection means that light can propagate through the space between the components and interact with the optical properties of each component. This optical connection can be achieved by positioning the first light source module 92a, a second light source module 92b, a third light source module 92c, a fiber optic coupler 94, and an output module 96 such that light is transmitted between the components due to intrinsic reflection and / or refraction properties of the components and / or the properties of a medium between the components (e.g., air).The optical connection can also be achieved by using an optical waveguide. Within the scope of this disclosure, an optical waveguide is a physical structure designed to confine and guide light along a specific path (i.e., between the first light source module 92a, a second light source module 92b, a third light source module 92c, a fiber optic coupler 94, and an output module 96). In a non-limiting example, a plurality of fiber optic cables 98a, 98b, 98c, 98d are used to establish an optical connection. In an exemplary embodiment, the fiber optic cables 98a, 98b, 98c, 98d are optoelectric cables functioning as optical waveguides. In a non-limiting example, the fiber optic cables 98a, 98b, 98c, 98d contain multiple strands of glass or plastic fibers.The fibers are bundled together and surrounded by a protective coating. The first fiber optic cable 98a is used to establish the optical connection between the first light source module 92a and the fiber optic coupler 94. The second fiber optic cable 98b is used to establish an optical connection between the second light source module 92b and the fiber optic coupler 94. The third fiber optic cable 98c is used to establish an optical connection between the third light source module 92c and the fiber optic coupler 94. The fourth fiber optic cable 98d is used to establish an optical connection between the fiber optic coupler 94 and the output module 96.It should further be understood that various additional methods for establishing an optical connection between optical components, including, for example, planar waveguides, ribbed waveguides, channel waveguides, hollow core waveguides and the like, are within the scope of this disclosure.

[0052] The first light source module 92a comprises an array of light-emitting diodes (LEDs) 100, an optical filter 102, and a focusing lens 104. The LED array 100 is used to provide a light source for the first light source module 92a. In an exemplary embodiment, the LED array 100 comprises a plurality of the LEDs (not shown) connected electrically in series or parallel. The LED array 100 further comprises at least two electrical terminals (not shown) that are electrically connected to the plurality of LEDs. The plurality of LEDs is arranged such that a high density of LEDs is achieved on a relatively small area. In a non-limiting example, the plurality of LEDs is arranged in a grid or lattice pattern. In another non-limiting example, the plurality of LEDs is arranged in a radial pattern.The multitude of LEDs is mechanically attached to a substrate to provide structural stability to the arrangement. In one non-restrictive example, the substrate is a printed circuit board (PCB). In another non-restrictive example, the substrate is a metal-core printed circuit board (MCPCB) containing a metal layer that contributes to the thermal management of the multitude of LEDs by dissipating heat.

[0053] When an electric current is passed through the plurality of LEDs using the electrical connections, the plurality of LEDs emits light. The light emitted by the plurality of LEDs of the LED array 100 is referred to as source light 106. In one exemplary embodiment, the source light 106 is polychromatic, meaning that the source light 106 contains several wavelengths of light (e.g., light with wavelengths between 380 nanometers and 460 nanometers). In another exemplary embodiment, the source light 106 is monochromatic, meaning that the source light 106 contains only a single wavelength of light (e.g., 380 nanometers, 405 nanometers, or 460 nanometers). It should be understood that the wavelengths and wavelength ranges mentioned above are only examples. The LED array 100 is configured such that the source light 106 falls onto the optical filter 102.

[0054] The optical filter 102 is used to filter the source light 106. In an exemplary embodiment, the optical filter 102 is configured to receive the source light 106 and transmit filtered light 108. Within the scope of this disclosure, the filtered light 108 is light that has only wavelengths within a transmission range of the optical filter 102. In a non-limiting example, the optical filter 102 comprises a substrate material (e.g., glass or quartz) onto which one or more thin-film layers are deposited. The thin-film layers are designed to either absorb or refract specific wavelengths of the light. In a first exemplary embodiment, the optical filter 102 is an optical interference bandpass filter.In a non-restrictive example, the optical interference bandpass filter contains alternating dielectric layers made of materials with different refractive indices. The alternating layers are configured to produce an interference pattern that (analogous to a Fabry-Perot interferometer) enhances the transmission of wavelengths within the passband and suppresses other wavelengths.

[0055] In another exemplary embodiment, the optical filter 102 is an absorbing optical bandpass filter. In a non-limiting example, the absorbing optical bandpass filter comprises one or more layers of an absorbing dielectric material deposited on the substrate. The absorbing layers dissipate the unwanted wavelengths by absorption, while the wavelengths within the passband are transmitted. In another exemplary embodiment, the passband of the optical filter 102 includes only monochromatic light with a single wavelength (e.g., 380 nanometers, 405 nanometers, 460 nanometers). Therefore, the filtered light 108 contains only light with a single wavelength.It should be understood that the wavelengths mentioned above are only examples and that the transmission range of the optical filter 102 can also include other wavelengths without deviating from the scope of this disclosure. The optical filter 102 is configured such that the filtered light 108 falls onto the focusing lens 104.

[0056] The focusing lens 104 is used to focus the filtered light 108 to produce a narrow beam of light 110. In an exemplary embodiment, the focusing lens 104 comprises a curved transparent substrate (e.g., glass or another transparent material). As the filtered light 108 passes through the focusing lens 104, the curvature of the focusing lens 104 causes the filtered light 108 to refract towards a focal point 112. The location or position of the focal point 112 is determined by the curvature and refractive index of the focusing lens 104. The focal point 112 of the focusing lens 104 is a termination of the first fiber optic cable 98a, so that the narrow beam light 110 is transmitted from the focusing lens 104 via the first fiber optic cable 98a to the fiber optic coupler 94.

[0057] It should be understood that the second light source module 92b and the third light source module 92c each contain the same components as the first light source module 92a (i.e., the LED array 100, the optical filter 102, and the focusing lens 104). Therefore, the description given above for the first light source module 92a also applies to the second light source module 92b and the third light source module 92c. It should be understood by a person skilled in the art that the VGP 58 can contain any number of light source modules. While in Fig. 2 a first light source module 92a and a second light source module 92b illustrated and Fig. 6 and Fig. Figure 7 illustrates a first light source module 92a, a second light source module 92b and a third light source module 92c; other numbers of light source modules can be used without deviating from the scope of the present invention.

[0058] In an exemplary embodiment, each of the first light source module 92a, the second light source module 92b, and the third light source module 92c is configured to generate narrow-beam light 110 with a different wavelength. In a non-limiting example, the first light source module 92a generates narrow-beam light 110 with a wavelength of 380 nanometers. The second light source module 92b generates narrow-beam light 110 with a wavelength of 405 nanometers. The third light source module 92c generates narrow-beam light 110 with a wavelength of 460 nanometers. It should be understood that the first light source module 92a, the second light source module 92b, and the third light source module 92c can be configured to generate narrow-beam light 110 with different wavelengths without departing from the scope of this disclosure.

[0059] The fiber optic coupler 94 is used to combine the narrow-beam light 110 from the first light source module 92a, the second light source module 92b, and the third light source module 92c. In an exemplary embodiment, the fiber optic coupler 94 comprises a first input port 114a, which is optically connected to the first light source module 92a via the first fiber optic cable 98a, a second input port 114b, which is optically connected to the second light source module 92b via the second fiber optic cable 98b, and a third input port 114c, which is optically connected to the third light source module 92c via the third fiber optic cable 98c. The fiber optic coupler 94 further comprises an output port 116. The input ports 114a, 114b, 114c, and the output port 116 each contain a fiber optic cable (not shown).Optical fiber that is aligned and fused with the optical fibers of the other ports. When light is introduced into one of the input ports 114a, 114b, or 114c, the light propagates along the optical fiber and is transmitted to the output port 116. Therefore, the intensity of the narrow-beam light 110 from each of the first light source module 92a, the second light source module 92b, and the third light source module 92c is summed at the output port 116 of the optical fiber coupler 94. The output port 116 is optically connected to the output module 96 via the fourth optical fiber 98d.

[0060] The output module 96 is used to direct the narrow-beam light 110 from the output aperture 116 of the fiber optic coupler 94 to project the second graphic image 60. The output module 96 comprises an optical collimator 118 and an optoelectric mirror 120.

[0061] The optical collimator 118 is used to generate collimated light 122 from the narrow-beam light 110. In an exemplary embodiment, the optical collimator 118 comprises a collimating or converging lens, which is used to focus the narrow-beam light 110 into a parallel (i.e., collimated) beam. In a non-limiting example, the converging lens is a plano-convex or double-convex lens configured to produce a desired beam divergence and collimation distance. The optical collimator 118 operates by refracting the narrow-beam light 110 from the fiber optic coupler 94 using the converging lens to generate the collimated light 122. The optical collimator 118 is optically connected to the optoelectric mirror 120.

[0062] The optoelectric mirror 120 is used to direct the collimated light 122 based on electrical signals. Within the scope of this disclosure, the optoelectric mirror 120 is an electromechanical device (e.g., a microelectromechanical system) configured to direct light with high precision, accuracy, and speed in response to electrical signals. In an exemplary embodiment, the optoelectric mirror 120 comprises a digital micromirror device (DMD). The DMD is an optical microelectromechanical system containing an array of mirrors that can be individually tilted to reflect light in a desired direction. In a non-limiting example, the DMD is used to generate high-resolution images by reflecting the collimated light 122 onto a projection surface.The tilting mirrors on the DMD are controlled by an electronic driver that rapidly modulates the mirrors to project the second graphic image 60 onto the windscreen 56.

[0063] In another exemplary embodiment, the optoelectric mirror 120 is a microelectromechanical scanning mirror. In this exemplary embodiment, the microelectromechanical scanning mirror is an optoelectric device that uses at least one mirror to generate high-resolution images. The at least one mirror can be tilted to reflect the collimated light 122 in a desired direction. The tilting movement of the at least one mirror is controlled by an electronic driver that rapidly modulates the mirrors to project the second graphic image 60 onto the windshield 56.

[0064] In another exemplary embodiment, the optoelectric mirror 120 is a galvanometer mirror. In this exemplary embodiment, the galvanometer mirror is an optoelectric device that uses at least one mirror rotating about an axis to deflect the collimated light 122. The at least one mirror of the galvanometer mirror is controlled by a galvanometer, which is an electric motor that converts electrical current signals into mechanical motion. The galvanometer rotates the at least one mirror rapidly about the axis so that the collimated light 122 can be deflected to scan the collimated light 122 via the windshield 56 and display the second graphic image 60. The light transmitted to the windshield 56 by means of the optoelectric mirror 120 is referred to as projected light 124.

[0065] It should be understood that, in order to set a total light intensity of the projected light 124, the VGP 58 may contain more or less than three light source modules without deviating from the scope of the present disclosure.

[0066] Referring to Fig. 7 comprises a further exemplary embodiment of the VGP 58 comprising the first light source module 92a, the second light source module 92b, the third light source module 92c, a first dichroic mirror 126a, a second dichroic mirror 126b, a third dichroic mirror 126c and the output module 96. The above with reference to Fig. The given description of the first light source module 92a, the second light source module 92b, the third light source module 92c and the output module 96 also applies to the corresponding elements in Fig. 7. Instead of the fiber optic cables 98a, 98b, 98c, 98d and the fiber optic coupler 94, the VGP 58 uses the one described in Fig. In the exemplary embodiment shown in Figure 7, the first dichroic mirror 126a, the second dichroic mirror 126b and the third dichroic mirror 126c are used to combine the narrow-beam light 110 from each of the first light source module 92a, the second light source module 92b and the third light source module 92c.

[0067] Within the scope of this disclosure, a dichroic mirror is a mirror that reflects light of a specific wavelength and transmits light of other wavelengths. In an exemplary embodiment, the first dichroic mirror 126a, the second dichroic mirror 126b, and the third dichroic mirror 126c comprise a substrate material (e.g., glass, quartz) coated with a plurality of dielectric layers. Each of the plurality of dielectric layers is selected to have a specific refractive index and thickness such that the first dichroic mirror 126a, the second dichroic mirror 126b, and the third dichroic mirror 126c reflect light of specific wavelengths and transmit light of other wavelengths.

[0068] In a non-restrictive example, the first light source module 92a generates narrow-beam light 110 with a wavelength of 380 nanometers. The second light source module 92b generates narrow-beam light 110 with a wavelength of 405 nanometers. The third light source module 92c generates narrow-beam light 110 with a wavelength of 460 nanometers. Accordingly, the first dichroic mirror 126a is configured to reflect narrow-beam light 110 with a wavelength of 380 nanometers and transmit all other wavelengths of light. The second dichroic mirror 126b is configured to reflect narrow-beam light 110 with a wavelength of 405 nanometers and transmit all other wavelengths of light. The third dichroic mirror 126c is configured to reflect narrow-beam light 110 with a wavelength of 460 nanometers and transmit all other wavelengths of light.It should be understood that the wavelengths mentioned above are only examples of their type.

[0069] The first dichroic mirror 126a is positioned such that the narrow-beam light 110 from the first light source module 92a, reflected by the first dichroic mirror 126a, falls onto the second dichroic mirror 126b. The second dichroic mirror 126b is positioned such that the narrow-beam light 110 from the second light source module 92b, reflected by the second dichroic mirror 126b, falls onto the third dichroic mirror 126c. The third dichroic mirror 126c is positioned such that the narrow-beam light 110 from the third light source module 92c, reflected by the third dichroic mirror 126c, falls onto the output module 96.In an exemplary embodiment, the first dichroic mirror 126a, the second dichroic mirror 126b and the third dichroic mirror 126c are arranged at an angle of 45 degrees to an angle of incidence of the narrow-beam light 110 and aligned along a central axis, as shown in . Fig. 7 is shown.

[0070] Therefore, the narrow-beam light 110 with a wavelength of 380 nanometers from the first light source module 92a is reflected by the first dichroic mirror 126a and falls onto the second dichroic mirror 126b, as indicated by the first line 128a. The narrow-beam light 110 with a wavelength of 380 nanometers from the first light source module 92a is transmitted by the second dichroic mirror 126b and falls onto the third dichroic mirror 126c, as indicated by the second line 128b. The narrow-beam light 110 with a wavelength of 405 nanometers from the second light source module 92b is reflected by the second dichroic mirror 126b and falls onto the third dichroic mirror 126c, as indicated by the second line 128b.Therefore, both the narrow-beam light 110 with a wavelength of 380 nanometers from the first light source module 92a and the narrow-beam light 110 with a wavelength of 405 nanometers from the second light source module 92b fall onto the third dichroic mirror 126c, as indicated by the second line 128b. The narrow-beam light 110 with a wavelength of 380 nanometers from the first light source module 92a and the narrow-beam light 110 with a wavelength of 405 nanometers from the second light source module 92b are transmitted by the third dichroic mirror 126c and fall onto the output module 96, as indicated by a third line 128c. The narrow-beam light 110 with a wavelength of 460 nanometers from the third light source module 92c is reflected by the third dichroic mirror 126c and falls on the output module 96, as indicated by the third line 128c.Therefore, the narrow-beam light 110 with a wavelength of 380 nanometers from the first light source module 92a, the narrow-beam light 110 with a wavelength of 405 nanometers from the second light source module 92b, and the narrow-beam light 110 with a wavelength of 460 nanometers from the third light source module 92c fall on the output module 96, as indicated by the third line 128c.

[0071] All the narrow-beam light (i.e., the narrow-beam light 110 with a wavelength of 380 nanometers from the first light source module 92a, the narrow-beam light 110 with a wavelength of 405 nanometers from the second light source module 92b, and the narrow-beam light 110 with a wavelength of 460 nanometers from the third light source module 92c) falling on the output module 96 is collimated by the optical collimator 118 and directed or steered by the optoelectric mirror 120 as described above.

[0072] Referring to Fig. The vehicle controller 34 includes a VGP engine 130. The VGP engine 130 has a programmable processor that is programmed to monitor various inputs and determine which information is suitable for display. The VGP engine 130 can communicate directly with various systems and components, or alternatively or additionally, it can communicate via a LAN / CAN system. The VGP engine 130 uses information relating to the operating environment of the vehicle 10, which is derived from a series of inputs. The various acquisition devices 40a-40n collect and provide information. The acquisition devices 40a-40n include a camera or image capture device that takes periodic or sequential images representing a view from inside the vehicle 10.The windscreen 56 is equipped with features that can display a projected image on it while remaining transparent or substantially transparent, so that occupants of the vehicle 10 can clearly see the external surroundings of the vehicle 10 through the windscreen 56.

[0073] The processor of the VGP Machine 130 comprises a non-transient computer-readable memory device or non-transient computer-readable storage media. The processor may be a custom-designed or commercially available processor, a central processing unit (CPU), a graphics processing unit (GPU), an auxiliary processor among several processors connected to the VGP Machine 130, a semiconductor-based microprocessor (in the form of a microchip or chipset), a macroprocessor, any combination thereof, or, more generally, any device for executing instructions. The computer-readable memory device or computer-readable storage media may include volatile and non-volatile memory, for example, in read-only or read-only memory (ROM), random-access memory (RAM), and keep-alive memory (KAM). KAM is a persistent orPersistent or non-volatile memory that can be used to store various operating variables while the processor is switched off or shut down. The computer-readable memory device or media can be implemented using a number of memory devices such as PROMs (programmable read-only memory), EPROMs (electrical PROMs), EEPROMs (electrically erasable PROMs), flash memory, or other electrical, magnetic, optical, or combined memory devices capable of storing data, some of which represent executable instructions used by the VGP Machine 130 to control various systems of the Vehicle 10. The VGP Machine 130 can also consist of multiple controllers electrically interconnected.The VGP machine 130 can be connected to additional systems and / or controllers of the vehicle 10, which allows the VGP machine 130 to access data such as speed, acceleration, braking and steering angle of the vehicle 10.

[0074] The VGP machine 130 is electrically connected to the plurality of detection devices 40a-40n via the vehicle controller 34. In one exemplary embodiment, the electrical communication or connection is established using, for example, a CAN network, a FLEXRAY network, a local area network (e.g., WiFi, Ethernet, and the like), a serial peripheral interface network (SPI), or the like. It should be understood that various additional wired and wireless techniques and communication protocols for communicating with the VGP machine 130 are within the scope of this disclosure.

[0075] Like the DLP 50, the VGP 58 projects light to excite the light-emitting material 90 (transparent phosphors) within the substrate 84 on the windshield 56 in a predetermined pattern to generate the second graphic image 60 on the windshield 56. In an exemplary embodiment, both the DLP 50 and the VGP 58 are arranged near the headliner of the vehicle 10. In a non-limiting example, the 380-nanometer light of the projected light 124 excites red transparent phosphors. The 405-nanometer light of the projected light 124 excites blue transparent phosphors. The 460-nanometer light of the projected light 124 excites green transparent phosphors. It should be understood that in some embodiments the transparent phosphors can also be excited by other wavelengths of the excitation light.Either the DLP 50 or the VGP 58 can be configured to generate any wavelength of excitation light required to excite the transparent phosphors.

[0076] In an exemplary embodiment, the vehicle controller 34 uses the system 11 to display graphics showing the states or conditions of the vehicle 10 and / or the environment around the vehicle 10, as detected by the plurality of sensing devices 40a-40n. In an exemplary embodiment, the vehicle controller 34 uses the DLP 50 to display the first graphic image 52, which may include two-dimensional and three-dimensional representations of the environment around the vehicle 10 or images with vehicle information or infotainment content superimposed on the occupant's view of the environment outside the vehicle 10. The DLP is capable of providing the first graphic image across the entire windshield 56. Furthermore, the vehicle controller 34 uses the VGP 58 to display the second graphic image 60, which provides warnings for reactions or rapid alerts.( : rapid response alerts) to critical safety conditions detected by the vehicle's sensor system 28 10. The VGP 58 is not capable of displaying three-dimensional graphic images; however, the VGP 58 can provide immediate and brighter alarm signals or warnings by providing augmented graphics such as highlighting a pedestrian or a point of interest. Referring to . Fig. 1. The second graphic image 60 can be displayed next to the first graphic image 52, such as the arrow intended to direct the driver's attention to the left. Alternatively, with reference to Fig. 8, the second graphic image 60, such as the highlighted box around the cyclist in Fig. 8, overlaid on the first graphic image 52.

[0077] Based on the output of the occupant monitoring system 78 and the input data, which tracks the location information in relation to the environment around the vehicle 10, the DLP machine 76 can accurately position the first graphic image 52 so that the occupant sees the first graphic image 52 superimposed with visual images through the windshield 56. Furthermore, the VGP machine 130 can accurately position the second graphic image 60 in relation to the first graphic image 52 so that the occupant sees the second graphic image 60 in the correct position near or superimposed on the first graphic image 52.

[0078] In another exemplary embodiment, the second graphic image includes at least one vehicle warning light. Vehicle warning lights can convey various types of information. One type of vehicle warning light illuminates or flashes to indicate a malfunction (e.g., oil pressure, engine temperature control, charging current, etc.), with the illumination and flashing indicating the transition from a warning to a malfunction indication. Another type illuminates to indicate the need for a specific service after a certain time has elapsed or a certain distance has been traveled (e.g., an oil change). The hybrid projector system 11 includes a calibration system suitable for checking and calibrating a displayed warning light projected into the second graphic image. Referring to Fig. 2. When a vehicle warning light is displayed, the vector graphics projector shows the second graphic image, including the vehicle warning light, in a position at the bottom of the windshield.

[0079] Referring to Fig. Figure 1 illustrates a reference calibration system 140, which generally includes a reference controller 142, a reference windscreen 144, a reference vector graphics projector 146 and a reference camera 148.

[0080] The reference controller 142 is used to implement a method 200 for calibrating a display for a vehicle, as described below. The reference controller 142 comprises at least one processor 150 and a non-transient computer-readable memory device or non-transient computer-readable memory media 152. The processor 150 may be a custom-designed or commercially available processor, a central processing unit (CPU), a graphics processing unit (GPU), an auxiliary processor among several processors connected to the reference controller 12, a semiconductor-based microprocessor (in the form of a microchip or chipset), a macroprocessor, a combination thereof, or generally, an instruction-executing device. The computer-readable memory device or computer-readable memory media 152 may be volatile and non-volatile memory in a read-only or non-transient state.The computer-readable memory (ROM), random-access memory (RAM), and keep-alive memory (KAM) may include read-only memory (ROM). KAM is persistent, permanent, or non-volatile memory that can be used to store various operating variables while the processor 150 is powered off or shut down. The computer-readable memory device or media 152 may be implemented using a variety of memory devices such as PROMs (programmable read-only memory), EPROMs (electrical PROMs), EEPROMs (electrically erasable PROMs), flash memory, or other electrical, magnetic, optical, or combined memory devices capable of storing data, some of which represent executable instructions used by the reference controller 142 to control the system 140.The reference controller 142 can also consist of several controllers that are electrically interconnected. In a non-restrictive example, the reference controller 142 comprises or is integrated into a computer system such as a server computer, a workstation computer, a personal computer, and / or the like.

[0081] The reference controller 142 is electrically connected to the reference vector graphics projector 146 and the reference camera 148. In one exemplary embodiment, the electrical communication or connection is established using, for example, a CAN network, a FLEXRAY network, a local area network (e.g., WiFi, Ethernet, and the like), a serial peripheral interface network (SPI), or the like. It should be understood that various additional wired and wireless techniques and communication protocols for communicating with the reference controller 142 are within the scope of this disclosure.

[0082] The reference windshield 144 is used to provide a reference projection surface for the system 140. In an exemplary embodiment, the reference windshield 144 is selected such that a plurality of variable properties of the reference windshield 144 lie within a predetermined range for each of the plurality of variable properties. Within the scope of this disclosure, the plurality of variable properties includes properties of the reference windshield 144 that can be affected by manufacturing variations, such as curvature, uniformity of glass thickness, quality of the glass surface, uniformity of the glass coating, and / or the like. In an exemplary embodiment, the predetermined range for each of the plurality of variable properties is determined based at least partially on a statistical analysis of a plurality of windshields.In a non-restrictive example, the predetermined range for each of the multitude of variable properties includes plus or minus one standard deviation from the mean value of each of the multitude of variable properties. Therefore, the reference windshield 144 is selected such that it represents a statistically accurate approximation of a typical windshield.

[0083] The reference windscreen 144 contains (not shown) transparent phosphors embedded within it. As described above with reference to the windscreen 56 of the vehicle 10, the transparent phosphors are light-emitting particles that fluoresce in response to excitation by the reference video graphics projector 146. In one exemplary embodiment, the transparent phosphors are red, green, and blue (RGB) phosphors. The use of monochromatic and / or bichromatic phosphors is also within the scope of this disclosure. When excitation light is absorbed by the transparent phosphors, visible light is emitted. The excitation light is provided by the reference video graphics projector 146.

[0084] The reference vector graphics projector 146 is used to excite the transparent phosphors in a predetermined pattern to generate the vector graphics on the reference windshield 144. In a first exemplary embodiment, the reference video graphics projector 146 is a violet / ultraviolet laser projector located near the headliner of the vehicle 10. In another exemplary embodiment, the reference video graphics projector 146 is an LED-based projector as discussed in U.S. Application No. 18 / 186,343, filed on March 20, 2023, entitled “GRAPHICS PROJECTOR FOR USE IN A VEHICLE,” the entirety of which is hereby incorporated by reference. The reference video graphics projector 146 is configured to selectively excite the red, green or blue transparent phosphors of the reference windscreen 144.The reference video graphics projector 146 has a projection field 154. Within the scope of this disclosure, the projection field 154 defines an area or region onto which the reference video graphics projector 146 can project. In a non-restrictive example, the projection field 154 is defined by a pixel width and a pixel height (e.g., 1920 x 1920 pixels).

[0085] The reference vector graphics projector 146 further comprises a reference vector graphics projector camera 156. The reference vector graphics projector camera 156 is a photo and / or video camera that views the reference windshield 144 from the perspective of the reference vector graphics projector 146. In an exemplary embodiment, the reference vector graphics projector camera 156 is integrated into the reference vector graphics projector 146, for example, by means of a lens adjacent to a projection lens of the reference vector graphics projector 146. The reference vector graphics projector 146 is fixedly mounted at a predetermined location or position and at a predetermined angle relative to the reference windshield 144, so that deviations due to the installation or assembly of the reference windshield 144 and the reference vector graphics projector 146 are excluded.The reference vector graphics projector 146 and the reference vector graphics projector camera 156 are electrically connected to the reference controller 142, as discussed in more detail above.

[0086] The reference camera 148 is used to capture images and / or videos of the reference windscreen 144. In an exemplary embodiment, the reference camera 148 is a photo and / or video camera positioned to view the reference windscreen 144. The reference camera 148 is fixedly mounted at a predetermined position and angle relative to the reference windscreen 144. In an exemplary embodiment, the predetermined position of the reference camera 148 is a reference position for the occupant's eye ellipses. Within the scope of this disclosure, a position for the occupant's eye ellipses represents a position and orientation of the eyes for a typical occupant while seated in a vehicle seat.Therefore, the reference position for the occupant's eye ellipses is a position relative to the reference windscreen 144 where the occupant's eye ellipse would be located if the occupant were seated in a vehicle seat at the same height, distance, orientation, and angle to the reference windscreen 414 as in a vehicle. Accordingly, the reference camera 148 is configured to view the reference windscreen 144 from the perspective of an occupant of a vehicle, as if the reference windscreen 144 were installed in that vehicle. It should be understood that cameras with various sensor types, such as CCD (charge-coupled device) sensors, CMOS (complementary metal oxide semiconductor) sensors, and / or HDR (high dynamic range) sensors, are within the scope of this disclosure.Furthermore, cameras with different lens types, including, for example, wide-angle and / or narrow-angle lenses, are also within the scope of this disclosure. The reference camera 148 is electrically connected to the reference controller 142, as discussed in more detail above.

[0087] The vehicle vector graphics projector 58 further comprises a vehicle vector graphics projector camera 158. The vehicle vector graphics projector camera 158 is a photo and / or video camera that views the vehicle windshield 56 from the perspective of the vehicle vector graphics projector 58. In an exemplary embodiment, the vehicle vector graphics projector camera 158 is integrated into the vehicle vector graphics projector 58, for example, with a lens next to a projection lens of the vehicle vector graphics projector 58. The vehicle vector graphics projector 58 and the vehicle vector graphics projector camera 158 are electrically connected to the vehicle controller 34, as discussed in more detail above.

[0088] In one exemplary embodiment, the vehicle controller 34 uses the vehicle vector graphics projector 58 to display secondary graphic images 60, including vehicle warning lights. In a non-limiting example, the vehicle vector graphics projector 58 is used as the primary instrument to display information such as vehicle speed, coolant temperature, fuel level, state of charge, and / or the like, as well as vehicle warning light information. In one exemplary embodiment, the secondary graphic images 60 are calibrated prior to display so that distortion of the secondary graphic images 60 caused by various properties is mitigated, as discussed in more detail below with reference to Method 200. The use of the vector graphics projector 58 to display graphics is described in U.S. Application No. 1, filed on May 20, 2022.: 17 / 749,464 entitled “HYBRID AUGMENTED REALITY HEAD-UP DISPLAY FOR CREATING AN EDGE-TO-EDGE AUGMENTED REALITY VIEW”, the entire contents of which are hereby incorporated by reference, are discussed in more detail.

[0089] Referring to Fig. 9 comprises a method 200 for displaying graphics with a hybrid projector system 11 for a head-up display in a vehicle, starting at block 202, the projection, with a digital light projector 50, of a first graphic image 52 onto an inner surface 54 of a windshield 56 of the vehicle 10 and, continuing to block 204, the projection, with a vector graphics projector 58, of a second graphic image 60 onto the inner surface 54 of the windshield 56 of the vehicle 10. Continuing to block 250, the method 200 comprises the checking and calibration, with a calibration system, of a displayed vehicle warning light within the second graphic image 60.

[0090] In an exemplary embodiment, the projection, with a digital light projector 50, of a first graphic image 52 onto an inner surface 54 of a windshield 56 of the vehicle 10 at block 202 further comprises, extending to block 206, the projection, with a light source 62, of an excitation light 64, extending to block 208, the focusing, with a converging lens 66, of the excitation light 64 from the light source 62, and, extending to block 210, the splitting, with a color filter 68, of the focused excitation light 64 into red, green and blue light, and, extending to block 212, the focusing, with a shaping lens 70, of the excitation light 64 passing through the color filter 68, and, extending to block 214, the deflection, with a digital micromirror device. (DMD) 72, of the excitation light 64 and, further to block 216, the reception, with a projection lens 74,of the excitation light 64 from the digital micromirror device 72 and, further to block 218, the projection, with the projection lens 74, of the excitation light 64 onto the inner surface 54 of the windshield 56.,

[0091] In an exemplary embodiment, projecting a second graphic image 60 onto the inner surface 54 of the windshield 56 of the vehicle 10 with a vector graphics projector 58, further comprising block 204, and extending to block 220, generating a source light 106 with an array 100 of light-emitting diodes (LEDs) of a light source module 92a, and, extending to block 222, receiving the source light 106 with an optical bandpass filter 102 of the light source module 92a in optical connection with the LED array 100, and, extending to block 224, filtering the source light 106 with the optical bandpass filter 102, and, extending to block 226, transmitting filtered light 108 with a wavelength within a transmission range of the optical bandpass filter 102 through the optical bandpass filter 102. Bandpass filter 102 and, continuing to block 228, the receiving,with a focusing lens 104 of the light source module 92a in optical connection with the optical filter 102, the filtered light 108 and, further to block 230, the transmission, with the focusing lens 104, of narrow-beam light 110 and, further to block 232, the reception, with an optical collimator 118 in optical connection with the light source module 92a, of the narrow-beam light 110 and, further to block 234, the transmission, with the optical collimator 118, of collimated light 122 and, further to block 236, the direction, with an optoelectric mirror 120 in optical connection with the optical collimator 118, of the collimated light 122 to form a graphic.

[0092] In another exemplary embodiment, projecting a second graphic image 60 onto the inner surface 54 of the windshield 56 of the vehicle 10 at block 202 with a vector graphics projector 58 further comprises projecting a second graphic image 60 onto the inner surface 54 of the windshield 56 of the vehicle 10 with a plurality of light source modules 92a, 92b, 92c in optical connection with the optical collimator 118 of the vector graphics projector 58.

[0093] In another exemplary embodiment, the transmission of a narrow-beam light at block 230 by means of the focusing lens further comprises the transmission, by means of a fiber optic cable waveguide 98a, 98b, 98c, 98d in optical connection with the plurality of light source modules 92a, 92b, 92c and the optical collimator 118, of the narrow-beam light 110 from each of the plurality of light source modules 92a, 92b, 92c to the optical collimator 118.

[0094] In another exemplary embodiment, the transmission of a narrow-beam light 110 at block 230 by means of the focusing lens 104 further comprises the transmission of the narrow-beam light 110 from each of the plurality of light source modules 92a, 92b, 92c to the optical collimator 118 by means of a plurality of dichroic mirrors 126a, 126b, 126c, wherein each of the plurality of dichroic mirrors 126a, 126b, 126c is in optical communication with one of the plurality of light source modules 92a, 92b, 92c, by means of a plurality of dichroic mirrors 126a, 126b, 126c, wherein each of the plurality of light source modules 92a, 92b, 92c is in optical communication with one of the plurality of light source modules 92a, 92b, 92c, by means of a plurality of dichroic mirrors 126a, 126b, 126c, wherein each of the plurality of dichroic mirrors 126a, 126b, 126c is configured to reflect a predetermined wavelength of the narrow-beam light 110 and to transmit all other wavelengths of the narrow-beam light 110.

[0095] In another exemplary embodiment, the transmission of a narrow-beam light 110 at block 230 by means of the focusing lens 104 further comprises the transmission of a narrow-beam light 110 with a wavelength of 380 nanometers by means of the focusing lens 104 of a first of the plurality of light source modules 92a, the transmission of a narrow-beam light 110 with a wavelength of 405 nanometers by means of the focusing lens 104 of a second of the plurality of light source modules 92b, and the transmission of a narrow-beam light 110 with a wavelength of 460 nanometers by means of the focusing lens 104 of a third of the plurality of light source modules 92c.

[0096] In an exemplary embodiment, the testing and calibration, with a calibration system 140, of a displayed vehicle warning light within the second graphic image 60 at block 250 further comprises, continuing to block 252, the use of the calibration system 140 to calculate at least one reference calibration matrix, as discussed in more detail below. After block 252, the method 200 continues to block 254. In block 254, the system 11 is used to calculate a vehicle vector graphic calibration matrix, which is discussed in more detail below. After block 254, the method 200 continues to block 256.

[0097] In Block 256, System 11 is used to display a graphic based at least partially on the vehicle vector graphics calibration matrix calculated in Block 254. In an exemplary embodiment, the vehicle controller 34 identifies an object of interest, as discussed above, and determines a graphic for display using the vector graphics projector 58. In a non-restrictive example, the object of interest is an obstacle on a roadway in the vicinity of the vehicle 10, and the graphic is an animated warning display containing several video still images, or video frames, displayed sequentially. To display each frame of the animated warning display, the vehicle controller 34 applies the vehicle vector graphics calibration matrix calculated in Block 254 to each frame of the animated warning display.In a non-restrictive example, to apply the vehicle TWD calibration matrix, the vehicle controller 34 adds the vehicle vector graphics calibration matrix to a matrix that defines each individual image or frame of the animated warning display before each frame of the animated warning display is projected using the vehicle vector graphics projector 58. Therefore, each frame of the animated warning display is compensated for distortion. After block 256, the procedure 200 continues to enter a standby or ready state in block 258. It should be understood that the procedure 200 can be repeated for additional areas (i.e., additional projection fields 154) of the reference windscreen 144 and / or the vehicle windscreen 56 to compensate for and display graphics across an entire windscreen surface.

[0098] It should be understood that the method 200 can periodically exit the ready state 258 and repeat some or all of the method steps. In an exemplary embodiment, the method 200 comprises a first re-entry point 260 and a second re-entry point 262, from which the method 200 can start under certain conditions. In an exemplary embodiment, the first re-entry point 260 is used if parts of the system 11 are replaced or exchanged. In a non-limiting example, if the vehicle windshield 56 and / or the vehicle vector graphics projector 58 are replaced, it is necessary to recalculate the vehicle vector graphics calibration matrix in block 254. Therefore, the first re-entry point 260 of the method 200 is used.For example, the procedure 200 can be initiated by a service technician after replacing the vehicle windshield 56 and / or the vehicle vector graphics projector 58, so that it starts at the first re-entry point 260. In an exemplary embodiment, the second re-entry point 262 is used during normal operation of the system 11 to display compensated graphics. In a non-restrictive example, the procedure 200 exits the standby state 258 and re-enters the procedure 200 at the second re-entry point 262 via a timer, for example, every three hundred milliseconds.

[0099] Referring to Fig. Figure 11 presents a flowchart of an exemplary embodiment of Block 252. Referring also to Fig. Figure 13A shows a first exemplary view of the projection field 154 of the system 11. The exemplary embodiment of block 252 begins with block 300. In block 300, the reference controller 142 uses the reference vector graphics projector 146 to project a reference graphic 160 onto the reference windscreen 144. Within the scope of this disclosure, the reference graphic 160 comprises a plurality of projected points 162 arranged in a uniform two-dimensional array or grid (i.e., the distance between each point and the surrounding points is uniform). Each of the plurality of projected points 162 has an intended x-coordinate and an intended y-coordinate defined relative to the projection field 154. The reference graphic 160 is represented as an intended reference graphic matrix.Within the scope of the present disclosure, the intended reference graphics matrix is ​​a two-dimensional matrix with a plurality of elements. Each of the plurality of elements of the intended reference graphics matrix defines a position of one of the plurality of projected points 162 by storing the intended x-coordinate and the intended y-coordinate of that one of the plurality of projected points 162. For the in . Fig. The exemplary reference graphic 160 shown in 12A is the intended reference graphic matrix: I=[x1,y1⋯x9,y1⋮⋮x1,y7⋯x9,y7] where I is the intended reference graphic matrix, x n the intended x-coordinate of one of the plurality of projected points 162 that lie in a column n of the intended reference graphic matrix, and y mThe intended y-coordinate is one of the plurality of projected points 162 that lies in a row m of the intended reference graphic matrix. It should be understood that the reference graphic 160 can have any number of points and the intended reference graphic matrix can have any number of rows and / or columns without deviating from the scope of the present disclosure. Following Block 300, the exemplary embodiment of Block 252 continues to Block 302.

[0100] In block 302, the reference controller 142 uses the reference camera 148 to acquire a first reference image 164 of the reference graphic 160 on the reference windshield 144. Due to manufacturing variations (e.g., variations in curvature, uniformity of glass thickness, variations in glass surface quality, uniformity of glass coating, and / or the like) of the reference windshield 144, the reference graphic 160 appears distorted in the first reference image 164. In other words, the position of each of the multitude of projected points 162 of the reference graphic 160 does not correspond to the position of each of the multitude of perceived points 166 in the first reference image 164, as shown in Fig. Figure 13A is shown. Within the scope of this disclosure, perceived points 166 refer to points as perceived by the reference camera 148, the reference vector graphics camera 156, or the vehicle vector graphics camera 158. According to Block 302, the exemplary embodiment of Block 252 continues to Block 304.

[0101] In block 304, the reference controller 142 identifies the plurality of perceived points 166 in the first reference image 164, which was captured in block 302. In an exemplary embodiment, the reference controller 142 uses a computer vision algorithm to identify the plurality of perceived points 166 in the first reference image 164. Within the scope of the present disclosure, identifying the plurality of perceived points 166 means that the reference controller 142 isolates the plurality of perceived points 166 from other elements in the first reference image 164 (e.g., background objects, dust particles, camera artifacts, and / or the like) so that a position of each of the plurality of perceived points 166 can be determined, as discussed below.In an exemplary embodiment, the computer vision algorithm is trained by providing it with a multitude of images containing points in various positions and angles. After sufficient training of the computer vision algorithm, the reference controller 142 can identify the multitude of perceived points 166 in the first reference image 164 with a high degree of accuracy and precision. After identifying the multitude of perceived points 166 in the first reference image 164, the reference controller 142 determines an actual x-coordinate and an actual y-coordinate of each of the multitude of perceived points 166 in the first reference image 164.In an exemplary embodiment, the actual coordinates of each of the plurality of perceived points 166 in the first reference image 164 are identified by performing pixel measurements at each of the plurality of perceived points 166 relative to the projection field 154 in the first reference image 164. Following block 304, the exemplary embodiment proceeds from block 252 to block 306.

[0102] In Block 306, the reference controller 142 generates an actual reference graphics matrix. Within the scope of the present disclosure, the actual reference graphics matrix contains the actual x-coordinate and the actual y-coordinate of each of the plurality of perceived points 66 in the first reference image 164, as determined in Block 304. Following Block 306, the exemplary embodiment of Block 252 proceeds to Block 308.

[0103] In block 308, the reference controller 142 calculates a reference camera deviation matrix. Within the scope of this disclosure, the reference camera deviation matrix encodes differences between the reference graphic 160 and the first reference image 164. In an exemplary embodiment, to calculate the reference camera deviation matrix, the actual reference graphic matrix generated in block 306 is subtracted from the intended reference graphic matrix. After block 308, the exemplary embodiment proceeds from block 252 to block 310.

[0104] In block 310, the reference controller 142 generates a deviation-compensated reference graphics matrix by summing the intended reference graphics matrix with the reference camera deviation matrix determined in block 308. Following block 310, the exemplary embodiment of block 252 continues to block 312.

[0105] Referring to Fig. Figure 12B shows a second exemplary view of the projection field 154 of system 11. With continued reference to Fig. 11, Fig. 12A and Fig. In block 312, the reference controller 142 uses the reference vector graphics projector 146 to project a deviation-compensated reference graphic 168 onto the reference windscreen 144. The position of each of the plurality of projected points 162 of the deviation-compensated reference graphic is defined by the deviation-compensated reference graphic matrix generated in block 310. Following block 312, the exemplary embodiment of block 252 continues to block 314.

[0106] In block 314, the reference controller 14 uses the reference vector graphics projector camera 156 to capture a second reference image 170 of the deviation-compensated reference graphic 168 on the reference windscreen 144. Due to the predetermined position and angle of the reference vector graphics projector camera 156 relative to the reference windscreen 144, the deviation-compensated reference graphic 168 appears distorted in the second reference image 170. In other words, the position of each of the plurality of projected points 162 of the deviation-compensated reference graphic 168 does not correspond to the position of each of the plurality of perceived points 166 in the second reference image 170, as shown in Fig. 13B is shown. After block 314, the exemplary embodiment of block 252 continues to block 316.

[0107] In block 316, the reference controller 142 identifies the plurality of perceived points 166 in the second reference image 170, which was recorded in block 314. In an exemplary embodiment, the reference controller 142 uses a computer vision algorithm to identify the plurality of perceived points 166 in the second reference image 170. Within the scope of the present disclosure, identifying the plurality of perceived points 166 means that the reference controller 142 isolates the plurality of perceived points 166 from other elements in the second reference image 170 (e.g., background objects, dust particles, camera artifacts, and / or the like) so that a position of each of the plurality of perceived points 166 can be determined, as discussed below.In an exemplary embodiment, the computer vision algorithm is trained by providing it with a multitude of images containing points in various positions and angles. After sufficient training of the computer vision algorithm, the reference controller 142 can identify the multitude of perceived points 166 in the second reference image 170 with a high degree of accuracy and precision. After identifying the multitude of perceived points 166 in the second reference image 170, the reference controller 142 determines an actual x-coordinate and an actual y-coordinate of each of the multitude of perceived points 166 in the second reference image 170.In an exemplary embodiment, the actual coordinates of each of the plurality of perceived points 166 in the second reference image 170 are identified by performing pixel measurements at each of the plurality of perceived points 166 relative to the projection field 154 in the second reference image 170. Following Block 316, the exemplary embodiment proceeds from Block 252 to Block 318.

[0108] In Block 318, the reference controller 142 generates a reference vector graphics projector camera matrix. Within the scope of the present disclosure, the reference vector graphics projector camera matrix contains the actual x-coordinate and the actual y-coordinate of each of the plurality of perceived points 166 in the second reference image 170, as determined in Block 316. The reference vector graphics projector camera matrix is ​​also referred to as a type of reference calibration matrix. Following Block 318, the exemplary embodiment of Block 252 proceeds to Block 320.

[0109] In Block 320, the reference controller 142 determines a reference vector graphics projector camera transformation matrix. Within the scope of this disclosure, the reference vector graphics projector camera transformation matrix defines a perspective transformation between the perspective of the reference camera 148 and the perspective of the reference vector graphics projector camera 156. The reference vector graphics projector camera transformation matrix is ​​also referred to as a type of reference calibration matrix. In an exemplary embodiment, to determine the reference vector graphics projector camera transformation matrix, the reference vector graphics projector camera matrix determined in Block 318 is subtracted from the reference camera deviation matrix determined in Block 308. After Block 320, the exemplary embodiment of Block 252 is completed, and Method 200 continues as described above.

[0110] Referring to Fig. Figure 13 shows a flowchart of an exemplary embodiment of Block 254. The exemplary embodiment of Block 254 begins in Block 402. In Block 402, the vehicle controller 34 uses the vehicle vector graphics projector 58 to project the reference graphic 160 onto the vehicle windshield 56. After Block 402, the exemplary embodiment of Block 254 continues to Block 404.

[0111] In block 404, the vehicle controller 34 uses the vehicle vector graphics projector camera 158 to capture a calibration image of the reference graphic 160 on the vehicle windshield 56. Due to manufacturing variations (e.g., curvature variations, variations in glass thickness uniformity, variations in glass surface quality, variations in glass coating uniformity, and / or the like) of the vehicle windshield 56, as well as the position and angle of the vehicle vector graphics projector 58 relative to the vehicle windshield 56, the reference graphic 160 appears distorted in the calibration image. The calibration image is essentially similar to the second reference image 170, which was described above with reference to Fig.13B was discussed. However, the distortion of the reference graphic 160 in the calibration image may differ from the distortion of the reference graphic 160 in the second reference image 170 due to differing manufacturing variations between the reference windscreen 144 and the vehicle windscreen 56. Furthermore, mounting variations (i.e., position and angle) of the vehicle windscreen 56 and the vehicle vector graphics projector 58 relative to the position and angle of the reference windscreen 144 and the reference vector graphics projector 146 may also introduce distortions that are not present in the second reference image 170. Following Block 404, the exemplary embodiment of Block 254 continues to Block 406.

[0112] In block 406, the vehicle controller 34 identifies a plurality of perceived points in the calibration image recorded in block 404. Within the scope of this disclosure, identifying the plurality of perceived points means that the vehicle controller 34 isolates the plurality of perceived points from other elements in the calibration image (e.g., background objects, dust particles, camera artifacts, and / or the like) so that a position of each of the plurality of perceived points can be determined, as discussed below. In an exemplary embodiment, the vehicle controller 34 uses a computer vision algorithm to identify the plurality of perceived points in the calibration image.In an exemplary embodiment, the computer vision algorithm is trained by providing it with a multitude of images containing points in various positions and angles. After sufficient training of the computer vision algorithm, the vehicle controller 34 can identify the multitude of perceived points in the calibration image with a high degree of accuracy and precision. After identifying the multitude of perceived points in the calibration image, the vehicle controller 34 determines an actual x-coordinate and an actual y-coordinate of each of the multitude of perceived points in the calibration image.In an exemplary embodiment, the actual coordinates of each of the plurality of perceived points in the calibration image are identified by performing pixel measurements at each of the plurality of perceived points relative to the projection field 26 in the calibration image. Following Block 406, the exemplary embodiment continues from Block 254 to Block 408.

[0113] In Block 408, the vehicle controller 34 generates an actual vehicle vector graphics matrix. Within the scope of the present disclosure, the actual vehicle vector graphics matrix contains the actual x-coordinate and the actual y-coordinate of each of the plurality of perceived points in the calibration image, as determined in Block 406. Following Block 408, the exemplary embodiment of Block 254 continues to Block 410.

[0114] In block 410, the vehicle controller 34 computes a vehicle vector graphics deviation matrix. Within the scope of this disclosure, the vehicle vector graphics deviation matrix encodes differences between the reference graphic 160 and the calibration image from the perspective of the vehicle vector graphics projector camera 158. In an exemplary embodiment, to compute the vehicle vector graphics deviation matrix, the actual vehicle vector graphics matrix generated in block 408 is subtracted from the reference vector graphics camera matrix generated in block 318. After block 410, the exemplary embodiment proceeds from block 254 to block 412.

[0115] In Block 412, the vehicle controller 34 computes the vehicle vector graphics calibration matrix. Within the scope of this disclosure, the vehicle vector graphics calibration matrix is ​​a two-dimensional matrix which, when added to a graphic-defining matrix, compensates for distortions introduced by manufacturing and assembly variations of the vehicle windscreen 56 and the vehicle vector graphics projector 58. Therefore, the compensated graphic does not appear distorted to an occupant from the perspective of an occupant of the vehicle 10. In an exemplary embodiment, to compute the vehicle vector graphics calibration matrix, the vehicle vector graphics deviation matrix computed in Block 410 is subtracted from the reference vector graphics camera transformation matrix computed in Block 320. After Block 412, the exemplary embodiment of Block 254 is completed, and Method 200 continues as discussed above.

[0116] It should be understood that the vehicle TWD calibration matrix can be extended (e.g., using mathematical interpolation and / or extrapolation) to include values ​​corresponding to each pixel of the projection field 154, without deviating from the scope of this disclosure. Furthermore, it should be understood that System 11 and Calibration System 140 can be used together, and that a system for calibrating a display for a vehicle can, of course, include both.

[0117] System 11 and Method 200 of this disclosure offer several advantages. Using the reference calibration system 140 and Method 200, the reference calibration matrices can be generated in a test environment and applied to System 11 during vehicle production. The application of Method 200 thus eliminates the need for complex and / or time-consuming calibration of System 11 during vehicle production and enables automatic self-calibration of System 11. Furthermore, the use of Method 200 allows a service technician to recalibrate System 11 without the need for special tools or equipment.Furthermore, System 11 enables the self-testing and self-calibration of secondary graphic images projected by the vector graphics projector 58, such as vehicle warning lights, thus ensuring the proper display of such warning lights. Using the vector graphics projector 58 with a variety of light source modules 92a, 92b, 92c, each of the variety of light source modules 92a, 92b, 92c can be individually configured to achieve a desired output characteristic or property (e.g., intensity, wavelength, and the like). Moreover, each of the variety of light source modules 92a, 92b, 92c can be adjusted by means of the VGP machine 130 to adapt or adjust the intensity and wavelength composition of the projected light 124 during a projection, enabling precise control of the excitation of the transparent phosphors.Moreover, the excitation of the transparent phosphors is achieved by diffuse light sources (i.e., the LED array), which reduces costs and complexity and avoids potential drawbacks of high-power, concentrated light sources such as the light source 62 of the DLP 50. These features of the vector graphics projector 58 enable an instantaneous response to quickly display vehicle warning lights that are brighter than would be possible with digital light processing projectors, thus ensuring that the vehicle occupants' attention is drawn to the displayed warning lights.

[0118] The description of the present revelation is by its very nature merely exemplary, and variations that do not deviate from the core of the present revelation are to be considered within the scope of the present revelation. Such variations are not to be regarded as a deviation from the spirit and scope of the present revelation. QUOTES INCLUDED IN THE DESCRIPTION

[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature

[0000] US 17 / 749,464 [0046, 0088] US 18 / 186,343

[0084]

Claims

[1] A system for a head-up display in a vehicle, comprising: a vehicle vector graphics projector adapted to project a second graphic image onto the interior surface of the windshield of the vehicle, the second graphic image having a greater brightness than the first graphic image and including at least one vehicle indicator light; and a calibration system suitable for testing and calibrating a displayed indicator light within the second graphic image. [2] The system of claim 1, wherein the calibration system includes a reference calibration system comprising: a reference windshield; a reference vector graphics projector, the reference vector graphics projector including a reference vector graphics projector camera; a reference camera; and a reference controller in electrical communication with the reference vector graphics projector and the reference camera, the reference controller being programmed to: using the reference vector graphics projector, project a reference graphic onto the reference windshield, the reference graphic being a vehicle warning light and including a plurality of projected points arranged in a two-dimensional array, and wherein an intended x-coordinate and an intended y-coordinate of each of the plurality of projected points is defined by an intended reference graphics matrix; takes a first reference image of the reference graphic using the reference camera; and at least one reference calibration matrix is ​​calculated based at least in part on the first reference image of the reference graphic. [3] The system of claim 2, wherein when calculating the at least one reference calibration matrix, the reference controller is further programmed to: a reference camera deviation matrix is ​​determined, wherein the reference camera deviation matrix encodes deviations in the reference graphic due to properties of the reference windshield; and a reference vector graphics projector-camera transformation matrix is ​​determined based at least in part on the reference camera deviation matrix. [4] The system of claim 3, wherein when determining the reference camera deviation matrix, the reference controller is further programmed to: a plurality of perceived points of the reference graphic are identified in the first reference image; determining an actual x-coordinate and an actual y-coordinate of each of the plurality of perceived points of the reference graphic in the first reference image; generates an actual reference graphics matrix, each element of the actual reference graphics matrix containing the actual x-coordinate and the actual y-coordinate of one of the plurality of perceived points of the reference graphics in the first reference image; and the reference camera deviation matrix is ​​calculated by subtracting the actual reference graphics matrix from the intended reference graphics matrix. [5] The system of claim 4, wherein when determining the reference vector graphics projector-camera transformation matrix, the reference controller is further programmed to: a deviation-compensated reference graphics matrix is ​​generated by summing the intended reference graphics matrix and the reference camera deviation matrix; using the reference vector graphics projector, projecting a deviation-compensated reference graphic onto the reference windshield, wherein a position of each of a plurality of projected points of the deviation-compensated reference graphic is defined by the deviation-compensated reference graphic matrix; takes a second reference image of the deviation-compensated reference graphic using the reference vector graphics projector camera; identifies a plurality of perceived points of the deviation-compensated reference graphic in the second reference image; determining an actual x-coordinate and an actual y-coordinate of each of the plurality of perceived points of the deviation-compensated reference graphic in the second reference image; generates a reference vector graphics projector-camera matrix, each element of the reference vector graphics projector-camera matrix containing the actual x-coordinate and the actual y-coordinate of one of the plurality of perceived points of the deviation-compensated reference graphic in the second reference image; and the reference vector graphics projector-camera transformation matrix is ​​determined by subtracting the reference vector graphics projector-camera matrix from the reference camera deviation matrix. [6] System according to claim 5, wherein: the vehicle vector graphics projector includes a vehicle vector graphics projector camera; and the hybrid projector system includes a vehicle controller in electrical communication with the vehicle vector graphics projector, the vehicle controller being programmed to: the reference graphic is projected onto the windshield of the vehicle using the vehicle vector graphics projector; captures a calibration image of the reference graphic using the vehicle vector graphics projector camera; calculates a vehicle vector graphics projector calibration matrix based at least in part on the at least one reference calibration matrix and the calibration image of the reference graphics; and applies the vehicle vector graphics projector calibration matrix to each frame projected with the vehicle vector graphics projector. [7] The system of claim 6, wherein when calculating the vehicle vector graphics projector calibration matrix, the vehicle controller is further programmed to: determining a vehicle vector graphics projector deviation matrix based at least in part on the at least one reference calibration matrix and the calibration image of the reference graphics; and the vehicle vector graphics projector calibration matrix is ​​calculated by subtracting the vehicle vector graphics projector deviation matrix from the reference TWD camera transformation matrix. [8] The system of claim 7, wherein when determining the vehicle vector graphics projector deviation matrix, the vehicle controller is further programmed to: identifies a plurality of perceived points of the reference graphic in the calibration image; determining an actual x-coordinate and an actual y-coordinate of each of the plurality of perceived points of the reference graphic in the calibration image; generates an actual vehicle vector graphics projector matrix, each element of the actual vehicle vector graphics projector matrix containing the actual x-coordinate and the actual y-coordinate of one of the plurality of perceived points of the reference graphic in the calibration image; and the vehicle vector graphics projector deviation matrix is ​​calculated by subtracting the actual vehicle vector graphics projector matrix from the reference vector graphics projector camera matrix. [9] The system of claim 1, wherein the reference camera is fixedly mounted at a reference position for the occupant's eye ellipses, and wherein the reference position for the occupant's eye ellipses is a predetermined position in space relative to the reference windshield. [10] The system of claim 1, wherein the vehicle vector graphics projector includes: a light source module comprising: an array of light-emitting diodes (LEDs) configured to produce a source light; an optical filter in optical communication with the LED array, the optical filter configured to receive the source light and transmit a filtered light; and a focusing lens in optical communication with the optical filter, the focusing lens configured to receive the filtered light and transmit a narrow beam of light; an optical collimator in optical communication with the light source module, the optical collimator configured to receive the narrow beam light and transmit a collimated light; and an optoelectric mirror in optical communication with the optical collimator, the optoelectric mirror configured to direct the collimated light to form a graphic.

Images