Optical display device, display system, vehicle, and color adjustment method
The optical display device addresses color cast and brightness issues by detecting and adjusting light weights in multiple colors, enhancing image quality without additional structure, suitable for various display systems and vehicles.
Patent Information
- Application Number
- JP2024525499
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-10-29
- Filing Date
- 2022-09-08
- Publication Date
- 2026-01-07
- Estimated Expiration
- 2042-09-08
AI Technical Summary
Environmental differences cause color casts and brightness attenuation in images displayed by optical display devices, particularly in complex vehicle environments, necessitating a solution to reduce these issues.
An optical display device with a light source module, light splitting module, and sensing module that detects color information to adjust the weights of multiple light colors, allowing for color correction without increasing the optical structure, using components like dichroic mirrors and polarizing beam splitters to split and modulate light paths.
Effectively reduces color cast in displayed images by adjusting light weights based on detected color information, improving image quality and compatibility with existing modules.
Smart Images

Figure 0007795623000008 
Figure 0007795623000009 
Figure 0007795623000010
Abstract
Description
[Technical Field]
[0001] The present application relates to the field of image display technology, and in particular to optical display devices, display systems, vehicles, and color adjustment methods. [Background technology]
[0002] With the continuous development of technology, increasingly higher requirements are being placed on the convenience and safety of vehicle use. For example, the widespread application of head-up display (HUD) (also called head-up display) systems can improve vehicle safety. A head-up display system projects driving-related information (such as instrument information and navigation information) into the driver's forward field of vision. The driver can view the instrument information and navigation information in front of their field of vision, eliminating the need to look down at the dashboard or central control display screen below the steering wheel, thereby increasing braking response time in an emergency and improving driving safety.
[0003] Vehicles operate in complex environments. For example, different seasons can result in humid spring environments, hot and stormy summer environments, strong autumn winds, and cold, snowy winter environments. All of these can affect the components within a HUD to some extent. Therefore, the HUD needs to set a specific operating mode based on the specific environment. In this case, the image (also called a picture) displayed by the optical display (also called an optics) within the HUD can be set to a specific brightness and color (which can be represented by color coordinates). However, environmental differences can cause color casts, brightness attenuation, and the like in the image displayed by the optical display. A color cast means that the color of the displayed actual image is clearly different from the color of the actual image.
[0004] In conclusion, how to reduce the color cast of images displayed by optical display devices is an urgent technical problem that currently needs to be solved. Summary of the Invention [Means for solving the problem]
[0005] The present application provides an optical display device, a display system, a vehicle, and a color adjustment method for reducing color cast in images displayed by the optical display device.
[0006] According to a first aspect, the present application provides an optical display device. The optical display device includes a light source module, a light splitting module, a modulation module, and a sensing module. The light source module is configured to emit (output) light. The light is combined with at least two colors of light. The light splitting module is configured to split the light from the light source module into a first light path and a second light path, and propagate the first light path to the sensing module and the second light path to the modulation module. The modulation module is configured to modulate the second light path to obtain image light carrying image information. The sensing module is configured to obtain color information of the first light path. The color information is used by the light source module to adjust the weights of the at least two colors of light. The modules may be referred to as components or modules, for example, a light source component, a light source module, a modulation component, and a modulation module.
[0007] Based on this solution, color information of the light currently emitted by the light source module can be detected by the sensing module, i.e., the first optical path can be used as color calibration of the light emitted by the light source module. Furthermore, based on the color information detected by the sensing module based on the first optical path, the weights of the at least two colors of light of the composite light are adjusted, so that color correction of the image light can be performed without increasing the optical structure, which is helpful to reduce color cast (also called chromatic aberration) of the image displayed by the optical display device.
[0008] For example, the following shows three possible solutions for adjusting the weights of at least two colors of light based on color information:
[0009] Embodiment 1: The light source module adjusts the weights of at least two colors of light based on color information. In one possible implementation, the light source module includes a processing component and a light-emitting component. The processing component is configured to receive color information from the sensing module, generate a control signal for adjusting weights of the at least two colors of light based on the color information, and send the control signal to the light-emitting component. The light-emitting component is configured to adjust the weights of the at least two colors of light based on the control signal.
[0010] According to the first embodiment, the processing component in the light source module may control the light-emitting component to adjust the weight of light of each color of the composite light based on the color information obtained from the sensing module, so as to reduce the color cast of the image formed based on the light as much as possible. Also, since the sensing module is configured to mainly detect the color information of the first optical path, the structure and operation logic of the existing sensing module do not need to be changed, so that the existing sensing module is compatible.
[0011] Further, optionally, the processing component is particularly configured to determine color coordinates of the image light based on the received color information, and to generate a control signal if a difference between the color coordinates of the image light and the predetermined target color coordinates is greater than a threshold value.
[0012] The control signal is generated when the difference between the color coordinates of the image light and the preset target color coordinates is greater than a threshold value, so that the light weights of each color of the composite light are avoided from being adjusted frequently, thereby reducing the amount of operation of the processing components.
[0013] Embodiment 2: The sensing module controls the light source module to adjust the weights of at least two colors of light based on color information. In one possible embodiment, the sensing module is configured to obtain color information of the first light path, generate a control signal based on the color information, and send the control signal to the light source module to adjust the weights of the at least two colors of light.
[0014] According to the second embodiment, the light source module can be controlled by the sensing module to adjust the weight of at least two colors of light. The structure and operation logic of the existing light source module do not need to be changed, so the existing light source module is compatible.
[0015] Embodiment 3: A processing component (sometimes referred to herein as a processing module) independent of the light source module and the sensing module may control the light source module to adjust the weights of at least two colors of light based on color information. In one possible embodiment, the optical display device further includes a processing module configured to receive the color information from the sensing module, generate a control signal based on the color information, and send the control signal to the light source module, where the control signal is for adjusting the weights of the at least two colors of light.
[0016] According to the third embodiment, if the existing sensing module and the light source module are compatible, the light source module can be controlled by the processing module to adjust the weights of the at least two colors of light. The processing component can be a processor.
[0017] In the above-mentioned embodiment 1, embodiment 2, and embodiment 3, the light source module may be configured to adjust the weights of the at least two colors of light based on the received control signal.
[0018] Further, optionally, the control signal may include a current weight for the light source corresponding to each color of light. It should be understood that a light source corresponding to one color of light refers to a light source that emits light of that color.
[0019] In one possible implementation, the light emitting components in the light source module include a first light source, a second light source, and a third light source.
[0020] Furthermore, the first light source is configured to emit red light, the second light source is configured to emit blue light, and the third light source is configured to emit green light, and the weights of the red light, green light, and blue light can be adjusted by controlling the weights of the currents input to the first light source, the second light source, and the third light source.
[0021] Furthermore, optionally, the light source module may further include a first dichroic mirror and a second dichroic mirror. The first dichroic mirror is configured to reflect blue light from the second light source and transmit green light from the third light source. The second dichroic mirror is configured to reflect red light from the first light source, transmit green light transmitted by the first dichroic mirror, and transmit blue light reflected by the first dichroic mirror. The dichroic mirror may also be called a dichromic mirror or a light-combining mirror.
[0022] Based on the first dichroic mirror and the second dichroic mirror, the third light source for emitting green light can be positioned farthest from the light splitting module. In this way, the brightness of the image can be balanced as much as possible. Green light has the greatest impact on the brightness of the image. The third light source is positioned farthest from the light splitting module, so that the impacts of red light, green light, and blue light on the brightness of the image can be balanced as much as possible.
[0023] In one possible embodiment, the light splitting module includes a polarizing beam splitter configured to split light from the light source module into a first polarization and a second polarization, and propagate the first polarization to the sensing module and the second polarization to the modulation module, where it is understood that the first polarization and the second polarization have different polarization states but match in color information, etc.
[0024] Furthermore, the first polarization is P polarization and the second polarization is S polarization, or the first polarization is S polarization and the second polarization is P polarization.
[0025] The light from the light source module can be split into a first polarization and a second polarization by a polarizing beam splitter. Furthermore, the first polarization emitted into the sensing module can be S-polarized, and correspondingly, the second polarization emitted into the modulation module can be P-polarized, or the first polarization emitted into the sensing module can also be P-polarized, and correspondingly, the second polarization emitted into the modulation module is S-polarized.
[0026] In another possible embodiment, the light dividing module includes a semi-transmissive reflector (e.g., a semi-transmissive semi-reflective portion), and the first light path is light transmitted from the semi-transmissive reflector and the second light path is light reflected from the semi-transmissive reflector, or the first light path is light reflected from the semi-transmissive reflector and the second light path is light transmitted from the semi-transmissive reflector.
[0027] The light from the light source module may be split into a first optical path and a second optical path by the semi-transmissive reflector, and the polarization states of the two optical paths may be the same.
[0028] Furthermore, optionally, when the light splitting module is a transflector, the light source module may further include a polarizer, or the optical display device may further include a polarizer.
[0029] In one possible embodiment, the optical display device may further include an optical lens, which is configured to project the image light output by the modulation module into a spatial domain.
[0030] The image light output by the modulation module may be shaped and / or homogenized by an optical lens to help improve the quality of an image formed based on the image light.
[0031] The optical display device provided in the first aspect may also be referred to as a picture generation unit (PGU) or optomechanical device, and the PGU may be used in a variety of display systems. For example, the PGU may be used in a projector, a head-up display system, a head-mounted optical display device, or a desktop display.
[0032] According to a second aspect, the present application provides an optical display device according to the first aspect or any one of the possible implementations of the first aspect, and a spatial light source arranged in a spatial domain. expansion and a display module. expansion The module displays an image corresponding to the image light from the optical display device. expansion It is configured to:
[0033] Display systems may include, but are not limited to, projectors, HUD systems, desktop displays, head-mounted optical displays, and the like.
[0034] For example, spatial light expansion The module may include at least one curved reflector, or may include at least one cylindrical mirror, or may include a combination of at least one curved reflector and at least one cylindrical mirror.
[0035] According to a third aspect, the present application provides a vehicle including a display system according to the second aspect or any one of the possible implementations of the second aspect, and a windshield, wherein the windshield is configured to reflect and image image light from the display system, for example, to reflect the image light into an eye movement range (eyebox position) of the vehicle.
[0036] According to a fourth aspect, the present application provides a color adjustment method applicable to an optical display device, the optical display device including a light source module, a light dividing module, a modulation module, and a sensing module.
[0037] The method includes controlling a light source module to emit light. The light is combined by at least two colors of light, and the light is split into a first light path and a second light path by a light splitting module. The method includes controlling a modulation module to modulate the second light path to obtain image light carrying image information. The method includes controlling a sensing module to obtain color information of the first light path. The method further includes controlling the light source module to adjust weights of the at least two colors of light based on the color information.
[0038] In one possible embodiment, color coordinates of the image light can be determined based on the color information, and if a difference between the color coordinates of the image light and the preset target color coordinates is greater than a threshold, a weight control signal for controlling and adjusting the at least two colors of light is generated, and the control signal is sent to the light source module to control the light source module to adjust the weights of the at least two colors of light based on the color information.
[0039] According to a fifth aspect, the present application provides a color adjustment device. The color adjustment device is configured to perform the method according to the fourth aspect or any one of the possible implementations of the fourth aspect, and includes corresponding functional modules each configured to perform the steps of the aforementioned method. The functions may be implemented by hardware or by executing corresponding software by the hardware. The hardware or software includes one or more modules corresponding to the aforementioned functions.
[0040] According to a sixth aspect, the present application provides an optical display device. The optical display device may include a light source module, a light splitting module, a modulation module, and a sensing module. The light source module is configured to emit light, and the light is combined with at least two colors of light. The light splitting module is configured to split the light from the light source module into a first light path and a second light path, propagate the first light path to the sensing module, and propagate the second light path to the modulation module. The modulation module is configured to modulate the second light path to obtain image light carrying image information. The sensing module is configured to obtain color information of the first light path, generate a control signal based on the color information, and send the control signal to the light source module. The light source module is further configured to adjust weights of the at least two colors of light based on the control signal.
[0041] According to a seventh aspect, the present application provides an optical display device. The optical display device may include a light source module, a light splitting module, a modulation module, a sensing module, and a processing module. The light source module is configured to emit light, and the light is combined with at least two colors of light. The light splitting module is configured to split the light from the light source module into a first light path and a second light path, and propagate the first light path to the sensing module and the second light path to the modulation module. The modulation module is configured to modulate the second light path to obtain image light carrying image information. The sensing module is configured to obtain color information of the first light path and send the color information to the processing module. The processing module is configured to generate a control signal based on the color information and send the control signal to the light source module. The control signal is used by the light source module to adjust the weights of the at least two colors of light. The light source module is further configured to adjust the weights of the at least two colors of light based on the control signal.
[0042] According to an eighth aspect, the present application provides a chip including at least one processor and an interface circuit. Optionally, the chip may further include a memory. The processor is configured to execute a computer program or instructions stored in the memory, thereby causing the chip to perform a method according to the fourth aspect or any one of the possible implementations of the fourth aspect.
[0043] According to a ninth aspect, the present application provides a computer-readable storage medium storing a computer program or instructions that, when executed by a control device, enables the control device to perform a method according to the fourth aspect or any one of the possible implementations of the fourth aspect.
[0044] According to a tenth aspect, the present application provides a computer program product, the computer program product comprising a computer program or instructions which, when executed by a control device, enable the control device to perform a method according to the fourth aspect or any one of the possible implementations of the fourth aspect.
[0045] For the technical effects that can be achieved in any one of the second to tenth aspects, reference may be made to the above description of the beneficial effects in the first aspect, and details will not be described again here. [Brief explanation of the drawings]
[0046] [Figure 1a] 1 is a schematic diagram of a possible application scenario according to the present application; [Figure 1b] 1 is a schematic diagram of a possible application scenario according to the present application; [Figure 1c] 1 is a schematic diagram of a possible application scenario according to the present application; [Figure 2] FIG. 1 is a schematic diagram of another possible application scenario according to the present application. [Figure 3] 1 is a schematic diagram of the structure of an optical display device according to the present application; [Figure 4a] 1 is a schematic diagram of the structure of a light source module according to the present application; [Figure 4b] 1 is a schematic diagram of the structure of another light source module according to the present application; [Figure 4c] 1 is a schematic diagram of the structure of a light homogenizing component according to the present application. [Figure 5a] 1 is a schematic diagram of the light splitting principle of a polarizing beam splitter according to the present application; [Figure 5b] 1 is a schematic diagram of a structure of a semi-transmissive reflector according to the present application. [Figure 5c] 1 is a schematic diagram of the structure of a liquid crystal LCoS on silicon according to the present application. [Figure 6] 1 is a schematic diagram of the structure of an optical lens according to the present application; [Figure 7a] 1 is a schematic diagram of the structure of another optical display device according to the present application; [Figure 7b] 1 is a schematic diagram of yet another optical display device structure according to the present application; [Figure 7c] 1 is a schematic diagram of the structure of yet another optical display device according to the present application; [Figure 8] 1 is a schematic diagram of the structure of another optical display device according to the present application; [Figure 9a] 1 is a schematic flowchart of a color adjustment method according to the present application. [Figure 9b] 3 is a schematic diagram of the current of the PWM input to the light source module according to the present application. [Figure 10] 1 is a schematic flowchart of a method for adjusting a color initialization process of an image according to the present application. [Figure 11] 1 is a schematic diagram of the structure of another optical display device according to the present application; [Figure 12a] 1 is a schematic diagram of yet another optical display device structure according to the present application; [Figure 12b] 1 is a schematic diagram of a circuit of an optical display device according to the present application; [Figure 13a] 1 is a schematic diagram of a partial structure of a vehicle according to the present application; [Figure 13b]1 is a schematic diagram of the functional framework of a vehicle according to the present application; [Figure 14] 1 is a schematic flowchart of a color adjustment method according to the present application. [Figure 15] 1 is a schematic diagram of the structure of a control device according to the present application; [Figure 16] 1 is a schematic diagram of the structure of a control device according to the present application; DETAILED DESCRIPTION OF THE INVENTION
[0047] Hereinafter, embodiments of the present application will be described in detail with reference to the accompanying drawings.
[0048] The following explains some terms in this application, and it should be noted that these explanations are intended to facilitate understanding by those skilled in the art, but do not constitute a limitation on the scope of protection claimed in this application.
[0049] 1. Color coordinates Color coordinates are also called color coordinate systems. Color coordinates can accurately represent colors. Generally, the horizontal axis of a color coordinate is x and the vertical axis is y. A point on a chromaticity diagram may be determined using color coordinates. The point may also be called a color point. Color coordinates (x, y) may be used to represent a color point.
[0050] 2. Spectrum A spectrum usually refers to the sequential arrangement of the dispersed monochromatic light based on wavelength (or frequency) after polychromatic light has been split by a dispersing system.
[0051] 3. Spectral Tristimulus Values Spectral tristimulus values are numerical values that approximately describe the three stimulus intensities of a color. In color matching, the three colors used to mix (also called composite) to create any color are called the three primary colors (or trichromats). Commonly, red, green, and blue are used as the three primary colors. The quantities of the three primary colors that match a color in the equal-energy spectrum are called spectral tristimulus values and are represented by the symbols r, g, and b.
[0052] 4. Pulse width modulation (PWM) waveform A pulse width modulation waveform is a pulse waveform with a variable duty cycle. In PWM, the amplitude of each pulse is equal. To change the amplitude of the equivalent output waveform, the width of each pulse only needs to be changed based on the same proportional coefficient. The principle of pulse width modulation is as follows: the on / off state of the switching element of the inverter circuit is controlled (for example, the conduction time of the switching element may be specifically controlled), thereby obtaining a series of pulses with the same amplitude at the output end, which can be used to replace a sine wave or any desired waveform.
[0053] 5.Dichroic mirror Dichroic mirrors are sometimes called dichroic mirrors, dichroic mirrors, or light-combining mirrors. A characteristic of dichroic mirrors is that light of a specific wavelength is almost completely transmitted and light of other wavelengths is almost completely reflected. For example, dichroic mirror 1 may transmit blue light and reflect green light. In other words, blue light may be almost completely transmitted when transmitted through dichroic mirror 1, and green light may be almost completely reflected by dichroic mirror 1. As another example, dichroic mirror 2 may transmit blue and green light and reflect red light. In other words, blue and green light may be almost completely transmitted when transmitted through dichroic mirror 2, and red light may be almost completely reflected by dichroic mirror 2. In this application, the wavelengths of light transmitted by the dichroic mirror and the wavelengths of light reflected by the dichroic mirror are not limited. The dichroic mirrors may be selected based on actual requirements.
[0054] 6.3 colors The three colors are "primary colors" that cannot be obtained by mixing other colors. Generally, the three colors refer to red, green, and blue, that is, R (Red), G (Green), and B (Blue). This can also be understood as meaning that the three primary colors are independent of each other, and any one of the primary colors cannot be obtained by mixing the other two primary colors.
[0055] The three primary colors can be combined (or blended) based on different proportions (i.e., weights) to obtain different colored lights. The luminance of the combined light is determined based on the sum of the luminances of the three primary colors, and the chrominance (which can be expressed by color coordinates) of the combined light is determined based on the weights of the three primary colors.
[0056] The above explains some terms in this application, and the following explains the technical solutions in this application.
[0057] The present application provides an optical display device, a display system, a vehicle, and a corresponding color adjustment method. The optical display device may be integrated into a projector 100a shown in FIG. 1a, which may project an image onto a wall or a projection screen. Alternatively, the optical display device may be integrated into a display 100b shown in FIG. 1b for use. Alternatively, the optical display device may be integrated into an in-vehicle display screen (e.g., as shown in 100c in FIG. 1c), which may be installed behind a seat or in a front passenger position of a vehicle. The location for installing the in-vehicle display screen is not limited by the present application. Alternatively, the optical display device may be integrated into a head-up display system shown in FIG. 2, which may display driving assistance information.
[0058] Furthermore, optionally, an example in which the optical display device is integrated into a HUD system and the HUD system is applied to a vehicle is used for explanation. The HUD system projects a formed image (called a HUD virtual image) into the driver's forward field of view and aggregates this image with actual road profile information to enhance the driver's perception of the real driving environment. For example, the HUD system may overlay a HUD virtual image with navigation information and / or instrument information (vehicle speed, rpm, temperature, oil level, etc.) on the real environment outside the vehicle, allowing the driver to obtain an augmented reality visual effect. Specifically, the system may be applied to scenarios such as AR navigation, adaptive tours, and lane departure warning. HUD systems include, but are not limited to, windshield (W)-HUD systems, augmented reality head-up displays (AR-HUD), etc.
[0059] It should be understood that the above scenarios are merely examples, and the methods and apparatus provided in this application may be further applied to multiple scenarios, but are not limited to the scenarios shown in the above examples.
[0060] As described in the background art, since a vehicle runs in a complex environment, in order to adapt to different environments, the HUD needs to set a specific operation mode based on the specific environment, which may cause problems such as color cast of the image displayed by the optical display device in the HUD, causing the image (also called picture) to be set to a specific color.
[0061] In view of this, the present application provides an optical display device, which can correct the color of an image to be displayed by detecting, via a sensing module, the color information of the light currently emitted by the light source module, thereby helping to reduce color cast of the image displayed by the optical display device.
[0062] Based on the above, the optical display device provided in the present application will be specifically described below with reference to FIGS.
[0063] FIG. 3 is a schematic diagram of the structure of an optical display device according to the present application. The optical display device 300 may include a light source module 301, a light splitting module 302, a modulation module 303, and a sensing module 304. The light source module 301 is configured to emit light and combine at least two colors of light. For example, the light may be obtained by mixing red, green, and blue light. The light splitting module 302 splits the light from the light source module 301 into a first optical path and a second optical path, propagating the first optical path to the sensing module 304 and the second optical path to the modulation module 303. The polarization states of the first and second optical paths may be the same or different, and color information, etc., may be consistent. The modulation module 303 is configured to modulate (e.g., amplitude modulate and / or phase modulate) the second optical path to obtain image light. The image light is light that carries image information (such as navigation information and / or instrument information). The sensing module 304 is configured to obtain color information of the first light path, and the color information is used by the light source module to adjust the weights of the at least two colors of light.
[0064] Based on the above-mentioned optical display device, the color information of the light currently emitted by the light source module can be detected by the sensing module, i.e., the first optical path can be used as color calibration of the light emitted by the light source module. Furthermore, based on the color information detected by the sensing module based on the first optical path, the weights of the at least two colors of light of the composite light are adjusted, so that color correction of the image light can be performed without increasing the optical structure, which is helpful in reducing color cast of the image displayed by the optical display device.
[0065] It should be understood that the sum of the weights of the various colors of light among the at least two colors of light in the composite light is a fixed value (e.g., 100%). When the weight of at least one color of light is changed, the weight of at least one color of light among the remaining colors of light is changed accordingly. In other words, adjusting the weights of the at least two colors of light may be changing the weight of each color of light among the at least two colors, or may be changing the weight of some of the colors of the at least two colors (here, the at least two colors may be three or more colors). This is not limited in the present application.
[0066] It should be noted that in an optical display device, the light source module is the factor that is affected by the environment (e.g., temperature) and causes a large color cast of the image displayed by the optical display device. Therefore, the color cast of the image can be effectively improved by monitoring the color information of the light emitted by the light source module.
[0067] The following will separately describe the functional modules shown in Figure 3 to provide an example of a specific implementation solution. For ease of description, the light source module, the light splitting module, the modulation module, and the sensing module will not be provided with numerical identifiers in the following.
[0068] 1. Light source module In one possible embodiment, the light source module may include a light-emitting component. For example, the light-emitting component may include at least two light sources, each emitting light of one color. The light source may be, for example, a laser diode (LD), a light-emitting diode (LED), an organic light-emitting diode (OLED), or a micro light-emitting diode (micro-LED).
[0069] For example, the light-emitting component may include a first light source, a second light source, and a third light source. The first light source is configured to emit red light, the second light source is configured to emit blue light, and the third light source is configured to emit green light. This may also be understood as the light-emitting component including an R light source, a G light source, and a B light source. The red light emitted by the first light source, the green light emitted by the third light source, and the blue light emitted by the second light source may be mixed to obtain light of different colors. For example, white light may be obtained by color mixing.
[0070] The following describes a possible structure of the light source module using an example in which the light-emitting components include a first light source, a second light source, and a third light source.
[0071] 4a is a schematic diagram of the structure of a light source module according to the present application. The light source module includes a light-emitting component. The light-emitting component includes a first light source, a second light source, and a third light source. The three light sources are arranged in a row. The three-color (RGB) light emitted by the three light sources can be mixed to form white light. Optionally, each light source further corresponds to a collimating mirror (e.g., a collimating lens or a curved reflecting mirror) to improve the uniformity of the light beam emitted by each light source. Specifically, the first light source corresponds to one collimating mirror, the second light source corresponds to one collimating mirror, and the third light source also corresponds to one collimating mirror.
[0072] Based on the light source module, lights of various colors can be mixed without passing through some optical elements (for example, dichromic mirrors), which helps to miniaturize the light source module and the optical display device.
[0073] Based on the light source module shown in Figure 4a, the spectrum of the light emerging from the light source module can be expressed as LED(λ). For details, see Equation 1 below. LED(λ)=LED B (λ)+LED G (λ)+LED R (λ) Equation 1
[0074] LED B (λ) represents the spectrum of the blue light emitted by the second light source, LED G (λ) represents the spectrum of the green light emitted by the third light source, the LED R (λ) represents the spectrum of the red light emitted by the first light source.
[0075] FIG. 4b is a schematic diagram of the structure of another light source module according to the present application. The light source module may include a light-emitting component, a first dichroic mirror, and a second dichroic mirror. The light-emitting component includes a first light source, a second light source, and a third light source. Three-color (RGB) light is emitted by the three light sources. The first dichroic mirror is configured to reflect blue light from the second light source and transmit green light from the third light source to the second dichroic mirror. The second dichroic mirror is configured to reflect red light from the first light source, transmit green light transmitted by the first dichroic mirror, and transmit blue light reflected by the first dichroic mirror. This can also be understood as the red light from the first light source, the green light from the third light source, and the blue light from the second light source being mixed to form light after passing through the second dichroic mirror. Furthermore, optionally, each light source may also correspond to one collimating mirror to improve the uniformity of the light beam emitted by each light source. For details, please refer to the description of Figure 4a. The details will not be described again here.
[0076] Based on the light source module shown in FIG. 4b, the spectrum of the light emerging from the light source module LED (λ) is given by Equation 2 below. LED(λ)=LED B (λ)×T1(λ)×T2(λ)+LED G (λ)×R1(λ)×T2(λ)+LED R (λ)×R2(λ) Equation 2
[0077] LED B (λ) represents the spectrum of the blue light emitted by the second light source, LED G (λ) represents the spectrum of the green light emitted by the third light source, the LED R(λ) represents the spectrum of the red light emitted by the first light source, T1(λ) represents the transmission spectrum of the first dichroic mirror, R1(λ) represents the reflection spectrum of the first dichroic mirror, T2(λ) represents the transmission spectrum of the second dichroic mirror, and R2(λ) represents the reflection spectrum of the second dichroic mirror.
[0078] It should be noted that the positions of the first light source, the second light source, and the third light source in the light source module may be interchanged. In the structure of the light source module shown in Figure 4b, if the positions of the first light source and the second light source are interchanged, the second dichroic mirror may be correspondingly replaced with a third dichroic mirror, and the third dichroic mirror may reflect blue light and transmit red and green light. Details will not be listed here one by one.
[0079] To improve the quality of the formed image (e.g., the brightness uniformity of the image), the light source module may further include a light homogenizing component. Specifically, the light formed by mixing light of various colors is first homogenized by the light homogenizing component and then emitted to the light splitting module. The light homogenizing component may be a compound lens (see FIG. 4c) (also called a sub-eye) formed by a series of (e.g., two or more) lenses to compress the angle of the light, so that the light emitted to the light splitting module becomes more uniform.
[0080] It should be noted that the number of lenses included in the compound eye lens shown in FIG. 4c is merely an example. In the present application, the compound eye lens may include more lenses than the lenses in FIG. 4c or may include fewer lenses than the lenses in FIG. 4c. This is not a limitation of the present application. It should be understood that the more sub-eyes included in the compound eye lens, the higher the light homogenization effect. Also, there may be one or more compound eye lenses. This is also not a limitation of the present application.
[0081] 2. Optical splitter module In one possible implementation, the light splitting module may split the light from the light source module into a first light path and a second light path.
[0082] Below are two possible structures of the optical splitting module as examples.
[0083] In a first configuration, the light splitting module may be a polarizing beam splitter.
[0084] Based on the first structure, the first optical path and the second optical path have different polarization states, and the first optical path may be referred to as a first polarization, and the second optical path may be referred to as a second polarization.
[0085] Figure 5a is a schematic diagram of the light splitting principle of a polarizing beam splitter according to the present application. A polarizing beam splitter (PBS) is an optical device in which one or more layers of thin film are plated on the slant surface of a right-angle prism and then bonded together using an adhesive layer. Based on the fact that the transmittance of P-polarized light is 1 and the transmittance of S-polarized light is less than 1 when light is incident at the Brewster angle, the P-polarized light component is completely transmitted and the S-polarized light component is mostly reflected (at least 90%) after the light passes through the thin film multiple times at the Brewster angle. This can also be understood as the PBS having transmission and reflection properties, and generally having a reflectance of greater than 99.5% for S-polarized light and a transmittance of greater than 91% for P-polarized light. For example, a polarizing beam splitter may split incident light (including P-polarized and S-polarized light) into horizontally polarized light (i.e., P-polarized light) and vertically polarized light (i.e., S-polarized light). The P-polarized light passes completely through the polarizing beam splitter, while the S-polarized light is reflected at a 45-degree angle, forming a 90-degree angle between the outgoing direction of the S-polarized light and the outgoing direction of the P-polarized light.
[0086] In one possible implementation, the polarizing beam splitter is configured to split the light from the light source module into a first polarization and a second polarization, where the first polarization may be P polarization and correspondingly the second polarization is S polarization, or the first polarization is S polarization and the second polarization is P polarization.
[0087] Further, optionally, the light splitting module further reflects the first polarized light (i.e., S polarized light) to the sensing module and transmits the second polarized light (i.e., P polarized light) to the modulation module, or transmits the first polarized light (i.e., P polarized light) to the sensing module and reflects the second polarized light (i.e., S polarized light) to the modulation module.
[0088] In the second configuration, the light splitting module is a transflective part.
[0089] Based on the second structure, the polarization states of the first and second optical paths are the same. For example, both the first and second optical paths may be P-polarized light, S-polarized light, or natural light. Note that if both the first and second optical paths are P-polarized or S-polarized light, a corresponding polarizer may be added in the light source module or between the light source module and the light splitting module, and the corresponding polarizer may pass P-polarized light or S-polarized light.
[0090] In one possible embodiment, the semi-transmissive reflector may transmit a portion of the light from the light source module to obtain a first optical path and reflect a portion of the light to obtain a second optical path. This may also be understood as the first optical path being light transmitted from the semi-transmissive reflector, and the second optical path being light reflected from the semi-transmissive reflector. Alternatively, the semi-transmissive reflector may reflect a portion of the light from the light source module to obtain the first optical path and transmit a portion of the light to obtain the second optical path. This may also be understood as the first optical path being light reflected from the semi-transmissive reflector, and the second optical path being light transmitted from the semi-transmissive reflector.
[0091] For example, the semi-transparent reflector may be, for example, a light-emitting mirror, and the active portion of the semi-transparent reflector may be plated on the plane of the light-emitting film (see FIG. 5b) to change the ratio of transmitted and reflected incident light. For example, the light-emitting film may be plated on a transparent planar substrate to form the semi-transparent reflector. Note that the reflectance and transmittance of the light-emitting film of the semi-transparent reflector may be selected based on specific requirements. For example, the reflectance may be higher than 50% and the transmittance may be less than 50%, or the reflectance may be less than 50% and the transmittance may be less than 50%, or both the reflectance and the transmittance are equal to 50%. This type of semi-transparent reflector may also be called a semi-transparent and semi-reflective mirror, i.e., the transmittance and reflectance of the semi-transparent and semi-reflective mirror are each 50%. After the incident light passes through the semi-transparent and semi-reflective mirror, the light intensity transmitted and reflected by the semi-transparent and semi-reflective mirror each account for 50%.
[0092] It should be noted that the structures of the light splitting module provided above are merely examples. The first structure may be understood as light splitting based on the principle of polarization state, and the second structure may be understood as light splitting based on light intensity (also called energy). Of course, other structures in which the light from the light source module can be split into the first light path and the second light path also fall within the scope of protection of the present application.
[0093] 3. Modulation module In one possible embodiment, the modulation module may include an image source (also called an optical data processing (ODP) unit) configured to modulate the received second polarized light to obtain image light carrying image information. Specifically, the modulation module may perform spatial phase modulation on the second polarized light to obtain image light carrying image information. The polarization state of the image light is the same as the polarization state of the first polarized light. Therefore, after the modulation module reflects the image light to the light splitting module, the image light may be transmitted into the spatial domain through the light splitting module. When the second polarized light is S-polarized, the modulation module performs spatial phase modulation on the second polarized light, and the obtained image light is P-polarized; or when the second polarized light is P-polarized, the modulation module performs spatial phase modulation on the second polarized light, and the obtained image light is S-polarized.
[0094] For example, the modulation module may include, but is not limited to, an LCoS (see related description above) display, a liquid crystal display (LCD), a Digital Light Processing (DLP) display, a laser beam scanning (LBS) display, etc.
[0095] Figure 5c is a schematic diagram of the structure of a liquid crystal on silicon (LCoS) device according to the present application. Based on the complementary metal oxide semiconductor (CMOS) process, liquid crystal is injected between the upper glass substrate and the lower silicon substrate of the LCoS to form a liquid crystal layer. Electrodes are disposed at the bottom of the liquid crystal layer. The operating principle of LCoS is as follows: when the external voltage applied to the pixel of the liquid crystal layer is 0, the input S-polarized light passes through the liquid crystal layer without any polarization. The S-polarized light is reflected back at the bottom and output. After being reflected by the polarizing beam splitter, the S-polarized light returns along its original path. When an external voltage is applied to the pixel, the input S-polarized light passes through the liquid crystal layer and its polarization direction is polarized. The S-polarized light is reflected back at the bottom and output as P-polarized light. The P-polarized light passes directly through the polarizing beam splitter and is coupled into an optical lens, etc. Therefore, by changing the external voltage or current, the direction of the major axes of the liquid crystal molecules can be changed, changing the refractive index of the LCoS and therefore the phase of light passing through the LCoS. This is equivalent to using a phase retarder to rotate the polarization state of light and, in cooperation with a polarizing beam splitter, perform light modulation. Based on LCOS, small display chips can be implemented, which contributes to the miniaturization of optical display devices.
[0096] It should be noted that the above modulation module is merely an example, and other devices capable of modulating light from a light source module to generate image light also fall within the protection scope of the present application.
[0097] In one possible embodiment, when the light splitting module is a polarizing beam splitter as shown in the first structure, the modulation module may be, for example, an LCoS display or an LCD, or when the light splitting module is a semi-transmissive reflector as shown in the second structure, the modulation module may be, for example, an LCoS display, an LCD, a DLP display, or an LBS display.
[0098] 4. Sensing module In one possible embodiment, the sensing module is configured to detect color information of the first polarization. For example, the color information may be represented by a spectrum. Specifically, the sensing module may detect a first spectrum of the first polarization and convert information about the first spectrum into a first electrical signal. This may also be understood as the sensing module performing optical-to-electrical conversion on the detected first spectrum of the first polarization to obtain a first electrical signal representing information about the first spectrum of the first polarization.
[0099] The first spectrum of the first polarization detected by the sensing module may be represented by Sensor(λ). If the first polarization is P-polarized light, see Equation 3 below for Sensor(λ), or if the first polarization is S-polarized light, see Equation 4 below for Sensor(λ): Sensor(λ)=LED(λ)×Tp(λ) Equation 3 Sensor(λ)=LED(λ)×Rs(λ) Equation 4
[0100] Tp(λ) represents the transmission spectrum of the optical division module, and Rs(λ) represents the reflection spectrum of the optical division module.
[0101] For example, the sensing module may include a detection component, such as, but not limited to, a photon detector (PD), a high-speed photodiode, a charge coupled device (CCD), a complementary metal-oxide-semiconductor (CMOS) phototransistor, a photodiode, etc. The sensing module may be, for example, a color sensor, which may also be referred to as a color recognition sensor or color sensor and may accurately distinguish between similar colors.
[0102] Furthermore, the color cast of the image formed based on the image light can be corrected based on the first electrical signal output by the sensing module and carrying information about the first spectrum. For specific processes, please refer to the descriptions of Figures 9a and 10 below, and details will not be described here.
[0103] In the present application, the optical display device may further include an optical lens. The optical lens may be configured to project the image light output by the modulation module into a spatial region. Specifically, the optical lens may shape and / or uniformize and / or focus the image light output by the modulation module and propagate the shaped and / or uniformized and / or focused image light into the spatial region. When the optical display device is used in a display system (e.g., a projector, a HUD system, a desktop display, or a head-mounted optical display device), the optical lens may project the shaped and / or uniformized and / or focused image light into a spatial light arranged in the spatial region. expansion It can be propagated to modules (see related discussion below for more details).
[0104] FIG. 6 is a schematic diagram of the structure of an optical lens according to the present application. The optical lens may include at least one lens. FIG. 6 illustrates an example in which three lenses are included. Note that the number of lenses included in the optical lens is not limited in the present application and may be more or less than that shown in FIG. 6. The type of lens is also not limited in the present application. The lens may also include other lenses or combinations of other lenses, such as plano-convex lenses or plano-concave lenses. The optical lens may also be rotationally symmetric about the optical axis of the optical lens. For example, the lens in the optical lens may be a single spherical lens or a combination of multiple spherical lenses. Alternatively, the optical lens may be non-rotationally symmetric. For example, the lens in the optical lens may be a single aspherical lens or a combination of multiple aspherical lenses. The combination of multiple spherical and / or aspherical lenses helps to improve the imaging quality of the optical lens and reduce aberrations of the optical lens.
[0105] In one possible embodiment, the lens material in the optical lens may be an optical material such as glass, resin, or crystal. If the lens material is resin, it will help to reduce the quality of the detection system. If the lens material is glass, it will help to further improve the imaging quality of the detection system. Furthermore, to effectively suppress temperature drift, the optical lens includes at least one lens made of glass.
[0106] Based on the above, the following provides three specific structures of the aforementioned optical display device to further understand the process of the aforementioned optical display device improving the color cast of the displayed image.
[0107] 7a is a schematic diagram of the structure of another optical display device according to the present application. The optical display device 700 may include a light source module 701, a polarizing beam splitter 702, a modulation module 703, a sensing module 704, and an optical lens 705. Optionally, the optical display device may further include a processing module 706. In FIG. 7a, an example is used in which the light source module 701 includes a first light source 7011, a second light source 7012, a third light source 7013, a first dichroic mirror 7014, a second dichroic mirror 7015, and a compound lens 7016. For a more detailed description of the other modules, please refer to the related descriptions above. The details will not be described again here.
[0108] Based on the optical display device, the first light source 7011 emits red light, the second light source 7012 emits blue light, and the third light source 7013 emits green light. The propagation light paths of various colors are as follows: the green light is transmitted through the first dichroic mirror 7014 to the second dichroic mirror 7015, the blue light is reflected through the first dichroic mirror 7014 to the second dichroic mirror 7015, the green and blue lights are transmitted through the second dichroic mirror 7015, the red light is reflected by the second dichroic mirror 7015 and then combined with the blue and green lights to form white light, which is homogenized by the compound lens 7016 and then transmitted to the polarizing beam splitter 702. The spectrum of light emitted from the light source module can be expressed by the above-mentioned Equation 2.
[0109] Further, the light is split into a first polarization and a second polarization through the polarizing beam splitter 702, and the first polarization is transmitted to the sensing module 704 through the polarizing beam splitter 702. Based on this, for the first spectrum of the first polarization received by the sensing module 704, see Sensor(λ) in the above-mentioned Equation 3. Tp(λ) in Equation 3 is the transmission spectrum of the polarizing beam splitter. The second polarization is reflected to the modulation module 703 through the polarizing beam splitter 702. The modulation module 703 performs spatial phase modulation on the second polarization to obtain image light (the polarization state of the image light is the same as the polarization state of the first polarization), and reflects the image light to the polarizing beam splitter 702. The image light is transmitted to the optical lens 705 through the polarizing beam splitter 702. Based on this, the second spectrum of the image light projected into the spatial domain can be expressed as Display(λ). For details, see Equation 5 below: Display`(λ)=LED(λ)×Rs(λ)×LCoS(λ)×Tp(λ)×A`(λ) Equation 5
[0110] Rs(λ) represents the reflection spectrum of the light splitting module (here, the polarizing beam splitter 702 ), LCoS(λ) represents the reflection spectrum of the modulation module 703 , and A′(λ) represents the transmission spectrum of the optical lens 705 .
[0111] Therefore, it may be determined that the difference between the first spectrum detected by the sensing module 704 and the second spectrum projected into the spatial domain by the optical lens 705 may be represented by t. For details, see Equation 6 below.
number
[0112] Rs(λ), LCoS(λ) and A`(λ) can be obtained by testing such as a spectrophotometer.
[0113] Therefore, it can be seen that the relationship between the first spectrum detected by the sensing module 704 and the second spectrum projected into the spatial domain satisfies Equation 7 below. Display(λ)=t×Sensor(λ) Equation 7
[0114] It should be noted that Figure 7a is described using an example in which the first polarization is P-polarized and the second polarization is S-polarized. If the first polarization is S-polarized and the second polarization is P-polarized, the positions of the modulation module 703 and the sensing module 704 in Figure 7a can be exchanged. Correspondingly, Rs(λ) in Equation 5 can be replaced with Tp(λ), and Tp(λ) can be replaced with Rs(λ), which is equivalent to Equation 5 remaining unchanged, and Rs(λ) in Equation 6 being replaced with Tp(λ).
[0115] 7b is a schematic diagram of the structure of yet another optical display device according to the present application. In the optical display device 710, the polarizing beam splitter 702 of FIG. 7a can be replaced with a transflector 712. Specifically, the optical display device 710 may include a light source module 711, a transflector 712, a modulation module 713, a sensing module 714, and an optical lens 715. Optionally, the optical display device may further include a processing module 716. For a more detailed description of the modules, please refer to the related descriptions above. The details will not be described again here.
[0116] Furthermore, the light is split into a first optical path and a second optical path via the semi-transmissive reflector 712, and the first optical path is partially transmitted to the sensing module 714 via the semi-transmissive reflector 712. Based on this, the first spectrum of the first optical path received by the sensing module 714 can be expressed as Sensor(λ) in Equation 3 below. Tp(λ) in Equation 3 is the transmission spectrum of the semi-transmissive reflector 712. The second optical path is reflected to the modulation module 713 via the semi-transmissive reflector 712. The modulation module 713 performs spatial phase modulation on the second optical path to obtain image light and reflects the image light to the semi-transmissive reflector 712. The image light is transmitted to the optical lens 715 via the semi-transmissive reflector 712. Based on this, the second spectrum of the image light projected into the spatial domain can be expressed as Display(λ). For details, see Equation 5 above. Here, Rs(λ) in Equation 5 represents the reflection spectrum of the semi-transmissive reflective portion 712.
[0117] Therefore, it may be determined that the difference between the first spectrum detected by the sensing module 714 and the second spectrum projected into the spatial domain by the optical lens 715 may be represented by t. For details, see Equation 6 above. The details will not be described again here.
[0118] 7b is described using an example in which the first optical path is light through the transmissive portion of the semi-transmissive reflective portion 712, and the second optical path is light through the reflective portion of the semi-transmissive reflective portion 712. When the first optical path is light through the reflective portion and the second optical path is light through the transmissive portion, the positions of the modulation module 713 and the sensing module 714 in FIG. 7b can be exchanged. Correspondingly, Rs(λ) in Equation 5 can be replaced with Tp(λ), and Tp(λ) can be replaced with Rs(λ), which is equivalent to leaving Equation 5 unchanged, and Rs(λ) in Equation 6 can be replaced with Tp(λ).
[0119] FIG. 7c is a schematic diagram of the structure of yet another optical display device according to the present application. A polarizer 727 can be added to the optical display device 720 before or after the compound lens 7116 in FIG. 7b (i.e., between the compound lens 7116 and the second dichroic mirror 7115). This can also be understood as the light source module 711 further including the polarizer 727. Alternatively, the polarizer 727 can be added between the light source module 711 and the semi-transmissive reflector 712 in FIG. 7b. This can also be understood as the optical display device 720 further including the polarizer 727. The polarizer 727 can pass P-polarized light or S-polarized light. FIG. 7c uses an example in which the polarizer 727 is added between the light source module 721 and the semi-transmissive reflector 722, and the polarizer 727 passes P-polarized light. Specifically, the optical display device 720 may include a light source module 721, a transflector 722, a modulation module 723, a sensing module 724, an optical lens 725, and a polarizer 727. Optionally, the optical display device may further include a processing module 726. For more detailed descriptions of the other modules, please refer to the related descriptions above. The details will not be described again here.
[0120] It should be noted that the difference between the spectra of the optical display device based on Figure 7c and the spectra of the optical display device based on Figure 7b is that the spectrum entering the semi-transmissive reflective portion 722 in Figure 7c is the spectrum emerging from the light source module 721, LED(λ) x T3(λ), where T3(λ) is the transmission spectrum of the polarizer 727.
[0121] To facilitate the explanation of the solution, the following provides an explanation using an example in which the first optical path is a first polarization, and the first polarization is P polarization, and the second optical path is a second polarization, and the second polarization is S polarization.
[0122] Based on the aforementioned relationship between the first spectrum, the second spectrum, and the first spectrum of the first polarization detected by the sensing module, the color cast of the image formed by the image light corresponding to the second spectrum is corrected. Specific processes can be performed by a processing component. The following provides a case-by-case description based on the module to which the processing component belongs.
[0123] Case 1: The processing component belongs to the light source module. It will also be understood that the light source module may further include a processing component. In other words, the light source module may include a light emitting component and a processing component. Furthermore, optionally, the light source module may further include a collimating mirror and / or a dichroic mirror.
[0124] FIG. 8 is a schematic diagram of the structure of another optical display device according to the present application. The optical display device may include a light source module 801, a light splitting module 802, a modulation module 803, a sensing module 804, and an optical lens 805. The light source module 801 includes a processing component 8011 and a light-emitting component 8012. The sensing module 804 is configured to transmit acquired color information to the processing component 8011. The processing component 8011 receives the color information from the sensing module 804, generates a control signal based on the color information, and transmits the control signal to the light-emitting component 8012. The light-emitting component 8012 is configured to adjust the weights of the at least two colors of light based on the control signal. For specific processes, please refer to the description of FIG. 9a below. For more detailed descriptions of the light source module 801, the light splitting module 802, the modulation module 803, the sensing module 804, and the optical lens 805, please refer to the above descriptions. The details will not be described again here.
[0125] For example, a processing element may be a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or another programmable logic device, a transistor logic device, a hardware component, or any combination thereof. A general-purpose processor may be a microprocessor or any conventional processor.
[0126] 9a is a schematic flow chart of a color adjustment method according to the present application. The method may be performed by a processing component in the light source module described above, and includes the following steps:
[0127] Step 901. The sensing module sends information about a first spectrum to the processing component. In response, the processing component receives information about the first spectrum from the sensing module.
[0128] The information about the first spectrum may be carried in a first electrical signal, i.e., the sensing module transmits the first electrical signal to the processing component, the first electrical signal including the information about the first spectrum.
[0129] Step 902. A processing component determines a second spectrum of the image light based on information about the first spectrum and a correspondence between the first spectrum and the second spectrum.
[0130] The first spectrum may be obtained by detecting the first polarization through the sensing module, and the second spectrum may be obtained based on the above-mentioned Equation 7, i.e., Display(λ)=t×Sensor(λ), where the second spectrum is represented by Display(λ) and the first spectrum is represented by Sensor(λ).
[0131] Step 903. The processing component determines color coordinates of the image light based on the second spectrum and the correspondence between the spectrum and the color coordinates.
[0132] For the correspondence between spectrum and color coordinates, see Equation 8 (Equation 2) and Equation 9 (Equation 3) below.
number
number
[0133] X, Y, and Z represent the spectral tristimulus values of the standard observer, x and y represent the color coordinates, φ(λ) represents the spectral intensity distribution, and the integration interval is the visible light range, which may be, for example, [380, 780] or even [400, 700].
[0134] In addition, the second spectrum (i.e., t×Sensor(λ)) represented by the first spectrum may be substituted into Equation 8 and Equation 9 to obtain Equation 10 (Equation 4) and Equation 11 (Equation 5), and the color coordinates of the image light may be obtained based on Equation 10 (Equation 4) and Equation 11 (Equation 5).
number
number
[0135] This means that the color coordinates of the image light are (x real ,y real) can also be understood as
[0136] Step 904. The processing component determines whether the weight of each color light needs to be adjusted based on the color coordinates of the image light and the preset target color coordinates, and if the weight needs to be adjusted, performs the following step 905, or if the weight does not need to be adjusted, performs the following step 906.
[0137] In one possible embodiment, the preset color coordinates (x target ,y target ) may be pre-stored. Furthermore, optionally, the optical display device may be of multiple operation modes (e.g., snow mode, rain mode, sunny mode, night mode, day mode). One operation mode may correspond to a group of preset color coordinates, and the group of preset color coordinates may be the color coordinates of white light. See Table 1. It should be understood that the preset target color coordinates may be one of the preset color coordinates.
[0138] [Table 1]
[0139] It should be noted that storing the correspondence between the operation modes and the preset color coordinates in the form of a table is merely an example, and the correspondence may alternatively be stored in another possible form, which is not a limitation of the present application.
[0140] Furthermore, optionally, the user may select a group of preset color coordinates (the selected preset color coordinates are preset target color coordinates). The processing component detects the group of preset target color coordinates selected by the user and calculates the color coordinates (x real ,y real ) with the preset target color coordinates to determine whether the light weight of each color needs to be adjusted. target -xreal |, Δy=|y target -y real |. If at least one of Δx and Δy is greater than the threshold, it indicates that the color coordinates of the image light do not match the preset target color coordinates, and the light weights of each color need to be adjusted. If both Δx and Δy are equal to or less than the threshold, it indicates that the color coordinates of the image light match the preset target color coordinates, and the light weights of each color do not need to be adjusted. The threshold may be, for example, 0.002.
[0141] Step 905. The processing component determines a light weight for each color and generates a control signal based on the light weight for each color.
[0142] For example, the light source module is of the structure shown in Figure 4b. Taking into account the weight of the light of various colors, the second spectrum of the image light is given by the following LED (λ) target where a, m, and n are the weights of blue, green, and red light, respectively. LED(λ) target = a × LED B (λ)×T1(λ)×T2(λ)+m×LED G (λ)×R1(λ)×T2(λ)+n×LED R (λ)×R2(λ)
[0143] This is to adjust the light emitted by the light source and reduce the color cast of the image formed based on the image light by using a second spectrum LED (λ) target may also be understood as being adjusted by adjusting the weights of red, green, and blue light.
[0144] In one possible implementation, to adjust the weights of the lights of different colors, the current weights of the light sources corresponding to the emitted lights of different colors may be adjusted. This may also be understood as the control signal including the current weight of each light source. For example, the light-emitting component may include a first light source, a second light source, and a third light source, and the processing component may adjust the light weights a:m:n of each color by adjusting I1:I2:I3.
[0145] Furthermore, optionally, the processing component may adjust the current weights based on a color processing algorithm, which may be preset. For example, the weight of the current input to one or more light sources is increased by a%, and the weight of the current of the remaining light sources is decreased by a%, where a% may be 0.5%, 0.2%, 1%, etc. It should be noted that the sum of the current weights of the light sources corresponding to each color of light is 100%.
[0146] It should be understood that each light source input to the light source module has an initial current weight, which may be pre-stored or determined during an initialization process, see the description of FIG. 10 below for the initialization process.
[0147] For example, the current input to the light source module is a PWM current, and the light source module includes an R light source, a G light source, and a B light source. See FIG. 9b. The duty cycle of the PWM input to the R light source, the G light source, and the B light source can be adjusted. Specifically, the interval between two adjacent pulses can be changed (i.e., the values of T1, T2, and T3 are adjusted). As another example, the current value (I) input to the R light source, the G light source, and the B light source can be changed. In this way, the weight of the current input to the R light source, the G light source, and the B light source can be adjusted.
[0148] Step 906. The processing component controls the light emitting component to emit light of the corresponding color based on the initialized weights of the various color lights.
[0149] From the above steps 901 to 906, it can be seen that the color cast of the image formed by the image light corresponding to the second spectrum is corrected based on the relationship between the first spectrum and the second spectrum and the first spectrum of the first polarization detected by the sensing module, so as to help reduce the color cast of the image displayed by the optical display device. That is, the second polarization is multiplexed, and the color information detected by the sensing module is compared with the preset target color coordinates to perform color point adjustment, thereby performing color calibration.
[0150] 10 is a schematic flowchart of a method for adjusting a color initialization process of an image according to the present application. The method can be performed by a processing component in the aforementioned light source module. To facilitate the description of the solution, the following uses an example in which the light source module includes a first light source, a second light source, and a third light source.
[0151] The method includes the following steps.
[0152] Step 1001. A processing component obtains preset target color coordinates.
[0153] In one possible implementation, a group of preset color coordinates selected by a user may be detected, and the selected preset color coordinates are preset target color coordinates.
[0154] Step 1002. The processing component generates an initial signal based on the obtained preset target color coordinates and the correspondence between the preset color coordinates and the current weights.
[0155] The initial signal includes a weight for the current input to each light source.
[0156] In one possible embodiment, the correspondence between the preset color coordinates and the current weights can be represented in the following Table 2. The current weights corresponding to the preset target color coordinates can be determined based on the preset target color coordinates and Table 2. For example, if the preset target color coordinates are A(x target1 ,y target1 ), the corresponding current weight ratio is I 11 :I 12 :I 13 and the weight of the current included in the initial signal is I 11 :I 12 :I 13 is.
[0157] [Table 2]
[0158] It should be noted that expressing the correspondence between the preset color coordinates, current weights, and luminance in the form of a table is merely an example, and the correspondence may alternatively be expressed in another possible form, which is not a limitation of the present application.
[0159] It should be further noted that Table 1 and Table 2 may be two independent tables or may be combined. This is not limited in the present application. Also, Table 1 and Table 2 may be stored in a memory or a register, and the processing component may obtain the data in Table 1 and Table 2 by accessing the memory or the register. For the memory or the register, please refer to the related description below. The details will not be described again here.
[0160] Step 1003. The processing component sends an initial signal to the light emitting component. Thus, the light emitting component may receive the initial signal from the processing component.
[0161] For example, the light emitting components include a first light source, a second light source, and a third light source.
[0162] Step 1004. The light-emitting component may emit light of a corresponding color based on the received initial signal.
[0163] It should be noted that the processes of Figures 9a and 10 can also be applied to brightness adjustment. Specifically, the weight of the current may be replaced by brightness, and the details will not be described again here.
[0164] Case 2: The processing component belongs to the sensing module. It will also be appreciated that the sensing module may further include a processing component, in other words, the sensing module may include a detection component and a processing component.
[0165] FIG. 11 is a schematic diagram of the structure of another optical display device according to the present application. The optical display device may include a light source module 1101, a light splitting module 1102, a modulation module 1103, and a sensing module 1104. The sensing module 1104 includes a processing component 11041 and a detection component 11042. The detection component 11042 may be configured to detect color information of the first polarized light and send the color information to the processing component 11041. The processing component 11041 is configured to generate a control signal based on the color information and send the control signal to the light source module 1101. Correspondingly, the light source module 1101 is configured to adjust the current weight of each color of light of at least two colors based on the control signal. For more detailed descriptions of the light source module 801, the light splitting module 802, the modulation module 803, the sensing module 804, and the optical lens 805, please refer to the above descriptions. The details will not be described again here.
[0166] For the process by which the processing component in the sensing module generates the control signal, please refer to the description of steps 902 to 905 in Figure 9a, and the details will not be described again here.
[0167] Case 3: The processing component is independent of the sensing module and the light source module. For example, the processing component may be referred to as the processing module.
[0168] It will also be appreciated that the optical display device may further include a processing module.
[0169] 12a is a schematic diagram of the structure of yet another optical display device according to the present application. The optical display device 1200 may include a light source module 1201, a light splitting module 1202, a modulation module 1203, a sensing module 1204, an optical lens 1205, and a processing module 1206. The sensing module 1204 is configured to obtain color information of the first polarization and send the color information to the processing module 1206. The processing module 1206 is configured to generate a control signal based on the color information and send the control signal to the light source module 1201. The light source module 1201 is further configured to adjust weights of the at least two colors of light based on the control signal.
[0170] For a more detailed description of the light source module 1201, the light splitting module 1202, the modulation module 1203, the sensing module 1204, and the optical lens 1205, please refer to the above description. The details will not be described again here. For the process in which the processing module generates the control signal, please refer to the description of steps 902 to 905 in Figure 9a. The details will not be described again here.
[0171] 9a and 10 may alternatively be performed by another module or structure that may have processing capabilities, such as an image processing control board of an ODP or an on-board controller. The on-board controller may be, for example, an independent controller, a domain controller in the vehicle, or an electronic control unit (ECU) in the vehicle. This is not a limitation of the present application.
[0172] Based on the above-mentioned optical display device, without increasing the complexity of the optical system, a sensing module is added, which can adjust the current weight of the light-emitting components (e.g., light sources) in the light source module through feedback when the environment (e.g., temperature) changes, thereby changing the light weight of each color of the composite light, ensuring that the optical display device displays light in a certain color range, and helping to reduce color cast of the image displayed by the optical display device.
[0173] 12b is a schematic diagram of the circuitry of an optical display device according to the present application. The circuitry in the optical display device mainly includes a host processor (host CPU) 1701, an external memory interface 1702, an internal memory 1703, an audio module 1704, a video module 1705, a power supply module 1706, a wireless communication module 1707, an I / O interface 1708, a video interface 1709, a display circuit 1710, and a modulator 1711. The host processor 1701 and its peripheral elements, such as the external memory interface 1702, the internal memory 1703, the audio module 1704, the video module 1705, the power supply module 1706, the wireless communication module 1707, the I / O interface 1708, the video interface 1709, and the display circuit 1710, may be connected via a bus. The host processor 1701 may also be referred to as a front-end processor.
[0174] Furthermore, the circuit schematics in the embodiments of the present application do not constitute any particular limitations on the optical display device. In some other embodiments of the present application, the optical display device may include more or fewer components than those shown in the figures, or may combine some components, or may separate some components, or may have a different component arrangement. The components shown in the figures may be implemented by hardware, software, or a combination of software and hardware.
[0175] The host processor 1701 includes one or more processing units. For example, the host processor 1701 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent components or may be integrated into one or more processors.
[0176] A memory may also be located within the host processor 1701 and configured to store instructions and data. In some embodiments, the memory within the host processor 1701 is a cache. The memory may store instructions or data that have just been used or that are periodically used by the host processor 1701. When the host processor 1701 needs to use the instructions or data again, the instructions or data may be retrieved directly from the memory. Repeated accesses are avoided, reducing the latency of the host processor 1701 and thereby improving the efficiency of the optical display device. The host processor 1701 may execute the stored instructions to perform the color adjustment methods described above.
[0177] In some embodiments, the optical display device may further include a plurality of input / output (I / O) interfaces 1708 connected to the host processor 1701. The interfaces 1708 may include an Inter-Integrated Circuit (I2C) interface, an Inter-Integrated Circuit Sound (I2S) interface, a Pulse Code Modulation (PCM) interface, a Universal Asynchronous Receiver / Transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a General-Purpose Input / Output (GPIO) interface, a Subscriber Identity Module (SIM) interface, a Universal Serial Bus (USB) interface, etc. The I / O interface 1708 may be connected to devices such as a mouse, touchpad, keyboard, camera, speaker / loudspeaker, microphone, or may be connected to physical buttons on an optical display device (such as volume buttons, brightness control buttons, and power on / off button).
[0178] The external memory interface 1702 can be configured to connect to an external memory card, such as a Micro SD card, to expand the storage capabilities of the optical display device. The external memory card communicates with the host processor 1701 via the external memory interface 1702 to perform data storage functions.
[0179] The internal memory 1703 may be configured to store computer-executable program code. The executable program code includes instructions. The internal memory 1703 may include a program storage area and a data storage area. The program storage area may store an operating system, applications required by at least one function (e.g., a call function or a time setting function), and the like. The data storage area may store data generated in the process of using the optical display device (e.g., a phone book or world time), and the like. The internal memory 1703 may also include high-speed random access memory and may further include non-volatile memory, such as at least one magnetic disk storage device, flash storage device, or universal flash storage (UFS). The host processor 1701 performs various functional applications and data processing of the optical display device by executing instructions stored in the internal memory 1703 and / or instructions stored in memory located within the host processor 1701.
[0180] The optical display device may perform audio functions via an audio module 1704, an application processor, etc., such as music playback and calling.
[0181] The audio module 1704 is configured to convert digital audio information to an analog audio signal output, and also to convert analog audio input to a digital audio signal. The audio module 1704 may be further configured to encode and decode audio signals, for example, to play or record audio. In some embodiments, the audio module 1704 may be located on the host processor 1701, or some functional modules of the audio module 1704 may be located on the host processor 1701.
[0182] The video interface 1709 may receive audio and video signals from the outside, specifically, a High Definition Multimedia Interface (HDMI), a Digital Visual Interface (DVI), a Video Graphics Array (VGA), a Display Port (DP), etc. The video interface 1709 may also output video to the outside. When the optical display device is used as a head-up display, the video interface 1709 may receive speed signals and electrical quantity signals input by a peripheral device, and may also receive an AR video signal input from the outside. When the optical display device is used as a projector, the video interface 1709 may receive a video signal input by an external computer or terminal device.
[0183] The video module 1705 may decode video input via the video interface 1709, for example, performing H.264 decoding. The video module may further encode video collected by the optical display device, for example, performing H.264 encoding on video collected by an external camera. The host processor 1701 may also decode video input via the video interface 1709 and then output the decoded image signal to the display circuit 1710.
[0184] The display circuit 1710 and the modulator 1711 are configured to display a corresponding image. In this embodiment, the video interface 1709 receives a permanently input video source signal, and the video module 1705 performs decoding and / or digitization processing and outputs one or more image signals to the display circuit 1710. Based on the input image signal, the display circuit 1710 drives the modulator 1711 to image the incident polarized light and output at least two image optical paths. The host processor 1701 may also output one or more image signals to the display circuit 1710.
[0185] In this embodiment, the display circuit 1710 and the modulator 1711 belong to the electronic elements in the modulation unit, and the display circuit 1710 may also be called a driver circuit.
[0186] The power supply module 1706 is configured to supply power to the host processor 1701 and the light source 1712 based on input power (e.g., direct current). The power supply module 1706 may include a rechargeable battery, which may supply power to the host processor 1701 and the light source 1712. Light emitted by the light source 1712 is transmitted to the modulator 1711 to form an image light signal for imaging.
[0187] The wireless communication module 1707 may enable the optical display device to communicate wirelessly with the outside world. The wireless communication module may provide wireless communication solutions such as Wireless Local Area Networks (WLANs) (e.g., Wireless Fidelity (Wi-Fi) networks), Bluetooth (BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), and Infrared (IR). The wireless communication module 1707 may be one or more components incorporating at least one communication processor module. The wireless communication module 1707 receives electromagnetic waves via an antenna, performs frequency modulation and filtering on the electromagnetic wave signals, and transmits the processed signals to the host processor 1701. The wireless communication module 1707 further receives a signal to be transmitted from the host processor 1701, performs frequency modulation and amplification on the signal to be transmitted, converts the signal to be transmitted into an electromagnetic wave via an antenna, and radiates the electromagnetic wave.
[0188] In addition to being input by the video interface 1709, the video data decoded by the video module 1705 may also be received wirelessly via the wireless communication module 1707 or read from an external memory. For example, the optical display device may receive video data from an in-vehicle information system via a terminal device or a wireless local area network within the vehicle, and the optical display device may further read audio and video data stored in an external memory.
[0189] Based on the structure and function principle of the optical display device described above, the present application further provides a display system, which comprises an optical display device shown in any one of the above embodiments and a spatial light source arranged in a spatial region. expansion Module and spatial light expansion The module displays an image corresponding to the image light from the optical display device. expansion For example, the display system may include, but is not limited to, a projector, a HUD system, a desktop display, etc.
[0190] In one possible embodiment, spatial light expansion The module includes any one or combination of at least one curved reflecting mirror and at least one cylindrical mirror. The cylindrical mirror may have one-dimensional curvature, thereby allowing for one-dimensional shaping. It will also be understood that light may diverge or converge in one dimension, and light may be reflected in another dimension. The cylindrical mirror may be, for example, a plano-convex cylindrical mirror or a plano-concave cylindrical mirror.
[0191] Based on the structure and function principle of the display system described above, the present application may further provide a vehicle. Figure 13a is a schematic diagram of a partial structure of a vehicle according to the present application. The vehicle may include the display system according to any one of the above-mentioned embodiments and a windshield, and the windshield is configured to reflect and image image light from the display system.
[0192] For example, the vehicle may be a vehicle, the display system may be a HUD system, and the windshield may be configured to reflect image light from the display system into the eye movement range of the vehicle (see FIG. 2).
[0193] When the optical display device of any one of the foregoing embodiments is applied to a vehicle, the second spectrum may be represented by the following Equation 12: Display(λ)=LED(λ)×Rs(λ)×LCoS(λ)×Tp(λ)×A(λ) Equation 12
[0194] A(λ) represents the sum of the spectra of all optical elements that pass through from the optical lens to the human eye. The optical elements that pass through include, but are not limited to, optical lenses, spatial light sources, and the like. expansion Includes modules, windshields, etc.
[0195] In one possible embodiment, the eye movement range may be referred to as the eyebox, and the driver's eyes should normally be within the eye movement range. See FIG. 2. It should be understood that if the glasses are aligned with the center of the eyebox, a complete and clear virtual image can be seen. If the eyes move left and right or up and down at a certain point in each direction, the virtual image may be distorted, the color rendering may be incorrect, or the virtual image may not even be displayed. Due to different heights of drivers, the eye movement range is generally 130 mm x 50 mm. That is, there is a vertical movement range of approximately ±50 mm and a horizontal movement range of approximately ±130 mm.
[0196] To prevent the entire windshield from being broken after being hit, the windshield typically includes two layers of glass and a layer of polyvinyl butyral (PVB) material sandwiched between the two layers of glass. The refractive index of the PVB material is close to that of glass. To illustrate the solution, the windshield may be simplified to a flat piece of glass with a specific thickness (typically 4-5 mm). In one possible embodiment, the windshield includes a wedge-shaped windshield or a flat windshield.
[0197] It should be understood that the vehicle structure shown in Figure 13a is merely an example, and the vehicle may further include other devices, such as a steering wheel, a memory, and a wireless communication device.
[0198] 13b is a schematic diagram of a possible functional framework of a vehicle according to the present application. In this example, an example in which the display system is a head-up display system is used for explanation. The functional framework of the vehicle may include various subsystems, such as a sensor system 12, a control system 14, one or more peripheral devices 16 (one is used as an example in the figure), a power supply 18, a computer system 20, and a head-up display system 22. Optionally, the vehicle may further include another functional system, such as an engine system that provides power to the vehicle. This is not limited in the present application.
[0199] The sensor system 12 may include several detection devices. The detection devices can sense measured information and convert the sensed information into an electrical signal or other information of a required form based on specific rules for output. As shown in the figure, the detection devices may include a global positioning system (GPS), a vehicle speed sensor, an inertial measurement unit (IMU), a radar unit, a laser range finder, a camera device, a wheel speed sensor, a steering sensor, a gear sensor, and other elements for automatic detection. This is not limited in the present application.
[0200] The control system 14 may include several elements, such as a steering unit, a braking unit, a lighting system, an automated driving system, a map navigation system, a network timing system, and an obstacle avoidance system, as shown. Optionally, the control system 14 may further include elements, such as a throttle controller and an engine controller, configured to control the driving speed of the vehicle, which is not limited in this application.
[0201] The peripheral device 16 may include several elements, such as a communication system, a touch screen, a user interface, a microphone, and a speaker. The communication system is configured to implement network communication between the vehicle and other devices other than the vehicle. In practical applications, the communication system may implement network communication between the vehicle and other devices using wireless communication technology or wired communication technology. Wired communication technology may mean communication between the vehicle and other devices using network cables, optical fibers, etc.
[0202] The power source 18 represents a system used to provide power or energy to the vehicle, and may include, but is not limited to, rechargeable lithium batteries and lead-acid batteries. In practical applications, one or more battery modules in the power source are configured to provide electrical energy or energy for starting the vehicle. The type and material of the power source are not limited in this application.
[0203] Some functions of the vehicle are controlled and performed by a computer system 20. The computer system 20 may include one or more processors 2001 (one processor is shown in the figure as an example) and a memory 2002 (which may also be called a storage device). In a practical application, the memory 2002 may be internal to the computer system 20 or external to the computer system 20, for example, used as a cache in the vehicle. This is not a limitation in the present application.
[0204] The processor 2001 may include one or more general-purpose processors, such as a graphics processing unit (GPU). The processor 2001 may be configured to execute associated programs or instructions corresponding to programs stored in the memory 2002 to perform corresponding functions of the vehicle.
[0205] The memory 2002 may include a volatile memory, such as a RAM. Alternatively, the memory may include a non-volatile memory, such as a ROM, a flash memory, a HDD, or a solid-state drive (SSD). Alternatively, the memory 2002 may include a combination of the aforementioned types of memory. The memory 2002 may be configured to store a program code or a set of instructions corresponding to the program code, such that the processor 2001 invokes the program code or instructions stored in the memory 2002 to implement corresponding functions of the vehicle. The functions include, but are not limited to, some or all of the functions in the schematic diagram of the vehicle's functional framework shown in FIG. 13b. In the present application, the memory 2002 may store a set of program code used to control the vehicle. The processor 2001 may control the safe operation of the vehicle by invoking the program code. A method for implementing the safe operation of the vehicle will be specifically described in detail below in the present application.
[0206] Optionally, in addition to storing program code or instructions, memory 2002 may further store information such as road maps, driving routes, and sensor data. Computer system 20 may perform vehicle-related functions in combination with other elements in the vehicle's functional framework schematic, such as sensors in a sensor system and a GPS. For example, computer system 20 may control the vehicle's driving direction, driving speed, etc. based on data input from sensor system 12. This is not a limitation of the present application.
[0207] The head-up display system 22 may include several elements, such as the windshield glass shown in the figure, a controller, and a head-up display. The controller 222 is configured to generate images (e.g., images including vehicle status such as vehicle speed and power / fuel amount, or images of augmented reality (AR) content) based on user commands and send the images to the head-up display for display. The head-up display may include a combination of an image generation unit and a reflector. The windshield glass is configured to cooperate with the head-up display to realize an optical path for the head-up display system, allowing a target image to be presented in front of the driver. It should be noted that the functions of some elements in the head-up display system may alternatively be performed by another subsystem of the vehicle. For example, the controller may alternatively be an element in a control system.
[0208] FIG. 13b of the present application shows that four subsystems are included. The sensor system 12, the control system 14, the computer system 20, and the head-up display system 22 are merely examples and do not constitute limitations. In actual applications, the vehicle may combine several elements in the vehicle based on different functions to obtain subsystems with corresponding different functions. In actual applications, the vehicle may include more or fewer systems or elements. This is not a limitation in the present application.
[0209] For example, the vehicle may be an intelligent vehicle, an electric vehicle, a digital vehicle, an automobile, a truck, a motorcycle, a bus, a boat, an airplane, a helicopter, a lawn mower, a recreational vehicle, a playground vehicle, construction equipment, a streetcar, a golf cart, a train, a dolly, etc. This is not a limitation of this application.
[0210] Based on the above and the same concept, the present application provides a color adjustment method. See the description in FIG. 14. The color adjustment method can be applied to the optical display device shown in any one of the embodiments in FIGS. 3 to 12a. It will also be understood that the color adjustment method can be implemented based on the optical display device shown in any one of the embodiments in FIGS. 3 to 12a. Alternatively, the color adjustment may be applied to the display system shown in any one of the foregoing embodiments, or to the vehicle shown in any one of the foregoing embodiments.
[0211] The color adjustment method may be performed by a controller. The controller may belong to the optical display device (e.g., a host processor in the optical display device) or may be a controller independent of the optical display device, such as a chip or chip system. If the controller belongs to the vehicle, the controller may be a domain processor in the vehicle, or an electronic control unit (ECU) in the vehicle, or a processing component in a light source module, or a processing component in a sensing module, etc.
[0212] The color adjustment method includes the following steps.
[0213] Step 1401. Control the light source module to emit light.
[0214] The light is synthesized by at least two colors of light. In one possible embodiment, the weight of the light of different colors input to the light source module can be controlled by controlling the weight of the current of the light source corresponding to the light of different colors. For the specific process, please refer to the above description of the light source module. The details will not be described again here.
[0215] Furthermore, the light from the light source module can be split into a first polarized light and a second polarized light by the light splitting module. For details, please refer to the above description of the light splitting module. The details will not be described again here.
[0216] Step 1402. Control a modulation module to modulate the second polarized light to obtain image light carrying image information.
[0217] For step 1402, please refer to the above description of the modulation module, and the details will not be described again here.
[0218] Step 1403. Control the sensing module to obtain color information of a first polarization.
[0219] For step 1403, please refer to the above description of the sensing module, and the details will not be described again here.
[0220] Step 1404: Control the light source module to adjust the weight of the at least two colors of light based on the color information.
[0221] For step 1404, please refer to the above description of Figures 9a and 10. The details will not be described again here.
[0222] In one possible implementation, a corresponding control signal may be sent to each module to control it.
[0223] From the above steps 1401 to 1404, it can be seen that the first polarization detected by the sensing module is used as color calibration of the light emitted by the light source module. Furthermore, the weights of the at least two colors of light in the composite light are adjusted based on the color information detected by the sensing module through the first polarization to perform color correction of the image light.
[0224] It should be understood that in order to implement the functions in the above-mentioned method embodiments, the control device includes corresponding hardware structures and / or software modules for performing each function. By referring to the modules and method steps in the examples described in the embodiments disclosed in the present application, those skilled in the art should easily understand that the present application can be implemented by hardware or a combination of hardware and computer software. Whether the functions are implemented by using hardware or by hardware driven by computer software depends on the specific application scenario and design constraints of the technical solution.
[0225] Based on the above and the same concept, Figures 15 and 16 are schematic diagrams of possible control device structures according to the present application. The control device may be configured to implement the functions of Figures 9a, 10, or 14 in the above method embodiments, and thus can also achieve the beneficial effects of the above method embodiments.
[0226] 15, the control device 1500 includes a processing module 1501 and may further include a transceiver module 1502. The control device 1500 is configured to perform the functions of the method embodiment shown in FIG.
[0227] 14, the processing module 1501 is configured to control the light source module to emit light, the modulation module to modulate the second polarization to obtain image light carrying image information, the sensing module to obtain color information of the first polarization, and the light source module to adjust weights of the at least two colors of light based on the color information. Optionally, the transceiver module 1502 is configured to transmit control signals to the light source module, the modulation module, the sensing module, etc.
[0228] It should be understood that the processing module 1501 in the embodiments of the present application may be implemented by a processor or circuit components associated with a processor, and the transceiver module 1502 may be implemented by associated circuit components such as an interface circuit.
[0229] Based on the foregoing and the same concept, the present application further provides a control device 1600, as shown in Fig. 16. The control device 1600 may include a processor 1601 and, optionally, may further include an interface circuit 1602. The processor 1601 and the interface circuit 1602 are coupled to each other. It will be understood that the interface circuit 1602 may be an input / output interface. Optionally, the control device 1600 may further include a memory 1603 configured to store computer programs, instructions, etc. to be executed by the processor 1601.
[0230] When the control device 1600 is configured to perform the functions of the method shown in FIG. 15, the processor 1601 is configured to perform the functions of the processing module 1501, and the interface circuit 1602 is configured to perform the functions of the transceiver module 1502.
[0231] Based on the above and the same concept, the present application provides a chip. The chip may include a processor and an interface circuit. Optionally, the chip may further include a memory. The processor is configured to execute a computer program or instructions stored in the memory to enable the chip to perform the method in any possible implementation of FIG. 14.
[0232] The method steps in the embodiments of the present application may be implemented in a hardware manner or by a processor executing software instructions. The software instructions may include corresponding software modules. The software modules may be stored in random access memory (RAM), flash memory, read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, a hard disk, a removable hard disk, a CD-ROM, or any other form of storage medium known in the art. For example, the storage medium may be coupled to the processor, thereby allowing the processor to read information from and write information to the storage medium. Of course, the storage medium may be a component of the processor. The processor and the storage medium may be located in an ASIC. The ASIC may also be located in an optical display device, a display system, or a vehicle. Of course, the processor and the storage medium may alternatively reside as discrete modules in the optical display device, display system, or vehicle.
[0233] All or part of the above-described embodiments may be implemented using software, hardware, firmware, or any combination thereof. When software is used to implement an embodiment, all or part of the embodiment may be implemented in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer programs or instructions are loaded and executed on a computer, the procedures or functions of the embodiments of the present application are performed, in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer program or instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer program or instructions may be transmitted from a website, computer, server, or data center to another website, computer, server, or data center via a wired or wireless method. The computer-readable storage medium may be any available medium accessible by a computer, or a data storage device, such as a server or data center, that integrates one or more available media. The available media may be magnetic media such as floppy disks, hard disks, or magnetic tapes, optical media such as digital video discs (DVDs), or semiconductor media such as solid state drives (SSDs).
[0234] In the embodiments of the present application, unless otherwise specified or there is no logical contradiction, the terms and / or descriptions between different embodiments are consistent and may be cross-referenced, and the technical features of different embodiments may be combined into a new embodiment based on their internal logical relationships.
[0235] In this application, "uniformity" does not mean absolute uniformity and may allow for technical error. "Perpendicular" does not mean absolute perpendicularity and may allow for technical error. "At least one" means one or more, and "multiple" means two or more. The term "and / or" describes an associative relationship between associated objects and indicates that three relationships may exist. For example, A and / or B may represent the following cases: only A is present, both A and B are present, and only B is present, where A and B may be singular or plural. "At least one of the following items (moieties)" or similar expressions refers to any combination of these items, including a singular item (moiety) or any combination of multiple items (moieties). For example, at least one of a, b, or c may refer to a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c may be singular or plural. In textual descriptions in this application, the character " / " typically indicates an "or" relationship between related objects. In formulas in this application, the character " / " indicates a "division" relationship between related objects. In this application, the symbol "(a,b)" represents an open interval greater than a and less than b, "[a,b]" represents a closed interval greater than a and less than b, "[a,b]" represents a half-open / semi-closed interval greater than a and less than b, and "[a,b]" represents a half-open / semi-closed interval greater than a and less than b, and "[a,b]" represents a half-open / semi-closed interval greater than a and less than b. Also, in this application, the term "example" is used to represent an example, illustration, or explanation. Any embodiment or design scheme described in this application as an "example" is not described as being preferred or having significant advantages over other embodiments or design schemes. Alternatively, it will be understood that the term "example" is used to concretely present concepts and does not constitute a limitation on this application.
[0236] It will be understood that various numbers in this application are used merely for distinction to facilitate description and are not used to limit the scope of the embodiments of this application. The sequential numbering of the aforementioned processes does not imply an execution order, and the execution order of the processes should be determined based on the function and internal logic of the processes. The terms "first," "second," and other similar expressions are intended to distinguish between similar objects but do not necessarily dictate a particular order or sequence. Furthermore, the terms "include," "have," and any variations thereof are intended to cover non-exclusive inclusions, for example, including a series of steps or units. A method, system, product, or device is not necessarily limited to the literally recited steps or units and may include other steps or units that are not literally recited or that are inherent to such a process, method, product, or device. [Explanation of symbols]
[0237] 100a projector, 100b display, 100c in-vehicle display screen, 300 optical display device, 301 light source module, 302 light splitting module, 303 modulation module, 304 sensing module, 700 optical display device, 701 light source module, 7011 first light source, 7012 second light source, 7013 third light source, 7014 first dichroic mirror, 7015 second dichroic mirror, 7016 compound lens, 702 polarizing beam splitter, 703 modulation module, 704 sensing module, 705 optical lens, 706 processing module, 710 optical display device, 711 light source module, 7111 first light source, 7112 second light source, 7113 third light source, 7114 first dichroic mirror, 7115 Second dichroic mirror, 7116; Compound lens, 712; Semi-transmissive reflector, 713; Modulation module, 714; Sensing module, 715; Optical lens, 716; Processing module, 720; Optical display device, 721; Light source module, 7211; First light source, 7212; Second light source, 7213; Third light source, 7214; First dichroic mirror, 7215; Second dichroic mirror, 7216; Compound lens, 722; Semi-transmissive reflector, 723; Modulation module, 724; Sensing module, 725; Optical lens, 726; Processing module, 727; Polarizer, 800; Optical display device, 801; Light source module, 8011; Processing component, 8012; Light splitting module, 803; Modulation module, 804; Sensing module, 805; Optical lens, 1101; Light source module, 1102 Light splitting module, 1103 Modulation module, 1104 Sensing module, 11041 Processing component, 11042 Detection component, 1105 Optical lens, 1200 Optical display device, 1201 Light source module, 1202 Light splitting module, 1203 Modulation module, 1204 Sensing module, 1205 Optical lens, 1206 Processing module, 1701 Host processor, 1702 External memory interface, 1703 Internal memory, 1704 Audio module, 1705 Video module, 1706 Power supply module, 1707 Wireless communication module, 1708 I / O interface, 1709Video interface, 1710 display circuit, 1711 modulator, 1712 light source, 12 sensor system, 14 control system, 16 peripheral device, 18 power supply, 20 computer system, 2001 processor, 2002 memory, 22 head-up display system, 1500 control device, 1501 processing module, 1502 transceiver module, 1600 control device, 1601 processor, 1602 interface circuit, 1603 memory
Claims
1. An optical display device including a light source module, a light dividing module, a modulation module, and a sensing module, The light source module is configured to emit light, and the light is composed of at least two colors of light; the light splitting module is configured to split the light from the light source module into a first light path and a second light path, and to propagate the first light path to the sensing module and the second light path to the modulation module; the modulation module is configured to modulate the second light path to obtain image light carrying image information; the sensing module is configured to obtain color information of the first light path, the color information being used by the light source module to adjust the weights of the light of the at least two colors; the light source module comprises a processing component and a light emitting component; The processing component includes: configured to receive the color information from the sensing module, generate a control signal based on the color information, and send the control signal to the light-emitting component, the control signal being for adjusting weights of the at least two colors of light; determining color coordinates of the image light based on the color information, and generating the control signal when a difference between the color coordinates of the image light and a predetermined target color coordinate is greater than a threshold value; It is configured as follows: the preset target color coordinates correspond to one operation mode, and the operation mode is selected from the group consisting of a snowy weather mode, a rainy weather mode, a sunny weather mode, a night mode, and a daytime mode; the light-emitting components are configured to adjust weights of the at least two colors of light based on the control signal; Optical display device.
2. the light splitting module includes a polarizing beam splitter; the first optical path is P-polarized and the second optical path is S-polarized; or The first optical path is S-polarized light and the second optical path is P-polarized light.
10. The apparatus of claim 1.
3. the light dividing module includes a semi-transmissive reflector; the first optical path is light transmitted from the semi-transmissive reflective portion, and the second optical path is light reflected from the semi-transmissive reflective portion; or The first optical path is light reflected from the semi-transmissive reflective unit, and the second optical path is light transmitted from the semi-transmissive reflective unit.
10. The apparatus of claim 1.
4. 10. The device of claim 1, wherein the light-emitting components include a first light source configured to emit red light, a second light source configured to emit blue light, and a third light source configured to emit green light.
5. the light source module further includes a first dichroic mirror and a second dichroic mirror; the first dichroic mirror is configured to reflect the blue light from the second light source and transmit the green light from the third light source; the second dichroic mirror is configured to reflect the red light from the first light source, transmit the green light transmitted by the first dichroic mirror, and transmit the blue light reflected by the first dichroic mirror.
5. The apparatus of claim 4.
6. The optical display device further includes an optical lens; the optical lens is configured to project the image light output by the modulation module into a spatial domain; 10. The apparatus of claim 1.
7. A display system comprising the optical display device according to any one of claims 1 to 6 and a spatial light expansion module arranged in a spatial region, the spatial light expansion module is configured to expand an image corresponding to the image light from the optical display device; Display system.
8. The spatial light expanding module comprises: at least one curved reflector; and at least one cylindrical mirror; 8. The system of claim 7, comprising any one or any combination of:
9. A vehicle including the display system of claim 7 and a windshield, the windshield is configured to reflect and image image light from the display system; Vehicle.
10. A color adjustment method applied to an optical display device, the optical display device including a light source module, a light dividing module, a modulation module, and a sensing module; The color adjustment method includes: controlling the light source module to emit light, wherein the light is combined by at least two colors of light, and the light is split into a first light path and a second light path via the light splitting module; controlling the modulation module to modulate the second optical path to obtain image light carrying image information; controlling the sensing module to acquire color information of the first optical path; controlling the light source module to adjust the weights of the light of the at least two colors based on the color information; Including, controlling the light source module to adjust the weights of the at least two colors of light based on the color information; determining color coordinates of the image light based on the color information; generating a control signal when a difference between the color coordinates of the image light and a preset target color coordinate is greater than a threshold, the control signal being for controlling and adjusting weights of the at least two colors of light; sending the control signal to the light source module; controlling the light source module to adjust the weights of the at least two colors of light based on the control signal; Including, the preset target color coordinates correspond to one operation mode, and the operation mode is selected from the group consisting of a snowy weather mode, a rainy weather mode, a sunny weather mode, a night mode, and a daytime mode; Color adjustment method.
Citation Information
Patent Citations
Head-up display
JP1997179060A
Head up display device
JP2005138801A
Drive sense adjusting device and drive sense adjusting method
JP2006069522A
Head-up display
JP2010149734A
Liquid crystal display device
JP2010276893A