Optical display device, display system, vehicle, and color adjustment method

Abstract

The optical display device includes a light source module configured to emit light (the light is combined with at least two colors of light), a light splitting module configured to split the light into a first light path and a second light path, propagating the first light path to a sensing module and propagating the second light path to a modulation module, a modulation module configured to modulate the second light path to obtain image light carrying image information, and a sensing module configured to obtain color information of the first light path, where the color information is for adjusting weights of the at least two colors of light.

Description

[Technical field]

[0001] The present application relates to the field of image display technology, and in particular to an optical display device, a display system, a vehicle, and a color adjustment method. [Background technology]

[0002] With the continuous development of technology, increasingly higher requirements are imposed on the convenience and safety of vehicle use. For example, the widespread application of head up display (HUD) (or called head-up display) systems can improve the safety of vehicle use. A head-up display system is a system that projects driving-related information (such as instrument information and navigation information) into the driver's forward field of vision. The driver can see the instrument information and navigation information in front of his field of vision, without having to look down to observe the dashboard or central control display screen under the steering wheel, which increases the braking response time in an emergency and improves driving safety.

[0003] Vehicles run in complex environments. For example, different seasons may produce a humid environment in spring, a hot and stormy environment in summer, a windy environment in autumn, and a cold and snowy environment in winter. All of these may affect the components in the HUD to some extent. Therefore, the HUD needs to set a specific operation mode based on the specific environment. In this case, the image (or called a picture) displayed by the optical display device (or called an optical machine) in the HUD may be set to a specific brightness and color (which may be represented by color coordinates). However, environmental differences may cause the image displayed by the optical display device to have color cast, brightness attenuation, etc. Color cast means that the color of the displayed real image is obviously different from the color of the real image.

[0004] In conclusion, how to reduce the color cast of an image displayed by an optical display device is currently an urgent technical problem that needs to be solved. Summary of the Invention [Means for solving the problem]

[0005] The present application provides an optical display device, a display system, a vehicle, and a color adjustment method that reduces color cast in an image displayed by the optical display device.

[0006] According to a first aspect, the present application provides an optical display device. The optical display device includes a light source module, a light splitting module, a modulation module, and a sensing module. The light source module is configured to emit (output) light. The light is combined by at least two colors of light. The light splitting module is configured to split light from the light source module into a first light path and a second light path, propagate the first light path to the sensing module, and propagate the second light path to the modulation module. The modulation module is configured to modulate the second light path to obtain image light carrying image information. The sensing module is configured to obtain color information of the first light path. The color information is used by the light source module to adjust the weight of the at least two colors of light. The module may be referred to as a component or a module, for example, a light source component, a light source module, a modulation component, and a modulation module.

[0007] Based on this solution, the color information of the light currently emitted by the light source module can be detected by the sensing module, i.e., the first optical path can be used as a color calibration of the light emitted by the light source module. Furthermore, based on the color information detected by the sensing module based on the first optical path, the weights of the at least two colors of light of the composite light are adjusted, so that the color correction of the image light can be implemented without increasing the optical structure, which is helpful to reduce the color cast (or called chromatic aberration) of the image displayed by the optical display device.

[0008] For example, the following shows three possible solutions for adjusting the weights of at least two colors of light based on color information:

[0009] Embodiment 1: The light source module adjusts the weights of at least two colors of light based on color information. In one possible implementation, the light source module includes a processing component and a light emitting component. The processing component is configured to receive color information from the sensing module, generate a control signal for adjusting weights of the at least two colors of light based on the color information, and send the control signal to the light emitting component. The light emitting component is configured to adjust weights of the at least two colors of light based on the control signal.

[0010] According to embodiment 1, the processing component in the light source module may control the light emitting component to adjust the light weight of each color of the composite light based on the color information obtained from the sensing module, so as to reduce the color cast of the image formed based on the light as much as possible. Also, since the sensing module is mainly configured to detect the color information of the first light path, the structure and operation logic of the existing sensing module do not need to be changed, so that the existing sensing module is compatible.

[0011] Further, optionally, the processing component is specifically configured to determine color coordinates of the image light based on the received color information, and generate a control signal when a difference between the color coordinates of the image light and the preset target color coordinates is greater than a threshold value.

[0012] The control signal is generated when the difference between the color coordinates of the image light and the preset target color coordinates is greater than a threshold value, so that the light weights of each color of the composite light are avoided from being adjusted frequently, thereby reducing the amount of operation of the processing components.

[0013] Embodiment 2: The sensing module controls the light source module to adjust the weights of at least two colors of light based on color information. In one possible implementation, the sensing module is configured to obtain color information of the first light path, generate a control signal based on the color information, and send the control signal to the light source module for adjusting weights of the at least two colors of light.

[0014] According to embodiment 2, the light source module can be controlled by the sensing module to adjust the weight of at least two colors of light. The structure and operation logic of the existing light source module need not be changed, so the existing light source module is compatible.

[0015] Implementation 3: A processing component (sometimes referred to herein as a processing module) independent of the light source module and the sensing module may control the light source module to adjust the weights of at least two colors of light based on color information. In one possible embodiment, the optical display device further includes a processing module configured to receive color information from the sensing module, generate a control signal based on the color information, and send the control signal to the light source module, where the control signal is for adjusting the weights of the at least two colors of light.

[0016] According to embodiment 3, when the existing sensing module and the light source module are compatible, the light source module can be controlled by the processing module to adjust the weight of the at least two colors of light. The processing component can be a processor.

[0017] In the above-mentioned embodiment 1, embodiment 2, and embodiment 3, the light source module may be configured to adjust the weights of the at least two colors of light based on the received control signal.

[0018] Further, optionally, the control signal may include a current weight of the light source corresponding to each color of light. It should be understood that a light source corresponding to one color of light refers to a light source that emits light of that color.

[0019] In one possible implementation, the light emitting components in the light source module include a first light source, a second light source, and a third light source.

[0020] Further, the first light source is configured to emit red light, the second light source is configured to emit blue light, and the third light source is configured to emit green light, and the weights of the red light, green light, and blue light can be adjusted by controlling the weights of the currents input to the first light source, the second light source, and the third light source.

[0021] Further, optionally, the light source module may further include a first dichroic mirror and a second dichroic mirror. The first dichroic mirror is configured to reflect blue light from the second light source and transmit green light from the third light source. The second dichroic mirror is configured to reflect red light from the first light source, transmit green light transmitted by the first dichroic mirror, and transmit blue light reflected by the first dichroic mirror. The dichroic mirror may be referred to as a dichromic mirror or a light combining mirror.

[0022] Based on the first dichroic mirror and the second dichroic mirror, the third light source for emitting green light can be arranged at a position farthest from the light splitting module. In this way, the brightness of the image can be balanced as much as possible. The green light has the greatest influence on the brightness of the image. The third light source is arranged at a position farthest from the light splitting module, so that the influence of the red light, the green light, and the blue light on the brightness of the image can be balanced as much as possible.

[0023] In one possible embodiment, the light splitting module includes a polarizing beam splitter configured to split the light from the light source module into a first polarization and a second polarization, propagating the first polarization to the sensing module and the second polarization to the modulation module, it being understood that the polarization states of the first polarization and the second polarization are different, but the color information, etc., are consistent.

[0024] Furthermore, the first polarization is P polarization and the second polarization is S polarization, or the first polarization is S polarization and the second polarization is P polarization.

[0025] The light from the light source module can be split into a first polarization and a second polarization by a polarizing beam splitter. Furthermore, the first polarization emitted into the sensing module can be S-polarized and correspondingly the second polarization emitted into the modulation module is P-polarized, or the first polarization emitted into the sensing module can also be P-polarized and correspondingly the second polarization emitted into the modulation module is S-polarized.

[0026] In another possible embodiment, the light splitting module includes a semi-transmissive reflector (e.g., a semi-transmissive semi-reflective portion). The first light path is light transmitted from the semi-transmissive reflector and the second light path is light reflected from the semi-transmissive reflector, or the first light path is light reflected from the semi-transmissive reflector and the second light path is light transmitted from the semi-transmissive reflector.

[0027] The light from the light source module may be split into a first optical path and a second optical path by the semi-transmissive reflector. The polarization states of the two optical paths may be the same.

[0028] Furthermore, optionally, when the light splitting module is a transflective part, the light source module may further include a polarizer, or the optical display device may further include a polarizer.

[0029] In one possible implementation, the optical display device may further include an optical lens, which is configured to project the image light output by the modulation module into the spatial domain.

[0030] The image light output by the modulation module may be shaped and / or uniformed by an optical lens to help improve the quality of an image formed based on the image light.

[0031] The optical display device provided in the first aspect may also be referred to as a picture generation unit (PGU) or optical machine, and the PGU may be used in a variety of display systems. For example, the PGU may be used in a projector, a head-up display system, a head-mounted optical display device, or a desktop display.

[0032] According to a second aspect, the present application provides a display system comprising an optical display device according to the first aspect or any one of the possible implementations of the first aspect, and a spatial light amplification module arranged in a spatial domain, the spatial light amplification module being configured to amplify an image corresponding to the image light from the optical display device.

[0033] The display system may include, but is not limited to, a projector, a HUD system, a desktop display, a head mounted optical display device, and the like.

[0034] For example, the spatial light amplification module may include at least one curved reflector, or may include at least one cylindrical mirror, or may include a combination of at least one curved reflector and at least one cylindrical mirror.

[0035] According to a third aspect, the present application provides a vehicle including a display system according to the second aspect or any one of the possible implementations of the second aspect, and a windshield, the windshield configured to reflect and image image light from the display system, e.g., to reflect the image light into an eye movement range (eyebox position) of the vehicle.

[0036] According to a fourth aspect, the present application provides a color adjustment method applicable to an optical display device, the optical display device including a light source module, a light splitting module, a modulation module and a sensing module.

[0037] The method includes controlling a light source module to emit light. The light is combined by at least two colors of light, and the light is split by a light splitting module into a first light path and a second light path. The method includes controlling a modulation module to modulate the second light path to obtain image light carrying image information. The method includes controlling a sensing module to obtain color information of the first light path. The method further includes controlling the light source module to adjust weights of the at least two colors of light based on the color information.

[0038] In one possible embodiment, a color coordinate of the image light can be determined based on the color information. If a difference between the color coordinate of the image light and the preset target color coordinate is greater than a threshold, a weight control signal for controlling and adjusting the at least two colors of light is generated, and the control signal is sent to the light source module to control the light source module to adjust the weight of the at least two colors of light based on the color information.

[0039] According to a fifth aspect, the present application provides a color adjustment device. The color adjustment device is configured to perform the method according to the fourth aspect or any one of the possible implementations of the fourth aspect, and includes corresponding functional modules respectively configured to perform the steps of the aforementioned method. The functions may be implemented by hardware or by executing corresponding software by the hardware. The hardware or software includes one or more modules corresponding to the aforementioned functions.

[0040] According to a sixth aspect, the present application provides an optical display device. The optical display device may include a light source module, a light splitting module, a modulation module, and a sensing module. The light source module is configured to emit light, and the light is combined by at least two colors of light. The light splitting module is configured to split light from the light source module into a first light path and a second light path, propagate the first light path to the sensing module, and propagate the second light path to the modulation module. The modulation module is configured to modulate the second light path to obtain image light carrying image information. The sensing module is configured to obtain color information of the first light path, generate a control signal based on the color information, and send the control signal to the light source module. The light source module is further configured to adjust weights of the at least two colors of light based on the control signal.

[0041] According to a seventh aspect, the present application provides an optical display device. The optical display device may include a light source module, a light splitting module, a modulation module, a sensing module, and a processing module. The light source module is configured to emit light, and the light is combined by at least two colors of light. The light splitting module is configured to split light from the light source module into a first light path and a second light path, propagate the first light path to the sensing module, and propagate the second light path to the modulation module. The modulation module is configured to modulate the second light path to obtain image light carrying image information. The sensing module is configured to obtain color information of the first light path and send the color information to the processing module. The processing module is configured to generate a control signal based on the color information and send the control signal to the light source module. The control signal is used by the light source module to adjust weights of the at least two colors of light. The light source module is further configured to adjust weights of the at least two colors of light based on the control signal.

[0042] According to an eighth aspect, the present application provides a chip, comprising at least one processor and an interface circuit. Optionally, the chip may further comprise a memory. The processor is configured to execute a computer program or instructions stored in the memory, such that the chip performs a method according to the fourth aspect or any one of the possible implementations of the fourth aspect.

[0043] According to a ninth aspect, the present application provides a computer readable storage medium storing a computer program or instructions which, when executed by a control device, enables the control device to perform a method according to the fourth aspect or any one of the possible implementations of the fourth aspect.

[0044] According to a tenth aspect, the present application provides a computer program product, the computer program product comprising a computer program or instructions which, when executed by a control device, enable the control device to perform a method according to the fourth aspect or any one of the possible implementations of the fourth aspect.

[0045] For the technical effects that can be achieved in any one of the second to tenth aspects, reference may be made to the above description of the beneficial effects in the first aspect, and details will not be described again here. [Brief description of the drawings]

[0046] [Figure 1a] FIG. 1 is a schematic diagram of a possible application scenario according to the present application. [Figure 1b] FIG. 1 is a schematic diagram of a possible application scenario according to the present application. [Figure 1c] FIG. 1 is a schematic diagram of a possible application scenario according to the present application. [Diagram 2] FIG. 2 is a schematic diagram of another possible application scenario according to the present application. [Diagram 3] 1 is a schematic diagram of the structure of an optical display device according to the present application; [Figure 4a] 1 is a schematic diagram of the structure of a light source module according to the present application; [Figure 4b] 1 is a schematic diagram of the structure of another light source module according to the present application; [Figure 4c] 1 is a schematic diagram of a structure of a light homogenizing component according to the present application. [Figure 5a] 1 is a schematic diagram of the light splitting principle of a polarizing beam splitter according to the present application; [Figure 5b] 1 is a schematic diagram of a structure of a semi-transmissive reflector according to the present application. [Figure 5c] FIG. 1 is a schematic diagram of the structure of a liquid crystal LCoS on silicon according to the present application. [Figure 6] 1 is a schematic diagram of the structure of an optical lens according to the present application; [Figure 7a] 2 is a schematic diagram of the structure of another optical display device according to the present application; [Figure 7b] 2 is a schematic diagram of the structure of yet another optical display device according to the present application; [Figure 7c] 2 is a schematic diagram of the structure of yet another optical display device according to the present application; [Figure 8] 2 is a schematic diagram of the structure of another optical display device according to the present application; [Figure 9a] 1 is a schematic flow chart of a color adjustment method according to the present application. [Figure 9b] 4 is a schematic diagram of the current of a PWM input to a light source module according to the present application. [Figure 10] 1 is a schematic flowchart of a method for adjusting a color initialization process of an image according to the present application. [Figure 11] 2 is a schematic diagram of the structure of another optical display device according to the present application; [Figure 12a] 2 is a schematic diagram of the structure of yet another optical display device according to the present application; [Figure 12b] 1 is a schematic diagram of a circuit for an optical display device according to the present application; [Figure 13a] 1 is a schematic diagram of a partial structure of a vehicle according to the present application; [Figure 13b]1 is a schematic diagram of a functional framework of a vehicle according to the present application; [Figure 14] 1 is a schematic flow chart of a color adjustment method according to the present application. [Figure 15] 1 is a schematic diagram of the structure of a control device according to the present application; [Figure 16] 1 is a schematic diagram of the structure of a control device according to the present application; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0047] Hereinafter, embodiments of the present application will be described in detail with reference to the accompanying drawings.

[0048] The following explains some terms in this application. Please note that these explanations are intended to facilitate understanding by those skilled in the art, but do not constitute a limitation on the scope of protection claimed in this application.

[0049] 1. Color coordinates Color coordinates are also called color coordinate systems. Color coordinates can accurately represent colors. Generally, the horizontal axis of a color coordinate is x and the vertical axis is y. A point on a chromaticity diagram may be determined using color coordinates. The point may also be called a color point. Color coordinates (x,y) may be used to represent a color point.

[0050] 2. Spectrum Spectrum usually refers to the sequential arrangement of dispersed monochromatic light based on wavelength (or frequency) after polychromatic light has been split by a dispersive system.

[0051] 3. Spectral Tristimulus Values Spectral tristimulus values ​​are numerical values ​​that approximately describe the three stimulus intensities of a color. In color matching, the three colors that can be mixed (also called composite) to produce any color are called the primary colors (or trichromats). Commonly, the three colors red, green, and blue are used as the primary colors. The quantities of the three primaries that match a color in the equal energy spectrum are called the spectral tristimulus values ​​and are represented by the symbols r, g, and b.

[0052] 4. Pulse width modulation (PWM) wave A pulse width modulated waveform is a pulse waveform with a variable duty cycle. In PWM, the amplitude of each pulse is equal. To change the amplitude of the equivalent output waveform, one only needs to change the width of each pulse based on the same proportionality factor. The principle of pulse width modulation is as follows: the on / off state of the switch element of the inverter circuit is controlled (for example, the conduction time of the switch element may be specifically controlled), so that the output end pulse obtains a series of pulses with the same amplitude, and the pulses are used to replace a sine wave or any desired waveform.

[0053] 5.Dichroic mirror The dichroic mirror may also be called a dichroic mirror, a dichroic mirror, or a light synthesis mirror. The characteristic is that light of a certain wavelength is almost completely transmitted, and light of other wavelengths is almost completely reflected. For example, the dichroic mirror 1 may transmit blue light and reflect green light. In other words, the blue light may be almost completely transmitted when transmitted to the dichroic mirror 1, and the green light may be almost completely reflected by the dichroic mirror 1. As another example, the dichroic mirror 2 may transmit blue light and green light and reflect red light. In other words, the blue light and green light may be almost completely transmitted when transmitted to the dichroic mirror 2, and the red light may be almost completely reflected by the dichroic mirror 2. In the present application, the light whose length is transmitted by the dichroic mirror and the light whose wavelength is reflected by the dichroic mirror are not limited. The dichroic mirror may be selected based on the actual requirements.

[0054] 6.3 colors The three colors are "primary colors" that cannot be obtained by mixing other colors. In general, the three colors refer to red, green, and blue, that is, R (Red), G (Green), and B (Blue). This can also be understood as the three primary colors being independent of each other, and any one of the primary colors cannot be obtained by mixing the other two primary colors.

[0055] The three primary colors can be combined (or called blended) based on different proportions (i.e., weights) to obtain different colored lights. The luminance of the combined light is determined based on the sum of the luminances of the three primary colors, and the chrominance (which can be represented by color coordinates) of the combined light is determined based on the weights of the three primary colors.

[0056] The above explains some terms in this application, and the following explains the technical solutions in this application.

[0057] The present application provides an optical display device, a display system, a vehicle, and a corresponding color adjustment method. The optical display device may be integrated into a projector 100a shown in FIG. 1a, which may project an image onto a wall or a projection screen. Alternatively, the optical display device may be integrated into a display 100b shown in FIG. 1b for use. Alternatively, the optical display device may be integrated into an in-vehicle display screen (e.g., as shown in 100c in FIG. 1c), which may be installed behind a seat of a vehicle, at a passenger position in front of the vehicle, and the like. The location for installing the in-vehicle display screen is not limited in the present application. Alternatively, the optical display device may be integrated into a head-up display system shown in FIG. 2, which may display driving assistance information.

[0058] Furthermore, optionally, the optical display device is integrated into a HUD system, and an example in which the HUD system is applied to a vehicle is used for the description. The HUD system can project a formed image (called a HUD virtual image) into the driver's forward field of view and aggregate this image with real road profile information to enhance the driver's perception of the real driving environment. For example, the HUD system may overlay a HUD virtual image with navigation information and / or instrument information (such as vehicle speed, rpm, temperature, oil level, etc.) on the real environment outside the vehicle, allowing the driver to obtain an augmented reality visual effect. Specifically, the system may be applied to scenarios such as AR navigation, adaptive tour, and lane departure warning. The HUD system includes, but is not limited to, a Windshield (W)-HUD system, an augmented reality head up display (AR-HUD), etc.

[0059] It should be understood that the above-mentioned scenarios are merely examples, and the methods and apparatus provided in the present application may be further applied to multiple scenarios, but are not limited to the scenarios shown in the above examples.

[0060] As described in the Background Art, since a vehicle runs in a complex environment, in order to adapt to different environments, the HUD needs to set a specific operation mode based on a specific environment, which may cause the image (also called picture) displayed by the optical display device in the HUD to be set to a specific color, which may cause problems such as color cast of the image displayed by the optical display device.

[0061] In view of this, the present application provides an optical display device, which can correct the color of an image to be displayed by detecting, via a sensing module, the color information of the light currently emitted by the light source module, thereby helping to reduce the color cast of the image displayed by the optical display device.

[0062] Based on the above, the optical display device provided in the present application will be specifically described below with reference to FIG. 3 to FIG.

[0063] FIG. 3 is a schematic diagram of the structure of an optical display device according to the present application. The optical display device 300 may include a light source module 301, a light splitting module 302, a modulation module 303, and a sensing module 304. The light source module 301 is configured to emit light and the light can be synthesized by at least two colors of light. For example, the light can be obtained by mixing red light, green light, and blue light. The light splitting module 302 is configured to split the light from the light source module 301 into a first light path and a second light path, propagate the first light path to the sensing module 304, and propagate the second light path to the modulation module 303, and the polarization states of the first light path and the second light path can be the same or different, and the color information, etc. are matched. The modulation module 303 is configured to modulate (e.g., perform amplitude modulation and / or phase modulation) the second light path to obtain image light. The image light is light carrying image information (such as navigation information and / or instrument information). The sensing module 304 is configured to obtain color information of the first light path, and the color information is used by the light source module to adjust the weights of the at least two colors of light.

[0064] Based on the aforementioned optical display device, the color information of the light currently emitted by the light source module can be detected by the sensing module, i.e., the first optical path can be used as color calibration of the light emitted by the light source module. Furthermore, based on the color information detected by the sensing module based on the first optical path, the weights of the at least two colors of light of the composite light are adjusted, so that the color correction of the image light can be implemented without increasing the optical structure, which is helpful to reduce the color cast of the image displayed by the optical display device.

[0065] It should be understood that the sum of the weights of the various colors of the at least two colors of the composite light is a fixed value (e.g., 100%). When the weight of the at least one color of the light is changed, the weight of the at least one color of the light of the other remaining colors is changed accordingly. In other words, adjusting the weights of the at least two colors of the light may be changing the weight of each color of the at least two colors, or changing the weight of some colors of the at least two colors (wherein the at least two colors may be three or more colors). This is not limited in the present application.

[0066] It should be noted that in the optical display device, the factor that is affected by the environment (e.g., temperature) and causes a large color cast of the image displayed by the optical display device is the light source module. Therefore, the color cast of the image can be effectively improved by monitoring the color information of the light emitted by the light source module.

[0067] The following describes the functional modules shown in Fig. 3 separately to provide an example of a specific implementation solution. For ease of description, the light source module, the light splitting module, the modulation module, and the sensing module are not provided with numerical identifiers in the following.

[0068] 1. Light source module In one possible embodiment, the light source module may include a light emitting component. For example, the light emitting component may include at least two light sources, and one light source may emit light of one color. The light source may be, for example, a laser diode (LD), a light emitting diode (LED), an organic light emitting diode (OLED), or a micro light emitting diode (micro-LED).

[0069] For example, the light-emitting component may include a first light source, a second light source, and a third light source. The first light source is configured to emit red light, the second light source is configured to emit blue light, and the third light source is configured to emit green light. This may also be understood as the light-emitting component may include an R light source, a G light source, and a B light source. The red light emitted by the first light source, the green light emitted by the third light source, and the blue light emitted by the second light source may be mixed to obtain lights of different colors. For example, white light may be obtained by mixing.

[0070] The following describes a possible structure of the light source module using an example in which the light-emitting components include a first light source, a second light source, and a third light source.

[0071] FIG. 4a is a schematic diagram of the structure of a light source module according to the present application. The light source module includes a light emitting component. The light emitting component includes a first light source, a second light source, and a third light source. The three light sources are arranged in a row. The three-color (RGB) lights emitted by the three light sources can be mixed to form white light. Furthermore, optionally, each light source further corresponds to a collimating mirror (e.g., a collimating lens or a curved reflector) to improve the uniformity of the light beam emitted by each light source. Specifically, the first light source corresponds to one collimating mirror, the second light source corresponds to one collimating mirror, and the third light source also corresponds to one collimating mirror.

[0072] Based on the light source module, lights of various colors can be mixed without passing through some optical elements (such as dichromic mirrors), which is conducive to miniaturization of the light source module and the optical display device.

[0073] Based on the light source module shown in Figure 4a, the spectrum of the light emerging from the light source module can be expressed as LED(λ). For details, please refer to the following formula in Equation 1. LED(λ)=LED B (λ)+LED G (λ)+LED R (λ) Equation 1

[0074] LED B (λ) represents the spectrum of the blue light emitted by the second light source, LED G (λ) represents the spectrum of the green light emitted by the third light source, the LED R (λ) represents the spectrum of the red light emitted by the first light source.

[0075] FIG. 4b is a schematic diagram of the structure of another light source module according to the present application. The light source module may include a light emitting component, a first dichroic mirror, and a second dichroic mirror. The light emitting component includes a first light source, a second light source, and a third light source. Three colors (RGB) of light are emitted by the three light sources. The first dichroic mirror is configured to reflect blue light from the second light source and transmit green light from the third light source to the second dichroic mirror. The second dichroic mirror is configured to reflect red light from the first light source, transmit green light transmitted by the first dichroic mirror, and transmit blue light reflected by the first dichroic mirror. This may also be understood as the red light from the first light source, the green light from the third light source, and the blue light from the second light source being mixed to form light after passing through the second dichroic mirror. In addition, optionally, in order to improve the uniformity of the light beam emitted by each light source, each light source may also correspond to one collimating mirror. For details, please refer to the description of Fig. 4a. The details will not be described again here.

[0076] Based on the light source module shown in FIG. 4b, the spectrum of the light emerging from the light source module LED(λ) is given by Equation 2 below. LED(λ)=LED B (λ)×T 1 (λ)×T 2 (λ)+LED G (λ)×R 1 (λ)×T 2 (λ)+LED R (λ)×R 2 (λ) Equation 2

[0077] LED B (λ) represents the spectrum of the blue light emitted by the second light source, LED G (λ) represents the spectrum of the green light emitted by the third light source, the LED R (λ) represents the spectrum of the red light emitted by the first light source, and T 1(λ) represents the transmission spectrum of the first dichroic mirror, and R 1 (λ) represents the reflectance spectrum of the first dichroic mirror, and T 2 (λ) represents the transmission spectrum of the second dichroic mirror, and R 2 (λ) represents the reflectance spectrum of the second dichroic mirror.

[0078] It should be noted that the positions of the first light source, the second light source, and the third light source in the light source module may be interchanged. In the structure of the light source module shown in Fig. 4b, if the positions of the first light source and the second light source are interchanged, the second dichroic mirror may be replaced by the third dichroic mirror correspondingly, and the third dichroic mirror may reflect blue light and transmit red light and green light. Details are not listed here one by one.

[0079] In order to improve the quality of the formed image (e.g., the brightness uniformity of the image), the light source module may further include a light homogenizing component. Specifically, the light formed by mixing the lights of various colors is first homogenized by the light homogenizing component, and then emitted to the light splitting module. The light homogenizing component may be a compound eye lens (see FIG. 4c) (or called a sub-eye) formed by a series of (e.g., two or more) lenses to compress the angle of the light, so that the light emitted to the light splitting module is more uniform.

[0080] Please note that the number of lenses included in the compound eye lens shown in Fig. 4c is merely an example. In the present application, the compound eye lens may include more lenses than the lenses in Fig. 4c, or may include fewer lenses than the lenses in Fig. 4c. This is not limited in the present application. It should be understood that the more sub-eyes included in the compound eye lens, the higher the light homogenization effect. There may also be one or more compound eye lenses. This is also not limited in the present application.

[0081] 2. Optical splitter module In one possible implementation, the light splitting module may split the light from the light source module into a first light path and a second light path.

[0082] The following shows two possible structures of the optical splitting module as examples.

[0083] In a first configuration, the light splitting module may be a polarizing beam splitter.

[0084] Based on the first structure, the first optical path and the second optical path have different polarization states, the first optical path may be referred to as a first polarization, and the second optical path may be referred to as a second polarization.

[0085] 5a is a schematic diagram of the light splitting principle of the polarizing beam splitter according to the present application. A polarizing beam splitter (PBS) is an optical device in which one or more layers of thin film are plated on the slant surface of a right-angle prism and then bonded together using an adhesive layer. Based on the fact that the transmittance of P-polarized light is 1 and the transmittance of S-polarized light is less than 1 when light is incident at Brewster's angle, the P-polarized light component is completely transmitted and the S-polarized light component is mostly reflected (at least 90%) after the light passes through the thin film at Brewster's angle multiple times. This can also be understood as the PBS having transmission and reflection properties, and generally, the reflectance of the PBS for S-polarized light is greater than 99.5%, and the transmittance of the PBS for P-polarized light is greater than 91%. For example, a polarizing beam splitter may split incident light (including P-polarized light and S-polarized light) into horizontally polarized light (i.e., P-polarized light) and vertically polarized light (i.e., S-polarized light). The P polarized light passes completely through the polarizing beam splitter, while the S polarized light is reflected at a 45 degree angle, forming a 90 degree angle between the outgoing direction of the S polarized light and the outgoing direction of the P polarized light.

[0086] In one possible implementation, the polarizing beam splitter is configured to split the light from the light source module into a first polarization and a second polarization, where the first polarization may be P polarization and correspondingly the second polarization is S polarization, or the first polarization is S polarization and the second polarization is P polarization.

[0087] Further, optionally, the light splitting module further reflects the first polarization (i.e., S polarization) to the sensing module and transmits the second polarization (i.e., P polarization) to the modulation module, or transmits the first polarization (i.e., P polarization) to the sensing module and reflects the second polarization (i.e., S polarization) to the modulation module.

[0088] In the second configuration, the light splitting module is a semi-transmissive reflector.

[0089] Based on the second structure, the polarization state of the first optical path and the second optical path is the same. For example, both the first optical path and the second optical path may be P-polarized light, or S-polarized light, or natural light. It should be noted that when both the first optical path and the second optical path are P-polarized light or S-polarized light, a corresponding polarizer may be added in the light source module or between the light source module and the light splitting module, and the corresponding polarizer may pass P-polarized light or pass S-polarized light.

[0090] In one possible embodiment, the semi-transmissive reflector may transmit a portion of the light from the light source module to obtain a first optical path, and may reflect a portion of the light to obtain a second optical path. This may also be understood as the first optical path being the light transmitted from the semi-transmissive reflector, and the second optical path being the light reflected from the semi-transmissive reflector. Alternatively, the semi-transmissive reflector may reflect a portion of the light from the light source module to obtain a first optical path, and may transmit a portion of the light to obtain a second optical path. This may also be understood as the first optical path being the light reflected from the semi-transmissive reflector, and the second optical path being the light transmitted from the semi-transmissive reflector.

[0091] For example, the semi-transparent reflector may be, for example, a light-emitting mirror, and the working part of the semi-transparent reflector may be plated on the plane of the light-emitting film (see FIG. 5b) to change the ratio of the incident light transmitted and the incident light reflected. For example, the light-emitting film may be plated on a transparent planar substrate to form the semi-transparent reflector. It should be noted that the semi-transparent reflector may select the reflectance and transmittance of the light-emitting film based on specific requirements. For example, the reflectance may be higher than 50% and the transmittance is less than 50%, or the reflectance may be less than 50% and the transmittance is less than 50%, or both the reflectance and the transmittance are equal to 50%, and this kind of semi-transparent reflector may also be called a semi-transparent and semi-reflective mirror, that is, the transmittance and the reflectance of the semi-transparent and semi-reflective mirror are 50% respectively. After the incident light passes through the semi-transparent and semi-reflective mirror, the intensity of the light transmitted and reflected by the semi-transparent and semi-reflective mirror accounts for 50% respectively.

[0092] Please note that the structures of the light splitting module provided above are just examples. The first structure may be understood as light splitting based on the principle of polarization state, and the second structure may be understood as light splitting based on light intensity (also called energy). Naturally, other structures in which the light from the light source module can be split into a first light path and a second light path also fall within the protection scope of the present application.

[0093] 3. Modulation module In one possible embodiment, the modulation module may include an image source (or called an optical data processing (ODP) unit) configured to modulate the received second polarization to obtain image light carrying image information. Specifically, the modulation module may perform spatial phase modulation on the second polarization to obtain image light carrying image information. The polarization state of the image light is the same as that of the first polarization. Therefore, after the modulation module reflects the image light to the light splitting module, the image light may be transmitted through the light splitting module to the spatial domain. When the second polarization is S-polarized, the modulation module performs spatial phase modulation on the second polarization, and the obtained image light is P-polarized, or when the second polarization is P-polarized, the modulation module performs spatial phase modulation on the second polarization, and the obtained image light is S-polarized.

[0094] For example, the modulation module may include, but is not limited to, an LCoS (see related description above) display, a liquid crystal display (LCD), a Digital Light Processing (DLP) display, a laser beam scanning (LBS) display, and the like.

[0095] FIG. 5c is a schematic diagram of the structure of liquid crystal on silicon (LCoS) according to the present application. Based on the complementary metal oxide semiconductor (COMS) process, liquid crystal is injected between the upper glass substrate and the lower silicon substrate of LCoS to form a liquid crystal layer. An electrode is arranged at the bottom of the liquid crystal layer. The working principle of LCOS is as follows: when the external voltage of the pixel of the liquid crystal layer is 0, the input S-polarized light passes through the liquid crystal layer, and the polarization direction is not deflected. The S-polarized light is reflected back at the bottom and output. After being reflected by the polarizing beam splitter, the S-polarized light is returned along the original path. When an external voltage is applied to the pixel, the input S-polarized light passes through the liquid crystal layer, and the polarization direction is deflected. The S-polarized light is reflected back at the bottom, and the P-polarized light is output. The P-polarized light passes directly through the polarizing beam splitter and is coupled into an optical lens, etc. Therefore, by changing the external voltage or current, the direction of the main axis of the liquid crystal molecules can be changed to change the refractive index of the LCoS and therefore the phase of the light passing through the LCoS. This is equivalent to using a phase retarder to rotate the polarization state of the light and cooperate with a polarizing beam splitter to perform light modulation. Based on the LCOS, a small display chip can be implemented, which contributes to the miniaturization of optical display devices.

[0096] It should be noted that the above modulation modules are merely examples, and other devices capable of modulating the light from the light source module to generate image light also fall within the scope of protection of the present application.

[0097] In one possible embodiment, when the light splitting module is a polarizing beam splitter as shown in the first structure, the modulation module may be, for example, an LCoS display or an LCD, or when the light splitting module is a semi-transmissive reflector as shown in the second structure, the modulation module may be, for example, an LCoS display, an LCD, a DLP display, or an LBS display.

[0098] 4. Sensing module In one possible implementation, the sensing module is configured to detect color information of the first polarization. For example, the color information may be represented by a spectrum. In particular, the sensing module may detect a first spectrum of the first polarization and convert information about the first spectrum into a first electrical signal. This may also be understood as the sensing module performing an optical-to-electrical conversion on the detected first spectrum of the first polarization to obtain a first electrical signal representing information about the first spectrum of the first polarization.

[0099] The first spectrum of the first polarization detected by the sensing module may be represented by Sensor(λ). If the first polarization is P-polarized light, see Equation 3 below for Sensor(λ), or if the first polarization is S-polarized light, see Equation 4 below for Sensor(λ): Sensor(λ)=LED(λ)×Tp(λ) Equation 3 Sensor(λ)=LED(λ)×Rs(λ) Equation 4

[0100] Tp(λ) represents the transmission spectrum of the optical division module, and Rs(λ) represents the reflection spectrum of the optical division module.

[0101] For example, the sensing module may include a detection component. For example, the detection component may include, but is not limited to, a photon detector (PD), a high-speed photodiode, a charge coupled device (CCD), a complementary metal-oxide-semiconductor (CMOS) phototransistor, a photodiode, etc. The sensing module may be, for example, a color sensor. A color sensor may also be called a color recognition sensor or color sensor, and may accurately distinguish between similar colors.

[0102] In addition, the color cast of the image formed based on the image light can be corrected based on the first electrical signal output by the sensing module and carrying information about the first spectrum. For the specific process, please refer to the description of Figure 9a and Figure 10 below. Details will not be described here.

[0103] In the present application, the optical display device may further include an optical lens. The optical lens may be configured to project the image light output by the modulation module into the spatial domain. Specifically, the optical lens may shape and / or uniformize and / or focus the image light output by the modulation module, and propagate the shaped and / or uniformized and / or focused image light into the spatial domain. When the optical display device is used in a display system (e.g., a projector, a HUD system, a desktop display, or a head-mounted optical display device), the optical lens may propagate the shaped and / or uniformized and / or focused image light to a spatial light amplification module arranged in the spatial domain (for details, please refer to the related description below).

[0104] FIG. 6 is a schematic diagram of the structure of an optical lens according to the present application. The optical lens may include at least one lens. FIG. 6 is an example in which three lenses are included. It should be noted that the number of lenses included in the optical lens is not limited in the present application and may be more or less than that in FIG. 6. Also, the type of lens is not limited in the present application. The lens may also include other lenses or combinations of other lenses, for example, plano-convex lenses or plano-concave lenses. Also, the optical lens may be rotationally symmetric about the optical axis of the optical lens. For example, the lens in the optical lens may be a spherical lens or a combination of multiple spherical lenses. Alternatively, the optical lens may be non-rotationally symmetric. For example, the lens in the optical lens may be an aspheric lens or a combination of multiple aspheric lenses. The combination of multiple spherical lenses and / or aspheric lenses helps to improve the imaging quality of the optical lens and reduce the aberration of the optical lens.

[0105] In one possible embodiment, the material of the lens in the optical lens may be an optical material such as glass, resin, or crystal. If the material of the lens is resin, it serves to reduce the quality of the detection system. If the material of the lens is glass, it serves to further improve the imaging quality of the detection system. Furthermore, in order to effectively suppress temperature drift, the optical lens includes at least one lens made of glass.

[0106] Based on the above, the following provides three specific structures of the aforementioned optical display device, in order to further understand the process of the aforementioned optical display device improving the color cast of the displayed image.

[0107] FIG. 7a is a schematic diagram of the structure of another optical display device according to the present application. The optical display device 700 may include a light source module 701, a polarizing beam splitter 702, a modulation module 703, a sensing module 704, and an optical lens 705. In addition, optionally, the optical display device may further include a processing module 706. In FIG. 7a, an example is used in which the light source module 701 has a first light source 7011, a second light source 7012, a third light source 7013, a first dichroic mirror 7014, a second dichroic mirror 7015, and a compound lens 7016. For a more detailed description of the other modules, please refer to the related description above. The details will not be described again here.

[0108] Based on the optical display device, the first light source 7011 emits red light, the second light source 7012 emits blue light, and the third light source 7013 emits green light. The propagation light paths of various colors are as follows: the green light is transmitted through the first dichroic mirror 7014 to the second dichroic mirror 7015, the blue light is reflected through the first dichroic mirror 7014 to the second dichroic mirror 7015, the green light and the blue light are transmitted through the second dichroic mirror 7015, and the red light is reflected by the second dichroic mirror 7015, and then combined with the blue light and the green light to become white light, which is transmitted to the polarizing beam splitter 702 after being homogenized by the compound lens 7016. The spectrum of the light emitted from the light source module can be expressed by the above-mentioned Equation 2.

[0109] Further, the light is split into a first polarization and a second polarization through the polarizing beam splitter 702, and the first polarization is transmitted to the sensing module 704 through the polarizing beam splitter 702. Based on this, for the first spectrum of the first polarization received by the sensing module 704, please refer to Sensor(λ) in the above Equation 3. Tp(λ) in Equation 3 is the transmission spectrum of the polarizing beam splitter. The second polarization is reflected to the modulation module 703 through the polarizing beam splitter 702. The modulation module 703 performs spatial phase modulation on the second polarization to obtain the image light (the polarization state of the image light is the same as that of the first polarization), and reflects the image light to the polarizing beam splitter 702. The image light is transmitted to the optical lens 705 through the polarizing beam splitter 702. Based on this, the second spectrum of the image light projected in the spatial domain can be expressed as Display(λ). For details, please refer to the following Equation 5: Display`(λ)=LED(λ)×Rs(λ)×LCoS(λ)×Tp(λ)×A`(λ) Equation 5

[0110] Rs(λ) represents the reflection spectrum of the light splitting module (here, the polarizing beam splitter 702 ), LCoS(λ) represents the reflection spectrum of the modulation module 703 , and A′(λ) represents the transmission spectrum of the optical lens 705 .

[0111] Therefore, it may be determined that the difference between the first spectrum detected by the sensing module 704 and the second spectrum projected into the spatial domain by the optical lens 705 may be represented by t. For details, see Equation 6 below.

number

[0112] Rs(λ), LCoS(λ) and A`(λ) may be obtained by testing such as a spectrophotometer.

[0113] Therefore, it can be seen that the relationship between the first spectrum detected by the sensing module 704 and the second spectrum projected into the spatial domain satisfies Equation 7 below. Display(λ)=t×Sensor(λ) Equation 7

[0114] It should be noted that Fig. 7a is described using an example where the first polarization is P polarization and the second polarization is S polarization. When the first polarization is S polarization and the second polarization is P polarization, the positions of the modulation module 703 and the sensing module 704 in Fig. 7a can be exchanged. Correspondingly, Rs(λ) in Equation 5 can be replaced with Tp(λ), and Tp(λ) can be replaced with Rs(λ), which is equivalent to Equation 5 remaining unchanged, and Rs(λ) in Equation 6 is replaced with Tp(λ).

[0115] Fig. 7b is a schematic diagram of the structure of yet another optical display device according to the present application. In the optical display device 710, the polarizing beam splitter 702 in Fig. 7a can be replaced with a semi-transmissive reflector 712. Specifically, the optical display device 710 may include a light source module 711, a semi-transmissive reflector 712, a modulation module 713, a sensing module 714, and an optical lens 715. In addition, optionally, the optical display device may further include a processing module 716. For a more detailed description of the modules, please refer to the above related description. The details will not be described again here.

[0116] Further, the light is split into a first optical path and a second optical path through the semi-transmissive reflector 712, and the first optical path is partially transmitted to the sensing module 714 through the semi-transmissive reflector 712. Based on this, for the first spectrum of the first optical path received by the sensing module 714, please refer to Sensor(λ) in the following Equation 3. Tp(λ) in Equation 3 is the transmission spectrum of the semi-transmissive reflector 712. The second optical path is reflected to the modulation module 713 through the semi-transmissive reflector 712. The modulation module 713 performs spatial phase modulation on the second optical path to obtain image light, and reflects the image light to the semi-transmissive reflector 712. The image light is transmitted to the optical lens 715 through the semi-transmissive reflector 712. Based on this, the second spectrum of the image light projected into the spatial domain can be expressed as Display(λ). For details, please refer to Equation 5 above. Here, Rs(λ) in formula 5 represents the reflection spectrum of the semi-transmissive reflective portion 712.

[0117] Therefore, it may be determined that the difference between the first spectrum detected by the sensing module 714 and the second spectrum projected into the spatial domain by the optical lens 715 may be represented by t. For details, please refer to Equation 6 above. The details will not be described again here.

[0118] It should be noted that Fig. 7b is described using an example in which the first optical path is the light of the transmissive part of the semi-transmissive reflector 712, and the second optical path is the light of the reflective part of the semi-transmissive reflector 712. When the first optical path is the light of the reflective part and the second optical path is the light of the transmissive part, the positions of the modulation module 713 and the sensing module 714 in Fig. 7b can be exchanged. Correspondingly, Rs(λ) in Equation 5 can be replaced with Tp(λ), and Tp(λ) can be replaced with Rs(λ), which is equivalent to Equation 5 remaining unchanged, and Rs(λ) in Equation 6 is replaced with Tp(λ).

[0119] FIG. 7c is a schematic diagram of the structure of yet another optical display device according to the present application. A polarizer 727 may be added to the optical display device 720 before (i.e., between the compound lens 7116 and the second dichroic mirror 7115) or after the compound lens 7116 of FIG. 7b. This may also be understood as the light source module 711 further including the polarizer 727. Alternatively, the polarizer 727 is added between the light source module 711 and the semi-transmissive reflector 712 of FIG. 7b. This may also be understood as the optical display device 720 further including the polarizer 727. The polarizer 727 may pass P-polarized light or S-polarized light. FIG. 7c uses an example in which the polarizer 727 is added between the light source module 721 and the semi-transmissive reflector 722, and the polarizer 727 passes P-polarized light. Specifically, the optical display device 720 may include a light source module 721, a semi-transmissive reflector 722, a modulation module 723, a sensing module 724, an optical lens 725, and a polarizer 727. In addition, optionally, the optical display device may further include a processing module 726. For more detailed descriptions of other modules, please refer to the related descriptions above. Details will not be described again here.

[0120] The difference between the spectra of the optical display device according to FIG. 7c and the spectra of the optical display device according to FIG. 7b is that the spectrum entering the semi-transmissive reflector 722 in FIG. 7c is the spectrum emerging from the light source module 721 LED(λ)×T 3 (λ), and T 3Note that (λ) is the transmission spectrum of polarizer 727.

[0121] To facilitate the explanation of the solution, the following provides an explanation using an example in which a first optical path is a first polarization, and the first polarization is P polarization, and a second optical path is a second polarization, and the second polarization is S polarization.

[0122] According to the above-mentioned relationship between the first spectrum and the second spectrum and the first spectrum of the first polarization detected by the sensing module, the color cast of the image formed by the image light corresponding to the second spectrum is corrected. The specific process can be performed by the processing component. The following provides a case-by-case description based on the module to which the processing component belongs.

[0123] Case 1: The processing component belongs to the light source module. It will also be understood that the light source module may further include a processing component. In other words, the light source module may include a light emitting component and a processing component. Furthermore, optionally, the light source module may further include a collimating mirror and / or a dichroic mirror.

[0124] FIG. 8 is a schematic diagram of the structure of another optical display device according to the present application. The optical display device may include a light source module 801, a light splitting module 802, a modulation module 803, a sensing module 804, and an optical lens 805. The light source module 801 includes a processing component 8011 and a light emitting component 8012. The sensing module 804 is configured to send the acquired color information to the processing component 8011. The processing component 8011 receives the color information from the sensing module 804, generates a control signal based on the color information, and sends the control signal to the light emitting component 8012. The light emitting component 8012 is configured to adjust the weight of at least two colors of light based on the control signal. For the specific process, please refer to the description of FIG. 9a below. For a more detailed description of the light source module 801, the light splitting module 802, the modulation module 803, the sensing module 804, and the optical lens 805, please refer to the above description. The details will not be described again here.

[0125] For example, a processing element may be a central processing unit (CPU), a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or another programmable logic device, a transistor logic device, a hardware component, or any combination thereof. A general purpose processor may be a microprocessor or any conventional processor.

[0126] 9a is a schematic flow chart of a color adjustment method according to the present application. The method may be performed by a processing component in the aforementioned light source module, and includes the following steps:

[0127] Step 901. A sensing module transmits information about a first spectrum to a processing component. In response, the processing component receives information about the first spectrum from the sensing module.

[0128] The information about the first spectrum may be carried in a first electrical signal, i.e., the sensing module transmits the first electrical signal to the processing component, where the first electrical signal includes information about the first spectrum.

[0129] Step 902. A processing component determines a second spectrum of the image light based on information about the first spectrum and a correspondence between the first spectrum and the second spectrum.

[0130] The first spectrum may be obtained by detecting the first polarization via the sensing module, and the second spectrum may be obtained based on the above Equation 7, i.e., Display(λ)=t×Sensor(λ), where the second spectrum is represented by Display(λ) and the first spectrum is represented by Sensor(λ).

[0131] Step 903. The processing component determines color coordinates of the image light based on the second spectrum and the correspondence between the spectrum and the color coordinates.

[0132] For the correspondence between spectra and color coordinates, see Equation 8 (Equation 2) and Equation 9 (Equation 3) below.

number

number

[0133] X, Y, and Z represent the spectral tristimulus values ​​of the standard observer, x and y represent the color coordinates, φ(λ) represents the spectral intensity distribution, and the integration interval is the visible light range, which can be, for example, [380,780] or even [400,700].

[0134] In addition, the second spectrum represented by the first spectrum (i.e., t × Sensor(λ)) may be substituted into Equation 8 and Equation 9 to obtain Equation 10 (Equation 4) and Equation 11 (Equation 5), and the color coordinates of the image light may be obtained based on Equation 10 (Equation 4) and Equation 11 (Equation 5).

number

number

[0135] This means that the color coordinates of the image light are (x real ,y real ) can also be understood as

[0136] Step 904. The processing component determines whether the weight of each color light needs to be adjusted based on the color coordinates of the image light and the preset target color coordinates, and performs the following step 905 if the weight needs to be adjusted, or performs the following step 906 if the weight does not need to be adjusted.

[0137] In one possible embodiment, the preset color coordinates (x target ,y target ) may be pre-stored. Furthermore, optionally, the optical display device may be of multiple operation modes (e.g., snow mode, rain mode, sunny mode, night mode, day mode). One operation mode may correspond to a group of preset color coordinates, and the group of preset color coordinates may be the color coordinates of white light. See Table 1. It should be understood that the preset target color coordinates may be one of the preset color coordinates.

[0138] [Table 1]

[0139] It should be noted that storing the correspondence between the operation modes and the preset color coordinates in the form of a table is merely an example, and the correspondence may alternatively be stored in another possible form, which is not a limitation of the present application.

[0140] Further, optionally, the user may select a group of preset color coordinates (the selected preset color coordinates are preset target color coordinates). The processing component detects the group of preset target color coordinates selected by the user and calculates the color coordinates (x real ,y real ) can be compared with the preset target color coordinates to determine whether the light weights of each color need to be adjusted. target -x real |, Δy=|y target -y real |. If at least one of Δx and Δy is greater than the threshold, it indicates that the color coordinates of the image light are not consistent with the preset target color coordinates, and the weights of the light of each color need to be adjusted. If both Δx and Δy are equal to or less than the threshold, it indicates that the color coordinates of the image light are consistent with the preset target color coordinates, and the weights of the light of each color do not need to be adjusted. The threshold may be, for example, 0.002.

[0141] Step 905. The processing component determines a light weight for each color and generates a control signal based on the light weight for each color.

[0142] For example, the light source module is of the structure shown in FIG. 4b. Taking into account the weight of the light of various colors, the second spectrum of the image light is given by the following LED (λ) target where a, m, and n are the weights of blue, green, and red light, respectively. LED(λ)target = a × LED B (λ)×T 1 (λ)×T 2 (λ) + m × LED G (λ)×R 1 (λ)×T 2 (λ) + n × LED R (λ)×R 2 (λ)

[0143] This is to adjust the light emitted by the light source and reduce the color cast of the image formed based on the image light by using a second spectrum LED (λ) target may also be understood as being adjusted by adjusting the weights of the red, green, and blue lights.

[0144] In one possible implementation, to adjust the weights of the lights of different colors, the weights of the currents of the light sources corresponding to the emitted lights of different colors can be adjusted. This can also be understood as the control signal including the current weights of each light source. For example, the light-emitting component includes a first light source, a second light source, and a third light source, and the processing component includes an I 1 :I 2 :I 3 By adjusting the weight a:m:n of the light of each color, the weight a:m:n of the light of each color can be adjusted.

[0145] Further, optionally, the processing component may adjust the current weights based on a color processing algorithm, which may be preset. For example, the weights of the currents input to one or more light sources are increased by a%, and the weights of the currents of the remaining light sources are decreased by a%, where a% may be 0.5%, 0.2%, 1%, etc. It should be noted that the sum of the current weights of the light sources corresponding to each color of light is 100%.

[0146] It should be understood that each light source input to the light source module has an initial current weight, which may be pre-stored or determined in an initialization process, see the description of FIG. 10 below for the initialization process.

[0147] For example, the current input to the light source module is a PWM current, and the light source module includes an R light source, a G light source, and a B light source. See FIG. 9b. The duty cycle of the PWM input to the R light source, the G light source, and the B light source can be adjusted. In particular, the interval between two adjacent pulses can be changed (i.e., T 1 , T 2 , T 3 (The value of I is adjusted.) As another example, the current value (I) input to the R light source, the G light source, and the B light source may be changed. In this way, the weights of the currents input to the R light source, the G light source, and the B light source can be adjusted.

[0148] Step 906. The processing component controls the light emitting component to emit light of the corresponding color based on the initialized weights of the various color lights.

[0149] From the above step 901 to step 906, it can be seen that the color cast of the image formed by the image light corresponding to the second spectrum is corrected based on the relationship between the first spectrum and the second spectrum and the first spectrum of the first polarization detected by the sensing module, so as to help reduce the color cast of the image displayed by the optical display device. That is, the second polarization is multiplexed, and the color information detected by the sensing module is compared with the preset target color coordinates to perform color point adjustment, thereby performing color calibration.

[0150] 10 is a schematic flow chart of a method for adjusting the color initialization process of an image according to the present application. The method can be performed by a processing component in the above-mentioned light source module. In order to facilitate the description of the solution, the following uses an example in which the light source module includes a first light source, a second light source, and a third light source for description.

[0151] The method includes the following steps.

[0152] Step 1001. A processing component obtains a preset target color coordinate.

[0153] In one possible implementation, a group of preset color coordinates selected by a user may be detected, and the selected preset color coordinates are preset target color coordinates.

[0154] Step 1002. The processing component generates an initial signal based on the obtained preset target color coordinates and the preset correspondence between the color coordinates and the current weights.

[0155] The initial signal includes a weight for the current input to each light source.

[0156] In one possible embodiment, the correspondence between the preset color coordinates and the current weights may be represented in the following Table 2. The current weights corresponding to the preset target color coordinates may be determined based on the preset target color coordinates and Table 2. For example, if the preset target color coordinates are A(x target1 ,y target1 ), the corresponding current weight ratio is I 11 :I 12 :I 13 and the weight of the current included in the initial signal is I 11 :I 12 :I 13 It is.

[0157] [Table 2]

[0158] It should be noted that expressing the correspondence between the preset color coordinates, current weights and luminance in the form of a table is merely an example, and the correspondence may alternatively be expressed in another possible form, which is not limited in this application.

[0159] It should be further noted that Table 1 and Table 2 may be two independent tables or may be combined. This is not limited in the present application. Also, Table 1 and Table 2 may be stored in a memory or a register, and the processing component may obtain the data of Table 1 and Table 2 by calling the memory or the register. For the memory or the register, please refer to the related description below. The details will not be described again here.

[0160] Step 1003. The processing component sends an initial signal to the light emitting component. Thus, the light emitting component may receive the initial signal from the processing component.

[0161] For example, the light emitting components include a first light source, a second light source, and a third light source.

[0162] Step 1004. The light-emitting component may emit light of a corresponding color based on the received initial signal.

[0163] It should be noted that the process of Figures 9a and 10 can also be applied to brightness adjustment. In particular, the weight of the current may be replaced with the brightness, and the details will not be described again here.

[0164] Case 2: The processing component belongs to the sensing module. It will also be appreciated that the sensing module may further include a processing component, in other words, the sensing module may include a detection component and a processing component.

[0165] FIG. 11 is a schematic diagram of the structure of another optical display device according to the present application. The optical display device may include a light source module 1101, a light splitting module 1102, a modulation module 1103, and a sensing module 1104. The sensing module 1104 includes a processing component 11041 and a detection component 11042. The detection component 11042 can be configured to detect color information of a first polarized light and send the color information to the processing component 11041. The processing component 11041 is configured to generate a control signal based on the color information and send the control signal to the light source module 1101. Correspondingly, the light source module 1101 is configured to adjust the current weight of each color of the at least two colors of light based on the control signal. For a more detailed description of the light source module 801, the light splitting module 802, the modulation module 803, the sensing module 804, and the optical lens 805, please refer to the above description. The details will not be described again here.

[0166] For the process by which the processing component in the sensing module generates the control signal, please refer to the description of steps 902 to 905 in Fig. 9a, and the details will not be described again here.

[0167] Case 3: The processing component is separate from the sensing module and the light source module, e.g., the processing component may be referred to as the processing module.

[0168] It will also be appreciated that the optical display device may further include a processing module.

[0169] 12a is a schematic diagram of the structure of yet another optical display device according to the present application. The optical display device 1200 may include a light source module 1201, a light splitting module 1202, a modulation module 1203, a sensing module 1204, an optical lens 1205, and a processing module 1206. The sensing module 1204 is configured to obtain color information of a first polarization and send the color information to the processing module 1206. The processing module 1206 is configured to generate a control signal based on the color information and send the control signal to the light source module 1201. The light source module 1201 is further configured to adjust the weights of at least two colors of light based on the control signal.

[0170] For more detailed description of the light source module 1201, the light splitting module 1202, the modulation module 1203, the sensing module 1204, and the optical lens 1205, please refer to the above description. The details will not be described again here. For the process of the processing module generating the control signal, please refer to the description of steps 902 to 905 in Fig. 9a. The details will not be described again here.

[0171] It should be noted that the processing of Figures 9a and 10 may alternatively be performed by another module or structure that may have processing capabilities, such as an image processing control board of the ODP or an on-board controller. The on-board controller may be, for example, an independent controller, a domain controller in the vehicle, or an electronic control unit (ECU) in the vehicle. This is not limited in this application.

[0172] Based on the above-mentioned optical display device, without increasing the complexity of the optical system, a sensing module is added, which can adjust the current weight of the light-emitting components (e.g., light sources) in the light source module through feedback when the environment (e.g., temperature) changes, so that the light weight of each color of the composite light can be changed, and the optical display device can be guaranteed to display light in a certain color range, which helps to reduce the color cast of the image displayed by the optical display device.

[0173] 12b is a schematic diagram of the circuit of the optical display device according to the present application. The circuit in the optical display device mainly includes a host processor (host CPU) 1701, an external memory interface 1702, an internal memory 1703, an audio module 1704, a video module 1705, a power module 1706, a wireless communication module 1707, an I / O interface 1708, a video interface 1709, a display circuit 1710, a modulator 1711, etc. The host processor 1701 and its peripheral elements, such as the external memory interface 1702, the internal memory 1703, the audio module 1704, the video module 1705, the power module 1706, the wireless communication module 1707, the I / O interface 1708, the video interface 1709, and the display circuit 1710, may be connected via a bus. The host processor 1701 may also be called a front-end processor.

[0174] Also, the schematic diagrams of the circuits in the embodiments of the present application do not constitute any particular limitation on the optical display device. In some other embodiments of the present application, the optical display device may include more or less components than those shown in the figures, may combine some components, may split some components, or may have a different component arrangement. The components shown in the figures may be implemented by hardware, software, or a combination of software and hardware.

[0175] The host processor 1701 includes one or more processing units. For example, the host processor 1701 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a video codec, a Digital Signal Processor (DSP), a baseband processor, and / or a Neural-Network Processing Unit (NPU). The different processing units may be independent components or may be integrated into one or more processors.

[0176] A memory may further be disposed within the host processor 1701 and configured to store instructions and data. In some embodiments, the memory within the host processor 1701 is a cache. The memory may store instructions or data that have just been used or are used periodically by the host processor 1701. When the host processor 1701 needs to use the instructions or data again, the instructions or data may be directly retrieved from the memory. Repeated accesses are avoided and the latency of the host processor 1701 is reduced, thereby improving the efficiency of the optical display device. The host processor 1701 may execute the stored instructions to perform the color adjustment method described above.

[0177] In some embodiments, the optical display device may further include a number of Input / Output (I / O) interfaces 1708 coupled to the host processor 1701. The interfaces 1708 may include an Inter-Integrated Circuit (I2C) interface, an Inter-Integrated Circuit Sound (I2S) interface, a Pulse Code Modulation (PCM) interface, a Universal Asynchronous Receiver / Transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a General-Purpose Input / Output (GPIO) interface, a Subscriber Identity Module (SIM) interface, a Universal Serial Bus (USB) interface, and the like. The I / O interface 1708 may be connected to devices such as a mouse, touchpad, keyboard, camera, speaker / loudspeaker, microphone, or may be connected to physical buttons on an optical display device (such as volume buttons, brightness control buttons, power on / off button, etc.).

[0178] The external memory interface 1702 can be configured to connect to an external memory card, such as a Micro SD card, to expand the storage capability of the optical display device. The external memory card communicates with the host processor 1701 via the external memory interface 1702 to perform data storage functions.

[0179] The internal memory 1703 may be configured to store computer executable program code. The executable program code includes instructions. The internal memory 1703 may include a program storage area and a data storage area. The program storage area may store an operating system, applications required by at least one function (such as a calling function or a time setting function), and the like. The data storage area may store data created in the process of using the optical display device (such as a phone book or world time), and the like. The internal memory 1703 may also include a high-speed random access memory, and may further include a non-volatile memory, such as at least one magnetic disk storage device, a flash storage device, or a universal flash storage (UFS), and the like. The host processor 1701 performs various function applications and data processing of the optical display device by executing instructions stored in the internal memory 1703 and / or instructions stored in a memory located in the host processor 1701.

[0180] The optical display device may perform audio functions via the audio module 1704, application processor, etc., such as music playback and calling.

[0181] The audio module 1704 is configured to convert digital audio information to an analog audio signal output, and also to convert an analog audio input to a digital audio signal. The audio module 1704 may be further configured to encode and decode audio signals, e.g., play and record voice. In some embodiments, the audio module 1704 may be located on the host processor 1701, or some functional modules of the audio module 1704 may be located on the host processor 1701.

[0182] The video interface 1709 may receive audio and video signals from the outside, specifically, a High Definition Multimedia Interface (HDMI), a Digital Visual Interface (DVI), a Video Graphics Array (VGA), a Display Port (DP), etc. The video interface 1709 may further output video to the outside. When the optical display device is used for a head-up display, the video interface 1709 may receive a speed signal and an electrical quantity signal input by a peripheral device, and may further receive an AR video signal input from the outside. When the optical display device is used as a projector, the video interface 1709 may receive a video signal input by an external computer or terminal device.

[0183] The video module 1705 may decode the video input by the video interface 1709, for example, performing H.264 decoding. The video module may further encode the video collected by the optical display device, for example, performing H.264 encoding on the video collected by the external camera. The host processor 1701 may also decode the video input by the video interface 1709 and then output the decoded image signal to the display circuit 1710.

[0184] The display circuit 1710 and the modulator 1711 are configured to display a corresponding image. In this embodiment, the video interface 1709 receives a video source signal that is permanently input, and the video module 1705 performs decoding and / or digitization processing and outputs one or more image signals to the display circuit 1710. The display circuit 1710 drives the modulator 1711 to image the incident polarized light based on the input image signal, and outputs at least two image optical paths. The host processor 1701 may also output one or more image signals to the display circuit 1710.

[0185] In this embodiment, the display circuit 1710 and the modulator 1711 belong to the electronic elements in a modulation unit, and the display circuit 1710 may also be called a driving circuit.

[0186] The power supply module 1706 is configured to provide power to the host processor 1701 and the light source 1712 based on an input power (e.g., direct current). The power supply module 1706 may include a rechargeable battery, which may provide power to the host processor 1701 and the light source 1712. Light emitted by the light source 1712 is transmitted to the modulator 1711 for imaging to form an image light signal.

[0187] The wireless communication module 1707 may enable the optical display device to perform wireless communication with the outside. The wireless communication module may provide wireless communication solutions such as Wireless Local Area Networks (WLAN) (such as Wireless Fidelity (Wi-Fi) networks), Bluetooth (BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), and Infrared (IR). The wireless communication module 1707 may be one or more components incorporating at least one communication processor module. The wireless communication module 1707 receives electromagnetic waves through an antenna, performs frequency modulation and filtering processes on the electromagnetic wave signals, and transmits the processed signals to the host processor 1701. The wireless communication module 1707 further receives a signal to be transmitted from the host processor 1701, performs frequency modulation and amplification on the signal to be transmitted, converts the signal to be transmitted into an electromagnetic wave via an antenna, and radiates the electromagnetic wave.

[0188] In addition, the video data decoded by the video module 1705 may be received wirelessly via the wireless communication module 1707 or read from an external memory, in addition to being input by the video interface 1709. For example, the optical display device may receive video data from an in-vehicle information system via a terminal device or a wireless local area network in the vehicle, and the optical display device may further read audio and video data stored in an external memory.

[0189] Based on the structure and function principle of the optical display device described above, the present application further provides a display system. The display system includes an optical display device shown in any one of the above embodiments and a spatial light amplification module arranged in a spatial domain. The spatial light amplification module is configured to amplify an image corresponding to the image light from the optical display device. For example, the display system may include, but is not limited to, a projector, a HUD system, a desktop display, etc.

[0190] In one possible embodiment, the spatial light amplification module includes any one or combination of at least one curved reflector and at least one cylindrical mirror. The cylindrical mirror may have a one-dimensional curvature, so that one-dimensional shaping can be performed. It will also be understood that light is diverged or focused in one dimension, and light is reflected in another dimension. The cylindrical mirror may be, for example, a plano-convex cylindrical mirror or a plano-concave cylindrical mirror.

[0191] Based on the structure and function principle of the display system described above, the present application may further provide a vehicle. Figure 13a is a schematic diagram of a partial structure of a vehicle according to the present application. The vehicle may include the display system in any one of the above-mentioned embodiments and a windshield, and the windshield is configured to reflect and image the image light from the display system.

[0192] For example, the vehicle may be a vehicle, the display system may be a HUD system, and the windshield may be configured to reflect image light from the display system into the eye movement range of the vehicle (see FIG. 2).

[0193] When the optical display device of any one of the above embodiments is applied to a vehicle, the second spectrum may be represented by the following Equation 12: Display(λ)=LED(λ)×Rs(λ)×LCoS(λ)×Tp(λ)×A(λ) Equation 12

[0194] A(λ) represents the spectral sum of all optical elements passing from the optical lens to the human eye, including but not limited to optical lenses, spatial light amplifier modules, windshields, etc.

[0195] In one possible embodiment, the eye movement range may also be called eyebox, and the driver's eyes should be generally within the eye movement range. See FIG. 2. It should be understood that if the glasses are aligned with the center of the eyebox, a complete and clear virtual image can be seen. If the eye moves left and right, or up and down, at a point in each direction, the virtual image seen may be distorted, the color rendering may be wrong, or the virtual image seen may not even be displayed. Due to the different heights of drivers, the eye movement range is generally 130mm x 50mm. That is, there is a movement range of about ±50mm vertically and about ±130mm horizontally.

[0196] To prevent the entire windshield from being broken after being hit, the windshield generally includes two layers of glass and a layer of polyvinyl butyral (PVB) material sandwiched between the two layers of glass. The refractive index of the PVB material is close to that of glass. To illustrate the solution, the windshield may be simplified to a flat glass having a certain thickness (generally 4-5 mm). In one possible embodiment, the windshield includes a wedge-shaped windshield or a flat windshield.

[0197] It should be understood that the vehicle structure shown in Figure 13a is merely an example, and the vehicle may further include other devices, such as a steering wheel, a memory, and a wireless communication device.

[0198] 13b is a schematic diagram of a possible functional framework of a vehicle according to the present application. In this example, an example in which the display system is a head-up display system is used for explanation. The functional framework of the vehicle may include various subsystems, such as a sensor system 12, a control system 14, one or more peripheral devices 16 (one is used as an example in the figure), a power source 18, a computer system 20, and a head-up display system 22. Optionally, the vehicle may further include another functional system, such as an engine system that powers the vehicle. This is not limited in the present application.

[0199] The sensor system 12 may include several detection devices. The detection devices can sense the measured information and convert the sensed information into an electrical signal or other information of a required form based on a specific rule for output. As shown in the figure, the detection devices may include a global positioning system (GPS), a vehicle speed sensor, an inertial measurement unit (IMU), a radar unit, a laser range finder, a camera device, a wheel speed sensor, a steering sensor, a gear sensor, another element for automatic detection, etc. This is not limited in the present application.

[0200] The control system 14 may include several elements, such as a steering unit, a braking unit, a lighting system, an automated driving system, a map navigation system, a network timing system, and an obstacle avoidance system, as shown. Optionally, the control system 14 may further include elements, such as a throttle controller and an engine controller, configured to control the driving speed of the vehicle, which is not limited in this application.

[0201] The peripheral device 16 may include several elements, such as a communication system, a touch screen, a user interface, a microphone, and a speaker in the figure. The communication system is configured to implement network communication between the vehicle and other devices other than the vehicle. In practical applications, the communication system may implement network communication between the vehicle and another device using wireless communication technology or wired communication technology. The wired communication technology may mean using a network cable, optical fiber, etc. to communicate between the vehicle and another device.

[0202] The power source 18 represents a system used to supply power or energy to the vehicle, and may include, but is not limited to, rechargeable lithium batteries and lead-acid batteries. In practical applications, one or more battery modules in the power source are configured to supply electrical energy or energy to start the vehicle. The type and material of the power source are not limited in this application.

[0203] Some functions of the vehicle are controlled and performed by a computer system 20. The computer system 20 may include one or more processors 2001 (one processor is shown in the figure as an example) and a memory 2002 (which may also be called a storage device). In a practical application, the memory 2002 may be internal to the computer system 20 or external to the computer system 20, for example, used as a cache in the vehicle. This is not a limitation in the present application.

[0204] The processor 2001 may include one or more general-purpose processors, such as a graphics processing unit (GPU). The processor 2001 may be configured to execute associated programs or instructions corresponding to programs stored in the memory 2002 to perform corresponding functions of the vehicle.

[0205] The memory 2002 may include a volatile memory, such as a RAM. The memory may alternatively include a non-volatile memory, such as a ROM, a flash memory, a HDD, or a solid-state drive SSD. The memory 2002 may alternatively include a combination of the aforementioned types of memory. The memory 2002 may be configured to store a program code or a set of instructions corresponding to the program code, so that the processor 2001 calls the program code or instructions stored in the memory 2002 to implement the corresponding function of the vehicle. The function includes, but is not limited to, some or all of the functions in the schematic diagram of the functional framework of the vehicle shown in FIG. 13b. In this application, the memory 2002 may store a set of program code used to control the vehicle. The processor 2001 may control the safe driving of the vehicle by calling the program code. The method of implementing the safe driving of the vehicle will be specifically described in detail below in this application.

[0206] Optionally, in addition to storing program codes or instructions, the memory 2002 may further store information such as road maps, driving routes, and sensor data. The computer system 20 may perform vehicle-related functions in combination with other elements in the vehicle's functional framework schematic, such as sensors in a sensor system and a GPS. For example, the computer system 20 may control the vehicle's driving direction, driving speed, etc. based on the data input of the sensor system 12. This is not limited in the present application.

[0207] The head-up display system 22 may include several elements, such as a windshield glass, a controller, and a head-up display as shown in the figure. The controller 222 is configured to generate images based on user commands (e.g., generate images including vehicle status such as vehicle speed and power / fuel amount, and images of augmented reality AR content) and send the images to the head-up display for display. The head-up display may include a combination of an image generation unit and a reflector. The windshield glass is configured to cooperate with the head-up display to realize the optical path of the head-up display system to enable a target image to be presented in front of the driver. It should be noted that the functions of some elements in the head-up display system may alternatively be performed by another subsystem of the vehicle. For example, the controller may alternatively be an element in a control system.

[0208] FIG. 13b of the present application shows that four subsystems are included. The sensor system 12, the control system 14, the computer system 20, and the head-up display system 22 are merely examples and do not constitute limitations. In actual applications, the vehicle may combine some elements in the vehicle based on different functions to obtain subsystems with corresponding different functions. In actual applications, the vehicle may include more or less systems or elements. This is not limited in the present application.

[0209] For example, the vehicle may be an intelligent vehicle, an electric vehicle, a digital vehicle, an automobile, a truck, a motorcycle, a bus, a boat, an airplane, a helicopter, a lawn mower, a recreational vehicle, a playground vehicle, construction equipment, a streetcar, a golf cart, a train, a dolly, etc., without limitation in this application.

[0210] Based on the above and the same concept, the present application provides a color adjustment method. Please refer to the description in Fig. 14. The color adjustment method can be applied to the optical display device shown in any one of the embodiments in Fig. 3 to Fig. 12a. It is also understood that the color adjustment method can be implemented based on the optical display device shown in any one of the embodiments in Fig. 3 to Fig. 12a. Alternatively, the color adjustment can be applied to the display system shown in any one of the embodiments in the past, or the vehicle shown in any one of the embodiments in the past.

[0211] The color adjustment method may be performed by a control device. The control device may belong to the optical display device (e.g., a host processor in the optical display device) or may be a control device independent of the optical display device, such as a chip or chip system. If the control device belongs to the vehicle, it may be a domain processor in the vehicle, or an electronic control unit (ECU) in the vehicle, or a processing component in the light source module, or a processing component in the sensing module, etc.

[0212] The color adjustment method includes the following steps.

[0213] Step 1401. A light source module is controlled to emit light.

[0214] The light is synthesized by at least two colors of light. In one possible embodiment, the weight of different colors of light input to the light source module can be controlled by controlling the weight of the current of the light source corresponding to the different colors of light. For the specific process, please refer to the above description of the light source module. The details will not be described again here.

[0215] In addition, the light from the light source module can be split into a first polarized light and a second polarized light by the light splitting module. For details, please refer to the above description of the light splitting module. The details will not be described again here.

[0216] Step 1402. Control a modulation module to modulate a second polarized light to obtain image light carrying image information.

[0217] For step 1402, please refer to the above description of the modulation module, and the details will not be described again here.

[0218] Step 1403. Control the sensing module to obtain color information of a first polarization.

[0219] For step 1403, please refer to the above description of the sensing module, and the details will not be described again here.

[0220] Step 1404. Control the light source module to adjust the weights of at least two colors of light based on the color information.

[0221] For step 1404, please refer to the above description of Figures 9a and 10. Details will not be described again here.

[0222] In one possible implementation, a corresponding control signal may be sent to each module to control it.

[0223] From the above steps 1401 to 1404, it can be seen that the first polarization detected by the sensing module is used as color calibration of the light emitted by the light source module. Furthermore, the weights of the at least two colors of the composite light are adjusted based on the color information detected by the sensing module through the first polarization to perform color correction of the image light.

[0224] It should be understood that in order to implement the functions in the above method embodiments, the control device includes corresponding hardware structures and / or software modules for performing each function. By referring to the modules and method steps in the examples described in the embodiments disclosed in the present application, those skilled in the art should easily understand that the present application can be implemented by hardware or a combination of hardware and computer software. Whether the function is performed by using hardware or by hardware driven by computer software depends on the specific application scenario and design constraints of the technical solution.

[0225] Based on the above and the same concept, Figures 15 and 16 are schematic diagrams of possible control device structures according to the present application. The control device may be configured to implement the functions of Figures 9a, 10, or 14 in the above method embodiments, and thus the beneficial effects of the above method embodiments may also be realized.

[0226] 15, the control device 1500 includes a processing module 1501, and may further include a transceiver module 1502. The control device 1500 is configured to perform the functions of the method embodiments shown in FIG.

[0227] 14, the processing module 1501 is configured to control the light source module to emit light, control the modulation module to modulate the second polarization to obtain image light carrying image information, control the sensing module to obtain color information of the first polarization, and control the light source module to adjust weights of the at least two colors of light based on the color information. Further, optionally, the transceiver module 1502 is configured to transmit control signals to the light source module, the modulation module, the sensing module, etc.

[0228] It should be understood that the processing module 1501 in the embodiments of the present application may be implemented by a processor or circuit components associated with a processor, and the transceiver module 1502 may be implemented by associated circuit components such as an interface circuit.

[0229] Based on the above and the same concept, the present application further provides a control device 1600, as shown in Fig. 16. The control device 1600 may include a processor 1601, and may further include an interface circuit 1602, optionally. The processor 1601 and the interface circuit 1602 are coupled to each other. It is understood that the interface circuit 1602 may be an input / output interface. Optionally, the control device 1600 may further include a memory 1603, configured to store computer programs, instructions, etc., executed by the processor 1601.

[0230] When the control device 1600 is configured to perform the functions of the method shown in FIG. 15, the processor 1601 is configured to perform the functions of the processing module 1501 and the interface circuit 1602 is configured to perform the functions of the transceiver module 1502.

[0231] Based on the above and the same concept, the present application provides a chip. The chip may include a processor and an interface circuit. In addition, optionally, the chip may further include a memory. The processor is configured to execute a computer program or instructions stored in the memory to enable the chip to perform the method in any possible embodiment of FIG. 14.

[0232] The method steps in the embodiments of the present application may be implemented in a hardware manner or in a manner of executing software instructions by a processor. The software instructions may include corresponding software modules. The software modules may be stored in a random access memory (RAM), a flash memory, a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a register, a hard disk, a removable hard disk, a CD-ROM, or any other form of storage medium known in the art. For example, the storage medium is coupled to the processor, such that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium may be a component of the processor. The processor and the storage medium may be located in an ASIC. The ASIC may also be located in an optical display device, a display system, or a vehicle. Of course, the processor and the storage medium may alternatively reside as discrete modules in the optical display, display system, or vehicle.

[0233] All or part of the above-mentioned embodiments may be implemented using software, hardware, firmware, or any combination thereof. When software is used to implement the embodiments, all or part of the embodiments may be implemented in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer programs or instructions are loaded and executed on a computer, the procedures or functions in the embodiments of the present application are performed in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer programs or instructions may be stored in a computer-readable storage medium or may be transmitted from one computer-readable storage medium to another. For example, the computer programs or instructions may be transmitted from a website, computer, server, or data center to another website, computer, server, or data center in a wired or wireless manner. The computer-readable storage medium may be any available medium accessible by a computer, or a data storage device, such as a server or data center, that integrates one or more available media. The available media may be magnetic media, such as a floppy disk, hard disk, or magnetic tape, optical media, such as a digital video disc (DVD), or semiconductor media, such as a solid state drive (SSD).

[0234] In the embodiments of the present application, unless otherwise specified or there is no logical contradiction, the terms and / or descriptions between different embodiments are consistent and may be cross-referenced, and the technical features of different embodiments may be combined into a new embodiment based on their internal logical relationships.

[0235] In this application, "uniformity" does not mean absolute uniformity and may allow for technical error. "Perpendicular" does not mean absolute perpendicularity and may allow for technical error. "At least one" means one or more, and "multiple" means two or more. The term "and / or" describes an association relationship between associated objects and indicates that three relationships may exist. For example, A and / or B may represent the following cases: only A is present, both A and B are present, and only B is present, where A and B may be singular or plural. "At least one of the following items (parts)" or similar expressions refers to any combination of these items, including any combination of singular items (parts) or multiple items (parts). For example, at least one of a, b, or c may refer to a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c may be singular or plural. In the textual description of this application, the character " / " generally indicates an "or" relationship between related objects. In the formulas of this application, the character " / " indicates a "division" relationship between related objects. In this application, the symbol "(a,b)" represents an open interval greater than a and less than b, "[a,b]" represents a closed interval greater than a and less than b, "(a,b]" represents a half-open semi-closed interval greater than a and less than b, and "(a,b)" represents a half-open semi-closed interval greater than a and less than b. Also, in this application, the term "example" is used to represent an example, illustration, or explanation. Any embodiment or design scheme described as an "example" in this application is not described as being preferred or having more advantages than other embodiments or design schemes. Alternatively, it will be understood that the term "example" is used to concretely present a concept and does not constitute a limitation on this application.

[0236] It will be understood that various numbers in this application are merely used for distinction to facilitate description, and are not used to limit the scope of the embodiments of this application. The sequential numbers of the above processes do not imply an order of execution, and the order of execution of the processes should be determined based on the functions and internal logic of the processes. The terms "first", "second", and other similar expressions are intended to distinguish similar objects, but do not necessarily indicate a particular sequence or order. In addition, the terms "include", "have", and any variations thereof are intended to cover non-exclusive inclusion, for example, including a series of steps or units. A method, system, product, or device is not necessarily limited to the steps or units listed verbatim, and may include other steps or units not listed verbatim or inherent to such a process, method, product, or device. [Explanation of symbols]

[0237] 100a projector, 100b display, 100c in-vehicle display screen, 300 optical display device, 301 light source module, 302 light splitting module, 303 modulation module, 304 sensing module, 700 optical display device, 701 light source module, 7011 first light source, 7012 second light source, 7013 third light source, 7014 first dichroic mirror, 7015 second dichroic mirror, 7016 compound lens, 702 polarizing beam splitter, 703 modulation module, 704 sensing module, 705 optical lens, 706 processing module, 710 optical display device, 711 light source module, 7111 first light source, 7112 second light source, 7113 third light source, 7114 first dichroic mirror, 7115 Second dichroic mirror, 7116 Compound lens, 712 Semi-transmissive reflector, 713 Modulation module, 714 Sensing module, 715 Optical lens, 716 Processing module, 720 Optical display device, 721 Light source module, 7211 First light source, 7212 Second light source, 7213 Third light source, 7214 First dichroic mirror, 7215 Second dichroic mirror, 7216 Compound lens, 722 Semi-transmissive reflector, 723 Modulation module, 724 Sensing module, 725 Optical lens, 726 Processing module, 727 Polarizer, 800 Optical display device, 801 Light source module, 8011 Processing component, 8012 Light-emitting component, 802 Light splitting module, 803 Modulation module, 804 Sensing module, 805 Optical lens, 1101 Light source module, 1102 Light splitting module, 1103; Modulation module, 1104; Sensing module, 11041; Processing component, 11042; Detection component, 1105; Optical lens, 1200; Optical display device, 1201; Light source module, 1202; Light splitting module, 1203; Modulation module, 1204; Sensing module, 1205; Optical lens, 1206; Processing module, 1701; Host processor, 1702; External memory interface, 1703; Internal memory, 1704; Audio module, 1705; Video module, 1706; Power module, 1707; Wireless communication module, 1708; I / O interface, 1709Video interface, 1710 display circuit, 1711 modulator, 1712 light source, 12 sensor system, 14 control system, 16 peripheral device, 18 power supply, 20 computer system, 2001 processor, 2002 memory, 22 head-up display system, 1500 control device, 1501 processing module, 1502 transceiver module, 1600 control device, 1601 processor, 1602 interface circuit, 1603 memory

Claims

1. An optical display device including a light source module, an optical splitting module, a modulation module, and a sensing module, wherein the light source module is configured to emit light, and the light is synthesized by at least two colors of light; the optical splitting module is configured to split the light from the light source module into a first optical path and a second optical path, propagate the first optical path to the sensing module, and propagate the second optical path to the modulation module; the modulation module is configured to modulate the second optical path to obtain image light carrying image information; the sensing module is configured to obtain color information of the first optical path, and the color information is used by the light source module to adjust the weights of the at least two colors of light; the light source module includes a processing component and a light emitting component; the processing component is configured to receive the color information from the sensing module, generate a control signal based on the color information, and transmit the control signal to the light emitting component, wherein the control signal is for adjusting the weights of the at least two colors of light; determine the color coordinates of the image light based on the color information, and generate the control signal when the difference between the color coordinates of the image light and preset target color coordinates is greater than a threshold; is configured as such; the preset target color coordinates correspond to one operation mode, and the operation mode is selected from the group consisting of a snow mode, a rainy day mode, a sunny day mode, a night mode, and a daytime mode; the light emitting component is configured to adjust the weights of the at least two colors of light based on the control signal; an optical display device.

2. The optical splitting module includes a polarization beam splitter, the first optical path is P-polarized light, and the second optical path is S-polarized light, or the first optical path is S-polarized light, and the second optical path is P-polarized light; the device according to Claim 1.

3. The optical splitting module includes a semi-transmissive reflection part, the first optical path is the light transmitted from the semi-transmissive reflection part, and the second optical path is the light reflected from the semi-transmissive reflection part, or the first optical path is the light reflected from the semi-transmissive reflection part, and the second optical path is the light transmitted from the semi-transmissive reflection part; the device according to Claim 1.

4. The light-emitting component includes a first light source configured to emit red light, a second light source configured to emit blue light, and a third light source configured to emit green light, and the apparatus according to claim 1.

5. The light source module further includes a first dichroic mirror and a second dichroic mirror, The first dichroic mirror is configured to reflect the blue light from the second light source and transmit the green light from the third light source, The second dichroic mirror is configured to reflect the red light from the first light source, transmit the green light transmitted by the first dichroic mirror, and transmit the blue light reflected by the first dichroic mirror, The apparatus according to claim 4.

6. The optical display device further includes an optical lens, The optical lens is configured to project the image light output by the modulation module into a spatial region. The apparatus according to claim 1.

7. A display system including the optical display device according to any one of claims 1 to 6 and a spatial light expansion module disposed in a spatial region, The spatial light expansion module is configured to expand an image corresponding to the image light from the optical display device. Display system.

8. The spatial light expansion module includes at least one curved mirror, and at least one cylindrical mirror, The system according to claim 7, comprising any one or an arbitrary combination thereof.

9. A vehicle including the display system according to claim 7 and a windshield, The windshield is configured to reflect and image the image light from the display system. Vehicle.

10. A color adjustment method applied to an optical display device, the optical display device including a light source module, a light splitting module, a modulation module, and a sensing module, The color adjustment method includes: controlling the light source module to emit light, the light being synthesized by at least two colors of light, and the light being split into a first optical path and a second optical path through the light splitting module; controlling the modulation module to modulate the second optical path to obtain image light carrying image information. Controlling the sensing module to obtain color information of the first optical path; Controlling the light source module to adjust the weights of the at least two colors of light based on the color information; including; The step of controlling the light source module to adjust the weights of the at least two colors of light based on the color information includes: Determining the color coordinates of the image light based on the color information; When the difference between the color coordinates of the image light and preset target color coordinates is greater than a threshold value, generating a control signal, wherein the control signal is for controlling and adjusting the weights of the at least two colors of light; Transmitting the control signal to the light source module; Controlling the light source module to adjust the weights of the at least two colors of light based on the control signal including; The preset target color coordinates correspond to one operation mode, and the operation mode is selected from the group consisting of a snow mode, a rain mode, a sunny mode, a night mode, and a daytime mode; Color adjustment method.

Images