Display device, electronic device, and vehicle

Abstract

The present application provides a display device, an electronic device, and a vehicle. The display device includes a picture generation unit, an imaging reflector, a detection unit, and a processing unit. The detection unit is disposed on the rear side of the imaging reflector. The picture generation unit is configured to generate an image and transmit image light of the image to the imaging reflector. The imaging reflector is configured to reflect the image light to generate a virtual image of the image. The detection unit is configured to collect a first signal light transmitted through the imaging reflector, the first signal light being light reflected by an eye of a user viewing the virtual image. The processing unit is configured to determine a position of the user's eye based on the first signal light collected by the detection unit, and the propagation direction of the image light reflected by the imaging reflector is parallel to the propagation direction of the first signal light. Thus, the position of the user's eye can be accurately detected when the user views a virtual image displayed by the display device.

Description

[Technical field]

[0001] This application claims priority to Chinese Patent Application No. 202111447555.7, entitled “DISPLAY APPARATUS, ELECTRONIC DEVICE, AND VEHICLE,” filed with the China National Intellectual Property Office on November 30, 2021, which is incorporated by reference in its entirety. The present application relates to the field of image display, and in particular to displays, electronic devices, and vehicles. [Background technology]

[0002] Currently, display devices with virtual imaging capabilities can generate virtual images that are long-distance and enlarged relative to the real image of the display target, allowing users to experience more realistic viewing effects and stronger immersion, and are widely used in fields such as augmented reality (AR) and entertainment displays. In order to improve the user's experience of viewing the virtual image, an eye detection device is usually used to detect the user's eyes, so that the generated image matches the position of the user's eyes, reducing the distortion of the virtual image and presenting a good virtual image. However, currently, display devices with virtual imaging capabilities lack effective technical means for accurately detecting the position of the user's eyes when the user views the virtual image displayed by the display device. Summary of the Invention

[0003] The embodiments of the present application provide a display device, an electronic device, and a vehicle for accurately detecting the eye position of a user viewing a virtual image displayed by the display device.

[0004] According to a first aspect, an embodiment of the present application provides a display device including a picture generation unit, an imaging reflector, a detection unit, and a processing unit. The detection unit is disposed behind the imaging reflector. The picture generation unit is configured to generate an image and transmit image light of the image to the imaging reflector. The imaging reflector is configured to reflect the image light to generate a virtual image of the image. The detection unit is configured to collect a first signal light transmitted through the imaging reflector, the first signal light being light reflected by an eye of a user viewing the virtual image. The processing unit is configured to determine a position of the user's eye based on the first signal light collected by the detection unit. A propagation direction of the image light reflected by the imaging reflector is parallel to a propagation direction of the first signal light.

[0005] According to the display device provided in the first aspect, the detection unit is disposed behind the imaging reflector, so that the propagation direction of the image light reflected by the imaging reflector is parallel to the propagation direction of the first signal light received by the detector. Therefore, the first signal light can accurately reflect the position of the user's eye viewing the virtual image, and the processing unit can obtain the accurate position of the eye based on the first signal light.

[0006] Optionally, the imaging reflector is configured to reflect visible light and transmit invisible light, wherein the image light is visible light and the first signal light is invisible light, or the imaging reflector is configured to reflect a first polarization and transmit a second polarization, wherein the polarization directions of the first polarization and the second polarization are perpendicular to each other, and wherein the image light is the first polarization and the first signal light is the second polarization.

[0007] The imaging reflector can reflect visible light and transmit invisible light, or can reflect the first polarized light and transmit the second polarized light. Based on this, reflection of the image light and transmission of the first signal light by the imaging reflector can be realized by making the image light visible light and the first signal light invisible light, or making the image light the first polarized light and the first signal light invisible light.

[0008] In one possible implementation, the curvature of the front surface of the imaging reflector matches the curvature of the rear surface of the imaging reflector to reduce aberrations and distortions introduced during light transmission.

[0009] In another possible implementation, the curvature of the front surface of the imaging reflector does not match the curvature of the rear surface of the imaging reflector. According to the display device provided in this implementation, the curvature of the front surface of the imaging reflector does not need to match the curvature of the rear surface of the imaging reflector, and instead, the image formed by the first signal light transmitted through the imaging reflector is corrected using an algorithm, or a lens is additionally provided for light compensation.

[0010] Optionally, the display device further includes a lens disposed between the imaging reflector and the detection unit, the lens configured to perform optical compensation on the first signal light transmitted through the imaging reflector and transmit the optically compensated first signal light to the detection unit.

[0011] When the curvatures of the front and back surfaces of the imaging reflector are not consistent, the lens may compensate for the first signal light transmitted through the imaging reflector to correct the image formed by the first signal light.

[0012] In one possible implementation, the detection unit is arranged on a connection line between a viewing position and a virtual image generated by the imaging reflector, the viewing position being the position of the user's eyes viewing the virtual image.

[0013] The display device provided in this implementation may reduce requirements for the field of view of the lens assembly of the detection unit.

[0014] In one possible implementation, the connecting line is perpendicular to the virtual image and passes through the center of the virtual image.

[0015] The display device provided in this implementation can ensure that the detection device is aligned with the line of sight of the user's both eyes, facilitating measurement of the user's gaze angle when viewing a virtual image, and further reduces the requirements for the field of view of the lens assembly of the detection unit, thereby reducing the cost of the display device.

[0016] In one possible implementation, the processing unit is further configured to generate image correction information based on the first signal light collected by the detection unit and transmit the image correction information to the picture generation unit, and the picture generation unit is further configured to adjust the generated image based on the image correction information.

[0017] According to the display device provided in this implementation, the virtual image generated by the imaging reflector can be aligned with the user's eye position and / or gaze direction to improve the user's viewing experience.

[0018] In one possible implementation, the imaging reflector is a viewing window.

[0019] The display device provided in this implementation allows a user to directly view a virtual image through an imaging reflector and is applicable to general displays such as desktop displays (displays on computers, televisions, etc.).

[0020] In one possible implementation, the image light reflected by the imaging reflector is reflected by a transparent reflector to form a virtual image of the image.

[0021] According to the display device provided in this implementation, the imaging reflector reflects the image light to the transparent reflector, so that the user sees a virtual image through the transparent reflector, which is applicable to scenarios where the imaging reflector is not used as a display screen, such as a Head-up Display (HUD) scenario.

[0022] In one possible implementation, the transparent reflector is the windshield of a vehicle.

[0023] According to the display device provided in this implementation, the display device may be used in a vehicle to implement a head-up display on the windshield of the vehicle.

[0024] According to a second aspect, an embodiment of the present application provides an electronic device, including the display device provided in the first aspect. For the specific structure and beneficial effects of the electronic device, please refer to the first aspect and possible implementation of the first aspect. Details are not repeated here.

[0025] According to a third aspect, the present application further provides a vehicle including a display device according to the first aspect. [Brief description of the drawings]

[0026] [Figure 1a] FIG. 1 is a schematic diagram of a display device used as a general display according to the present application. [Figure 1b] 1 is a schematic diagram of a display device for use as a television in accordance with the present application; [Figure 1c] 1 is a schematic diagram of a display device used as an in-vehicle display according to the present application; [Figure 1d] 1 is a schematic diagram of a head-up display system according to the present application. [Figure 2a] 1 is a schematic diagram of an eye detection device in a display device according to an embodiment of the present application. [Figure 2b] 1 is a schematic diagram of an eye detection device in another display device according to an embodiment of the present application. [Figure 3a] 1 is a schematic diagram of a structure of a display device 300a according to an embodiment of the present application. [Figure 3b] FIG. 3 is a schematic diagram of the structure of a display device 300b according to an embodiment of the present application. [Figure 4a] 1 is a schematic side view of a display device according to the present application; [Figure 4b] 1 is a schematic top view of a display device according to the present application; [Figure 5a]1 is a schematic diagram of an imaging reflector according to the present application; [Figure 5b] 2 is a schematic diagram of another imaging reflector according to the present application; [Figure 6] 6 is a schematic diagram of the structure of a display device 600 according to an embodiment of the present application. [Figure 7] FIG. 2 is a schematic diagram of light compensation according to an embodiment of the present application. [Figure 8] FIG. 8 is a schematic diagram of the structure of a display device 800 according to an embodiment of the present application. [Figure 9] FIG. 9 is a schematic diagram of the structure of a display device 900 according to an embodiment of the present application. [Figure 10] FIG. 2 is a schematic diagram of a circuit of a display device according to an embodiment of the present application. [Figure 11] FIG. 2 is a schematic diagram of a possible functional framework of a vehicle according to the present application. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0027] The present application provides a display device, an electronic device, and a vehicle. The display device may be used as a general display for an office (e.g., as shown in FIG. 1a by 100a), as a TV for family entertainment (e.g., as shown in FIG. 1b by 100b), as an in-vehicle display (e.g., as shown in FIG. 1c by 100c, where the display device is installed on the seat back or passenger seat of the vehicle), or as a vehicle HUD device (shown in FIG. 1d). The physical size, display size, and resolution of the display device may be adjusted according to the application scenario.

[0028] In this application, the display device may also be referred to as a display system or a virtual image display device. The units or modules included in the display device may also be referred to as components or mechanisms.

[0029] The display device provided in the present application has a virtual imaging function and can generate a long-distance and enlarged virtual image for a real image of a display target. Compared with a display using a conventional display screen without a virtual imaging function or a projection display using a projection screen, the display device with the virtual imaging function can allow a user to experience a more realistic viewing effect and a stronger immersive feeling. However, unlike a conventional display screen or a projection screen, the display device with the virtual imaging function does not have a diffusion function that allows a light beam to radiate from the screen in a wide angle range. In other words, the effective viewing area of ​​the display device with the virtual imaging function is limited, and the light beam can only be received by the user's eye within a small angle range. In addition, even if a user views a virtual image in the effective viewing area, dynamic distortion occurs with the change of the observation position. Therefore, an eye detection device needs to be used to detect the position of the eye.

[0030] In general, the eye detection device may be disposed on the frame of the display device. For example, the eye detection device (such as a camera) 201a shown in Fig. 2a is disposed on the frame of the display 200a. Alternatively, the eye detection device may be integrated inside the display device. For example, the eye detection device 201b shown in Fig. 2b is disposed on the display device 200b.

[0031] Referring to FIG. 2b, the image source 202b emits image light. The image light is reflected by the reflecting components (203-1b and 203-2b) and then reflected by the windshield 204b to the eye to form a virtual image. In addition, an infrared light source 205b in the display device 200b is used to illuminate the eye. Then, the eye detection device 201b detects the optical signal reflected back from the eye. The display device 200b determines the position of the eye based on the detected optical signal. However, because the optical path of the image light and the optical path of the optical signal are not parallel, the optical signal cannot accurately reflect the position of the user's eye viewing the virtual image.

[0032] In order to solve the above technical problems, the display device provided in the embodiments of the present application can accurately detect the eye position.

[0033] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a display device provided in an embodiment of the present application will be described in detail with reference to the accompanying drawings.

[0034] Please refer to Figure 3a. Figure 3a is a schematic diagram of the structure of a display device 300a according to one embodiment of the present application.

[0035] As shown in FIG. 3a, the display device 300a includes a Picture Generation Unit (PGU) 310a, an imaging reflector 320a, a detection unit 330a, and a processing unit 340a. The picture generation unit 310a is configured to generate an image and project an image light of the image onto the imaging reflector 320a. The imaging reflector 330a is configured to reflect the received image light to generate a virtual image of the image. The imaging reflector 330a is further configured to transmit a first signal light, the first signal light being a light reflected by a user's eye viewing the virtual image. The detection unit 330a is configured to collect the first signal light transmitted through the imaging reflector 320a. The processing unit 340a is configured to determine the position of the user's eye based on the first signal light collected by the detection unit 330a.

[0036] It should be noted that the detection unit 330a is disposed behind the imaging reflector 320a. In this case, referring to Fig. 3a, the propagation direction of the image light reflected by the imaging reflector 330a is parallel to the propagation direction of the first signal light. It should be understood that in some scenarios, the parallel propagation directions can also be expressed as parallel light beams or overlapping light beams.

[0037] It should also be understood that the processing unit 340a may determine the user's eye position and the user's gaze direction based on the first signal light collected by the detection unit 330a.

[0038] In Fig. 3a, the display device 300 may be a display or a component within a display, such as the display 100a of Fig. 1a, the display 100b of Fig. 1b, or the display 100c of Fig. 1c. The imaging reflector 330a in the display device 300a shown in Fig. 3a may be a viewing window. The viewing window faces the user's eye that views the virtual image.

[0039] Please refer to Figure 3b, which is a schematic diagram of the structure of a display device 300b according to an embodiment of the present application.

[0040] As shown in Fig. 3b, the display device 300b includes a picture generation unit 310b, an imaging reflector 320b, a detection unit 330b, and a processing unit 340b. The functions realized by the picture generation unit 310b, the imaging reflector 320b, the detection unit 330b, and the processing unit 340b are the same as those realized by the picture generation unit 310a, the imaging reflector 320a, the detection unit 330a, and the processing unit 340a, and the positional relationship between the detection unit 330b and the imaging reflector 320b is also the same as the positional relationship between the detection unit 330a and the imaging reflector 320a. Details are not repeated here.

[0041] The difference between the embodiment shown in Fig. 3b and the embodiment shown in Fig. 3a is that the image light reflected by the imaging reflector 320b in Fig. 3b is reflected by the transparent reflector 350b to form a virtual image of the image. The transparent reflector 350 faces the user's eyes, which view the virtual image.

[0042] The transparent reflector 350 may be, for example, a vehicle windshield. When the reflector 350 is a vehicle windshield, the display device 300b may be a HUD device, for example the HUD device of FIG.

[0043] In the display device provided in Figures 3a and 3b, the detection unit is disposed behind the imaging reflector, so that the propagation direction of the image light reflected by the imaging reflector is parallel to the propagation direction of the first signal light received by the detector. Therefore, the first signal light can accurately reflect the position of the user's eye viewing the virtual image, and the processing unit can obtain the accurate position of the eye according to the first signal light.

[0044] Based on the embodiment shown in Fig. 3a, the detection unit may be arranged behind the imaging reflector, specifically at the position shown in Fig. 4a and Fig. 4b. Fig. 4a is a side view of the display device. Fig. 4b is a top view of the display device. Neither Fig. 4a nor Fig. 4b shows the picture generation unit and the processing unit in the display device.

[0045] Please refer to Figure 4a and Figure 4b. A detection unit 420 (e.g., detection unit 330a in Figure 3a) is arranged on the rear side of the imaging reflector 410 (e.g., imaging reflector 320a in Figure 3a), and the detection unit 420 is arranged on the connection line between the observation position and the virtual image generated by the imaging reflector 410. The observation position is the position of the user's eyes viewing the virtual image. Optionally, the connection line on which the detection unit 420 is arranged (located) is perpendicular to the virtual image (the plane on which the virtual image is located) and passes through the center of the virtual image. By arranging the detection unit 420 on the vertical connection line passing through the center of the virtual image, it can be ensured that the detection unit 420 is aligned with the line of sight of the user's both eyes, which can facilitate the measurement of the line of sight angle of the user viewing the virtual image, and the field of view requirement of the lens assembly of the detection unit 420 can be reduced, thereby reducing the cost of the display device.

[0046] The imaging reflector 320a in FIG. 3a may transmit the first signal light to the detection unit 330a. In the process of the imaging reflector 320a transmitting the first signal light, referring to FIG. 5a, if the curvature of the front surface of the imaging reflector 320a and the curvature of the rear surface are consistent, i.e., if the thickness of the imaging reflector 320a is uniform, the refraction angles of the light rays at different heights in the transmitted first signal light are the same, and the image quality shown by the first signal light received by the detection unit 330a will not deteriorate within the allowable range of the image processing algorithm. Referring to FIG. 5b, if the curvature of the front surface of the imaging reflector 320a and the curvature of the rear surface are not consistent, i.e., if the thickness of the imaging reflector 320a is not uniform, the refraction angles of the light rays at different heights in the transmitted first signal light are different, which will significantly reduce the image quality of the image formed by the first signal light received by the detection unit 330a, and will introduce aberrations and distortions during the light transmission of the first signal light.

[0047] In this case, the curvatures of the front and rear surfaces (e.g., 300a in FIG. 3a and 300b in FIG. 3b) of the imaging reflector provided in the display device provided in this embodiment need to match in order to reduce aberrations and distortions introduced during light transmission.

[0048] In some embodiments, the curvature of the front surface and the curvature of the rear surface of the imaging reflector (e.g., 300a in FIG. 3a and 300b in FIG. 3b) provided on the display device provided in this embodiment may not match. When the curvature of the front surface and the curvature of the rear surface of the imaging reflector do not match, the display device provided in this embodiment may be shown in FIG. 6. FIG. 6 is a schematic diagram of the structure of a display device 600 according to an embodiment of the present application.

[0049] 6, the display device 600 includes a picture generation unit 610, an imaging reflector 620, a detection unit 630, a processing unit 640, and a lens 650. The functions realized by the picture generation unit 610, the imaging reflector 620, the detection unit 630, and the processing unit 640 are the same as the functions realized by the picture generation unit 310a, the imaging reflector 320a, the detection unit 330a, and the processing unit 340a, and the positional relationship between the detection unit 630 and the imaging reflector 620 is also the same as the positional relationship between the detection unit 330a and the imaging reflector 320a. Details will not be repeated here.

[0050] The lens 650 is disposed between the imaging reflector 620 and the detection unit 630. The lens 650 is configured to perform optical compensation on the first signal light transmitted through the imaging reflector 620, and transmit the optically compensated first signal light to the detection unit 630. See Fig. 7. The lens (e.g., 650 in Fig. 6) may correct the light rays with different refraction angles of the first signal light transmitted through the imaging reflector (e.g., 620 in Fig. 6) into parallel light rays (parallel light beams).

[0051] For example, the imaging reflector is made of optical glass (N-BK7), has a front surface curvature radius of 500 mm, a rear surface curvature radius of 250 mm, and a center thickness of 20 mm. In order to correct different refraction angles, a lens made of optical glass (N-BK7) with a front surface curvature radius of 460 mm and a center thickness of 5 mm may be further provided behind the imaging reflector.

[0052] It should be noted that the embodiment shown in Fig. 6 only describes the additional deployment of a lens based on Fig. 3a, and does not constitute any limitation to the present application. For example, a lens may be further deployed in Fig. 3b, in which the positional relationship between the lens, the imaging reflector, and the detection unit is the same as that between the lens, the imaging reflector, and the detection unit shown in Fig. 6. Details will not be repeated here.

[0053] Optionally, the detection unit may use a software algorithm to correct image degradation when the curvature of the front and rear surfaces of the imaging reflector do not match.

[0054] FIG. 8 is a schematic diagram of a structure of a display device 800 according to an embodiment of the present application.

[0055] The display principle of the display device 800 shown in Fig. 8 is the same as that of the display device 300a shown in Fig. 3a. The difference is that the imaging reflector 820 in the embodiment of Fig. 8 is specifically configured to reflect visible light and transmit invisible light. The functions of the picture generation unit 810, the detection unit 830, and the processing unit 840 are respectively the same as those of the picture generation unit 310a, the detection unit 330a, and the processing unit 340a, and the positional relationship between the detection unit 830 and the imaging reflector 820 is also the same as that between the detection unit 330a and the imaging reflector 320a. Details are not repeated here.

[0056] 8, the image light sent by the picture generation unit 810 to the imaging reflector 820 may be visible light, and the imaging reflector 820 may reflect the image light, so that the user views a virtual image of the image generated by the picture generation unit 810. The first signal light reflected by the user's eye viewing the virtual image may be invisible light, and the invisible light may be received by the detection unit 830 after transmitting through the imaging reflector.

[0057] The imaging reflector 820 may be covered with a wavelength-dependent film 821 that reflects light in the visible light band (400 nm to 700 nm) and transmits light in the invisible light band, for example.

[0058] In the display device 800, the light source of the invisible light reflected by the eye of the user viewing the virtual image may be, for example, image light, ambient light, or a pre-arranged light source. Optionally, the pre-arranged light source may be an invisible light source, for example, an infrared light source. The invisible light reflected by the eye of the user viewing the virtual image may be a light beam that is a part of the light reflected by the eye of the user viewing the virtual image, in other words, the light reflected by the eye of the user viewing the virtual image may further include visible light.

[0059] The detection unit 830 may be an invisible light detector, for example an infrared detector.

[0060] FIG. 9 is a schematic diagram of a structure of a display device 900 according to an embodiment of the present application.

[0061] The display device 900 shown in FIG. 9 is similar to the display device 800 shown in FIG. 8. The difference is that the imaging reflector 920 in the embodiment of FIG. 9 is configured to reflect a first polarization (e.g., S polarization) and transmit a second polarization (e.g., P polarization), and the imaging reflector 820 in the embodiment of FIG. 8 is configured to reflect visible light and transmit invisible light. The functions of the picture generation unit 910, the detection unit 930, and the processing unit 940 are the same as those of the picture generation unit 310a, the detection unit 330a, and the processing unit 340a, respectively, and the positional relationship between the detection unit 930 and the imaging reflector 920 is also the same as that between the detection unit 330a and the imaging reflector 320a. Details are not repeated here.

[0062] It should be noted that the present embodiment is described using an example in which the first polarization is S-polarized light and the second polarization is P-polarized light. However, the first polarization is not limited to S-polarized light and the second polarization is not limited to P-polarized light, and any two polarized beams whose polarization directions are orthogonal to each other may be the first polarization and the second polarization, respectively.

[0063] The imaging reflector 920 may be coated with a polarizing film 921 that reflects S-polarized light and transmits P-polarized light.

[0064] In the display device 900 provided in this embodiment, the image light sent by the picture generation unit 910 to the imaging reflector 920 may be S-polarized (the polarization direction is perpendicular to the paper), and the imaging reflector 920 may reflect the image light, so that the user views a virtual image of the image generated by the picture generation unit 910. Among the signal light reflected by the eye of the user viewing the virtual image, P-polarized light (the polarization direction is parallel to the paper) is transmitted through the imaging reflector 920 and emitted. In this way, the P-polarized light is transmitted to the detection unit 930. Therefore, the propagation direction of the image light reflected by the imaging reflector is parallel to the propagation direction of the first signal light.

[0065] The light beam emitted by the picture generating unit 910 may be polarized light. For example, the polarization state of the polarized light emitted by the picture generating unit, such as a Liquid Crystal Display (LCD), a Liquid Crystal on Silicon (LCoS)-based display device, and a laser-based laser beam scanning projector, may be the same as the polarization state of the first polarization. When the polarization state of the polarized light is different from the polarization state of the first polarization, referring to FIG. 9, the display device 900 may further include a half-wave plate 950 disposed on the optical path between the picture generating unit 910 and the imaging reflector 920, configured to adjust the image light emitted by the picture generating unit 910 to the first polarization.

[0066] Alternatively, the light beam emitted by the picture generating unit 910 may be unpolarized. For example, when the picture generating unit is a Digital Light Processor (DLP)-based white light projector, an Organic Light-Emitting Diode (OLED) screen, a Micro Light-Emitting Diode (Micro-LED) screen, etc., the display device 900 may further include a polarizer (e.g., an S-polarizer). The polarizer 960 is disposed on the optical path between the picture generating unit 910 and the imaging reflector 920, and is configured to convert the image light generated by the picture generating unit 910 into polarized light. In addition, the image light generated by the picture generating unit 910 is adjusted to a first polarization by controlling the polarization direction of the polarizer 960.

[0067] Polarizers are also called polarizing plates, polarizers, polarizing devices, polarizing films, and polarizer devices. For example, an S polarizer is sometimes called an S polarizing film.

[0068] It should be noted that the embodiments shown in Figures 8 and 9 are merely examples described based on the embodiment shown in Figure 3a, and do not constitute any limitation to the present application. For example, the imaging reflector 320b in Figure 3b may be configured to reflect visible light and transmit invisible light, or to reflect a first polarization and transmit a second polarization. As another example, a half-wave plate or polarizer may be disposed on the optical path between the picture generating unit 310b and the imaging reflector 320b in Figure 3b to adjust the image light emitted by the picture generating unit 910 to a first polarization.

[0069] For simplicity of explanation, in the following embodiments, only the display device 300a and its components shown in Fig. 3a are referred to. However, it should be understood that the exemplary description of the display device 300a shown in Fig. 3a is also applicable to the display device 300b and its components shown in Fig. 3b, the display device 600 and its components shown in Fig. 6, the display device 800 and its components shown in Fig. 8, and the display device 900 and its components shown in Fig. 9.

[0070] In the display device 300a, the light source of the light reflected by the user's eye viewing the virtual image may be, for example, image light, ambient light, or a pre-arranged light source. Optionally, the pre-arranged light source may be arranged within the display device 300a or may be a light source independent of the display device 300a.

[0071] In some embodiments, the processing unit 340a further generates image correction information based on the first signal light collected by the detection unit 330a, and transmits the image correction information to the picture generation unit 310a, which adjusts the generated image based on the image correction information.

[0072] For example, the detection unit 330a may obtain a face image or a pupil image of a user by receiving a first signal light, and the detection unit 330a transmits the obtained face image or pupil image to the processing unit 340a. The processing unit 340a obtains information such as a pupil position and / or a gaze direction of the user by analysis based on the received face image or pupil image. Furthermore, the processing unit 340a determines image correction information, for example, at least one of a distortion correction value, an image size, a color correction, etc., based on the information such as the pupil position and / or the gaze direction of the user. The processing unit 340a may transmit control information (carrying the image correction information) to the picture generation unit 310a to transfer the image correction information. The picture generation unit 310a may correct the image to be displayed based on the image correction information and emit the image light of the corrected image, so that the virtual image generated by the imaging reflector can be consistent with the eye position and / or gaze direction of the user, and the user's viewing experience can be improved.

[0073] Please refer to Figure 10. Figure 10 is a schematic diagram of a circuit of a display device according to an embodiment of the present application.

[0074] 10, the circuit of the display device mainly includes a processor 1001, a memory 1002, a controller area network (CAN) transceiver 1003, an audio module 1004, a video module 1005, a power module 1006, a wireless communication module 1007, an I / O interface 1008, a video interface 1009, a touch control unit 1010, a display circuit 1028, an imaging device 1029, etc. The processor 1001 may be connected to peripheral components such as the memory 1002, the CAN transceiver 1003, the audio module 1004, the video module 1005, the power module 1006, the wireless communication module 1007, the I / O interface 1008, the video interface 1009, the touch control unit 1010, and the display circuit 1028 by a bus. The processor 1001 may also be called a front-end processor.

[0075] Additionally, the schematic diagram of the circuit in this embodiment of the present application does not constitute a specific limitation on the display device. In some other embodiments of the present application, the display device may include more or fewer components than those shown, some components may be combined, some components may be split, or different component arrangements may be used. The components shown may be implemented by hardware, software, or a combination of software and hardware.

[0076] The processor 1001 includes one or more processing units. For example, the processor 1001 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a video codec, a Digital Signal Processor (DSP), a baseband processor, and / or a Neural-Network Processing Unit (NPU), etc. The different processing units may be separate components or may be integrated into one or more processors. A processor may implement the functions of the processing units 340a, 340b, 640, 840, and 940.

[0077] A memory configured to store instructions and data may further be located within the processor 1001. In some embodiments, the memory of the processor 1001 is a cache. The memory may store instructions or data that have been recently or periodically used by the processor 1001. When the instructions or data need to be used again, the processor 1001 may directly retrieve the instructions or data from the memory. This avoids repeated accesses and reduces the waiting time of the processor 1001, thereby improving system efficiency. The processor 1001 may also be referred to as a controller.

[0078] In some embodiments, the display device may further include a number of Input / Output (I / O) interfaces 1008 coupled to the processor 1001. The interfaces 1008 may include, but are not limited to, an Inter-Integrated Circuit (I2C) interface, an Inter-Integrated Circuit Sound (I2S), a Pulse Code Modulation (PCM) interface, a Universal Asynchronous Receiver / Transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a General-Purpose Input / Output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and / or a Universal Serial Bus (USB) interface. The I / O interface 1008 may be connected to devices such as a mouse, touchpad, keyboard, camera, speaker / horn, or microphone, or may be connected to physical buttons on a display device (such as volume buttons, brightness control buttons, or power button).

[0079] The memory 1002 may include an internal memory and may further include an external memory (e.g., a Micro SD card). The memory 1002 may be configured to store computer executable program code. The computer executable program code includes instructions. The memory 1002 may include a program storage area and a data storage area. The program storage area may store an operating system, an application program required by at least one function (such as a calling function or a time setting function), and the like. The data storage area may store data created during use of the display device (such as a phone book and world time), and the like. In addition, the memory 1002 may include a high-speed random access memory and may further include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or a universal flash storage (UFS). The processor 1001 executes various functional applications and data processing of the display device by executing instructions stored in the memory 1002 and / or instructions stored in a memory located in the processor 1001.

[0080] In addition, the display device further includes a CAN transceiver 1003, which may be connected to a vehicle's CAN bus (CAN BUS). Through the CAN bus, the display device may communicate with an in-vehicle infotainment system (music module, radio module, and video module), a vehicle status system, etc. For example, a user may turn on an in-vehicle music playback function by operating the display device. The vehicle status system may send vehicle status information (such as vehicle door or seat belt) to the display device for display.

[0081] The display device may perform audio functions via an audio module 1004, an application processor, etc. For example, the audio functions include music playback, phone calls, etc.

[0082] The audio module 1004 is configured to convert digital audio information to analog audio signals for output, and is also configured to convert analog audio input to digital audio signals. The audio module 1004 may be further configured to encode and decode audio signals, e.g., perform audio playback and recording. In some embodiments, the audio module 1004 may be located in the processor 1001, or some functional modules of the audio module 1004 may be located in the processor 1001.

[0083] The video interface 1009 may receive input audio and video, and may be, among others, a High Definition Multimedia Interface (HDMI), a Digital Visual Interface (DVI), a Video Graphics Array (VGA), a Display port (DP), a Low Voltage Differential Signaling (LVDS) interface, etc. The video interface 1009 may also output video. For example, a display device receives video data transmitted by a navigation system via the video interface.

[0084] The video module 1005 may decode the video input via the video interface 1009, for example, performing H.264 decoding. The video module may further encode the video captured by the display device, for example, performing H.264 encoding on the video captured by an external camera. In addition, the processor 1001 may also decode the video input via the video interface 1009 and output the decoded image signal to the display circuit.

[0085] The display circuit 1028 and the imaging device 1029 are configured to display a corresponding image. In this embodiment, the video interface 1009 receives input video data (or is called a video source), the video module 1005 performs decoding and / or digital processing of the video data, and outputs an image signal to the display circuit 1028, which drives the imaging device 1029 to perform imaging using the light beam emitted by the light source 101 based on the input image signal, and generates a visible image. For example, the imaging device 1029 generates a source image and emits imaging light. The display circuit 1028 and the imaging device 1029 are electronic components of the imaging module 102, and the display circuit 1028 may also be called a driving circuit.

[0086] The power module 1006 is configured to provide power to the processor 1001 and the light source 101 based on an input power (such as a direct current). The power module 1006 may include a rechargeable battery. The rechargeable battery may provide power to the processor 1001 and the light source 101. The light emitted by the light source 101 may propagate to the imaging device 1029 for imaging to form an image light signal (imaging light).

[0087] In addition, the power module 1006 may be connected to a power module (such as a power battery) of the vehicle, which supplies power to the power module 1006 of the display device.

[0088] The wireless communication module 1007 may enable the display device to wirelessly communicate with the outside, and may provide wireless communication solutions such as Wireless Local Area Networks (WLAN) (such as Wireless Fidelity (Wi-Fi) networks), Bluetooth (BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), and Infrared (IR). The wireless communication module 1007 may be one or more components incorporating at least one communication processor module. The wireless communication module 1007 receives electromagnetic waves through an antenna, performs frequency modulation and filtering on the electromagnetic wave signal, and transmits the processed signal to the processor 1001. The wireless communication module 1007 may further receive a signal to be transmitted from the processor 1001, and perform frequency modulation and amplification on the signal. The amplified signal is converted into an electromagnetic wave and radiated through an antenna.

[0089] In addition, the video data decoded by the video module 1005 may be input via the video interface 1009, may be received wirelessly via the wireless communication module 1007, or may be read from the memory 1002. For example, the display device may receive video data from a terminal device or an in-vehicle infotainment system via a wireless local area network in the vehicle, and the display device may also read audio and video data stored in the memory 1002.

[0090] The touch control unit 1010 may generate a control signal (such as a brightness / contrast adjustment signal) based on a touch control operation performed by a user on the touch control interface, and then send the control signal to the display circuit 1028 via the processor 201. The display circuit 1028 adjusts the imaging of the imaging device 1029 based on the control signal to change the displayed original image. The touch control interface may include control buttons (such as a volume button, a brightness adjustment button, a contrast adjustment button, etc.).

[0091] Please refer to FIG. 11, which is a schematic diagram of a possible functional framework of a vehicle according to the present application. In this example, an example in which the display system is a head-up display system is used for explanation. The functional framework of the vehicle may include various subsystems, such as the sensor system 12 of the figure, the control system 14, one or more peripheral devices 16 (one peripheral device is shown in the figure as an example), a power source 18, a computer system 20, and a head-up display system 22. The subsystems may communicate with each other. Optionally, the vehicle may further include another functional system, such as an engine system that powers the vehicle, or a cockpit. This is not limited in the present application.

[0092] The sensor system 12 may include several detection devices. These detection devices can sense measured information and convert the sensed information into an electrical signal or another form of information required for output according to a rule. As shown in the figure, these detection devices may include a global positioning system (GPS), a vehicle speed sensor, an inertial measurement unit (IMU), a radar unit, a laser range finder, a camera device, a wheel speed sensor, a steering sensor, a gear position sensor, another element for automatic detection, etc. This is not limited in this application.

[0093] The control system 14 may include several elements, such as a steering unit, a braking unit, a lighting system, an autonomous driving system, a map navigation system, a network time synchronization system, and an obstacle avoidance system, as shown in the figure. The control system 14 may receive information (such as vehicle speed or vehicle distance) transmitted by the sensor system 12 and perform functions such as autonomous driving and map navigation.

[0094] Optionally, the control system 14 may further include elements such as a throttle controller and an engine controller configured to control the driving speed of the vehicle, which is not limited in this application.

[0095] The peripheral device 16 may include several elements, such as a communication system, a touch screen, a user interface, a microphone, and a speaker, as shown in the figure. The communication system is configured to implement network communication between the vehicle and a device other than the vehicle. In practical application, the communication system may implement network communication between the vehicle and another device using wireless communication technology or wired communication technology. Wired communication technology may mean that the vehicle communicates with other devices via network cables, optical fibers, etc.

[0096] The power source 18 represents a system that supplies power or energy to the vehicle, and may include, but is not limited to, rechargeable lithium-ion batteries or lead-acid batteries. In practical applications, one or more battery components in the power source are configured to provide power or energy to start the vehicle. The type and material of the power source are not limited in this application.

[0097] Some functions of the vehicle are performed under the control of a computer system 20. The computer system 20 may include one or more processors 2001 (one processor is shown in the figure as an example) and a memory 2002 (sometimes called a storage device). In practical applications, the memory 2002 may be located within the computer system 20 or may be located outside the computer system 20, for example as a cache in the vehicle. This is not limited in this application.

[0098] The processor 2001 may include one or more general-purpose processors, such as a graphics processing unit (GPU). The processor 2001 may be configured to execute associated programs or instructions corresponding to programs stored in the memory 2002 to perform corresponding functions of the vehicle.

[0099] The memory 2002 may include a volatile memory, such as a RAM, or the memory may include a non-volatile memory, such as a ROM, a flash memory, a HDD, or a solid-state disk SSD, or the memory 2002 may further include a combination of the aforementioned types of memory. The memory 2002 may be configured to store a program code or an instruction corresponding to the program code, so that the processor 2001 calls the program code or the instruction stored in the memory 2002 to implement the corresponding function of the vehicle. The function includes, but is not limited to, some or all of the functions in the schematic diagram of the vehicle's functional framework shown in FIG. 11. In this application, the memory 2002 may store a program code for vehicle control, and the processor 2001 may call the program code to control the vehicle to drive safely. The method of implementing the safe driving of the vehicle will be specifically described in detail below in this application.

[0100] Optionally, in addition to storing program codes or instructions, the memory 2002 may further store information such as road maps, driving routes, and sensor data. The computer system 20 may perform related functions of the vehicle in combination with other elements in the schematic diagram of the vehicle's functional framework, such as sensors in a sensor system or a GPS. For example, the computer system 20 may control the driving direction, driving speed, etc. of the vehicle based on the data input of the sensor system 12. This is not limited in the present application.

[0101] The head-up display system 22 may project an image onto the windshield to present a target image in front of the driver. For the specific structure of the head-up display device, please refer to the above-mentioned embodiment of the display device, and the details will not be repeated here.

[0102] The head-up display system 22 may receive image data transmitted by the control system 14 or the computer system 20, for example, images including vehicle status such as vehicle speed or battery / fuel levels, and images including augmented reality (AR) content. The head-up display system 22 may further receive control signals from the computer system 20 to enable or disable head-up display functionality.

[0103] In this application, the framework including the four subsystems of the sensor system 12, the control system 14, the computer system 20, and the head-up display system 22 shown in FIG. 11 is merely an example and does not constitute a limitation. In a practical application, some elements in a vehicle may be combined according to different functions of the vehicle to obtain subsystems corresponding to different functions. In a practical application, a vehicle may include more or fewer subsystems or elements. This is not limited in this application.

[0104] The curved mirror of the embodiment of the present application may be a multi-focal freeform mirror. The design of the multi-focal freeform reflector allows it to be viewed by multiple people.

[0105] The vehicle in the embodiment of the present application may be a known vehicle, such as a car, an airplane, a ship, or a rocket, or may be a vehicle to be developed in the future. The vehicle may be an electric vehicle, a fuel vehicle, or a hybrid powered vehicle, such as a pure electric vehicle, a range-extended electric vehicle, a hybrid electric vehicle, a fuel cell vehicle, or a new energy vehicle. This is not particularly limited in the present application. In addition, the electronic device in the embodiment of the present application may include a device with a display device, including the aforementioned vehicle, and may be a medical device, an office entertainment device, or an industrial control device. This is not limited in the present embodiment.

[0106] Terms such as "first, second, third, fourth" in this application are intended to distinguish between similar objects, but do not necessarily indicate a particular order or sequence. It is to be understood that such referred data may be interchangeable where appropriate, such that the embodiments described herein may be performed in an order not described in this application. In order to more clearly reflect the relationship between components in different embodiments, the same reference numbers are used in this application to represent components having the same or similar functions in different embodiments.

[0107] It should be further noted that unless otherwise specified, a specific description of some technical features in one embodiment may also be used to describe corresponding technical features described in other embodiments.

[0108] Please cross-reference the same or similar parts in the embodiments of this application. The above description is only a specific implementation form of this application, and is not intended to limit the protection scope of this application. Any modifications and replacements that can be easily thought of by those skilled in the art in the technical scope disclosed in this application are included in the protection scope of this application. [Explanation of symbols]

[0109] 12 Sensor System 14 Control System 16 Peripheral Devices 18 Power supply 20. Computer Systems 22 Head-up display system 100a Display 100b Display 100c Display 101 Light source 200a Display 200b display device 201a Eye detection device 201b Eye detection device 202b Image source 203-1b Reflective Component 203-2b Reflective Component 204b Windshield 300a display device 300b display device 310a Picture generation unit 310b Picture generation unit 320a Imaging reflector 320b Imaging reflector 330a Detection unit 330b Detection unit 340a Processing Unit 340b Processing unit 350 Transparent reflector 350b transparent reflector 410 Imaging reflector 420 Detection Unit 600 display device 610 Picture Generation Unit 620 Imaging reflector 630 Detection Unit 640 Processing Unit 650 Lens 800 display device 810 Picture Generation Unit 820 Imaging reflector 830 Detection Unit 840 Processing Unit 900 Display device 910 Picture Generation Unit 920 Imaging reflector 921 Polarizing Film 930 Detection Unit 940 Processing Unit 950 half wave plate 960 Polarizer 1001 Processor 1002 Memory 1003 CAN transceiver 1004 Audio Module 1005 Video Module 1006 Power Module 1007 Wireless communication module 1008 I / O Interface 1009 Video Interface 1010 Touch Control Unit 1028 display circuit 1029 Imaging Device 2001 Processor 2002 Memory

Claims

1. A display device comprising: a picture generating unit, an imaging reflector, a detection unit, and a processing unit, the detection unit being disposed behind the imaging reflector, The picture generation unit is configured to generate an image and transmit image light of the image to the imaging reflector; the imaging reflector is configured to reflect the image light to generate a virtual image of the image; the detection unit is configured to collect a first signal light that has passed through the imaging reflector, the first signal light being light reflected by an eye of a user viewing the virtual image; the processing unit is configured to determine an eye position of the user based on the first signal light collected by the detection unit; A propagation direction of the image light reflected by the imaging reflector is parallel to a propagation direction of the first signal light. Display device.

2. the imaging reflector is configured to reflect visible light and transmit invisible light, the image light being visible light, and the first signal light being invisible light; or the imaging reflector is configured to reflect a first polarization and transmit a second polarization, the polarization directions of the first polarization and the second polarization are perpendicular to each other, the image light is the first polarization, and the first signal light is the second polarization; The display device according to claim 1.

3. 3. The display device of claim 1, wherein a curvature of the front surface of the imaging reflector coincides with a curvature of the rear surface of the imaging reflector.

4. 3. The display device of claim 1, wherein a curvature of the front surface of the imaging reflector does not match a curvature of a rear surface of the imaging reflector.

5. The display device further comprises a lens, the lens being disposed between the imaging reflector and the detection unit; the lens is configured to perform optical compensation on the first signal light transmitted through the imaging reflector, and transmit the first signal light after the optical compensation to the detection unit; The display device according to claim 4.

6. 6. The display device according to claim 1, wherein the detection unit is arranged on a connection line between an observation position and the virtual image generated by the imaging reflector, and the observation position is the position of the user's eye that views the virtual image.

7. The display device of claim 6 , wherein the connecting line is perpendicular to the virtual image and passes through a center of the virtual image.

8. the processing unit is further configured to generate image correction information based on the first signal light collected by the detection unit, and send the image correction information to the picture generation unit; the picture generation unit is further configured to adjust the generated image based on the image correction information.

8. The display device according to claim 1 .

9. 9. The display device according to claim 1, wherein the imaging reflector is a display window.

10. 9. The display device of claim 1, wherein the image light reflected by the imaging reflector is reflected by a transparent reflector to form the virtual image of the image.

11. 11. The display device according to claim 10, wherein the transparent reflector is a windshield of a vehicle.

12. An electronic device comprising a display device according to any one of claims 1 to 11.

13. A vehicle comprising a display device according to any one of claims 1 to 11.

Images