In-vehicle interactive aerial imaging display system for driver

Abstract

The invention discloses an in-vehicle interactive aerial imaging display system for a driver, and the main design concept of the system is that driving related information is generated in a space in front of the eyes of the driver by using an aerial projection interaction scheme, and interaction with aerial imaging is realized through a multi-mode mode. Specifically, a high-definition and vivid image without medium bearing is projected in the space of the sight range of a driver through a flat lens, the safety risk caused by sight transfer is reduced, and dynamic adjustment can be performed according to perception and interaction information such as a sight focus point of the driver and ambient light so as to ensure the optimal visual effect; particularly, through multiple interaction modes such as head actions, sight lines, gestures and voice, the driver can focus on driving more, and the risk that attention is distracted due to operation of a complex interface is reduced. The implementation of the invention can get rid of the dependence limitation of the traditional vehicle-mounted display equipment on a carrier similar to a screen, and the interactive experience and the driving safety are greatly improved.

Description

Technical Field

[0001] The invention relates to the field of vehicle-mounted display equipment, and in particular to an in-vehicle interactive aerial imaging display system for drivers. Background Art

[0002] Vehicle display devices include, but are not limited to, instruments, central control screens, rear screens, and head-up display systems. The head-up display system mainly uses the principle of optical reflection to project driving assistance information onto the windshield, helping the driver to obtain key information while maintaining sight. However, most of these systems are limited by the imaging distance, viewing angle range, and interaction methods.

[0003] Specifically, head-up display technology uses the principle of optical projection to project important information (such as speed, navigation, vehicle status, etc.) in the form of images or text directly in front of the driver or operator's line of sight, usually on the front windshield or a dedicated display screen. This design allows users to maintain continuous attention to the external environment without having to lower their heads to look at the instrument or other display devices, thereby improving operational efficiency and safety.

[0004] However, the shortcomings of existing head-up display technology are also obvious:

[0005] 1. Head-up display technology mainly displays basic vehicle information such as speed, navigation, and fuel level. Faced with increasingly complex and diverse information display requirements, such as three-dimensional models and dynamic images, head-up display technology cannot support this and has limitations;

[0006] 2. Although head-up display technology can display basic vehicle information, its interactivity is relatively limited. Users mainly receive information through vision, and it does not support interactive operations such as user gesture recognition and voice control;

[0007] 3. The display effect of head-up display technology is greatly affected by light. In strong sunlight or insufficiently lit environments, the display effect of the head-up display may be affected, resulting in unclear or difficult to recognize information. Summary of the invention

[0008] In view of the above, the present invention aims to provide an in-vehicle interactive aerial imaging display system for the driver to solve the above-mentioned technical problems.

[0009] The technical solution adopted by the present invention is as follows:

[0010] The present invention provides an in-vehicle interactive aerial imaging display system for a driver, comprising: a projection module composed of at least a flat-panel lens and a projector, the projection module being mounted on the top of the vehicle and used to present a projection image in a space within the driver's field of vision;

[0011] Sensor module, used to obtain vehicle and environmental status in real time;

[0012] An interaction module, the interaction module at least comprising a camera and a sound pickup device for collecting information about the driver's head and hands;

[0013] An on-board computer, used for receiving and processing data from the sensing module and the interaction module and performing interaction control;

[0014] The display controller is used to control the projection module to generate images to present driving-related information and adjust projection parameters according to the processing results of the on-board computer.

[0015] In at least one possible implementation, the vehicle-mounted computer is further used to determine the focus point of the driver's line of sight according to the driver's line of sight position and line of sight angle;

[0016] The display controller is also used to dynamically adjust the display parameters of the projected image according to the focus point and the brightness of the ambient light, and to adaptively fine-tune the display position of the content in the projected image.

[0017] In at least one possible implementation manner, the driving-related information includes: vehicle information, road information, path planning information, in-vehicle environment information, and out-vehicle environment information.

[0018] In at least one possible implementation manner, the display controller is further configured to superimpose the vehicle exterior environment information onto a real image of a real object outside the vehicle.

[0019] In at least one possible implementation, the flat lens is calibrated in advance, specifically including: adjusting the imaging position of the projected image, and adjusting the projection viewing angle and the clarity of the projected image according to the distribution of the projection light and the image focusing effect.

[0020] In at least one possible implementation manner, the flat plate lens is a DCT-plate negative refraction flat plate lens.

[0021] Compared with the prior art, the main design concept of the present invention is to generate driving-related information in the space in front of the driver's eyes by using an aerial projection interaction solution, and to achieve interaction with aerial imaging in a multimodal manner. Specifically, a high-definition, realistic image without a medium carrier is projected in the space within the driver's field of vision through a flat lens, reducing the safety risks caused by line of sight diversion, and can be dynamically adjusted to ensure the best visual effect based on the driver's line of sight focus, ambient light and other perception and interaction information; in particular, through a variety of interaction methods such as head movements, line of sight, gestures, and voice, the driver can be more focused on driving and reduce the risk of distraction due to operating complex interfaces. The implementation of the present invention can get rid of the dependence of traditional vehicle-mounted display devices on screen-like carriers, greatly improving the interactive experience and driving safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to make the purpose, technical solutions and advantages of the present invention more clear, the present invention will be further described below with reference to the accompanying drawings, in which:

[0023] Figure 1 A schematic diagram of an in-vehicle interactive aerial imaging display system for a driver provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0024] Embodiments of the present invention are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and cannot be interpreted as limiting the present invention.

[0025] The present invention proposes an embodiment of an in-vehicle interactive aerial imaging display system for a driver, specifically, as Figure 1 As shown, it includes: a projection module composed of at least a flat lens and a projector. Specifically, in actual operation, a DCT-plate negative refraction flat lens can be used. The lens has a micro-array structure, which can periodically change the light path to produce a negative refraction effect, and re-converge the divergent light into a real image in the air; and the projector preferably uses a micro-projector with high resolution and low latency, which is tightly integrated with the aforementioned DCT-plate negative refraction flat lens to ensure the clarity and stability of the projected image;

[0026] Continuing from the above, the projection module is installed at the top of the vehicle, such as the central position, and can be calibrated to ensure that the projected image can be accurately presented at the appropriate position in the space in front of the driver's line of sight. In addition, based on this concept, the distribution and focusing effect of the projected light can be further optimized according to the characteristics of the DCT-plate negative refractive flat lens to ensure high definition and wide viewing angle of the projected image.

[0027] In addition, the display system also includes: a sensor module, such as but not limited to a camera (for ADAS warnings, lane keeping, etc.), a radar (for distance measurement), a lidar (for three-dimensional environmental perception), etc., to ensure that the system can obtain the status of the vehicle and the surrounding environment in real time; an on-board computer, which serves as the central processor of the system and is responsible for receiving and processing data from the sensor module and performing interactive control; and a display controller, which controls the aforementioned projection module to generate corresponding aerial imaging to present driving-related information based on the processing results of the on-board computer, and can adjust projection parameters (such as brightness, contrast, position, etc.).

[0028] Regarding the driving-related information mentioned above, it is preferred but not limited to being displayed in 3D form: vehicle information, road information, path planning information, in-vehicle environment information, vehicle body surrounding environment information (i.e., vehicle outside environment information), etc. Furthermore, it can also be combined with augmented reality technology to superimpose the current vehicle body surrounding environment information on the real image of the real object outside the vehicle at an actual distance. For example, if the vehicle in front changes lanes to this lane, a red reminder translucent dynamic layer can be superimposed on the real image of the surrounding vehicles to warn of the risk of collision.

[0029] In addition, the system also includes: an interactive module, which specifically includes a camera for collecting the driver's head and hand movements (the existing fatigue detection camera can be reused) and a sound pickup device, which captures the driver's line of sight position and angle, etc. through the camera, and can use mature technology to recognize gestures and head movements for controlling the system; for the sound pickup device, it is preferable to use a microphone array to receive voice commands and realize voice control function.

[0030] It is mentioned here that the driver's head status such as line of sight can be collected through the interactive module, and the display controller can be used to adjust the projection parameters. The combination of the two can preferably refer to the following method:

[0031] Determine the focus point based on the driver's sight position and sight angle;

[0032] According to the focus point and the brightness of the ambient light, the display parameters of the projected image are dynamically adjusted, and the imaging position is adaptively fine-tuned. It can be pointed out here that this concept originates from the consideration of driving safety. For example, when it is detected that the driver's line of sight has deviated from the projected content, the display position of the projected content can be automatically adjusted and / or the projection brightness can be reduced. Because the present invention believes that this state is mostly when the driver shifts his attention from the projected content to the driving operation, the parameter change fine-tuning strategy is proposed.

[0033] Finally, it can be added that during operation, the display system automatically reduces the brightness of the projected image at night or in low-light environments for safety reasons to avoid glare to the driver.

[0034] In summary, the main design concept of the present invention is to generate driving-related information in the space in front of the driver's eyes by using an aerial projection interaction solution, and to achieve interaction with aerial imaging in a multimodal manner. Specifically, a high-definition, realistic image without a medium carrier is projected in the space within the driver's field of vision through a flat lens, which reduces the safety risks caused by line of sight diversion, and can be dynamically adjusted to ensure the best visual effect based on the driver's line of sight focus, ambient light and other perception and interaction information; in particular, through a variety of interaction methods such as head movements, line of sight, gestures, and voice, the driver can be more focused on driving and reduce the risk of distraction due to operating complex interfaces. The implementation of the present invention can get rid of the dependence of traditional vehicle-mounted display devices on screen-like carriers, and greatly improve the interactive experience and driving safety.

[0035] If the expressions expressing orientation are mentioned in the embodiments of the present invention, they are relative concepts based on the embodiments. In addition, "at least one" means one or more, and "plurality" means two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent the existence of A alone, the existence of A and B at the same time, and the existence of B alone. Among them, A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c can be represented by: a, b, c, a and b, a and c, b and c, or a and b and c, wherein a, b, c can be single or multiple.

[0036] The above describes in detail the structure, features and effects of the present invention based on the embodiments shown in the drawings, but the above is only a preferred embodiment of the present invention. It should be noted that the technical features involved in the above embodiments and their preferred methods can be reasonably combined and matched into a variety of equivalent schemes by those skilled in the art without departing from or changing the design ideas and technical effects of the present invention; therefore, the present invention is not limited to the scope of implementation shown in the drawings, and all changes made in accordance with the concept of the present invention, or modifications to equivalent embodiments with equivalent changes, which still do not exceed the spirit covered by the specification and drawings, should be within the protection scope of the present invention.

Claims

1. An in-vehicle interactive aerial imaging display system for drivers, characterized in that: include: A projection module consisting of at least a flat lens and a projector, the projection module being mounted on the top of the vehicle and used to present a projected image in a space within the driver's field of vision; Sensor module, used to obtain vehicle and environmental status in real time; An interaction module, the interaction module at least comprising a camera and a sound pickup device for collecting information about the driver's head and hands; An on-board computer, used for receiving and processing data from the sensing module and the interaction module and performing interaction control; The display controller is used to control the projection module to generate images to present driving-related information and adjust projection parameters according to the processing results of the on-board computer.

2. The in-vehicle interactive aerial imaging display system for drivers according to claim 1, characterized in that: The vehicle-mounted computer is further used to determine the focus point of the driver's line of sight according to the driver's line of sight position and line of sight angle; The display controller is also used to dynamically adjust the display parameters of the projected image according to the focus point and the brightness of the ambient light, and to adaptively fine-tune the display position of the content in the projected image.

3. The in-vehicle interactive aerial imaging display system for drivers according to claim 1, characterized in that: The driving related information includes: vehicle information, road information, path planning information, in-vehicle environment information, and out-vehicle environment information.

4. The in-vehicle interactive aerial imaging display system for drivers according to claim 3, characterized in that: The display controller is also used to superimpose the vehicle exterior environment information onto a real image of a real object outside the vehicle.

5. The in-vehicle interactive aerial imaging display system for drivers according to claim 1, characterized in that: The flat lens is calibrated in advance, specifically including: adjusting the imaging position of the projected image, and adjusting the projection viewing angle and the clarity of the projected image according to the distribution of the projection light and the image focusing effect.

6. The in-vehicle interactive aerial imaging display system for the driver according to any one of claims 1 to 5, characterized in that: The flat plate lens adopts a DCT-plate negative refraction flat plate lens.

Images