Virtual image display method, display device and vehicle-mounted terminal
By monitoring the real scene of the vehicle and the driver's eye point position in real time, dynamically adjusting the virtual image display and performing distortion correction, the problem of insufficient fit between the virtual image and the real scene is solved, and the driving experience and driving safety are improved.
Patent Information
- Application Number
- CN202411726174.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-28
- Publication Date
- 2025-02-18
AI Technical Summary
In the existing head-up display technology, the fitting ability of virtual images and real scenes is limited, and cannot change with the driver's observation angle. It also has a large distortion, resulting in the inability to align the virtual and real scenes, affecting the driver's driving experience.
By monitoring the target real scene position of the vehicle and the driver's target eye point position in real time, dynamically adjust the virtual image display to make the virtual image better fit with the actual road and environment, and reduce image distortion through distortion correction technology and improve the alignment of the virtual image and the real scene Spend.
It achieves a better fit between virtual images and real scenes, reduces the visual deviation between virtual and real, and improves the driver's driving experience and driving safety.
Smart Images
Figure CN119472042A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of virtual display technology, and in particular to a virtual image display method, a display device and a vehicle-mounted terminal. Background Art
[0002] Head-up display is a popular technology today, and automobiles' investment in this technology is increasing year by year. Head-up display can project a variety of driving information onto the vehicle's windshield, so that the driver can see relevant information without lowering his head, and can focus more on observing the road ahead and surrounding vehicles. It can also reduce the driver's visual fatigue caused by frequently switching between looking up to view the road in the distance and looking down to view the vehicle interface, thereby improving driving safety.
[0003] However, in the existing head-up display technology, the ability to fit the virtual image and the real scene is limited, and it cannot change with the driver's observation angle. At the same time, the distortion is large, which makes it impossible to align the virtual and real scenes, affecting the driver's driving experience. Summary of the invention
[0004] In order to solve the above technical problems, the present application provides a virtual image display method, a display device and a vehicle-mounted terminal that can increase the degree of fit between the virtual image and the real object.
[0005] Specifically, the present application provides a virtual image display method, the virtual image display method comprising the following steps:
[0006] Monitor the current vehicle's target real-scene position and the driver's target eye point position in real time.
[0007] Position offset correction is performed according to the target real scene position and the target eye point position to output a virtual image display signal.
[0008] And, distortion correction is performed according to the target eye point position and the virtual image display signal to output a target virtual image plane, and the target virtual image plane is displayed on the windshield of the current vehicle.
[0009] In the above technical solution, by real-time monitoring of the target real-scene position of the vehicle and the target eye position of the driver, the system can dynamically adjust the virtual image display so that the virtual image can better fit the actual road and environment. This dynamic adjustment capability solves the problem in the prior art that the virtual image and the real scene cannot change with the observation angle.
[0010] In addition, the target virtual image plane is output based on the target eye point position and the virtual image display signal, which effectively reduces distortion and further enables better alignment of the virtual image and the real scene, thereby improving the driver's driving experience.
[0011] Furthermore, before monitoring the target real scene position and the target eye point position, it includes:
[0012] N groups of first eye boxes, M groups of second eye boxes and N+M groups of simulated eye point positions are predetermined; wherein N and M are both integers greater than 1.
[0013] In the above technical solution, multiple groups of first eye boxes and second eye boxes are predetermined to ensure that under different driving conditions (such as different drivers, different seat positions, etc.), the system can automatically select the most suitable eye box and simulated eye point position, thereby achieving personalized virtual image display adjustment.
[0014] Furthermore, before monitoring the target real scene position and the target eye point position, it also includes:
[0015] The simulated real scene position is obtained, and N groups of simulated virtual image planes are obtained based on the simulated real scene position and the simulated eye point positions corresponding to each group of first eye boxes.
[0016] Based on the distance difference between the second eye box and any group of first eye boxes, simulated virtual image planes corresponding to the M groups of second eye boxes are obtained.
[0017] In the above technical solution, by pre-acquiring the simulated real scene position and the simulated virtual image plane, the system can perform preprocessing and optimization before monitoring the actual data, reducing the computational burden and error in real-time monitoring, improving the robustness and reliability of the system, and ensuring that the system can provide stable virtual image display under various driving conditions; based on the distance difference between the first eye box and the second eye box, the simulated virtual image plane of each second eye box is obtained, which simplifies the calculation process and improves the computing efficiency.
[0018] Furthermore, before monitoring the target real scene position and the target eye point position, it also includes:
[0019] Distortion recording is performed based on each group of first eye boxes, second eye boxes and simulated eye point positions to obtain several groups of distortion correction data according to the distortion recording results.
[0020] In the above technical solution, by pre-recording the distortion based on each group of first eye boxes, second eye boxes and simulated eye point positions, the system can identify and quantify in advance the image distortion problems that may occur under different viewing angles and eye point positions. This method of pre-recording distortion enables the system to better understand and correct the distortion phenomenon in the virtual image display; obtaining several groups of distortion correction data based on the distortion recording results enables the system to apply these correction data in real time during virtual image display, thereby significantly reducing image distortion, improving the fit between the virtual image and the real scene, and providing a more realistic and clear image display.
[0021] Furthermore, the output virtual image display signal includes:
[0022] A corresponding set of simulated eye point positions are matched according to the target eye point positions, so as to obtain corresponding simulated virtual image planes according to the matched simulated eye point positions.
[0023] A virtual image display signal is output according to the target real scene position, the target eye point position and the matched simulated virtual image plane.
[0024] In the above technical solution, by matching a corresponding set of simulated eyepoint positions according to the target eyepoint position, the system can more accurately determine the driver's actual observation angle and position; obtain the corresponding simulated virtual image plane according to the matched simulated eyepoint position, and output the virtual image display signal in combination with the target real scene position and the target eyepoint position, which lays a solid foundation for subsequent virtual image adjustment and optimization.
[0025] Furthermore, the output target virtual image plane includes:
[0026] A set of distortion correction data corresponding to the target eye point position is matched as target correction data.
[0027] A target virtual image plane is output based on the target correction data and the virtual image display signal.
[0028] In the above technical solution, by matching a corresponding set of distortion correction data according to the target eye point position, the system can more accurately determine the current driver's observation angle and position, thereby selecting the most appropriate distortion correction data. This method can significantly reduce image distortion and improve the realism and clarity of the virtual image display; by dynamically adjusting the target virtual image plane, the system can automatically optimize the virtual image display effect under different driving conditions and eye point positions, ensuring that the virtual image is always within the driver's optimal field of view, while also further improving the fit between the real scene and the virtual image.
[0029] Based on the same concept, the present application also provides a virtual image display device, comprising at least:
[0030] A driving assistance system is used to obtain the real-life location of a target.
[0031] A monitoring system is used to obtain the target eye point position.
[0032] And a head-up display system is used to display a virtual image display signal and a target virtual image plane according to the virtual image display method.
[0033] In the above technical solution, through the virtual image display device, the virtual image display can be dynamically adjusted according to the acquired target real scene position and target eye point position, and the fit between the virtual image and the real scene can be enhanced, making the virtual image display more natural and realistic, reducing the visual deviation between virtual and real, thereby improving the comfort and safety of the driving experience.
[0034] Furthermore, the virtual image display device further comprises:
[0035] A memory is used to store N+M groups of simulated virtual image planes and several groups of distortion correction data; wherein N and M are both integers greater than 1.
[0036] In the above technical solution, multiple sets of simulated virtual image planes and distortion correction data are pre-stored, and the system can be pre-loaded and optimized when it starts, reducing the time and resource consumption of dynamic calculations.
[0037] Furthermore, the head-up display system includes:
[0038] The central processing system is used to match the corresponding simulated virtual image plane according to the target eye point position, so as to output a virtual image display signal according to the target real scene position, the target eye point position and the matched simulated virtual image plane; and is also used to match the corresponding distortion correction data according to the target eye point position as the target correction data, so as to output the target virtual image plane to the projection system based on the target correction data and the virtual image display signal.
[0039] The projection system is used to project the target virtual image plane onto a windshield for display.
[0040] In the above technical solution, the central processing system can process the data of the target real scene position and the target eye point position in real time, ensuring that the projection system can display a virtual image that is highly consistent with the actual environment, enhancing the fit between the virtual image and the real scene, and reducing the visual deviation between the virtual and the real.
[0041] Based on the same concept, the present application also provides a vehicle-mounted terminal, which is at least configured with the virtual image display device to implement the virtual image display method through the virtual image display device.
[0042] Compared with the prior art, the beneficial effects of this application are:
[0043] The present application first monitors the target real-scene position of the current vehicle and the target eye point position of the driver in real time; then performs position offset correction according to the target real-scene position and the target eye point position to output a virtual image display signal; and, based on the virtual image display signal and the target eye point position, performs distortion correction to output a target virtual image plane and display the target virtual image plane on the windshield of the current vehicle. The present application can dynamically adjust the virtual image display so that the virtual image can better fit the actual road and environment, and can effectively reduce distortion, further align the virtual image with the real scene better, and enhance the driver's driving experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0044] Figure 1 This is a flow chart of the virtual image display method described in this application.
[0045] Figure 2 Schematic diagram of the calculation method of the virtual image display signal and the target virtual image plane.
[0046] Figure 3 Schematic diagram of the eye box position during distortion recording.
[0047] Figure 4 This is a framework diagram of the virtual image display device described in this application. DETAILED DESCRIPTION
[0048] A virtual image display method, a display device and a vehicle-mounted terminal of the present application are further described in detail below in conjunction with specific embodiments and drawings.
[0049] See also Figure 1 , an embodiment of the present application provides a virtual image display method, and the virtual image display method includes steps S100 to S300.
[0050] Specifically, the front vehicle or vehicle-mounted camera is used for monitoring and data collection, and then the acquired target real scene position is input into the AR-HUD head-up display system. At the same time, the driver's head position information and eye position information are monitored by a driver monitoring system such as a DMS, and the target eye point position is obtained by combining the head position information and eye position information, and then the target eye point position is input into the AR-HUD head-up display system.
[0051] Furthermore, after receiving the target real scene position and the target eye point position, the head-up display system first performs position offset correction to output a virtual image display signal; then, based on the virtual image display signal and the target eye point position, distortion correction is performed, and the target virtual image plane generated is transmitted through the PGU display system. The optical projection system projects the content illuminated by the PGU backlight system onto the windshield of the current vehicle after reflection through two curved mirrors for the driver to observe.
[0052] The following is a detailed description of steps S100 to S300.
[0053] Wherein, step S100: real-time monitoring of the target real-scene position of the current vehicle and the target eye point position of the driver.
[0054] In some embodiments, the target real-scene position includes at least a preceding vehicle position, a road position, and a lane line position.
[0055] It should be noted that the target real scene location may also include other environmental information and is not limited to the above types.
[0056] Optionally, the information related to the target real-scene position is obtained through a vehicle-mounted camera. Those skilled in the art may also select other acquisition methods according to actual application requirements and are not limited to this.
[0057] Furthermore, before monitoring the target real scene position and the target eye point position, it includes:
[0058] N groups of first eye boxes, M groups of second eye boxes and N+M groups of simulated eye point positions are predetermined; wherein N and M are both integers greater than 1.
[0059] In some embodiments, the N groups of first eye boxes include a high eye box, a middle eye box and a low eye box, and the M groups of second eye boxes include eye boxes that have a preset distance difference from each first eye box in the vertical or horizontal direction; each group of simulated eye point positions is the eye point position of the center of the eye box corresponding to each first eye box or the second eye box, and each group of simulated eye point positions can be regarded as arranged in a matrix form after combination.
[0060] It should be noted that the first eye boxes are preferably three groups to cover more eye positions, and it is also convenient to obtain the corresponding virtual image plane based on the remaining eye boxes; the number of the second eye boxes is not limited here, and technical personnel in this field can set it according to actual application requirements.
[0061] In the above technical solution, multiple groups of first eye boxes and second eye boxes are predetermined to ensure that under different driving conditions (such as different drivers, different seat positions, etc.), the system can automatically select the most suitable eye box and simulated eye point position, thereby achieving personalized virtual image display adjustment.
[0062] Furthermore, before monitoring the target real scene position and the target eye point position, it also includes:
[0063] The simulated real scene position is obtained, and N groups of simulated virtual image planes are obtained based on the simulated real scene position and the simulated eye point positions corresponding to each group of first eye boxes.
[0064] In some embodiments, it is necessary to first establish an eye box model corresponding to each eye box, taking the high eye box as an example:
[0065] See also Figure 2 , pre-input the simulated eye point position corresponding to the high eye box, such as point B0, obtain the specific coordinate position, and then pre-input the simulated real scene position to obtain the specific position P. At this time, the straight line B0P can be obtained, and the high eye box lower viewing angle β and the high eye box virtual image distance B0B1 are input. With B0B1 as the normal and B1 as the center, a plane is established, and the virtual image display plane M2 is obtained according to the virtual image size.
[0066] In the same way, a middle eye box model and a low eye box model are established, and the virtual image display planes corresponding to the middle eye box and the low eye box are found.
[0067] Based on the distance difference between the second eye box and any group of first eye boxes, simulated virtual image planes corresponding to the M groups of second eye boxes are obtained.
[0068] In some embodiments, three eye box model data of high, medium and low are established, which correspond to the highest, middle and lowest eye box positions of AR-HUD. At this time, the positions of the virtual image planes of the remaining eye box heights can be obtained by the difference method.
[0069] In the above technical solution, by pre-acquiring the simulated real scene position and the simulated virtual image plane, the system can perform preprocessing and optimization before monitoring the actual data, reducing the computational burden and error in real-time monitoring, improving the robustness and reliability of the system, and ensuring that the system can provide stable virtual image display under various driving conditions; based on the distance difference between the first eye box and the second eye box, the simulated virtual image plane of each second eye box is obtained, which simplifies the calculation process and improves the computing efficiency.
[0070] Furthermore, before monitoring the target real scene position and the target eye point position, it also includes:
[0071] Distortion recording is performed based on each group of first eye boxes, second eye boxes and simulated eye point positions to obtain several groups of distortion correction data according to the distortion recording results.
[0072] In some embodiments, see Figure 3 , taking the five eye boxes in the vertical direction as an example; among them, No. 1, No. 3, and No. 5 are three eye boxes of high, medium and low respectively, and No. 2 and No. 4 are the second eye boxes mentioned above.
[0073] Adjust the simulated eye point position to the position of eye box No. 1, select eye points 1, 2, and 3 of eye box No. 1, and record the static distortion; at the same time, adjust the simulated eye point position to eye points 4, 5, and 6 of eye box No. 1, and record the static distortion.
[0074] Optionally, the record of the static distortion includes, for example, a distorted image and distortion parameters; those skilled in the art may also record more distortion data according to actual application requirements and are not limited thereto.
[0075] Furthermore, the simulated eye point position is adjusted to the position of eye box No. 2, and eye points No. 4, 5, and 6 of eye box No. 2 are selected to record the static distortion.
[0076] Furthermore, the simulated eye point position is adjusted to the position of eye box No. 3, and eye points No. 4, 5, and 6 of eye box No. 3 are selected to record the static distortion.
[0077] Furthermore, the simulated eye point position is adjusted to the position of eye box No. 4, and eye points No. 4, 5, and 6 of eye box No. 4 are selected to record the static distortion.
[0078] Further, the simulated eye point position is adjusted to the position of eye box No. 5, and eye points No. 4, 5, and 6 of eye box No. 5 are selected to record the static distortion; at the same time, the simulated eye point position is adjusted to eye points No. 7, 8, and 9 of eye box No. 5 to record the static distortion.
[0079] In this embodiment, a total of 21 sets of static distortion data of eye positions are obtained, and these static distortion data are summarized and subdivided using interpolation method according to usage, so as to obtain static distortion data within the entire eye box; the static distortion data is distortion correction data.
[0080] Optionally, the static distortion data of all eye positions are aggregated into a unified data table or database, and a suitable interpolation method is selected according to the data distribution and application requirements, such as linear interpolation, polynomial interpolation, spline interpolation, etc.
[0081] Take the linear interpolation method as an example:
[0082] Determine the interpolation nodes, which are points that need to be interpolated between known eye points; for example, interpolate between eye points 1, 2, and 3 of eye box 1.
[0083] Furthermore, interpolation coefficients are calculated based on the coordinates of the known eye points and the coordinates of the points to be interpolated, and the known eye points are linearly combined using the interpolation coefficients to obtain static distortion data of the points to be interpolated. The above steps are repeated to perform interpolation calculations on all points that need to be interpolated, and the static distortion data obtained by interpolation are summarized in a data table or database.
[0084] It should be noted that those skilled in the art may also use other aggregation methods to aggregate the static distortion data, and may also use interpolation methods other than those listed above, and are not limited to these.
[0085] In the above technical solution, by pre-recording the distortion based on each group of first eye boxes, second eye boxes and simulated eye point positions, the system can identify and quantify in advance the image distortion problems that may occur under different viewing angles and eye point positions. This method of pre-recording distortion enables the system to better understand and correct the distortion phenomenon in the virtual image display; obtaining several groups of distortion correction data based on the distortion recording results enables the system to apply these correction data in real time during virtual image display, thereby significantly reducing image distortion, improving the fit between the virtual image and the real scene, and providing a more realistic and clear image display.
[0086] Step S200: performing position offset correction according to the target real scene position and the target eye point position to output a virtual image display signal.
[0087] Furthermore, the output virtual image display signal includes:
[0088] A corresponding set of simulated eye point positions are matched according to the target eye point positions, so as to obtain corresponding simulated virtual image planes according to the matched simulated eye point positions.
[0089] A virtual image display signal is output according to the target real scene position, the target eye point position and the matched simulated virtual image plane.
[0090] In some embodiments, the actual binocular coordinates of the driver are obtained, and the binocular midpoint coordinates are taken as the target eye point position at this time. If the corresponding simulated eye point position is matched, such as point B0, point B0 is taken as the eye box height at this time, and the virtual image plane position M2 at this time is calculated, and B0 and the target real scene position P are connected. At this time, B0P and M2 intersect at point B2, then the position of point B2 on M2 is the position where the display content in the virtual image plane fits with the target real scene position P at this time, that is, the virtual image display plane.
[0091] In addition, a virtual image display signal is output based on the virtual image display plane to advance to the next step of distortion correction.
[0092] In the above technical solution, by matching a corresponding set of simulated eyepoint positions according to the target eyepoint position, the system can more accurately determine the driver's actual observation angle and position; obtain the corresponding simulated virtual image plane according to the matched simulated eyepoint position, and output the virtual image display signal in combination with the target real scene position and the target eyepoint position, which lays a solid foundation for subsequent virtual image adjustment and optimization.
[0093] Step S300: performing distortion correction according to the target eye point position and the virtual image display signal to output a target virtual image plane, and displaying the target virtual image plane on the windshield of the current vehicle.
[0094] Furthermore, the output target virtual image plane includes:
[0095] A set of distortion correction data corresponding to the target eye point position is matched as target correction data.
[0096] A target virtual image plane is output based on the target correction data and the virtual image display signal.
[0097] In some embodiments, after receiving a virtual image display signal, a corresponding virtual image display plane is obtained based on the virtual image display signal, and its specific position within the entire eye box is determined according to the acquired target eye point position, and then a corresponding set of distortion correction data is matched to perform distortion correction, thereby confirming the specific display position of the virtual image display plane corresponding to the TFT display screen.
[0098] The PGU display system illuminates the display information of the TFT so that it propagates along the optical path; then the optical projection system projects the content illuminated by the PGU display system onto the windshield after being reflected by two curved mirrors, and forms a projection at a certain distance in front of the vehicle, which is a virtual image for the driver to observe.
[0099] It should be noted that the target virtual image plane is displayed by the PGU display system and the optical projection system.
[0100] In the above technical solution, by matching a corresponding set of distortion correction data according to the target eye point position, the system can more accurately determine the current driver's observation angle and position, thereby selecting the most appropriate distortion correction data. This method can significantly reduce image distortion and improve the realism and clarity of the virtual image display; by dynamically adjusting the target virtual image plane, the system can automatically optimize the virtual image display effect under different driving conditions and eye point positions, ensuring that the virtual image is always within the driver's optimal field of view, while also further improving the fit between the real scene and the virtual image.
[0101] Based on the same idea, see Figure 4 The present application also provides a virtual image display device, which at least includes a driving assistance system, a monitoring system and a head-up display system.
[0102] Wherein, the driving assistance system is used to obtain the real-scene position of the target.
[0103] In this embodiment, the driving assistance system is an ADAS driving assistance system, and the target real-scene position includes at least the position of the leading vehicle, the road position, and the lane line position. Usually, monitoring and data collection are carried out using equipment such as the leading vehicle or the vehicle body camera, and finally the obtained target real-scene position is input into the AR-HUD head-up display system.
[0104] Among them, ADAS stands for Advanced Driver Assistance Systems, which is an active safety technology that uses sensor technology to improve vehicle safety. The system collects environmental data inside and outside the vehicle through various sensors installed on the vehicle, such as cameras, radars, lasers, and ultrasound, and performs technical processing such as identification, detection, and tracking of static and dynamic objects.
[0105] Furthermore, the monitoring system is used to obtain the target eye point position.
[0106] In this embodiment, the monitoring system, namely the DMS driver monitoring system, is used to monitor the driver's head position information and eye position information, and obtain the target eye point position by integrating the head position information and eye position information, and then input the target eye point position into the AR-HUD head-up display system.
[0107] Among them, DMS driver eye position recognition is a key function in the Driver Monitoring System (DMS). It mainly captures the driver's head and eye movements through a camera, and combines deep learning algorithms to conduct in-depth analysis of the captured information, thereby achieving accurate judgment of the driver's status.
[0108] Furthermore, the head-up display system is used to display the virtual image display signal and the target virtual image plane according to the virtual image display method.
[0109] In the above technical solution, through the virtual image display device, the virtual image display can be dynamically adjusted according to the acquired target real scene position and target eye point position, and the fit between the virtual image and the real scene can be enhanced, making the virtual image display more natural and realistic, reducing the visual deviation between virtual and real, thereby improving the comfort and safety of the driving experience.
[0110] Furthermore, the virtual image display device further comprises:
[0111] A memory is used to store N+M groups of simulated virtual image planes and several groups of distortion correction data; wherein N and M are both integers greater than 1.
[0112] In the above technical solution, multiple sets of simulated virtual image planes and distortion correction data are pre-stored, and the system can be pre-loaded and optimized when it starts, reducing the time and resource consumption of dynamic calculations.
[0113] Furthermore, the head-up display system includes:
[0114] The central processing system is used to match the corresponding simulated virtual image plane according to the target eye point position, so as to output a virtual image display signal according to the target real scene position, the target eye point position and the matched simulated virtual image plane; and is also used to match the corresponding distortion correction data according to the target eye point position as the target correction data, so as to output the target virtual image plane to the projection system based on the target correction data and the virtual image display signal.
[0115] In some embodiments, the central processing system is responsible for processing information from other driving systems that communicate with it, integrating the information to output a display content signal (i.e., the target virtual image plane), and transmitting the display content signal to the TFT display screen of the PGU display system.
[0116] The projection system is used to project the target virtual image plane onto a windshield for display.
[0117] In some embodiments, the projection system includes at least a PGU display system and an optical projection system.
[0118] The PGU display system includes a backlight system and a TFT display screen. The TFT receives information processed by the central processor and illuminates the received information through the backlight system so that the information is transmitted along the optical path.
[0119] The optical projection system projects the content illuminated by the PGU backlight system onto the windshield after being reflected by two curved mirrors, and forms a projection at a certain distance in front of the vehicle, which is a virtual image for the driver to observe.
[0120] In the above technical solution, the central processing system can process the data of the target real scene position and the target eye point position in real time, ensuring that the projection system can display a virtual image that is highly consistent with the actual environment, enhancing the fit between the virtual image and the real scene, and reducing the visual deviation between the virtual and the real.
[0121] Based on the same concept, the present application also provides a vehicle-mounted terminal, which is at least configured with the virtual image display device to implement the virtual image display method through the virtual image display device.
[0122] In summary, the present application provides a virtual image display method, a display device, and a vehicle-mounted terminal; first, the target real scene position of the current vehicle and the target eye point position of the driver are monitored in real time; then, position offset correction is performed according to the target real scene position and the target eye point position to output a virtual image display signal; and, distortion correction is performed based on the virtual image display signal and the target eye point position to output a target virtual image plane, and the target virtual image plane is displayed on the windshield of the current vehicle. The present application can dynamically adjust the virtual image display so that the virtual image can better fit the actual road and environment, and can effectively reduce distortion, further align the virtual image with the real scene better, and enhance the driver's driving experience.
[0123] Although example embodiments have been described herein with reference to the accompanying drawings, it should be understood that the above example embodiments are merely exemplary and are not intended to limit the scope of the present application to this. Those of ordinary skill in the art may make various changes and modifications therein without departing from the scope and spirit of the present application. All these changes and modifications are intended to be included within the scope of the present application as required by the appended claims.
[0124] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0125] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of the units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed.
[0126] The various component embodiments of the present application can be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. It should be understood by those skilled in the art that a microprocessor or digital signal processor (DSP) can be used in practice to implement some or all functions of some modules according to the embodiments of the present application. The application can also be implemented as a device program (e.g., computer program and computer program product) for executing a part or all of the methods described herein. Such a program implementing the present application can be stored on a computer-readable medium, or can have the form of one or more signals. Such a signal can be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.
[0127] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.
[0128] Although the description of the present application is carried out in conjunction with the above specific embodiments, it is obvious that those skilled in the art can make many substitutions, modifications and changes based on the above content. Therefore, all such substitutions, improvements and changes are included in the spirit and scope of the appended claims.
Claims
1. A virtual image display method, characterized in that: The virtual image display method comprises the following steps: Real-time monitoring of the current vehicle's target real-scene position and the driver's target eye point position; Performing position offset correction according to the target real scene position and the target eye point position to output a virtual image display signal; And, distortion correction is performed based on the virtual image display signal and the target eye point position to output a target virtual image plane, and the target virtual image plane is displayed on the windshield of the current vehicle.
2. The virtual image display method according to claim 1, characterized in that: Before monitoring the target real scene position and target eye point position, including: N groups of first eye boxes, M groups of second eye boxes and N+M groups of simulated eye point positions are predetermined; wherein N and M are both integers greater than 1.
3. The virtual image display method according to claim 2, characterized in that: Before monitoring the target real scene position and the target eye point position, it also includes: Acquire a simulated real scene position, and acquire N groups of simulated virtual image planes based on the simulated real scene position and the simulated eye point positions corresponding to each group of first eye boxes; Based on the distance difference between the second eye box and any group of first eye boxes, simulated virtual image planes corresponding to the M groups of second eye boxes are obtained.
4. The virtual image display method according to claim 2, characterized in that: Before monitoring the target real scene position and the target eye point position, it also includes: Distortion recording is performed based on each group of first eye boxes, second eye boxes and simulated eye point positions to obtain several groups of distortion correction data according to the distortion recording results.
5. The virtual image display method according to claim 3, characterized in that: The output virtual image display signal comprises: Matching a corresponding set of simulated eye point positions according to the target eye point position, so as to obtain a corresponding simulated virtual image plane according to the matched simulated eye point positions; A virtual image display signal is output according to the target real scene position, the target eye point position and the matched simulated virtual image plane.
6. The virtual image display method according to claim 4, characterized in that: The output target virtual image plane comprises: Matching a corresponding set of distortion correction data according to the target eye point position as target correction data; A target virtual image plane is output based on the target correction data and the virtual image display signal.
7. A virtual image display device, characterized in that: At least: Driving assistance system, used to obtain the real-life location of the target; A monitoring system for obtaining the target eye point position; And a head-up display system, used for displaying a target virtual image plane according to the virtual image display method according to any one of claims 1-6.
8. The virtual image display device according to claim 7, characterized in that: The virtual image display device also includes: A memory is used to store N+M groups of simulated virtual image planes and several groups of distortion correction data; wherein N and M are both integers greater than 1.
9. The virtual image display device according to claim 8, characterized in that: The head-up display system comprises: A central processing system, used for matching a corresponding simulated virtual image plane according to the target eye point position, so as to output a virtual image display signal according to the target real scene position, the target eye point position and the matched simulated virtual image plane; and also used for matching corresponding distortion correction data according to the target eye point position as target correction data, so as to output the target virtual image plane to the projection system based on the target correction data and the virtual image display signal; The projection system is used to project the target virtual image plane onto a windshield for display.
10. A vehicle-mounted terminal, characterized in that: The vehicle-mounted terminal is at least equipped with the virtual image display device, so as to implement the virtual image display method as described in any one of claims 1 to 6 through the virtual image display device.