A calibration device for AR-HUD

Abstract

This utility model relates to the field of automotive calibration technology, specifically to an AR-HUD calibration device. It includes a vehicle positioning module, a camera fixing device, an AR-HUD display module, an image acquisition module, an industrial control computer, and a height control module. The vehicle positioning module positions the vehicle at a fixed point; the AR-HUD display module displays a crosshair image on the windshield; the camera fixing device is a multi-axis robotic arm that moves the camera to simulate different heights; the image acquisition module is connected to the camera and acquires the crosshair image through the camera; the industrial control computer is connected to and controls the multi-axis robotic arm, the image acquisition module, and the AR-HUD display module; the height control module is connected to the industrial control computer and adjusts the alignment of the acquired crosshair image with the center of the camera's field of view. This utility model solves the problem of drivers of different heights not being able to see the crosshair image by moving the camera to simulate the eye position of people of different heights, and the height control module adjusts the height of the crosshair image.

Description

Technical Field

[0001] This utility model relates to the field of automotive calibration technology, specifically to a calibration device for an AR-HUD. Background Technology

[0002] AR-HUD is a technology that combines augmented reality (AR) with a head-up display (HUD). The HUD projects an image onto the windshield using a projector, and after optical imaging, displays a virtual scene several meters in front of the car window. The in-vehicle computing system then renders important information needed by the driver into the virtual scene, such as navigation and traffic information. This rendered information blends seamlessly with the real-world scene within the driver's field of vision, achieving the AR effect.

[0003] Currently, existing AR-HUD calibration technology can adjust the height and brightness of the AR-HUD. This brightness adjustment method includes acquiring a scene image in front of the car window; generating an AR-HUD display image based on the scene image; obtaining the brightness distribution of the AR-HUD display image; dividing the AR-HUD display image into one or more image regions; and calculating and adjusting the light source power corresponding to the image region based on the brightness distribution of the scene image. While this method can adjust the brightness of different regions, it does not specifically handle brightness variations in different scenes. In practical applications, due to the complexity and diversity of actual driving environments, different weather brightness and different scene brightness require matching display brightness, which may lead to situations where the AR-HUD is not visible in tunnel scenes. Furthermore, its height adjustment control method cannot limit the upper and lower limits of the AR-HUD height. In practical applications, because different drivers have different line-of-sight heights, the required AR-HUD imaging height also varies, which may result in some tall or short people not being able to see the AR-HUD.

[0004] This invention addresses the shortcomings of existing technologies by disclosing a calibration device for an automotive AR-HUD to solve the aforementioned problems. Utility Model Content

[0005] This invention addresses the technical problems existing in the prior art by providing an AR-HUD calibration device, which can effectively improve the problem of AR-HUD being too dim to see in special scenarios and the problem of drivers of different heights not being able to see it.

[0006] The technical solution of this utility model to solve the above-mentioned technical problems is as follows: A calibration device for an automotive AR-HUD, comprising:

[0007] Vehicle positioning module: used to move the vehicle to the calibration test bench for fixed-point positioning;

[0008] AR-HUD display module: used to display a crosshair cursor image on the windshield;

[0009] Image acquisition module: This is a camera used to capture the image of the crosshair cursor on the windshield;

[0010] The camera fixing device is a multi-axis robotic arm used to move and fix the camera to different heights;

[0011] An industrial control computer is connected to and controls the multi-axis robotic arm, camera, and AR-HUD display module, respectively.

[0012] The calibration module includes:

[0013] The height control module, connected to the industrial control computer, is used to adjust the position of the crosshair image to match the position of the camera's field of view center based on the positional relationship between the acquired crosshair image and the camera's field of view center.

[0014] Based on the above technical solution, the present invention can be further improved as follows.

[0015] Furthermore, the calibration module also includes a brightness control module, which is connected to an industrial control computer. The industrial control computer simulates ambient lighting data and sends it to the AR-HUD, such as simulated tunnel ambient lighting data, garage ambient lighting data, nighttime interval street light ambient lighting data, and daytime bright sunlight interval tree shade ambient lighting data, etc., to adjust the display brightness of the AR-HUD.

[0016] Furthermore, it also includes a sunlight and rain sensor, used to collect real-time data on ambient light levels.

[0017] Furthermore, the brightness control module is connected to the sunlight and rain sensor to acquire ambient light data; and adjusts the display brightness of the AR-HUD according to the correspondence between the data and the display brightness.

[0018] Furthermore, the industrial control computer is communicatively connected to the vehicle positioning module to lock the vehicle's location.

[0019] Furthermore, the industrial control computer communicates with the vehicle positioning module via an OBD interface.

[0020] Furthermore, the AR-HUD image uses a crosshair cursor image.

[0021] Furthermore, the multi-axis robotic arm is a six-axis robotic arm.

[0022] The beneficial effects of this utility model are:

[0023] 1. In this embodiment, an industrial control computer connects to a six-axis robotic arm to control a camera. The camera is moved to different heights to simulate the eye position of people of different heights to acquire images. The height control module is then used to adjust the AR-HUD height for calibration. This solves the problem that people of different heights cannot see the AR-HUD image display, improves the calibration accuracy of the AR-HUD, and expands the range of user heights that the AR-HUD imaging can adapt to.

[0024] 2. In this embodiment, an industrial control computer connects to the vehicle, acquires data from sunlight and rainfall sensors, and, based on the correspondence between the sunlight and rainfall sensor data and display brightness, controls the brightness control module to adjust the brightness for automatic calibration. This solves the problem of AR-HUD being invisible due to excessive changes in ambient brightness within a short period, improves the calibration accuracy of AR-HUD, and increases the vehicle ambient light scenarios that AR-HUD imaging can adapt to. Attached Figure Description

[0025] Figure 1 This is a schematic diagram of the AR-HUD calibration device described in an embodiment of the present invention;

[0026] Figure 2 This is a flowchart of the AR-HUD calibration device described in an embodiment of the present invention. Detailed Implementation

[0027] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0028] In the description of this application, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the stated features. In the description of this application, "multiple" means two or more, unless otherwise explicitly specified.

[0029] In the description of this application, the term "for example" is used to mean "used as an example, illustration, or description." Any embodiment described as "for example" in this application is not necessarily to be construed as being more preferred or advantageous than other embodiments. The following description is provided to enable any person skilled in the art to implement and use the present invention. Details are set forth in the following description for purposes of explanation. It should be understood that those skilled in the art will recognize that the present invention can be implemented without using these specific details. In other instances, well-known structures and processes will not be described in detail to avoid obscuring the description of the present invention with unnecessary detail. Therefore, the present invention is not intended to be limited to the embodiments shown, but is consistent with the broadest scope of the principles and features disclosed in this application.

[0030] Example

[0031] A calibration device for an automotive AR-HUD, comprising:

[0032] Vehicle positioning module: used to move the vehicle to the calibration test bench for fixed-point positioning;

[0033] AR-HUD display module: used to display a crosshair cursor image on the windshield;

[0034] Image acquisition module: This is a camera used to capture the image of the crosshair cursor on the windshield;

[0035] The camera fixing device is a multi-axis robotic arm used to move and fix the camera to different heights to simulate the eye position of people of different heights;

[0036] An industrial control computer is connected to and controls the multi-axis robotic arm, camera, and AR-HUD display module; the industrial control computer is communicatively connected to the vehicle positioning module for locking the vehicle's position; wherein, the industrial control computer communicates with the vehicle positioning module via an OBD interface.

[0037] The calibration module includes:

[0038] The height control module, connected to the industrial control computer, is used to adjust the position of the crosshair image to match the position of the camera's field of view center based on the positional relationship between the acquired crosshair image and the camera's field of view center.

[0039] The multi-axis robotic arm is a six-axis robotic arm, capable of vertical, horizontal, and vertical adjustment.

[0040] In this embodiment, the vehicle positioning module can be one that is already available in the prior art, for example, a high-precision GNSS positioning module of model u-blox NEO-F9P can be used;

[0041] The AR-HUD display module can use existing technologies, such as the Texas Instruments DLP3030-Q1 automotive-grade DMD chip;

[0042] The height control module can be one that is already in use in existing technologies. For example, a robotic arm drive module can be used to drive a six-axis robotic arm to achieve adjustments in height, direction, left and right.

[0043] In this embodiment, the industrial control computer (ICC) uses a vehicle positioning module to position the vehicle at a fixed point for subsequent calibration testing. The ICC controls a multi-axis robotic arm to move the camera to the test point and operates the camera to acquire images. An AR-HUD display module is used to display a crosshair image, connected to the ICC. This module adjusts the position of the crosshair image based on its positional relationship with the center of the camera's field of view, ensuring their centers coincide, thus calibrating the vertical adjustment stroke and completing the height calibration. This allows the six-axis robotic arm to simulate the AR-HUD image position as seen by people of different heights.

[0044] Specifically, the method for adjusting the position of the crosshair image is as follows: the image acquisition module acquires the crosshair image on the windshield through the camera, extracts the center coordinates of the cursor after image processing, and compares them with the center position of the camera's field of view. As long as the two positions do not overlap, the position of the crosshair image is adjusted by the height control module. The adjustment method can be manual adjustment or simple algorithm calculation adjustment.

[0045] The following is one algorithmic adjustment method: The image acquisition module captures an image of a crosshair cursor on the windshield using a camera. After image processing to extract the cursor center coordinates, the vertical pixel deviation between the crosshair and the camera's field of view center is calculated. Based on pre-calibrated camera focal length, installation angle, and projection distance parameters, this pixel deviation is converted into an actual height difference and fed back to the height control module until the cursor center coincides with the field of view center, completing the height calibration. Since the horizontal position is assumed to coincide, only height adjustment is described here. Although this embodiment assumes horizontal calibration is complete, the same principle can be used to achieve lateral adjustment when needed. This algorithm is prior art and is not the focus of this utility model's protection. In actual implementation, manual adjustment or different algorithm adjustments can be selected according to requirements, and the specific implementation method does not affect the protection scope of this utility model.

[0046] In a preferred embodiment, the calibration module further includes a brightness control module, which is connected to an industrial control computer and sends simulated ambient lighting data to the AR-HUD, such as simulated tunnel ambient lighting data, garage ambient lighting data, nighttime interval street light ambient lighting data, and daytime bright sunlight interval tree shade ambient lighting data, etc., to adjust the display brightness of the AR-HUD.

[0047] In a preferred embodiment, a sunlight and rainfall sensor is also included to collect real-time ambient light data, providing data for subsequent brightness adjustment.

[0048] In this embodiment, the sunlight and rain sensor can be one that is already available in the prior art, for example, a high-precision environmental sensor such as the Vishay VEML7700.

[0049] The brightness control module can be one that is already in use in existing technologies, such as the Texas Instruments LP5866 multi-channel LED driver.

[0050] Specifically, the brightness control module is connected to the sunlight and rain sensor to acquire ambient light data; and adjusts the display brightness of the AR-HUD according to the correspondence between the data and the display brightness.

[0051] In this embodiment, the industrial control computer adjusts the AR-HUD brightness using a brightness control module based on data from a sunlight and rainfall sensor, and the correspondence between this data and display brightness, thus completing brightness calibration. Specifically, the AR-HUD brightness adjustment can be achieved by the industrial control computer having a built-in historical brightness database storing optimal AR-HUD display brightness parameters under different lighting conditions. The correspondence between sunlight and rainfall sensor data and display brightness can be derived from this historical brightness database. This method is existing technology and not the focus of this invention; other existing methods can also be used in actual implementation. The brightness control module dynamically adjusts the AR-HUD brightness based on these parameters, ensuring clear and comfortable visual information under different lighting conditions. This improves the AR-HUD's display effect in more bright and dark scenes, avoids situations where the HUD becomes invisible due to large changes in ambient brightness within a short period, and enhances the user's viewing experience.

[0052] The height calibration method in this embodiment is as follows:

[0053] Step 1: Connect the vehicle to the industrial computer via the OBD interface, move the vehicle to the test bench, and use the vehicle positioning module to locate the vehicle. Establish the connection between the vehicle and the industrial computer to position the vehicle for subsequent testing.

[0054] Step 2: Connect the industrial control computer to the six-axis robotic arm and control the six-axis multi-axis robotic arm to move the camera, simulating the eye height position of people of different heights, and simulating the position of the AR-HUD image seen by people of different heights through the six-axis robotic arm;

[0055] Step 3: Display the crosshair image via the AR-HUD display module;

[0056] Step 4: The camera captures the scene image on the windshield within the driver's field of vision, and captures the crosshair image. The industrial control computer then compares the crosshair image displayed on the AR-HUD with the center position of the camera.

[0057] Step 5: Based on the positional relationship obtained in Step 4, control the height control module to adjust the crosshair image so that it coincides with the center position of the camera, thus completing the height calibration. This achieves the height calibration effect.

[0058] Current AR-HUDs typically capture images directly from the vehicle window (windshield) and adjust the AR-HUD's height accordingly. This results in different perceived heights for people of different heights, significantly compromising the height display experience for each individual. In this embodiment, however, a camera simulates the height of a person's eye, and a height control module adjusts the vertical movement of the crosshair image to align it with the center of the camera, ensuring a consistent AR-HUD imaging display experience for people of different heights.

[0059] The brightness calibration method in this embodiment is as follows:

[0060] Step 1: Collect ambient light data in real time using a sunlight and rain sensor to provide data for subsequent brightness adjustment;

[0061] Step 2: The industrial control computer connects to the vehicle via the OBD interface to acquire data collected by the sunlight and rain sensors. Based on the correspondence between this data and the display brightness, the industrial control computer controls the brightness control module to adjust the AR-HUD brightness, thereby obtaining the final display brightness and completing the brightness calibration.

[0062] The brightness calibration method uses data from sunlight and rain sensors to adjust the brightness device. For example, in a tunnel scene, the brightness control module will adjust the brightness according to the illuminance in front of the vehicle collected by the sunlight and rain sensor, thereby effectively avoiding the situation where the HUD cannot be seen due to excessive changes in ambient brightness in a short period of time.

[0063] While embodiments or examples of this disclosure have been described with reference to the accompanying drawings, it should be understood that the methods, systems, and devices described above are merely exemplary embodiments or examples, and the scope of this utility model is not limited by these embodiments or examples, but only by the granted claims and their equivalents. Various elements in the embodiments or examples may be omitted or replaced by their equivalents. Furthermore, the steps may be performed in a different order than that described in this disclosure. Further, various elements in the embodiments or examples may be combined in various ways. Importantly, as technology evolves, many elements described herein can be replaced by equivalents that appear after this disclosure.

Claims

1. A calibration device for an automotive AR-HUD, characterized by, include: Vehicle positioning module: used to move the vehicle to the calibration test bench for fixed-point positioning; AR-HUD display module: used to display a crosshair cursor image on the windshield; Image acquisition module: This is a camera used to capture the image of the crosshair cursor on the windshield; The camera fixing device is a multi-axis robotic arm used to move and fix the camera to different heights; An industrial control computer is connected to and controls the multi-axis robotic arm, camera, and AR-HUD display module, respectively. The calibration module includes: The height control module, connected to the industrial control computer, is used to adjust the position of the crosshair image to match the position of the camera's field of view center based on the positional relationship between the acquired crosshair image and the camera's field of view center.

2. The calibration apparatus of the AR-HUD according to claim 1, wherein The calibration module also includes a brightness control module, which is connected to an industrial computer and used to adjust the display brightness of the AR-HUD.

3. The calibration apparatus of the AR-HUD according to claim 2, wherein It also includes a sunlight and rain sensor, used to collect real-time ambient light data.

4. The calibration apparatus of the AR-HUD according to claim 3, wherein The brightness control module is connected to the sunlight and rain sensor to acquire ambient light data and adjust the display brightness of the AR-HUD according to the correspondence between the data and the display brightness.

5. The calibration apparatus of the AR-HUD according to claim 1, wherein The industrial control computer is communicatively connected to the vehicle positioning module and is used to lock the vehicle's location.

6. The calibration apparatus of the AR-HUD according to claim 4, wherein The industrial control computer communicates with the vehicle positioning module via an OBD interface.

7. The calibration apparatus of the AR-HUD according to claim 1, wherein The multi-axis robotic arm is a six-axis robotic arm.

Images