Vehicle-mounted head-up display man-machine interaction design auxiliary system and method

Abstract

The invention relates to the technical field of intelligent driving, in particular to a human-computer interaction design assisting system and method for a vehicle-mounted head-up display, and the system comprises the steps: obtaining an HUD optical parameter, a vehicle parameter, an observation visual angle parameter and a UI parameter through a user interface module; the parameter calculation module adopts a left-handed coordinate system, calculates point position coordinates of an original point of a middle eye position coordinate system to obtain HUD virtual image parameters, and calculates paving parameters based on the point position coordinates; the visual rendering module renders a three-dimensional picture based on HUD virtual image parameters, a vehicle model and indication lines, and renders a two-dimensional picture based on a user interface and an HUD picture; and the design auxiliary module provides a parameter mapping table for adjusting HUD virtual image display parameters. According to the implementation of the method, the UI / UX design efficiency, accuracy and safety of the HUD system are remarkably improved.

Description

Technical Field

[0001] The present application relates to the field of intelligent driving technology, and in particular to a human-computer interaction design assistance system and method for an in-vehicle head-up display. Background Art

[0002] Head-up display (HUD) systems are a key technology for improving driving safety and experience, and their user interface (UI) and user experience (UX) design are crucial. Currently, HUD UI / UX design primarily relies on general-purpose design tools (such as Sketch and Figma). Designers design interface layout and interactive features based on the resolution and size of the HUD's physical display area, and element sizing is often determined based on design experience and trial and error.

[0003] However, this traditional design approach has significant drawbacks: 1. Difficulties in UI / UX design adaptation: Existing general-purpose design tools lack quantitative guidance for effectively linking core HUD optical parameters (such as virtual image distance, field of view, eye movement range, and distortion characteristics) with UI element size and layout. This makes it difficult for designers to intuitively foresee how UI elements will appear in the actual optical system (such as size, position, and clarity) during the design phase. This leads to significant discrepancies between the design results and the final HUD optical presentation. Adjusting the design to accommodate optical constraints requires repeated trial and error, which is inefficient and costly.

[0004] 2. Lack of dynamic interaction design: When presenting dynamic content (such as navigation arrows and the motion trajectory of ADAS alerts), existing tools are unable to automatically generate or suggest UI element motion trajectories that conform to the laws of optical physics and human visual perception based on the HUD's optical parameters (particularly the change in virtual image distance and eyebox range). This results in the movement of dynamic information within the HUD virtual image space being choppy, jumpy, and inconsistent with the driver's natural visual expectations, undermining the effectiveness and smoothness of information delivery.

[0005] 3. Insufficient human factors engineering support: The existing design process lacks tools that integrate driver eye movement models, visual attention models, and driving safety standards (such as distraction management). This makes it difficult for designers to easily access human factors-based "safety zone" recommendations (such as optimal placement of key driving information and restricted areas to avoid visual distractions) during design. This can easily lead to inappropriate UI layouts, forcing drivers to excessively divert their gaze from the road ahead, increasing the risk of distracted driving.

[0006] In summary, the core problem of existing HUD design methods lies in the serious disconnect between UI / UX design and the underlying optical parameters, dynamic presentation physical characteristics, and ergonomic requirements. This disconnect leads to a design process that is highly dependent on experience, repeated trial and error, and inefficient. The final design is prone to problems such as poor display adaptability, discontinuous dynamic interaction, and potential safety risks. Therefore, there is an urgent need for a technical solution that can effectively solve the above problems and deeply integrate optical parameters, dynamic interaction physical models, and ergonomic factors into the design process to improve the scientificity, efficiency, and safety of HUD design. Summary of the Invention The present invention aims to solve one of the problems existing in the background technology.

[0007] To this end, the present invention provides a human-computer interaction design assistance system and method for a vehicle-mounted head-up display.

[0008] The technical solution adopted by the present invention to solve its technical problem is: A human-computer interaction design assistance system for a vehicle-mounted head-up display, comprising: A user interface module, configured to obtain HUD optical parameters, vehicle parameters, viewing angle parameters, and UI parameters; A parameter calculation module, connected to the user interface module, for obtaining parameters from the user interface module to calculate point coordinates, HUD virtual image parameters, and paving parameters for drawing indicator lines; A visualization rendering module is connected to the parameter calculation module, and the visualization rendering module renders a three-dimensional picture.

[0009] Furthermore, it also includes a design auxiliary module, which is connected to the user interface module and the visual rendering module.

[0010] A human-computer interaction design auxiliary method for a vehicle-mounted head-up display comprises the following steps: Step 1: Obtain HUD optical parameters, vehicle parameters, viewing angle parameters, and UI parameters; Step 2: Use the left-handed coordinate system and the mid-eye coordinate system origin to calculate the point coordinates to obtain the HUD virtual image parameters and indicator lines, and calculate the paving parameters based on the point coordinates; Step three: render a three-dimensional image based on the HUD virtual image parameters, vehicle model, and indicator lines, and render a two-dimensional image based on the user interface and HUD image.

[0011] Furthermore, in step 1, the observation angle parameters include vehicle height, middle eye height, eye box movement, observation field of view, perspective switching and line thickness.

[0012] Furthermore, in step 2, the HUD virtual image parameters include mid-eye height, FOV, VID, lower viewing angle, projection length, projection height, and observation size.

[0013] Furthermore, in the step 2, the paving parameters include a proximal distance, a distal distance, a proximal width, a distal width, and a paving area.

[0014] Furthermore, in step 2, the indicator lines include the HUD virtual image, the visual cone, and the paved area lines. Drawing these lines requires obtaining the coordinates of the following points: the middle eye position (a), the upper left corner point of the virtual image (b), the lower left corner point of the virtual image (c), the upper right corner point of the virtual image (d), the lower right corner point of the virtual image (e), the upper left corner point of the paved area (f), the lower left corner point of the paved area (g), the upper right corner point of the paved area (h), and the lower right corner point of the paved area (i). The upper left corner point of the virtual image (b), the lower left corner point of the virtual image (c), the upper right corner point of the virtual image (d), and the lower right corner point of the virtual image (e) are the four corner points of the HUD virtual image, the visual cone lines are the line segments connected by abf, acg, adh, and aei, and the paved area is the line segment connected by fg, fh, gi, and hi.

[0015] Furthermore, in step 2, ray detection is used to calculate the ground point coordinates in the visual cone indicator line for obtaining the lines of the paved area, including the upper left corner point (f) of the paved area, the lower left corner point (g) of the paved area, the upper right corner point (h) of the paved area, and the lower right corner point (i) of the paved area.

[0016] Furthermore, the HUD virtual image parameters include: mid-eye height, FOV (field of view), VID (virtual image distance), and lower viewing angle input by the user; and projection length, projection height, and observation size calculated by the program. The projection length is obtained by calculating the width of the line segment formed by the virtual image's upper left corner (f) and the virtual image's upper right corner (h). The projection height is obtained by calculating the width of the line segment formed by the virtual image's upper left corner (f) and the virtual image's lower left corner (g). .

[0017] Furthermore, the design assistance module can obtain and draw recommended UI design parameters based on the HUD parameters input by the user according to the system's built-in parameter mapping table. The parameter mapping table provides the recommended font sizes for large text, medium text, and small text under different VIDs and FOVs, and the maximum and minimum size ranges of AR content.

[0018] The beneficial effects of the present invention are: The implementation of this invention significantly improves the efficiency, accuracy, and safety of HUD system UI / UX design, which is specifically reflected in the following core effects: 1. Real-time dynamic mapping of optical parameters and design effects By establishing a deep correlation model between optical parameters (such as virtual image distance (VID) and field of view (FOV)) and UI design, the system automatically calculates and generates virtual image boundaries, projection area parameters, and visual previews in real time. Designers can directly observe the size, position, and deformation of UI elements in a real HUD optical environment within the design interface, completely resolving the disconnect between design and optics found in traditional design tools and avoiding repeated revisions due to adaptation errors.

[0019] 2. Intelligent quantitative recommendation of design rules Based on core optical parameters like VID and FOV, the system automatically calculates and recommends safe size ranges, layout areas, and dynamic motion trajectories for UI elements (such as text and icons) and AR content (such as navigation arrows). This feature provides designers with objective, quantitative design guidance, replacing the empirically based trial-and-error process and significantly improving the first-pass success rate of designs while ensuring the consistency and visual comfort of dynamic interactions.

[0020] 3. Actively avoid ergonomic risks Integrating eye movement models with driving safety regulations, the system automatically marks visual safety zones and distraction-free zones, and verifies UI layout compliance in real time during the design process. This effectively prevents driver distraction caused by improper placement of key information, reducing the risk of driver distraction from the very beginning and improving driving safety.

[0021] 4. Improved design verification and collaboration efficiency Through the high-fidelity virtual image simulation environment, customers and development teams can intuitively understand the final presentation effect of the design in the real HUD, significantly reducing the cost of multi-party communication, accelerating the alignment of design requirements and solution confirmation, and shortening the product development cycle. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The present invention will be further described below with reference to the accompanying drawings and examples.

[0023] Figure 1 It is a schematic diagram of the execution flow of the human-computer interaction design auxiliary method for the vehicle-mounted head-up display in the present invention.

[0024] Figure 2 It is a structural diagram of the human-computer interaction design auxiliary system for the vehicle-mounted head-up display in the present invention.

[0025] Figure 3 It is a schematic diagram of parameter adjustment in the present invention.

[0026] Figure 4 Schematic diagram of calculating the HUD virtual image and the floor area based on the viewing angle in the present invention.

[0027] Figure 5 Schematic diagram of the structure of the HUD virtual image from the driver's perspective in the present invention.

[0028] Figure 6 It is a side view of the HUD virtual image in the present invention.

[0029] Figure 7 Schematic diagram of the HUD screen in the present invention.

[0030] Figure 8 Schematic diagram of the far and near ends of AR content in the HUD virtual image in the present invention.

[0031] Figure 9 It is a schematic diagram of the perspective switching operation interface in the present invention. DETAILED DESCRIPTION

[0032] The present invention will now be described in further detail with reference to the accompanying drawings, which are simplified schematic diagrams that illustrate the basic structure of the present invention in a schematic manner.

[0033] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise", "axial", "radial", "circumferential" and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings. They are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, features defined as "first" or "second" may explicitly or implicitly include one or more of such features. In the description of the present invention, unless otherwise specified, "multiple" means two or more.

[0034] In the description of the present invention, it should be noted that, unless otherwise expressly specified or limited, the terms "mounted," "connected," and "connected" should be understood in a broad sense. For example, they may refer to fixed, detachable, or integral connections; mechanical or electrical connections; direct or indirect connections through an intermediate medium; and internal communication between two components. Those skilled in the art will understand the specific meanings of the above terms in the present invention based on the specific circumstances.

[0035] A human-computer interaction design assistance system for an in-vehicle head-up display includes a user interface module, a parameter calculation module, a visualization rendering module, and a design assistance module. The user interface module is connected to the parameter calculation module and the design assistance module, and the parameter calculation module and the design assistance module are both connected to the visualization rendering module.

[0036] The user interface module is used to obtain HUD optical parameters, vehicle parameters, observation angle parameters and UI parameters; the parameter calculation module obtains various parameters in the user interface module and calculates HUD virtual image parameters and paving parameters; the design auxiliary module is used to set the UI interface text font size, icon pixel size, UI size, AR content size and safety boundary, etc.; the visual rendering module performs visual rendering based on the calculation results of the parameter design module and the conditions set in the design auxiliary module.

[0037] Among them, the observation angle parameters include vehicle height, middle eye height, eye box movement, observation field, perspective switching and line thickness. The lines include the HUD virtual image border indicator line, the paving area wireframe indicator line, and the lines between the middle eye position and the HUD virtual image border and the paving area corners. These lines are all virtual indicator lines; HUD virtual image parameters include middle eye height, FOV (field of view), VID (virtual image distance), lower angle of view, projection length and height, and observation size; paving parameters include near-end distance, far-end distance, near-end width, far-end width, and paving area.

[0038] Specifically, a human-computer interaction design assistance method for an in-vehicle head-up display includes the following steps: Step 1: Get parameters through the user interface module In this embodiment, the user interface module uses the Unity engine UGUI to implement the user interface and interactive functions. You can also use the interface framework of other rendering engines to implement it, such as the UMG framework of the UE engine.

[0039] like Figure 4 As shown, build an observation parameter adjustment interface, including viewing angle switching, vehicle height selection, mid-eye height adjustment, eyebox movement adjustment, observation field adjustment, and indicator line thickness adjustment. Build a HUD parameter adjustment interface, including HFOV (horizontal field of view), VFOV (vertical field of view), VID (virtual image distance), and LDA (lower viewing angle). Build a virtual image parameter display panel, including mid-eye height, FOV, VID, lower viewing angle, projection length, projection height, and observation size. Build a paving parameter display, including near-end distance, far-end distance, near-end width, far-end width, and paving area.

[0040] When the user adjusts the items on the observation parameter surface and the HUD parameter panel, the system can calculate the virtual image parameters and paving parameters and display them on the corresponding panels.

[0041] Step 2: Calculate the point coordinates, HUD virtual image parameters, and paving parameters for drawing indicator lines The parameter calculation module is responsible for calculating the point coordinates, HUD virtual image parameters and paving parameters used to draw the indicator lines. Figure 4) consists of the HUD virtual image, the viewing cone, and the lines of the pavement area. Drawing these lines requires the coordinates of the following points: mid-eye position (a), top-left corner of the virtual image (b), bottom-left corner of the virtual image (c), top-right corner of the virtual image (d), bottom-right corner of the virtual image (e), top-left corner of the pavement area (f), bottom-left corner of the pavement area (g), top-right corner of the pavement area (h), and bottom-right corner of the pavement area (i).

[0042] The HUD virtual image lines are the line segments connected by bc, bd, ce, and de; the visual cone lines are the line segments connected by abf, acg, adh, and aei; and the ground area is the line segments connected by fg, fh, gi, and hi.

[0043] The left-hand coordinate system is used to calculate the coordinates of the points with the origin of the mid-eye coordinate system. The calculation formula for the HUD virtual image point is: Coordinates of the upper left corner (b)

[0044]

[0045]

[0046] Coordinates of the lower left corner (c)

[0047]

[0048]

[0049] Coordinates of the upper right corner (d)

[0050]

[0051]

[0052] Coordinates of the lower right corner (e)

[0053]

[0054]

[0055] Ray detection (implemented using the Raycast function provided by the Unity engine in the current implementation) is used to calculate the coordinates of the ground points within the view cone indicator line, taking the line segment in the upper left corner as an example. A ray is emitted from the eye coordinates through the coordinates of the upper left corner of the HUD virtual image. The intersection of the ray and the ground is the upper left corner of the paved area (f). The lower left corner of the paved area (g), the upper right corner of the paved area (h), and the lower right corner of the paved area (i) are determined by collision detection with the ground using rays passing through the upper right corner, lower left corner, and lower right corner of the HUD virtual image, respectively.

[0056] The HUD virtual image parameters include user input: mid-eye height, FOV, VID, and lower viewing angle; and program calculation: projection length, projection height, and viewing size. The projection length is calculated by calculating the width of the line segment formed by the virtual image's upper left corner (f) and upper right corner (h). The projection height is calculated by calculating the width of the line segment formed by the virtual image's upper left corner (f) and lower left corner (g), using the formula:

[0057] To convert the observed size in meters to inches, multiply by 39.37.

[0058] Paving parameters include: near end distance, far end distance, near end width, far end width, and paving area. The near end distance is the distance from the gi line segment to the front of the vehicle, the far end distance is the distance from the fh line segment to the front of the vehicle, the near end width is the width of the gi line segment, and the far end width is the width of the fh line segment. The paving area is calculated as follows: .

[0059] Step 3: Visual rendering The visualization rendering module renders three-dimensional images, such as Figure 4 The display includes a HUD virtual image, a vehicle model, indicator lines, and AR content. The current embodiment uses the LineRenderer function provided by the Unity engine to draw three-dimensional lines, and uses meshes and shaders to draw the vehicle model and AR content.

[0060] Rendering 2D images, including the 2D content of the user interface and HUD images. The current embodiment is implemented using the UGUI module of the Unity engine.

[0061] Provides perspective control and switching functions, such as Figure 9 The user can hold down the left mouse button to pan the view, scroll the mouse wheel to zoom the view, and click the view switch button on the user interface to switch the driver's view ( Figure 5 ) or side view ( Figure 6 ) to observe the HUD virtual image size effect.

[0062] Step 4: Screen parameter settings The design assistance module can obtain and draw the recommended UI design parameters based on the HUD parameters input by the user according to the system's built-in parameter mapping table. Figure 7 As shown, the recommended: safety boundaries of the UI canvas; UI font size, corresponding to vehicle speed, speed unit, remaining navigation distance, and navigation road name; icon size, corresponding to the navigation TBT icon, navigation intersection guidance icon, and ADAS function icon.

[0063] like Figure 8 As shown in the figure, the recommended sizes of AR content at near and far ends are displayed. Users can adjust the overall UI size in the design parameter adjustment panel to preview and select the optimal UI and AR content size.

[0064] The parameter mapping table provides the recommended font sizes for large, medium, and small text, as well as the maximum and minimum size ranges for AR content under different VIDs and FOVs.

[0065] Use the vehicle height adjustment button on the user interface to switch between different vehicle heights. The system automatically adjusts the upper and lower mid-eye level ranges based on the vehicle's height. This allows you to simulate different driver seat heights and mid-eye level heights for different vehicle types, such as sedans and SUVs.

[0066] With the above-described preferred embodiments of the present invention as a guide, and with reference to the above description, relevant personnel are fully capable of making various changes and modifications without departing from the technical spirit of this invention. The technical scope of this invention is not limited to the contents of the specification, but must be determined according to the scope of the claims.

Claims

1. A human-computer interaction design assistance system for vehicle-mounted head-up display, characterized in that: include, A user interface module, configured to obtain HUD optical parameters, vehicle parameters, viewing angle parameters, and UI parameters; A parameter calculation module, connected to the user interface module, for obtaining parameters from the user interface module to calculate point coordinates, HUD virtual image parameters, and paving parameters for drawing indicator lines; A visualization rendering module is connected to the parameter calculation module, and the visualization rendering module renders a three-dimensional picture.

2. The human-computer interaction design assistance system for vehicle-mounted head-up display according to claim 1, characterized in that: It also includes a design auxiliary module, which is connected to the user interface module and the visual rendering module.

3. A human-computer interaction design assistance method for an in-vehicle head-up display implemented based on the human-computer interaction design assistance system for an in-vehicle head-up display according to claim 2, characterized in that: The following steps are included: Step 1: Obtain HUD optical parameters, vehicle parameters, viewing angle parameters, and UI parameters; Step 2: Use the left-handed coordinate system and the mid-eye coordinate system origin to calculate the point coordinates to obtain the HUD virtual image parameters and indicator lines, and calculate the paving parameters based on the point coordinates; Step three: render a three-dimensional image based on the HUD virtual image parameters, vehicle model, and indicator lines, and render a two-dimensional image based on the user interface and HUD image.

4. The human-computer interaction design assistance method for vehicle-mounted head-up display according to claim 3, characterized in that: In step 1, the observation angle parameters include vehicle height, mid-eye height, eye box movement, observation field, perspective switching, and line thickness.

5. The human-computer interaction design assistance method for vehicle-mounted head-up display according to claim 3, characterized in that: In the step 2, the HUD virtual image parameters include the middle eye height, FOV, VID, lower viewing angle, projection length, projection height, and observation size.

6. The human-computer interaction design assistance method for vehicle-mounted head-up display according to claim 3, characterized in that: In the step 2, the paving parameters include proximal distance, distal distance, proximal width, distal width, and paving area.

7. The human-computer interaction design assistance method for vehicle-mounted head-up display according to claim 6, characterized in that: In step 2, the indicator lines include the HUD virtual image, the visual cone, and the paved area lines. Drawing these lines requires obtaining the coordinates of the following points: the middle eye position (a), the upper left corner point of the virtual image (b), the lower left corner point of the virtual image (c), the upper right corner point of the virtual image (d), the lower right corner point of the virtual image (e), the upper left corner point of the paved area (f), the lower left corner point of the paved area (g), the upper right corner point of the paved area (h), and the lower right corner point of the paved area (i). The upper left corner point of the virtual image (b), the lower left corner point of the virtual image (c), the upper right corner point of the virtual image (d), and the lower right corner point of the virtual image (e) are the four corner points of the HUD virtual image. The visual cone lines are the line segments connected by abf, acg, adh, and aei, and the paved area is the line segment connected by fg, fh, gi, and hi.

8. The human-computer interaction design assistance method for vehicle-mounted head-up display according to claim 7, characterized in that: In step 2, ray detection is used to calculate the ground point coordinates in the visual cone indicator line used to obtain the paved area lines, including the upper left corner point (f) of the paved area, the lower left corner point (g) of the paved area, the upper right corner point (h) of the paved area, and the lower right corner point (i) of the paved area.

9. The human-computer interaction design assistance method for vehicle-mounted head-up display according to claim 7, characterized in that: The HUD virtual image parameters include: mid-eye height, FOV (field of view), VID (virtual image distance), and lower viewing angle input by the user; and projection length, projection height, and observation size calculated by the program. The projection length is calculated by calculating the width of the line segment formed by the virtual image's upper left corner (f) and the virtual image's upper right corner (h). The projection height is calculated by calculating the width of the line segment formed by the virtual image's upper left corner (f) and the virtual image's lower left corner (g). .

10. The human-computer interaction design auxiliary method for vehicle-mounted head-up display according to claim 3, characterized in that: The design assistance module can obtain and draw recommended UI design parameters based on the HUD parameters input by the user according to the system's built-in parameter mapping table. The parameter mapping table provides the recommended font sizes for large text, medium text, and small text under different VIDs and FOVs, as well as the maximum and minimum size ranges of AR content.

Images