Information display control method, recording medium and electronic device

The method enhances HUD lane guidance by dynamically adjusting virtual lane graphics to match actual lanes, addressing FOV limitations and improving navigation clarity.

JP2025540466APending Publication Date: 2025-12-11JIANGSU NEW VISION AUTOMOTIVE ELECTRONICS CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2025536425
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-04-11
Filing Date
2023-12-25
Publication Date
2025-12-11

AI Technical Summary

Technical Problem

Existing HUD devices, particularly AR-HUDs, suffer from limited Field of View (FOV) leading to inaccurate lane guidance and insufficient display quality, as they primarily display navigation information in the form of navigation maps or arrows.

Method used

An information display control method that dynamically calculates and displays virtual lane indication graphics on the HUD based on real-time navigation and vehicle position data, adjusting the graphics to match the current lane using deformation parameters and transparency controls to enhance alignment with the actual lane.

Benefits of technology

Improves lane guidance accuracy by strengthening the mental association between virtual and actual lanes through augmented reality overlays, ensuring clear navigation instructions without requiring drivers to divert their gaze from the road.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025540466000001_ABST
    Figure 2025540466000001_ABST
Patent Text Reader

Abstract

The present disclosure relates to a vehicle electronics technology field, for example, an information display control method, a recording medium, and an electronic device, and includes the steps of: determining current lane area data by combining updated current position information with navigation information, and obtaining an area intersection area between the current lane area data and head-up display projection area data corresponding to a head-up display device; and displaying a virtual lane indication graphic based on the current lane on the head-up display projection area, wherein the virtual lane indication graphic is triggered when the area intersection area satisfies a first determination condition.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] (CROSS-REFERENCE TO RELATED APPLICATIONS) This application claims priority from Chinese Patent Application No. 202310381517.9 filed in China on April 11, 2023, the entire contents of which are incorporated herein by reference.

[0002] The present disclosure relates to the field of vehicle electronic technology, for example, to an information display control method, a recording medium, and an electronic device. [Background technology]

[0003] In recent years, with the rapid advancement of electronics and intelligent automobiles, HUDs (Head-Up Displays) have been installed in an increasing number of vehicles. HUDs can project important driving information, such as vehicle speed and navigation, onto the windshield in front of the driver. AR-HUD, for example, is an in-vehicle HUD that combines AR (Augmented Reality) technology with HUD, and is characterized by a wider viewing angle and longer projection distance compared to conventional HUDs. However, existing HUD devices generally only display navigation information in the form of a navigation map or navigation arrow, and their limited FOV (Field of View) leads to issues such as inaccurate lane guidance and insufficient display quality.

[0004] It should be noted that the disclosure of the above prior art is intended to facilitate understanding of the background of the present invention, and does not encompass all of the related art that a person skilled in the art would already know. Summary of the Invention [Means for solving the problem]

[0005] The present invention discloses an information display control method, a recording medium, and an electronic device. According to the present disclosure, trajectory information can be dynamically displayed in a HUD system, thereby improving the effectiveness of trajectory line guidance for a driver while driving.

[0006] In a first aspect, an information display control method is disclosed, which includes the steps of: determining current lane area data by combining navigation information with updated current position information in response to an update of position information; obtaining an area intersection area between the current lane area data and head-up display projection area data corresponding to a head-up display device; and displaying a virtual lane indication figure based on the current lane on the head-up display projection area, wherein the virtual lane indication figure is triggered when the area intersection area satisfies a first judgment condition.

[0007] In a second aspect, an information display control device is disclosed that includes: a data acquisition module that, in response to an update of position information, determines current lane area data by utilizing the updated current position information and combining it with navigation information, and acquires an area intersection area between the current lane area data and head-up display projection area data corresponding to a head-up display device; and a display control module that displays a virtual lane indication figure based on the current lane on the head-up display projection area, wherein the virtual lane indication figure is triggered when the area intersection area satisfies a first judgment condition.

[0008] In a third aspect, a recording medium is disclosed, characterized in that a computer program is recorded thereon, and the computer program executes the information display control method when executed by a processor.

[0009] In a fourth aspect, an electronic device is disclosed that includes a processor and a storage device that stores executable instructions for the processor, and the processor is configured to execute the executable instructions to realize the execution of the above-mentioned information display control method. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a schematic diagram of an information display control method according to an embodiment of the present disclosure. [Figure 2] 1 is a schematic diagram of a lane with zero curvature according to an embodiment of the present disclosure. FIG. [Figure 3] FIG. 1 is a schematic diagram of a lane with non-zero curvature according to an embodiment of the present disclosure. [Figure 4] FIG. 10 is a schematic diagram of a display effect of a virtual lane display according to an embodiment of the present disclosure. [Figure 5] FIG. 10 is a schematic diagram of an image stretching effect according to an embodiment of the present disclosure. [Figure 6] 10A and 10B are schematic diagrams illustrating the display effect of virtual lane guide signs in a curved section according to an embodiment of the present disclosure. [Figure 7] 10 is a schematic diagram illustrating a display effect of displaying another guide sign among virtual lane guide signs in a curve section in an embodiment of the present disclosure. FIG. [Figure 8] 10 is a schematic diagram illustrating a display effect in which virtual lane guide signs fit actual lanes in a curved section in an embodiment of the present disclosure. FIG. [Figure 9] 10 is a schematic diagram of a display effect in which only navigation guide figures are displayed in an embodiment of the present disclosure; [Figure 10] 10A and 10B are schematic diagrams illustrating the display effect of virtual lane display in a slope section in an embodiment of the present disclosure. [Figure 11] 10 is a schematic diagram illustrating a display effect in which a navigation arrow is displayed in the center of a virtual lane display in a slope section in an embodiment of the present disclosure. FIG. [Figure 12] 10 is a schematic diagram illustrating a display effect in which a virtual lane fits an actual lane in a slope section in an embodiment of the present disclosure. FIG. [Figure 13] 10 is a schematic diagram illustrating a display effect in which only navigation guide figures are displayed in a slope section in an embodiment of the present disclosure. [Figure 14] FIG. 10 is a schematic diagram of another information display control method according to an embodiment of the present disclosure. [Figure 15] 1 is a schematic diagram illustrating a configuration of an information display control device according to an embodiment of the present disclosure. [Figure 16] FIG. 1 is a schematic diagram illustrating a configuration of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, a more comprehensive description of the embodiments will be given with reference to the accompanying drawings. However, the embodiments of the present disclosure may be implemented in various forms and are not limited to the examples set forth herein. Rather, the purpose of presenting these embodiments is to provide a more complete and comprehensive understanding of the present disclosure and to fully convey the concept of the embodiments to those skilled in the art. The described features, configurations, or characteristics may be implemented in any suitable combination in at least one embodiment.

[0012] Furthermore, the drawings conceptually illustrate the present disclosure and are not necessarily drawn to scale. The same reference numerals denote the same or similar parts, and redundant descriptions may be omitted. The block diagrams shown in the drawings illustrate functional entities that do not necessarily correspond to physically or logically separate entities. These functional entities may be realized in software, or may be implemented in at least one hardware module or integrated circuit, or may be implemented across multiple networks and / or processing devices and / or microcontroller devices.

[0013] In response to the shortcomings and deficiencies of the related art, this exemplary embodiment discloses an information display control method applicable to an AR-HUD device of a vehicle, which can calculate and display navigation guidance graphics with corresponding enhanced display effects based on navigation information and real-time vehicle position information, thereby providing more accurate lane guidance to the driver. Referring to FIG. 1, the information display control method can include the following steps.

[0014] In step S11, in response to the update of the position information, the updated current position information is used in combination with the navigation information to determine the current lane area data, and further the area intersection area (area intersection area) between the current lane area data and the HUD (head-up display) projection area data corresponding to the HUD device is obtained.

[0015] In step S12, a virtual lane indication graphic based on the current lane is displayed on the HUD projection area, where the virtual lane indication graphic is triggered when the area intersection area satisfies a predetermined first judgment condition.

[0016] The information display control method according to this embodiment collects current location information in real time, combines the collected current location information with navigation data to calculate current lane area data, and, when the intersection area between the current lane area data and HUD projection area data corresponding to the AR-HUD device satisfies a predetermined first determination condition, triggers the display of a virtual lane indicator graphic based on the current lane on the HUD projection area, thereby providing lane guidance to the user. By displaying the virtual lane indicator graphic as an augmented reality overlay on the actual lane, the driver's mental association between the driving indicator graphic and the current lane (i.e., the relationship between the virtual lane indicator graphic and the actual lane) is strengthened based on the principle of visual inertia, making the guidance direction clearer.

[0017] Hereinafter, each step of the information display control method of this embodiment will be described in more detail with reference to the drawings and examples.

[0018] In step S11, in response to the update of the position information, the updated current position information and the navigation information are combined to identify current lane area data, and the area intersection area between the current lane area data and the HUD projection area data corresponding to the AR-HUD device is calculated.

[0019] In this exemplary embodiment, the method can be applied to an in-vehicle terminal device, an intelligent in-vehicle system, an AR-HUD device, or an intelligent mobile terminal device that communicates data with these in-vehicle systems. For example, while a driver is driving a vehicle, the driver can plan and navigate a route using a navigation application built into the in-vehicle system or a navigation application on a smart mobile terminal, and the navigation data can be projected and displayed in real time on the AR-HUD device. Projections by the AR-HUD device include lane indication information, navigation arrows, and vehicle speed information. The position information can be acquired in real time by a position sensor installed in the in-vehicle system or the smart mobile terminal. Furthermore, data such as vehicle speed data, rotation speed data, steering wheel angle, lane inclination angle, and lane width can be acquired via a vehicle speed sensor, a rotation speed sensor, a steering angle sensor, an in-vehicle navigation system, or an ADAS (Advanced Driving Assistance System).

[0020] For example, an intelligent vehicle-mounted system may acquire real-time location information, and whenever the vehicle position changes, the lane the vehicle is currently traveling in may be identified based on the current vehicle location information and the high-precision lane information included in the navigation information, where the navigation information may include a combination of any one or more of the current lane identifier, lane inclination angle, lane width, and lane curvature.

[0021] Here, the current lane area data may include the area and width of the lane area corresponding to the current lane on which the vehicle is traveling, and coordinate data corresponding to the area. The HUD projection area data may indicate the area of ​​the area projected onto the ground by the HUD imaging surface of the AR-HUD device. For example, as shown in FIG. 2, in the coordinate system, the Sw area indicates an ideal driving lane with a constant altitude above sea level and zero curvature, the Sy area indicates the lanes on both the left and right sides of the driving lane, and the trapezoidal Sb area indicates the area projected onto the ground by the imaging surface of the AR-HUD device. 理想 The area indicates the intersection area between the current lane (ideal lane) in which the vehicle is traveling and the ground projection area of ​​the HUD imaging surface. Here, the coordinate system may be a coordinate system based on the real world, where the viewpoint position is identified based on the fixed position of the driver, and the position of the HUD imaging surface in the coordinate system is identified based on the vehicle mounting position of the HUD device. The length of the imaging range of the HUD imaging surface can be set to a range of 20 m to 100 m. Correspondingly, when calculating the area of ​​each area, calculations can be performed based on the projection length of the HUD imaging surface, for example, a length of 80 m. Under ideal conditions, the intersection area between the current lane area (ideal lane area) and the HUD projection area is S 理想 It becomes an area, and S 理想 The area of ​​the area corresponds to the ideal projected area. If the projected length does not change by 80 m, the lane width can be obtained by simply obtaining the S 理想 The area of ​​the area can be calculated.

[0022] Referring to FIG. 3, the So area indicates the actual lane (real lane) on which the vehicle is currently traveling, and the curvature of this actual lane is greater than zero, meaning that the actual lane is a non-ideal lane that includes a curve. The Sw area indicates an ideal lane that has a constant altitude above sea level and a curvature of zero, starting from the current position. The trapezoidal Sb area represents the area projected onto the ground by the imaging surface of the AR-HUD device. The Sg area, which is the dark-colored portion in the figure, is the intersection area between the solid line of the vehicle's traveling lane and the ground projection area of ​​the HUD imaging surface, and the area of ​​this Sg area corresponds to the area intersection area obtained in step S11.

[0023] For example, when starting navigation, a coordinate system is set, and based on the acquired position information, lane information, and lane width, the current lane and the area of ​​each area are calculated in real time in the coordinate system based on the current position.

[0024] In step S12, a virtual lane indication figure based on the current lane is displayed on the HUD projection area, where the virtual lane indication figure is triggered when the area intersection area satisfies a predetermined first determination condition.

[0025] In this embodiment, after obtaining the calculated region intersection area, it may first be determined whether the region intersection area satisfies a predetermined judgment condition, such as a first judgment condition. Here, the first judgment condition may be set based on an ideal projection area. The corresponding ideal projection area may be determined based on the HUD projection area and the ideal lane area corresponding to the current lane under predetermined ideal conditions. For example, after obtaining the current position information and lane width, the ideal region area may be calculated based on a predetermined HUD projection length, such as the aforementioned 80 m, i.e., lane width x 80 m.

[0026] For example, the first judgment condition is that the area of ​​intersection is [S 臨1 ,S 臨2 If the area intersection area is within this range, it is determined that the condition for generating the virtual lane indication figure is met. For example, S 臨1 =S 理想 ×30%, S 臨1 =S 理想 × 60%, where S 理想 refers to the area of ​​the ideal lane intersection between the HUD projection area on the ground of the HUD image plane and the current lane in which the vehicle is traveling under ideal lane conditions. For example, S in Figures 2 and 3 理想 For example, the range and area of ​​the HUD projection area on the ground, Sb, is the area of ​​the defined trapezoidal area, and S 理想Calculating the area of ​​the area means calculating the area occupied by the ideal lane Sw of the current lane in the area Sb, that is, S 理想 The area is the intersection of the Sw area and the Sb area. In the scene shown in Figure 2, 理想 The area of ​​the area is the width of the current lane multiplied by the length between the front and rear boundaries of the area Sb. The length between the front and rear boundaries of Sb is related to the FOV and is known, for example, 80 m. Therefore, S 理想 When calculating the area, real-time GPS location and navigation map data must be collected to obtain current lane width data.

[0027] If it is determined that the area intersection area satisfies the first judgment condition, the AR-HUD device projects a virtual lane indicator graphic. The AR-HUD system stretches, shrinks, or deforms the virtual lane lines (virtual lane indicator graphic) of the current driving lane and projects them onto the windshield. As shown in FIG. 4, virtual lane dividing lines 41 displayed on the imaging surface 40 of the AR-HUD device may include two parallel indicator lines of the same width as the current lane 43. For example, the display length and display position of the virtual lane indicator graphic can be set in advance. For example, in the coordinate system shown in FIG. 2 or FIG. 3, the display position of the starting point of the virtual lane indicator graphic may be set at a point 20 m away, and the length of the virtual lane lines of the virtual lane indicator graphic may be set based on the projection effect.

[0028] In this embodiment, the method further includes controlling the deformation amount of the virtual lane indication graphic based on a target deformation parameter, where the target deformation parameter is determined based on a difference between the ideal projection area and the area intersection area, so that the virtual lane indication graphic blends into the current lane.

[0029] The target deformation parameters are determined based on the difference between the ideal projection area and the area intersection area, including:

[0030] A corresponding ideal projection area is determined based on the HUD projection area and an ideal lane area corresponding to the current lane under predetermined ideal conditions.

[0031] A corresponding area difference is determined based on the ideal projected area and the area intersection area.

[0032] A target deformation parameter of the virtual lane indication figure is set based on the difference in area, where the target deformation parameter changes in proportion to the difference in area.

[0033] After obtaining the calculation result of the above-mentioned region intersection area, the difference ΔS between the ideal projection area and the region intersection area can be calculated. For example, the formula may include the following formula: △S=S 理想 -Sg where S 理想 indicates the area of ​​the intersection between the ideal lane area corresponding to the current lane under ideal conditions and the ground projection area of ​​the HUD image capture surface, and Sg indicates the intersection between the actual lane the vehicle is traveling on (the actual lane of the current lane) and the HUD projection on the ground of the HUD image capture surface. 理想 is.

[0034] In this embodiment, the method further includes a step of determining a degree of merging between the virtual lane indication figure and the current lane based on the area intersection area, and controlling the transparency of the virtual lane indication figure to be gradually changed according to a predetermined rule when the degree of merging between the virtual lane indication figure and the current lane satisfies a predetermined first preset threshold.

[0035] The image deformation coefficient on the virtual image plane (virtual surface) indicates the degree to which the virtual lane markings on the virtual image plane observed by the driver are displaced from the actual lane, and a coefficient of 1 indicates that there is no deformation in the image. As shown in Figure 5, the image deformation ratio on the virtual surface is classified into horizontal and vertical directions. The horizontal deformation is classified into left and right tilt extension (W 水平 indicates the horizontal deformation degree), and vertical deformation is the vertical image length extension (W 垂直 is defined as the degree of vertical deformation), where a change in road curvature causes horizontal deformation, and a change in road inclination angle causes vertical deformation. ​

[0036] The difference △S between the intersection area of ​​the ideal lane and the HUD ground projection area and the intersection area of ​​the actual lane and the HUD ground projection area (△S = S 理想 -Sg) is proportional to the degree of image deformation on the virtual image plane. When the horizontal curvature of the road is K and the inclination angle of the road is α, the degree of deformation W 総 is calculated using the following formula: W 総 =(W 水平 +W 垂直 ) / 2={[K×(△S / S 理想 )×a]+[α / 180×(△S / S 理想 )×b]} / 2 Here, a is the horizontal deformation constant and b is the vertical deformation constant.

[0037] In addition, △S is inversely proportional to the degree of merging between the virtual lane and the actual lane. 融合 is K 融合 =1-W 総 When the virtual lane and the real lane are completely merged (the image deformation degree of the virtual image plane is 0), K 融合 =1.

[0038] After the virtual lane is generated, its horizontal and vertical deformation degrees are changed based on the above formula, and the deformation degree varies in proportion to △S. When the virtual lane line L1 perfectly matches the current lane L2 in the real environment, K 融合 =1, and the virtual lane line L1 gradually becomes transparent and disappears.

[0039] While the vehicle is moving, the degree of deformation of the virtual lane (virtual lane indication figure) fluctuates with changes in Sg, and during this process, the deformation of the guidance virtual lane also changes synchronously. In addition, the degree of deformation of the virtual lane is directly affected by the road curvature and is proportional to the road curvature, so the virtual lane is controlled to gradually adapt to the current lane.

[0040] Alternatively, in some embodiments, the curvature of a predetermined length of lane based on the current location is obtained based on navigation information, e.g., a length of 100 m. If the lane curvature is identified as 0, it means that the actual lane is straight. In this case, only the vertical extension degree of the virtual lane needs to be calculated. In contrast, if the curvature of the actual lane is not 0, it is necessary to calculate the horizontal and vertical extension degrees of the virtual lane.

[0041] In this embodiment, the method further includes dynamically displaying guide signs within the virtual lane markings.

[0042] As shown in FIG. 4, the guide sign 42 may be a dynamically displayed navigation arrow. Here, the display position and timing of the guide sign can be set in advance. For example, the dynamic display effect of the navigation arrow is a dynamic display method in which the arrow is displayed sequentially from the near end to the far end. The display timing of the navigation arrow can also be set to be displayed in synchronization with the virtual lane, for example. Alternatively, the navigation arrow may be set to be displayed only when the deformation of the virtual lane reaches a predetermined level, thereby allowing the driver to accurately understand the lane indicated by the navigation arrow.

[0043] In addition, the degree of fusion between the virtual lane and the current lane (actual lane) is calculated in real time, and the display transparency of the virtual lane can be controlled based on the result. For example, when the virtual lane and the actual lane are completely fused (the degree of image deformation on the virtual image plane is 0), the fusion degree K 融合 When the value of the transparency parameter is 1, the display transparency of the virtual lane is controlled to gradually change up to 100%, and the virtual lane disappears in the form of a dynamic gradation.

[0044] In this embodiment, referring to FIG. 14, the method further includes the following steps:

[0045] In step S11, current lane area data is identified using the updated current position information and navigation information in response to the update of the position information, and an area intersection area between the current lane area data and HUD projection area data corresponding to the HUD device is obtained.

[0046] In step S13, a navigation guide sign is displayed on the HUD projection area, where the navigation guide sign is triggered when the area intersection area satisfies a predetermined second determination condition.

[0047] The second judgment condition may be set based on the ideal projection area. For example, the second judgment condition may be set based on whether the intersection area Sg is greater than or equal to a threshold Sg≧S 臨2 Alternatively, the system may determine whether the current lane is visible. If Sg satisfies the above requirements, it indicates that 60% or more of the current lane is visible from the HUD imaging surface. In this case, a single navigation guide sign alone can provide clear lane guidance to the driver. In this case, it is not necessary to directly project pre-stored navigation guidance graphics onto the HUD imaging surface based on real-time GPS location information and navigation map data to generate virtual lanes. For example, the navigation guide signs can be similar to the aforementioned guide signs, i.e., they can be displayed sequentially from the near end to the far end, creating a dynamic effect.

[0048] In some embodiments, in a scenario where the field of view (FOV) is exceeded in a curve, the above information display control method includes the following steps:

[0049] In step S31, a route is planned based on navigation.

[0050] In step S32, while the vehicle is traveling, the sensing module is used to collect data such as vehicle speed, rotation speed, steering wheel angle, lane inclination angle, lane width, lane curvature, and remaining turning distance during turning.

[0051] In step S33, the data is analyzed and processed.

[0052] The data processing module may be used to reprocess the collected data information and control the display (appearance) and dynamic changes of elements such as the virtual lane line L1 and indicator figures. Specifically, the intersection Sg between the actual lane area on which the vehicle is traveling and the ground projection area of ​​the HUD image pickup surface is calculated based on the current lane curvature, lane inclination angle, and lane width, and Sg is calculated as [S 臨1 ,S 臨2 ) to determine whether to generate a virtual lane. If the condition is met, the area difference △S (△S = S 理想 -Sg) depending on the magnitude of the virtual lane line deformation W 総 Control.

[0053] In step S34, the area of ​​the intersection region Sg is S 臨1 ≦Sg 臨2 In other words, in a scenario where the FOV is exceeded due to a curve, the area of ​​the intersection Sg of the lanes in which the vehicle is currently traveling is determined to be within the range of [S 臨1 ,S 臨2 ) to determine whether it is within the range.

[0054] In step S35, a dynamic virtual lane line L1 is generated. In a scenario where the FOV is exceeded in a curve, the condition of step S34 is satisfied. 臨1 ≦Sg 臨2 If the above conditions are met, the system processes data such as lane width, lane curvature, and lane inclination angle obtained by the sensing module in the calculation part of the element generation module, and generates a virtual lane line L1 of the current driving lane by stretching and deforming it (see Figure 6).

[0055] A navigation arrow L3 is dynamically displayed in the center of the generated virtual lane line L1 (see Figure 7). After the virtual lane line is generated, the deformation degree of the virtual lane line is stretched according to the calculation method described above, and △S (△S = S 理想 ​​The degree of deformation of the virtual lane lines in curved sections is directly affected by the curvature of the road and is similarly proportional to the curvature. When the virtual lane line L1 completely overlaps with the actual lane line L2, the virtual lane line L1 gradually becomes transparent and disappears (see Figure 8).

[0056] After the virtual lane lines disappear, only the navigation arrow L3 remains on the HUD imaging surface (see Figure 9).

[0057] In addition, in some embodiments, in a scenario where a downhill slope exceeds the FOV, the above information display control method may include the following steps.

[0058] In step S41, a route is planned based on navigation.

[0059] In step S42, the sensing module collects data such as vehicle speed, rotation speed, steering angle, lane inclination angle, lane width, lane curvature, and remaining turning distance (remaining steering distance during the steering process) while the vehicle is traveling.

[0060] In step S43, data analysis and processing are performed. The collected data (collected data information) is reprocessed using a data processing module to control the display and dynamic changes of elements such as the virtual lane line L1 and indicator graphics. Specifically, the area of ​​the intersection region Sg between the current lane area and the ground projection region of the HUD image capture surface is calculated based on the current lane curvature, lane inclination angle, and lane width. A determination is made as to whether or not to generate a virtual lane based on the extent of the intersection region. If the virtual lane generation conditions are met, the amount of deformation of the virtual lane line is controlled according to the size of the intersection region Sg, and the degree of merging of the virtual lane line with the actual lane line is controlled using the remaining steering distance during the steering process and the size of the intersection region Sg.

[0061] In step S44, the intersection area Sg is 臨1 ≦Sg 臨2 ​In a scene where the downhill slope exceeds the FOV, it is determined whether the area of ​​the intersection region Sg of the current lane where the vehicle is traveling is within the range of [S 臨1 ,S 臨2 ) range.

[0062] In step S45, a dynamic virtual lane line L1 is generated. When the downhill slope exceeds the FOV, the determination result satisfies the condition in step S44. 臨1 ≦Sg 臨2 If the above condition is satisfied, the data such as lane width, lane curvature, and lane inclination angle acquired by the sensing module are processed by the calculation unit of the element generation module, and a virtual lane line L1 of the current driving lane is generated by stretching and deforming it (see Figure 10).

[0063] A navigation arrow L3 is dynamically displayed in the center of the generated virtual lane line L1 (see FIG. 11).

[0064] After generating the virtual lane line, the deformation amount (degree of deformation) of the virtual lane line is stretched, and △S (△S = S 理想 When the imaginary lane line L1 completely overlaps with the actual lane line L2, the imaginary lane line L1 gradually becomes transparent and disappears (see Figure 12).

[0065] After the virtual lane lines disappear, only the navigation instruction graphic, that is, the navigation arrow L3, remains on the HUD imaging surface (see FIG. 13).

[0066] Alternatively, in some embodiments, in scenarios over several FOVs, if the road has a sloped curve, the deformation of the virtual lane is affected by and proportional to the slope angle and curvature of the road.

[0067] ​In the display control method disclosed herein, the degree of deformation of the virtual lane lines while the vehicle is traveling changes in response to changes in the intersection area Sg, and is inversely proportional to the change in Sg. In addition, the deformation of the navigation guidance graphic also changes in tandem with this change. When the virtual lane completely overlaps with the actual lane, the virtual lane gradually becomes transparent and disappears. Meanwhile, the navigation guidance graphic displayed in the center of the lane remains, creating an augmented reality (AR) effect between the navigation guidance graphic and the current lane line. This process, based on the principle of visual inertia, strengthens the connection between the navigation guidance graphic and the actual lane in the driver's mind, resulting in clearer driving instructions.

[0068] This method is primarily used to solve the problem of how to accurately guide the driver along the current lane even when the FOV (Field of View) of the HUD system is limited and the current lane is not displayed within the HUD projection area. The method acquires the current vehicle's external environment and vehicle status signals and performs calculations. When it is determined that the intersection area of ​​the current lane with the projection area of ​​the FOV image plane onto the ground is less than a predetermined value, the lane line obtained by calculation is offset and stretched based on the position difference with the FOV image plane, and then graphically rendered and projected onto the windshield in front of the driver, allowing the driver to obtain accurate navigation instructions (guidance information) without having to avert their eyes from the road surface ahead.

[0069] It should be noted that the above figures are merely schematic illustrations of the processes involved in the method according to the exemplary embodiments of the present disclosure and are not intended to be limiting. It is easily understood that the processes shown in the above figures do not indicate or limit the chronological order of these processes. It is also easily understood that these processes can be performed synchronously or asynchronously in multiple modules, for example.

[0070] 15, this embodiment further discloses an information display control device 150. The information display control device 150 includes a data acquisition module 1501 and a display control module 1502.

[0071] The data acquisition module 1501 may be configured to determine current lane area data by combining the updated current location information and the navigation information in response to updating of the location information, and then acquire an area intersection area between the current lane area data and the HUD projection area data corresponding to the HUD device.

[0072] The display control module 1502 may be configured to display a virtual lane indicator based on the current lane within the HUD projection area, where the virtual lane indicator is triggered when the area intersection area satisfies a first determination condition.

[0073] In some embodiments, the information display control device 150 further includes a fusion control module that controls the amount of deformation of the virtual lane indication graphic based on a target deformation parameter so as to blend the virtual lane indication graphic with the current lane. Here, the target deformation parameter is determined based on an area difference between the ideal projection area and the intersection area.

[0074] In some embodiments, the information display control device 150 further includes a fusion degree calculation module and a virtual lane display control module. The fusion degree calculation module may be configured to calculate the fusion degree between the virtual lane indication graphic and the current lane based on the area intersection area. The virtual lane display control module may be configured to control the transparency of the first virtual lane so that it gradually changes according to a preset rule when the fusion degree between the virtual lane indication graphic and the current lane satisfies a predetermined first threshold.

[0075] In some embodiments, the information display control device 150 further includes a guide sign display control module. The guide sign display control module may be configured to dynamically display guide signs within the virtual lane indication graphic.

[0076] In some embodiments, the fusion control module includes a shape transformation parameter calculation module. The shape transformation parameter calculation module may be configured to determine a corresponding ideal projection area based on a HUD projection area and an ideal lane area corresponding to the current lane under ideal conditions. The shape transformation parameter calculation module may be configured to determine a corresponding area difference based on the ideal projection area and the area intersection area. The shape transformation parameter calculation module may be configured to set a target shape transformation parameter of the virtual lane indication figure based on the area difference. Here, the target shape transformation parameter changes in proportion to the area difference.

[0077] In some embodiments, the information display control device 150 further includes a navigation guide sign display control module, which may be configured to display a navigation guide sign on the HUD projection area, where the navigation guide sign is triggered when the area intersection area satisfies a second determination condition.

[0078] In some embodiments, the information display control device 150 further includes a judgment condition setting module. The judgment condition setting module may be configured to calculate an ideal projection area based on the HUD projection area and an ideal lane area corresponding to the current lane under predetermined ideal conditions. The judgment condition setting module is configured to set a first judgment condition and a second judgment condition according to the ideal projection area.

[0079] In some embodiments, the navigation information is configured as a combination including one or more of the following: a current lane identifier, a lane slope angle, a lane width, and a lane curvature.

[0080] The details of each module in the information display control device 150 are disclosed in detail in the description of the corresponding information display control method, and therefore will not be described repeatedly in this specification.

[0081] It should be noted that although the detailed description of the present disclosure refers to multiple modules or units for performing operations, such division is not required. In fact, according to embodiments of the present invention, the features and functions of two or more of the modules or units described above may be embodied in a single module or unit. Conversely, the features and functions of a single module or unit described above may be divided and embodied in multiple modules or units.

[0082] FIG. 16 is a schematic diagram illustrating the configuration of an electronic device suitable for implementing an embodiment of the present disclosure.

[0083] Note that the electronic device 1000 shown in FIG. 16 is merely an example and does not limit the functions or application range of the embodiments of the present disclosure.

[0084] As shown in Fig. 16, electronic device 1000 includes a central processing unit (CPU) 1001, which executes various operations and processes based on programs stored in read-only memory (ROM) 1002 or programs loaded from storage unit 1008 into random access memory (RAM) 1003. RAM 1003 stores various programs and data necessary for system operation. CPU 1001, ROM 1002, and RAM 1003 are interconnected via bus 1004. Input / output (I / O) interface 1005 is also connected to bus 1004.

[0085] An input / output interface (I / O interface) 1005 is connected to an input unit 1006, an output unit 1007, a memory unit 1008, and a communication unit 1009. The input unit 1006 includes a keyboard, a mouse, etc., the output unit 1007 includes a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and speakers, etc., the memory unit 1008 includes a hard disk, etc., and the communication unit 1009 includes a network interface card such as a LAN (Local Area Network) card or a modem. The communication unit 1009 performs communication processing via a network such as the Internet. A drive (drive unit) 1010 is also connected to the input / output interface 1005 as needed. A removable medium 1011 such as a disk, optical disk, magneto-optical disk, or semiconductor memory is attached to the drive 1010, and this medium enables installation of a program into the memory unit 1008.

[0086] In particular, in an embodiment of the present disclosure, the processes based on the flowcharts shown below may be implemented as a computer software program. An embodiment of the present disclosure includes a computer program product including a computer program recorded on a storage medium. The computer program has program code for executing the methods shown in the flowcharts. In such an embodiment, the computer program may be downloaded and installed from a network via the communication unit 1009 and / or installed from a removable medium 1011. When the computer program is executed by the central processing unit (CPU) 1001, each function defined in the system of the present application is performed.

[0087] Specifically, the electronic device may be a smart mobile electronic device such as a smartphone, a tablet computer, a laptop computer, etc. The electronic device may also be a smart electronic device such as a desktop computer.

[0088] The storage medium described in the embodiments of the present disclosure may be a computer-readable signal medium, a computer-readable storage medium, or any combination thereof. Examples of computer-readable storage media include, but are not limited to, electrical, magnetic, optical, electromagnetic, infrared, and semiconductor systems and devices, or any combination thereof. Specific examples include electrical conductors, portable computer magnetic disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable ROM (EPROM), flash memory, optical fiber, portable compact disc-ROM (CD-ROM), optical storage devices, magnetic storage devices, and any combination thereof. In this disclosure, a computer-readable storage medium refers to a tangible medium that contains or stores a program and that can be used by or in conjunction with an instruction execution system, device, or appliance. On the other hand, a computer-readable signal medium includes a data signal transmitted in baseband or as part of a carrier, carrying computer-readable program code. Such transmitted data signals may take various forms, such as electromagnetic signals, optical signals, or any combination thereof. The computer-readable signal medium may be any storage medium other than a computer-readable storage medium that can transmit, propagate, or transfer a program that can be used by or in conjunction with an instruction execution system, device, or apparatus. Transmission of the program code contained on the storage medium can be via any suitable medium, such as wireless, wired, or any combination thereof.

[0089] The flowcharts and block diagrams in the drawings illustrate the architecture, functionality, and operation of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, program partition, or portion of code, which includes one or more executable instructions for implementing the specified logical function. It should also be noted that, in alternative embodiments, functions may be performed in a different order than illustrated. For example, two blocks shown in succession may be executed substantially in parallel, or may be executed in the reverse order. In the present disclosure, each block in a flowchart or block diagram, and combinations thereof, may be configured to be executed by a dedicated hardware-based system or may be implemented by a combination of dedicated hardware and computer instructions.

[0090] Each unit described in the embodiments of the present disclosure may be implemented by software or hardware. These units may be located in a processor. Note that the names of the units do not necessarily limit the units themselves.

[0091] The present application also provides a storage medium. The storage medium may be built into an electronic device or may exist independently of the electronic device. One or more programs are recorded on the storage medium, and when these programs are executed on the electronic device, the electronic device implements the methods described in the above embodiments. For example, the electronic device executes the steps shown in FIG. 1.

[0092] Furthermore, the flow charts and block diagrams shown in the above figures are intended to conceptually illustrate the processes included in the method according to the embodiments of the present disclosure, and are not intended to be limiting. For ease of understanding, it should be noted that the processes shown in the figures do not imply or limit the order of execution. Furthermore, these processes may be executed synchronously or asynchronously among multiple modules.

[0093] Those skilled in the art will readily appreciate other embodiments of the present disclosure based on the present specification and examples. Accordingly, this application is intended to cover any modifications, uses, or adaptations that combine known or customary techniques in the art, but are not described herein, in accordance with the general principles of the present disclosure. The specification and examples are merely exemplary, with the true scope and spirit of the present disclosure being defined by the following claims.

[0094] Furthermore, the present disclosure is not limited to the exact configuration described above and illustrated in the drawings, and various changes and modifications can be made without departing from the scope of the present disclosure, which is to be understood as being defined solely by the description of the appended claims.

Claims

1. In response to updating the position information, determining current lane area data using the updated current position information in combination with navigation information; obtaining an area intersection area between the current lane area data and head-up display projection area data corresponding to a head-up display device; and displaying a virtual lane indication graphic based on the current lane on a head-up display projection area, The virtual lane indication figure is triggered when the area intersection area satisfies a first determination condition.

10. An information display control method comprising:

2. The method further includes controlling a deformation amount of the virtual lane indication graphic based on a target deformation parameter so as to blend the virtual lane indication graphic with the current lane; The target deformation parameters are determined based on an area difference between an ideal projection area and the area intersection area. The information display control method according to claim 1 .

3. determining a degree of merging between the virtual lane indication figure and the current lane based on the area intersection area; and when the degree of merging between the virtual lane indication graphic and the current lane satisfies a first threshold, controlling the transparency of the virtual lane indication graphic so that the transparency is gradually changed according to a predetermined rule. The information display control method according to claim 2 .

4. further comprising dynamically displaying a navigation guide sign within the virtual lane indication graphic.

3. The information display control method according to claim 1.

5. the target shape transformation parameter is determined based on an area difference between the ideal projected area and the area intersection area; determining the ideal projection area based on the head-up display projection area and an ideal lane area corresponding to the current lane under predetermined ideal conditions; determining the corresponding area difference based on the ideal projected area and the area intersection area; and setting the target shape transformation parameters of the virtual lane indication figure based on the area difference, The target shape transformation parameter changes in proportion to the area difference. The information display control method according to claim 2 .

6. The method further includes displaying a navigation guide sign on the head-up display projection area, and the navigation guide sign is triggered when the area intersection area satisfies a second determination condition. The information display control method according to claim 1 .

7. determining the corresponding ideal projection area based on the head-up display projection area and an ideal lane area corresponding to the current lane under predetermined ideal conditions; and setting the first and second judgment conditions based on the ideal projected area. The information display control method according to claim 6.

8. The navigation information includes any one or a combination of a current lane identifier, a lane inclination angle, a lane width, and a lane curvature. The information display control method according to claim 1 .

9. A recording medium having a computer program recorded thereon, the computer program executing the information display control method according to any one of claims 1 to 8 when executed by a processor.

10. a processor and a storage device storing executable instructions for said processor; 9. An electronic device, wherein the processor is configured to execute the executable instructions to implement the information display control method according to claim 1.

Citation Information

Patent Citations

  • Image processing apparatus

    JP2016105256A

  • Display control device and display control program

    JP2020125033A

  • Vehicle display device

    WO2019031291A1