Information display control method, recording medium, and electronic device

Abstract

The present disclosure relates to a vehicle electronics technology field, for example, an information display control method, a recording medium, and an electronic device, and includes the steps of: determining current lane area data by combining updated current position information with navigation information, and obtaining an area intersection area between the current lane area data and head-up display projection area data corresponding to a head-up display device; and displaying a virtual lane indication graphic based on the current lane on the head-up display projection area, wherein the virtual lane indication graphic is triggered when the area intersection area satisfies a first determination condition.

Description

[Technical Field]

[0001] (Cross-reference of related applications) This application claims priority to Chinese Patent Application No. 202310381517.9, filed in China on April 11, 2023, and all contents of that application are incorporated herein by reference.

[0002] This disclosure relates to the field of vehicle electronics technology, for example, to information display control methods, recording media, and electronic devices. [Background technology]

[0003] In recent years, as automobiles have become increasingly electronic and intelligent, Head-Up Displays (HUDs) are being installed in more and more vehicles. HUDs can project important driving information, such as vehicle speed and navigation, onto the windshield in front of the driver. Taking AR-HUDs as an example, they are in-car HUDs that combine AR (augmented reality) technology with HUDs, and have the advantage of a wider field of view and longer projection distance compared to conventional HUDs. However, existing HUD devices generally only display navigation information in the form of navigation maps or navigation arrows, and their FOV (Field of View) is limited, which can lead to problems such as inaccurate lane guidance and insufficient display quality.

[0004] The above disclosure of prior art is intended to facilitate understanding of the background of the present invention and does not cover all related technologies already known to those skilled in the art. [Overview of the project] [Means for solving the problem]

[0005] This invention discloses an information display control method, a recording medium, and an electronic device. According to this disclosure, trajectory information can be dynamically displayed in a HUD system, and the guidance effect on the driver by the trajectory line during operation can be improved.

[0006] Disclosed is, in a first aspect, an information display control method, comprising: determining current lane area data by combining updated current position information with navigation information in response to update of position information; obtaining an area intersection area between said current lane area data and head-up display projection area data corresponding to a head-up display device; and displaying a virtual lane indication graphic based on a current lane on a head-up display projection area, wherein said virtual lane indication graphic is triggered when said area intersection area satisfies a first determination condition.

[0007] Disclosed is, in a second aspect, an information display control device, comprising: a data acquisition module that determines current lane area data by combining updated current position information with navigation information in response to update of position information, and obtains an area intersection area between said current lane area data and head-up display projection area data corresponding to a head-up display device; and a display control module that displays a virtual lane indication graphic based on a current lane on a head-up display projection area, wherein said virtual lane indication graphic is triggered when said area intersection area satisfies a first determination condition.

[0008] Disclosed is, in a third aspect, a recording medium having a computer program recorded thereon, wherein when said computer program is executed by a processor, the above-mentioned information display control method is performed.

[0009] Disclosed is, in a fourth aspect, an electronic device, comprising a processor and a storage device storing executable instructions of said processor, wherein said processor is configured to implement execution of the above-mentioned information display control method by executing said executable instructions. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] [Figure 1] It is a schematic diagram of an information display control method according to an embodiment of the present disclosure. [Figure 2] It is a schematic diagram of a lane with zero curvature according to an embodiment of the present disclosure. [Figure 3] It is a schematic diagram of a lane with non-zero curvature according to an embodiment of the present disclosure. [Figure 4] It is a schematic diagram of the display effect of a virtual lane display according to an embodiment of the present disclosure. [Figure 5] It is a schematic diagram of an image stretching effect according to an embodiment of the present disclosure. [Figure 6] It is a schematic diagram of the display effect of a virtual lane guidance sign in a curved section according to an embodiment of the present disclosure. [Figure 7] It is a schematic diagram of the display effect of displaying another guidance sign in the virtual lane guidance sign in a curved section according to an embodiment of the present disclosure. [Figure 8] It is a schematic diagram of the display effect that a virtual lane guidance sign fits an actual lane in a curved section according to an embodiment of the present disclosure. [Figure 9] It is a schematic diagram of the display effect of displaying only navigation guidance graphics according to an embodiment of the present disclosure. [Figure 10] It is a schematic diagram of the display effect of a virtual lane display in a slope section according to an embodiment of the present disclosure. [Figure 11] It is a schematic diagram of the display effect of displaying a navigation arrow in the center of a virtual lane display in a slope section according to an embodiment of the present disclosure. [Figure 12] It is a schematic diagram of the display effect that a virtual lane fits an actual lane in a slope section according to an embodiment of the present disclosure. [Figure 13] It is a schematic diagram of the display effect of displaying only navigation guidance graphics in a slope section according to an embodiment of the present disclosure. [Figure 14] It is a schematic diagram of another information display control method according to an embodiment of the present disclosure. [Figure 15] It is a schematic diagram of the configuration of an information display control device according to an embodiment of the present disclosure. [Figure 16] It is a schematic diagram of the configuration of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION

[0011] The embodiments will be described more comprehensively below with reference to the accompanying drawings. However, the embodiments of this disclosure can be implemented in a variety of forms and are not limited to the examples described herein. Rather, the purpose of showing these embodiments is to provide a more complete and overall understanding of this disclosure and to fully convey the concept of the embodiments to those skilled in the art. The described features, configurations, or characteristics can be implemented in appropriate combinations in at least one embodiment.

[0012] Furthermore, the drawings are conceptual in nature and are not necessarily drawn to actual scale. Identical reference numerals indicate identical or similar parts, and redundant descriptions may be omitted. The block diagrams shown in the drawings represent functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities may be implemented in software, or implemented in at least one hardware module or integrated circuit, or implemented across multiple networks and / or processing units and / or microcontroller devices.

[0013] In response to the shortcomings and deficiencies of related technologies, this exemplary embodiment discloses an information display control method adaptable to a vehicle's AR-HUD device, which can calculate and display navigation guidance graphics with corresponding augmented display effects (enhanced display effects) based on navigation information and the vehicle's real-time position information, thereby enabling more accurate lane guidance to the driver. Referring to Figure 1, the above information display control method may include the following steps.

[0014] In step S11, in response to the update of location information, the current lane area data is determined by combining the updated current location information with navigation information, and further, the area intersection area (area intersection area) between the current lane area data and the HUD projection area data corresponding to the HUD (head-up display) device is obtained.

[0015] In step S12, a virtual lane indicator figure based on the current lane is displayed on the HUD projection area. Here, the virtual lane indicator figure is triggered when the area intersection area satisfies a predetermined first judgment condition.

[0016] The information display control method according to this embodiment collects current location information in real time, calculates current lane area data by combining the collected current location information and navigation data, and provides lane guidance to the user by triggering the display of a virtual lane indication figure based on the current lane on the HUD projection area when the area intersection area between the current lane area data and the HUD projection area data corresponding to the AR-HUD device satisfies a predetermined first judgment condition. By displaying the virtual lane indication figure as an augmented reality overlay on the actual lane, the connection between the driving instruction figure and the current lane in the driver's brain (i.e., the relationship between the virtual lane indication figure and the actual lane) is strengthened based on the principle of visual inertia, and the guidance direction becomes clearer.

[0017] The steps of the information display control method of this embodiment will be described in more detail below with reference to the drawings and examples.

[0018] In step S11, in response to the update of location information, the updated current location information and navigation information are combined to identify the current lane area data, and the area intersection area between the current lane area data and the HUD projection area data corresponding to the AR-HUD device is calculated.

[0019] In this exemplary embodiment, the above method can be applied to an in-vehicle terminal device, an intelligent in-vehicle system, an AR-HUD device, or an intelligent mobile terminal device that communicates data with these in-vehicle systems. For example, while driving, the driver can plan a route and perform navigation using a navigation application built into the in-vehicle system or a navigation application on a smart mobile terminal, and the instruction information included in the navigation data can be projected and displayed on the AR-HUD device in real time. The projection on the AR-HUD device includes lane indication information, navigation arrows, vehicle speed information, etc. The above position information may be acquired in real time by a position sensor mounted on the in-vehicle system or smart mobile terminal. In addition, data such as vehicle speed data, rotation speed data, steering wheel angle, lane inclination angle, and lane width can be acquired via a vehicle speed sensor, rotation speed sensor, steering angle sensor, in-vehicle navigation system, or ADAS (Advanced Driving Assistance System).

[0020] Taking an intelligent in-vehicle system as an example, location information may be acquired in real time, and each time the vehicle's position changes, the lane the vehicle is currently traveling in can be identified based on the current vehicle position information and high-precision lane information included in the navigation information. Here, the navigation information may be composed of any one or more of the following: current lane identifier, lane inclination angle, lane width, and lane curvature.

[0021] Here, the current lane area data may include the area, width, and coordinate data of the lane area corresponding to the current lane in which the vehicle is traveling. The HUD projection area data can indicate the area of ​​the region that the HUD imaging surface of the AR-HUD device projects onto the ground. For example, as shown in Figure 2, in the coordinate system, the Sw area represents an ideal driving lane with a constant elevation and zero curvature, the Sy area represents the lanes on both the left and right sides of that driving lane, and the trapezoidal Sb area represents the region that the imaging surface of the AR-HUD device projects onto the ground. 理想 The area represents the intersection area between the current lane the vehicle is traveling in (ideal lane) and the ground projection area of ​​the HUD imaging surface. Here, the above coordinate system may be a coordinate system based on the real world, the viewpoint position is determined based on the driver's fixed position, and the position of the HUD imaging surface in the coordinate system is determined based on the vehicle mounting position of the HUD device. The length of the imaging range of the HUD imaging surface can be set to a range of 20m to 100m. Accordingly, when calculating the area of ​​each region, it can be calculated based on the projection length of the HUD imaging surface, for example, a length of 80m. Under ideal conditions, the intersection area between the current lane area (ideal lane area) and the HUD projection area is S 理想 It will become an area, and furthermore, S 理想 The area corresponds to the ideal projected area. If the projected length remains constant at 80m, then simply obtaining the lane width will result in S 理想 The area can be calculated.

[0022] Referring to Figure 3, the So area represents the actual lane the vehicle is currently traveling in, and the curvature of this actual lane is greater than zero, meaning the actual lane is a non-ideal lane that includes curves. The Sw area represents an ideal lane with a constant altitude and zero curvature, starting from the current position. The trapezoidal Sb area represents the area projected onto the ground by the imaging surface of the AR-HUD device. The dark area Sg in the figure is the intersection area between the solid line of the vehicle's lane and the ground projection area of ​​the HUD imaging surface, and the area of ​​this Sg area corresponds to the area intersection area acquired in step S11.

[0023] For example, when starting navigation, a coordinate system is set, and based on the acquired position information, lane information and lane width, the current lane based on the current position and the area of each region are calculated in real time in the coordinate system.

[0024] In step S12, a virtual lane instruction graphic based on the current lane is displayed on the HUD projection area. Here, the virtual lane instruction graphic is triggered when the region intersection area satisfies a predetermined first judgment condition.

[0025] In this embodiment, after acquiring the calculation result of the region intersection area, it may first be determined whether the region intersection area satisfies a predetermined judgment condition, for example, the first judgment condition. Here, the first judgment condition may be set based on an ideal projection area. The corresponding ideal projection area can be determined based on the HUD projection area and the corresponding ideal lane area under a preset ideal condition for the current lane. For example, after acquiring the current position information and the lane width, the ideal area can be calculated based on a preset HUD projection length, such as the above-mentioned 80m, that is, lane width × 80m.

[0026] For example, the above-mentioned first judgment condition may be to determine whether the region intersection area is within the range of [S 臨1 ,S 臨2 ). If the value of the region intersection area is within this range, it is determined that the generation condition for the virtual lane instruction graphic is satisfied. For example, S 臨1 =S 理想 ×30%, S 臨1 =S 理想 ×60% can be set. Here, S 理想 refers to the area of the ideal lane intersection region between the HUD projection region of the HUD imaging surface with respect to the ground and the current lane on which the vehicle is traveling under ideal lane conditions, for example, S 理想 area in FIGS. 2 and 3. For example, the range and area Sb of the HUD projection area of the HUD imaging surface on the ground is the area of a predetermined trapezoidal region, and S 理想Calculating the area of ​​an area means calculating the area occupied by the ideal lane Sw of the current lane within region Sb, that is, S 理想 The area is the intersection region of the Sw area and the Sb area. In the scenario shown in Figure 2, S 理想 The area of ​​the region is currently the width of the lane multiplied by the distance between the forward and rear boundary lines of region Sb. The distance between the forward and rear boundary lines of Sb is related to the FOV and is a known value, for example, 80m. Therefore, S 理想 When calculating the area, it is necessary to collect real-time GPS location and navigation map data in order to obtain the current lane width data.

[0027] If the area intersection is determined to satisfy the first judgment condition, the AR-HUD device projects a virtual lane indicator figure. The AR-HUD system projects the virtual lane lines (virtual lane indicator figure) of the current driving lane onto the windshield by stretching and deforming them. As shown in Figure 4, the virtual lane division lines 41 displayed on the imaging surface 40 of the AR-HUD device may include two parallel indicator lines of the same width as the current lane 43. For example, the display length and display position of the virtual lane indicator figure can be set in advance. For example, in the coordinate system shown in Figure 2 or Figure 3, the display position of the starting point of the virtual lane indicator figure may be set at 20m, and the length of the virtual lane lines of the virtual lane indicator figure may be set based on the projection effect.

[0028] In this embodiment, the method further includes the step of controlling the amount of deformation of the virtual lane indicator figure based on a target deformation parameter so that the virtual lane indicator figure merges with the current lane. Here, the target deformation parameter is determined based on the difference between the ideal projection area and the area intersection area.

[0029] The above target deformation parameters are determined based on the difference between the ideal projection area and the area of ​​intersection of the above regions, which includes the following:

[0030] The corresponding ideal projection area is determined based on the HUD projection area and the ideal lane area corresponding to the current lane under predetermined ideal conditions.

[0031] The difference between the corresponding areas is determined based on the above ideal projection area and the above region intersection area.

[0032] The target deformation parameters for the virtual lane indicator shape are set based on the difference in area. Here, the target deformation parameters change in proportion to the difference in area.

[0033] After obtaining the calculation result for the area of ​​intersection of the above regions, the difference △S between the ideal projected area and the area of ​​intersection of those regions can be calculated. For example, the formula may include the following: △S=S 理想 -Sg Here, S 理想 Sg represents the area of ​​the intersection region between the ideal lane region corresponding to the current lane under ideal conditions and the ground projection region of the HUD imaging surface, while Sg represents the intersection between the actual lane during vehicle travel (the actual lane of the current lane) and the HUD projection on the ground of the HUD imaging surface. 理想 That is the case.

[0034] In this embodiment, the method further includes the step of determining the degree of fusion between the virtual lane indicator figure and the current lane based on the area of ​​intersection of the regions, and controlling the transparency of the virtual lane indicator figure to change in steps according to a predetermined rule when the degree of fusion between the virtual lane indicator figure and the current lane satisfies a predetermined first preset threshold.

[0035] The image deformation coefficient on the virtual image plane (virtual surface) indicates the degree to which the virtual lane indicator figure on the virtual image plane observed by the driver deviates from the actual lane. A coefficient of 1 indicates no image deformation. As shown in Figure 5, the image deformation ratio on the virtual surface is classified into horizontal and vertical directions. Horizontal deformation is the left-right tilt elongation (W 水平 (This indicates the degree of deformation in the horizontal direction), and vertical deformation is the elongation of the image length in the vertical direction (W 垂直 It is defined as the degree of vertical deformation, where changes in road curvature cause horizontal deformation, and changes in road inclination angle cause vertical deformation. ​

[0036] The difference between the intersection area of ​​the ideal lane and the HUD ground projection area and the intersection area of ​​the actual lane and the HUD ground projection area is △S (△S = S 理想 -Sg) is proportional to the degree of image deformation on the virtual image plane. When the horizontal curvature of the road is K and the slope angle of the road is α, the degree of deformation is W. 総 It can be obtained using the following formula. W 総 =(W 水平 +W 垂直 ) / 2={[K×(△S / S 理想 )×a]+[α / 180×(△S / S 理想 ) × b]} / 2 Here, a is the horizontal deformation constant and b is the vertical deformation constant.

[0037] Furthermore, △S is inversely proportional to the degree of integration between the virtual lane and the actual lane, and the degree of integration between the virtual lane and the actual lane K 融合 is K 融合 = 1 - W 総 This is represented by . When the virtual lane and the actual lane are completely fused (the degree of image deformation of the virtual image plane is 0), K 融合 = 1.

[0038] After the virtual lane is generated, its degree of horizontal and vertical deformation changes based on the above formula, and the degree of deformation fluctuates in proportion to △S. When the virtual lane line L1 perfectly matches the current lane L2 in the real environment, K 融合 The value becomes 1, and the virtual lane line L1 gradually becomes transparent and disappears.

[0039] While the vehicle is in motion, the degree of deformation of the virtual lane (virtual lane indicator figure) changes in accordance with the change in Sg, and in this process, the deformation of the guidance virtual lane also changes in sync. Furthermore, the degree of deformation of the virtual lane is directly affected by the road curvature and is proportional to the road curvature, and the virtual lane is controlled to gradually adapt to the current lane.

[0040] Alternatively, in some embodiments, the curvature of a predetermined lane based on the current position is obtained based on navigation information, for example, the length being 100m. If the lane curvature is identified as 0, it means that the actual lane is straight. In this case, only the degree of vertical extension of the virtual lane needs to be calculated. On the other hand, if the curvature of the actual lane is not 0, it is necessary to calculate the degree of horizontal and vertical extension and deformation of the virtual lane.

[0041] In this embodiment, the method further includes the step of dynamically displaying guide signs within a virtual lane indicator figure.

[0042] As shown in Figure 4, the guide sign 42 may be a dynamically displayed navigation arrow. Here, the display position and timing of the guide sign can be set in advance. For example, the dynamic display effect of the navigation arrow is a dynamic display method that displays sequentially from the near end to the far end. The display timing of the navigation arrow can also be set to be synchronized with, for example, a virtual lane. Alternatively, the navigation arrow may be set to be displayed only when the deformation amount of the virtual lane reaches a predetermined level, thereby enabling the driver to accurately understand the lane indicated by the navigation arrow.

[0043] Furthermore, the degree of fusion between the virtual lane and the actual lane can be calculated in real time, and the transparency of the virtual lane display can be controlled based on the result. For example, when the virtual lane and the actual lane are completely fused (the degree of image deformation on the virtual image plane becomes 0), the degree of fusion K 融合 If the value becomes 1, the display transparency of the virtual lane is controlled to gradually change to 100%, and the virtual lane disappears in the form of a dynamic gradient.

[0044] Referring to Figure 14, this embodiment further includes the following steps.

[0045] In step S11, the current lane area data is identified using the updated current location information and navigation information in response to the location information update, and the area of ​​intersection between the current lane area data and the HUD projection area data corresponding to the HUD device is obtained.

[0046] Step S13 involves displaying navigation guidance signs on the HUD projection area. Here, the navigation guidance signs are triggered when the area intersection of the above regions satisfies a predetermined second judgment condition.

[0047] The second criterion may be set based on the ideal projected area. For example, the second criterion may be that the crossover region Sg is threshold Sg ≥ S 臨2 It may also be a determination of whether or not the above requirement is met. If Sg satisfies the above requirement, it indicates that 60% or more of the current lane is visible from the HUD imaging surface, and in this case, clear lane guidance can be provided to the driver with only a single navigation guidance sign. At this time, it is not necessary to generate a virtual lane by directly projecting pre-stored navigation guidance graphics onto the HUD imaging surface based on real-time GPS location information and navigation map data. For example, the navigation guidance sign may be similar to the guidance sign described above, that is, both of which have a dynamic effect of being displayed sequentially from the near end to the far end.

[0048] In some embodiments, in scenarios where the field of view (FOV) is exceeded in a curve, the above information display control method includes the following steps.

[0049] In step S31, the route is planned based on the navigation.

[0050] In step S32, while the vehicle is in motion, a sensing module is used to collect data such as vehicle speed, rotational speed, steering wheel angle, lane inclination angle, lane width, lane curvature, and remaining turning distance during the turn.

[0051] Step S33 involves analyzing and processing the data.

[0052] A data processing module may be used to reprocess various collected data information and control the display (appearance) and dynamic changes of elements such as virtual lane lines L1 and indicator shapes. Specifically, based on the current lane curvature, lane inclination angle, and lane width, the intersection Sg between the actual lane area where the vehicle is traveling and the ground projection area of ​​the HUD imaging surface is calculated, and if Sg is [S 臨1 ,S 臨2 Whether or not to generate a virtual lane is determined by whether or not it is within the range of ), and if the condition is met, the area difference △S (△S = S 理想 Deformation amount W of the virtual lane line according to the magnitude of -Sg) 総 Control.

[0053] In step S34, the area of ​​the cross region Sg is S 臨1 ≤Sg 臨2 Determine whether it is within the range of [S]. That is, in a scenario where the FOV is exceeded on a curve, if the area of ​​intersection Sg of the lane the vehicle is currently traveling in is within the range of [S]. 臨1 ,S 臨2 Determine whether it is within the range of ).

[0054] In step S35, a dynamic virtual lane line L1 is generated. In a scenario where the FOV is exceeded on a curve, the condition S in step S34 is met. 臨1 ≤Sg 臨2 If the conditions are met, the system processes data such as lane width, lane curvature, and lane inclination angle acquired by the sensing module in the calculation unit of the element generation module to generate a virtual lane line L1 of the currently driven lane, which has been stretched and deformed (see Figure 6).

[0055] A navigation arrow L3 is dynamically displayed in the center of the generated virtual lane line L1 (see Figure 7). After the virtual lane line is generated, the degree of deformation of the virtual lane line is stretched according to the calculation method described above, so that △S(△S=S 理想 ​​It is proportional to -Sg). The degree of deformation of the virtual lane line in a curved section is directly affected by the curvature of the road and is similarly proportional. When the virtual lane line L1 completely overlaps with the actual lane line L2, the virtual lane line L1 gradually becomes transparent and disappears (see Figure 8).

[0056] After the virtual lane lines disappear, only the navigation arrow L3 remains on the HUD image sensor (see Figure 9).

[0057] Furthermore, in some embodiments, in scenarios where a downhill slope exceeds the field of view (FOV), the above-described information display control method may include the following steps.

[0058] In step S41, the route is planned based on the navigation.

[0059] In step S42, the sensing module collects data. While the vehicle is in motion, the sensing module collects data such as vehicle speed, rotational speed, steering wheel angle, lane inclination angle, lane width, lane curvature, and remaining turning distance during a turn (remaining steering distance during the steering process).

[0060] Step S43 involves data analysis and processing. The data processing module is used to reprocess the collected data (collected data information) and control the display and dynamic changes of elements such as the virtual lane line L1 and indicator shapes. Specifically, the area of ​​the intersection region Sg between the current lane area during driving and the ground projection area of ​​the HUD imaging surface is calculated based on the current lane curvature, lane inclination angle, and lane width. A decision is made as to whether or not to generate a virtual lane based on the range in which the area of ​​the intersection region is located. If the conditions for generating a virtual lane are met, the amount of deformation of the virtual lane line is controlled according to the size of the intersection region Sg, and the degree of fusion between the virtual lane line and the actual lane line is controlled using the remaining steering distance during the steering process and the size of the intersection region Sg.

[0061] In step S44, the crossing region Sg is S 臨1 ≤Sg 臨2 ​Determine whether it is within the range. When the downhill slope exceeds the FOV, the area of ​​the intersection region Sg of the current lane the vehicle is traveling in is [S 臨1 ,S 臨2 It is within the range of ).

[0062] In step S45, a dynamic virtual lane line L1 is generated. In situations where the downhill slope exceeds the FOV, the judgment result is that the condition in step S44 is met. 臨1 ≤Sg 臨2 If the conditions are met, the data acquired by the sensing module, such as lane width, lane curvature, and lane inclination angle, is processed by the calculation unit of the element generation module to generate a virtual lane line L1 of the currently driven lane, which has been stretched and deformed (see Figure 10).

[0063] A navigation arrow L3 is dynamically displayed in the center of the generated virtual lane line L1 (see Figure 11).

[0064] After generating the virtual lane lines, the deformation amount (degree of deformation) of the virtual lane lines is stretched, and △S (△S = S 理想 It is proportional to -Sg). On a downhill slope, it is directly affected by the road gradient angle. When the virtual lane line L1 completely overlaps with the actual lane line L2, the virtual lane line L1 gradually becomes transparent and disappears (see Figure 12).

[0065] After the virtual lane lines disappear, only the navigation instruction shape, i.e., the navigation arrow L3, remains on the HUD imaging surface (see Figure 13).

[0066] Alternatively, in some embodiments, in scenarios exceeding certain FOVs, if the road has a sloping curve, the deformation of the virtual lane is affected by and proportional to the road's slope angle and curvature.

[0067] ​In the display control method disclosed herein, the degree of deformation of the virtual lane while the vehicle is in motion changes in accordance with the change in the intersection area Sg, and is inversely proportional to the change in Sg. In conjunction with this, the deformation of the navigation instruction graphic (navigation guidance graphic) also changes to a similar extent, and when the virtual lane completely overlaps with the lane in the real environment, the virtual lane gradually becomes transparent and disappears. On the other hand, the navigation instruction graphic displayed in the center of the lane remains, and the navigation instruction graphic and the current lane line exhibit an augmented reality (AR) effect. This process is based on the principle of visual inertia, strengthening the connection between the navigation instruction graphic and the actual lane in the driver's brain, resulting in clearer driving instructions.

[0068] This method is primarily used to solve the problem of how to accurately guide the driver in the current lane even when the current lane is not displayed within the HUD projection area, given the limited size of the HUD system's FOV (Field of View). The method acquires the current external environment and vehicle status signals and performs calculations. When it is determined that the intersection area of ​​the current lane with the projection area of ​​the FOV image sensor onto the ground is less than a predetermined value, the calculated lane line is offset and stretched based on the positional difference with the FOV image sensor, and the resulting graphic is projected onto the windshield in front of the driver. This allows the driver to obtain accurate navigation instructions (guidance information) without taking their eyes off the road ahead.

[0069] It should be noted that the above drawings are merely schematic diagrams of the processes included in the exemplary embodiments of the present disclosure and are not intended to limit them. It is readily apparent that the processes shown in the above drawings do not represent or limit the chronological order of these processes. It is also readily apparent that these processes can be executed synchronously or asynchronously, for example, in multiple modules.

[0070] As shown in Figure 15, this embodiment further discloses an information display control device 150. The information display control device 150 includes a data acquisition module 1501 and a display control module 1502.

[0071] The data acquisition module 1501 may be configured to identify the current lane area data by combining the updated current location information and navigation information in response to location information updates. The module then acquires the area intersection area between the current lane area data and the HUD projection area data corresponding to the HUD device.

[0072] The display control module 1502 may be configured to display a virtual lane indicator figure based on the current lane within the HUD projection area. Here, the virtual lane indicator figure is triggered when the area intersection area satisfies a first determination condition.

[0073] In some embodiments, the information display control device 150 further includes a fusion control module. The fusion control module controls the amount of deformation of the virtual lane indicator figure based on a target deformation parameter so as to fuse the virtual lane indicator figure with the current lane. Here, the target deformation parameter is determined based on the area difference between the ideal projection area and the intersection area.

[0074] In some embodiments, the information display control device 150 further includes a degree of fusion calculation module and a virtual lane display control module. The degree of fusion calculation module may be configured to calculate the degree of fusion between the virtual lane indicator figure and the current lane based on the area intersection area. The virtual lane display control module may be configured to control the transparency of the first virtual lane to gradually change according to a preset rule when the degree of fusion between the virtual lane indicator figure and the current lane satisfies a predetermined first threshold.

[0075] In some embodiments, the information display control device 150 further includes a guide sign display control module. The guide sign display control module may be configured to dynamically display guide signs within the virtual lane indicator figure.

[0076] In some embodiments, the fusion control module is Deformation Includes a parameter calculation module. Deformation The parameter calculation module may be configured to determine the corresponding ideal projected area based on the HUD projection area and the ideal lane area corresponding to the current lane under ideal conditions. It may also be configured to determine the corresponding area difference based on the above ideal projected area and the area intersection area. The target of the virtual lane indicator shape based on the area difference. Deformation Set parameters Yo It may be configured as follows: Here, the above objective Deformation The parameter changes in proportion to the area difference.

[0077] In some embodiments, the information display control device 150 further includes a navigation guidance sign display control module. This navigation guidance sign display control module may be configured to display a navigation guidance sign on the HUD projection area. Here, the navigation guidance sign is triggered when the area intersection area satisfies a second determination condition.

[0078] In some embodiments, the information display control device 150 further includes a decision condition setting module. This decision condition setting module may be configured to calculate an ideal projection area based on the HUD projection area and an ideal lane area corresponding to the current lane under predetermined ideal conditions. It is configured to set a first decision condition and a second decision condition according to the ideal projection area.

[0079] In some embodiments, the navigation information currently consists of a combination of one or more of the following: lane identifier, lane inclination angle, lane width, and lane curvature.

[0080] Details of each module in the information display control device 150 are disclosed in detail in the corresponding information display control method description and will not be repeated herein.

[0081] While the detailed description in this disclosure refers to multiple modules or units for performing operations, such division is not mandatory. In fact, according to embodiments of the present invention, the features and functions of two or more modules or units described above may be embodied in a single module or unit. Conversely, the features and functions of a single module or unit described above may be embodied by being divided into multiple modules or units.

[0082] Figure 16 shows a schematic configuration diagram of an electronic device suitable for realizing an embodiment of the present disclosure.

[0083] The electronic device 1000 shown in Figure 16 is merely an example and does not limit the functions or scope of application of the embodiments of this disclosure.

[0084] As shown in Figure 16, the electronic device 1000 includes a Central Processing Unit (CPU) 1001, which performs various operations and processes based on programs stored in a Read-Only Memory (ROM) 1002 or programs read from a storage unit 1008 into a Random Access Memory (RAM) 1003. The RAM 1003 stores various programs and data necessary for the operation of the system. The CPU 1001, ROM 1002, and RAM 1003 are interconnected via a bus 1004. An Input / Output (I / O) interface 1005 is also connected to the bus 1004.

[0085] The input / output interface (I / O interface) 1005 is connected to an input unit 1006, an output unit 1007, a storage unit 1008, and a communication unit 1009. The input unit 1006 includes a keyboard and mouse, the output unit 1007 includes a cathode ray tube (CRT), a liquid crystal display (LCD), and speakers, the storage unit 1008 includes a hard disk, and the communication unit 1009 includes a LAN (Local Area Network) card and a network interface card such as a modem. The communication unit 1009 performs communication processing via a network such as the Internet. A drive (drive unit) 1010 is also connected to the input / output interface 1005 as needed. The drive 1010 is equipped with removable media 1011 such as a disk, optical disk, magneto-optical disk, or semiconductor memory, and this media enables program installation to the storage unit 1008.

[0086] In particular, in embodiments of the present disclosure, the processing based on the flowchart shown below can be implemented as a computer software program. Embodiments of the present disclosure include a computer program product which includes a computer program recorded on a storage medium. Such a computer program has program code for performing the method shown in the flowchart. In such embodiments, the computer program may be downloaded and installed from a network via a communication unit 1009 and / or installed from a removable medium 1011. When the computer program is executed by a central processing unit (CPU) 1001, the functions defined in the system of the present application are performed.

[0087] Specifically, such electronic devices may be smart mobile electronic devices such as smartphones, tablet terminals, and laptop computers. Alternatively, such electronic devices may be smart electronic devices such as desktop computers.

[0088] The storage mediums shown in the embodiments of this disclosure may be computer-readable signaling media, computer-readable storage media, or any combination of the above. Computer-readable storage media include, for example, (but are not limited to) electrical, magnetic, optical, electromagnetic, infrared, semiconductor systems, devices, or any combination thereof. Specifically, these include electrically connected wires, magnetic disks for portable computers, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable ROM (EPROM), flash memory, optical fibers, portable compact disk-ROM (CD-ROM), optical storage devices, magnetic storage devices, or any appropriate combination thereof. In this disclosure, computer-readable storage media means tangible media containing or storing programs that can be used or combined with instruction execution systems, devices, or equipment. On the other hand, computer-readable signaling media include data signals transmitted in the baseband or as part of a carrier, and such data signals carry computer-readable program code. The data signals transmitted in this manner can take various forms, such as electromagnetic signals, optical signals, or any appropriate combination thereof. A computer-readable signaling medium may be any storage medium other than a computer-readable storage medium, such medium capable of transmitting, propagating, or transferring programs that can be used or combined with instruction execution systems, devices, or equipment. Transmission of program code contained on the storage medium may be via any suitable medium, such as wireless, wired, or any combination thereof.

[0089] The flowcharts and block diagrams in the drawings illustrate the architecture, functions, and operations that can be realized by systems, methods, and computer program products according to each embodiment of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, program section, or part of code, which includes one or more executable instructions for realizing a defined logical function. It should also be noted that in substitutable embodiments, the functions may be executed in an order different from that shown. For example, two blocks shown consecutively may be executed substantially in parallel, or in some cases in reverse order. In this disclosure, each block in a flowchart or block diagram, and combinations thereof, may be configured to be executed by a dedicated hardware-based system, or may be implemented by a combination of dedicated hardware and computer instructions.

[0090] Each unit described in the embodiments of this disclosure may be implemented in software or in hardware. These units may be located within a processor. The names of the units are not necessarily limited to the units themselves.

[0091] This application also provides a storage medium, which may be embedded in an electronic device or may exist independently without being incorporated into an electronic device. One or more programs are recorded on the storage medium, and when these programs are executed on the electronic device, the electronic device implements the method shown in the above embodiment. For example, the electronic device performs each step shown in Figure 1.

[0092] Furthermore, the flowcharts and block diagrams shown above conceptually illustrate the processes included in the methods according to the embodiments of this disclosure and are not intended to limit them. For ease of understanding, please note that the processes shown in the diagrams do not suggest or limit their execution order. Moreover, these processes may be executed synchronously or asynchronously across multiple modules.

[0093] Those skilled in the art will readily conceive of other embodiments of this disclosure by reference to this specification and the examples. Accordingly, this application is intended to include any variations, uses, or adaptations that combine prior art or conventional art not described herein, in accordance with the general principles of this disclosure. The specification and examples are illustrative only, and the true scope and intent of this disclosure are determined by the claims.

[0094] Furthermore, this disclosure is not limited to the exact configuration described above and shown in the drawings, and various changes and modifications are permitted as long as they do not exceed this scope. The scope of this disclosure should be understood to be determined solely by the claims attached.

Claims

1. In response to location information updates, the current lane area data is determined by combining the updated current location information with navigation information. The steps include obtaining the area of ​​intersection between the current lane area data and the head-up display projection area data corresponding to the head-up display device, The steps include displaying a virtual lane indicator figure based on the current lane on the head-up display projection area, The process includes the step of controlling the amount of deformation of the virtual lane indicator figure based on a target deformation parameter in order to merge the virtual lane indicator figure with the current lane, The virtual lane indicator figure is triggered when the area crossing the region satisfies the first judgment condition. The information display control method is characterized in that the target deformation parameter is determined based on the area difference between the ideal projection area and the area intersection area.

2. A step of determining the degree of integration between the virtual lane indicator figure and the current lane based on the area of ​​intersection of the aforementioned regions, The further step includes controlling the transparency of the virtual lane indicator to change in steps according to a predetermined rule when the degree of fusion between the virtual lane indicator and the current lane satisfies a first threshold, The information display control method according to claim 1.

3. The step further includes dynamically displaying navigation guidance signs within the virtual lane indicator figure. The information display control method according to claim 1.

4. The target deformation parameter is determined based on the area difference between the ideal projection area and the region intersection area. The steps include determining the ideal projection area based on the head-up display projection area and the ideal lane area corresponding to the current lane under predetermined ideal conditions, A step of determining the corresponding area difference based on the ideal projected area and the area of ​​intersection of the regions, The step of setting the target deformation parameter of the virtual lane indicator figure based on the area difference, The target deformation parameter changes in proportion to the area difference. The information display control method according to claim 1.

5. The method further includes the step of displaying a navigation guide sign on the head-up display projection area, wherein the navigation guide sign is triggered when the area intersection area satisfies a second determination condition. The information display control method according to claim 1.

6. The steps include determining the corresponding ideal projection area based on the head-up display projection area and the ideal lane area corresponding to the current lane under predetermined ideal conditions, The step further includes setting the first and second judgment conditions based on the ideal projected area, The information display control method according to claim 5.

7. The aforementioned navigation information includes one or a combination of the following: current lane identifier, lane inclination angle, lane width, and lane curvature. The information display control method according to claim 1.

8. A recording medium characterized in that a computer program is recorded on it, and when the computer program is executed by a processor, the information display control method described in any one of claims 1 to 7 is executed.

9. The system includes a processor and a storage device that stores executable instructions for the processor, The electronic device is characterized in that the processor is configured such that the information display control method described in any one of claims 1 to 7 is realized by executing the executable instructions.

Images