Head-up display device, display control method and device, storage medium and vehicle

By filling the movable fragmented image elements in the track image of the head-up display device and controlling its movement rate according to the information of the road ahead, the problem of intuition and accuracy in the prior art is solved, and driving safety is improved.

WO2025118680A1PCT designated stage expired Publication Date: 2025-06-12JIANGSU NEW VISION AUTOMOTIVE ELECTRONICS CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/112225
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-12-08
Filing Date
2024-08-15
Publication Date
2025-06-12

AI Technical Summary

Technical Problem

When the existing head-up display device displays the road ahead, the information is not intuitive and accurate enough, which increases the driver's thinking burden and reduces the safety in complex driving environments.

Method used

By filling the track image with movable fragmented image elements and controlling the movement rate of the image elements according to the road situation information ahead, the driver can more intuitively sense the road situation and adjust the vehicle's driving speed.

Benefits of technology

It reduces the driver's thinking burden, improves safety in complex driving environments, and helps drivers control vehicles more effectively through more intuitive and accurate road conditions display.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024112225_12062025_PF_FP_ABST
    Figure CN2024112225_12062025_PF_FP_ABST
Patent Text Reader

Abstract

A head-up display device (170), a display control method, a display control device, a storage medium and a vehicle. The display control method comprises: filling a track line image (52) with a movable fragmented image element (80), the movement direction of the image element (80) being consistent with the extension direction of the track line image (52) (S701); acquiring road condition information of the road ahead of the present vehicle (S702); and controlling the movement rate of the movable fragmented image element (80) on the basis of the road condition information of the road ahead (S703).
Need to check novelty before this filing date? Find Prior Art

Description

Head-up display device, display control method, device and storage medium, vehicle

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to the Chinese patent application filed with the China Patent Office on December 8, 2023, with application number 2023116868579, and invention name “Head-up display device, display control method, device and storage medium, vehicle”. The content of the Chinese patent application is hereby introduced into this application as a reference. Technical Field

[0003] The present disclosure relates to the field of assisted driving technology, and more specifically to a head-up display device, a display control method, a device and a storage medium, and a vehicle. Background Art

[0004] A head-up display (HUD) device projects the light of a display image output by an image source onto an imaging window (e.g., an imaging board, windshield, etc.) through, for example, a reflective optical design, so as to display vehicle status information such as speed and fuel level, as well as indication information such as navigation and hazard warnings, at an appropriate position in front of the driver. In this way, the driver can obtain relevant information such as vehicle speed and fuel level without shifting his or her line of sight away from the road ahead, thereby improving driving safety and driving experience.

[0005] Technical content

[0006] The present disclosure provides a head-up display device, display control method, device, storage medium, and vehicle. By more intuitively and accurately displaying road conditions ahead, the driver can control the vehicle's speed based on the perceived road conditions ahead, reducing the driver's mental burden and improving safety in complex driving environments.

[0007] The technical solution of the present disclosure is achieved as follows:

[0008] In a first aspect, the present disclosure provides a display control method, the method comprising:

[0009] Filling the track line image with movable fragmented image elements, wherein the moving direction of the image elements is consistent with the extending direction of the track line image;

[0010] Obtaining information about the road conditions ahead of the vehicle;

[0011] The moving speed of the movable fragmented image element is controlled according to the front road condition information.

[0012] In a second aspect, the present disclosure provides a display control device, comprising: a filling part, an acquisition part, and a control part; wherein,

[0013] The filling portion is configured to fill the track line image with movable fragmented image elements, wherein the moving direction of the image elements is consistent with the extending direction of the track line image;

[0014] The acquisition part is configured to acquire information about the road condition ahead of the vehicle;

[0015] The control portion is configured to control a moving speed of the movable fragmented image element according to the front road condition information.

[0016] In a third aspect, the present disclosure provides a display control device, comprising: a processor and a memory; the processor is configured to execute instructions stored in the memory to implement the display control method as described in the first aspect.

[0017] In a fourth aspect, the present disclosure provides a computer-readable storage medium storing at least one instruction, wherein the at least one instruction is used to be executed by a processor to implement the display control method as described in the first aspect.

[0018] In a fifth aspect, the present disclosure provides a head-up display device, comprising a display control unit and a display unit; wherein,

[0019] The display control unit is configured to fill the track line image with movable fragmented image elements, wherein the moving direction of the image elements is consistent with the extending direction of the track line image;

[0020] and obtaining information about the road conditions ahead of the vehicle;

[0021] and, controlling a moving rate of the movable fragmented image element according to the front road condition information;

[0022] The display unit is configured to project the track line image and the image elements onto a windshield of the vehicle for display based on the control of the display control unit.

[0023] In a sixth aspect, the present disclosure provides a vehicle, comprising the head-up display device described in the fifth aspect.

[0024] The present disclosure provides a head-up display device, display control method, device, storage medium, and vehicle. These devices fill a track image with movable, fragmented image elements, and control the movement speed of the image elements based on information about the road ahead. This allows the driver to control the vehicle's speed based on the perceived movement speed of the image elements. This reduces the driver's mental burden and improves safety in complex driving environments.

[0025] BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the following briefly introduces the drawings required for describing the embodiments. The drawings described below are only exemplary embodiments of the present disclosure.

[0027] FIG1 is a schematic diagram showing the composition of a vehicle-mounted system provided by the present disclosure.

[0028] FIG. 2 is an exemplary top view of a vehicle provided by the present disclosure.

[0029] FIG. 3 is an exemplary perspective view provided by the present disclosure, viewed from a driver's seat of a vehicle.

[0030] FIG4 is a schematic diagram of the architecture of the head-up display device provided by the present disclosure.

[0031] FIG5 is a schematic diagram of a track line image provided by the present disclosure.

[0032] FIG6(A) is a schematic diagram of another track line image provided by the present disclosure.

[0033] FIG6(B) is a schematic diagram of another track line image provided by the present disclosure.

[0034] FIG6(C) is a schematic diagram of another track line image provided by the present disclosure.

[0035] FIG6(D) is another schematic diagram of a track line image provided by the present disclosure.

[0036] FIG7 is a flow chart of a display control method provided by the present disclosure.

[0037] FIG8 is a schematic diagram of an image element provided by the present disclosure.

[0038] FIG9 is a schematic diagram of another image element provided by the present disclosure.

[0039] FIG10 is a schematic diagram of a flow chart of controlling the movement rate of image elements provided by the present disclosure.

[0040] FIG11(A) is a schematic diagram of the movement rate of image elements at the first congestion level.

[0041] FIG11(B) is a schematic diagram of the movement rate of image elements in the second congestion level.

[0042] FIG11(C) is a schematic diagram of the movement speed of image elements at the third congestion level.

[0043] FIG12 is a schematic diagram of another flow chart of controlling the movement rate of image elements provided by the present disclosure.

[0044] FIG13 is a schematic diagram showing the movement of image elements according to a reference movement rate.

[0045] FIG14 is a schematic diagram of the movement rate of image elements when the current speed of the vehicle is greater than the upper speed limit value.

[0046] FIG15 is a schematic diagram of the movement rate of image elements when the current speed of the vehicle is less than the upper speed limit.

[0047] FIG16 is a schematic diagram of another flow chart of controlling the movement rate of image elements provided by the present disclosure.

[0048] FIG17 is a schematic diagram showing a situation in which the distance between the vehicle provided by the present disclosure and other vehicles is relatively far.

[0049] FIG18 is a schematic diagram showing the moving speed of image elements when the distance between the own vehicle and other vehicles is relatively far.

[0050] FIG19 is a schematic diagram showing a situation in which the distance between the vehicle provided by the present disclosure and other vehicles is relatively close.

[0051] FIG20 is a schematic diagram showing the moving speed of image elements when the distance between the own vehicle and other vehicles is relatively close.

[0052] FIG21 is a schematic diagram of the vehicle provided by the present disclosure being too close to other vehicles.

[0053] FIG22 is a schematic diagram of a navigation arrow-shaped track line image provided by the present disclosure.

[0054] FIG23 is a schematic diagram of a flow chart of controlling track line branches in a track line image provided by the present disclosure.

[0055] FIG24 is a schematic diagram of a vehicle coordinate system provided by the present disclosure.

[0056] FIG25 is a schematic diagram of dividing areas in the XOY plane of the vehicle coordinate system provided by the present disclosure.

[0057] FIG26(A) is a schematic diagram of a track line branch provided by the present disclosure.

[0058] FIG26(B) is a schematic diagram showing a branch of a track provided by the present disclosure.

[0059] FIG27(A) is another schematic diagram of a track line branch provided by the present disclosure.

[0060] FIG27(B) is a schematic diagram showing another branch of a track provided by the present disclosure.

[0061] FIG28(A) is another schematic diagram of a track line branch provided by the present disclosure.

[0062] FIG28(B) is a schematic diagram showing another type of track branch provided by the present disclosure.

[0063] FIG29 is a schematic diagram showing a display of maintaining complete track line branches provided by the present disclosure.

[0064] FIG30 is a schematic diagram of forming a dual focal plane provided by the present disclosure.

[0065] FIG31 is a schematic diagram showing the composition of a display control device provided by the present disclosure.

[0066] FIG32 is a schematic structural diagram of a display control device provided by the present disclosure. DETAILED DESCRIPTION

[0067] In order to make the purpose, technical solutions and advantages of the present disclosure more apparent, the following will describe in detail exemplary embodiments of the present disclosure with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present disclosure, rather than all the embodiments of the present disclosure, and it should be understood that the present disclosure is not limited to the exemplary embodiments described herein.

[0068] Referring to FIG. 1 , an example of an in-vehicle system 100 applicable to the technical solutions of the present disclosure is shown. In some examples, the vehicle equipped with this system 100 may be an internal combustion engine vehicle powered by an engine, a hybrid vehicle powered by an engine and an electric motor, an electric vehicle powered by an electric motor, or other types of vehicles. Throughout this specification, a vehicle equipped with this in-vehicle system 100 will be referred to as the vehicle itself.

[0069] As shown in FIG1 , the vehicle-mounted system 100 includes a navigation subsystem 110, an environmental detection device group 120 for acquiring the vehicle's surroundings while the vehicle is traveling, a vehicle driving status detection device group 130, a data processing unit 140, a display control unit 150, and a display unit 160. These components or device groups are coupled together via a communication bus 12. In some examples, the communication bus 12 is used for communication between these components or device groups. It should be noted that FIG1 only illustrates a portion of the vehicle-mounted system 100, and does not represent all of the components of the vehicle-mounted system 100.

[0070] In Figure 1 , navigation subsystem 110 includes a positioning device 111 and a map information storage device 112. Positioning device 111 can locate the vehicle's position based on positioning systems such as the Global Positioning System (GPS), China's Beidou system, Russia's GLONASS system, Europe's Galileo system, Japan's Quasi-Zenith Satellite System (QZSS), and India's Indian Regional Navigation Satellite System (IRNSS), obtaining the vehicle's location information. Map information storage device 112 stores map information and can retrieve a navigation route to the destination based on the location information obtained from positioning device 111. The location information and navigation route are then displayed in a map application.

[0071] 1 , the environment detection device group 120 may include an onboard communication device 121, a radar 122, a laser rangefinder 123, and a camera 124. These devices can acquire environmental information representing the surrounding environment of the vehicle.

[0072] The in-vehicle communication device 121 can communicate wirelessly with one or more devices directly or via a communication network. These devices that can communicate with the in-vehicle communication device 121 can be other vehicles, roadside devices or roadside stations, or mobile terminal devices used by passengers in the vehicle. In some examples, the in-vehicle communication device 121 can use 3G cellular communication, such as code division multiple access (CDMA), EVDO, global system for mobile communications (GSM) / general packet radio service (GPRS), or 4G cellular communication, such as long term evolution (LTE), or 5G cellular communication. In some examples, the in-vehicle communication device 121 can also use WiFi to communicate with a wireless local area network (WLAN). In some embodiments, the in-vehicle communication device 121 can also use infrared links, Bluetooth, or ZigBee to communicate directly with devices. In some examples, the in-vehicle communication device 121 can also use other wireless protocols to communicate with devices.

[0073] The radar 122 is used to sense objects in the surrounding environment of the vehicle, and can also be used to sense the speed and / or direction of these objects. In some examples, the radar 122 can use electromagnetic waves or lasers as a medium to detect objects based on a time of flight (TOF) method or a phase-shift method, and detect the position of the detected object, the distance to the detected object, and the relative speed. In some examples, in order to be able to detect objects located in front of, behind, or to the side of the vehicle, the radar 122 can be configured at an appropriate location outside the vehicle.

[0074] The laser rangefinder 123 may utilize laser light to sense objects in the environment in which the host vehicle is located. In some embodiments, the laser rangefinder 123 may include one or more laser sources, a laser scanner, and one or more detectors, among other system components.

[0075] Camera 124 can be used to capture multiple images of the surrounding environment of the vehicle. Camera 122 can be a still camera or a video camera. In some examples, in order to obtain images of the exterior of the vehicle, camera 122 can be located at an appropriate location outside the vehicle. For example, in order to obtain images in front of the vehicle, camera 122 can be arranged in the interior of the vehicle near the front windshield. Alternatively, camera 122 can be arranged around the front bumper or radiator grille. In some examples, in order to obtain images from the rear of the vehicle, camera 122 can be arranged in the interior of the vehicle near the rear window glass. Alternatively, camera 122 can be arranged around the rear bumper, trunk, or tailgate. In some examples, in order to obtain images from the sides of the vehicle, camera 122 can be arranged in the interior of the vehicle near at least one of the side windows. Alternatively, camera 122 can be arranged around the side mirrors, fenders, or doors.

[0076] In Figure 1 , vehicle driving state detection device group 130 may include a steering angle sensor 131 for detecting the steering angle of the vehicle, a vehicle speed sensor 132 for detecting the vehicle's driving speed, and an acceleration sensor 133 for detecting acceleration applied to the vehicle. In some examples, as shown in the dashed box, an inertial sensor 134 may also be included to detect changes in the vehicle's position and orientation based on inertial acceleration. In a specific implementation, this inertial sensor 134 may be a combination of the acceleration sensor 133 and a gyroscope.

[0077] In Figure 1 , the data processing unit 140 can be implemented as a computing system comprising a memory, a processor, input / output interfaces, and a bus connecting these. In some examples, the data processing unit 140 uses program instructions stored in the memory to cause the processor to execute multiple commands to process data obtained by the navigation subsystem 110, the environmental detection device group 120, and the vehicle driving status detection device group 130. In some examples, the data processing unit 140 can also partially or fully control the driving of the vehicle based on the processed data.

[0078] In FIG1 , as shown by the dashed box, the display control unit 150 and the display unit 160 may serve as the main body of a head-up display (HUD) device 170. After receiving data processed by the data processing unit 140, or after receiving data obtained by the navigation subsystem 110, the environmental detection device group 120, and the vehicle driving status detection device group 130, the display control unit 150 may process the received data to obtain display information to be displayed, and then project this display information onto the vehicle's windshield for display via the display unit 160.

[0079] 2 and the exemplary perspective view from the driver's seat of the vehicle shown in FIG3 , the vehicle includes a windshield 204 at the front of the vehicle. The driver and passengers in the passenger cabin 208 of the vehicle can see the front of the vehicle through the windshield 204.

[0080] 3 , the windshield 204 is visually positioned above the vehicle dashboard 206. The driver can turn the steering wheel 210 within the passenger compartment 208 to steer the vehicle, such as to change lanes, merge, and park the vehicle. In some embodiments, the steering wheel 210 can be retracted or omitted.

[0081] The head-up display 170 (see FIG. 4 ) projects display information 212 (e.g., a virtual image) onto a portion of the windshield 204 through one or more apertures (e.g., aperture 216 ) in the instrument panel 206 . Although FIG. 3 illustrates an example size of the display information 212 , the display information 212 may be presented over a larger or smaller area. Examples of the display information 212 include various vehicle information, such as the current vehicle speed, the current gear of the vehicle's transmission, the engine speed, the vehicle's direction of travel, the current infotainment system settings, and / or other vehicle information. The head-up display 170 provides information to the vehicle driver without the driver having to look away from objects in front of the vehicle.

[0082] Referring to the exemplary implementation architecture of the head-up display device 170 shown in FIG4 , the display control unit 150 generates a signal 412 based on data processed by the data processing unit 140 or data 420 transmitted by the navigation subsystem 110, the environment detection device group 120, and the vehicle driving status detection device group 130. The display unit 160 may include a light source 161 and an optical path component 162. Based on the signal 412 from the display control unit 150, the light source 161 outputs light (e.g., a virtual image) for display on the windshield 204. For example, the light source 161 may include one or more lasers and output red, green, and blue light.

[0083] The optical path component 162 can reflect the output of the light source 161 onto the windshield 204 through the hole 216. The viewer (e.g., the driver) can view the display information 212 in the display area formed by projecting the display information 212 onto the windshield 204. In some examples, the optical path component 162 may include one or more reflectors (plane mirrors) and concave mirrors (magnifying glasses). The output of the light source 161 is reflected back by the reflector and magnified by the concave mirror and then reflected to the windshield 204 to form a virtual image 40 that can be visually observed by the driver. The visual effect presented by the virtual image 40 is that the virtual image 40 is projected onto the projection surface 41 at a set distance in front of the vehicle, but the real environment remains visible through the projection surface 41. In some examples, the optical path component 162 can also be omitted, and the light source 161 can directly project the display information 212 onto the windshield 204 to form the virtual image 40 on the projection surface 41.

[0084] As shown in Figures 1 to 4 above, when the vehicle is driving, the display control unit 150 determines the direction information of the vehicle's driving trajectory based on the vehicle's position information and the navigation path provided by the navigation subsystem 110, and projects the direction information of the driving trajectory onto the windshield 204 in the form of a track line through the display unit 160. The driver can drive the vehicle to the destination based on the guidance of the projected track line image. Specifically, as shown in Figure 5, in the display area 5 of the windshield 204, the track line image 51 is displayed as being covered on the driving road. Since the track line image 51 is a virtual image formed by the display unit 160, its figure mark is indicated by a dotted line in Figure 5. The lane line 52 of the driving road is a scene in the real environment, so its figure mark is indicated by a solid line in Figure 5. In FIG5 , the track line image 51 is displayed as a line extending from the front of the vehicle toward the direction of travel. The extension direction of the line corresponds to the direction of the vehicle's travel trajectory. If the current direction of the travel trajectory is a straight-ahead direction, the track line image 51 shown in FIG5 will correspondingly appear to extend in a straight line from the front of the vehicle. In some examples, as the direction of the travel trajectory changes, the extension direction of the track line image 51 will also change corresponding to the direction of the travel trajectory. For example, as shown in FIG6(A), when the direction of the travel trajectory needs to turn right, that is, when the road between the lane lines 52 curves to the right, the track line image 51 will also appear to extend from the front of the vehicle to curve to the right to correspond to the direction of the travel trajectory. As shown in FIG6(B), when the direction of the travel trajectory needs to turn left, the track line image 51 will also appear to extend from the front of the vehicle to curve to the left to correspond to the direction of the travel trajectory. As shown in Figures 6(C) and 6(D), respectively, when the driving trajectory requires a left or right lane change, the trackline image 51 will be displayed correspondingly, extending from the front of the vehicle in the direction of the left or right lane change to correspond to the driving trajectory. Furthermore, when the driving trajectory requires a U-turn, the trackline image 51 will be displayed correspondingly, extending from the front of the vehicle in the direction opposite to the current driving direction to correspond to the driving trajectory.

[0085] As can be seen from Figures 5 and 6, the track line image 51 can intuitively show the driver the direction of the driving trajectory, allowing the driver to see relevant information without having to lower his head, thereby improving safety and convenience. It is a visual aid tool used to help the driver better understand the vehicle's position and expected driving path during driving.

[0086] Although the track line image 51 shown in Figures 5 and 6 can intuitively display the direction of the driving trajectory, the driver needs more information about the road conditions ahead to understand the navigation route. Typically, the head-up display device 170 will display some road conditions ahead in the form of numbers or color changes. For example, when there is a speed limit sign ahead of the navigation route, the speed limit specified by the speed limit sign will usually be displayed in the display area 5 as a red circle with the speed limit value within the frame. For another example, when congestion occurs ahead, the location or section of the navigation route where the congestion occurs will be indicated by yellow, light red, and dark red to indicate the degree of congestion with increasing severity. The above display method requires the driver to match the displayed content with various possible road conditions ahead to determine the road conditions ahead that the displayed content actually matches. As the road environment becomes increasingly complex, performing such matching will increase the driver's thinking burden, thereby reducing driving safety.

[0087] Based on the above, the present disclosure aims to provide a more intuitive and accurate display solution for road conditions ahead. FIG7 illustrates an example of a display control method provided by the present disclosure. This method can be executed by the aforementioned head-up display device 170, and in particular, by the display control unit 150 within the head-up display device 170. The method illustrated in FIG7 includes steps S701 to S703.

[0088] In step S701 , movable fragmented image elements are filled in the track line image, and the moving direction of the fragmented image elements is consistent with the extending direction of the track line image.

[0089] It should be noted that in the track line image 51 shown in Figures 5 and 6, although the track line image 51 can intuitively display the direction of the current driving track, the track line image 51 is usually filled in the form of a "surface" for display, and this display method cannot provide more intuitive road condition information during driving.

[0090] In the present disclosure, the display control unit 150 renders fragmented and movable image elements into the trackline image. Specifically, the shapes of the image elements may include circles, rectangles, triangles, and the like. Taking a circle as an example, and referring to the example of a trackline image 51 extending in a straight-ahead direction shown in FIG5 , in some examples, as shown in FIG8 , all image elements 80 are neatly arranged in a grid or dot matrix within the trackline image 51. In some examples, as shown in FIG9 , all image elements 80 are randomly arranged within the trackline image 51. The image elements in FIG8 and FIG9 can be moved in the direction of extension of the trackline image 51, as indicated by the solid arrows. It should be noted that, in addition to the example of a trackline image 51 extending in a straight-ahead direction, trackline images corresponding to left turns, right turns, left lane changes, right lane changes, and U-turns can also be populated with image elements 80 in the manner shown in FIG8 and FIG9 , with the movement direction of the image elements 80 being consistent with the extension direction of the trackline image corresponding to the direction of the driving track.

[0091] In some examples, as shown in Figures 8 and 9, a baseline movement rate V0 can be set for the image element, where V0 represents the movement rate of the image element in the default state. For example, in some examples, when the vehicle is traveling and there is no situation ahead along the navigation path that affects the vehicle's speed, the image element 80 can move at the baseline movement rate V0.

[0092] In the present disclosure, after the fragmented movable image elements are filled into the track line image, an information dimension that can be displayed intuitively is added to the track line image by controlling the movement rate of the image elements.

[0093] In step S702, the road condition information ahead of the vehicle is obtained.

[0094] In the present disclosure, the display control unit 150 controls the speed of movable image elements within the track image displayed on the display unit 160. Based on the human perception system, in order to effortlessly correlate the speed of image elements with information in the real driving environment based on evolutionary biology, in some examples, the forward road condition information can be information that appears ahead of the vehicle's driving trajectory based on the vehicle's current location and can positively or negatively affect the vehicle's driving speed.

[0095] In some examples, when there is congestion ahead of the vehicle's trajectory (including visible and invisible traffic ahead), the vehicle's speed needs to be reduced. When there is no congestion ahead of the vehicle's trajectory and other information that affects the speed does not have a negative impact on the speed, there is no need to reduce the vehicle's speed, and the vehicle's speed can even be increased within the speed limit set by some regulations.

[0096] In some examples, when there is a speed limit sign ahead of the vehicle's trajectory (including both visible and invisible directions), if the current speed exceeds the upper speed limit indicated by the speed limit sign, the vehicle's speed needs to be reduced. If the current speed is less than the upper speed limit indicated by the speed limit sign, and other information that affects the speed does not negatively affect the speed, there is no need to reduce the vehicle's speed, and the vehicle's speed can even be increased within the range of the upper speed limit.

[0097] In some examples, when there are other vehicles visible ahead of the vehicle, it is also necessary to reduce the vehicle's speed. When there are no other vehicles visible ahead of the vehicle and other information that affects the vehicle's speed does not negatively affect the vehicle's speed, there is no need to reduce the vehicle's speed. The vehicle's speed can even be increased within the speed limit.

[0098] The three types of road ahead information examples described above not only affect the vehicle's speed, but also can be differentiated based on certain pre-set benchmark values ​​or benchmark conditions, thereby categorizing each type of information into more than one level. It should be noted that while this disclosure only provides examples of three types of road ahead information, it does not exclude other types of information that can both positively or negatively affect the vehicle's speed and can be differentiated based on certain pre-set benchmark values ​​or benchmark conditions to provide different levels of information. This disclosure does not elaborate further here.

[0099] In some examples, the road condition information that is not visible ahead of the vehicle refers to road condition information that is far ahead of the vehicle and cannot be visually observed. This information can be obtained through the navigation subsystem 110 or the onboard communication device 121. The road condition information that is visible ahead refers to road condition information that is relatively close ahead of the vehicle and can be visually observed, such as road signs and other vehicles ahead that the driver observes within the field of view of the windshield 204. In addition to being obtained through the navigation subsystem 110 or the onboard communication device 121, this information can also be obtained using the radar 122, laser rangefinder 123, and camera 124 in the environmental detection device group 120.

[0100] In step S703 , the moving speed of the movable fragmented image elements is controlled according to the front road condition information.

[0101] In the present disclosure, according to the example shown in step S702, road condition information ahead can be differentiated based on certain set benchmark values ​​or conditions to categorize the information into different levels. In some examples, the display control unit 150 controls the movement rate of the fragmented image elements along the moving direction in the track image based on the resulting information levels, and projects the fragmented image elements onto the windshield 204 via the display unit 160. By observing the changes in the movement rate of the fragmented image elements, the driver can intuitively perceive the road condition ahead and control the vehicle's driving speed based on the changes in the image element's movement rate.

[0102] In some examples, even if there are conditions ahead on the navigation path that affect the vehicle's driving speed, if the road conditions ahead do not require the driver to slow down, the image element may still move at the reference moving speed V0.

[0103] The technical solution shown in Figure 7 incorporates movable fragmented image elements into the track image, and the image element's movement speed is controlled based on information about the road ahead. This allows the driver to control the vehicle's speed based on the perceived movement speed of the image element. This reduces the driver's mental burden and improves safety in complex driving environments.

[0104] With respect to the technical solution shown in FIG7 , in some implementations, the road condition information ahead includes road congestion status information within a set distance ahead of the vehicle. In some examples, after obtaining the location information of the current location of the vehicle through the positioning device 111 of the navigation subsystem 110, a request is sent to a server providing a map application via the on-board communication device 121 to obtain the number of other vehicles within the set distance ahead of the vehicle from the server. The road congestion status information can be characterized by the number of other vehicles within the set distance ahead of the vehicle, and can be divided into two or more congestion status levels based on these numbers, with different congestion status levels corresponding to congestion statuses of different degrees of congestion.

[0105] Corresponding to the road congestion status information, referring to FIG. 10 , the controlling of the moving speed of the movable fragmented image elements according to the front road condition information includes steps S1001 to S1003 .

[0106] In step S1001 , a congestion level is determined based on road congestion information within a set distance ahead of the vehicle.

[0107] In step S1002 , when the congestion level within a set distance ahead of the vehicle is a first congestion level, the moving speed of the movable fragmented image elements is controlled to be a first moving speed.

[0108] In step S1003, when the congestion level within a set distance in front of the vehicle is a second congestion level that is higher than the congestion level corresponding to the first congestion level, the moving rate of the movable fragmented image elements is controlled to be a second moving rate; wherein the second moving rate is less than the first moving rate.

[0109] In some examples, since the road congestion status information can be characterized by the number of other vehicles within a set distance in front of the vehicle, in the present disclosure, the road congestion status corresponding to no other vehicles within 1 kilometer in front of the vehicle can be set to the first congestion status level, that is, the congestion status is unobstructed. The road congestion status corresponding to 1 to 5 other vehicles within 1 kilometer in front of the vehicle is set to the second congestion status level, that is, the congestion status is slow. In addition, the road congestion status corresponding to 5 or more other vehicles within 1 kilometer in front of the vehicle can also be set to the third congestion status level, that is, the congestion status is congested. It can be seen from the number of vehicles in front corresponding to the above three congestion status levels that the congestion level corresponding to the third congestion status level is higher than the congestion level corresponding to the second congestion status level, and the congestion level corresponding to the second congestion status level is higher than the congestion level corresponding to the first congestion status level.

[0110] In some examples, road congestion status information can also be determined by the traffic condition information ahead in the navigation path obtained by the navigation subsystem 110. Specifically, in the navigation path, the traffic condition information ahead can also include at least four congestion status levels, namely, unobstructed, slow, congested, and severely congested. In some examples, these four congestion status levels are represented by different colors in the navigation path. For example, when the traffic condition ahead is unobstructed, the color of the road ahead in the navigation path is green. When the traffic condition ahead is slow, the color of the road ahead in the navigation path is yellow. When the traffic condition ahead is congested, the color of the road ahead in the navigation path is light red. When the traffic condition ahead is severely congested, the color of the road ahead in the navigation path is dark red. In some examples, when the traffic condition ahead is congested or severely congested, they can be combined and considered as the same type of traffic condition information, that is, there are many vehicles in the road ahead in the navigation path and the congestion level is relatively serious.

[0111] In conjunction with the above-mentioned different levels of congestion, it is necessary to promptly remind the driver to control the vehicle's speed. In other words, the more congested the road ahead is, the more the driver needs to slow down to ensure safety. In the present disclosure, corresponding to the aforementioned example, see Figures 11(A), (B), and (C), which show the movement rate of image elements at the first congestion level, the second congestion level, and the third congestion level within a set distance ahead of the vehicle. In Figures 11(A), (B), and (C), the depth of the line color within the dotted box 1100 indicates the congestion level corresponding to each congestion level within 1 kilometer ahead of the vehicle. The darker the color, the more severe the congestion level; the lighter the color, the less severe the congestion level. It can be understood that the dotted box 1100 is used to exemplify the congestion level in the solution. During specific implementation, the dotted box may not be displayed in area 5. When the congestion level ahead is the third congestion level, the display control unit 150 controls the moving speed V3 of the movable fragmented image element 80 to be less than the moving speed V2 of the image element 80 corresponding to the second congestion level. When the congestion level ahead is the second congestion level, the display control unit 150 controls the moving speed V2 of the movable fragmented image element 80 to be less than the moving speed V1 of the image element 80 corresponding to the first congestion level. It should be noted that the more severe the congestion (i.e., the more congested the road ahead), the lower the moving speed of the image element 80. After the driver perceives the reduced moving speed, he or she will reduce the vehicle's speed based on this perception, thereby improving driving safety.

[0112] In some examples, when the current congestion status is the first congestion status level, that is, when the road ahead is unobstructed, it means that the driver does not need to reduce the vehicle's driving speed, and the display control unit 150 can also control the image element 80 to move according to the aforementioned benchmark moving speed V0.

[0113] Regarding the technical solution shown in FIG. 7 , in some implementations, the road condition information ahead includes information indicating a speed limit is required ahead of the vehicle. For example, after obtaining the vehicle's current location information using the positioning device 111 of the navigation subsystem 110, the speed limit sign at a set distance ahead of the vehicle on the navigation path can be retrieved from the map information stored in the map information storage device 112, and the speed limit value indicated by the speed limit sign can be obtained. This information indicates that a speed limit is required at the set distance ahead according to the speed limit value.

[0114] In response to the information that the speed limit is required ahead of the vehicle, referring to FIG. 12 , the controlling of the moving speed of the movable fragmented image elements according to the ahead road condition information includes steps S1201 to S1203 .

[0115] In step S1201, the current speed of the vehicle is compared with the upper speed limit value indicated by the information requiring speed limit.

[0116] In step S1202, when the current speed of the vehicle is less than or equal to the upper speed limit, the moving speed of the movable fragmented image elements is controlled to be a third moving speed;

[0117] In step S1203, when the current speed of the vehicle is greater than the upper speed limit, the moving speed of the movable fragmented image elements is controlled to be a fourth moving speed; wherein the fourth moving speed is less than the third moving speed and less than the reference moving speed.

[0118] In some examples, as shown in FIG13 , when the vehicle is traveling normally at a speed of 100 km / h as indicated by the dotted box 1300, the display control unit 150 controls the image element 80 in the track line image 51 to move at a reference moving speed V0. When a speed limit sign is found 1 km ahead of the vehicle's current position on the navigation path, as shown in the dotted box 1400 in FIG14 , and the speed limit indicated by the sign is 85 km / h, it indicates that the vehicle's current speed is greater than the speed limit value and the driver needs to slow down. At this time, the display control unit 150 controls the image element 80 in the track line image 51 to move at a moving speed V5, which is less than V0. After the driver perceives that the moving speed of the image element 80 has decreased, he or she will reduce the vehicle's speed to prevent speeding.

[0119] In some examples, as shown in FIG15 , when a driver is driving a vehicle at a normal speed of 75 km / h, they discover a speed limit sign 1 km ahead of the vehicle's current location on the navigation path, as shown in the dashed box 1500 in FIG15 . The speed limit indicated by the sign is 85 km / h, indicating that the vehicle's current speed does not exceed the speed limit and the driver does not need to slow down. In this case, the display control unit 150 can control the image element 80 in the track line image 51 to maintain movement at the baseline movement rate V0, or to move at a movement rate V4, where V4 is greater than V5 and V4 is less than V0.

[0120] It can be understood that the dotted boxes 1300 , 1400 and 1500 in Figures 13 to 15 are used to exemplarily represent the driving speed and speed limit signs in the solution. In the specific implementation process, these dotted boxes may not be displayed in area 5.

[0121] Regarding the technical solution shown in FIG. 7 , in some implementations, the road condition information includes the presence of other vehicles in the visible area ahead of the host vehicle and the distance between the host vehicle and the other vehicles. For example, when one or more of the radar 122 , the laser rangefinder 123 , and the camera 124 detects the presence of other vehicles ahead of the host vehicle, the host vehicle's speed may be reduced to mitigate driving risks. Furthermore, the closer the distance between the host vehicle and the other vehicle, the greater the required speed reduction.

[0122] Corresponding to the presence of other vehicles in the visible area in front of the vehicle and the distance between the vehicle and the other vehicles, referring to FIG. 16 , the controlling of the moving rate of the movable fragmented image elements according to the road condition information ahead includes steps S1601 to S1603 .

[0123] In step S1601 , the distance between the host vehicle and other vehicles in the visible area in front of the host vehicle is compared with a first distance threshold.

[0124] In step S1602 , when the distance between the host vehicle and other vehicles in the visible area in front of the host vehicle is greater than or equal to a first distance threshold, the moving speed of the movable fragmented image elements is controlled to be a fifth moving speed.

[0125] In step S1603, when the distance between the host vehicle and other vehicles in the visible area ahead of the host vehicle is less than a first distance threshold, the movement rate of the movable fragmented image element is controlled to be a sixth movement rate, wherein the fifth movement rate is greater than the sixth movement rate and less than the baseline movement rate.

[0126] In some examples, referring to Figures 17 to 20 , consider the case where another vehicle 1702 is located to the right of the visible area ahead of host vehicle 1701, as indicated by the arrow. The driver can observe other vehicle 1702 through windshield 204. At this point, one or more of the radar 122, laser rangefinder 123, and camera 124 in the host vehicle can sense vehicle 1702 and obtain the distance D between host vehicle 1701 and other vehicle 1702. Upon sensing other vehicle 1702, display control unit 150 can control image element 80 in trackline image 51 to move at a speed less than a reference speed V0. This speed can be correlated to distance D between host vehicle 1701 and other vehicle 1702. In a specific implementation, a first distance threshold, such as 80 meters, can be set to distinguish between the distance between host vehicle 1701 and other vehicle 1702, as shown in Figure 17 . When D is greater than the first distance threshold, indicating that the distance between the host vehicle 1701 and the other vehicle 1702 is relatively far, the display control unit 150 may control the image element 80 in the trackline image 51 to move at a movement rate V6 less than V0, as shown in FIG18 . As shown in FIG19 , when D is less than the first distance threshold, indicating that the distance between the host vehicle 1701 and the other vehicle 1702 is relatively close, the display control unit 150 may control the image element 80 in the trackline image 51 to move at a movement rate V7 less than V6, as shown in FIG20 .

[0127] As the distance D between the host vehicle 1701 and the other vehicle 1702 gradually decreases, the host vehicle 1701 gradually approaches the other vehicle 1702. As shown in FIG21 , when D is less than another set second distance threshold, such as 20 meters, it can be considered that the host vehicle 1701 and the other vehicle 1702 are too close. To provide a more intuitive display to the driver, in some examples, the method further includes:

[0128] When the distance between the vehicle and other vehicles in the visible area ahead of the vehicle is less than a second distance threshold, the track line image shape is modified to a navigation arrow shape, and the movement speed of the image elements within the navigation arrow is controlled to be the minimum movement speed.

[0129] In the above example, the second distance threshold is less than the first distance threshold. When D is less than the second distance threshold, as shown in FIG22 , the display control unit 150 controls the shape of the track line image 51 to change to a navigation arrow, with the direction of the navigation arrow still corresponding to the direction of the driving track. Furthermore, the display control unit 150 controls the movement rate of the image element filled in the navigation arrow to the minimum movement rate Vmin, that is, the movement rate of the image element filled in the navigation arrow is less than the movement rate mentioned in any of the aforementioned examples or implementations of this disclosure.

[0130] Based on the implementation shown in FIG16 , in order to use the track line image to identify other vehicles 1702 in front of the vehicle 1701 to alert the driver, and avoid using separate marking symbols for identification, in some examples, the method provided by the present disclosure further includes:

[0131] When the track line image extends to the rear of another vehicle in the visible area in front of the own vehicle, the track line image portion starting from the rear of the other vehicle is branched to form two track line branches.

[0132] It should be noted that, in the driver's field of view, the track line image usually extends forward a certain distance. If other vehicles are outside this distance, the track line image cannot extend to the tail of other vehicles, and there is no need to perform branch processing. The present disclosure sets the maximum distance that the track line image extends forward as the third distance threshold. In addition, when other vehicles are in front of the vehicle but will not affect the normal driving of the vehicle, there is no need to mark them to remind the driver of the vehicle. For example, when other vehicles are in other lanes, they will not affect the normal driving of the vehicle. For example, when the projections of other vehicles in the driving direction do not overlap with the projections of the vehicle in the driving direction, it will not affect the normal driving of the vehicle. Based on this, the present disclosure provides an exemplary implementation of the above-mentioned branch processing, as shown in Figure 23, which includes steps S2301 to S2304.

[0133] In step S2301, when the distance between the host vehicle and the other vehicle is greater than the second distance threshold and less than the third distance threshold, the distance between the central axis of the host vehicle and the central axis of the other vehicle is obtained.

[0134] In step S2302, when the distance between the central axis of the own vehicle and the central axis of the other vehicles is less than a fourth distance threshold, the numbers of image elements filled in the two track line branches are controlled to be approximately the same.

[0135] In step S2303, when the distance between the central axis of the vehicle and the central axis of other vehicles is greater than the fourth distance threshold and less than the fifth distance threshold, the number of image elements filled in the first trajectory branch of the two trajectory branches is controlled to be greater than the number of image elements filled in the second trajectory branch, wherein the first trajectory branch is the trajectory branch close to the vehicle and the second trajectory branch is the trajectory branch away from the vehicle.

[0136] In step S2304, when the distance between the central axis of the own vehicle and the central axis of the other vehicles is greater than the fifth distance threshold, the track line image is kept as a whole without being divided.

[0137] For the above example and its implementation, specifically referring to Figure 24 , a vehicle coordinate system is established with the host vehicle as the reference. This coordinate system adopts a right-handed coordinate system. In this coordinate system, the positive direction of the X-axis is the direction facing the host vehicle's front end, the positive direction of the Y-axis is the direction along the host vehicle's width pointing to the left, and the positive direction of the Z-axis is the height of the host vehicle. Based on these three coordinate axes, three planes are formed with the projection of the host vehicle's front center on the ground as the origin. Plane XOY is the ground, plane YOZ is a plane parallel to the host vehicle's front end, and plane XOZ is a plane passing through the centers of the front and rear ends of the vehicle and perpendicular to the ground.

[0138] Taking the XOY plane as an example, see Figure 25, set the upper limit of the road width to L, the central axis O1 of the vehicle 1701 is on the X axis, and the central axis O2 of other vehicles 1702, when the distance between the vehicle 1701 and other vehicles 1702 is greater than the second distance threshold (such as 20m) and less than the third distance threshold (such as 80m), as shown in the dotted box in Figure 25, the range 2501 can be used to determine whether other vehicles 1702 affect the normal driving of the vehicle 1701 by using the distance D1 between O1 and O2. As shown in Figure 25, the fourth distance threshold is one-sixth of the vehicle width W1 of the vehicle 1701, and the fifth distance threshold is one-half of the vehicle width W1 of the vehicle 1701. Based on this setting, the above range 2501 can be divided into five areas according to the distance D1 between O1 and O2, among which the interval 1 corresponding to the dot-filled area A1 is The interval 2 corresponding to the cross-line filled area A2 is The interval 3 corresponding to the area A3 filled with oblique lines is The interval 4 corresponding to the light gray filled area A4 is The interval 5 corresponding to the dark gray filled area A5 is

[0139] In conjunction with Figure 25, when the distance D1 between O2 and O1 is less than At this time, O2 is in area A1, and vehicle 1702 is approximately directly in front of vehicle 1701. In this case, as shown in Figures 26(A) and 26(B), the display control unit 150 controls the track line image 52 to extend to vehicle 1702 and then branch it, forming two track line branches. The display control unit 150 controls the number of image elements filled in the two track line branches to be approximately the same. The driver can perceive that vehicle 1702 is approximately directly in front of vehicle 1701 by observing the number of image elements in each branch.

[0140] When the distance D1 between O2 and O1 is greater than and less than When , O2 may be in area A2 or A3.

[0141] In some implementations, when O2 is in A2, from the driver's perspective, vehicle 1702 is on the right side of the host vehicle 1701 and is closer to the host vehicle. In this case, as shown in FIG27(A), the display control unit 150 controls the track line image 52 to extend to the vehicle 1702 and then perform branching processing to form two track line branches. The display control unit 150 controls the number of image elements filled in the track line branch close to the host vehicle (i.e., the track line branch on the left side of the vehicle 1702's travel direction) of the two track line branches to be greater than the number of image elements filled in the track line branch away from the host vehicle (i.e., the track line branch on the right side of the vehicle 1702's travel direction). In some examples, as shown in FIG27(B), the ratio of the number of image elements filled in the track line branch close to the host vehicle to the number of image elements filled in the track line branch away from the host vehicle is 3:1.

[0142] In some implementations, when O2 is in A3, from the driver's perspective, vehicle 1702 is on the left side of the host vehicle 1701 and is closer to the host vehicle. In this case, as shown in FIG28(A), the display control unit 150 controls the track line image 52 to extend to the vehicle 1702 and then perform branching processing to form two track line branches. The display control unit 150 controls the number of image elements filled in the track line branch close to the host vehicle (i.e., the track line branch on the right side of the vehicle 1702's travel direction) of the two track line branches to be greater than the number of image elements filled in the track line branch away from the host vehicle (i.e., the track line branch on the left side of the vehicle 1702's travel direction). In some examples, as shown in FIG28(B), the ratio of the number of image elements filled in the track line branch close to the host vehicle to the number of image elements filled in the track line branch away from the host vehicle is 3:1.

[0143] When the distance D1 between O2 and O1 is greater than , O2 may be in area A4 or A5. When O2 is in A4, from the driver's perspective, vehicle 1702 is on the right side of host vehicle 1701 and relatively far away from host vehicle 1701. When O2 is in A5, from the driver's perspective, vehicle 1702 is on the left side of host vehicle 1701 and relatively far away from host vehicle 1701. In this case, as shown in FIG29 , since vehicle 1702 is relatively far away from host vehicle 1701 and does not affect the driving of host vehicle 1701, the display control unit 150 still maintains the track line image 52 intact without dividing it into branches.

[0144] In order to enhance the AR display effect of the track line image filled with image elements disclosed in the aforementioned technical solution. Referring to Figure 30, the optical path component 162 in the display unit 160 shown in the present disclosure can reflect the output of the light source 161 in the form of two light paths (such as the light paths L-1 and L-2 in Figure 30) onto the windshield 204, and form two projection surfaces 41-A and 41-B in front of the vehicle, wherein the distance between the projection surface 41-A and the driver's viewpoint is 5m to 7m, which is referred to as the near focal plane. The distance between the projection surface 41-B and the driver's viewpoint is 12m to 17m, which is referred to as the far focal plane. The display control unit 150 can also control the display unit 160 to display the formed virtual image 40 on the near focal plane and / or the far focal plane, so that the track line image filled with image elements provided in the aforementioned technical solution of the present disclosure produces an AR display effect.

[0145] In some examples, when another vehicle approaches too closely, the trackline image is modified to a pilot arrow shape, and the movement rate of the image elements within the pilot arrow is controlled to a minimum. To enhance driver perception, the pilot arrow-shaped trackline image and the image elements within the pilot arrow can be displayed on the near-focus plane, i.e., projection surface 41-A. Furthermore, the various trackline image formats shown in the aforementioned technical solutions can all be displayed on the far-focus plane, i.e., projection surface 41-B.

[0146] Based on the same inventive concept as the above technical solutions, referring to FIG31 , a display control device 310 provided by the present disclosure is shown. The device 310 may be the display control unit shown in FIG1 , FIG4 , or FIG30 . The device 310 includes: a filling part 3101 , an acquisition part 3102 , and a control part 3103 ; wherein,

[0147] The filling part 3101 is configured to fill the track line image with movable fragmented image elements, wherein the moving direction of the image elements is consistent with the extending direction of the track line image;

[0148] The acquisition part 3102 is configured to acquire information about the road condition ahead of the vehicle;

[0149] The control part 3103 is configured to control the moving speed of the movable fragmented image elements according to the front road condition information.

[0150] In some examples, the forward road condition information includes road congestion status information within a set distance ahead of the vehicle; accordingly, the control portion 3103 is configured to:

[0151] determining a congestion level based on the road congestion information within a set distance ahead of the vehicle;

[0152] When the congestion level is a first congestion level, controlling the moving speed of the movable fragmented image element to be a first moving speed;

[0153] When the congestion state level is a second congestion state level having a higher congestion degree than that corresponding to the first congestion state level, the moving speed of the movable fragmented image element is controlled to be a second moving speed; wherein the second moving speed is less than the first moving speed.

[0154] In some examples, the control portion 3103 is further configured to:

[0155] When the road ahead is clear, the moving speed of the movable fragmented image elements is controlled to be a reference moving speed.

[0156] In some examples, the control portion 3103 is further configured to:

[0157] A track line image filled with image elements having a moving rate of the first moving rate, the second moving rate, or the reference moving rate is displayed through the far focus plane.

[0158] In some examples, the forward road condition information includes information that a speed limit is required ahead of the vehicle; accordingly, the control portion 3103 is configured to:

[0159] Comparing the current speed of the vehicle with the upper speed limit indicated by the information requiring speed limit;

[0160] When the current speed of the host vehicle is less than or equal to the speed upper limit value, controlling the moving speed of the movable fragmented image element to be a third moving speed;

[0161] When the current driving speed of the vehicle is greater than the speed upper limit value, the moving rate of the movable fragmented image element is controlled to be a fourth moving rate; wherein the fourth moving rate is less than the third moving rate and less than the benchmark moving rate.

[0162] In some examples, the control portion 3103 is further configured to:

[0163] A track line image filled with image elements moving at the third moving rate or the fourth moving rate is displayed through the far focus plane.

[0164] In some examples, the forward road condition information includes the presence of other vehicles in the visible area ahead of the vehicle and the distance between the vehicle and the other vehicles; accordingly, the control portion 3103 is configured to:

[0165] Comparing the distance between the host vehicle and other vehicles in the visible area ahead of the host vehicle with a first distance threshold;

[0166] When the distance between the host vehicle and the other vehicle is greater than or equal to a first distance threshold, controlling the moving speed of the movable fragmented image element to be a fifth moving speed;

[0167] When the distance between the host vehicle and the other vehicle is less than a first distance threshold, the moving speed of the movable fragmented image element is controlled to be a sixth moving speed, wherein the fifth moving speed is greater than the sixth moving speed and less than a base moving speed.

[0168] In some examples, the control portion 3103 is further configured to:

[0169] A track line image filled with image elements moving at the fifth moving rate or the sixth moving rate is displayed through the far focus plane.

[0170] In some examples, the control portion 3103 is further configured to:

[0171] When the distance between the host vehicle and the other vehicle is less than a second distance threshold, the shape of the track line image is modified to a navigation arrow shape, and the moving speed of the image element within the navigation arrow is controlled to be the minimum moving speed.

[0172] In some examples, the control portion 3103 is further configured to:

[0173] The track line graphic in the shape of the navigation arrow and the image elements within the navigation arrow are displayed through the near focus plane.

[0174] In some examples, the control portion 3103 is further configured to:

[0175] When the track line image extends to the rear of another vehicle in the visible area in front of the host vehicle, branch processing is performed on the track line image portion starting from the rear of the other vehicle to form two track line branches.

[0176] In some examples, the control portion 3103 is further configured to:

[0177] When the distance between the host vehicle and the other vehicle is greater than a second distance threshold and less than a third distance threshold, obtaining a distance between a central axis of the host vehicle and a central axis of the other vehicle;

[0178] When the distance between the central axis of the host vehicle and the central axis of the other vehicle is less than a fourth distance threshold, controlling the numbers of image elements filled in the two track line branches to be approximately the same;

[0179] When the distance between the central axis of the host vehicle and the central axis of the other vehicle is greater than a fourth distance threshold and less than a fifth distance threshold, controlling the number of image elements filled in a first track branch of the two track branches to be greater than the number of image elements filled in a second track branch, wherein the first track branch is a track branch close to the host vehicle and the second track branch is a track branch away from the host vehicle;

[0180] When the distance between the central axis of the host vehicle and the central axis of the other vehicle is greater than a fifth distance threshold, the track line image is kept as a whole without being divided.

[0181] In some examples, the control portion 3103′ is further configured to:

[0182] A track line image with two track line branches and the image elements filled in the track line image with two track line branches are displayed through a far focus plane.

[0183] Referring to Figure 32, a block diagram of a display control device 310 according to an exemplary embodiment of the present disclosure is shown. In some examples, the display control device 310 has communication capabilities and can access a wired or wireless network. In some examples, the display control device 310 can receive data based on the accessed wired or wireless network. It is understood that the display control device 310 is responsible for the computation and processing of the technical solution of the present disclosure, and this disclosure does not limit this.

[0184] As shown in FIG. 32 , the display control device 310 in the present disclosure may include one or more of the following components: a processor 3210 and a memory 3220 .

[0185] Optionally, the processor 3210 utilizes various interfaces and lines to connect various parts of the entire computing device, and performs various functions of the computing device and processes data by running or executing instructions, programs, code sets, or instruction sets stored in the memory 3220, and calling data stored in the memory 3220. Optionally, the processor 3210 can be implemented in at least one hardware form of digital signal processing (DSP), field-programmable gate array (FPGA), and programmable logic array (PLA). The processor 3210 can integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), a neural network processing unit (NPU), and a baseband chip. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing the content required to be displayed on the touch screen; the NPU is used to implement artificial intelligence (AI) functions; and the baseband chip is used to handle wireless communications. It is understandable that the above-mentioned baseband chip may not be integrated into the processor 3210, but may be implemented by a separate chip.

[0186] The memory 3220 may include a random access memory (RAM) or a read-only memory (ROM). Optionally, the memory 3220 includes a non-transitory computer-readable storage medium. The memory 3220 may be used to store instructions, programs, codes, code sets, or instruction sets. The memory 3220 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above various method embodiments, etc.; the data storage area may store data created according to the use of the display control device 310, etc.

[0187] In addition, those skilled in the art will understand that the structure of the display control device 310 shown in the above figures does not constitute a limitation of the display control device 310. The display control device 310 may include more or fewer components than shown, or may combine certain components, or arrange the components differently. For example, the display control device 310 also includes a display screen, a camera assembly, a microphone, a speaker, a radio frequency circuit, an input unit, sensors (such as an accelerometer, an angular velocity sensor, a light sensor, etc.), an audio circuit, a WiFi module, a power supply, a Bluetooth module, and other components, which will not be detailed here.

[0188] The present disclosure also provides a computer-readable storage medium storing at least one instruction, wherein the at least one instruction is used to be executed by a processor to implement the display control method described in the above embodiments.

[0189] The present disclosure also provides a computer program product, which includes computer instructions stored in a computer-readable storage medium; a processor of a computing device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computing device executes to implement the display control method described in each of the above embodiments.

[0190] Those skilled in the art will appreciate that in one or more of the above examples, the functions described in this disclosure can be implemented using hardware, software, firmware, or any combination thereof. When implemented using software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or codes on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein communication media include any media that facilitates the transmission of computer programs from one place to another. The storage medium can be any available medium that can be accessed by a general-purpose or special-purpose computer.

[0191] It should be noted that the technical solutions described in this disclosure can be combined arbitrarily without conflict.

[0192] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any modifications or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in the present invention should be included in the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be based on the scope of protection of the claims. Industrial Applicability

[0193] In this disclosure, movable fragmented image elements are inserted into the track image, and the movement speed of the image elements is controlled according to the road conditions ahead. This allows the driver to control the vehicle's speed based on the perceived movement speed of the image elements. This reduces the driver's thinking burden and improves safety in complex driving environments.

Claims

1. A display control method, characterized in that: The method comprises: Filling movable fragmented image elements in the track line image, wherein the moving direction of the image elements is consistent with the extending direction of the track line image; Obtaining the road condition information ahead of the vehicle; The moving speed of the movable fragmented image element is controlled according to the front road condition information.

2. The method according to claim 1, characterized in that The road condition information ahead includes road congestion status information within a set distance ahead of the vehicle; accordingly, controlling the moving rate of the movable fragmented image element according to the road condition information ahead includes: Determining a congestion level according to the road congestion information within a set distance ahead of the vehicle; When the congestion state level is a first congestion state level, controlling the moving speed of the movable fragmented image element to be a first moving speed; When the congestion state level is a second congestion state level having a higher congestion degree than that corresponding to the first congestion state level, a moving speed of the movable fragmented image element is controlled to be a second moving speed; wherein the second moving speed is less than the first moving speed.

3. The method according to claim 2, characterized in that The method further includes: when the road ahead is unobstructed, controlling the moving speed of the movable fragmented image elements to be a reference moving speed.

4. The method according to claim 3, characterized in that: The method further includes: displaying, through a far focus plane, a track line image filled with image elements whose moving speed is the first moving speed, the second moving speed, or the reference moving speed.

5. The method according to claim 1, characterized in that The road condition information ahead includes information about the speed limit required ahead of the vehicle; accordingly, controlling the moving speed of the movable fragmented image element according to the road condition information ahead includes: Compare the current speed of the vehicle with the upper speed limit indicated by the information requiring speed limit; When the current driving speed of the host vehicle is less than or equal to the speed upper limit value, controlling the moving speed of the movable fragmented image element to be a third moving speed; When the current driving speed of the vehicle is greater than the speed upper limit value, the moving speed of the movable fragmented image element is controlled to be a fourth moving speed; wherein the fourth moving speed is less than the third moving speed and less than the benchmark moving speed.

6. The method according to claim 5, characterized in that The method further comprises: The track line image filled with image elements whose moving speed is the third moving speed or the fourth moving speed is displayed through the far focus plane.

7. The method according to claim 1, characterized in that The road condition information ahead includes other vehicles in a visible area ahead of the vehicle and a distance between the vehicle and the other vehicles; accordingly, controlling the moving rate of the movable fragmented image elements according to the road condition information ahead includes: Comparing the distance between the host vehicle and other vehicles in the visible area in front of the host vehicle with a first distance threshold; When the distance between the host vehicle and the other vehicle is greater than or equal to a first distance threshold, controlling the moving speed of the movable fragmented image element to be a fifth moving speed; When the distance between the host vehicle and the other vehicles is less than a first distance threshold, the moving speed of the movable fragmented image element is controlled to be a sixth moving speed; wherein the fifth moving speed is greater than the sixth moving speed and less than a benchmark moving speed.

8. The method according to claim 7, characterized in that The method further includes: displaying, through a far focus plane, a track line image filled with image elements whose moving speed is the fifth moving speed or the sixth moving speed.

9. The method according to claim 7, characterized in that: The method further comprises: When the distance between the host vehicle and the other vehicles is less than a second distance threshold, the track line image shape is modified to a navigation arrow shape, and the moving speed of the image elements within the navigation arrow is controlled to be the minimum moving speed; the second distance threshold is less than the first distance threshold.

10. The method according to claim 9, characterized in that The method further comprises: displaying a track line graphic in the shape of the pilot arrow and an image element within the pilot arrow through a near focus plane.

11. The method according to claim 1 or 7, characterized in that: The method further includes: when the track line image extends to the rear of another vehicle in the visible area in front of the host vehicle, branching processing is performed on the track line image portion starting from the rear of the other vehicle to form two track line branches.

12. The method according to claim 11, characterized in that The method further comprises: When the distance between the host vehicle and the other vehicle is greater than a second distance threshold and less than a third distance threshold, obtaining a distance between a central axis of the host vehicle and a central axis of the other vehicle; When the distance between the central axis of the host vehicle and the central axis of the other vehicle is less than a fourth distance threshold, controlling the numbers of image elements filled in the two track line branches to be approximately the same; When the distance between the center axis of the host vehicle and the center axis of the other vehicle is greater than a fourth distance threshold and less than a fifth distance threshold, controlling the number of image elements filled in a first track branch of the two track branches to be greater than the number of image elements filled in a second track branch, wherein the first track branch is a track branch close to the host vehicle, and the second track branch is a track branch away from the host vehicle; When the distance between the central axis of the host vehicle and the central axis of the other vehicle is greater than the fifth distance threshold, the track line image is kept as a whole without being divided.

13. The method according to claim 11, characterized in that The method further comprises: A track line image with two track line branches and the image elements filled in the track line image with two track line branches are displayed through a far focal plane.

14. A display control device, characterized in that: The device comprises: a filling part, an acquisition part and a control part; wherein, The filling part is configured to fill movable fragmented image elements in the track line image, and the moving direction of the image elements is consistent with the extending direction of the track line image; The acquisition part is configured to acquire the road condition information ahead of the vehicle; The control part is configured to control the moving speed of the movable fragmented image elements according to the front road condition information.

15. A display control device, characterized in that: The device comprises: a processor and a memory; the processor is used to execute instructions stored in the memory to implement the display control method according to any one of claims 1 to 13.

16. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores at least one instruction, and the at least one instruction is used to be executed by a processor to implement the display control method according to any one of claims 1 to 13.

17. A head-up display device, characterized in that: The head-up display device includes a display control unit and a display unit; wherein, The display control unit is configured to fill movable fragmented image elements in the track line image, and the moving direction of the image elements is consistent with the extending direction of the track line image; and obtaining road condition information ahead of the vehicle; and, controlling the moving speed of the movable fragmented image elements according to the front road condition information; The display unit is configured to project the track line image and the image elements onto a windshield of the vehicle for display based on the control of the display control unit.

18. A vehicle, characterized in that: The vehicle includes the head-up display device according to claim 17.

Citation Information

Patent Citations

  • Navigation information processing method and device and virtual reality head-up display device

    CN108759854A

  • Dynamic display method and device for vehicle-mounted AR navigation

    CN108896067A

  • Driving guide processing method and device, electronic equipment and storage medium

    CN113815415A

  • Vehicle display control device, display method, and storage medium

    CN115648938A

  • Navigation information display method, head-up display device, carrier and storage medium

    CN115857168A