Head-up display device and prompting method

Abstract

The application relates to a head-up display device and a prompting method, the prompting method comprising determining a corresponding prompting mode according to driving-related information; and prompting the driving-related information according to the determined prompting mode. According to the scheme, the driving-related information can be prompted according to the corresponding prompting mode of the driving-related information, and the prompting effect of the driving-related information is improved.

Description

Technical Field

[0001] This application relates to the field of computers, and more particularly to a head-up display device and a prompting method. Background Technology

[0002] Currently, by displaying the light emitted from the image source of a head-up display (HUD) onto an imaging window (such as an aftermarket imaging panel or the vehicle's windshield), users can see the image directly without looking down, thus improving the user experience. For example, in some situations, it can prevent drivers from being distracted by looking down at the instrument panel while driving, thereby improving driving safety and providing a better driving experience. Summary of the Invention

[0003] According to a first aspect of this application, a prompting method is provided, wherein the method is applied in a virtual image display device, the method comprising:

[0004] Determine the appropriate prompting method based on driving-related information;

[0005] The driving-related information will be prompted according to the determined prompting method.

[0006] According to a second aspect of this application, a prompting device is provided, comprising:

[0007] The determination module is configured to determine the appropriate prompting method based on driving-related information.

[0008] The prompting module is configured to provide prompts for the driving-related information according to a determined prompting method.

[0009] According to a third aspect of this application, a non-transitory computer storage medium is provided, which stores a computer program that, when executed by a plurality of processors, causes the processors to perform the prompting method described in the first aspect.

[0010] According to a fourth aspect of this application, an electronic device is provided, comprising:

[0011] Processor; and

[0012] The memory stores computer instructions that, when executed by the processor, cause the processor to perform the prompting method described in the first aspect.

[0013] According to a fifth aspect of this application, a head-up display device is provided, wherein the head-up display device is used to perform the prompting method described in the first aspect, the head-up display device comprising: an image source device and a light control device;

[0014] The image source device is configured to emit image light to the light control device, and the light control device is configured to change the emission direction of the image light so that the image light is reflected to the imaging device to form a viewable image.

[0015] According to a sixth aspect of this application, a means of transportation is provided, comprising a prompting device as described in the second aspect, an electronic device as described in the fourth aspect, or a head-up display device as described in the fifth aspect.

[0016] For example, in embodiments of the first to sixth aspects of this application, the driving-related information includes navigation data from a navigation system, and the step of prompting the driving-related information according to the determined prompting method includes: prompting the navigation data in a visual display manner at a first time point; and / or prompting the navigation data in a voice playback manner at a second time point; wherein the second time point is different from the first time point.

[0017] For example, in embodiments of the first to sixth aspects of this application, the first time node and / or the second time node are at least ahead of a predetermined prompt time node of the navigation system, at which the navigation system prompts the navigation data.

[0018] For example, in embodiments of the first to sixth aspects of this application, the driving-related information includes vehicle takeover information and / or vehicle braking information from the driver assistance system, and the step of prompting the driving-related information according to the determined prompting method includes: at a third time node, prompting the vehicle takeover information and / or vehicle braking information by displaying the information on a screen; and / or at a fourth time node, prompting the vehicle takeover information and / or vehicle braking information by playing the information on a voice; wherein the fourth time node is different from the third time node.

[0019] For example, in embodiments of the first to sixth aspects of this application, the driving-related information includes driving control behavior prediction information from the driver assistance system, and the step of prompting the driving-related information according to the determined prompting method includes:

[0020] At least five time points before the execution time point, the driving control behavior prediction information is prompted by visual display and / or voice playback, wherein the execution time point is the time point at which the control behavior indicated by the driving control behavior prediction information is executed.

[0021] For example, in embodiments of the first to sixth aspects of this application, where the driving-related information includes at least one of the vehicle takeover information, the vehicle braking information, and the driving control behavior prediction information, before prompting the driving-related information according to the determined prompting method, the method further includes:

[0022] Display at least one of the following information on the vehicle: vehicle speed, gear position, driving mode, and blind spot monitoring system.

[0023] The step of prompting the driving-related information according to the determined prompting method further includes: prompting the event information associated with the driving-related information by means of visual display and / or voice playback, wherein the event information includes user status information and / or road condition information that leads to taking over the vehicle, braking the vehicle and / or executing the control behavior indicated by the prediction information.

[0024] For example, in embodiments of the first to sixth aspects of this application, where the driving-related information includes vehicle takeover information, after prompting the driving-related information according to the determined prompting method, the method further includes:

[0025] If no user intervention is detected in the vehicle equipped with the virtual image display device within a preset time interval, the vehicle is controlled to decelerate and / or brake.

[0026] For example, in the embodiments of the first to sixth aspects of this application, the driving-related information includes multiple external prompts from the external environment, and the prompting of the driving-related information according to the determined prompting method includes: prompting the multiple external prompts by means of visual display and / or voice playback.

[0027] For example, in the embodiments of the first to sixth aspects of this application, the step of prompting the plurality of external prompts by means of screen display and / or voice playback includes: sorting the plurality of external prompts according to a predetermined priority list, and prompting at least one of the plurality of external prompts according to the sorting result.

[0028] For example, in embodiments of the first to sixth aspects of this application, wherein the driving-related information includes information from other vehicles, and the step of prompting the driving-related information according to the determined prompting method includes:

[0029] The information from other vehicles is displayed visually and / or played back verbally; and / or an action is determined based on the information from other vehicles, and the information for the action is displayed visually and / or played back verbally.

[0030] For example, in the embodiments of the first to sixth aspects of this application, the virtual image display device is installed in a vehicle with an autonomous driving level less than or equal to a target autonomous driving level, the target autonomous driving level supporting both autonomous driving mode and manual driving mode.

[0031] For example, in the embodiments of the first to sixth aspects of this application, the step of determining the corresponding prompting method based on driving-related information includes:

[0032] When the driving-related information is target information, the driving-related information is prompted at two different time points. The target information is used to instruct the vehicle equipped with the virtual image display device to switch between autonomous driving mode and manual driving mode.

[0033] If the driving-related information is not the target information, the driving-related information will be prompted at a single time point.

[0034] For example, in embodiments of the first to sixth aspects of this application, the time interval between the two different time points is determined based on road conditions associated with user status information and / or the driving-related information. Attached Figure Description

[0035] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings, without exceeding the scope of protection claimed by this application.

[0036] Figure 1 This is a schematic diagram of the structure of a head-up display device according to the prior art.

[0037] Figure 2 This is a schematic diagram of the structure of a head-up display device according to an embodiment of this application.

[0038] Figure 3 This is a flowchart of the prompting method according to an embodiment of this application.

[0039] Figure 4 This is a schematic diagram of a prompting device according to an embodiment of this application.

[0040] Figure 5This is a structural diagram of an electronic device provided in this application. Detailed Implementation

[0041] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0042] In this embodiment, ADAS (Advanced Driving Assistance System) utilizes various sensors installed on the vehicle to continuously sense the surrounding environment during driving, collect data, identify, detect, and track static and dynamic objects, and combine this data with navigation map data for system calculation and analysis. This allows the driver to anticipate potential dangers, effectively increasing driving comfort and safety. The sensors used in ADAS mainly include cameras, radar, lasers, and ultrasonic sensors, which can detect light, heat, pressure, or other variables used to monitor the vehicle's status. These sensors can be located in the front and rear bumpers, side mirrors, steering wheel, or windshield.

[0043] During the research process, the inventors of this application discovered that due to the delay between the driver noticing the HUD's reminder information and responding, the effect of using the HUD to remind the user is poor in some situations, and therefore the reminder effect urgently needs to be improved.

[0044] In some embodiments of this application, HUD assists ADAS in displaying corresponding driving-related information (such as road condition information and / or vehicle condition information), and provides prompts for driving-related information according to the prompting method corresponding to the driving-related information, thereby improving the prompting effect of driving-related information and thus improving driving safety.

[0045] Furthermore, in this application's solution, the light emitted from the HUD's image source is projected onto the imaging window (an aftermarket imaging panel or the vehicle's windshield, etc.), allowing the user to see the image directly without looking down. Moreover, compared to traditional HUDs, the HUD proposed in this application has a larger display panel, capable of displaying more information, especially driving-related information. Presenting the driver with more driving-related information facilitates driver takeover when switching from autonomous driving mode to driver control mode, improving the accuracy and efficiency of the takeover. Furthermore, the HUD in this application can acquire various information from ADAS (especially driving-related information). After acquiring this information, the HUD does not directly project it but processes it before displaying and prompting the driver, facilitating driver takeover of the vehicle.

[0046] Figure 1 This is a schematic diagram of a head-up display device according to the prior art. As shown in Figure 1, in the prior art, the process of displaying information in a head-up display device is as follows: a flat mirror reflects the light emitted from the image source to a curved mirror, the curved mirror reflects the light through a light outlet onto the windshield, and the driver, looking from the eye box position, can see a virtual image formed in front of the windshield (i.e., ...) through the windshield. Figure 1 The information in the image (of the image).

[0047] The eyebox refers to the area where the driver's eyes are located, where they can see the virtual image of the head-up display (HUD). The eyebox area has a certain size, and even if the driver's eyes are offset from the center of the eyebox by a certain distance, such as moving up and down or left and right, as long as they remain within the eyebox area, they can see the virtual image of the HUD. However, existing HUDs have small display panels and display limited content.

[0048] In response to the above problems, Figure 2 This is a schematic diagram of the structure of a head-up display device according to an embodiment of this application. Figure 2As shown, the head-up display device proposed in this application includes an image source device 11, a light control device 12, and an information processing device 14. The information processing device 14 sends information to the image source device 11. The image source device 11 can be installed inside a vehicle, while the light control device 12 can be installed on the vehicle's center console (e.g., on a surface opposite the windshield 10). The image source device 11 is configured to emit image light to the light control device 12 (e.g., the image light emitted by the image source device 11 is reflected by the windshield 10 and then incident on the light control device 12). The light control device 12 is configured to change the exit direction of the image light emitted by the image source device (i.e., change the direction of the image light incident on it), so that the image light with the changed exit direction reaches the eye box 13 after being reflected by the windshield 10, thereby forming an image (i.e., a virtual image) that can be viewed by the user on the outside of the windshield 10. In this application, the image source device can be a liquid crystal display (LCD), a DLP projector (Digital Light Processing), or a projector, etc.

[0049] The size and shape of the light control device 12 are matched with the visible area of ​​the windshield, so that the light emitted by the image source device 11 is reflected by the light control device 12 onto the windshield and can present an image covering the visible area of ​​the windshield.

[0050] Compared with the prior art, the head-up display device of this application has a smaller display panel, resulting in a smaller displayed image. In contrast, the head-up display device of this application emits light capable of displaying an image covering the visible area of ​​the windshield, thus allowing for a larger display panel. The term "coverage" means that an observer can see an image at the windshield location that is the same size as or slightly smaller than the visible area of ​​the windshield through the eye-box area; from the observer's perspective, the image appears to be presented on the windshield, but this does not mean the image is actually displayed on the windshield.

[0051] Compared with the prior art, the head-up display device of this application displays a larger screen, and the larger display panel can display more content, thereby showing users more driving-related information. Users can use more driving-related information to determine whether and how to take over, thereby improving the efficiency of takeover.

[0052] In some embodiments, the virtual image display device is a HUD device, whose imaging range is the same size as or slightly smaller than the visible area of ​​the vehicle's windshield. That is, an observer can see an image at the windshield position through the eye-box area that is the same size as or slightly smaller than the visible area of ​​the windshield. This HUD device can also be called a full-window HUD device. In some embodiments, this full-window HUD can replace traditional instrument panels to display routine vehicle status information, including vehicle speed, gear position, driving mode information, BSD (Blind Spot Detection) system, etc., thereby improving the convenience of information access for the user.

[0053] In some embodiments, this full-window HUD can replace traditional instrument panels and vehicle infotainment displays (such as the vehicle's central control screen). The full-window HUD can simultaneously display corresponding warning information and driving assistance information along with the vehicle's own prompts (such as warning sounds / steering wheel vibrations, or BSD lights in the left and right rearview mirrors). The warning information includes obstacle information, bad road information, bad weather information, etc., and the driving assistance information includes the vehicle's status while driving in the current lane (such as acceleration or deceleration) and changes in its relationship with adjacent vehicles (such as changes in distance). For example, the full-window HUD displaying warning information and driving assistance information can be understood as the full-window HUD displaying the corresponding information for the driver to view by displaying a UI screen.

[0054] In this application, the provided head-up display device can display more driving-related information, thereby improving the efficiency of driver takeover. To further improve the efficiency of driver takeover, this application also provides a prompting method and a prompting device.

[0055] Figure 3 This is a flowchart of a prompting method according to an embodiment of this application. For example... Figure 3 As shown, the method includes the following steps.

[0056] Step S301: Determine the corresponding prompting method based on driving-related information.

[0057] In some embodiments, the virtual image display device is installed in a vehicle with an autonomous driving level less than or equal to a target autonomous driving level. The target autonomous driving level supports both autonomous driving mode and manual driving mode. The virtual image display device can be a HUD device or AR glasses, etc., and the vehicle can be a vehicle. The target autonomous driving level can be Level 3 autonomous driving. Level 3 vehicles support both autonomous driving mode and manual driving mode; that is, Level 3 autonomous driving is conditional autonomous driving, where the vehicle can perform autonomous driving, but under certain conditions it needs to switch to manual driving by a driver.

[0058] In one embodiment, prior to step S301, the virtual image display device receives driving-related information. The received driving-related information may come from an Advanced Driver Assistance System (ADAS). The ADAS may be an Advanced Driver Assistance System. When the vehicle is in Advanced Driver Assistance mode, it can engage the corresponding autonomous driving mode. Since autonomous driving at Level 3 and above requires no user intervention, while autonomous driving at Level 3 and below requires user intervention, in some embodiments, the autonomous driving mode may be either Level 3 or a level below Level 3.

[0059] In autonomous driving mode, driving-related information can be obtained directly from ADAS. For example, the driver assistance system can acquire various information related to vehicle driving in real time, such as navigation information, warning information, accident information, driving assistance information, feedback information from other vehicles, etc., and send this information to the head-up display for display to the user (e.g., the driver).

[0060] In one embodiment, driving-related information can be obtained directly from ADAS, or it can be obtained by a virtual display device (such as HUD) after it has acquired detection data (such as vehicle distance, user status information, or road conditions) from various sensors (such as cameras, radar, lasers, or ultrasonic waves) and analyzed the detection data to obtain information such as takeover, braking, and behavior prediction.

[0061] In some embodiments, driving-related information includes all information related to the entire driving process, that is, any driving-related information from the start to the end of driving, such as the driver's state, road conditions, weather conditions, driving route, destination information, locations along the driving route, locations of interest to the driver during the driving process, or traffic scheduling information, or so on.

[0062] In some embodiments, different prompting methods can be used for different types of driving-related information. For example, for some driving-related information, such as navigation data, vehicle takeover information, vehicle braking information, and driving control behavior prediction information, prompts can be given at two different time points, and the content of the prompts at the two different time points is the same, such as "Left turn ahead" or "Please take over the vehicle." For other driving-related information, prompts can be given at a single time point. Furthermore, the time interval between the two different time points is determined based on the user's status information and / or the road conditions associated with the driving-related information. For example, if the driver's status is poor and / or the road conditions are complex, the time interval is set to be longer; if the driver's status is good and / or the road conditions are less complex, the time interval is set to be shorter.

[0063] Thus, step S301 may also include sub-step S3011 and / or sub-step S3012:

[0064] Sub-step S3011: When the driving-related information is target information, prompts are given on the driving-related information at two different time points. The target information is used to instruct the vehicle equipped with the virtual image display device to switch between autonomous driving mode and manual driving mode.

[0065] Sub-step S3012: If the driving-related information is not the target information, provide a prompt for the driving-related information at a single time point.

[0066] In some embodiments, the target information may include vehicle takeover information, which prompts the user to take over the vehicle, indicating that the vehicle needs to switch from autonomous driving mode to manual driving mode. Prompting the user (e.g., the driver) twice when the vehicle switches between autonomous driving and manual driving modes provides preparation time, significantly improving the effectiveness of the prompts and enhancing driving safety.

[0067] In some embodiments, the two different time points include a previous time point and a subsequent time point; at the previous time point, the target information is prompted in a first prompting manner; at the previous time point, the target information is prompted in a second prompting manner, wherein when both the first prompting manner and the second prompting manner are single prompting methods, the first prompting manner and the second prompting manner are different prompting methods, for example, the first prompting manner is a screen display method, and the second prompting manner is a voice playback method.

[0068] The head-up display (HUD) can display information received from the driver assistance system. Specifically, to facilitate driver takeover, the HUD's information processing equipment uses different methods to process different types of driving-related information.

[0069] In one embodiment, the head-up display (HUD) acquires navigation data from the navigation system installed in the vehicle to display corresponding navigation data. To improve the efficiency of human intervention and the driver's trust in the autonomous driving system, the navigation data is displayed a certain amount of time before the navigation system's prompt, for example, 10 or 15 seconds in advance. For instance, if the navigation data includes "the vehicle is turning left at the intersection ahead," normally the navigation system would send this data to the driver 5 seconds before the vehicle reaches the navigation point (this is just an example). However, in assisted driving mode, the HUD of this application will provide a navigation prompt 15 seconds in advance after acquiring the navigation data, allowing the driver time to react. The navigation data may include complex road condition data such as the vehicle reaching an accident / non-standard road section, and this application does not impose any limitations on this.

[0070] In one embodiment, the driver assistance system or virtual display device can also determine whether driver intervention and / or vehicle braking are required based on navigation data, driver status, traffic conditions, and other information. In this case, the head-up display device will display the corresponding vehicle intervention information and / or vehicle braking information, thereby providing the driver with the relevant information. Specifically, the vehicle intervention information is used to inform the driver of the reason for intervention (e.g., complex road conditions) and the actions required during intervention (e.g., deceleration), while the vehicle braking information is used to inform the driver of the reason for braking (e.g., vehicle malfunction) and the actions required during braking (e.g., braking and / or pulling over).

[0071] For example, when providing navigation prompts based on navigation data, the head-up display can also show a takeover prompt. The driver can then choose whether to enter the vehicle to take over. For vehicle takeover information and / or vehicle braking information, the corresponding prompts can be displayed visually or aloud. The timing of the visual and aloud prompts can differ, thus providing the driver with two separate prompts.

[0072] In this application, "screen display" can refer to displaying relevant information, such as specific navigation data or driving-related information, on the outside of the windshield of a vehicle, that is, displaying relevant information in a virtual image formed on the outside of the windshield; or it can refer to displaying relevant information, such as specific navigation data or driving-related information, in a virtual image formed on the windshield.

[0073] In one embodiment, the driver assistance system can predict vehicle control behavior based on navigation data, driver status, traffic conditions, and other information. The predicted behavior includes steering wheel rotation angle, vehicle acceleration / deceleration, or turn signal activation, forming vehicle driving control behavior prediction information which is then sent to the head-up display (HUD). Alternatively, the HUD can predict vehicle control behavior based on navigation data, driver status, traffic conditions, and other information. The predicted behavior includes steering wheel rotation angle, vehicle acceleration / deceleration, or turn signal activation, forming vehicle driving control behavior prediction information. The prediction information includes at least one of the following: steering wheel rotation information, vehicle gear shift information, and turn signal information. The HUD will then display the corresponding prediction information, visualizing the prediction of control behavior.

[0074] For example, when a vehicle is about to enter a deceleration zone, the driver assistance system / HUD device predicts that the vehicle will decelerate accordingly. At this time, the head-up display will show the corresponding prediction information, thus prompting the driver to perform the control action that is about to be taken. To facilitate the driver's anticipation of the upcoming control action, the information processing equipment of the head-up display can provide a warning before the actual control action occurs, for example, a warning can be given 1 second in advance. Therefore, for the vehicle driving control action prediction information, the corresponding warning method is to provide a warning at a preset time in advance.

[0075] In one embodiment, the driver assistance system / HUD device can also generate alerts for other vehicles based on navigation data, driver status, traffic conditions, and other information (e.g., issuing avoidance warnings to other vehicles when a vehicle has a problem). These alerts can be sent to other vehicles via, for example, V2V (Vehicle-to-Vehicle communication).

[0076] V2V is a type of intelligent connected vehicle technology. Its principle is to utilize the transmission unit on each vehicle to send signals via a high-speed wireless network. This information includes basic vehicle information, speed, direction, geographical location, and route, enabling communication between vehicles. Other vehicles in the vicinity receive this wireless information in real time and simultaneously send similar feedback from their own onboard units, forming an interactive information exchange process.

[0077] For the current driver's vehicle, the external prompts received include information from other vehicles and other external prompts, such as those sent by traffic authorities. These external prompts can come from multiple sources and contain various types of information. Multiple external prompts can be displayed visually and / or played aloud, and selective display is also possible, especially when these prompts appear simultaneously. The head-up display's information processing equipment prioritizes these external prompts according to their type. Information types can include warning information, accident information, traffic control information, and general interactive information. The priority of these types can be set from highest to lowest as follows: accident information, warning information, traffic control information, and general interactive information. When multiple external prompts appear, one or more are displayed based on their type and priority. Thus, the display method for external prompts is based on their priority.

[0078] Step S302: Provide prompts for the driving-related information according to the determined prompting method.

[0079] First, for navigation data, the corresponding prompting method is to prompt the navigation data in advance through the navigation system. Thus, step S302 includes sub-steps S3021 and / or S3022.

[0080] Sub-step S3021: At the first time point, the navigation data is displayed on the screen.

[0081] In sub-step S30222, at the second time node, the navigation data is prompted by voice playback.

[0082] In one embodiment, the head-up display (HUD) provides navigation data prompts by acquiring navigation data from the vehicle's onboard navigation system. To improve the efficiency of human intervention and increase driver trust in the autonomous driving system, the navigation data prompts are given before the navigation system's prompts. Normally, the navigation system sends the navigation data to the driver 5 seconds before the vehicle arrives at the navigation point (this is just an example). However, in assisted driving mode, the HUD in this application provides the navigation prompt 15 seconds in advance after acquiring the navigation data, allowing the driver time to react.

[0083] The head-up display (HUD) can provide navigation data in two ways: visual display and voice prompts. The timing of these two prompts differs; for example, a visual display might be used at the first time point, while voice prompts are used at the second time point. The same content, such as the same navigation data, is presented at both times. At least one of the first or second time points precedes a predetermined prompt time point from the navigation system, at which the navigation system provides the navigation data.

[0084] Secondly, for vehicle takeover information and / or vehicle braking information, the corresponding prompting method includes prompting the vehicle takeover information and / or vehicle braking information. Thus, step S302 further includes sub-steps S3023 and / or S3024.

[0085] Sub-step S3023: At the third time node, the vehicle takeover information and / or vehicle braking information are displayed on the screen.

[0086] Sub-step S3024: At the fourth time node, the vehicle takeover information and / or vehicle braking information are prompted by voice playback.

[0087] In one embodiment, the driver assistance system can also determine whether driver intervention and / or vehicle braking are required based on navigation data, driver status, traffic conditions, and other information. In this case, the head-up display (HUD) will show the corresponding vehicle intervention and / or vehicle braking information, providing the driver with the relevant information. For example, when providing navigation prompts based on navigation data, the HUD can also display intervention prompts, allowing the driver to choose whether to enter the vehicle under intervention. The vehicle intervention and / or vehicle braking information can be prompted either visually or via voice. As described above, at the third time point, the vehicle intervention and / or vehicle braking information is prompted visually; at the fourth time point, it is prompted via voice, thus providing the driver with two prompts.

[0088] Furthermore, for the vehicle driving control behavior prediction information, the corresponding prompting method is to provide a prompt at a preset time. Thus, step S302 includes sub-step S30225.

[0089] Sub-step S3025: At least at the fifth time node before the execution time node, the driving control behavior prediction information is prompted by means of screen display and / or voice playback, wherein the execution time node is the time node for executing the control behavior indicated by the driving control behavior prediction information.

[0090] Finally, for external prompts, the corresponding prompting methods are visual display and / or voice playback. Therefore, step S302 also includes sub-step S30226:

[0091] Sub-step S30226: Provide prompts for the multiple external prompts by means of visual display and / or voice playback.

[0092] In one embodiment, the assistance system can also generate prompts for other vehicles based on navigation data, driver status, traffic conditions, and other information. These prompts can be sent to other vehicles, for example, via V2V.

[0093] For the current driver's vehicle, the received external prompts include information from other vehicles, as well as information sent by traffic authorities. These external prompts can come from multiple sources and contain various types of information. These prompts can be selectively displayed, especially when they occur simultaneously. The head-up display's information processing device prioritizes these external prompts according to their type. The information types can include warning information, accident information, traffic control information, and general interactive information. The priorities of these types can be set from highest to lowest as follows: accident information, warning information, traffic control information, and general interactive information. When multiple external prompts occur, one or more are displayed based on their type and priority. Thus, sub-step S3026 can specifically involve sorting the multiple external prompts according to a predetermined priority list and displaying at least one of the multiple external prompts based on the sorting result.

[0094] Furthermore, since vehicles can interconnect via V2V, vehicle A can receive and display information from vehicle B. When this information is, for example, an obstacle avoidance signal, the driver can take control of the vehicle based on this signal. For vehicle A, when it receives information from vehicle B, it can display the information, for example, through a visual prompt; and it can determine an action to take based on the information received from vehicle B, while simultaneously displaying information about that action. For example, if the information received from vehicle B is an obstacle avoidance signal, it can directly display this information and determine a steering action, displaying a steering prompt to guide the driver to turn.

[0095] Step S302 also includes sub-steps S3027 and S3028:

[0096] Sub-step S3027, displaying information from other vehicles on a screen; and / or,

[0097] Sub-step S30228: Determine an action to be performed based on information from other vehicles, and display the information of the action on the screen.

[0098] In some embodiments, to facilitate the driver's awareness of the vehicle's driving status, it is necessary to display relevant information, such as vehicle speed, gear position, driving mode, and blind spot monitoring system information, for example, in the form of a screen. Figure 3 The method shown may also include:

[0099] Step S303: Before prompting driving-related information according to the determined prompting method, at least one of the following is displayed on the screen: vehicle speed information, gear information, driving mode information, and blind spot monitoring system information.

[0100] Furthermore, when driving-related information includes at least one of the vehicle takeover information, vehicle braking information, and driving control behavior prediction information, during the process of prompting driving-related information according to the determined prompting method, event information associated with the driving-related information can be prompted through an appropriate means (e.g., visual display and / or voice playback). This event information includes user status information and / or road condition information that leads to taking over the vehicle, braking the vehicle, and / or executing the control behavior indicated by the prediction information. By prompting this user status information and / or road condition information, the user can understand the reasons and basis for the vehicle's infotainment system (e.g., HUD device or driver assistance system) to determine the need for the user to take over the vehicle, brake, or execute the driving control behavior corresponding to the prediction information. For example, these reasons include the driver's status, road conditions, obstacle information, bad road information, bad weather information, the vehicle's status while driving in the current lane (e.g., acceleration, deceleration, etc.) or changes in its relationship with adjacent vehicles in front, behind, left, and right.

[0101] Thus, step S302 may also include sub-step S3029:

[0102] Sub-step S3029: Display the event information associated with the driving-related information on the screen and / or play it on the voice. The event information includes user status information and / or road condition information that leads to taking over the vehicle, braking the vehicle, and / or performing the control actions indicated by the prediction information.

[0103] In some embodiments, where driving-related information includes vehicle takeover information, the driver is required to take over the vehicle promptly. If the driver fails to take over the vehicle within a predetermined time, measures must be taken to control the vehicle for safety, such as deceleration or braking.

[0104] Therefore, when the driving-related information includes vehicle takeover information, after the driving-related information is prompted according to the determined prompting method, Figure 3 The method shown may also include:

[0105] Step S304: If no user intervention is detected in the vehicle equipped with the virtual image display device within a preset time interval, the vehicle is controlled to decelerate and / or brake.

[0106] Figure 4 This is a schematic diagram of a prompting device according to an embodiment of this application. The prompting device may be a HUD. Figure 4 As shown, the device includes the following modules.

[0107] The determination module 401 is used to determine the corresponding prompting method based on driving-related information.

[0108] In some embodiments, the virtual image display device is installed in a vehicle with an autonomous driving level less than or equal to a target autonomous driving level. The target autonomous driving level supports both autonomous driving mode and manual driving mode. The virtual image display device can be a HUD device or AR glasses, etc., and the vehicle can be a vehicle. The target autonomous driving level can be Level 3 autonomous driving. Level 3 vehicles support both autonomous driving mode and manual driving mode; that is, Level 3 autonomous driving is conditional autonomous driving, where the vehicle can perform autonomous driving, but under certain conditions it needs to switch to manual driving by a driver.

[0109] In one embodiment, prior to step S301, the virtual image display device receives driving-related information. The received driving-related information may come from an Advanced Driver Assistance System (ADAS). The ADAS may be an Advanced Driver Assistance System. When the vehicle is in Advanced Driver Assistance mode, it can engage the corresponding autonomous driving mode. Since autonomous driving at Level 3 and above requires no user intervention, while autonomous driving at Level 3 and below requires user intervention, in some embodiments, the autonomous driving mode may be either Level 3 or a level below Level 3.

[0110] In autonomous driving mode, driving-related information can be obtained directly from ADAS. For example, the driver assistance system can acquire various information related to vehicle driving in real time, such as navigation information, warning information, accident information, driving assistance information, feedback information from other vehicles, etc., and send this information to the head-up display for display to the user (e.g., the driver).

[0111] In one embodiment, driving-related information can be obtained directly from ADAS, or it can be obtained by a virtual display device (such as HUD) after it has acquired detection data (such as vehicle distance, user status information, or road conditions) from various sensors (such as cameras, radar, lasers, or ultrasonic waves) and analyzed the detection data to obtain information such as takeover, braking, and behavior prediction.

[0112] In some embodiments, driving-related information includes all information related to the entire driving process, that is, any driving-related information from the start to the end of driving, such as the driver's state, road conditions, weather conditions, driving route, destination information, locations along the driving route, locations of interest to the driver during the driving process, or traffic scheduling information, or so on.

[0113] In some embodiments, different prompting methods can be used for different types of driving-related information. For example, for some driving-related information, such as navigation data, vehicle takeover information, vehicle braking information, and driving control behavior prediction information, prompts can be given at two different time points, and the content of the prompts at the two different time points is the same, such as "Left turn ahead" or "Please take over the vehicle." For other driving-related information, prompts can be given at a single time point. Furthermore, the time interval between the two different time points is determined based on the user's status information and / or the road conditions associated with the driving-related information. For example, if the driver's status is poor and / or the road conditions are complex, the time interval is set to be longer; if the driver's status is good and / or the road conditions are less complex, the time interval is set to be shorter.

[0114] Thus, the determining module 401 may further include a first prompting mode determining unit 4011 and / or a second prompting mode determining unit 4012:

[0115] The first prompting method determination unit 4011 is used to prompt the driving-related information at two different time points when the driving-related information is the target information. The target information is used to instruct the vehicle equipped with the virtual image display device to switch between automatic driving mode and manual driving mode.

[0116] The second prompting method determination unit 4012 is used to prompt the driving-related information at a single time point when the driving-related information is not the target information.

[0117] The head-up display (HUD) can display information received from the driver assistance system. Specifically, to facilitate driver takeover, the HUD's information processing equipment uses different methods to process different types of driving-related information.

[0118] In one embodiment, the head-up display (HUD) acquires navigation data from the navigation system installed in the vehicle to display corresponding navigation data. To improve the efficiency of human intervention and the driver's trust in the autonomous driving system, the navigation data is displayed a certain amount of time before the navigation system's prompt, for example, 10 or 15 seconds in advance. For instance, if the navigation data includes "the vehicle is turning left at the intersection ahead," normally the navigation system would send this data to the driver 5 seconds before the vehicle reaches the navigation point (this is just an example). However, in assisted driving mode, the HUD of this application will provide a navigation prompt 15 seconds in advance after acquiring the navigation data, allowing the driver time to react. The navigation data may include complex road condition data such as the vehicle reaching an accident / non-standard road section, and this application does not impose any limitations on this.

[0119] In one embodiment, the driver assistance system or virtual display device can also determine whether driver intervention and / or vehicle braking are required based on navigation data, driver status, traffic conditions, and other information. In this case, the head-up display device will display the corresponding vehicle intervention information and / or vehicle braking information, thereby providing the driver with the relevant information. Specifically, the vehicle intervention information is used to inform the driver of the reason for intervention (e.g., complex road conditions) and the necessary actions during intervention (e.g., deceleration), while the vehicle braking information is used to inform the driver of the reason for braking (e.g., vehicle malfunction) and the necessary actions during braking (e.g., deceleration and / or pulling over).

[0120] For example, when providing navigation prompts based on navigation data, the head-up display can also show a takeover prompt. The driver can then choose whether to enter the vehicle to take over. For vehicle takeover information and / or vehicle braking information, the corresponding prompts can be displayed visually or aloud. The timing of the visual and aloud prompts can differ, thus providing the driver with two separate prompts.

[0121] In one embodiment, the driver assistance system can predict vehicle control behavior based on navigation data, driver status, traffic conditions, and other information. The predicted behavior includes steering wheel rotation angle, vehicle acceleration / deceleration, or turn signal activation, forming vehicle driving control behavior prediction information which is then sent to the head-up display (HUD). Alternatively, the HUD can predict vehicle control behavior based on navigation data, driver status, traffic conditions, and other information. The predicted behavior includes steering wheel rotation angle, vehicle acceleration / deceleration, or turn signal activation, forming vehicle driving control behavior prediction information. The prediction information includes at least one of the following: steering wheel rotation information, vehicle gear shift information, and turn signal information. The HUD will then display the corresponding prediction information, visualizing the prediction of control behavior.

[0122] For example, when a vehicle is about to enter a deceleration zone, the driver assistance system / HUD device predicts that the vehicle will decelerate accordingly. At this time, the head-up display will show the corresponding prediction information, allowing the driver to be aware of the upcoming control action. To facilitate the driver's anticipation of the upcoming control action, the information processing equipment of the head-up display can provide a warning before the actual control action occurs, for example, a warning 1 second in advance. Therefore, for the vehicle driving control action prediction information, the corresponding warning method is to provide a warning at a preset time in advance.

[0123] In one embodiment, the driver assistance system / HUD device can also generate alerts for other vehicles based on navigation data, driver status, traffic conditions, and other information (e.g., issuing avoidance warnings to other vehicles when a vehicle has a problem). These alerts can be sent to other vehicles via, for example, V2V.

[0124] V2V is a type of intelligent connected vehicle technology. Its principle is to utilize the transmission unit on each vehicle to send signals via a high-speed wireless network. This information includes basic vehicle information, speed, direction, geographical location, and route, enabling communication between vehicles. Other vehicles in the vicinity receive this wireless information in real time and simultaneously send similar feedback from their own onboard units, forming an interactive information exchange process.

[0125] For the current driver's vehicle, the external prompts received include information from other vehicles and other external prompts, such as those sent by traffic authorities. These external prompts can come from multiple sources and contain various types of information. Multiple external prompts can be displayed visually and / or played aloud, and selective display is also possible, especially when these prompts appear simultaneously. The head-up display's information processing equipment prioritizes these external prompts according to their type. Information types can include warning information, accident information, traffic control information, and general interactive information. The priority of these types can be set from highest to lowest as follows: accident information, warning information, traffic control information, and general interactive information. When multiple external prompts appear, one or more are displayed based on their type and priority. Thus, the display method for external prompts is based on their priority.

[0126] The prompting module 402 is used to prompt the driving-related information according to the determined prompting method.

[0127] First, for navigation data, the corresponding prompting method is to prompt the navigation system in advance. Thus, the prompting module 402 includes a first prompting unit 4021 and / or a second prompting unit 4022.

[0128] The first prompting unit 4021 is used to prompt the navigation data in a screen display manner at the first time node;

[0129] The second prompting unit 4022 is used to prompt the navigation data by voice playback at a second time node.

[0130] In one embodiment, the head-up display (HUD) provides navigation data prompts by acquiring navigation data from the vehicle's onboard navigation system. To improve the efficiency of human intervention and increase driver trust in the autonomous driving system, the navigation data prompts are given before the navigation system's prompts. Normally, the navigation system sends the navigation data to the driver 5 seconds before the vehicle arrives at the navigation point (this is just an example). However, in assisted driving mode, the HUD in this application provides the navigation prompt 15 seconds in advance after acquiring the navigation data, allowing the driver time to react.

[0131] The head-up display (HUD) can provide navigation data in two ways: visual display and voice prompts. The timing of these two prompts differs; for example, a visual display might be used at the first time point, followed by voice prompts at the second. The same content, such as the same navigation data, may be presented at both times. At least one of the first or second time points precedes a predetermined prompt point by the navigation system, at which the navigation system provides the navigation data.

[0132] Secondly, for vehicle takeover information and / or vehicle braking information, the corresponding prompting method includes prompting the vehicle takeover information and / or vehicle braking information. Thus, the prompting module 402 also includes a third prompting unit 4023 and / or a fourth prompting unit 4024.

[0133] The third prompting unit 4023 is used to prompt the vehicle takeover information and / or vehicle braking information in a screen display manner at the third time node.

[0134] The fourth prompting unit 4024 is used to prompt the vehicle takeover information and / or vehicle braking information by voice playback at the fourth time node.

[0135] In one embodiment, the driver assistance system can also determine whether driver intervention and / or vehicle braking are required based on navigation data, driver status, traffic conditions, and other information. In this case, the head-up display (HUD) will show the corresponding vehicle intervention and / or vehicle braking information, providing the driver with the relevant information. For example, when providing navigation prompts based on navigation data, the HUD can also display intervention prompts, allowing the driver to choose whether to enter the vehicle under intervention. The vehicle intervention and / or vehicle braking information can be prompted either visually or via voice. As described above, at the third time point, the vehicle intervention and / or vehicle braking information is prompted visually; at the fourth time point, it is prompted via voice, thus providing the driver with two prompts.

[0136] Furthermore, for the vehicle driving control behavior prediction information, the corresponding prompting method is to provide a prompt at a preset time. Thus, the prompting module 402 includes a fifth prompting unit 4025.

[0137] The fifth prompting unit 4025 is used to prompt the driving control behavior prediction information by means of screen display and / or voice playback at least at the fifth time node before the execution time node, wherein the execution time node is the time node for executing the control behavior indicated by the driving control behavior prediction information.

[0138] Finally, for external prompts, the corresponding prompting methods are visual display and / or voice playback. Therefore, the prompting module 402 also includes a sixth prompting unit 4026:

[0139] The sixth prompting unit 4026 is used to provide prompts for the plurality of external prompts by means of displaying images and / or playing voice messages.

[0140] In one embodiment, the assistance system can also generate prompts for other vehicles based on navigation data, driver status, traffic conditions, and other information. These prompts can be sent to other vehicles, for example, via V2V.

[0141] For the current driver's vehicle, the received external prompts include information from other vehicles, as well as information sent by traffic authorities. These external prompts can originate from multiple sources and contain various types of information. These prompts can be selectively displayed, especially when they occur simultaneously. The head-up display's information processing device prioritizes these external prompts according to their type. The information types can include warning information, accident information, traffic control information, and general interactive information. The priorities of these types can be set from highest to lowest as follows: accident information, warning information, traffic control information, and general interactive information. When multiple external prompts occur, one or more are displayed based on their type and priority. Thus, the sixth prompt unit 4026 can specifically be used to sort the multiple external prompts according to a predetermined priority list and to display at least one of the multiple external prompts based on the sorting result.

[0142] Furthermore, since vehicles can interconnect via V2V, vehicle A can receive and display information from vehicle B. When this information is, for example, an obstacle avoidance signal, the driver can take control of the vehicle based on this signal. For vehicle A, when it receives information from vehicle B, it can display the information, for example, through a visual prompt; and it can determine an action to take based on the information received from vehicle B, while simultaneously displaying information about that action. For example, if the information received from vehicle B is an obstacle avoidance signal, it can directly display this information and determine a steering action, displaying a steering prompt to guide the driver to turn.

[0143] The prompting module 402 also includes a seventh prompting unit 4027 and an eighth prompting unit 4028:

[0144] The seventh prompting unit 4027 is used to display information from other vehicles on a screen; and / or,

[0145] The eighth prompting unit 4028 is used to determine an action to be performed based on information from other vehicles and to prompt the information of the action to be performed by displaying it on a screen.

[0146] In some embodiments, to facilitate understanding of the vehicle's driving status, it is necessary to display relevant information, such as vehicle speed, gear position, driving mode, and blind spot monitoring system information, for example, in the form of a screen. Figure 4 The apparatus shown may also include:

[0147] The display module 403 is used to display at least one of the following information in a display manner: vehicle speed information, gear information, driving mode information, and blind spot monitoring system information, before prompting driving-related information according to the determined prompting method.

[0148] Furthermore, when driving-related information includes at least one of the vehicle takeover information, vehicle braking information, and driving control behavior prediction information, during the process of prompting driving-related information according to the determined prompting method, event information associated with the driving-related information can be prompted through an appropriate means (e.g., visual display and / or voice playback). This event information includes user status information and / or road condition information that leads to taking over the vehicle, braking the vehicle, and / or executing the control behavior indicated by the prediction information. By prompting this user status information and / or road condition information, the user can understand the reasons and basis for the vehicle's infotainment system (e.g., HUD device or driver assistance system) to determine the need for the user to take over the vehicle, brake, or execute the driving control behavior corresponding to the prediction information. For example, these reasons include the driver's status, road conditions, obstacle information, bad road information, bad weather information, the vehicle's status while driving in the current lane (e.g., acceleration, deceleration, etc.) or changes in its relationship with adjacent vehicles in front, behind, left, and right.

[0149] Thus, the prompting module 402 may also include a ninth prompting unit 4029:

[0150] The ninth prompting unit 4029 is used to prompt the event information associated with the driving-related information by means of screen display and / or voice playback, wherein the event information includes user status information and / or road condition information that leads to taking over the vehicle, braking the vehicle and / or performing the control behavior indicated by the prediction information.

[0151] In some embodiments, where driving-related information includes vehicle takeover information, the driver is required to take over the vehicle promptly. If the driver fails to take over the vehicle within a predetermined time, measures must be taken to control the vehicle for safety, such as deceleration or braking.

[0152] Therefore, when the driving-related information includes vehicle takeover information, after the driving-related information is prompted according to the determined prompting method, Figure 4 The apparatus shown may also include:

[0153] The control module 404 is used to control the vehicle to decelerate and / or brake if no user intervention is detected in the vehicle equipped with the virtual image display device within a preset time interval.

[0154] According to the solution of this application, the structure of the proposed head-up display device is different from the prior art. It can display the entire vehicle window and show more driving-related information, thereby improving the efficiency of driver takeover. In addition, the proposed prompting method can further process the driving-related information provided by the driver assistance system before displaying it, so that the driver knows whether or not to take over and how to do so, further improving the efficiency of driver takeover.

[0155] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.

[0156] See Figure 5 , Figure 5 An electronic device is provided, including a processor; and a memory storing computer instructions that, when executed by the processor, cause the processor to perform the computer instructions as follows: Figure 3 The method and its detailed scheme are shown.

[0157] It should be understood that the above-described device embodiments are merely illustrative, and the device disclosed in this invention can be implemented in other ways. For example, the division of units / modules described in the above embodiments is only a logical functional division, and there may be other division methods in actual implementation. For example, multiple units, modules, or components may be combined, integrated into another system, or some features may be ignored or not executed.

[0158] Furthermore, unless otherwise specified, the functional units / modules in the various embodiments of the present invention can be integrated into one unit / module, or each unit / module can exist physically separately, or two or more units / modules can be integrated together. The integrated units / modules described above can be implemented in hardware or as software program modules.

[0159] If the integrated unit / module is implemented in hardware, the hardware can be digital circuits, analog circuits, etc. The physical implementation of the hardware structure includes, but is not limited to, transistors, memristors, etc. Unless otherwise specified, the processor or chip can be any suitable hardware processor, such as a CPU, GPU, FPGA, DSP, and ASIC, etc. Unless otherwise specified, the on-chip cache, off-chip memory, and storage can be any suitable magnetic or magneto-optical storage medium, such as resistive random access memory (RRAM), dynamic random access memory (DRAM), static random access memory (SRAM), enhanced dynamic random access memory (EDRAM), high-bandwidth memory (HBM), hybrid memory cube (HMC), etc.

[0160] If the integrated unit / module is implemented as a software program module and sold or used as an independent product, it can be stored in a computer-readable storage device (CMD). Based on this understanding, the technical solution of this invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this disclosure. The aforementioned memory includes various media capable of storing program code, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.

[0161] This application embodiment also provides a means of transportation, wherein, as shown in the example below, it includes... Figure 4 The aforementioned prompting device, or as... Figure 5 The electronic device mentioned above, or such as Figure 2The head-up display device.

[0162] This application embodiment also provides a non-transitory computer storage medium storing a computer program, which, when executed by multiple processors, causes the processors to perform actions such as... Figure 3 The method and its detailed scheme are shown.

[0163] According to the solution of this application, the light emitted from the HUD's image source is projected onto the imaging window, allowing the user to see the image directly without looking down. Furthermore, compared to traditional HUDs, the HUD proposed in this application has a larger display panel, capable of displaying more information, especially driving-related information. The more driving-related information presented to the driver, the easier it is for the driver to take over when switching from autonomous driving mode to driver control mode, improving the accuracy and efficiency of the takeover. Moreover, the HUD of this application can acquire various information from ADAS (especially driving-related information). After acquiring this information, the HUD does not directly project it, but processes it before displaying and prompting the driver, facilitating driver takeover of the vehicle.

[0164] The embodiments of this application have been described in detail above. Specific examples have been used to illustrate the principles and implementation methods of this application. The descriptions of the embodiments above are only for the purpose of helping to understand the method and core ideas of this application. Furthermore, any changes or modifications made by those skilled in the art based on the ideas of this application, and on the specific implementation methods and application scope of this application, are all within the scope of protection of this application. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A method for providing prompts, wherein, The method is applied in a virtual image display device, and the method includes: Determine the appropriate prompting method based on driving-related information; The driving-related information is displayed according to the determined prompting method; The driving-related information includes navigation data from the navigation system, and the step of providing prompts for the driving-related information according to the determined prompting method includes: At the first point in time, the navigation data is displayed visually. At a second time point, the navigation data is prompted by voice playback, wherein the second time point is different from the first time point; Wherein, the first time node and / or the second time node are at least ahead of the predetermined prompt time node of the navigation system, and at the predetermined prompt time node, the navigation system prompts the navigation data.

2. The prompting method as described in claim 1, wherein: The driving-related information includes vehicle takeover information and / or vehicle braking information, and the step of providing prompts for the driving-related information according to the determined prompting method includes: At the third time point, the vehicle takeover information and / or vehicle braking information are displayed on the screen. At the fourth time point, the vehicle takeover information and / or vehicle braking information are prompted by voice playback; wherein, the fourth time point is different from the third time point; And / or The driving-related information includes driving control behavior prediction information, and the step of providing prompts for the driving-related information according to the determined prompting method includes: At least five time points before the execution time point, the driving control behavior prediction information is prompted by visual display and / or voice playback, wherein the execution time point is the time point at which the control behavior indicated by the driving control behavior prediction information is executed.

3. The prompting method as described in claim 1 or 2, wherein, When the driving-related information includes at least one of the vehicle takeover information, the vehicle braking information, and the driving control behavior prediction information, before prompting the driving-related information according to the determined prompting method, the method further includes: Display at least one of the following information on the vehicle: vehicle speed, gear position, driving mode, and blind spot monitoring system. The step of prompting the driving-related information according to the determined prompting method further includes: prompting the event information associated with the driving-related information by means of visual display and / or voice playback, wherein the event information includes user status information and / or road condition information that leads to taking over the vehicle, braking the vehicle and / or executing the control behavior indicated by the prediction information.

4. The prompting method as described in claim 1 or 2, wherein, When the driving-related information includes vehicle takeover information, after prompting the driving-related information according to the determined prompting method, the method further includes: If no user intervention is detected in the vehicle equipped with the virtual image display device within a preset time interval, the vehicle is controlled to decelerate and / or brake.

5. The prompting method as described in claim 1 or 2, wherein, The driving-related information includes multiple external prompts from the external environment, and the step of prompting the driving-related information according to the determined prompting method includes: The multiple external prompts are displayed visually and / or played aloud.

6. The prompting method as described in claim 5, wherein, The method of providing prompts for the multiple external prompts through visual display and / or voice playback includes: The plurality of external prompts are sorted according to a predetermined priority list, and at least one of the plurality of external prompts is prompted according to the sorting result.

7. The prompting method as described in claim 1 or 2, wherein, The driving-related information includes information from other vehicles, and the step of providing prompts for the driving-related information according to the determined prompting method includes: The information from other vehicles is displayed visually and / or played back via audio. And / or An action is determined based on information from other vehicles, and information about the action is displayed on a screen and / or played back by voice.

8. The prompting method as described in claim 1 or 2, wherein, The virtual image display device is installed in vehicles with an autonomous driving level less than or equal to the target autonomous driving level, wherein the target autonomous driving level supports both autonomous driving mode and manual driving mode.

9. The prompting method as described in claim 1, wherein, The step of determining the corresponding prompting method based on driving-related information includes: When the driving-related information is target information, the driving-related information is prompted at two different time points. The target information is used to instruct the vehicle equipped with the virtual image display device to switch between autonomous driving mode and manual driving mode. If the driving-related information is not the target information, the driving-related information will be prompted at a single time point.

10. The prompting method as described in claim 9, wherein, The time interval between the two different time points is determined based on the user status information and / or the road conditions associated with the driving-related information.

11. A prompting device, wherein, include: The determination module is configured to determine the appropriate prompting method based on driving-related information. The prompting module is configured to prompt the driving-related information according to a determined prompting method; The driving-related information includes navigation data from the navigation system, and the prompting module includes: The first prompting unit is used to prompt the navigation data in a visual manner at the first time point; The second prompting unit is used to prompt the navigation data by voice playback at a second time node, wherein the second time node is different from the first time node; Wherein, the first time node and / or the second time node are at least ahead of the predetermined prompt time node of the navigation system, and at the predetermined prompt time node, the navigation system prompts the navigation data.

12. A non-transitory computer storage medium storing a computer program that, when executed by a plurality of processors, causes the processors to perform the prompting method according to any one of claims 1-10.

13. An electronic device, comprising: processor; as well as A memory storing computer instructions that, when executed by the processor, cause the processor to perform the prompting method according to any one of claims 1-10.

14. A head-up display device, wherein, The head-up display device is used to perform the prompting method according to any one of claims 1-10, and the head-up display device includes: an image source device and a light control device; The image source device is configured to emit image light to the light control device, and the light control device is configured to change the emission direction of the image light so that the image light is reflected to the imaging device to form a viewable image.

15. A means of transportation, wherein, This includes the prompting device as described in claim 11, the electronic device as described in claim 13, or the head-up display device as described in claim 14.

Images