Display method, vehicle, and computer-readable storage medium
By generating and integrating the marking information of surrounding vehicle models, the problem of insufficient content in lane-level navigation displays is solved, thus improving driving safety.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-05-23
- Publication Date
- 2026-03-24
AI Technical Summary
The lane-level navigation display screen does not provide enough content to meet the needs of users for safe driving.
By acquiring lane-level data and vehicle environment data from the map, an environmental simulation screen is generated. By combining the component status information of surrounding vehicles, marking information of surrounding vehicle models is generated, and this information is merged with the environmental simulation screen to generate a navigation simulation screen, providing warnings about the component status of surrounding vehicles.
It improves driving safety, allowing users to more accurately know the status information of surrounding vehicles, reducing distractions while driving and enhancing safety.
Smart Images

Figure CN114964291B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of vehicle control technology, and in particular to a display method, a vehicle, and a computer-readable storage medium. Background Technology
[0002] In related technologies, lane-level navigation displays can be generated by combining lane-level data from map providers with environmental information collected by vehicle sensors. However, the content displayed in lane-level navigation displays is not rich enough to meet the needs of users for safe driving. Summary of the Invention
[0003] The present invention provides a display method, a vehicle, and a computer-readable storage medium.
[0004] The present invention discloses a display method for an in-vehicle system, wherein the in-vehicle system is installed in a vehicle. The display method includes: upon acquiring lane-level data of a map and environmental data of the vehicle traveling on the current road, generating an environmental simulation screen based on the lane-level data and the environmental data, wherein the environmental simulation screen displays several lanes corresponding to the current road and surrounding vehicle models; generating marking information of the surrounding vehicle models based on the status information of the components of the surrounding vehicles; and fusing the marking information of the surrounding vehicle models with the environmental simulation screen to generate a navigation simulation screen.
[0005] In the above display method, users can know the status information of the components of surrounding vehicles through the marking information of the surrounding vehicle models, thereby facilitating the user's vehicle operation and improving driving safety.
[0006] The step of generating the marking information of the surrounding vehicle model based on the state information of the components of the surrounding vehicles includes: detecting the state information of the components of the surrounding vehicles; determining whether the state information of the components of the surrounding vehicles will threaten the driving of the vehicle; and generating the marking information of the surrounding vehicle model if the state information of the components will threaten the driving of the vehicle.
[0007] In this way, when surrounding vehicles pose a threat to the vehicle's operation, it can generate marker information of surrounding vehicle models to warn the user, thereby improving driving safety.
[0008] The status information of the surrounding vehicle components includes the door opening information and door closing information of each vehicle within the preset range of the vehicle. The step of generating the marking information of the surrounding vehicle model based on the status information of the surrounding vehicle components includes: when the status information of the surrounding vehicle components is the door opening information, marking the door of the surrounding vehicle model corresponding to the door opening information as the marking information of the surrounding vehicle model.
[0009] In this way, if the doors of surrounding vehicles are open, the doors of the surrounding vehicle models can be marked to alert the user.
[0010] The status information of the surrounding vehicle components includes the door opening information and door closing information of each vehicle within the preset range of the vehicle. The step of generating the marking information of the surrounding vehicle model based on the status information of the surrounding vehicle components includes: when the status information of the surrounding vehicle components is the door opening information, marking the entire surrounding vehicle model as the marking information of the surrounding vehicle model.
[0011] In this way, if the doors of surrounding vehicles are open, the entire model of the surrounding vehicles can be marked, thereby alerting the user.
[0012] The status information of the surrounding vehicle components includes the door opening information and door closing information of each vehicle within the preset range of the vehicle. The display method further includes: when the status information of the surrounding vehicle components is the door opening information, determining the threatened lane based on the door opening information and marking the threatened lane as a prompt information.
[0013] In this way, if the doors of surrounding vehicles are open, the threatened lane can be marked to warn the user.
[0014] The status information of the surrounding vehicle components includes the headlight switch information and headlight color information of each vehicle within the preset range of the vehicles. The step of generating the marking information of the surrounding vehicle model based on the status information of the surrounding vehicle components includes: when the headlight switch information is headlight on information and / or the headlight color information is preset color information, marking the headlights of the surrounding vehicle model corresponding to the headlight on information as the marking information of the surrounding vehicle model.
[0015] In this way, when the headlights of surrounding vehicles are on and / or set to a preset color, the headlights of surrounding vehicle models can be marked to warn the user.
[0016] The status information of the surrounding vehicle components includes the hazard warning light activation and deactivation information of each vehicle within the preset range of the vehicle. The step of generating the marking information of the surrounding vehicle model based on the status information of the surrounding vehicle components includes: when the status information of the surrounding vehicle components is the hazard warning light activation information, marking the entire surrounding vehicle model of the surrounding vehicle as the marking information of the surrounding vehicle model.
[0017] In this way, when the hazard warning lights of surrounding vehicles are activated, the entire model of the surrounding vehicles can be marked, thereby alerting the user.
[0018] The status information of the surrounding vehicle components includes hazard warning light activation and hazard warning light deactivation information for each vehicle within the preset range of the vehicle. The display method further includes marking the lane ahead of the vehicle as a warning message when the status information of the surrounding vehicle components indicates that the hazard warning lights are activated and the speed of the surrounding vehicles is less than the speed of the vehicle.
[0019] In this way, if the hazard warning lights of surrounding vehicles are on and the speed of surrounding vehicles is less than that of the vehicle, the lane ahead can be marked to warn the user.
[0020] The vehicle of the present invention includes one or more processors and a memory, the memory storing a computer program that, when executed by the processor, implements the steps of the display method described in any of the above embodiments.
[0021] In the aforementioned vehicles, users can learn about the status information of the components of surrounding vehicles through the marking information of the surrounding vehicle models, thereby facilitating the user's vehicle operation and improving driving safety.
[0022] The computer-readable storage medium of the present invention stores a computer program thereon, which, when executed by a processor, implements the display method described in any of the above embodiments.
[0023] In the aforementioned computer-readable storage medium, users can know the status information of the components of surrounding vehicles through the marking information of the surrounding vehicle models, thereby facilitating user operation of the vehicle and improving driving safety.
[0024] Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. Attached Figure Description
[0025] The above and / or additional aspects and advantages of the present invention will become apparent and readily understood from the description of the embodiments taken in conjunction with the following drawings, in which:
[0026] Figure 1 This is a flowchart illustrating the display method of the present invention;
[0027] Figure 2 This is a schematic diagram of the vehicle of the present invention;
[0028] Figure 3 This is a schematic diagram of the navigation simulation screen of the present invention;
[0029] Figures 4 to 6 This is a flowchart illustrating the display method of the present invention;
[0030] Figure 7 This is a schematic diagram of the navigation simulation screen of the present invention;
[0031] Figure 8 This is a flowchart illustrating the display method of the present invention;
[0032] Figure 9 and Figure 10 This is a schematic diagram of the navigation simulation screen of the present invention;
[0033] Figure 11 This is a flowchart illustrating the display method of the present invention;
[0034] Figure 12 This is a schematic diagram of the navigation simulation screen of the present invention;
[0035] Figure 13 This is a flowchart illustrating the display method of the present invention;
[0036] Figure 14 This is a schematic diagram of the navigation simulation screen of the present invention;
[0037] Figure 15 This is a flowchart illustrating the display method of the present invention;
[0038] Figure 16 This is a schematic diagram of the navigation simulation screen of the present invention;
[0039] Figure 17 This is a schematic diagram of the vehicle of the present invention.
[0040] Explanation of key component symbols:
[0041] Vehicle 10, vehicle system 11, main body 13, processor 15, memory 17;
[0042] Surrounding vehicle model 21, marking information 22, warning information 23, threatened lane 231, lane ahead 232. Detailed Implementation
[0043] Embodiments of the present invention are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and should not be construed as limiting the present invention.
[0044] In related technologies, lane-level navigation displays can be generated by combining lane-level data from map providers with environmental information collected by vehicle sensors. However, the content displayed in lane-level navigation displays is not rich enough to meet the needs of users for safe driving.
[0045] Please see Figures 1 to 3 The display method of the present invention can be used in an in-vehicle system 11, which is installed in a vehicle 10. The display method includes:
[0046] 012: After obtaining the lane-level data of the map and the environmental data of the vehicle 10 when it is driving on the current road, an environmental simulation screen is generated based on the lane-level data and the environmental data. The environmental simulation screen displays several lanes corresponding to the current road and the surrounding vehicle models 21 of the surrounding vehicles.
[0047] 014: Generate marking information 22 for the surrounding vehicle model 21 based on the status information of the surrounding vehicle's components;
[0048] 016: The marking information 22 of the surrounding vehicle models 21 is merged with the environmental simulation screen to generate a navigation simulation screen.
[0049] Vehicle 10 includes an in-vehicle system 11 and a main body 13, with the in-vehicle system 11 disposed on the main body 13. The in-vehicle system 11 may include at least one of the following display components: an instrument panel, a central control screen, a head-up display (HUD) for the windshield, and an extended reality (XR) system. In some embodiments, vehicle 10 can display the navigation simulation screen described in the above embodiments via the in-vehicle system 11. In other embodiments, vehicle 10 can also display the navigation simulation screen via a terminal device with display capabilities that can communicate with vehicle 10. In one embodiment, the terminal device may be a mobile phone.
[0050] In the above display method, the user can know the status information of the components of the surrounding vehicles through the marking information 22 of the surrounding vehicle model 21, thereby facilitating the user to operate the vehicle 10 and improving driving safety.
[0051] Specifically, the map can be a high-precision map provided by a supplier. The map may include lane-level data, place names, buildings, natural landscapes, etc. Lane-level data may include lane data, tunnel data, bridge data, guardrail data, and traffic camera data. The map may be stored on a cloud server or in the local storage of vehicle 10; this is not limited thereto. In some embodiments, the map is stored on a cloud server, and vehicle 10 can connect to the cloud server via wireless communication (such as Wi-Fi, mobile communication networks, etc.), thereby obtaining the lane-level data of the map from the cloud server. In some embodiments, the map is stored in the local storage of vehicle 10, thereby obtaining the lane-level data of the map from the local storage of vehicle 10. In other embodiments, the lane-level data of the map is static.
[0052] Environmental data may include surrounding pedestrians, their location information, surrounding vehicles, and their location information. Specifically, in one embodiment, vehicle 10 may include an environmental perception sensor (not shown). The environmental perception sensor can acquire real-time data on the dynamic changes around vehicle 10 and generate corresponding electrical signals. By processing the electrical signals generated by the environmental perception sensor, environmental data of vehicle 10 can be acquired, thereby directly obtaining information related to the environment surrounding vehicle 10. Environmental perception sensors may include high-definition cameras, millimeter-wave radar, ultrasonic radar, lidar, attitude sensors, positioning sensors, etc. The specific type of environmental perception sensor is not limited here. It is understood that environmental data is dynamic.
[0053] In some implementations, the environmental perception sensor may be mounted on the roof of the vehicle 10, or it may be mounted around the front, rear and doors of the vehicle 10.
[0054] In this implementation, with lane-level data and environmental data acquired, the lane-level data and environmental data can be fused to obtain an environmental simulation screen. Specifically, the environmental simulation screen can display real-world information of several lanes of the road where vehicle 10 is located, such as the vehicles in front and behind (as surrounding vehicle models 21) in the lane where vehicle 10 is located, other vehicles in parallel lanes (as surrounding vehicle models 21), lane markings, road sign information, and road type. This allows the user to determine, based on the environmental simulation screen, whether sufficient distance is maintained between the vehicle and the vehicles in front and behind, whether conditions are available for changing lanes to parallel lanes, whether vehicle 10 has deviated from its current lane, the current road restrictions on vehicle 10 (such as speed, whether high beams can be used), and whether turning is necessary. This allows the user to intuitively grasp the dynamic changes around vehicle 10, facilitating timely judgment and operation.
[0055] Based on the above, given the generated environmental simulation screen, the screen can be fused according to the status information of the surrounding vehicle components. Specifically, the surrounding vehicles can refer to each vehicle within a preset range of vehicle 10, and the components of the surrounding vehicles can include doors, lights, etc. The status information of the surrounding vehicle components can generate marking information 22 for the surrounding vehicle model 21. Marking information 22 can be used to represent the status information of the surrounding vehicle components, such as the status of doors and lights, allowing users to more accurately understand the status of the surrounding vehicle components. Marking information 22 can provide users with clear warnings, providing better judgment for driving and thus improving driving safety. The marking information 22 of the surrounding vehicle model 21 is fused into the environmental simulation screen for corresponding optimization processing, allowing users to determine the status information of the surrounding vehicle components based on the optimized navigation simulation screen.
[0056] It is understandable that in practical applications, users need to concentrate on confirming and judging their surroundings. If they need to confirm the status information of the components of surrounding vehicles, they would need to distract themselves to observe. In the embodiments of the present invention, users can judge the current environment of vehicle 10 through the navigation simulation screen, and at the same time, they can quickly and easily confirm the status information of the components of surrounding vehicles based on the marking information 22 of the surrounding vehicle models 21 in the navigation simulation screen. The navigation simulation screen displays richer content and has more comprehensive functions, providing users with one-stop driving information, making it less likely to cause user distraction while driving, and thus improving safety.
[0057] Please see Figure 4 Step 014 (generating marking information 22 for the surrounding vehicle model 21 based on the status information of the surrounding vehicle components) includes:
[0058] 0141: Detect the status information of components of surrounding vehicles;
[0059] 0142: Determine whether the status of the components of surrounding vehicles will threaten the operation of vehicle 10;
[0060] 0143: In situations where the movement of vehicle 10 is threatened, generate marking information 22 for surrounding vehicle models 21.
[0061] Thus, when surrounding vehicles threaten the driving of the vehicle (vehicle 10), it is possible to generate marking information 22 of surrounding vehicle models 21 to warn the user, thereby improving driving safety.
[0062] Specifically, environmental data may include the status information of components of surrounding vehicles, which can be obtained through the sensing hardware of vehicle 10, such as environmental sensing sensors. The environmental sensing sensors can acquire real-time data on the dynamic changes around vehicle 10 and generate corresponding electrical signals. By processing the electrical signals generated by the environmental sensing sensors, the environmental data of vehicle 10 can be obtained, thereby enabling the acquisition of the status information of components of surrounding vehicles.
[0063] Surrounding vehicles can refer to every vehicle within a preset range of vehicle 10. The preset range can be determined based on the detection capability and accuracy of the environmental perception sensor of vehicle 10. For example, surrounding vehicles can refer to all vehicles that the environmental perception sensor of vehicle 10 can detect. In one embodiment, the preset range can be 0-2 meters, that is, surrounding vehicles can refer to every vehicle within 2 meters of vehicle 10. However, in cases of heavy traffic (i.e., many surrounding vehicles), the environmental perception sensor may be unable to detect information about other vehicles in the blind spot of vehicle 10 because it may be blocked by nearby vehicles.
[0064] The system determines whether the status of surrounding vehicle components threatens the driving of vehicle 10. Taking a car door as an example, a door can include the front door, rear door, front trunk, and trunk. The front and rear doors, front trunk, and trunk of surrounding vehicles can potentially affect or threaten the driving of vehicle 10. For example, an open front or rear door may block the driving lane of vehicle 10, a half-open front or rear door may indicate that someone is about to get out of the car, and an open trunk of the car in front may cause cargo to fall out. Therefore, these situations threaten the driving of vehicle 10, and corresponding marking information 22 can be generated on the surrounding vehicle model 21. The marking information 22 is integrated into the environmental simulation screen to generate a navigation simulation screen, thereby alerting the user. However, situations such as an open charging port cover on a nearby vehicle do not threaten the driving of vehicle 10, so these situations can be ignored, and the marking information 22 on the surrounding vehicle model 21 is not generated to avoid unnecessary interference to the user. Only when there is a threat to the driving of vehicle 10 is a marker information 22 of the surrounding vehicle model 21 generated, thereby providing better guidance to the user and assisting the user in making driving decisions to achieve safe driving. By making the marker information 22 of the surrounding vehicle model 21 explicit the state information of the components of the surrounding vehicles detected by the environmental perception sensors of vehicle 10, confidence in human-machine co-driving can be established.
[0065] Please see Figure 5 The status information of the surrounding vehicle components includes the door opening and closing information of each vehicle within a preset range of vehicle 10. Step 014 (generating the marking information 22 of the surrounding vehicle model 21 based on the status information of the surrounding vehicle components) includes:
[0066] 0144: When the status information of the components of the surrounding vehicles is door opening information, mark the door of the surrounding vehicle model 21 corresponding to the door opening information as the marking information 22 of the surrounding vehicle model 21.
[0067] In this way, if the doors of surrounding vehicles are open, the doors of the surrounding vehicle models 21 can be marked to alert the user.
[0068] Specifically, vehicle doors can include front doors, rear doors, front trunks, and rear trunks. The front doors, rear doors, front trunks, and rear trunks of surrounding vehicles can potentially affect or threaten the driving of vehicle 10. For example, open front or rear doors may obstruct the driving lane of vehicle 10, half-open front or rear doors may indicate that someone is about to get out of the vehicle, and an open trunk of the vehicle in front may allow cargo to fall out. When the status information of the components of surrounding vehicles indicates that the doors of the surrounding vehicles are open, it means that the doors of the surrounding vehicles are open. Since open doors threaten the driving of vehicle 10, the doors of the surrounding vehicle models 21 corresponding to the door opening information can be marked as marking information 22 of the surrounding vehicle models 21. The marking methods include: the door is in an open state in the surrounding vehicle models 21, the open door is colored (using a more conspicuous color such as red or yellow), the door is highlighted, etc., at least one of these methods. Thus, the user can more easily discover that the door is open, and the user can operate the vehicle according to the marking information 22 of the surrounding vehicle models 21 to achieve safe driving. If the status information of the surrounding vehicle's components is "door closed", it means that the doors of the surrounding vehicles are closed. Since the closed doors do not threaten the driving of vehicle 10, the marking information 22 of the surrounding vehicle model 21 is not generated, and the surrounding vehicle model 21 can be displayed normally.
[0069] Please see Figure 6 and Figure 7 The status information of the surrounding vehicle components includes the door opening and closing information of each vehicle within a preset range of vehicle 10. Step 014 (generating the marking information 22 of the surrounding vehicle model 21 based on the status information of the surrounding vehicle components) includes:
[0070] 0145: If the status information of the components of the surrounding vehicles is door opening information, mark the entire surrounding vehicle model 21 as the marking information 22 of the surrounding vehicle model 21.
[0071] In this way, when the doors of surrounding vehicles are open, the entire surrounding vehicle model 21 can be marked, thereby alerting the user.
[0072] Specifically, vehicle doors may include front doors, rear doors, front trunk, and rear trunk. The front doors, rear doors, front trunk, and rear trunk of surrounding vehicles may potentially affect or threaten the driving of vehicle 10. For example, an open front door or rear door may occupy the driving lane of vehicle 10, a half-open front door or rear door may indicate that someone is about to get off the vehicle, and an open trunk of the vehicle in front may cause cargo to fall out. If the status information of a component of a surrounding vehicle indicates that the door is open, it means that the door of the surrounding vehicle is open. Since an open door poses a threat to the driving of vehicle 10, the entire surrounding vehicle model 21 corresponding to the open door information can be marked as marking information 22 for the surrounding vehicle model 21. Marking methods include at least one of the following: outlining the surrounding vehicle model 21 (e.g., enhancing the outline of the surrounding vehicle model 21) or making the surrounding vehicle model 21 glow (adding a light visual effect to the surrounding vehicle model 21). Marking the entire surrounding vehicle model 21 strengthens the prompt, making it easier for the user to notice that the door is open. The user can then control the vehicle based on the marking information 22 of the surrounding vehicle model 21 to achieve safe driving. If the status information of a component of a surrounding vehicle indicates that the door is closed, it means that the door of the surrounding vehicle is closed. Since a closed door does not pose a threat to the driving of vehicle 10, marking information 22 for the surrounding vehicle model 21 is not generated, and the surrounding vehicle model 21 can be displayed normally.
[0073] Please see Figures 8 to 10 The status information of surrounding vehicle components includes door opening and closing information for each vehicle within a preset range of vehicle 10, and the display method also includes:
[0074] 018: If the status information of the surrounding vehicle's components is door open, determine the threatened lane 231 based on the door open information and mark the threatened lane 231 as a warning message 23.
[0075] In this way, if the doors of surrounding vehicles are open, the threatened lane 231 can be marked to warn the user.
[0076] Specifically, vehicle doors can include front doors, rear doors, front trunks, and rear trunks. The front doors, rear doors, front trunks, and rear trunks of surrounding vehicles can potentially affect or threaten the movement of vehicle 10. For example, an open front or rear door may obstruct vehicle 10's driving lane; a half-open front or rear door may indicate someone is about to get out; and an open trunk of the vehicle in front may allow cargo to fall out. If the status information of surrounding vehicle components indicates that the doors of the surrounding vehicles are open, it means that the doors of the surrounding vehicles are open. Since open doors threaten the movement of vehicle 10, the threatened lane 231 can be determined based on the door opening information. Figure 9As shown, when the door opening information indicates the trunk is open, cargo may fall out of the open trunk, thus determining that the lane behind the corresponding surrounding vehicle model 21 is the threatened lane 231; as Figure 10 As shown, when the door opening information indicates that the front right door is open, the opening of the front right door may obstruct the lane or someone may be about to get off the vehicle. Therefore, the right lane of the corresponding surrounding vehicle model 21 can be identified as the threatened lane 231. The threatened lane 231 can be marked as a prompt message 23. Marking methods include at least one of the following: coloring the threatened lane 231, highlighting the threatened lane 231, etc. Step 016 specifically involves: fusing the prompt message 23, the marking information 22, and the environmental simulation screen to generate a navigation simulation screen. This allows the user to easily detect that the door is open and see the threatened lane 231 through the prompt message 23. The user can then control the vehicle based on the prompt message 23, for example, by avoiding the threatened lane 231 to achieve safe driving. If the status information of the surrounding vehicle's components indicates that the door is closed, it means that the doors of the surrounding vehicles are closed. Since closed doors do not threaten the driving of vehicle 10, no prompt message 23 is generated.
[0077] In some implementations, the prompt can be given by combining at least two of the following methods: marking the door of the surrounding vehicle model 21 corresponding to the door opening information, marking the entire surrounding vehicle model 21, and marking the threatened lane 231. No specific limitation is made here.
[0078] Please see Figure 11 and Figure 12 The status information of surrounding vehicle components includes the headlight switch information and headlight color information of each vehicle within the preset range of vehicle 10. Step 014 (generating the marking information 22 of the surrounding vehicle model 21 based on the status information of surrounding vehicle components) includes:
[0079] 0146: When the headlight switch information is headlight on information and / or the headlight color information is preset color information, mark the headlights of the surrounding vehicle model 21 corresponding to the headlight on information as the marking information 22 of the surrounding vehicle model 21.
[0080] Thus, when the headlights of surrounding vehicles are on and / or set to a preset color, the headlights of the surrounding vehicle model 21 can be marked to warn the user.
[0081] Specifically, vehicle lights can include brake lights, turn signals, hazard warning lights (double flashers), etc. Brake lights, turn signals, and hazard warning lights are vehicle lights related to the driving posture or driving intention of surrounding vehicles. For example, when the brake lights of the vehicle in front are on, it means that the vehicle in front is trying to slow down, and vehicle 10 needs to maintain a safe distance from the vehicle in front; when the left turn signal is on, it means that surrounding vehicles are preparing to turn left; when the right turn signal is on, it means that surrounding vehicles are preparing to turn right; when the hazard warning lights are on, it means that surrounding vehicles may be in danger or have encountered a special situation. When the headlight switch information indicates that the headlights are on, it means that the headlights of surrounding vehicles are on. Since headlights are related to the driving posture or intention of surrounding vehicles, these vehicles may threaten the driving of vehicle 10. The headlights of the surrounding vehicle models 21 corresponding to the headlight-on information can be marked as marking information 22 for the surrounding vehicle models 21. Marking methods include at least one of the following: coloring the on headlights (using conspicuous colors such as red or yellow), highlighting the headlights, etc., so that the user can easily detect that the headlights are on. The user can then control the vehicle based on the marking information 22 of the surrounding vehicle models 21 to achieve safe driving. When the headlight switch information indicates that the headlights are off, it means that the headlights of surrounding vehicles are off and do not threaten the driving of vehicle 10. Therefore, marking information 22 for the surrounding vehicle models 21 is not generated, and the surrounding vehicle models 21 can be displayed normally. As for ambient lighting used for decoration or headlights used for illumination, these vehicles do not pose a threat to the driving of vehicle 10, so these situations can be ignored. Regardless of whether the ambient lighting or headlights are on, no marking information 22 for the surrounding vehicle model 21 is generated to avoid causing unnecessary interference to the user.
[0082] The preset color information can be, for example, colors commonly used for warnings, such as red or yellow. When the headlight color information is the preset color information, it indicates that the turned-on headlights are related to the driving posture or driving intention of surrounding vehicles (such as brake lights, turn signals, hazard warning lights, etc.), and therefore may threaten the driving of vehicle 10. The headlights of the surrounding vehicle model 21 corresponding to the headlights being turned on can be marked as marking information 22 of the surrounding vehicle model 21. The marking methods include: coloring the turned-on headlights (using more conspicuous colors such as red or yellow), highlighting the headlights, etc., at least one of these methods, so that the user can more easily find that the headlights used for warning are turned on. The user can control the vehicle according to the marking information 22 of the surrounding vehicle model 21 to achieve safe driving. If the headlight color information is not the preset color information, such as white, green, or blue, it means that the turned-on headlights are unrelated to the driving posture or driving intention of the surrounding vehicles (such as ambient lights, headlights, etc.). The surrounding vehicles will not threaten the driving of vehicle 10. Therefore, the marking information 22 of the surrounding vehicle model 21 is not generated, and the surrounding vehicle model 21 can be displayed normally.
[0083] Please see Figure 13 and Figure 14 The status information of surrounding vehicle components includes hazard warning light activation and deactivation information for each vehicle within a preset range of vehicle 10. Step 014 (generating marking information 22 for surrounding vehicle model 21 based on the status information of surrounding vehicle components) includes:
[0084] 0147: When the status information of the components of the surrounding vehicles is that the hazard warning flashers are on, mark the entire surrounding vehicle model 21 as the marking information 22 of the surrounding vehicle model 21.
[0085] In this way, when the hazard warning lights of surrounding vehicles are activated, the entire surrounding vehicle model 21 can be marked, thereby alerting the user.
[0086] Specifically, the vehicle lights may include hazard warning lights, which are related to the driving posture or intention of surrounding vehicles. For example, when hazard warning lights are activated, it indicates that a hazard or special situation may have occurred with the surrounding vehicles. If the status information of the surrounding vehicle's components indicates that the hazard warning lights are activated, it means that the hazard warning lights are on. Since the vehicle lights are related to the driving posture or intention of surrounding vehicles, these vehicles may threaten the driving of vehicle 10. The entire surrounding vehicle model 21 corresponding to the hazard warning light activation information can be marked as marking information 22 for the surrounding vehicle model 21. Marking methods include at least one of outlining the surrounding vehicle model 21 (e.g., enhancing the outline of the surrounding vehicle model 21) or making the surrounding vehicle model 21 illuminate (adding a light visual effect to the surrounding vehicle model 21). Marking the entire surrounding vehicle model 21 can enhance the prompt, allowing the user to more easily detect that the hazard warning lights of the surrounding vehicles are on. The user can then control the vehicle based on the marking information 22 of the surrounding vehicle model 21 to achieve safe driving. If the status information of the surrounding vehicle's components indicates that the hazard warning lights are off, it means that the surrounding vehicles' hazard warning lights are off and the surrounding vehicles will not threaten the driving of vehicle 10. Therefore, the marking information 22 for the surrounding vehicle model 21 is not generated, and the surrounding vehicle model 21 can be displayed normally.
[0087] In some implementations, step 014 includes: when the status information of the components of the surrounding vehicles is brake light on information and turn signal on information, marking the entire surrounding vehicle model 21 of the surrounding vehicles as marking information 22 of the surrounding vehicle model 21, which is not specifically limited here.
[0088] Please see Figure 15 and Figure 16 The status information of surrounding vehicle components includes hazard warning light activation and deactivation information for each vehicle within a preset range of vehicle 10. The display method also includes:
[0089] 019: If the status information of the surrounding vehicles' components indicates that the hazard warning lights are on and the speed of the surrounding vehicles is less than the speed of vehicle 10, mark the lane 232 in front of vehicle 10 as a warning message 23.
[0090] Thus, if the hazard warning lights of surrounding vehicles are on and the speed of surrounding vehicles is less than 10 km / h, lane 232 ahead can be marked to warn the user.
[0091] Specifically, the vehicle lights may include hazard warning lights. Hazard warning lights are lights that are related to the driving posture or intention of surrounding vehicles. For example, when hazard warning lights are activated, it indicates that a hazard or special situation may have occurred with surrounding vehicles. If the status information of surrounding vehicle components indicates that the hazard warning lights are activated, it means that the hazard warning lights are on. Because the lights are related to the driving posture or intention of surrounding vehicles, surrounding vehicles may threaten the driving of vehicle 10. Please refer to [link / reference]. Figure 16 When the speed of surrounding vehicles (e.g., the vehicle in front of vehicle 10) is less than the speed of vehicle 10, vehicle 10 is prone to collision with the vehicle in front. The lane 232 in front of vehicle 10 is a potential collision area. Therefore, the lane 232 in front of vehicle 10 can be marked as a warning message 23. The marking method includes at least one of the following: coloring the lane 232 in front, highlighting the lane 232 in front, etc. Step 016 can specifically be: merging the warning message 23, the marking information 22 and the environmental simulation screen to generate a navigation simulation screen. Thus, the user can more easily discover that the hazard warning flashers of the vehicle in front are on and the speed of the vehicle in front is less than the speed of vehicle 10 through the warning message 23 in the lane 232 in front. The user can control the vehicle according to the warning message 23, such as controlling vehicle 10 to decelerate or waiting for the vehicle in front to accelerate, in order to achieve safe driving. After vehicle 10 decelerates or the vehicle in front accelerates until the relative speed of the two vehicles is within a safe range, the lane 232 in front of vehicle 10 can no longer be marked. In one embodiment, the speed of the vehicle in front is less than the speed of vehicle 10. Specifically, the speed of the vehicle in front is much less than the speed of vehicle 10, meaning the difference between the speeds of vehicle 10 and the vehicle in front is greater than a preset speed difference. In this case, there is a significant safety hazard. Therefore, marking the lane 232 in front of vehicle 10 can better warn the user. If the status information of the surrounding vehicles' components is "hazard warning lights off" or the speed of the vehicle in front is greater than the speed of vehicle 10, the surrounding vehicles will not threaten the driving of vehicle 10, therefore, no warning message 23 is generated.
[0092] In some implementations, the prompt can be given by combining at least two of the following methods: the headlights of the surrounding vehicle model 21 corresponding to the headlight activation information, the overall marking of the surrounding vehicle model 21, and the marking of the lane 232 in front of the vehicle 10. No specific limitation is made here.
[0093] Please see Figure 17 The vehicle 10 of the present invention includes one or more processors 15 and a memory 17. The memory 17 stores a computer program, which, when executed by the processor 15, implements the steps of the display method of any of the above embodiments.
[0094] For example, when a computer program is executed by processor 15, the following can be achieved:
[0095] 012: After obtaining the lane-level data of the map and the environmental data of the vehicle 10 when it is driving on the current road, an environmental simulation screen is generated based on the lane-level data and the environmental data. The environmental simulation screen displays several lanes corresponding to the current road and the surrounding vehicle models 21 of the surrounding vehicles.
[0096] 014: Generate marking information 22 for the surrounding vehicle model 21 based on the status information of the surrounding vehicle's components;
[0097] 016: The marking information 22 of the surrounding vehicle models 21 is merged with the environmental simulation screen to generate a navigation simulation screen.
[0098] In the aforementioned vehicle 10, the user can know the status information of the components of the surrounding vehicles through the marking information 22 of the surrounding vehicle models 21, thereby facilitating the user's operation of the vehicle 10 and improving driving safety.
[0099] The computer-readable storage medium of the present invention stores a computer program thereon, which, when executed by the processor 15, implements the display method of any of the above embodiments.
[0100] For example, when a computer program is executed by processor 15, it can achieve the following:
[0101] 012: After obtaining the lane-level data of the map and the environmental data of the vehicle 10 when it is driving on the current road, an environmental simulation screen is generated based on the lane-level data and the environmental data. The environmental simulation screen displays several lanes corresponding to the current road and the surrounding vehicle models 21 of the surrounding vehicles.
[0102] 014: Generate marking information 22 for the surrounding vehicle model 21 based on the status information of the surrounding vehicle's components;
[0103] 016: The marking information 22 of the surrounding vehicle models 21 is merged with the environmental simulation screen to generate a navigation simulation screen.
[0104] In the aforementioned computer-readable storage medium, the user can know the status information of the components of the surrounding vehicles through the marking information 22 of the surrounding vehicle model 21, thereby facilitating the user's operation of the vehicle 10 and improving driving safety.
[0105] In this invention, the computer program includes computer program code. The computer program code can be in the form of source code, object code, executable file, or some intermediate form. The memory 17 can include high-speed random access memory, and can also include non-volatile memory, such as hard disk, RAM, plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, at least one disk storage device, flash memory device, or other volatile solid-state storage device. The processor 15 can be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor.
[0106] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of the present invention. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of different embodiments or examples.
[0107] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this invention, "a plurality of" means at least two, such as two, three, etc., unless otherwise explicitly specified.
[0108] Any process or method description in the flowchart or otherwise herein can be understood as representing a module, segment, or portion of code comprising one or more executable instructions for implementing a particular logical function or process, and the scope of the preferred embodiments of the invention includes additional implementations in which functions may be performed not in the order shown or discussed, including substantially simultaneously or in reverse order depending on the functions involved, as will be understood by those skilled in the art to which embodiments of the invention pertain.
[0109] Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention. Those skilled in the art can make changes, modifications, substitutions and variations to the above embodiments within the scope of the present invention.
Claims
1. A display method for an in-vehicle system, characterized in that, The in-vehicle system is installed in the vehicle, and the display method includes: Having acquired the lane-level data of the map and the environmental data of the vehicle traveling on the current road, an environmental simulation screen is generated based on the lane-level data and the environmental data. The environmental simulation screen displays several lanes corresponding to the current road and surrounding vehicle models of the surrounding vehicles. The surrounding vehicle model is marked with label information based on the status information of the components of the surrounding vehicles. The status information of the components of the surrounding vehicles includes the door opening information, headlight switch information, and headlight color information of each vehicle within a preset range. The step of generating the label information of the surrounding vehicle model based on the status information of the components of the surrounding vehicles includes marking the entire surrounding vehicle model corresponding to the door opening information as the label information of the surrounding vehicle model when the status information of the components of the surrounding vehicles is the door opening information, by at least one method of outlining or illuminating. The marking information of the surrounding vehicle models is fused with the environmental simulation screen to generate a navigation simulation screen.
2. The display method according to claim 1, characterized in that, The step of generating the tagging information of the surrounding vehicle model based on the state information of the surrounding vehicle components includes: Detect the status information of the components of the surrounding vehicles; Determine whether the surrounding vehicle's operation is threatened based on the status information of its components; In situations where the movement of the vehicle would be threatened, marker information for the surrounding vehicle models is generated.
3. The display method according to claim 1, characterized in that, The status information of the surrounding vehicle components includes the door opening and closing information of each vehicle within the preset range of the surrounding vehicles. The step of generating the marking information of the surrounding vehicle model based on the status information of the surrounding vehicle components includes: If the status information of the components of the surrounding vehicles is the door opening information, the door of the surrounding vehicle model corresponding to the door opening information is marked as the marking information of the surrounding vehicle model.
4. The display method according to claim 1, characterized in that, The status information of the surrounding vehicle components includes door opening and closing information for each vehicle within a preset range. The display method further includes: If the status information of the surrounding vehicle components indicates that the door is open, the threatened lane is determined based on the door opening information and the threatened lane is marked as a warning message.
5. The display method according to claim 1, characterized in that, The step of generating the tagging information of the surrounding vehicle model based on the state information of the surrounding vehicle components includes: When the headlight switch information is headlight on information and / or the headlight color information is preset color information, the headlights of the surrounding vehicle models corresponding to the headlight on information are marked as the marking information of the surrounding vehicle models.
6. The display method according to claim 1, characterized in that, The status information of the surrounding vehicle components includes hazard warning light activation and deactivation information for each vehicle within the preset range. The step of generating marking information for the surrounding vehicle model based on the status information of the surrounding vehicle components includes: If the status information of the components of the surrounding vehicles indicates that the hazard warning lights are on, the entire surrounding vehicle model is marked as the marking information of the surrounding vehicle model.
7. The display method according to claim 1, characterized in that, The status information of the surrounding vehicle components includes hazard warning light activation and deactivation information for each vehicle within the preset range of the vehicles. The display method further includes: If the status information of the surrounding vehicles' components indicates that the hazard warning lights are on and the speed of the surrounding vehicles is less than the speed of the vehicle in question, the lane ahead of the vehicle will be marked as a warning message.
8. A vehicle, characterized in that, The vehicle includes one or more processors and a memory, the memory storing a computer program that, when executed by the processor, implements the steps of the display method according to any one of claims 1-7.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the display method according to any one of claims 1-7.
Citation Information
Patent Citations
Display device for vehicle
CN108128243A
Display control apparatus, display apparatus, and display control method
CN109844837A
Vehicle control method and system, and vehicle
CN109849917A
Method and system for displaying surrounding environment in running process of vehicle
CN110758243A
Driving scene reconstruction method, device and system, vehicle, equipment and storage medium
CN111915915A