Real-time road condition display method and device, electronic equipment and storage medium

Abstract

The invention relates to the field of image processing, in particular to a real-time road condition display method and device, electronic equipment and a storage medium. According to the method provided by the embodiment of the invention, firstly, the driver monitoring device is called to monitor the eyeball position of the driver, then the target road condition data shielded by the vehicle engine hood are extracted from the real-time road condition data, and the virtual image display content is generated and displayed on the decoration table screen. And finally, adjusting display parameters by using eyeball positions, so that virtual image display contents and the current driving scene are naturally spliced, and a view blind area caused by a low posture is made up. No matter which sitting posture or visual angle the driver is in, the virtual image display content can be ensured to be always fit with the actual scene through monitoring and adjusting the eyeball position, so that sufficient road surface information is provided for the driver, the visual field is widened, the trouble caused by a low-posture driving position is effectively solved, and the driving safety and comfort are improved.

Description

Technical Field

[0001] The present invention relates to the field of image processing, and in particular to a method, device, electronic equipment and storage medium for displaying real-time road conditions. Background Art

[0002] In the current automobile market, an increasing number of personalized niche models are favored by consumers. Especially with the widespread popularity of electrification, the restrictions on vehicle styling have become less and less, making many models continue to pursue low-lying and flying-close-to-the-ground body posture design. However, this low-profile driving position brings a series of problems to ordinary drivers, mainly manifested in the increase of blind spots, narrow field of vision, and insufficient road information. Specifically, the low-profile driving position makes the driver's vision more obstructed during driving due to the low sitting posture, making it difficult to directly observe some areas in front, side and rear, which in turn affects the driver's perception of the surrounding environment and reduces driving safety and comfort. Summary of the invention

[0003] In view of this, an embodiment of the present invention provides a method, device, electronic device and storage medium for displaying real-time road conditions to solve the problem that ordinary drivers have large blind spots, narrow fields of vision and insufficient road information due to low-profile driving positions.

[0004] In a first aspect, an embodiment of the present invention provides a method for displaying real-time traffic conditions, the method comprising:

[0005] Invoking a driver monitoring device to monitor the driver and obtain the eye position of the driver;

[0006] Acquire real-time traffic data of a current driving scene of the vehicle, and extract target traffic data blocked by a vehicle hood of the vehicle from the real-time traffic data;

[0007] Generate virtual image display content using the target road condition data, and display the virtual image display content on the decoration platform screen;

[0008] The eyeball position is used to adjust the display parameters of the virtual image display content on the decoration platform screen, so that the adjusted virtual image display content is combined with the current driving scene.

[0009] Furthermore, the method of adjusting the display parameters of the virtual image display content on the decoration table screen by using the eyeball position includes:

[0010] Acquire the reference space coordinates, and acquire the eye space coordinates corresponding to the eye position;

[0011] Comparing the eyeball space coordinates with the reference space coordinates to obtain difference data between the eyeball space coordinates and the reference space coordinates;

[0012] An adjustment strategy corresponding to the difference data is obtained, and display parameters of the virtual image display content on the decoration table screen are adjusted according to the adjustment strategy.

[0013] Furthermore, the obtaining of the reference space coordinates includes:

[0014] Detecting facial features corresponding to the driver, and querying whether a driver account corresponding to the facial features is stored;

[0015] If there is a driver account corresponding to the facial feature, the preset spatial coordinates stored in the driver account are used as the reference spatial coordinates; or, if there is no driver account corresponding to the facial feature, the universal spatial coordinates are obtained from the cloud and used as the reference spatial coordinates.

[0016] Furthermore, adjusting the display parameters of the virtual image display content on the decoration platform screen according to the adjustment strategy includes:

[0017] If the difference data belongs to horizontal axis difference data, determining the horizontal axis offset direction and the horizontal axis offset value of the horizontal axis difference data;

[0018] Obtaining a zoom operation corresponding to the horizontal axis offset direction, and obtaining a zoom ratio corresponding to the horizontal axis offset value;

[0019] A scaling operation is performed on the virtual image display content according to the scaling ratio, and the virtual image display content after the scaling operation is performed is displayed on the decoration table screen.

[0020] Furthermore, adjusting the display parameters of the virtual image display content on the decoration platform screen according to the adjustment strategy includes:

[0021] If the difference data belongs to the longitudinal axis difference data, determining the longitudinal axis offset direction and the longitudinal axis offset value of the longitudinal axis difference data;

[0022] Obtaining a target perspective direction corresponding to the longitudinal axis offset direction, and obtaining a target perspective degree corresponding to the longitudinal axis offset value;

[0023] A perspective operation is performed on the virtual image display content in the target perspective direction according to the target perspective degree, and the virtual image display content after the perspective operation is performed is displayed on the decoration table screen.

[0024] Furthermore, adjusting the display parameters of the virtual image display content on the decoration platform screen according to the adjustment strategy includes:

[0025] If the difference data is vertical axis difference data, determining a vertical axis offset direction and a vertical axis offset value of the vertical axis difference data;

[0026] Obtaining a target distortion direction corresponding to the vertical axis offset direction, and obtaining a target distortion amplitude corresponding to the vertical axis offset value;

[0027] A perspective operation is performed on the virtual image display content in the target distortion direction according to the target distortion amplitude, and the virtual image display content after the distortion operation is performed is displayed on the decoration table screen.

[0028] Furthermore, the method further comprises:

[0029] Acquire vehicle driving data of the vehicle, and analyze whether the vehicle driving data and the real-time road condition data match a preset prompt rule;

[0030] If the preset prompt rule is hit, the prompt content and rendering method corresponding to the preset prompt rule are obtained;

[0031] The prompt content is rendered to the virtual image display content in the decoration table screen according to the rendering method.

[0032] In a second aspect, an embodiment of the present invention provides a device for displaying real-time traffic conditions, the device comprising:

[0033] A monitoring module, used for calling a driver monitoring device to monitor the driver and obtain the eye position of the driver;

[0034] An acquisition module, used to acquire real-time traffic data in a current driving scene of the vehicle, and extract target traffic data blocked by a vehicle hood of the vehicle from the real-time traffic data;

[0035] A display module, used for generating virtual image display content by using the target road condition data, and displaying the virtual image display content on the decoration platform screen;

[0036] The adjustment module is used to adjust the display parameters of the virtual image display content on the decoration platform screen by using the eyeball position, so that the adjusted virtual image display content is combined with the current driving scene.

[0037] In a third aspect, an embodiment of the present invention provides a computer device, comprising: a memory and a processor, the memory and the processor being communicatively connected to each other, the memory storing computer instructions, and the processor executing the method of the first aspect or any corresponding embodiment thereof by executing the computer instructions.

[0038] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium having computer instructions stored thereon, the computer instructions being used to enable a computer to execute the method of the first aspect or any corresponding embodiment thereof.

[0039] The method provided in the embodiment of the present application first calls the driver monitoring device to monitor the driver's eye position, then extracts the target road condition data blocked by the vehicle hood from the real-time road condition data, and generates virtual image display content to be displayed on the decorative table screen. Finally, the display parameters are adjusted using the eye position so that the virtual image display content is naturally combined with the current driving scene, making up for the blind spot caused by the low posture. Regardless of the driver's sitting posture or viewing angle, by monitoring and adjusting the eye position, it can be ensured that the virtual image display content is always in line with the actual scene, thereby providing the driver with sufficient road information and broadening the field of vision, effectively solving the problems caused by the low posture driving position, and improving driving safety and comfort. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0041] Figure 1 is a flowchart of a method for displaying real-time traffic conditions according to some embodiments of the present invention;

[0042] Figure 2 is a display effect diagram of real-time traffic conditions on a decoration platform screen according to some embodiments of the present invention;

[0043] Figure 3 is a flow chart of another method for displaying real-time traffic conditions according to some embodiments of the present invention;

[0044] Figure 4 is a display effect diagram of real-time traffic conditions on a decoration platform screen according to some embodiments of the present invention;

[0045] Figure 5 is a display effect diagram of real-time traffic conditions on a decoration platform screen according to some embodiments of the present invention;

[0046] Figure 6 is a display effect diagram of real-time traffic conditions on a decoration platform screen according to some embodiments of the present invention;

[0047] Figure 7 is a structural block diagram of a device for displaying real-time traffic conditions according to an embodiment of the present invention;

[0048] Figure 8 It is a schematic diagram of the hardware structure of a computer device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0049] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0050] According to an embodiment of the present invention, a method, device, electronic device and storage medium for displaying real-time traffic conditions are provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0051] In this embodiment, a method for displaying real-time traffic conditions is provided. Figure 1 is a flow chart of a method for displaying real-time traffic conditions according to an embodiment of the present invention. Figure 1 As shown, the process includes the following steps:

[0052] Step S101, calling a driver monitoring device to monitor the driver and obtain the driver's eye position.

[0053] In an embodiment of the present application, after the vehicle is started and enters the running state, it automatically enters the monitoring mode. At this time, it is confirmed that the driver monitoring system (DMS) is in normal working condition and has established a stable data connection with the vehicle system (including DHU). The eye tracking sensor in the DMS device starts working. These sensors can be camera-based, infrared or other advanced technology devices that can accurately capture the characteristics of the driver's face and eyeballs. The sensor continuously collects image data of the driver at a certain frequency (for example, 30 times per second) to ensure that the movement of the eyeballs can be tracked in real time. Sensors such as cameras obtain facial images of the driver, including information such as the position, shape, size and position of the eyes. For infrared sensors, it can determine the position and direction of the eyeball by detecting infrared light reflected by the eyeball.

[0054] The sensor transmits the collected image data to the processing unit in the vehicle system in real time. After receiving the image data, the vehicle system first performs image processing. The driver's facial features, especially the eye area, are identified using an image recognition algorithm. The exact position of the eye in the image is determined using an eye tracking algorithm. For example, the eye can be located based on the shape, color, reflection and other features of the pupil. Parameters such as the center position of the eye and the direction of sight are calculated, which will be used for subsequent spatial position calculations and image adjustments. The analyzed eye position data is sorted and formatted for subsequent processing and use. The sorted eye position data is then transmitted to the vehicle DHU (Display Head Unit) in real time. The DHU will use this data to compare with the reference spatial position saved by the user to perform operations such as image adjustment.

[0055] Step S102, acquiring real-time traffic data in the current driving scene of the vehicle, and extracting target traffic data blocked by the vehicle hood from the real-time traffic data.

[0056] In an embodiment of the present application, a variety of sensors are installed on the vehicle, including but not limited to cameras, millimeter-wave radars, laser radars, etc. These sensors collect information about the vehicle's surroundings from different angles and methods. The camera can capture image information in front of, behind, and on the sides of the vehicle; the millimeter-wave radar and laser radar can detect the distance, speed, and direction of objects. The sensor transmits the collected real-time road condition data to the central processing unit of the vehicle via wired or wireless means. The central processing unit integrates and preprocesses the data from different sensors, removes noise, calibrates timestamps, etc., to ensure the accuracy and consistency of the data.

[0057] By using the vehicle's design parameters and 3D modeling technology, an accurate digital model of the vehicle is constructed. This model includes information such as the location, size, and angle of the vehicle's hood. Then, the constructed vehicle digital model is fused with the environmental data collected by the sensor to determine the specific location of the vehicle's hood in the actual scene and the occlusion range it produces. After that, the real-time traffic data that has been fused is analyzed to determine which traffic data is within the occlusion area of ​​the vehicle's hood. Finally, the traffic data within the occlusion area of ​​the vehicle's hood is marked and defined as the target traffic data. The marked target traffic data is extracted from the real-time traffic data, including information such as the type, location, and speed of the occluded object.

[0058] Step S103: Generate virtual image display content using the target road condition data, and display the virtual image display content on the decoration platform screen.

[0059] In an embodiment of the present application, the target road condition data is further processed and converted into a format suitable for generating virtual image display content. For example, the position coordinates of the object are converted into coordinate values ​​in three-dimensional space. Based on the object information in the target road condition data, a virtual object model is created using three-dimensional modeling technology. For different types of objects such as vehicles and pedestrians, a predefined model library or a real-time generated model can be used. Based on the object's motion state data, the position and posture of the virtual object model are updated in real time so that it can accurately reflect the dynamics of the actual object.

[0060] Render the created virtual object model, add materials, textures, lighting effects, etc. to make it more realistic. Graphics processing units (GPUs) can be used to accelerate the rendering process and improve efficiency. Optimize the rendered image to remove possible defects such as jagged edges and blurs to improve image quality. At the same time, adjust parameters such as image transparency and brightness to better integrate it with the actual scene. Finally, the virtual image display content is obtained.

[0061] The generated virtual image display content is transmitted to the display controller of the decoration table screen through a data transmission line (such as HDMI, USB, etc.). The display controller superimposes the virtual image display content on the actual scene according to the selected display technology and displays it on the decoration table screen. The virtual image display content can be made more coordinated with the actual scene by adjusting the display parameters such as transparency, brightness, contrast, etc.

[0062] In addition, as the vehicle travels and the road conditions change, new target road condition data is continuously acquired and the virtual image display content is updated in real time, ensuring that the virtual image display content is always synchronized with the actual scene.

[0063] Step S104, adjusting the display parameters of the virtual image display content on the decoration platform screen by using the eyeball position, so that the adjusted virtual image display content is combined with the current driving scene.

[0064] In the embodiment of the present application, the eyeball position is compared with the reference space position (such as the reference coordinate system introduced when the vehicle leaves the factory or the personal coordinate system established according to the driver's personal habits). The difference between the eyeball position and the reference position in different axial directions is calculated, including the difference in the horizontal direction (X axis), the vertical direction (Y axis) and the depth direction (Z axis). According to the difference in different axial directions, the display parameters of the virtual image display content on the decoration table screen are adjusted through a specific algorithm.

[0065] By constantly monitoring the eyeball position and adjusting the display parameters of the virtual image content in real time, the virtual image can dynamically adjust its position, shape and perspective effect according to the driver's line of sight, so as to naturally merge with the current driving scene. Figure 2 shown.

[0066] The method provided in the embodiment of the present application first calls the driver monitoring device to monitor the driver's eye position, then extracts the target road condition data blocked by the vehicle hood from the real-time road condition data, and generates virtual image display content to be displayed on the decorative table screen. Finally, the display parameters are adjusted using the eye position so that the virtual image display content is naturally combined with the current driving scene, making up for the blind spot caused by the low posture. Regardless of the driver's sitting posture or viewing angle, by monitoring and adjusting the eye position, it can be ensured that the virtual image display content is always in line with the actual scene, thereby providing the driver with sufficient road information and broadening the field of vision, effectively solving the problems caused by the low posture driving position, and improving driving safety and comfort.

[0067] In the embodiment of the present application, the display parameters of the virtual image display content on the decoration table screen are adjusted by using the eyeball position, including the following steps A1-A3:

[0068] Step A1, obtaining the reference space coordinates, and obtaining the eye space coordinates corresponding to the eye position.

[0069] In the embodiment of the present application, obtaining the reference space coordinates includes: detecting the facial features corresponding to the driver, and querying whether a driver account corresponding to the facial features is stored. If there is a driver account corresponding to the facial features, the preset space coordinates stored in the driver account are used as the reference space coordinates. Alternatively, if there is no driver account corresponding to the facial features, the universal space coordinates are obtained from the cloud, and the universal space coordinates are used as the reference space coordinates.

[0070] Specifically, the driver monitoring device is called to take a photo of the driver's face. The facial recognition algorithm is used to extract the driver's facial features, such as the position and shape of the facial contour, eyes, nose, mouth and other feature points. The extracted facial features are digitized to generate a unique facial feature vector.

[0071] The vehicle system searches the locally stored driver account database for a driver account that matches the currently detected facial feature vector. If a matching driver account is found in the local database, it means that the driver has used the vehicle before and established a personal coordinate system. From the matching driver account, the stored preset spatial coordinates (reference spatial coordinates in the personal coordinate system) are read. It can be understood that the preset spatial coordinates are established and saved in the personal account data when the driver used the vehicle before.

[0072] If no matching driver account is found in the local database, the vehicle system will send a request to the cloud server, which contains the currently detected facial feature vector for further query and processing by the cloud server. After receiving the request, the cloud server queries the universal space coordinate database stored in it. Universal space coordinates can be understood as a relatively universal reference space coordinate based on ergonomic principles and a large amount of user data statistics. The cloud server returns the queried universal space coordinates to the vehicle system. After receiving the universal space coordinates returned by the cloud, the vehicle system uses them as the reference space coordinates of the current driver.

[0073] After obtaining the reference space coordinates, the eye space coordinates corresponding to the driver's eye position are obtained.

[0074] Step A2, comparing the eye space coordinates with the reference space coordinates to obtain difference data between the eye space coordinates and the reference space coordinates.

[0075] Specifically, the calculation of the horizontal axis difference data: calculate the difference between the eye space coordinates and the reference space coordinates on the horizontal axis, that is, X_difference = X_eye-X_base. This difference represents the offset of the eye relative to the reference position in the horizontal axis direction. If the difference is positive, it means that the eye position is to the right of the reference position; if the difference is negative, it means that the eye position is to the left of the reference position.

[0076] Calculate the difference between the eye space coordinates and the reference space coordinates on the vertical axis (Y axis), that is, Y_difference = Y_eye-Y_base. The difference represents the offset of the eye relative to the reference position in the vertical axis (Y axis) direction. If the difference is positive, it means that the eye position is above the reference position; if the difference is negative, it means that the eye position is below the reference position.

[0077] Calculation of vertical axis (Z axis) difference data: Calculate the difference between the eyeball space coordinates and the reference space coordinates on the vertical axis (Z axis), that is, Z_difference = Z_eye-Z_base. The difference represents the depth offset of the eyeball relative to the reference position in the vertical axis (Z axis) direction. If the difference is positive, it means that the eyeball position is closer to the screen than the reference position; if the difference is negative, it means that the eyeball position is farther from the screen than the reference position.

[0078] The sorted difference data is transmitted to the vehicle computer DHU. The DHU will use this difference data to adjust the image size, left and right and up and down perspective distortion through algorithms to make the image adapt to the driver's perspective changes.

[0079] Step A3, obtaining an adjustment strategy corresponding to the difference data, and adjusting display parameters of the virtual image display content on the decoration table screen according to the adjustment strategy.

[0080] Specifically, the display parameters of the virtual image display content on the decoration table screen are adjusted according to the adjustment strategy, including: if the difference data belongs to the horizontal axis difference data, the horizontal axis offset direction and the horizontal axis offset value of the horizontal axis difference data are determined. The zoom operation corresponding to the horizontal axis offset direction is obtained, and the zoom ratio corresponding to the horizontal axis offset value is obtained. The virtual image display content is zoomed in and out according to the zoom ratio, and the virtual image display content after the zoom operation is performed is displayed on the decoration table screen.

[0081] First, analyze the horizontal axis difference data to determine its direction (positive or negative) and numerical value. If the difference is positive, it means that the eye position is on the right side of the reference position, that is, the horizontal axis offset direction is to the right; if the difference is negative, it means that the eye position is on the left side of the reference position, that is, the horizontal axis offset direction is to the left. The numerical value represents the horizontal axis offset value, which reflects the degree to which the eye deviates from the reference position in the horizontal axis direction. Secondly, determine the corresponding zoom operation according to the horizontal axis offset direction. If the horizontal axis offset direction is positive (to the right), the corresponding zoom operation is to enlarge the image ratio; if the horizontal axis offset direction is negative (to the left), the corresponding zoom operation is to reduce the image ratio.

[0082] Next, the scaling ratio is determined according to the magnitude of the horizontal axis offset value. A larger positive difference corresponds to a larger image magnification ratio, and a smaller positive difference corresponds to a smaller magnification; similarly, a larger negative difference corresponds to a larger image reduction ratio, and a smaller negative difference corresponds to a smaller reduction. Then, the virtual image display content is scaled according to the determined scaling ratio. If it is a zoom-in operation, the size of the virtual image display content is proportionally increased in the horizontal axis direction; if it is a zoom-out operation, the size of the virtual image display content is proportionally reduced in the horizontal axis direction. Finally, the virtual image display content after the zoom operation is performed is displayed on the decorative table screen. Technologies such as transparent display and augmented reality display can be used to better integrate the virtual image with the actual scene, providing the driver with a more intuitive and clear visual experience.

[0083] Specifically, the display parameters of the virtual image display content on the decoration table screen are adjusted according to the adjustment strategy, including: if the difference data belongs to the longitudinal axis difference data, the longitudinal axis offset direction and the longitudinal axis offset value of the longitudinal axis difference data are determined. The target perspective direction corresponding to the longitudinal axis offset direction is obtained, and the target perspective degree corresponding to the longitudinal axis offset value is obtained. According to the target perspective degree, the virtual image display content is perspective-operated in the target perspective direction, and the virtual image display content after the perspective operation is performed is displayed on the decoration table screen.

[0084] First, analyze the vertical axis difference data. If the difference is positive, it means that the eyeball position is above the reference position, and the vertical axis offset direction is upward; if the difference is negative, it means that the eyeball position is below the reference position, and the vertical axis offset direction is downward. The value represents the vertical axis offset value, which reflects the degree to which the eyeball deviates from the reference position in the vertical axis direction. Secondly, determine the target perspective direction based on the vertical axis offset direction. When the vertical axis offset direction is positive (upward), the target perspective direction is to see through to the left; when the vertical axis offset direction is negative (downward), the target perspective direction is to see through to the right.

[0085] Next, the target perspective is determined based on the vertical axis offset value. Generally speaking, the larger the vertical axis offset value, the stronger the target perspective; the smaller the vertical axis offset value, the weaker the target perspective.

[0086] Then, according to the determined target perspective degree, the virtual image display content is perspective-operated in the target perspective direction. This can be achieved through image processing algorithms, adjusting the shape, angle, and size of the virtual image to simulate the perspective effect. For example, if the target perspective direction is to perspective to the left, and the target perspective degree is strong, then the left part of the virtual image display content is deformed and stretched to a greater extent to make it look closer to the observer. Finally, the virtual image display content after the perspective operation is displayed on the decoration table screen. Ensure the integration of the virtual image and the actual scene, so that the driver can clearly see the virtual image display content and feel the coordination of the perspective effect with the actual driving environment.

[0087] Specifically, the display parameters of the virtual image display content on the decoration table screen are adjusted according to the adjustment strategy, including: if the difference data is vertical axis difference data, the vertical axis offset direction and the vertical axis offset value of the vertical axis difference data are determined. The target distortion direction corresponding to the vertical axis offset direction is obtained, and the target distortion amplitude corresponding to the vertical axis offset value is obtained. The virtual image display content is perspective-operated in the target distortion direction according to the target distortion amplitude, and the virtual image display content after the distortion operation is performed is displayed on the decoration table screen.

[0088] First, analyze the vertical axis difference data. If the difference is positive, it means that the eye position is closer to the screen than the reference position, and the vertical axis offset direction is upward; if the difference is negative, it means that the eye position is farther from the screen than the reference position, and the vertical axis offset direction is downward. The value represents the vertical axis offset value, which reflects the degree to which the eye deviates from the reference position in the vertical axis direction. Secondly, determine the target distortion direction based on the vertical axis offset direction. When the vertical axis offset direction is positive (upward), the target distortion direction is to distort upward; when the vertical axis offset direction is negative (downward), the target distortion direction is to distort downward.

[0089] Next, the target distortion amplitude is determined according to the size of the vertical axis offset value. The larger the vertical axis offset value, the stronger the target distortion amplitude; the smaller the vertical axis offset value, the weaker the target distortion amplitude. Then, according to the determined target distortion amplitude, the virtual image display content is distorted in the target distortion direction. Image processing algorithms can be used to distort, stretch, or compress specific areas of the image to achieve the distortion effect. For example, if the target distortion direction is to distort upward and the target distortion amplitude is strong, then the upper part of the virtual image display content is distorted and stretched to a greater extent to make its deformation amplitude larger. Finally, the virtual image display content after the distortion operation is displayed on the decoration table screen. Ensure the integration of the virtual image and the actual scene, so that the driver can clearly see the virtual image display content and feel the coordination of the distortion effect with the actual driving environment.

[0090] It should be noted that due to the presence of the vehicle hood, the driver may not be able to directly observe the obscured area in some cases. Extracting these target road condition data and presenting them in the form of virtual image display content can allow the driver to promptly understand the road condition information that was originally invisible, such as obstacles at a lower position in front, changes in road conditions near the bottom of the vehicle, etc. Secondly, by obtaining and displaying the obscured road condition data, the driver can make more accurate judgments and decisions in advance to avoid potential dangers caused by the unknown obscured area, such as being able to respond more quickly when encountering sudden obstacles during driving. Furthermore, it can improve the driving experience and convenience. The driver does not need to try to observe the obscured area by drastically adjusting his body posture or line of sight, but can directly see the adjusted virtual image display content that is spliced ​​with the current driving scene on the decorative table screen, reducing fatigue and discomfort during driving.

[0091] Figure 3 is a flow chart of a method for displaying real-time traffic conditions according to an embodiment of the present invention. Figure 3 As shown, the method also includes:

[0092] Step S201, obtaining the vehicle driving data of the vehicle, and analyzing the vehicle driving data and the real-time road condition data to see whether they match the preset prompt rules.

[0093] In the present embodiment, the vehicle driving data can be obtained through various sensors and systems on the vehicle. For example, the vehicle speed can be obtained from the vehicle's speed sensor; the acceleration can be obtained from the acceleration sensor; the steering angle can be obtained from the steering system, etc. The preset prompt rules can be set according to traffic regulations, safe driving requirements, and navigation information. For example, the rule that the vehicle needs to stop at a zebra crossing can be determined by detecting whether there is a zebra crossing in front of the vehicle and the speed and position of the vehicle; the rule that the vehicle is close to the front vehicle can be determined by detecting the distance to the front vehicle by radar and comparing it with the preset safety distance; the navigation prompt rule can be determined based on the route information and current position provided by the navigation system.

[0094] Analyze the vehicle driving data and real-time traffic data to see if they match the preset prompt rules. For example: determine the vehicle's position and speed based on the vehicle driving data. Determine the position and speed of the vehicle in front or the pedestrian in front based on the real-time traffic conditions, and judge whether there is a risk of collision or the distance is close. If there is a risk of collision or the distance is close, determine that the preset prompt rules are matched. Alternatively, determine the vehicle's position based on the vehicle driving data, and determine whether there is a zebra crossing in front of the vehicle based on the real-time traffic data. If there is a zebra crossing, obtain the distance between the vehicle and the zebra crossing. If the distance is within the preset distance, determine that the preset prompt rules are matched.

[0095] Step S202: if the preset prompt rule is matched, the prompt content and rendering method corresponding to the preset prompt rule are obtained.

[0096] In the present embodiment, when it is determined that the vehicle driving data and the real-time road condition data hit the preset prompt rule, it is determined which preset prompt rule is hit. For each preset prompt rule, the corresponding prompt content and rendering method can be preset. For example, for the rule that you need to stop at a zebra crossing, the prompt content can be "There is a zebra crossing ahead, please slow down and stop"; for the rule that you are close to the vehicle in front, the prompt content can be "Please keep a safe distance from the vehicle", etc. These prompt contents can be stored in the memory of the vehicle-mounted system, and when the corresponding rule is hit, the corresponding prompt content is read from the memory.

[0097] The rendering mode determines how the prompt content is displayed on the decoration console screen. Different prompt rules can have different rendering modes to attract the driver's attention and ensure clear communication of information. The rendering mode can include text color, size, font, flashing effect, background color, etc. For example, for urgent prompt rules, red flashing text can be used; for general prompt rules, yellow text can be used, etc. For example, if the rendering mode includes red text and flashing effect, determine the parameters such as the red value of the text and the flashing frequency.

[0098] Step S203: Render the prompt content to the virtual image display content on the decoration platform screen according to the rendering method.

[0099] In an embodiment of the present application, the prompt content is merged with the virtual image display content in the decoration table screen in a rendering manner. This can be achieved through graphics processing technology, where the prompt content is superimposed on the virtual image display content. The virtual image display content merged with the prompt content is displayed on the decoration table screen. The decoration table screen can be a device such as a liquid crystal display screen, a head-up display (HUD), etc.

[0100] The method provided in the embodiment of the present application can timely detect potential dangerous situations or special road conditions by acquiring vehicle driving data and real-time road condition data and analyzing whether the preset prompt rules are hit, and provide active safety protection for the driver. For example, a warning can be issued in time when the vehicle is too close to the vehicle in front, an obstacle appears in front, or a zebra crossing is about to be reached. Secondly, when the preset prompt rules are hit, the corresponding prompt content and rendering method are obtained, and important information can be conveyed to the driver in a more intuitive and personalized way. Different prompt rules can use different rendering methods, such as specific colors, fonts, flashing effects, etc., to attract the driver's attention and ensure that they can quickly understand and respond correctly. Finally, the prompt content is rendered to the virtual image display content in the decorative table screen, which realizes the fusion of information and actual driving scenes, does not distract the driver's attention too much, and enables them to obtain key information without having to significantly divert their sight, thereby improving the safety and convenience of driving.

[0101] As an example, a vehicle-mounted radar (such as a millimeter wave radar) is used to detect the position and speed of the vehicle in front. The radar emits electromagnetic waves to the front of the vehicle. When the electromagnetic waves encounter the object in front, they are reflected back. By measuring the time and intensity of the reflected waves, the distance, relative speed, angle and other information of the vehicle in front can be calculated. Alternatively, a laser radar is used to construct a point cloud map of the surrounding environment by emitting a laser beam and measuring the time of reflected light, thereby detecting obstacles. Then, the collision time (TTC, Time To Collision) is calculated based on the relative distance and relative speed. If the TTC is less than the preset safety time threshold, it is considered that there is a collision risk. Factors such as the acceleration, braking performance and driver's reaction time of the vehicle can also be considered to make a more accurate assessment of the collision risk. Next, the safety distance threshold is determined, and the distance information between the vehicle and the vehicle in front is compared with the safety distance threshold to determine whether the distance is close. The safety distance threshold can be dynamically adjusted according to factors such as the vehicle's speed, road conditions and driving environment. If it is determined that there is a risk of collision or the distance is close, it is determined that the preset prompt rule (close to the vehicle in front / there is a risk of collision) is hit. At this time, the prompt message is "Keep the distance between vehicles" or "Slow down, there is a risk of collision". Then, the prompt message is rendered into the virtual image display content according to the corresponding rendering method. The rendering effect is as follows: Figure 4 shown.

[0102] As another example, an image of the road in front of the vehicle taken by the vehicle's forward-facing camera is obtained. The image taken by the camera is analyzed using an image recognition algorithm. These algorithms can identify zebra crossing features and signal light features in the image, such as stripe shape, color, etc. If a zebra crossing is detected in the image, it is determined that there is a zebra crossing in front of the vehicle. The distance information between the vehicle and each point of the zebra crossing can be detected by a sensor. According to traffic regulations and safety considerations, the acquired distance between the vehicle and the zebra crossing is compared with a preset distance threshold (which can be adjusted according to different regions, road types and traffic conditions). If the distance is less than or equal to the preset distance threshold, and the light state of the signal light is red, it is determined that the preset prompt rule is hit (the distance to the zebra crossing is close and the light state of the signal light is red). At this time, the prompt information is "There is a zebra crossing ahead, and red light prohibits driving", and then the prompt information is rendered to the virtual image display content according to the corresponding rendering method. The rendering effect is as follows. Figure 5 shown.

[0103] As another example, the vehicle determines the obstacle ahead or the degree of congestion based on real-time traffic data. The degree of congestion can be determined by factors such as the vehicle's speed, driving time, and the distance between other vehicles. If the congestion is high, the navigation system will consider updating the driving route to avoid the congested area. The system can find nearby roads, assess their congestion, and select a less congested route. Taking into account obstacles and congestion levels, the vehicle's system will decide whether to update the driving route / navigation information. If updating the route can reduce driving time, improve safety, or avoid danger, the system will trigger a route update and determine that the preset prompt rules are hit. The prompt information is the corresponding route update information, and then the prompt information is rendered to the virtual image display content according to the corresponding rendering method. The rendering effect is as follows Figure 6 shown.

[0104] In the present embodiment, a display device for real-time traffic conditions is also provided, and the device is used to implement the above-mentioned embodiments and preferred implementation modes, and the descriptions that have been made will not be repeated. As used below, the term "module" can implement a combination of software and / or hardware of a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceivable.

[0105] This embodiment provides a device for displaying real-time traffic conditions, such as Figure 7 As shown, including:

[0106] A monitoring module 701 is used to call a driver monitoring device to monitor the driver and obtain the eye position of the driver;

[0107] An acquisition module 702 is used to acquire real-time traffic data in a current driving scene of the vehicle, and extract target traffic data blocked by a vehicle hood of the vehicle from the real-time traffic data;

[0108] A display module 703, used to generate virtual image display content using the target road condition data, and display the virtual image display content on the decoration platform screen;

[0109] The adjustment module 704 is used to adjust the display parameters of the virtual image display content on the decoration platform screen by using the eyeball position, so that the adjusted virtual image display content is combined with the current driving scene.

[0110] In the embodiment of the present application, the adjustment module 704 includes:

[0111] The acquisition submodule is used to acquire the reference space coordinates and the eye space coordinates corresponding to the eye position.

[0112] A comparison submodule, used for comparing the eye space coordinates with the reference space coordinates to obtain difference data between the eye space coordinates and the reference space coordinates;

[0113] The execution submodule is used to obtain the adjustment strategy corresponding to the difference data, and adjust the display parameters of the virtual image display content on the decoration table screen according to the adjustment strategy.

[0114] In the embodiment of the present application, the acquisition submodule is used to detect the facial features corresponding to the driver and query whether there is a driver account corresponding to the facial features stored. If there is a driver account corresponding to the facial features, the preset spatial coordinates stored in the driver account are used as the reference spatial coordinates. Or, if there is no driver account corresponding to the facial features, the universal spatial coordinates are obtained from the cloud and used as the reference spatial coordinates.

[0115] In the embodiment of the present application, the execution submodule is used to determine the horizontal axis offset direction and the horizontal axis offset value of the horizontal axis difference data if the difference data belongs to the horizontal axis difference data, obtain the zoom operation corresponding to the horizontal axis offset direction, and obtain the zoom ratio corresponding to the horizontal axis offset value, perform the zoom operation on the virtual image display content according to the zoom ratio, and display the virtual image display content after the zoom operation on the decoration table screen.

[0116] In the embodiment of the present application, the execution submodule is used to determine the longitudinal axis offset direction and longitudinal axis offset value of the longitudinal axis difference data if the difference data belongs to the longitudinal axis difference data. Obtain the target perspective direction corresponding to the longitudinal axis offset direction, and obtain the target perspective degree corresponding to the longitudinal axis offset value. Perform a perspective operation on the virtual image display content in the target perspective direction according to the target perspective degree, and display the virtual image display content after the perspective operation on the decoration table screen.

[0117] In the embodiment of the present application, the execution submodule is used to determine the vertical axis offset direction and the vertical axis offset value of the vertical axis difference data if the difference data is the vertical axis difference data. Obtain the target distortion direction corresponding to the vertical axis offset direction, and obtain the target distortion amplitude corresponding to the vertical axis offset value. Perform a perspective operation on the virtual image display content in the target distortion direction according to the target distortion amplitude, and display the virtual image display content after the distortion operation on the decoration table screen.

[0118] In an embodiment of the present application, the device further includes: an update module, which is used to obtain vehicle driving data of the vehicle, analyze whether the vehicle driving data and real-time road condition data hit the preset prompt rule. If the preset prompt rule is hit, the prompt content and rendering method corresponding to the preset prompt rule are obtained. The prompt content is rendered to the virtual image display content in the decoration table screen according to the rendering method.

[0119] See also Figure 8 , Figure 8is a schematic diagram of the structure of a computer device provided by an optional embodiment of the present invention, such as Figure 8 As shown, the computer device includes: one or more processors 10, a memory 20, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. Various components are connected to each other using different buses for communication, and can be installed on a common mainboard or installed in other ways as needed. The processor can process the instructions executed in the computer device, including instructions stored in or on the memory to display the graphical information of the GUI on an external input / output device (such as, a display device coupled to the interface). In some optional embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple computer devices can be connected, and each device provides some necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Figure 8 A processor 10 is taken as an example.

[0120] The processor 10 may be a central processing unit, a network processor or a combination thereof. The processor 10 may further include a hardware chip. The hardware chip may be a dedicated integrated circuit, a programmable logic device or a combination thereof. The programmable logic device may be a complex programmable logic device, a field programmable gate array, a general purpose array logic or any combination thereof.

[0121] The memory 20 stores instructions executable by at least one processor 10, so that the at least one processor 10 executes the method shown in the above embodiment.

[0122] The memory 20 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created by the use of a computer device based on the presentation of a small program landing page, etc. In addition, the memory 20 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some optional embodiments, the memory 20 may optionally include a memory remotely arranged relative to the processor 10, and these remote memories may be connected to the computer device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0123] The memory 20 may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a flash memory, a hard disk or a solid state drive; the memory 20 may also include a combination of the above types of memory.

[0124] The computer device further comprises a communication interface 30 for the computer device to communicate with other devices or a communication network.

[0125] The embodiment of the present invention also provides a computer-readable storage medium. The method according to the embodiment of the present invention can be implemented in hardware, firmware, or can be implemented as a computer code that can be recorded in a storage medium, or can be implemented as a computer code that is originally stored in a remote storage medium or a non-temporary machine-readable storage medium and will be stored in a local storage medium through a network download, so that the method described herein can be stored in such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only storage memory, a random access memory, a flash memory, a hard disk or a solid-state hard disk, etc.; further, the storage medium can also include a combination of the above types of memories. It can be understood that a computer, a processor, a microprocessor controller, or programmable hardware includes a storage component that can store or receive software or computer code. When the software or computer code is accessed and executed by a computer, a processor, or hardware, the method shown in the above embodiment is implemented.

[0126] Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the present invention, and such modifications and variations are all within the scope defined by the appended claims.

Claims

1. A method for displaying real-time traffic conditions, characterized in that: The method comprises: Invoking a driver monitoring device to monitor the driver and obtain the eye position of the driver; Acquire real-time traffic data of a current driving scene of the vehicle, and extract target traffic data blocked by a vehicle hood of the vehicle from the real-time traffic data; Generate virtual image display content using the target road condition data, and display the virtual image display content on the decoration platform screen; The eyeball position is used to adjust the display parameters of the virtual image display content on the decoration platform screen, so that the adjusted virtual image display content is combined with the current driving scene.

2. The method according to claim 1, characterized in that The method of adjusting the display parameters of the virtual image display content on the decoration platform screen by using the eyeball position includes: Acquire the reference space coordinates, and acquire the eye space coordinates corresponding to the eye position; Comparing the eyeball space coordinates with the reference space coordinates to obtain difference data between the eyeball space coordinates and the reference space coordinates; An adjustment strategy corresponding to the difference data is obtained, and display parameters of the virtual image display content on the decoration table screen are adjusted according to the adjustment strategy.

3. The method according to claim 2, characterized in that The obtaining of reference space coordinates includes: Detecting facial features corresponding to the driver, and querying whether a driver account corresponding to the facial features is stored; If there is a driver account corresponding to the facial feature, the preset spatial coordinates stored in the driver account are used as the reference spatial coordinates; or, if there is no driver account corresponding to the facial feature, the universal spatial coordinates are obtained from the cloud and used as the reference spatial coordinates.

4. The method according to claim 2, characterized in that: The step of adjusting the display parameters of the virtual image display content on the decoration platform screen according to the adjustment strategy includes: If the difference data belongs to horizontal axis difference data, determining the horizontal axis offset direction and the horizontal axis offset value of the horizontal axis difference data; Obtaining a zoom operation corresponding to the horizontal axis offset direction, and obtaining a zoom ratio corresponding to the horizontal axis offset value; A scaling operation is performed on the virtual image display content according to the scaling ratio, and the virtual image display content after the scaling operation is performed is displayed on the decoration table screen.

5. The method according to claim 2, characterized in that: The step of adjusting the display parameters of the virtual image display content on the decoration platform screen according to the adjustment strategy includes: If the difference data belongs to the longitudinal axis difference data, determining the longitudinal axis offset direction and the longitudinal axis offset value of the longitudinal axis difference data; Obtaining a target perspective direction corresponding to the longitudinal axis offset direction, and obtaining a target perspective degree corresponding to the longitudinal axis offset value; A perspective operation is performed on the virtual image display content in the target perspective direction according to the target perspective degree, and the virtual image display content after the perspective operation is performed is displayed on the decoration table screen.

6. The method according to claim 2, characterized in that The step of adjusting the display parameters of the virtual image display content on the decoration platform screen according to the adjustment strategy includes: If the difference data is vertical axis difference data, determining a vertical axis offset direction and a vertical axis offset value of the vertical axis difference data; Obtaining a target distortion direction corresponding to the vertical axis offset direction, and obtaining a target distortion amplitude corresponding to the vertical axis offset value; A perspective operation is performed on the virtual image display content in the target distortion direction according to the target distortion amplitude, and the virtual image display content after the distortion operation is performed is displayed on the decoration table screen.

7. The method according to claim 1, characterized in that The method further comprises: Acquire vehicle driving data of the vehicle, and analyze whether the vehicle driving data and the real-time road condition data match a preset prompt rule; If the preset prompt rule is hit, the prompt content and rendering method corresponding to the preset prompt rule are obtained; The prompt content is rendered to the virtual image display content in the decoration table screen according to the rendering method.

8. A device for displaying real-time traffic conditions, characterized in that: The device comprises: A monitoring module, used for calling a driver monitoring device to monitor the driver and obtain the eye position of the driver; An acquisition module, used to acquire real-time traffic data in a current driving scene of the vehicle, and extract target traffic data blocked by a vehicle hood of the vehicle from the real-time traffic data; A display module, used to generate virtual image display content using the target road condition data, and display the virtual image display content on a decoration platform screen; The adjustment module is used to adjust the display parameters of the virtual image display content on the decoration platform screen by using the eyeball position, so that the adjusted virtual image display content is combined with the current driving scene.

9. A computer device, characterized in that: include: A memory and a processor, wherein the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the method according to any one of claims 1 to 7 by executing the computer instructions.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a computer to execute the method according to any one of claims 1 to 7.

Images