Screen display method, device, equipment and storage medium

By calculating the danger index of the car's driving status parameters, determining and highlighting key content modules, the problem of drivers being unable to obtain important information in a timely manner in dangerous situations is solved, thereby improving the safety of the car.

CN115848139BActive Publication Date: 2025-09-05WUHU AUTOMOBILE ADVANCED TECHNOLOGY INSTITUTE +1
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202211430021.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-11-15
Publication Date
2025-09-05
Estimated Expiration
2042-11-15

AI Technical Summary

Technical Problem

On the car display screen, when the driver's eyes fall on the navigation information in a dangerous situation, the relevant technology cannot obtain the danger-related information in time, resulting in lower safety.

Method used

By obtaining multiple driving status parameters of the target vehicle, calculating the first hazard index and the second hazard index, determining the key content module, and highlighting it at the intersection of the driver's line of sight and the screen to remind the driver to adjust the driving status.

Benefits of technology

It can timely remind the driver of key information in dangerous situations, thus improving the safety of the car.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115848139B_ABST
    Figure CN115848139B_ABST
Patent Text Reader

Abstract

The embodiments of the present application disclose a method, apparatus, device, and storage medium for screen display, which pertains to the automotive field. The method comprises: obtaining the value of a driving state parameter of a target vehicle whenever a detection cycle is reached; determining a corresponding target level value based on the value, further determining a corresponding weight value, and performing a weighted summation of the target level values ​​to obtain a first danger index; when the first danger index is greater than a first danger index threshold, determining the driving state parameter corresponding to a key content module, further determining a corresponding weight value, and performing a weighted summation of the corresponding target level values ​​to obtain a second danger index; determining the key content module with the largest second danger index as the target key content module; and when the spatial straight lines corresponding to the driver's line of sight have an intersection on the screen, highlighting the target key content module at the intersection. Using the embodiments of the present application can improve safety.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of automotive technology, and in particular to a screen display method, device, equipment, and storage medium. Background Art

[0002] In the field of automotive technology, a car's display screen displays information such as vehicle-machine interaction, navigation, and ADAS (advanced driving assistance system) related information. When a driver needs to access a specific piece of information, other information on the display screen may interfere with the driver's ability to access it.

[0003] Therefore, most cars are equipped with a DMS (Drive Monitoring System) that can identify the point on the driver's line of sight display. The car can obtain the coordinates of the point and highlight a display range centered on the coordinates of the point.

[0004] However, in related technologies, if the car is in a dangerous state (for example, speeding) and the driver's gaze is focused on navigation information on the screen, the car will highlight the navigation information, preventing the driver from timely accessing the most relevant information about the dangerous situation, which may cause a safety accident. Therefore, related technologies have low safety. Summary of the Invention

[0005] The embodiments of the present application provide a screen display method, apparatus, device, and storage medium that can solve the problems of related technologies. The technical solution is as follows:

[0006] In a first aspect, a screen display method is provided. The method is applied to an onboard terminal of a target vehicle, wherein the onboard terminal has a screen, and the display content of the screen is composed of multiple content modules, wherein the multiple content modules include multiple pre-designated key content modules. The method includes:

[0007] Whenever a detection cycle is reached, current values ​​of multiple driving state parameters of the target vehicle are obtained;

[0008] For each driving state parameter, based on a pre-stored correspondence between the value range of the driving state parameter and the level value, determining a target level value corresponding to the value range to which the current value of the driving state parameter belongs, and obtaining the target level value corresponding to the driving state parameter;

[0009] Determining a weight value corresponding to each driving state parameter based on a target level value corresponding to each driving state parameter;

[0010] Based on the weight value corresponding to each driving state parameter, performing weighted summation on the target level value corresponding to each driving state parameter to obtain a first risk index;

[0011] determining that the first risk index is greater than a first risk index threshold;

[0012] For each key content module, determining a pre-recorded driving state parameter corresponding to the key content module, and based on a weight value corresponding to each driving state parameter corresponding to the key content module, performing a weighted summation on the target level value corresponding to each driving state parameter corresponding to the key content module to obtain a second risk index corresponding to the key content module;

[0013] determining at least one key content module whose second risk index is greater than a second risk index threshold;

[0014] determining the key content module with the largest second risk index among the at least one key content module as a target key content module;

[0015] determining a spatial straight line corresponding to the driver's line of sight, and if the spatial straight line intersects the screen, determining a position of the intersection on the screen;

[0016] Based on the position, the target key content module is highlighted.

[0017] In one possible implementation, the multiple driving state parameters of the target vehicle include at least one of a relative speed between the target vehicle and a first vehicle, a distance between the target vehicle and the first vehicle, a lateral speed of the target vehicle, a distance between the target vehicle and a first lane line, a distance between the target vehicle and a first obstacle, a rear width of the first vehicle, a distance between the second vehicle and the first lane line, an information processing delay, a lateral distance deviation, and an overspeed percentage. The first vehicle is the vehicle closest to the target vehicle among the vehicles ahead of the target vehicle, the first lane line is the lane line closest to the target vehicle among the lane lines in the target vehicle's lane, the first obstacle is the obstacle closest to the target vehicle among the obstacles to the side of the target vehicle, and the second vehicle is the vehicle closest to the target vehicle among the vehicles to the side of the target vehicle. The lateral distance deviation is the difference between the distance between the target vehicle and the first lane line and a safety distance. The overspeed percentage is the ratio of the difference between the target vehicle's speed and a speed threshold to the speed threshold. The information processing delay is the duration from when the target vehicle captures an image to when the driving state parameters excluding the information processing delay are calculated based on the image.

[0018] In a possible implementation, the multiple key content modules include a lane departure warning module, a forward collision warning module, a steering assist module, a speed limit module, and a lane change guidance module.

[0019] In one possible implementation, the driving state parameters corresponding to the lane departure warning module include the lateral speed of the target vehicle, the distance between the target vehicle and the first lane line, and the lateral distance deviation; the driving state parameters corresponding to the forward collision warning module include the distance between the first vehicle and the first lane line, the distance between the first vehicle and the target vehicle, and the rear width of the first vehicle; the driving state parameters corresponding to the steering assist module include the speed of the target vehicle; the driving state parameters corresponding to the speed limit module include the speed of the target vehicle and the speeding percentage; the driving state parameters corresponding to the lane change guidance module include the distance between the target vehicle and the first vehicle.

[0020] In a second aspect, a screen display device is provided. The device is applied to an onboard terminal of a target vehicle. The onboard terminal has a screen. The display content of the screen is composed of multiple content modules. The multiple content modules include multiple pre-designated key content modules. The device includes:

[0021] An acquisition module, configured to acquire current values ​​of a plurality of driving state parameters of the target vehicle whenever a detection cycle is reached;

[0022] Identify modules for:

[0023] For each driving state parameter, based on a pre-stored correspondence between the value range of the driving state parameter and the level value, determining a target level value corresponding to the value range to which the current value of the driving state parameter belongs, and obtaining the target level value corresponding to the driving state parameter;

[0024] Determining a weight value corresponding to each driving state parameter based on a target level value corresponding to each driving state parameter;

[0025] Based on the weight value corresponding to each driving state parameter, performing weighted summation on the target level value corresponding to each driving state parameter to obtain a first risk index;

[0026] determining that the first risk index is greater than a first risk index threshold;

[0027] For each key content module, determining a pre-recorded driving state parameter corresponding to the key content module, and based on a weight value corresponding to each driving state parameter corresponding to the key content module, performing a weighted summation on the target level value corresponding to each driving state parameter corresponding to the key content module to obtain a second risk index corresponding to the key content module;

[0028] determining at least one key content module whose second risk index is greater than a second risk index threshold;

[0029] determining the key content module with the largest second risk index among the at least one key content module as a target key content module;

[0030] determining a spatial straight line corresponding to the driver's line of sight, and if the spatial straight line intersects the screen, determining a position of the intersection on the screen;

[0031] The display module is configured to highlight the target key content module based on the position.

[0032] In one possible implementation, the multiple driving state parameters of the target vehicle include at least one of a relative speed between the target vehicle and a first vehicle, a distance between the target vehicle and the first vehicle, a lateral speed of the target vehicle, a distance between the target vehicle and a first lane line, a distance between the target vehicle and a first obstacle, a rear width of the first vehicle, a distance between the second vehicle and the first lane line, an information processing delay, a lateral distance deviation, and an overspeed percentage. The first vehicle is the vehicle closest to the target vehicle among the vehicles ahead of the target vehicle, the first lane line is the lane line closest to the target vehicle among the lane lines in the target vehicle's lane, the first obstacle is the obstacle closest to the target vehicle among the obstacles to the side of the target vehicle, and the second vehicle is the vehicle closest to the target vehicle among the vehicles to the side of the target vehicle. The lateral distance deviation is the difference between the distance between the target vehicle and the first lane line and a safety distance. The overspeed percentage is the ratio of the difference between the target vehicle's speed and a speed threshold to the speed threshold. The information processing delay is the duration from when the target vehicle captures an image to when the driving state parameters excluding the information processing delay are calculated based on the image.

[0033] In a possible implementation, the multiple key content modules include a lane departure warning module, a forward collision warning module, a steering assist module, a speed limit module, and a lane change guidance module.

[0034] In one possible implementation, the driving state parameters corresponding to the lane departure warning module include the lateral speed of the target vehicle, the distance between the target vehicle and the first lane line, and the lateral distance deviation; the driving state parameters corresponding to the forward collision warning module include the distance between the first vehicle and the first lane line, the distance between the first vehicle and the target vehicle, and the rear width of the first vehicle; the driving state parameters corresponding to the steering assist module include the speed of the target vehicle; the driving state parameters corresponding to the speed limit module include the speed of the target vehicle and the speeding percentage; the driving state parameters corresponding to the lane change guidance module include the distance between the target vehicle and the first vehicle.

[0035] In a third aspect, a computer device is provided, comprising a memory and a processor, wherein the memory is used to store computer instructions; the processor executes the computer instructions stored in the memory so that the computer device executes the method of the first aspect and its possible implementation methods.

[0036] In a fourth aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer program code. In response to the computer program code being executed by a computer device, the computer device executes the method of the first aspect and possible implementations thereof.

[0037] In a fifth aspect, a computer program product is provided, the computer program product comprising computer program code. In response to the computer program code being executed by a computer device, the computer device executes the method of the first aspect and possible implementations thereof.

[0038] The technical solutions provided by the embodiments of the present application may have the following beneficial effects:

[0039] Through the method provided in the embodiments of the present application, based on the driving state parameters of the target vehicle, after determining that the first hazard index is greater than the first hazard index threshold, the key content module with the highest second hazard index is determined and highlighted at the intersection of the spatial straight line corresponding to the driver's line of sight and the screen. In this way, the periodic calculation of the first hazard index and the second hazard index can monitor the degree of danger of the target vehicle's driving state in real time. The key content module with the highest second hazard index is highlighted at the position on the screen where the driver's line of sight is on the driver's line of sight, which can promptly remind the driver to adjust the driving state parameters corresponding to the key content module, thereby improving safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0041] Figure 1 This is a structural diagram of a screen provided in an embodiment of the present application;

[0042] Figure 2 This is a schematic diagram of the structure of a terminal provided in an embodiment of the present application;

[0043] Figure 3 This is a flow chart of a screen display method provided in an embodiment of the present application;

[0044] Figure 4 is a schematic diagram of a screen display interface provided in an embodiment of the present application;

[0045] Figure 5 is a schematic diagram of a screen display interface provided in an embodiment of the present application;

[0046] Figure 6 is a schematic diagram of a screen display interface provided in an embodiment of the present application;

[0047] Figure 7 This is a structural diagram of a screen display device provided in an embodiment of the present application;

[0048] Figure 8 This is a structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0049] An embodiment of the present application provides a screen display method, which is applied to a vehicle-mounted terminal and is used to highlight a target key content module, prompting the driver to perform subsequent operations on the vehicle based on the vehicle status parameters of the target key content module.

[0050] The screen of the vehicle terminal can be a backplane using full-area partitioned backlight technology. The backplane is equipped with dozens to hundreds of tiny backlight processing and signal processing chips, each of which controls a portion of the display area. The embodiment of the present application is described by taking a backplane equipped with 72 chips as an example. Figure 1 shown.

[0051] From the perspective of hardware composition, the structure of the terminal can be as follows Figure 2 As shown, it includes a processor 210 , a memory 220 , and a display component 230 .

[0052] The processor 210 may be a CPU (central processing unit) or a SoC (system on chip), etc. The processor 210 may be configured to execute various instructions involved in the method.

[0053] The memory 220 may include various volatile memories or non-volatile memories, such as an SSD (solid state disk) or a DRAM (dynamic random access memory). The memory 220 may be used to store pre-stored data, intermediate data, and result data during the process of determining the target key content module, such as the first risk index and the first risk index threshold.

[0054] The display component 230 can be an independent screen, or a screen integrated with the terminal body, a projector, etc. The screen can be a touch screen or a non-touch screen. The display component is used to display key content modules, such as a lane departure warning module, a forward collision warning module, etc.

[0055] In addition to the processor, memory, and display components, the terminal may also include a communication component, an audio acquisition component, an audio output component, and the like.

[0056] The communication component may be a wired network connector, a WiFi (wireless fidelity) module, a Bluetooth module, a cellular network communication module, etc. The communication component may be used to transmit data with other devices, such as servers or other terminals.

[0057] The audio collection component may be a microphone for collecting the user's voice, and the audio output component may be a speaker, earphones, etc. for playing audio.

[0058] In the automotive field, the screen of an in-vehicle terminal can display different interfaces, including the main interface and interfaces corresponding to different applications. Generally, an in-vehicle terminal is installed with multiple applications, such as ADAS (advanced driver assistance system) applications, navigation applications, media applications, etc.

[0059] The vehicle-mounted terminal has a screen, and the display content of the screen is composed of multiple content modules, and the multiple content modules include multiple pre-designated key content modules. The display content of the screen in the embodiment of the present application includes the following three types of content modules: ADAS content modules, navigation content modules and vehicle-mounted content modules. ADAS content modules include lane departure warning modules, forward collision warning modules, blind spot detection alarm modules and pedestrian protection warning modules. Navigation content modules include steering assist modules, speed limit modules, lane change guidance modules and the like. Vehicle-mounted content modules include fuel modules, endurance modules and caller ID modules and the like. Among them, multiple pre-designated key content modules may include lane departure warning modules, forward collision warning modules, steering assist modules, speed limit modules and lane change guidance modules.

[0060] The embodiment of the present application provides a screen display method for the above application scenario. The processing flow of the method can be as follows: Figure 3 As shown, the following processing steps are included:

[0061] 301. Whenever a detection cycle is reached, obtain current values ​​of multiple driving state parameters of the target vehicle.

[0062] The detection period is preset and may be 100 milliseconds. The plurality of driving state parameters may include the relative speed of the target vehicle and the first vehicle, the distance between the target vehicle and the first vehicle, the lateral speed of the target vehicle, the distance between the target vehicle and the first lane line, the distance between the target vehicle and the first obstacle, the rear width of the first vehicle, the distance between the second vehicle and the first lane line, information processing delay, lateral distance deviation, and speeding percentage. Among them, the first vehicle is the vehicle closest to the target vehicle among the vehicles in front of the target vehicle, the first lane line is the lane line closest to the target vehicle among the lane lines of the target vehicle, the first obstacle is the obstacle closest to the target vehicle among the obstacles on the side of the target vehicle, and the second vehicle is the vehicle closest to the target vehicle among the vehicles on the side of the target vehicle. The information processing delay is the time from the time the target vehicle captures the image to the time when the driving state parameters excluding the information processing delay are calculated based on the image (this time can be the average of the time durations for calculating multiple driving state parameters excluding the information processing delay, or the longest time duration among the time durations for calculating multiple driving state parameters excluding the information processing delay is used as the information processing delay time duration). The lateral distance deviation is the difference between the relative distance between the target vehicle and the first lane line and the safety distance. The speeding percentage refers to the ratio of the difference between the speed of the target vehicle and the speed threshold to the speed threshold.

[0063] 302. For each driving state parameter, based on the pre-stored correspondence between the value range and level value of the driving state parameter, determine the target level value corresponding to the value range of the current value of the driving state parameter, and obtain the target level value corresponding to the driving state parameter.

[0064] The level value indicates the target vehicle's safety level under the current value of the driving state parameter. A higher level value indicates a more dangerous driving state. For example, a level value of 1 indicates a safe driving state, a level value of 2 indicates a relatively safe driving state, a level value of 3 indicates a relatively dangerous driving state, and a level value of 4 indicates a dangerous driving state.

[0065] In implementation, the correspondence table between the value range and level value of each driving state parameter can be shown in Table 1.

[0066] Table 1

[0067]

[0068] For example, the relative speed between the target vehicle and the first vehicle is 2.1 m / s. Based on Table 1, it can be determined that the current value of the driving state parameter belongs to the value range [0, 3], and the corresponding target level value is 1.

[0069] 303. Determine a weight value corresponding to each driving state parameter based on the target level value corresponding to each driving state parameter.

[0070] In implementation, technicians need to first determine the polynomial model. The specific process of determining the polynomial model can be: determine multiple groups of values ​​corresponding to multiple driving state parameters from the vehicle driving data generated by the target vehicle during operation, and determine multiple groups of level values ​​based on the determined multiple groups of values. The technicians determine a set of weight values ​​corresponding to each group of level values ​​based on experience to obtain multiple groups of weight values. For each group of level values, the group of level values ​​and the corresponding set of weight values ​​are taken as a sample, so that multiple samples can be obtained. Using multiple samples, a pre-set polynomial function with pending parameters is fitted to determine the values ​​of the pending parameters. The independent variables in the polynomial function are the level values ​​corresponding to the driving state parameters, which can be in matrix form, and each element in the matrix corresponds to the level value of a driving state parameter. The function value of the polynomial function is the weight value corresponding to each driving state parameter, and can also be in matrix form, and each element in the matrix corresponds to the weight value of a driving state parameter. For example, the polynomial function can be Among them, a0, a1, a3, and a4 are the unknown parameters of the polynomial function, J iIt is a matrix, each element in the matrix represents the level value corresponding to each driving state parameter, w i is a matrix, each element of which represents the weight value corresponding to each driving state parameter. By fitting, the unknown parameters of the polynomial function can be determined, that is, the polynomial function with the determined parameters that can be used to calculate the weight value can be determined. For example, the polynomial function obtained by fitting can be

[0071]

[0072] Based on the determined polynomial model, the target level value corresponding to each driving state parameter is input into the model, and the weight value corresponding to each driving state parameter can be obtained.

[0073] Alternatively, each driving state parameter can be input into a weight model to obtain a corresponding weight value for each driving state parameter. The weight model can be a machine learning model, such as a neural network model. When training the model, the samples used can be obtained through experiments or set by technicians based on experience.

[0074] Alternatively, a technician may pre-establish a table of correspondences between target level value combinations and weight value combinations corresponding to multiple driving state parameters. After determining the target level value corresponding to each driving state parameter, a target level value combination is obtained. A table lookup is performed using the target level value combination to obtain the weight value combination corresponding to the target level value. Furthermore, the weight value corresponding to each target level value in the target level value combination is obtained, i.e., the weight value corresponding to each driving state parameter.

[0075] Generally speaking, among multiple driving state parameters, the larger the target level value is, the larger the corresponding weight value is.

[0076] 304 , based on the weight value corresponding to each driving state parameter, perform weighted summation on the target level value corresponding to each driving state parameter to obtain a first risk index.

[0077] The expression of the first risk index can be:

[0078]

[0079] Among them, w A represents the weight value corresponding to the relative speed between the target vehicle and the first vehicle, w B represents the weight value corresponding to the distance between the target vehicle and the first vehicle, w C Indicates the weight value corresponding to the lateral velocity of the target vehicle, w D Indicates the weight value corresponding to the distance between the target vehicle and the first lane line, w Erepresents the weight value corresponding to the distance between the target vehicle and the first obstacle, w F represents the weight value corresponding to the tail width of the first vehicle, w G represents the weight value corresponding to the distance between the second vehicle and the first lane line, w H The weight value corresponding to the information processing delay, w I Indicates the weight value corresponding to the horizontal distance deviation, w J Indicates the weight value corresponding to the speeding percentage, J A represents the target level value corresponding to the relative speed between the target vehicle and the first vehicle, J B represents the target level value corresponding to the distance between the target vehicle and the first vehicle, J C Indicates the target level value corresponding to the lateral speed of the target vehicle, J D Indicates the target level value corresponding to the distance between the target vehicle and the first lane line, J E Indicates the target level value corresponding to the distance between the target vehicle and the first obstacle, J F represents the target level value corresponding to the tail width of the first vehicle, J G represents the target level value corresponding to the distance between the second vehicle and the first lane line, J H The target level value corresponding to the information processing delay, J I Indicates the target level value corresponding to the lateral distance deviation, J J Indicates the target level value corresponding to the speeding percentage.

[0080] 305 : Determine whether the first risk index is greater than a first risk index threshold.

[0081] The first risk index threshold is preset, for example, it may be 2.85.

[0082] 306. For each key content module, determine the pre-recorded driving state parameters corresponding to the key content module, and based on the weight value corresponding to each driving state parameter corresponding to the key content module, perform weighted summation on the target level value corresponding to each driving state parameter corresponding to the key content module to obtain a second danger index corresponding to the key content module.

[0083] The driving status parameters corresponding to the lane departure warning module include the lateral speed of the target vehicle, the distance between the target vehicle and the first lane line, and the lateral distance deviation; the driving status parameters corresponding to the forward collision warning module include the distance between the first vehicle and the first lane line, the distance between the first vehicle and the target vehicle, and the rear width of the first vehicle; the driving status parameters corresponding to the steering assist module include the speed of the target vehicle; the driving status parameters corresponding to the speed limit module include the speed of the target vehicle and the speeding percentage; the driving status parameters corresponding to the lane change guidance module include the distance between the target vehicle and the first vehicle.

[0084] For example, for the lane departure warning module, the corresponding driving state parameters include the target vehicle's lateral speed of 5 m / s, the distance between the target vehicle and the first lane line of 0.3 m, and the lateral distance deviation of 0.2 m. The target level values ​​corresponding to each driving state parameter are 3, 4, and 3, respectively. Assuming that the weight values ​​corresponding to each target level value are 0.1, 0.2, and 0.1, respectively, the following expression can be used:

[0085]

[0086] A second danger index J1 corresponding to the lane departure warning module is obtained.

[0087] 307 : Determine at least one key content module whose second risk index is greater than a second risk index threshold.

[0088] The second risk index threshold is preset, for example, it may be 3.19.

[0089] During implementation, the second risk index of each key content module is compared with the second risk index threshold, and key content modules having a second risk index greater than the second risk index threshold are determined.

[0090] 308 : Determine the key content module with the highest second risk index among the at least one key content module as a target key content module.

[0091] In implementation, if there are multiple key content modules whose second risk index is greater than the second risk index threshold, the key content module with the largest second risk index is determined as the target key content module.

[0092] 309 , determining a spatial straight line corresponding to the driver's line of sight. If the spatial straight line intersects the screen, determining a position of the intersection on the screen.

[0093] During implementation, a camera in the target vehicle captures the driver's facial image in real time, and the facial image is input into a trained gaze analysis model to determine the spatial line corresponding to the driver's line of sight in the cockpit space. The gaze analysis model can be a machine learning model, such as a decision matrix model, a neural network model, etc. The input data of the gaze analysis model is the facial image, and the output data can be the parameters of the linear equation of the spatial line where the line of sight is located in a certain spatial coordinate system. In other words, the linear equation of the spatial line can be determined based on the parameters output by the model. The spatial coordinate system can be set manually. For example, with the center point of the screen as the origin, the direction perpendicular to the screen and facing the front of the screen is the positive x-axis, the direction horizontally to the right along the plane of the screen is the positive y-axis, and the direction perpendicular to the x-axis and y-axis upward is the positive z-axis. During the training and use of the gaze analysis model, the spatial coordinate system used is the same.

[0094] After determining the spatial line of sight, the intersection of this spatial line and the plane of the screen can be determined through geometric calculations. This intersection is then determined to see if it is within the area enclosed by the screen edge. If so, the spatial line and the screen do intersect; if not, the spatial line and the screen do not intersect.

[0095] In addition to establishing the above-mentioned spatial coordinate system, a plane coordinate system within the screen plane can also be pre-established. The origin and x-axis and y-axis directions of the plane coordinate system can be set arbitrarily based on needs. Based on the established spatial coordinate system and plane coordinate system, the coordinate transformation relationship from the spatial coordinate system to the plane coordinate system can be determined. This coordinate transformation relationship can only be applied to points on the screen plane. If there is an intersection between a spatial straight line and the screen, the coordinates of the intersection in the spatial coordinate system can be converted to the coordinates of the intersection in the plane coordinate system. The converted coordinates are the position of the intersection on the screen.

[0096] 310 , highlighting the target key content module based on the position of the intersection on the screen.

[0097] In practice, the intersection point on the screen may be used as the display center to highlight the target key content module. The highlighting may be achieved by using software to enhance the brightness and contrast of the local microchip using HDR (high-dynamic range) technology.

[0098] After determining the spatial line corresponding to the driver's line of sight in the spatial coordinate system, if the spatial line corresponding to the driver's line of sight in the spatial coordinate system does not intersect the screen, the intersection of the spatial line of sight and the plane of the screen is determined, and the point on the edge of the screen closest to the intersection is determined as the reference point. The display center is then determined based on the position of the reference point and the shape and size of the display unit corresponding to the target key content module (the following example uses the shape of the display unit as a rectangle, with the longer side of the rectangle parallel to the upper and lower sides of the screen and the shorter side perpendicular to the upper and lower sides of the screen; other cases are similar).

[0099] Based on the different positions of the reference points, the specific processing of determining the display center may include the following situations:

[0100] In case 1, when the reference point is located on the upper edge of the screen and the distance between the reference point and the left and right edges of the screen is greater than or equal to half of the long side length of the display unit corresponding to the target key content module, the point directly below the reference point and at a distance from the reference point that is half of the wide side length of the display unit corresponding to the target key content module is determined as the display center. Figure 4 shown.

[0101] In the second case, when the reference point is located on the bottom edge of the screen and the distance between the reference point and the left and right edges of the screen is greater than or equal to half of the long side length of the display unit corresponding to the target key content module, the point directly above the reference point and at a distance from the reference point that is half of the wide side length of the display unit corresponding to the target key content module is determined as the display center.

[0102] Case 3: When the reference point is on the left edge of the screen and the distance between the reference point and the upper and lower edges of the screen is greater than or equal to half of the width of the display unit corresponding to the target key content module, the point to the right of the reference point that is half of the length of the long side of the display unit corresponding to the target key content module is determined as the display center. Figure 5 shown.

[0103] Case four: when the reference point is on the right edge of the screen and the distance between the reference point and the upper and lower edges of the screen is greater than or equal to half of the wide side length of the display unit corresponding to the target key content module, the point to the left of the reference point at a distance of half of the long side length of the display unit corresponding to the target key content module is determined as the display center.

[0104] Case five: when the reference point is located on the upper and lower edges of the screen, and the distance between the reference point and the left and right edges of the screen is less than half of the long side length of the display unit corresponding to the target key content module (or when the reference point is located on the left and right edges of the screen, and the distance between the reference point and the upper and lower edges of the screen is less than half of the wide side length of the display unit corresponding to the target key content module), determine the vertex of the screen closest to the reference point, and take the intersection of a horizontal line whose distance to the vertex is equal to half of the wide side length of the display unit corresponding to the target key content module and a vertical line whose distance to the vertex is equal to half of the long side length of the display unit corresponding to the target key content module as the display center. Figure 6 shown.

[0105] After the display center is determined, the target key content module is highlighted based on the determined display center.

[0106] In implementation, the determined position of the display center on the screen may be used as the display center, and the target key content module may be highlighted. The highlighting may be achieved through HDR technology.

[0107] If the straight line corresponding to the driver's line of sight in the cockpit space does not intersect the screen, another solution is:

[0108] The Lane Departure Warning module determines whether the target vehicle has departed from its lane based on the current values ​​of the module's corresponding driving state parameters and driver behavior, such as whether the driver has activated the turn signal to change lanes. If so, the LDW (lane departure warning) light illuminates and the Lane Departure Warning module is highlighted. The LDW light can be displayed on the target vehicle's screen or as a hardware device mounted above the screen or elsewhere.

[0109] For the forward collision warning module, the target vehicle determines whether it will collide with the vehicle ahead of it based on the current value of the module's corresponding driving state parameter. If so, the FCW (forward collision warning) light illuminates and the forward collision warning module is highlighted. The FCW light can be displayed on the target vehicle's screen or as a hardware device installed above the screen or elsewhere.

[0110] The blind spot detection alarm module uses the target vehicle's radar sensor to detect vehicles in the target vehicle's rearview mirror blind spot. If a vehicle is in the blind spot, the BSD (blind spot detection) warning light illuminates and the blind spot detection alarm module is highlighted. The BSD warning light can be displayed on the screen or as a hardware device installed on the rearview mirror.

[0111] For the pedestrian protection warning module, the target vehicle's camera uses a machine learning model to determine whether a zebra crossing and pedestrians are present in the captured image. It then determines whether the target vehicle, given its current driving parameters, is likely to collide with a pedestrian. If so, the PC (pedestrian collision warning) light illuminates, and the pedestrian protection warning module is highlighted. The PC light can be displayed on the target vehicle's screen or as a hardware device mounted above the screen or elsewhere.

[0112] For the steering assist module, if the driver turns on the turn signal, or the target vehicle determines a turning intersection based on the driver's preset itinerary, and the distance to the turning intersection is less than a preset threshold, the steering assist module will be highlighted.

[0113] For the fuel module, when the remaining fuel amount of the target vehicle reaches a preset threshold, the fuel module is highlighted.

[0114] For the endurance module, the target vehicle calculates the amount of fuel required for the target vehicle to complete the journey based on the journey pre-set by the driver, and compares the calculated amount of fuel required for the target vehicle to complete the journey with the remaining fuel amount. If the amount of fuel required for the target vehicle to complete the journey is greater than the remaining fuel amount, the endurance module is highlighted.

[0115] For the incoming call display module, when the target vehicle receives an incoming call, the incoming call display module is highlighted.

[0116] For each of the above-mentioned content modules, the corresponding content module can be highlighted with the center of the screen as the display center, or the corresponding content module can be highlighted at the original position (if the original position is in the interface displayed on the current screen, it will be highlighted directly; if the original position is not in the interface displayed on the current screen, it will be switched to the interface corresponding to the content module and then highlighted).

[0117] Through the method provided in the embodiments of the present application, based on the driving state parameters of the target vehicle, after determining that the first hazard index is greater than the first hazard index threshold, the key content module with the highest second hazard index is determined and highlighted at the intersection of the spatial straight line corresponding to the driver's line of sight and the screen. In this way, the periodic calculation of the first hazard index and the second hazard index can monitor the degree of danger of the target vehicle's driving state in real time. When the driver's line of sight falls on the screen, the key content module with the highest second hazard index is highlighted, which can promptly remind the driver to adjust the driving state parameters corresponding to the key content module, thereby improving safety.

[0118] Based on the same technical concept, the embodiment of the present application also provides a device for screen display, such as Figure 7 As shown, the device includes:

[0119] An acquisition module 710 is configured to acquire current values ​​of multiple driving state parameters of the target vehicle whenever a detection cycle is reached;

[0120] The determination module 720 is configured to:

[0121] For each driving state parameter, based on the pre-stored correspondence between the value range of the driving state parameter and the level value, determine the target level value corresponding to the value range of the current value of the driving state parameter, and obtain the target level value corresponding to the driving state parameter;

[0122] Determining a weight value corresponding to each driving state parameter based on a target level value corresponding to each driving state parameter;

[0123] Based on the weight value corresponding to each driving state parameter, a weighted sum is performed on the target level value corresponding to each driving state parameter to obtain a first danger index;

[0124] determining that the first risk index is greater than a first risk index threshold;

[0125] For each key content module, determining a pre-recorded driving state parameter corresponding to the key content module, and performing a weighted summation of target level values ​​corresponding to each driving state parameter corresponding to the key content module based on a weight value corresponding to each driving state parameter corresponding to the key content module to obtain a second hazard index corresponding to the key content module;

[0126] determining at least one key content module having a second risk index greater than a second risk index threshold;

[0127] determining the key content module with the largest second risk index among the at least one key content module as a target key content module;

[0128] Determine the spatial straight line corresponding to the driver's line of sight, and if the spatial straight line intersects the screen, determine the position of the intersection on the screen;

[0129] The display module 730 is configured to highlight the target key content module based on the location.

[0130] In one possible implementation, the multiple driving state parameters of the target vehicle include at least one of a relative speed between the target vehicle and a first vehicle, a distance between the target vehicle and the first vehicle, a lateral speed of the target vehicle, a distance between the target vehicle and a first lane line, a distance between the target vehicle and a first obstacle, a rear width of the first vehicle, a distance between the second vehicle and the first lane line, an information processing delay, a lateral distance deviation, and a speeding percentage. The first vehicle is the vehicle closest to the target vehicle among the vehicles ahead of the target vehicle, the first lane line is the lane line closest to the target vehicle among the lane lines in the target vehicle's lane, the first obstacle is the obstacle closest to the target vehicle among the obstacles to the side of the target vehicle, and the second vehicle is the vehicle closest to the target vehicle among the vehicles to the side of the target vehicle. The lateral distance deviation is the difference between the distance between the target vehicle and the first lane line and the safety distance. The speeding percentage is the ratio of the difference between the speed of the target vehicle and a speed threshold to the speed threshold. The information processing delay is the time from when the target vehicle captures an image to when the driving state parameters excluding the information processing delay are calculated based on the image.

[0131] In one possible implementation, the multiple key content modules include a lane departure warning module, a forward collision warning module, a steering assist module, a speed limit module, and a lane change guidance module.

[0132] In one possible implementation, the driving state parameters corresponding to the lane departure warning module include the lateral speed of the target vehicle, the distance between the target vehicle and the first lane line, and the lateral distance deviation; the driving state parameters corresponding to the forward collision warning module include the distance between the first vehicle and the first lane line, the distance between the first vehicle and the target vehicle, and the rear width of the first vehicle; the driving state parameters corresponding to the steering assist module include the speed of the target vehicle; the driving state parameters corresponding to the speed limit module include the speed of the target vehicle and the speeding percentage; the driving state parameters corresponding to the lane change guidance module include the distance between the target vehicle and the first vehicle.

[0133] Through the device provided in the embodiment of the present application, based on the driving state parameters of the target vehicle, after determining that the first hazard index is greater than the first hazard index threshold, the key content module with the highest second hazard index is determined and highlighted at the intersection of the spatial straight line corresponding to the driver's line of sight and the screen. In this way, the periodic calculation of the first hazard index and the second hazard index can monitor the degree of danger of the target vehicle's driving state in real time. When the driver's line of sight falls on the screen, the key content module with the highest second hazard index is highlighted, which can promptly remind the driver to adjust the driving state parameters corresponding to the key content module, thereby improving safety.

[0134] It should be noted that the screen display device provided in the above embodiment is only illustrated by the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the terminal can be divided into different functional modules to complete all or part of the functions described above. In addition, the screen display device provided in the above embodiment and the screen display method embodiment are based on the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0135] Figure 8 The following is a block diagram of the structure of an electronic device 800 provided in an embodiment of the present application. The electronic device may be any of the terminals in the above embodiments. The electronic device 800 may be a portable mobile terminal, such as a smartphone, a tablet computer, an MP3 player (moving picture experts group audio layer III), an MP4 player (moving picture experts group audio layer IV), a laptop computer, or a desktop computer. The electronic device 800 may also be referred to as a user device, a portable terminal, a laptop terminal, a desktop terminal, or other names.

[0136] Typically, the electronic device 800 includes a processor 801 and a memory 802 .

[0137] The processor 801 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 801 may be implemented in at least one hardware form of DSP (digital signal processing), FPGA (field-programmable gate array), or PLA (programmable logic array). The processor 801 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (central processing unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 801 may be integrated with a GPU (graphics processing unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 801 may also include an AI (artificial intelligence) processor, which is used to process computing operations related to machine learning.

[0138] The memory 802 may include one or more computer-readable storage media, which may be non-transitory. The memory 802 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices and flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 802 is used to store at least one instruction, which is executed by the processor 801 to implement the method provided in the embodiment of the present application.

[0139] In some embodiments, electronic device 800 may optionally include a peripheral device interface 803 and at least one peripheral device. The processor 801, memory 802, and peripheral device interface 803 may be connected via a bus or signal lines. Each peripheral device may be connected to peripheral device interface 803 via a bus, signal lines, or circuit boards. Specifically, the peripheral device may include at least one of a radio frequency circuit 804, a display screen 805, a camera assembly 806, an audio circuit 807, a positioning assembly 808, and a power supply 809.

[0140] The peripheral device interface 803 can be used to connect at least one I / O (input / output)-related peripheral device to the processor 801 and the memory 802. In some embodiments, the processor 801, the memory 802, and the peripheral device interface 803 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 801, the memory 802, and the peripheral device interface 803 can be implemented on separate chips or circuit boards, which is not limited in this embodiment.

[0141] The radio frequency circuit 804 is used to receive and transmit RF (radio frequency) signals, also known as electromagnetic signals. The radio frequency circuit 804 communicates with communication networks and other communication devices via electromagnetic signals. The radio frequency circuit 804 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals. Optionally, the radio frequency circuit 804 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The radio frequency circuit 804 can communicate with other terminals via at least one wireless communication protocol. Such wireless communication protocols include, but are not limited to, the World Wide Web, a metropolitan area network, an intranet, various generations of mobile communication networks (2G, 3G, 4G, and 5G), a wireless local area network, and / or a WiFi (wireless fidelity) network. In some embodiments, the radio frequency circuit 804 may also include circuits related to NFC (near field communication), which is not limited in this application.

[0142] Display screen 805 is used to display a user interface (UI). This UI can include graphics, text, icons, videos, or any combination thereof. When display screen 805 is a touchscreen display, it can also capture touch signals on or above the surface of display screen 805. These touch signals can be input as control signals to processor 801 for processing. Display screen 805 can also be used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there can be a single display screen 805, located on the front panel of electronic device 800. In other embodiments, there can be at least two display screens 805, located on different surfaces of electronic device 800 or in a foldable design. In still other embodiments, display screen 805 can be a flexible display, located on a curved or foldable surface of electronic device 800. Display screen 805 can also be configured as a non-rectangular, irregular shape, also known as a special-shaped screen. Display screen 805 can be made of materials such as LCD (liquid crystal display) and OLED (organic light-emitting diode).

[0143] The camera assembly 806 is used to capture images or videos. Optionally, the camera assembly 806 includes a front camera and a rear camera. Typically, the front camera is arranged on the front panel of the terminal, and the rear camera is arranged on the back of the terminal. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, the fusion of the main camera and the wide-angle camera to realize panoramic shooting and VR (virtual reality) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 806 may also include a flash. The flash can be a single-color temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures.

[0144] The audio circuit 807 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals to be input into the processor 801 for processing, or input into the radio frequency circuit 804 to achieve voice communication. For the purpose of stereo sound collection or noise reduction, there can be multiple microphones, which are respectively arranged in different parts of the electronic device 800. The microphone can also be an array microphone or an omnidirectional collection microphone. The speaker is used to convert the electrical signals from the processor 801 or the radio frequency circuit 804 into sound waves. The speaker can be a traditional thin film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signals into sound waves audible to humans, but also convert the electrical signals into sound waves inaudible to humans for purposes such as ranging. In some embodiments, the audio circuit 807 may also include a headphone jack.

[0145] The positioning component 808 is used to locate the current geographic location of the electronic device 800 to implement navigation or LBS (location-based service). The positioning component 808 can be a positioning component based on the GPS (global positioning system), Beidou system or Galileo system.

[0146] Power supply 809 is used to power the various components of electronic device 800. Power supply 809 can be AC ​​power, DC power, a disposable battery, or a rechargeable battery. When power supply 809 includes a rechargeable battery, the rechargeable battery can be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery that is charged via a wired line, while a wireless rechargeable battery is a battery that is charged via a wireless coil. The rechargeable battery can also be used to support fast charging technology.

[0147] In some embodiments, the electronic device 800 further includes one or more sensors 810 , including but not limited to: an acceleration sensor 811 , a gyroscope sensor 812 , a pressure sensor 813 , a fingerprint sensor 814 , an optical sensor 815 , and a proximity sensor 816 .

[0148] The accelerometer 811 can detect the magnitude of acceleration along the three coordinate axes of the coordinate system established by the electronic device 800. For example, the accelerometer 811 can be used to detect the components of gravity acceleration along the three coordinate axes. The processor 801 can control the display screen 805 to display the user interface in a landscape or portrait view based on the gravity acceleration signal collected by the accelerometer 811. The accelerometer 811 can also be used to collect game or user motion data.

[0149] The gyroscope sensor 812 can detect the orientation and rotation angle of the electronic device 800. It can work in conjunction with the accelerometer 811 to capture the user's 3D movements of the electronic device 800. Based on the data collected by the gyroscope sensor 812, the processor 801 can implement the following functions: motion sensing (for example, changing the UI based on the user's tilt operation), image stabilization during shooting, game control, and inertial navigation.

[0150] The pressure sensor 813 can be set on the side frame of the electronic device 800 and / or the lower layer of the display screen 805. When the pressure sensor 813 is set on the side frame of the electronic device 800, it can detect the user's grip signal of the electronic device 800, and the processor 801 performs left and right hand recognition or shortcut operations based on the grip signal collected by the pressure sensor 813. When the pressure sensor 813 is set on the lower layer of the display screen 805, the processor 801 controls the operable controls on the UI interface based on the user's pressure operation on the display screen 805. The operable controls include at least one of a button control, a scroll bar control, an icon control, and a menu control.

[0151] The fingerprint sensor 814 is used to collect the user's fingerprint. The processor 801 identifies the user's identity based on the fingerprint collected by the fingerprint sensor 814, or the fingerprint sensor 814 identifies the user's identity based on the collected fingerprint. When the user's identity is identified as a trusted identity, the processor 801 authorizes the user to perform relevant sensitive operations, such as unlocking the screen, viewing encrypted information, downloading software, making payments, and changing settings. The fingerprint sensor 814 can be set on the front, back, or side of the electronic device 800. When a physical button or manufacturer logo is set on the electronic device 800, the fingerprint sensor 814 can be integrated with the physical button or manufacturer logo.

[0152] The optical sensor 815 is used to detect ambient light intensity. In one embodiment, the processor 801 can control the display brightness of the display screen 805 based on the ambient light intensity detected by the optical sensor 815. Specifically, when the ambient light intensity is high, the display brightness of the display screen 805 is increased; when the ambient light intensity is low, the display brightness of the display screen 805 is decreased. In another embodiment, the processor 801 can also dynamically adjust the shooting parameters of the camera assembly 806 based on the ambient light intensity detected by the optical sensor 815.

[0153] Proximity sensor 816, also known as a distance sensor, is typically located on the front panel of electronic device 800. Proximity sensor 816 is used to detect the distance between the user and the front of electronic device 800. In one embodiment, when proximity sensor 816 detects that the distance between the user and the front of electronic device 800 is gradually decreasing, processor 801 controls display screen 805 to switch from the screen-on state to the screen-off state. When proximity sensor 816 detects that the distance between the user and the front of electronic device 800 is gradually increasing, processor 801 controls display screen 805 to switch from the screen-off state to the screen-on state.

[0154] Those skilled in the art will understand that Figure 8 The structure shown in the figure does not constitute a limitation on the electronic device 800, and the electronic device 800 may include more or fewer components than shown in the figure, or combine certain components, or adopt a different component arrangement.

[0155] In an embodiment of the present application, a computer-readable storage medium is further provided, such as a memory including instructions, wherein the instructions can be executed by a processor in a terminal to perform the method for performing interactive operations in the above embodiment. The computer-readable storage medium can be non-transitory. For example, the computer-readable storage medium can be a ROM (read-only memory), a RAM (random access memory), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0156] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals (including but not limited to signals transmitted between user terminals and other devices, etc.) involved in this application are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions.

[0157] Those skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware, or by a program to instruct the relevant hardware, and the program may be stored in a computer-readable storage medium, which may be a read-only memory, a disk, or an optical disk, etc.

[0158] The above descriptions are only some possible embodiments of the present application and are not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the scope of protection of the present application.

Claims

1. A screen display method, characterized in that: The method is applied to an on-board terminal of a target vehicle, wherein the on-board terminal has a screen, and the display content of the screen is composed of multiple content modules, wherein the multiple content modules include multiple pre-specified key content modules, and the method includes: Whenever a detection cycle is reached, current values ​​of multiple driving state parameters of the target vehicle are obtained; For each driving state parameter, based on a pre-stored correspondence between the value range of the driving state parameter and the level value, determining a target level value corresponding to the value range to which the current value of the driving state parameter belongs, and obtaining the target level value corresponding to the driving state parameter; Determining a weight value corresponding to each driving state parameter based on a target level value corresponding to each driving state parameter; Based on the weight value corresponding to each driving state parameter, performing weighted summation on the target level value corresponding to each driving state parameter to obtain a first risk index; determining that the first risk index is greater than a first risk index threshold; For each key content module, determining a pre-recorded driving state parameter corresponding to the key content module, and based on a weight value corresponding to each driving state parameter corresponding to the key content module, performing a weighted summation on the target level value corresponding to each driving state parameter corresponding to the key content module to obtain a second risk index corresponding to the key content module; determining at least one key content module whose second risk index is greater than a second risk index threshold; determining the key content module with the largest second risk index among the at least one key content module as a target key content module; determining a spatial straight line corresponding to the driver's line of sight, and if the spatial straight line intersects the screen, determining a position of the intersection on the screen; Based on the position, the target key content module is highlighted.

2. The method according to claim 1, characterized in that The multiple driving state parameters of the target vehicle include at least one of a relative speed between the target vehicle and a first vehicle, a distance between the target vehicle and the first vehicle, a lateral speed of the target vehicle, a distance between the target vehicle and a first lane line, a distance between the target vehicle and a first obstacle, a rear width of the first vehicle, a distance between the second vehicle and the first lane line, an information processing delay, a lateral distance deviation, and an overspeed percentage. The first vehicle is the vehicle closest to the target vehicle among the vehicles ahead of the target vehicle, the first lane line is the lane line closest to the target vehicle among the lane lines in the target vehicle's lane, the first obstacle is the obstacle closest to the target vehicle among the obstacles to the side of the target vehicle, and the second vehicle is the vehicle closest to the target vehicle among the vehicles to the side of the target vehicle. The lateral distance deviation is the difference between the distance between the target vehicle and the first lane line and a safety distance. The overspeed percentage is the ratio of the difference between the speed of the target vehicle and a speed threshold to the speed threshold. The information processing delay is the time from when the target vehicle captures an image to when the driving state parameters excluding the information processing delay are calculated based on the image.

3. The method according to claim 1, characterized in that The multiple pre-designated key content modules include a lane departure warning module, a forward collision warning module, a steering assist module, a speed limit module, and a lane change guidance module.

4. The method according to claim 3, characterized in that The driving state parameters corresponding to the lane departure warning module include the lateral speed of the target vehicle, the distance between the target vehicle and the first lane line, and the lateral distance deviation, where the lateral distance deviation is the difference between the distance between the target vehicle and the first lane line and the safety distance; the driving state parameters corresponding to the forward collision warning module include the distance between the first vehicle and the first lane line, the distance between the first vehicle and the target vehicle, and the rear width of the first vehicle, where the first vehicle is the vehicle closest to the target vehicle among the vehicles in front of the target vehicle; The driving state parameters corresponding to the steering assist module include the speed of the target vehicle; the driving state parameters corresponding to the speed limit module include the speed and speeding percentage of the target vehicle, and the speeding percentage is the ratio of the difference between the speed of the target vehicle and the speed threshold to the speed threshold; the driving state parameters corresponding to the lane change guidance module include the distance between the target vehicle and the first vehicle.

5. A screen display device, characterized in that: The device is applied to an on-board terminal of a target vehicle, wherein the on-board terminal has a screen, and the display content of the screen is composed of multiple content modules, wherein the multiple content modules include multiple pre-specified key content modules, and the device includes: An acquisition module, configured to acquire current values ​​of a plurality of driving state parameters of the target vehicle whenever a detection cycle is reached; Identify modules for: For each driving state parameter, based on a pre-stored correspondence between the value range of the driving state parameter and the level value, determining a target level value corresponding to the value range to which the current value of the driving state parameter belongs, and obtaining the target level value corresponding to the driving state parameter; Determining a weight value corresponding to each driving state parameter based on a target level value corresponding to each driving state parameter; Based on the weight value corresponding to each driving state parameter, performing weighted summation on the target level value corresponding to each driving state parameter to obtain a first risk index; determining that the first risk index is greater than a first risk index threshold; For each key content module, determining a pre-recorded driving state parameter corresponding to the key content module, and based on a weight value corresponding to each driving state parameter corresponding to the key content module, performing a weighted summation on the target level value corresponding to each driving state parameter corresponding to the key content module to obtain a second risk index corresponding to the key content module; determining at least one key content module whose second risk index is greater than a second risk index threshold; determining the key content module with the largest second risk index among the at least one key content module as a target key content module; determining a spatial straight line corresponding to the driver's line of sight, and if the spatial straight line intersects the screen, determining a position of the intersection on the screen; The display module is configured to highlight the target key content module based on the position.

6. The device according to claim 5, characterized in that The multiple driving state parameters of the target vehicle include at least one of a relative speed between the target vehicle and a first vehicle, a distance between the target vehicle and the first vehicle, a lateral speed of the target vehicle, a distance between the target vehicle and a first lane line, a distance between the target vehicle and a first obstacle, a rear width of the first vehicle, a distance between the second vehicle and the first lane line, an information processing delay, a lateral distance deviation, and an overspeed percentage. The first vehicle is the vehicle closest to the target vehicle among the vehicles ahead of the target vehicle, the first lane line is the lane line closest to the target vehicle among the lane lines in the target vehicle's lane, the first obstacle is the obstacle closest to the target vehicle among the obstacles to the side of the target vehicle, and the second vehicle is the vehicle closest to the target vehicle among the vehicles to the side of the target vehicle. The lateral distance deviation is the difference between the distance between the target vehicle and the first lane line and a safety distance. The overspeed percentage is the ratio of the difference between the speed of the target vehicle and a speed threshold to the speed threshold. The information processing delay is the time from when the target vehicle captures an image to when the driving state parameters excluding the information processing delay are calculated based on the image.

7. The device according to claim 5, characterized in that The multiple pre-designated key content modules include a lane departure warning module, a forward collision warning module, a steering assist module, a speed limit module, and a lane change guidance module.

8. The device according to claim 7, characterized in that The driving state parameters corresponding to the lane departure warning module include the lateral speed of the target vehicle, the distance between the target vehicle and the first lane line, and the lateral distance deviation, where the lateral distance deviation is the difference between the distance between the target vehicle and the first lane line and the safety distance; the driving state parameters corresponding to the forward collision warning module include the distance between the first vehicle and the first lane line, the distance between the first vehicle and the target vehicle, and the rear width of the first vehicle, where the first vehicle is the vehicle closest to the target vehicle among the vehicles in front of the target vehicle; The driving state parameters corresponding to the steering assist module include the speed of the target vehicle; the driving state parameters corresponding to the speed limit module include the speed and speeding percentage of the target vehicle, and the speeding percentage is the ratio of the difference between the speed of the target vehicle and the speed threshold to the speed threshold; the driving state parameters corresponding to the lane change guidance module include the distance between the target vehicle and the first vehicle.

9. A computer device, characterized in that: The computer device includes a memory and a processor, wherein the memory is used to store computer instructions; The processor executes the computer instructions stored in the memory to enable the computer device to perform the method according to any one of claims 1 to 4.

10. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program code. In response to the computer program code being executed by a computer device, the computer device executes the method according to any one of claims 1 to 4.

Citation Information

Patent Citations

  • Driving assisting system based on interaction of augmented reality head-up display and multi-screen voice

    CN108099790A

  • Display control device, display control program, and continuous tangible computer-readable medium thereof

    WO2020039855A1