An ADAS data visualization system, method, electronic device, and storage medium

Abstract

The application relates to the technical field of data visualization, and discloses an ADAS data visualization system and method, an electronic device and a storage medium, which comprise a main control module, a data processing module, a scene rendering module and a layer display module. The main control module is used for issuing system configuration parameters, scheduling runtime sequences and data interaction of the data processing module, the scene rendering module and the layer display module, and monitoring and managing the running states of the modules. The data processing module is used for receiving first ADAS data, pre-processing and multi-stage anti-shake processing the first ADAS data, and obtaining second ADAS data. The second ADAS data is transmitted to the scene rendering module. The scene rendering module is used for receiving the second ADAS data and generating different rendering graphic data. The layer display module is used for receiving the rendering graphic data output by the scene rendering module, generating a visual picture and completing terminal output. The scheme effectively improves the stability and fluency of ADAS data display.

Description

Technical Field

[0001] This specification relates to the field of data visualization technology, and in particular to an ADAS data visualization system, method, electronic device and storage medium. Background Technology

[0002] Advanced Driver Assistance Systems (ADAS) are widely used in modern automobiles. They collect real-time information about the vehicle's surroundings through various sensors and provide drivers with assistance functions such as lane departure warning and collision warning. With the continuous development of ADAS technology, how to present the massive amounts of real-time data collected by sensors to users in an intuitive, efficient, and stable manner has become a significant technical challenge in the industry.

[0003] In existing ADAS data visualization solutions, some adopt direct rendering, which maps the raw data directly onto the screen. This lacks an effective data processing mechanism. Because sensor data itself contains noise and fluctuations, direct rendering causes frequent jitter in elements such as vehicle markings and lane lines in the image, resulting in unstable display effects. Summary of the Invention

[0004] In view of this, the present invention aims to propose an ADAS data visualization system, method, electronic device and storage medium to solve the problem of frequent jitter of displayed content caused by the lack of an effective anti-jitter mechanism in existing ADAS data display.

[0005] To achieve the above objectives, the present invention adopts the following technical solution: An ADAS data visualization system, comprising: The main control module is used to issue system configuration parameters, schedule the runtime sequence and data interaction of the data processing module, scene rendering module, and layer display module, and monitor and manage the running status of each module. The data processing module is used to receive first ADAS data, perform preprocessing and multi-level anti-shake processing on the first ADAS data to obtain second ADAS data, and transmit the second ADAS data to the scene rendering module. The scene rendering module is used to receive the second ADAS data and generate different rendering graphics data; The layer display module is used to receive the rendered graphics data output by the scene rendering module to generate a visual image and complete the terminal output.

[0006] Furthermore, the multi-level image stabilization process includes: The preprocessed data is smoothed using a weighted average algorithm to obtain smoothed data. The smoothed data is time-aligned and interpolated to mark the points, generating second ADAS data and transmitting it to the scene rendering module.

[0007] Furthermore, the scene rendering module includes a lane line module, a vehicle module, and an alarm module; The lane line module is used to extract lane line information from the second ADAS data, smooth the lane line information and configure the line color to generate lane graphic data, and transmit the lane graphic data to the alarm module. The vehicle module is used to extract vehicle position, relative distance, and relative speed information from the second ADAS data; calculate the collision time based on the extracted vehicle position, relative distance, and relative speed information, and generate vehicle graphic data by combining the vehicle outline information, and transmit the vehicle graphic data to the alarm module.

[0008] Furthermore, the alarm module is used to perform calculations on the received lane graphic data and vehicle graphic data; classify alarm levels according to preset judgment rules, set the rendering order of the warning graphic data according to the alarm level, configure corresponding color codes and dynamic rendering parameters for different levels of warning graphic data, and output the processed warning graphic data.

[0009] Furthermore, the scene rendering module also includes a built-in tool unit; the tool unit includes drawing tools and zoom tools; The scaling tool calculates the scaling ratio based on the ratio of the current display device's resolution to the preset reference resolution, and multiplies the coordinate values ​​used to generate lane graphic data and vehicle graphic data in the second ADAS data by the scaling ratio to obtain the adapted coordinate values; and adjusts the line width and vehicle mark size according to the scaling ratio to obtain the adapted line width and adapted vehicle mark size. The drawing tool is used to perform graphic drawing operations on lane graphic data and vehicle graphic data based on the adapted coordinate values, adapted line width, and adapted vehicle mark size.

[0010] Furthermore, the layer display module includes a layer overlay unit, a rendering optimization unit, and a screen output unit; The layer overlay unit is used to call the graphics drawing interface and perform multi-layer image overlay according to the layer order of lane line layer, vehicle layer and alarm layer; The rendering optimization unit is used to batch draw graphic elements of the same preset type in the same layer; it is also used to cache the position information of each graphic element in the previous frame, and determine the area where the position of the current frame is different from that of the previous frame as the area to be cleared; it compares the coordinates of each graphic element with the current viewport area, and marks the elements located outside the viewport area as invisible and skips rendering. The image output unit is used to push the superimposed visualization image to the terminal for output.

[0011] Furthermore, the main control module is also used to sort the rendering priorities of the lane line layer, vehicle layer, and alarm layer in the layer overlay unit according to the preset priority identifier and update frequency of each graphic element.

[0012] An ADAS data visualization method, comprising: S1: Receive the first ADAS data, and perform preprocessing and multi-level anti-shake processing on the first ADAS data to obtain the second ADAS data; S2: Transmit the second ADAS data to the scene rendering module; S3: Receive the second ADAS data through the scene rendering module and generate different rendering graphics data; S4: Receives the rendered graphics data output by the scene rendering module through the layer display module to generate a visual image and complete the terminal output.

[0013] An electronic device includes: a processor; a memory; and a program, wherein the program is stored in the memory and configured to be executed by the processor, the program being used to perform an ADAS data visualization method.

[0014] A computer-readable storage medium having a computer program stored thereon, the computer program being executed by a processor as an ADAS data visualization method.

[0015] The principles and advantages of this invention are: 1. The first ADAS data is processed by the data processing module through three levels of anti-shake processing: time window filtering, weighted average smoothing, time sequence alignment and interpolation point marking, to generate the second ADAS data. This solves the problem of frequent jitter of the displayed content caused by the lack of an effective anti-shake mechanism in the existing technology, and achieves a balance between data stability and real-time response requirements.

[0016] 2. The lane line module extracts lane line information to generate lane graphic data, the vehicle module extracts vehicle position, relative distance, and relative speed information to calculate collision time and generate vehicle graphic data, and the alarm module classifies alarm levels based on lane graphic data and vehicle graphic data and configures corresponding color codes and dynamic rendering parameters to generate warning graphic data. This solves the problem of the single alarm display function and the difficulty for users to quickly obtain key information in the existing technology, and realizes hierarchical management and visual enhancement of alarm information.

[0017] 3. By using the layer display module to perform multi-layer image overlay according to the layer order of lane line layer, vehicle layer, and alarm layer, batch drawing of graphic elements of the same preset type in the same layer is performed. The position information of the previous frame is cached to determine the area to be cleared. Invisible elements are marked and skipped from rendering based on the comparison between element coordinates and viewport area. This solves the problem of insufficient rendering performance causing lag in the existing technology and improves rendering efficiency and display smoothness. Attached Figure Description

[0018] This specification will be further described by way of exemplary embodiments, which will be described in detail with reference to the accompanying drawings. These embodiments are not limiting; in these embodiments, the same reference numerals denote the same structures, wherein: Figure 1 This is an exemplary system architecture diagram of an ADAS data visualization system; Figure 2 This is an exemplary flowchart of an ADAS data visualization method. Detailed Implementation

[0019] To more clearly illustrate the technical solutions of the embodiments in this specification, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are merely some examples or embodiments of this specification. For those skilled in the art, these drawings can be applied to other similar scenarios without creative effort. Unless obvious from the context or otherwise specified, the same reference numerals in the drawings represent the same structures or operations.

[0020] As indicated in this specification and claims, unless the context clearly indicates otherwise, the words "a," "an," "an," and / or "the" do not specifically refer to the singular and may also include the plural. Generally speaking, the terms "comprising" and "including" only indicate the inclusion of expressly identified steps and elements, which do not constitute an exclusive list, and the method or apparatus may also include other steps or elements.

[0021] Flowcharts are used in this specification to illustrate the operations performed by the system according to embodiments of this specification. It should be understood that the preceding or following operations are not necessarily performed in exact order. Instead, the steps can be processed in reverse order or simultaneously. Furthermore, other operations can be added to these processes, or one or more steps can be removed from them.

[0022] The following detailed explanation illustrates the specific implementation methods: Example 1: like Figure 1-2 As shown, an ADAS data visualization system includes: The main control module is used to issue system configuration parameters, schedule the runtime sequence and data interaction of the data processing module, scene rendering module, and layer display module, and monitor and manage the running status of each module.

[0023] The data processing module is used to receive the first ADAS data, perform preprocessing and multi-level anti-shake processing on the first ADAS data to obtain the second ADAS data, and transmit the second ADAS data to the scene rendering module.

[0024] In this embodiment, the data processing module first performs preprocessing on the received first ADAS data, including format parsing and legality verification, to obtain data after the format parsing and legality verification have passed.

[0025] ADAS data refers to data related to the vehicle's surrounding environment collected by advanced driver assistance systems through various sensors.

[0026] In this embodiment, the first ADAS data refers to the raw data received by the data processing module from the ADAS system. For example, the first ADAS data may include lane line information, obstacle information, vehicle status information, and alarm information.

[0027] In this embodiment, the data processing module can use a JSON parser to decompose the data message and extract fields such as the coordinate point set and confidence level of the lane line, the relative distance and relative speed of the obstacle, the vehicle speed and acceleration, and the alarm type and alarm level.

[0028] After extracting the fields, the data processing module can perform validity verification in various ways.

[0029] For example, range checks determine whether the relative distance is non-negative and whether the vehicle speed is within the 0-250 km / h range; enumeration checks determine whether the alarm level belongs to preset values ​​such as "warning" or "danger"; logical checks determine whether the coordinate point set meets the basic requirement that lane lines require at least two points; and integrity checks check whether key fields (such as obstacle distance) exist and are not empty. For data that fails verification, the data parsing unit marks it as illegal data and filters it to ensure that the data entering the multi-level anti-shake unit is complete and valid.

[0030] After obtaining the pre-processed first ADAS data, multi-level image stabilization is performed on it.

[0031] In this embodiment, the multi-level image stabilization process includes: A-1. The preprocessed first ADAS data is smoothed using a weighted average algorithm to obtain smoothed data.

[0032] Smoothing can be achieved using a weighted average algorithm, or, for example, a Kalman filter or a median filter.

[0033] A-2. Perform time-series alignment and interpolation point marking on the smoothed data to generate second ADAS data and transmit it to the scene rendering module.

[0034] The second ADAS data is the ADAS data after preprocessing and multi-level image stabilization.

[0035] In this embodiment, time alignment refers to unifying data from different sensors or different data sources onto the same time reference to ensure that data such as lane line information, obstacle information, and vehicle status information are consistent in time.

[0036] For example, lane line data is collected at T=100ms, vehicle distance data at T=120ms, and alarm data is triggered at T=110ms. The multi-level anti-shake unit uses the system's base clock as a reference and employs interpolation or hysteresis alignment to align the timestamps of all data to T=110ms. This ensures that the lane lines, vehicle positions, and alarm information used by the scene rendering module in the same frame are time-matched, avoiding display misalignment due to time deviations.

[0037] In this embodiment, the interpolation point marker refers to marking the position where the time interval between two adjacent sets of data in the time-aligned data exceeds a preset threshold. This position is marked to indicate that inter-frame interpolation calculation is required, and the start and end data points and timestamp information required for interpolation are recorded.

[0038] For example, the normal reception interval of ADAS data is 33 milliseconds. If the time interval between two adjacent sets of data reaches 66 milliseconds due to network fluctuations or sensor delays, the multi-level anti-shake unit inserts interpolation point markers at this position. The markers include the starting data point (such as the coordinates of the previous set of valid lane lines), the ending data point (such as the coordinates of the current set of valid lane lines), and the number of intermediate frames to be interpolated (such as 2 frames). The scene rendering module calculates the image data of the intermediate frames at the rendering level based on these markers to ensure the continuity and smoothness of the display.

[0039] The scene rendering module is used to receive the second ADAS data and generate different rendering graphics data.

[0040] The scene rendering module includes a lane line module, a vehicle module, and an alarm module.

[0041] The lane line module is used to extract lane line information from the second ADAS data, smooth the lane line information and configure the line color, generate lane graphic data, and transmit the lane graphic data to the alarm module.

[0042] Lane graphic data refers to the lane line rendering instruction set generated by the lane line module after parsing, smoothing and color configuring the lane line information in the second ADAS data, which is used for Canvas drawing.

[0043] For example, lane graphic data can include parameters such as the coordinate point set of lane lines, line width, line color, and line style.

[0044] Specifically, the lane line module extracts the original coordinate point set of the lane line from the second ADAS data; it uses a cubic spline interpolation algorithm to fit the discrete points to generate a smooth continuous curve coordinate sequence; it sets the line transparency according to the lane line confidence field and configures the corresponding line style according to the lane line type; it encapsulates the processed coordinate point set, line width, line color and line style into a lane line rendering instruction set and transmits it to the alarm module as lane graphic data.

[0045] The lane line confidence field can be set based on the experience of domain personnel; for example, the transparency can be set to 0.5 when it is below 70%.

[0046] The vehicle module is used to extract vehicle position, relative distance, and relative speed information from the second ADAS data; it calculates the collision time based on the extracted vehicle position, relative distance, and relative speed information, and generates vehicle graphic data by combining the vehicle outline information, and transmits the vehicle graphic data to the alarm module.

[0047] Vehicle graphic data refers to the set of vehicle marker rendering instructions generated by the vehicle module after parsing the vehicle information in the second ADAS data, which is used for Canvas drawing.

[0048] For example, vehicle graphic data may include the coordinates of vehicle markers, vehicle outline shape, vehicle type, and relative motion parameters.

[0049] In this embodiment, the vehicle module calculates the collision time based on the extracted vehicle position, relative distance, and relative speed information, and generates vehicle graphic data by combining the vehicle outline information, and transmits the vehicle graphic data to the alarm module.

[0050] Specifically, the vehicle module calculates the collision time by dividing the relative distance by the absolute value of the relative speed, and encapsulates the calculated collision time together with the vehicle position and vehicle outline information into a vehicle marking rendering instruction set, which is then transmitted to the alarm module.

[0051] The alarm module is used to perform calculations on the received lane graphic data and vehicle graphic data; according to the preset judgment rules, it classifies the alarm level, sets the rendering order of the warning graphic data according to the alarm level, configures the corresponding color code and dynamic rendering parameters for the warning graphic data of different levels, and outputs the processed warning graphic data.

[0052] For example, when the collision time output by the vehicle module is less than the first preset threshold, it is determined to be a level one alarm; when the collision time is less than the second preset threshold, it is determined to be a level two alarm; when the lane line module detects that the vehicle deviates from the current lane and does not use the turn signal, it is determined to be a lane departure alarm.

[0053] Among them, the Level 2 alarm has the highest rendering priority, followed by the Level 1 alarm, and the lane departure alarm has the lowest priority.

[0054] The Level 2 alarm is configured with red color coding and high-frequency flashing dynamic effect, the Level 1 alarm is configured with yellow color coding and medium-frequency flashing dynamic effect, and the lane departure alarm is configured with blue color coding and static display effect.

[0055] In this embodiment, the scene rendering module also includes a built-in tool unit.

[0056] The tool unit includes drawing tools and zoom tools.

[0057] The scaling tool calculates a scaling ratio based on the ratio of the current display device's resolution to a preset reference resolution, and multiplies the coordinate values ​​used to generate lane and vehicle graphic data from the second ADAS data by the scaling ratio to obtain adapted coordinate values. It also adjusts the line width and vehicle marker size according to the scaling ratio to obtain adapted line width and adapted vehicle marker size. This ensures a suitable display effect on devices with different resolutions.

[0058] The drawing tools are used to perform graphic drawing operations on lane graphic data and vehicle graphic data based on the adapted coordinate values, adapted line widths, and adapted vehicle mark sizes.

[0059] In this embodiment, the drawing tool encapsulates common drawing methods of the Canvas context object, such as drawing basic graphic operations like rectangles, circles, line segments, and text, for use by the lane line module, vehicle module, and alarm module.

[0060] The layer display module is used to receive the rendered graphics data output by the scene rendering module to generate a visual image and complete the terminal output.

[0061] In this embodiment, the layer display module includes a layer overlay unit, a rendering optimization unit, and a screen output unit.

[0062] The layer overlay unit is used to call the graphics drawing interface to perform multi-layer image overlay according to the layer order of lane line layer, vehicle layer, and alarm layer. The graphics drawing interface can be drawing methods provided by the Canvas context object, such as the drawImage method used to draw each layer onto the main canvas, or fillRect, stroke, etc. used to directly draw graphic elements on the corresponding layers.

[0063] Specifically, three Canvas buffers are created using the layer overlay unit, serving as the drawing carriers for the lane line layer, vehicle layer, and alarm layer, respectively. The lane line module, vehicle module, and alarm module each draw their generated rendering instruction sets onto their corresponding Canvas. The layer overlay unit calls the main canvas's drawImage interface sequentially from the bottom layer to the top layer, drawing the contents of the lane line layer, vehicle layer, and alarm layer onto the main canvas to complete the overlay and compositing of multiple layers. The alarm layer is located at the top layer to ensure that the alarm information is always displayed above the lane lines and vehicle markers, without being obscured.

[0064] In this embodiment, the content of each layer is updated independently, eliminating the need to redraw the entire screen. This reduces unnecessary redrawing overhead and improves rendering efficiency. Simultaneously, layered overlay ensures that alarm information is displayed on the top layer, preventing critical warning content from being obscured by other graphic elements, thus improving the readability of alarm information and user response speed.

[0065] The rendering optimization unit is used to batch draw graphic elements of the same preset type within the same layer.

[0066] Among them, the same preset type refers to a category of graphic elements that have the same graphic attributes or share the same drawing instructions.

[0067] For example, in the vehicle layer, the rectangular bounding boxes of all target vehicles belong to the same preset type. After the rendering optimization unit collects the coordinate position and size information of all vehicles in the current frame, it calls the fillRect method to draw all vehicle bounding boxes in batches at once, instead of calling the drawing method for each vehicle individually.

[0068] For example, in the lane line layer, all lane line segments belong to the same preset type. The rendering optimization unit collects the coordinate points of all lane lines and then calls the stroke method at once to complete the drawing of all lane lines.

[0069] In this embodiment, batch drawing reduces the number of calls to the Canvas API, thereby reducing the interaction overhead between the CPU and the graphics interface and improving rendering efficiency.

[0070] The rendering optimization unit is also used to cache the position information of each graphic element in the previous frame, and to identify the area where the position in the current frame is different from that in the previous frame as the area to be cleared; and to compare the coordinates of each graphic element with the current viewport area, and to mark the elements located outside the viewport area as invisible and skip rendering.

[0071] Specifically, the rendering optimization unit pre-sets a mapping table of element positions from the previous frame to record the coordinates and boundary range of each graphic element in the previous frame. When receiving data from the current frame, it compares the current position with the cached position element by element. If the position changes, the area occupied by that element in the previous frame is marked as a region to be cleared, represented by a rectangular bounding box. After collecting all regions to be cleared, the rendering optimization unit calls the `clearRect` method on each region to perform local clearing, rather than clearing the entire canvas.

[0072] In terms of viewport comparison, the rendering optimization unit obtains the visible area boundary of the current viewport (i.e., the coordinate range from the upper left corner to the lower right corner of the canvas), traverses all graphic elements, and if the coordinate position of an element exceeds the viewport boundary (e.g., the x-coordinate of a vehicle marker is less than 0 or greater than the canvas width), the element is marked as invisible and subsequent drawing calls are skipped directly. Rendering operations are only performed on elements located within the viewport area or intersecting with the viewport.

[0073] In this embodiment, unnecessary canvas clearing and drawing operations are reduced by partial clearing and viewport clipping, thereby reducing the load on the CPU and graphics interface and improving the rendering frame rate and overall smoothness.

[0074] The screen output unit is used to push the superimposed visualization to the terminal for output.

[0075] In this embodiment, the main control module is also used to sort the rendering priorities of the lane line layer, vehicle layer, and alarm layer in the layer overlay unit according to the preset priority identifier and update frequency of each graphic element.

[0076] The main control module sets up a layer priority queue. Each layer is assigned a preset priority identifier during initialization. At the same time, the priority is dynamically adjusted according to the update frequency of the graphic elements in each layer: layers with high update frequency (such as the vehicle layer where the vehicle position changes every frame) have their rendering priority appropriately increased, while layers with low update frequency (such as the lane line layer where changes are slow) have their priority decreased.

[0077] For example, if the alarm module fails to output warning graphic data for three consecutive frames, the main control module can temporarily reduce the rendering priority of the alarm layer and raise the priority of the vehicle layer to the highest level to ensure the real-time rendering of dynamic vehicle positions. When new alarm data arrives, the main control module immediately restores the priority of the alarm layer to the highest level to ensure that the alarm information can be displayed in a timely manner.

[0078] In this embodiment, by combining preset priorities with dynamic adjustments, rendering resources are allocated reasonably while ensuring timely response to alarm information, thus avoiding unnecessary processing overhead caused by low-update-frequency layers.

[0079] This embodiment also provides an ADAS data visualization method, including: S1: Receive the first ADAS data, and perform preprocessing and multi-level anti-shake processing on the first ADAS data to obtain the second ADAS data.

[0080] S2: Transfer the second ADAS data to the scene rendering module.

[0081] S3: Receive the second ADAS data through the scene rendering module and generate different rendering graphics data.

[0082] S4: Receives the rendered graphics data output by the scene rendering module through the layer display module to generate a visual image and complete the terminal output.

[0083] The above method preprocesses and performs multi-level anti-shake processing on the received first ADAS data to generate more stable second ADAS data. Then, the scene rendering module generates rendered graphic data based on the second ADAS data, and the layer display module generates a visualization and completes the terminal output. This reduces the impact of fluctuations in the original ADAS data on the displayed image, reduces jitter in display elements such as vehicles and lane lines, and improves the stability, continuity, and smoothness of ADAS data visualization.

[0084] This embodiment also provides an electronic device, including: a processor; a memory and a program, wherein the program is stored in the memory and configured to be executed by the processor, the program being used to perform an ADAS data visualization method.

[0085] This embodiment also provides a computer-readable storage medium storing a computer program thereon, the computer program being executed by a processor as an ADAS data visualization method.

[0086] The basic concepts have been described above. Obviously, for those skilled in the art, the detailed disclosure above is merely illustrative and does not constitute a limitation of this specification. Although not explicitly stated herein, those skilled in the art may make various modifications, improvements, and corrections to this specification. Such modifications, improvements, and corrections are suggested in this specification and therefore remain within the spirit and scope of the exemplary embodiments described herein.

[0087] Furthermore, unless expressly stated in the claims, the order of processing elements and sequences, the use of numbers and letters, or other names described in this specification are not intended to limit the order of the processes and methods described herein. Although various examples have been discussed in the foregoing disclosure of some embodiments of the invention that are currently considered useful, it should be understood that such details are for illustrative purposes only, and the appended claims are not limited to the disclosed embodiments; rather, the claims are intended to cover all modifications and equivalent combinations that conform to the spirit and scope of the embodiments described herein. For example, while the system components described above can be implemented using hardware devices, they can also be implemented solely using software solutions, such as installing the described system on existing servers or mobile devices.

[0088] Similarly, it should be noted that, in order to simplify the description disclosed herein and thus aid in the understanding of one or more embodiments of the invention, the foregoing description of embodiments in this specification may sometimes combine multiple features into a single embodiment, drawing, or description thereof. However, this method of disclosure does not imply that the subject matter of this specification requires more features than those mentioned in the claims. In fact, the embodiments contain fewer features than all the features of a single embodiment disclosed above.

[0089] In some embodiments, numbers describing the quantity of components and attributes are used. It should be understood that such numbers used in the description of embodiments are modified in some examples with the terms "approximately," "approximately," or "generally." Unless otherwise stated, "approximately," "approximately," or "generally" indicates that the numbers are allowed to vary by ±20%. Accordingly, in some embodiments, the numerical parameters used in the specification and claims are approximate values, which may be changed depending on the characteristics required by individual embodiments. In some embodiments, numerical parameters should take into account specified significant digits and employ a general method of digit reservation. Although the numerical ranges and parameters used to confirm their breadth of range in some embodiments of this specification are approximate values, in specific embodiments, such values ​​are set as precisely as feasible.

[0090] For each patent, patent application, patent application publication, and other material such as articles, books, specifications, publications, and documents referenced in this specification, the entire contents of which are incorporated herein by reference. This excludes historical application documents that are inconsistent with or conflict with the content of this specification, as well as documents that limit the broadest scope of the claims in this specification (currently or subsequently appended to this specification). It should be noted that in the event of any inconsistency or conflict between the descriptions, definitions, and / or terminology used in the supplementary materials to this specification and the content of this specification, the descriptions, definitions, and / or terminology used in this specification shall prevail.

[0091] Finally, it should be understood that the embodiments described in this specification are merely illustrative of the principles of the embodiments described herein. Other variations may also fall within the scope of this specification. Therefore, alternative configurations of the embodiments described herein are intended to be illustrative rather than limiting, and should be considered consistent with the teachings of this specification. Accordingly, the embodiments described herein are not limited to those explicitly introduced and described herein.

Claims

1. An ADAS data visualization system, characterized in that, include: The main control module is used to issue system configuration parameters, schedule the runtime sequence and data interaction of the data processing module, scene rendering module, and layer display module, and monitor and manage the running status of each module. The data processing module is used to receive the first ADAS data and perform preprocessing and multi-level anti-shake processing on the first ADAS data to obtain the second ADAS data. The second ADAS data is transmitted to the scene rendering module; The scene rendering module is used to receive the second ADAS data and generate different rendering graphics data; The layer display module is used to receive the rendered graphics data output by the scene rendering module to generate a visual image and complete the terminal output.

2. The ADAS data visualization system according to claim 1, characterized in that, The multi-level image stabilization process includes: The preprocessed data is smoothed using a weighted average algorithm to obtain smoothed data. The smoothed data is time-aligned and interpolated to mark the points, generating second ADAS data and transmitting it to the scene rendering module.

3. The ADAS data visualization system according to claim 1, characterized in that, The scene rendering module includes a lane line module, a vehicle module, and an alarm module; The lane line module is used to extract lane line information from the second ADAS data, smooth the lane line information and configure the line color to generate lane graphic data, and transmit the lane graphic data to the alarm module. The vehicle module is used to extract vehicle position, relative distance, and relative speed information from the second ADAS data; calculate the collision time based on the extracted vehicle position, relative distance, and relative speed information, and generate vehicle graphic data by combining the vehicle outline information, and transmit the vehicle graphic data to the alarm module.

4. The ADAS data visualization system according to claim 3, characterized in that, The alarm module is used to perform calculations on the received lane graphic data and vehicle graphic data; classify alarm levels according to preset judgment rules; set the rendering order of warning graphic data according to the alarm level; configure corresponding color codes and dynamic rendering parameters for warning graphic data of different levels; and output the processed warning graphic data.

5. The ADAS data visualization system according to claim 3, characterized in that, The scene rendering module also has a built-in tool unit; the tool unit includes drawing tools and zoom tools; The scaling tool calculates the scaling ratio based on the ratio of the current display device's resolution to the preset reference resolution, and multiplies the coordinate values ​​in the second ADAS data used to generate lane graphic data and vehicle graphic data by the scaling ratio to obtain the adapted coordinate values. And adjust the line width and vehicle mark size according to the scaling ratio to obtain the adapted line width and adapted vehicle mark size; The drawing tool is used to perform graphic drawing operations on lane graphic data and vehicle graphic data based on the adapted coordinate values, adapted line width, and adapted vehicle mark size.

6. The ADAS data visualization system according to claim 1, characterized in that, The layer display module includes a layer overlay unit, a rendering optimization unit, and a screen output unit; The layer overlay unit is used to call the graphics drawing interface and perform multi-layer image overlay according to the layer order of lane line layer, vehicle layer and alarm layer; The rendering optimization unit is used to batch draw graphic elements of the same preset type within the same layer; It is also used to cache the position information of each graphic element in the previous frame, and to identify the area where the position of the current frame is different from that of the previous frame as the area to be cleared; and to compare the coordinates of each graphic element with the current viewport area, and to mark the elements located outside the viewport area as invisible and skip rendering. The image output unit is used to push the superimposed visualization image to the terminal for output.

7. The ADAS data visualization system according to claim 6, characterized in that, The main control module is also used to sort the rendering priorities of the lane line layer, vehicle layer, and alarm layer in the layer overlay unit according to the preset priority identifier and update frequency of each graphic element.

8. An ADAS data visualization method, characterized in that, include: S1: Receive the first ADAS data, and perform preprocessing and multi-level anti-shake processing on the first ADAS data to obtain the second ADAS data; S2: Transmit the second ADAS data to the scene rendering module; S3: Receive the second ADAS data through the scene rendering module and generate different rendering graphics data; S4: Receives the rendered graphics data output by the scene rendering module through the layer display module to generate a visual image and complete the terminal output.

9. An electronic device, characterized in that, include: processor; The memory and the program, wherein the program is stored in the memory and configured to be executed by a processor, the program being used to perform the method of claim 8.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, The computer program is executed by a processor as described in claim 8.

Images