Display exception processing method and device, equipment and storage medium

Abstract

The invention discloses a display exception processing method and device, equipment and a storage medium. The method comprises the steps that the collection time of sensing signals corresponding to multiple visual objects is obtained, the multiple visual objects are displayed on a vehicle-mounted display interface, and the visual objects are obtained through 3D rendering based on the corresponding sensing signals; according to the collection time sequence, respectively calculating the duration difference between the collection time corresponding to each visual object and the current time; and determining the visual object of which the duration difference exceeds a preset duration threshold as a target visual object, and removing the target visual object from the vehicle-mounted display interface. According to the method, the abnormally displayed visual object can be removed from the vehicle-mounted display interface in time, so that the problems of interface lagging, visual disorder and the like caused by display retention are avoided, the real-time response capability of a vehicle-mounted display system is improved, and the visual experience of a user is also enhanced.

Description

Technical Field

[0001] The present application belongs to the field of vehicle technology, and in particular, relates to a display abnormality processing method, device, equipment and storage medium. Background Art

[0002] In the on-board system of an intelligent vehicle, by collecting perception signals of the surrounding environment in real time and transmitting these signals to the 3D rendering engine for processing, a visual image of a dynamic driving scene can be generated.

[0003] However, in the existing solution, abnormal situations may occur during the rendering process, causing some rendered objects to get stuck on the car screen and fail to disappear in time. This phenomenon will affect the dynamic update of the scene, reduce the real-time performance of the driving scene, and further affect the driver's judgment and operation, and in serious cases may affect driving safety.

[0004] Therefore, how to effectively solve the rendering lag problem and improve the system's response speed and real-time performance has become a technical problem that needs to be solved urgently. Summary of the invention

[0005] The embodiments of the present application provide a method, device, equipment and computer storage medium for processing display anomalies, which can effectively solve the problem of rendering lag.

[0006] In a first aspect, an embodiment of the present application provides a method for processing display abnormalities, the method comprising:

[0007] Acquiring acquisition times of perception signals corresponding to a plurality of visualization objects, wherein the plurality of visualization objects are displayed on an in-vehicle display interface, and the visualization objects are obtained by 3D rendering based on the corresponding perception signals;

[0008] According to the order of acquisition time, calculate the time difference between the acquisition time corresponding to each visualization object and the current time;

[0009] The visualization object whose time difference exceeds the preset time threshold is determined as the target visualization object, and the target visualization object is removed from the vehicle display interface.

[0010] In a possible implementation manner of the first aspect, determining a visualization object whose time difference exceeds a preset time threshold as a target visualization object, and removing the target visualization object from the in-vehicle display interface, the method further includes:

[0011] For any target visualization object, read the signal value of the perception signal corresponding to the target visualization object in the signal acquisition buffer;

[0012] The target visualization object whose signal value meets the preset conditions is removed from the vehicle display interface. The preset conditions include: the signal value is lost or the environmental element corresponding to the signal value indication does not exist.

[0013] In a possible implementation manner of the first aspect, the method further includes:

[0014] The identifier of each visualization object and the corresponding acquisition time are stored in a pre-built target mapping table in the form of a key-value pair.

[0015] In a possible implementation manner of the first aspect, the method further includes:

[0016] For any visualization object stored in the target mapping table, when the environment element corresponding to the visualization object satisfies the disappearance judgment, the visualization object and the corresponding acquisition time are deleted from the target mapping table.

[0017] In a possible implementation manner of the first aspect, after removing the target visualization object from the in-vehicle display interface, the method further includes:

[0018] Delete the target visualization object and the corresponding acquisition time from the target mapping table.

[0019] In a possible implementation manner of the first aspect, determining a visualization object whose time difference exceeds a preset time threshold as a target visualization object, and removing the target visualization object from the vehicle-mounted display interface includes:

[0020] Query the target visualization object identifier in the target mapping table;

[0021] According to the identifier of the target visualization object, the target visualization object is found in the vehicle display interface and removed.

[0022] In a possible implementation manner of the first aspect, removing the target visualization object from the in-vehicle display interface includes:

[0023] Delete the target visualization object from the vehicle display interface; or modify the rendering property of the target visualization object to be invisible.

[0024] In a possible implementation of the first aspect, calculating the time difference between the acquisition time corresponding to each visualization object and the current time in the acquisition time sequence includes:

[0025] The target mapping table is periodically calculated after a preset time interval, and the preset time interval is less than a preset duration threshold.

[0026] In a possible implementation manner of the first aspect, the acquisition time in the target mapping table is converted into a timestamp for storage.

[0027] In a second aspect, an embodiment of the present application provides a display abnormality processing device, the device comprising:

[0028] An acquisition module is used to acquire the acquisition time of the perception signals corresponding to the multiple visualization objects respectively, wherein the multiple visualization objects are displayed on the vehicle display interface, and the visualization objects are obtained by 3D rendering based on the corresponding perception signals;

[0029] The calculation module is used to calculate the time difference between the acquisition time corresponding to each visualization object and the current time according to the acquisition time sequence;

[0030] The processing module is used to determine the visualization object whose time difference exceeds a preset time threshold as a target visualization object, and remove the target visualization object from the vehicle display interface.

[0031] In a third aspect, an embodiment of the present application provides a computer device, comprising: a processor, and a memory storing computer program instructions; the processor reads and executes the computer program instructions to implement any one of the methods in the first aspect above.

[0032] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having computer program instructions stored thereon, and when the computer program instructions are executed by a processor, the method of any one of the above-mentioned first aspects is implemented.

[0033] In a fifth aspect, an embodiment of the present application provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, it implements any one of the methods in the above-mentioned first aspect.

[0034] The technical solution provided by the embodiments of the present application brings at least the following beneficial effects:

[0035] The display abnormality processing method provided in the embodiment of the present application records the acquisition time of the perception signal corresponding to each visualization object and calculates the time difference with the current time, so as to effectively identify the abnormal visualization object whose display time exceeds the preset threshold. This method can promptly remove the abnormally displayed visualization object from the vehicle display interface, thereby avoiding problems such as interface freeze and visual confusion caused by display retention, which not only significantly improves the real-time response capability of the vehicle display system, but also enhances the user's visual experience, ensures the smoothness and clarity of the vehicle display interface, and improves the overall stability and reliability of the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the technical solution of the embodiments of the present application, the following is a brief introduction to the drawings required for use in the embodiments of the present application.

[0037] Figure 1 It is a flowchart of a method for processing display abnormality provided in an embodiment of the present application;

[0038] Figure 2 It is a flowchart of a method for processing display abnormality provided in an embodiment of the present application;

[0039] Figure 3 It is a flowchart of a method for processing display abnormality provided in an embodiment of the present application;

[0040] Figure 4 is a schematic diagram of a target mapping table provided in an embodiment of the present application;

[0041] Figure 5 It is a schematic diagram of a framework of an abnormal display processing system provided in an embodiment of the present application;

[0042] Figure 6 It is a structural schematic diagram of a display abnormality processing device provided in an embodiment of the present application;

[0043] Figure 7 It is a structural diagram of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0044] In order to make those of ordinary skill in the art better understand the technical scheme of the present application, the technical scheme in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings. It should be understood that the specific embodiments described herein are only intended to explain the present application, rather than to limit the present application. For those skilled in the art, the present application can be implemented without the need for some of these specific details. The following description of the embodiments is only to provide a better understanding of the present application by illustrating the examples of the present application.

[0045] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present application described here can be implemented in an order other than those illustrated or described here. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. On the contrary, they are only examples consistent with some aspects of the present application as detailed in the attached claims.

[0046] As described in the background technology section, the rendering process of the perception signal in the prior art may have abnormal situations, such as loss of disappearance signal, abnormal rendering update signal or system freeze, etc., which causes some rendered objects to be stuck on the vehicle screen and cannot disappear in time. This not only affects the real-time performance of the driving scene, but may also interfere with the driver's field of vision, thereby affecting driving decisions and safety. In order to solve this technical problem, the embodiment of the present application proposes a display abnormality processing method, device, equipment and computer storage medium, which determines whether the rendered object should disappear by judging the display time of the rendered object. If it is found that the display of an object exceeds the preset time, it is considered that the object has a display abnormality, and then the object is automatically removed to ensure that the scene presented on the vehicle display interface is real-time and accurate, avoid the stuck phenomenon of the rendered object, improve the user experience and ensure driving safety.

[0047] The method for processing display abnormalities provided in the embodiments of the present application is described in detail below through specific embodiments in conjunction with the accompanying drawings.

[0048] Figure 1 A flowchart of a method for processing display anomalies provided by an embodiment of the present application is shown.

[0049] like Figure 1 As shown, the method may include the following steps.

[0050] S110: Obtaining acquisition time of perception signals corresponding to a plurality of visualization objects respectively.

[0051] It can be understood that the execution entity of the embodiment of the present application can be a vehicle-mounted computer, a vehicle-mounted system or other vehicle-mounted equipment, which is responsible for processing environmental perception data and driving the vehicle-mounted display device to perform corresponding rendering operations.

[0052] The applicable scenarios of the method of the present application are: through various sensors such as radars and cameras, the perception signals of various environmental elements in the vehicle's surrounding environment are collected in real time, the collected perception signals are processed, converted into 3D rendered visualization objects, and displayed in real time on the on-board display interface, and provided to the driver or the automatic driving system as information to assist decision-making.

[0053] Perception signals refer to attribute data containing environmental element information obtained by processing and transforming the original environmental data collected by vehicle-mounted sensors.

[0054] Exemplarily, the perception signal may include, but is not limited to, the following information: timestamp, data value, spatial coordinates of environmental elements, and other information.

[0055] Exemplarily, there may be multiple types of perception signals, such as lane line signals, obstacle signals, lane marking signals, etc. Each signal type corresponds to a specific environmental element and is used to describe various types of information about the vehicle's surroundings. For example, a lane line signal provides information about the position and angle of the lane line, while an obstacle signal provides information about the position and type of the obstacle. Different types of perception signals will be converted into different visualization objects.

[0056] Visual objects refer to virtual objects that convert perception signals into visual forms through 3D rendering and can be displayed on the in-vehicle display screen.

[0057] Each perception signal corresponds to at least one visualization object. Multiple perception signals are used to generate multiple visualization objects through 3D rendering and displayed together on the vehicle display screen, forming a real-time image interface of the driving assistance system.

[0058] Exemplarily, the visualized objects may include lane lines, vehicles, pedestrians, traffic lights, etc.

[0059] In short, perception data is the raw environmental data collected by sensors, which is processed and analyzed to extract the corresponding perception signals. Each perception signal contains information about a specific environmental element, and the 3D rendering engine generates corresponding visualization objects based on this information. For example, the lane line signal provides the spatial coordinates and geometric shape of the lane line, and the 3D rendering engine generates the corresponding lane line visualization object based on this information, which is finally presented on the in-vehicle display.

[0060] It is understandable that after the perception signal is collected, it is transmitted to the display device for rendering through the vehicle-mounted device. Usually, without considering subtle differences, the collection time and display time are almost synchronized, that is, the collection duration and display duration can be considered consistent. Therefore, the display duration of the visualization object can be indirectly inferred by the collection time of the perception signal.

[0061] Therefore, in one implementation, obtaining the acquisition time of the perception signals corresponding to multiple visualization objects respectively includes: performing 3D rendering on the collected multiple perception signals to obtain multiple visualization objects, and displaying the multiple visualization objects on the vehicle display interface, recording the acquisition time of each perception signal.

[0062] In one implementation, in response to obtaining the acquisition time of the perception signals corresponding to multiple visualizations, the identifier of each visualization object and the acquisition time of the corresponding perception signal can be stored in a pre-built target mapping table in the form of a key-value pair. Each entry in the target mapping table contains a unique visualization object identifier as a key and an acquisition time as a value. When it is necessary to retrieve or update the status of a visualization object based on the acquisition time, the table can be quickly accessed to directly locate the corresponding acquisition time through the identifier. This method makes storage and query efficiency high and facilitates the management and processing of large-scale real-time perception data.

[0063] In one implementation, in response to obtaining the acquisition time of the perception signals corresponding to the plurality of visualizations, the identifier of the visualization object and the acquisition time of the corresponding perception signal can be stored in an array or list in the form of a structure or a tuple. Each structure or tuple contains two elements: one is an identifier, which is used to uniquely identify the visualization object; the other is an acquisition time, which indicates the time when the perception signal of the object was acquired. By combining the identifier and the acquisition time and storing them in an array or a list, the plurality of visualization objects and their acquisition times can be compactly stored in a data structure, which is convenient for batch processing and iterative access.

[0064] S120: Calculate the time difference between the acquisition time corresponding to each visualization object and the current time according to the acquisition time sequence.

[0065] In this step, the time difference between the acquisition time corresponding to each visualization object and the current time needs to be calculated according to the acquisition time sequence.

[0066] To simplify the calculation, the acquisition time and current time can be converted into timestamps. After conversion into timestamps, the duration difference of each visualization object is obtained by calculating the difference between the acquisition time and the current time.

[0067] For example, the timestamp is a time value calculated based on 00:00:00 UTC (Coordinated Universal Time) on January 1, 1970. In other words, we can use 00:00:00 UTC (Coordinated Universal Time) on January 1, 1970 as the starting point, subtract the starting point from the collection time to get the timestamp of the collection time; and subtract the time point from the current time to get the timestamp of the current time.

[0068] In one implementation, when a target mapping table is used to store the identifier and the acquisition time of each visualization object in the form of a key-value pair, the acquisition time in the target mapping table is converted into a timestamp for storage.

[0069] The calculation method of the time difference includes:

[0070] You can traverse all entries in the target mapping table, extract the collection time of each object and compare it with the current time in the order of collection time. The specific steps are as follows:

[0071] Traverse all entries in the target mapping table and extract the identifier of the visualization object and the corresponding acquisition time.

[0072] Convert the acquisition time and current time into timestamp.

[0073] Calculate the duration difference of each object, that is, the difference between the current timestamp and the acquisition timestamp of the object.

[0074] The duration difference of each visualization object is calculated in sequence according to the acquisition time.

[0075] This method is suitable for when the size of the target mapping table is relatively small or the number of entries in the table is small, and can quickly perform traversal and time difference calculation in sequence. For example, the target mapping table can accommodate 200 key-value pairs.

[0076] S130: Determine the visualization object whose duration difference exceeds a preset duration threshold as a target visualization object, and remove the target visualization object from the vehicle-mounted display interface.

[0077] The preset duration threshold refers to a standard duration that is preset and is used to determine whether a display abnormality occurs in a visualization object.

[0078] It should be understood that in practical applications, the specific value of the preset duration threshold can be flexibly set according to different environmental perception signal types or display requirements, and this application does not limit this. Exemplarily, the preset duration threshold can be set to 5 seconds.

[0079] In this step, for any visualization object, when the time difference between its acquisition time and the current time exceeds the preset time threshold, it is determined that the visualization object may have display abnormality, such as being stuck on the display interface, and it is identified as a target visualization object and removed from the vehicle display interface.

[0080] For example, the preset duration threshold is set to 5 seconds, the current time is 2024-11-22 11:35:05, and the corresponding timestamp is 1732246505. The timestamp of the first visualization object obstacle1 is 1732244988. By calculating the duration difference 1732246505-1732244988=1517 seconds>5 seconds, it means that obstacle1 has been displayed on the vehicle display interface for a long time, and there may be lag or display abnormality. Therefore, the visualization object is identified as the target visualization object and removed from the display interface to restore the real-time and smoothness of the interface display.

[0081] This application solution can quickly identify abnormal objects whose display time exceeds a preset threshold by recording the acquisition time information of each perceived object and calculating the time difference between it and the current time, and remove the corresponding visual objects from the vehicle display interface. This method effectively avoids the interface jamming problem caused by display retention and improves the real-time performance and visual clarity of the vehicle display system.

[0082] In one embodiment, removing the target visual object from the vehicle display interface may include the following steps:

[0083] S131. Query the target visualization object's identifier in the target mapping table.

[0084] As mentioned above, the target mapping table is a data structure containing information such as the visual object identifier and its corresponding acquisition time. Each visual object has a unique identifier that is used to correspond to the acquired perception signal, rendering process, and display element on the display interface.

[0085] By querying the target mapping table, the identifiers of the target visualization objects to be removed can be obtained, and then it can be confirmed which visualization objects have been displayed for a duration exceeding a preset duration threshold and have display anomalies.

[0086] S132: According to the identifier of the target visualization object, find the target visualization object in the vehicle display interface and remove it.

[0087] According to the identifier queried in the previous step, the corresponding visual object is located and searched on the vehicle display interface. If the identifier has a corresponding visual object in the vehicle display interface, the object will be identified and selected on the display interface. After finding the target visual object, it can be removed from the vehicle display interface in different ways.

[0088] In one implementation, the operation corresponding to removing the target visualization object from the vehicle display interface may be: deleting the target visualization object from the vehicle display interface. The deletion operation may include removing the data record of the object from the display layer, refreshing the display interface, or re-rendering the current image to ensure that the target visualization object is no longer displayed.

[0089] In one implementation, the operation corresponding to removing the target visual object from the vehicle display interface may be: modifying the rendering attribute of the target visual object to be invisible. By modifying the rendering attribute of the visual object to the "invisible" state, the target object still exists in the vehicle display system, but it will not be rendered and displayed on the screen. In this way, the data of the target object is still retained in the system and can be restored for display or further processing when needed.

[0090] The above two implementation methods can effectively remove abnormal display objects by deleting the target visualization object or modifying its rendering properties to be invisible. This solution simplifies the interface management process, avoids abnormal objects interfering with the user's vision, and improves the clarity of the vehicle display interface and the controllability of the system.

[0091] In this embodiment, the identifier of the target perception object is queried through the target mapping table, and the target visualization object in the vehicle display interface is quickly located and removed accordingly. This method simplifies the location and processing flow of abnormal display objects, improves the response efficiency of the system, and ensures the real-time and accuracy of the display interface.

[0092] It should be noted that, based on the foregoing, the method of judging whether a visual object displays an abnormality based solely on the time difference has low accuracy and the possibility of misjudgment. In other words, some visual objects that do not display abnormalities may be misjudged as abnormal due to timeouts and mistakenly removed from the vehicle display interface. This misjudgment may affect the driver's judgment of the surrounding environment and may even cause interference. In order to solve this problem, the present application proposes a method for processing display abnormalities in combination with a secondary test of the signal value, which further improves the accuracy of display abnormality detection by adding the test of the signal value. The following is combined with Figure 2 The process is introduced in detail.

[0093] Figure 2 A schematic flow chart of a method for processing display anomalies provided in an embodiment of the present application is shown.

[0094] It should be understood that Figure 2 Embodiments include Figure 1 In addition to all the steps of the embodiment, the following steps are also included.

[0095] S210 . For any target visualization object, read a signal value of a perception signal corresponding to the target visualization object in a signal acquisition buffer.

[0096] For each target visualization object that has been identified as possibly abnormal, the signal value of the corresponding perception signal of the target visualization object is read from the signal acquisition buffer.

[0097] Signal value refers to the actual numerical information in the perceived signal, which may include information such as the specific state, attributes, or position of the visual object.

[0098] In the vehicle system, all perception signals are collected regularly and stored in the signal collection buffer. The information in the buffer can help the system confirm the current state of a visual object and whether it still exists in the environment.

[0099] For example, for an obstacle signal, the signal value may include information such as whether the obstacle is still on the lane and whether it is moving; for a lane line signal, the signal value may indicate the shape and position of the lane line.

[0100] S220: Remove the target visualization object whose signal value meets the preset condition from the vehicle display interface.

[0101] By further judging the read perception signal value, it is confirmed whether the target visualization object does have a display abnormality. Specifically, the read perception signal value is further analyzed to determine whether there is a problem with the signal value, and then decide whether to remove the target visualization object from the vehicle display interface.

[0102] The preset condition refers to a signal value standard for determining whether a target visualization object needs to be removed from the vehicle display interface.

[0103] In one implementation, the preset condition may be: a signal value is lost.

[0104] If the perception signal of the target visualization object is lost, that is, the signal value is empty or invalid, it means that the environmental element corresponding to the visualization object has disappeared in the environment, or its status information cannot be obtained due to system problems.

[0105] In this case, the visualization object is judged to be abnormal and is removed from the vehicle display interface.

[0106] In one implementation, the preset condition may be: the signal value indicates that the environment element corresponding to the visualization object does not exist.

[0107] That is, the perception signal value content of the target visualization object clearly indicates that the environmental element corresponding to the object no longer exists. For example, if the environmental element disappears, is blocked, or exceeds the effective perception range, the perception signal will indicate that the environmental element no longer appears in the perception range of the vehicle system.

[0108] In this case, it is determined based on the signal value that the visualization object no longer exists, so it is removed from the vehicle display interface.

[0109] That is, the target visualization object corresponding to the situation where the signal value is lost or the environmental element corresponding to the signal value indication does not exist is removed from the vehicle display interface.

[0110] The method of this embodiment, after screening out the perceived objects suspected of display abnormality, reads the signal value in its signal acquisition buffer. If the signal is lost or indicates that the object does not exist, its abnormal state is confirmed and removed from the display interface. This method effectively improves the accuracy of abnormality identification, reduces misjudgment, and ensures the stability and reliability of the vehicle display system.

[0111] Figure 3 A flow chart of a method for processing abnormal display provided in an embodiment of the present application is shown.

[0112] It should be understood that Figure 3 The embodiment stores the identifiers and corresponding acquisition times of the visualization objects based on the target mapping table. The method of this embodiment checks the visualization objects in the target mapping table twice to determine whether display abnormality occurs. Figure 3 The embodiment can be seen as Figure 1 An example of an embodiment.

[0113] like Figure 3 As shown, the method includes the following steps.

[0114] S310: Start to judge abnormal display of the visual objects in the target mapping table.

[0115] S320: traverse the visualization objects in the target mapping table to determine whether the duration difference thereof exceeds a preset duration threshold.

[0116] Starting from the first visualization object in the target mapping table, the time difference between the acquisition time and the current time is calculated to determine whether it exceeds the preset time threshold.

[0117] If so, execute step S330; if not, return to S320, skip the current visualization object, and continue to determine the next visualization object.

[0118] S330: Read the signal value of the perception signal corresponding to the target visualization object in the signal acquisition buffer, and determine whether the signal value meets a preset condition.

[0119] The preset conditions include: the signal value is lost or the signal value indicates that the environment element corresponding to the visualization object does not exist.

[0120] If so, execute step S340; if not, return to S310, skip the current visualization object, and continue to determine the next visualization object.

[0121] S330: Remove the visualization objects whose signal values ​​meet the preset conditions from the vehicle display interface.

[0122] S340 , performing the above steps S310 - S330 on all visual objects in the target mapping table once every preset time interval.

[0123] That is, at each preset time interval, each visualization object in the target mapping table is rechecked, and the time difference between the acquisition time corresponding to all visualization objects therein and the current time is calculated.

[0124] The preset time interval is less than the preset duration threshold.

[0125] Figure 4 A schematic diagram of a timing check target mapping table is given. Figure 4 In the example shown, the target mapping table stores n visual objects and their corresponding acquisition timestamps of perception signals, where n is a positive integer not exceeding 200.

[0126] In this example, the inspection process starts from visual object 1, and each visual object is judged one by one to see if there is any abnormal display, until all n visual objects are inspected. After completing the inspection of all visual objects, the inspection will start again from visual object 1 at a preset time interval (for example, 1 second). This process will continue in a loop to ensure that any potential abnormal display is discovered and handled in a timely manner.

[0127] By performing periodic calculations at time intervals less than a preset time threshold, this method ensures real-time monitoring and timely updating of the state of visual objects, effectively improving the recognition speed and processing efficiency of abnormal display objects, and enhancing the dynamic response capability of the vehicle display system.

[0128] It is understandable that during the operation of the vehicle, the environmental elements change very quickly. It can be said that the vehicle will collect new perception signals at every moment. These signals are used to dynamically generate or remove visual objects on the vehicle display interface. Since the environment changes so quickly, in order to avoid data redundancy, the content in the target mapping table needs to be updated. Specifically, new visual objects will be added to the mapping table, and some old visual objects will be deleted from the mapping table.

[0129] In one implementation, for any visualization object stored in the target mapping table, when the environment element corresponding to the visualization object meets the disappearance determination condition, the visualization object and the corresponding acquisition time are deleted from the target mapping table.

[0130] Exemplarily, the disappearance determination conditions may include but are not limited to time expiration, space disappearance, or state disappearance, etc.

[0131] Time expiration, for example, may be: when the time for collecting signals exceeds a certain threshold, and no change or reappearance of the environmental element is detected within the time period, the element is considered to have disappeared.

[0132] Spatial disappearance may be, for example, when the target environmental element no longer appears in the perception range of the vehicle, that is, when the sensor no longer receives a signal from the environmental element, it is determined that the element disappears.

[0133] The state disappearance may be, for example: some environmental elements may be meaningful to the driver only in a certain state (for example, some obstacles no longer need to be displayed after being removed), and when the state of the environmental element changes to "disappeared", the condition is triggered.

[0134] In one implementation, after the target visualization object is determined and removed from the vehicle display interface, the target visualization object and the corresponding acquisition time are deleted from the target mapping table. This deletion operation ensures that the data in the mapping table is consistent with the information presented on the vehicle display interface, thereby avoiding errors or interference in the displayed information due to outdated or redundant data.

[0135] In this embodiment, by updating the target mapping table in real time and promptly deleting no longer needed visual objects according to the disappearance judgment conditions, the system can dynamically adjust the vehicle display interface to ensure that the visual information obtained by the driver is always consistent with the actual environment, thereby improving driving safety and user experience.

[0136] Figure 5 A schematic diagram of the framework of a system for processing abnormal display provided in an embodiment of the present application is shown.

[0137] The framework of the display system is shown in the figure, which includes a signal unit, a target mapping table and a 3D rendering engine.

[0138] From the architecture, it can be seen that the signal unit is the input source of the entire display system and is used to collect various types of perception signals in real time.

[0139] Among them, the perception signals can include multiple types: lane line signals, obstacle signals, lane marking signals, reversing radar signals, own vehicle signals, braking signals and hazard signals.

[0140] The lane line signal may include information such as the type, color, curvature, and flashing of the left and right lane lines;

[0141] Obstacle signals include information on small passenger cars, motorcycles, pedestrians, animals, custom vehicles, etc.

[0142] Lane marking signals include information such as vehicle speed, traffic lights, warning signs, and roadblocks;

[0143] The reversing radar signal contains information such as distance and color;

[0144] The vehicle signal involves information such as door status, light status, lock status, and color;

[0145] In order to better understand and illustrate the method provided by the embodiment of the present application, the method provided by the present application is introduced through a specific embodiment in combination with the framework diagram below.

[0146] After the signal unit sends the perception signal to the 3D rendering engine, and the 3D rendering engine renders and displays the visualization object, the system associates the visualization object with the acquisition timestamp of the corresponding perception signal. Figure 5 The key-value pairs shown are recorded in the target mapping table. Each mapping entry includes a visualization object and the corresponding acquisition timestamp to form a complete data record.

[0147] according to Figure 3 and Figure 4 According to the periodic inspection method described in , the system will periodically perform abnormal display inspections on all visual objects in the target mapping table. During the inspection process, each visual object is judged in turn to see if there is a display abnormality. The inspection sequence starts from visual object 1 until all objects are inspected. If a visual object is found to be abnormal during the inspection process, the system will immediately send a removal signal to the 3D rendering engine, instructing it to remove the abnormal object from the rendering.

[0148] The inspection process will restart at a preset time interval (e.g. 1 second) after each complete inspection, and perform a cyclic inspection again starting from visualization object 1 to ensure that all visualization objects remain valid and display without abnormalities. This cyclic inspection mechanism can effectively ensure real-time monitoring and timely feedback to ensure stable operation of the system.

[0149] The above mainly introduces a method for processing a display abnormality in an embodiment of the present application in conjunction with the accompanying drawings. It should be understood that, although the steps in the flowcharts involved in the embodiments described above are displayed in sequence, these steps are not necessarily executed in sequence in the order shown in the figure. Unless there is a clear description in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the embodiments described above may include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily sequentially, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps. A display abnormality processing device of an embodiment of the present application is introduced below in conjunction with the accompanying drawings. For the sake of brevity, when introducing the device below, it will be appropriately omitted, and the relevant content can refer to the relevant description in the method above, and will not be repeated.

[0150] Corresponding to the method described in the above embodiment, Figure 6 A structural block diagram of a display abnormality processing device 1000 provided in an embodiment of the present application is shown. For ease of explanation, only the parts related to the embodiment of the present application are shown.

[0151] like Figure 6 As shown, the display abnormality processing device 1000 may include:

[0152] The acquisition module 1001 is used to acquire the acquisition time of the perception signals corresponding to the multiple visualization objects respectively.

[0153] Among them, multiple visualization objects are displayed on the in-vehicle display interface.

[0154] The visual object is rendered in 3D based on the corresponding perception signal.

[0155] The calculation module 1002 is used to calculate the time difference between the acquisition time corresponding to each visualization object and the current time according to the acquisition time sequence.

[0156] The processing module 1003 is used to determine the visualization object whose time difference exceeds a preset time threshold as a target visualization object, and remove the target visualization object from the vehicle-mounted display interface.

[0157] Figure 7 A schematic diagram of the hardware structure of a computer device provided in an embodiment of the present application is shown.

[0158] The computer device may include a processor 7001 and a memory 7002 storing computer program instructions.

[0159] Specifically, the processor 7001 may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiments of the present application.

[0160] The memory 7002 may include a large capacity memory for data or instructions. By way of example and not limitation, the memory 7002 may include a hard disk drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a universal serial bus (USB) drive or a combination of two or more of these. In one example, the memory 7002 may include a removable or non-removable (or fixed) medium, or the memory 7002 is a non-volatile solid-state memory. The memory 7002 may be inside or outside the integrated gateway disaster recovery device.

[0161] In one example, the memory 7002 may be a read-only memory (ROM). In one example, the ROM may be a mask-programmed ROM, a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), an electrically rewritable ROM (EAROM), or a flash memory, or a combination of two or more of these.

[0162] The memory 7002 may include a read-only memory (ROM), a random access memory (RAM), a magnetic disk storage medium device, an optical storage medium device, a flash memory device, an electrical, optical or other physical / tangible memory storage device. Thus, typically, the memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., a memory device) encoded with software including computer-executable instructions, and when the software is executed (e.g., by one or more processors), it is operable to perform the operations described with reference to the method according to an aspect of the present disclosure.

[0163] The processor 7001 reads and executes the computer program instructions stored in the memory 7002 to implement Figure 1 The method for handling display abnormality in the illustrated embodiment.

[0164] In one example, the computer device may further include a communication interface 7003 and a bus 7004. Figure 7 As shown, the processor 7001, the memory 7002, and the communication interface 7003 are connected via a bus 7004 and communicate with each other.

[0165] The communication interface 7003 is mainly used to implement communication between various modules, devices, units and / or equipment in the embodiments of the present application.

[0166] Bus 7004 includes hardware, software or both, and the components of online data flow billing equipment are coupled to each other. For example, but not limitation, the bus may include Accelerated Graphics Port (AGP) or other graphics bus, Enhanced Industry Standard Architecture (EISA) bus, Front Side Bus (FSB), Hyper Transport (HT) interconnection, Industry Standard Architecture (ISA) bus, InfiniBand interconnection, Low Pin Count (LPC) bus, Memory bus, Micro Channel Architecture (MCA) bus, Peripheral Component Interconnect (PCI) bus, PCI-Express (PCI-X) bus, Serial Advanced Technology Attachment (SATA) bus, Video Electronics Standards Association Local (VLB) bus or other suitable bus or two or more of these combinations. In appropriate cases, bus 7004 may include one or more buses. Although the present application embodiment describes and shows a specific bus, the present application considers any suitable bus or interconnection.

[0167] In addition, in combination with the display abnormality processing method in the above embodiment, the embodiment of the present application can provide a computer storage medium for implementation. The computer storage medium stores computer program instructions; when the computer program instructions are executed by the processor, any one of the display abnormality processing methods in the above embodiment is implemented.

[0168] An embodiment of the present application also provides a computer program product, including a computer program, which, when executed, implements any one of the display exception processing methods in the above embodiments.

[0169] It should be clear that the present application is not limited to the specific configuration and processing described above and shown in the figures. For the sake of simplicity, a detailed description of the known method is omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method process of the present application is not limited to the specific steps described and shown, and those skilled in the art can make various changes, modifications and additions, or change the order between the steps after understanding the spirit of the present application.

[0170] The functional blocks shown in the structural block diagram described above can be implemented as hardware, software, firmware or a combination thereof. When implemented in hardware, it can be, for example, an electronic circuit, an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), appropriate firmware, plug-in, function card, etc. When implemented in software, the elements of the present application are programs or code segments used to perform the required tasks. The program or code segment can be stored in a machine-readable medium, or transmitted on a transmission medium or communication link by a data signal carried in a carrier. "Machine-readable medium" can include any medium capable of storing or transmitting information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, read-only memory (Read-Only Memory, ROM), flash memory, erasable read-only memory (Erasable ReadOnly Memory, EROM), floppy disks, compact disc read-only memory (Compact Disc Read-Only Memory, CD-ROM), optical discs, hard disks, optical fiber media, radio frequency (Radio Frequency, RF) links, etc. The code segment can be downloaded via a computer network such as the Internet, an intranet, etc.

[0171] Aspects of the present disclosure are described above with reference to the flowchart and / or block diagram of the method, device (system) and computer program product according to the embodiment of the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device to produce a machine so that these instructions executed by the processor of the computer or other programmable data processing device enable the implementation of the function / action specified in one or more boxes of the flowchart and / or block diagram. Such a processor can be, but is not limited to, a general-purpose processor, a special-purpose processor, a special application processor, or a field programmable logic circuit. It can also be understood that each box in the block diagram and / or flowchart and the combination of boxes in the block diagram and / or flowchart can also be implemented by dedicated hardware that performs a specified function or action, or can be implemented by a combination of dedicated hardware and computer instructions.

[0172] The above is only a specific implementation of the present application. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working processes of the systems, modules and units described above can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here. It should be understood that the protection scope of the present application is not limited to this. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in this application, and these modifications or replacements should be included in the protection scope of this application.

Claims

1. A method for processing display abnormality, characterized in that: include: Acquiring acquisition time of perception signals respectively corresponding to a plurality of visualization objects, wherein the plurality of visualization objects are displayed on an in-vehicle display interface, and the visualization objects are obtained by 3D rendering based on the corresponding perception signals; According to the order of acquisition time, calculate the time difference between the acquisition time corresponding to each visualization object and the current time; The visualization object whose time difference exceeds a preset time threshold is determined as a target visualization object, and the target visualization object is removed from the vehicle-mounted display interface.

2. The method according to claim 1, characterized in that The step of determining the visualization object whose time difference exceeds a preset time threshold as a target visualization object, and removing the target visualization object from the vehicle-mounted display interface includes: For any target visualization object, read the signal value of the perception signal corresponding to the target visualization object in the signal acquisition buffer; The target visualization object whose signal value satisfies a preset condition is removed from the vehicle-mounted display interface, wherein the preset condition includes: the signal value is lost or the signal value indicates that an environmental element corresponding to the target visualization object does not exist.

3. The method according to claim 1, characterized in that The acquiring of the acquisition time of the perception signals respectively corresponding to the plurality of visualization objects comprises: In response to obtaining the acquisition time of the perception signals corresponding to the plurality of visualizations respectively, an identifier of each visualization object and the corresponding acquisition time are stored in a pre-constructed target mapping table in the form of a key-value pair.

4. The method according to claim 3, characterized in that The method further comprises: For any visual object stored in the target mapping table, when the environmental element corresponding to the visual object meets the disappearance determination condition, the visual object and the corresponding acquisition time are deleted from the target mapping table.

5. The method according to claim 3, characterized in that: After removing the target visualization object from the in-vehicle display interface, the method further includes: The target visualization object and the corresponding acquisition time are deleted from the target mapping table.

6. The method according to claim 3, characterized in that: The step of determining the visualization object whose time difference exceeds a preset time threshold as a target visualization object, and removing the target visualization object from the vehicle-mounted display interface includes: Query the target visualization object's identifier in the target mapping table; According to the identifier of the target visual object, the target visual object is searched for in the vehicle display interface and removed.

7. The method according to any one of claims 3 to 6, characterized in that The removing the target visual object from the vehicle-mounted display interface includes: Deleting the target visualization object from the vehicle-mounted display interface; or, The rendering attribute of the target visual object is modified to be invisible.

8. The method according to any one of claims 3 to 6, characterized in that The step of calculating the time difference between the acquisition time corresponding to each visualization object and the current time in the order of acquisition time includes: At every preset time interval, the time difference between the acquisition time corresponding to all the visualization objects in the target mapping table and the current time is recalculated; the preset time interval is less than a preset time threshold.

9. A display abnormality processing device, characterized in that: include: An acquisition module, used to acquire acquisition time of perception signals corresponding to a plurality of visualization objects, wherein the plurality of visualization objects are displayed on a vehicle-mounted display interface, and the visualization objects are obtained by 3D rendering based on the corresponding perception signals; The calculation module is used to calculate the time difference between the acquisition time corresponding to each visualization object and the current time according to the acquisition time sequence; The processing module is used to determine the visualization object whose time difference exceeds a preset time threshold as a target visualization object, and remove the target visualization object from the vehicle-mounted display interface.

10. A computer device, characterized in that: The computer device comprises: a processor and a memory storing computer program instructions; the processor reads and executes the computer program instructions to implement the method according to any one of claims 1 to 8.

Images