Rendering method, apparatus, device, and storage medium

Abstract

This application discloses a rendering method, apparatus, device, and storage medium, relating to the field of intelligent driving technology. The method includes: receiving a user's theme switching command and loading a theme configuration file corresponding to the command to obtain corresponding theme rendering parameters; acquiring environmental perception data of the vehicle and determining the object to be displayed on the vehicle's in-vehicle interface based on the environmental perception data, the object representing obstacles within a preset range of the vehicle; generating a geometric line drawing of the object to be displayed based on the environmental perception data, the geometric line drawing representing the outline of the obstacles; and rendering the object based on the theme rendering parameters using the geometric line drawing as a constraint to obtain the theme object corresponding to the in-vehicle interface. This application constrains the theme rendering process by combining the geometric line drawing generated from the environmental perception data, achieving theme switching while avoiding visual distortion or obstruction of core safety information, thus improving driving safety.

Description

Technical Field

[0001] This application relates to the field of intelligent driving technology, and in particular to a rendering method, apparatus, device and storage medium. Background Technology

[0002] With the popularization of intelligent driving technology, the 3D visualization interface of the in-vehicle intelligent driving system is the core human-machine interaction interface for drivers to perceive the vehicle environment and understand intelligent driving decisions. It provides drivers with an intuitive environmental model by rendering perception data from the intelligent driving controller in real time (such as the position, size and type of vehicles, pedestrians, lane lines, etc.).

[0003] Currently, the visual style of this visualization interface, including environmental models (such as the sky and buildings), base map styles (such as road textures), vehicle and obstacle models, and user interface elements, is pre-defined and fixed in the system by the system developer. Users are generally not allowed to modify any interface elements. Because the intelligent driving visualization interface reflects real-time key data of the real environment (such as the precise outlines and locations of obstacles), arbitrarily modifying the intelligent driving interface elements using common graphical interface skinning techniques (such as changing phone themes) could cause visual distortion or obstruction of this core safety information. For example, if a user changes the display color of obstacles in the intelligent driving interface to a color similar to the background, or adjusts the display style of obstacle outlines, it may make it difficult for the driver to accurately identify the presence and location of obstacles, thereby increasing the risk of collision and causing the driver to misjudge the environment and trigger driving risks. Therefore, traditional theme-changing techniques are difficult to use in intelligent driving interfaces. Summary of the Invention

[0004] The main purpose of this application is to provide a rendering method, apparatus, device and storage medium, which aims to solve the technical problem that traditional theme changing technology can cause visual distortion of safety information in the intelligent driving interface, thus affecting driving safety.

[0005] To achieve the above objectives, this application proposes a rendering method, the method comprising:

[0006] Receive the user's theme switching command, load the theme configuration file corresponding to the theme switching command, and obtain the corresponding theme rendering parameters; Acquire environmental perception data of the vehicle, and determine the object to be displayed on the vehicle's in-vehicle interface based on the environmental perception data. The object to be displayed represents an obstacle within a preset range of the vehicle. A geometric line drawing of the object to be displayed is generated based on the environmental perception data, and the geometric line drawing is used to represent the outline of the obstacle. Using the geometric line diagram as a constraint, the object to be displayed is rendered based on the theme rendering parameters to obtain the theme object corresponding to the vehicle interface.

[0007] In one embodiment, the step of rendering the object to be displayed based on the theme rendering parameters, using the geometric line diagram as a constraint, to obtain the theme object corresponding to the vehicle interface includes: Obtain the visual model of the object to be displayed; Using the geometric line diagram as a constraint, the visual model is superimposed on the upper layer of the geometric line diagram to obtain the object to be rendered; The graphics processor maps the subject rendering parameters to the model to be rendered. The underlying data corresponding to the object to be displayed in the environmental perception data is loaded into the mapped rendering model to obtain the theme object corresponding to the vehicle interface.

[0008] In one embodiment, the step of obtaining the visual model of the object to be displayed includes: Determine the object type of the object to be displayed, and determine whether the object to be displayed is a non-core display element of the vehicle interface based on the object type; When the object to be displayed is a non-core display element, the object to be displayed is queried through a preset mapping table to obtain a model index. The preset mapping table includes the mapping relationship between non-core display elements and corresponding visual models. Based on the model index, obtain the visual model of the object to be displayed.

[0009] In one embodiment, the step of mapping the subject rendering parameters to the model to be rendered using a graphics processor includes: Get the current resource utilization of the graphics processor; If the current resource utilization rate reaches a preset utilization threshold, the preset rendering resolution in the graphics processor is reduced. Based on the reduced rendering resolution, the graphics processor maps the subject rendering parameters to the model to be rendered.

[0010] In one embodiment, after the step of mapping the subject rendering parameters to the model to be rendered via the graphics processor based on the reduced rendering resolution, the method further includes: During the mapping process of the model to be rendered, the rendering time of each frame of the graphics processor is collected; If the rendering time is lower than a preset time threshold, the preset rendering frame rate in the graphics processor is enhanced. Based on the enhanced rendering frame rate, return to the step of mapping the theme rendering parameters to the model to be rendered through the graphics processor based on the reduced rendering resolution, until the theme object corresponding to the vehicle interface is obtained.

[0011] In one embodiment, the step of generating the geometric line drawing of the object to be displayed based on the environmental perception data includes: Extract the geometric data corresponding to the object to be displayed from the environmental perception data; The geometric data is uploaded to the vertex buffer of the graphics processor; In the vertex buffer, the geometric data is used to draw the graphics, resulting in the geometric line drawing of the object to be displayed.

[0012] In one embodiment, before the step of receiving the user's topic switching instruction, the method further includes: In response to the user's theme editing command, the visual resources corresponding to the theme editing command are associated with the corresponding non-core display elements to obtain a theme configuration file; Perform local signing and cloud authentication on the aforementioned theme configuration file; After the local signature and cloud authentication are successful, the theme configuration file is uploaded to the vehicle's theme database.

[0013] Furthermore, to achieve the above objectives, this application also proposes a rendering apparatus, the apparatus comprising: The theme module is used to receive the user's theme switching command, load the theme configuration file corresponding to the theme switching command, and obtain the corresponding theme rendering parameters; The display module is used to acquire environmental perception data of the vehicle and determine the object to be displayed on the vehicle's in-vehicle interface based on the environmental perception data. The object to be displayed represents an obstacle within a preset range of the vehicle. The line graph module is used to generate a geometric line graph of the object to be displayed based on the environmental perception data, wherein the geometric line graph is used to represent the outline of the obstacle; The rendering module is used to render the object to be displayed based on the theme rendering parameters, using the geometric line diagram as a constraint, to obtain the theme object corresponding to the vehicle interface.

[0014] In addition, to achieve the above objectives, this application also proposes a rendering device, the device comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the rendering method as described above.

[0015] In addition, to achieve the above objectives, this application also proposes a storage medium, which is a computer-readable storage medium, on which a computer program is stored, and which, when executed by a processor, implements the steps of the rendering method described above.

[0016] One or more technical solutions proposed in this application have at least the following technical effects: The rendering method of this application includes: receiving a user's theme switching instruction and loading the theme configuration file corresponding to the theme switching instruction to obtain the corresponding theme rendering parameters; acquiring environmental perception data of the vehicle, determining the object to be displayed on the vehicle's in-vehicle interface based on the environmental perception data, wherein the object to be displayed represents obstacles within a preset range of the vehicle; generating a geometric line drawing of the object to be displayed based on the environmental perception data, wherein the geometric line drawing is used to represent the outline of the obstacle; and rendering the object to be displayed based on the theme rendering parameters using the geometric line drawing as a constraint to obtain the theme object corresponding to the in-vehicle interface.

[0017] This application first receives the user's theme switching command and loads the corresponding theme configuration file to obtain theme rendering parameters. Simultaneously, it acquires vehicle environmental perception data to determine the object to be displayed and generates its geometric line drawing. Then, it renders the object to be displayed using the geometric line drawing as a constraint to obtain the theme object. By combining the geometric line drawing generated from environmental perception data with the theme rendering process, this application avoids visual distortion or obstruction of core safety information while enabling theme switching, thus improving driving safety. Attached Figure Description

[0018] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0019] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0020] Figure 1 This is a flowchart illustrating the rendering method of this application in Embodiment 1. Figure 2 This is a flowchart illustrating the rendering method of Embodiment 2 of this application; Figure 3 This is a flowchart illustrating the rendering method of Embodiment 3 of this application; Figure 4 This is a block diagram of the module structure of the rendering apparatus according to an embodiment of this application; Figure 5This is a schematic diagram of the hardware operating environment involved in the rendering device in the embodiments of this application.

[0021] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0022] To make the above-mentioned objectives, features, and advantages of this application more apparent and understandable, the technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are merely some embodiments of this application, and not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the scope of protection of this application.

[0023] The main solution of this application is as follows: With the popularization of intelligent driving technology, the 3D visualization interface of the in-vehicle intelligent driving system is the core human-machine interaction interface for drivers to perceive the vehicle environment and understand intelligent driving decisions. It provides drivers with an intuitive environmental model by rendering perception data (such as the position, size, and type of vehicles, pedestrians, lane lines, etc.) from the intelligent driving controller in real time.

[0024] Currently, the visual style of this visualization interface, including environmental models (such as the sky and buildings), base map styles (such as road textures), vehicle and obstacle models, and user interface elements, is pre-defined and fixed in the system by the system developer. Users are generally not allowed to modify any interface elements. Because the intelligent driving visualization interface reflects real-time key data of the real environment (such as the precise outlines and locations of obstacles), arbitrarily modifying the intelligent driving interface elements using common graphical interface skinning techniques (such as changing phone themes) could cause visual distortion or obstruction of this core safety information. For example, if a user changes the display color of obstacles in the intelligent driving interface to a color similar to the background, or adjusts the display style of obstacle outlines, it may make it difficult for the driver to accurately identify the presence and location of obstacles, thereby increasing the risk of collision and causing the driver to misjudge the environment and trigger driving risks. Therefore, traditional theme-changing techniques are difficult to use in intelligent driving interfaces.

[0025] To address the aforementioned issues, this application provides a rendering method. First, it receives a user's theme switching command and loads the corresponding theme configuration file to obtain theme rendering parameters. Simultaneously, it acquires vehicle environmental perception data to determine the object to be displayed and generates its geometric line drawing. Then, it renders the object to be displayed using the geometric line drawing as a constraint to obtain the theme object. This application constrains the theme rendering process by combining the geometric line drawing generated from environmental perception data. This achieves theme switching while avoiding visual distortion or obstruction of core safety information, thereby improving driving safety.

[0026] It should be noted that the executing entity of this application embodiment can be a computing service device with data processing, network communication, and program execution functions, such as an in-vehicle computer, a personal computer, a server, etc., or an electronic device capable of realizing the above functions, a rendering device executing the rendering device method of this application, etc., and this embodiment does not limit it. The following uses a rendering device (hereinafter referred to as the device) as an example to describe this embodiment and the following embodiments.

[0027] Based on this, this application proposes a rendering method according to a first embodiment, referring to... Figure 1 , Figure 1 This is a flowchart illustrating an embodiment of the rendering method of this application. In this embodiment, the rendering method may include steps S10 to S40: Step S10: Receive the user's theme switching command, load the theme configuration file corresponding to the theme switching command, and obtain the corresponding theme rendering parameters.

[0028] It should be noted that the theme switching command can be a user-issued command to change the visual style of the in-vehicle interface. In intelligent driving scenarios, when a user feels that the current intelligent driving interface of the vehicle is too dark and wants to change to a bright and lively style, they can issue a theme switching command to initiate the interface style change process.

[0029] Understandably, a theme configuration file is a pre-defined file containing information such as the style, color, and layout of various interface elements.

[0030] The rendering device includes a dedicated database for managing theme resources. This database stores, indexes, and manages multiple independent theme resource packages. Each resource contains replacement 3D model files (such as vehicles and trees), texture maps (such as roads and skies), icon and font files, and comes with a configuration file that defines the mapping relationship between the resource and the underlying rendering objects.

[0031] It is important to note that the theme resource package includes a private key signature from the car manufacturer. This signature must be verified during the rendering process to prevent malicious code injection.

[0032] It is also understandable that theme rendering parameters can be extracted from the theme configuration file and are specific parameters used to actually render and display interface elements. For example, these include specific color codes (such as the RGB value of the sky being (0,0,139)) and line thickness (such as the width of the obstacle outline being 2 pixels).

[0033] In actual use, the device can respond to the user's theme switching command, read the theme configuration file selected by the theme switching command, and schedule the loading of the corresponding resource package in the theme configuration file into memory to obtain theme rendering parameters, thus providing data preparation for subsequent rendering.

[0034] Step S20: Obtain environmental perception data of the vehicle, and determine the object to be displayed on the vehicle's in-vehicle interface based on the environmental perception data. The object to be displayed represents an obstacle within a preset range of the vehicle.

[0035] It should be noted that environmental perception data can be information about the vehicle's surrounding environment (i.e., within a preset range) collected in real time by the vehicle's intelligent driving system through various sensors (such as cameras, radar, etc.). For example, if a camera detects a truck 50 meters in front of the vehicle, the radar will measure the distance between the truck and the vehicle as 5 meters, the height of the truck as approximately 2.5 meters, and other information.

[0036] The preset range can be a pre-defined spatial area around the vehicle in an intelligent driving scenario, and this area is related to the effective detection distance and angle of the vehicle's sensors.

[0037] It should also be noted that the objects to be displayed are determined based on the vehicle's environmental perception data and are the objects that need to be shown on the in-vehicle interface. For example, a rock on the road ahead, a car that suddenly stops, a pedestrian crossing the road, or lane markings ahead are all objects that may affect the vehicle's movement or require the driver's attention.

[0038] In actual use, the device can collect environmental perception data about the vehicle's surroundings in real time through various sensors in the vehicle (such as the bounding box, position coordinates, type identification, lane line geometry information, etc. of the target object), and then determine the objects to be displayed on the vehicle's in-vehicle interface based on the environmental perception data.

[0039] Step S30: Generate a geometric line drawing of the object to be displayed based on the environmental perception data. The geometric line drawing is used to represent the outline of the obstacle.

[0040] Understandably, a geometry graph is a graphic representation of the outline of obstacles, generated based on the vehicle's environmental perception data. For example, for a truck ahead, the geometry graph would use lines to outline the actual bounding box of the truck (such as the shape of its four wheels and body).

[0041] In practical use, the device can generate a geometric line drawing of the object to be displayed based on environmental perception data. This process can be performed in a separate graphics processing unit (GPU). The GPU execution process is divided into two parts: one is the drawing of the geometric line drawing in step S30, which is a high-priority security domain; the other is the rendering process in step S40, which is a low-priority entertainment domain. The command queues of the security domain and the entertainment domain are hardware-level serially isolated to ensure that even if the entertainment domain crashes, the submission of security domain frames will not be blocked.

[0042] It is important to note that a security domain refers to a set of hardware and software that handles the underlying data functions of the vehicle. It is responsible for rendering real-time perception data from the vehicle (such as obstacle bounding boxes, lane lines, etc.) into geometric frames that cannot be tampered with by the subject, and running them in an independent, high-priority GPU command queue.

[0043] The entertainment domain refers to the hardware-software combination that handles subsequent rendering functions. It only performs material-level skinning on non-core display elements (such as skyboxes, road textures, vehicle models, etc.) and runs in a secondary, low-priority GPU command queue. The entertainment domain's buffer uses read-only mapping, prohibiting writing to the address space of the security domain. Data security can be further enhanced through the physical separation of the data layer and rendering layer of the graphics processor.

[0044] Furthermore, in order to obtain the aforementioned geometric line drawing, in this embodiment, the step of generating the geometric line drawing of the object to be displayed based on the environmental perception data includes: Extract the geometric data corresponding to the object to be displayed from the environmental perception data; The geometric data is uploaded to the vertex buffer of the graphics processor; In the vertex buffer, the geometric data is used to draw the graphics, resulting in the geometric line drawing of the object to be displayed.

[0045] Geometric data, extracted from environmental perception data, describes the geometric features of the object to be displayed, including its shape, size, and position. For example, the geometric data for a truck might include the coordinates of its four wheels, its length, width, and height, and the overall shape of its body.

[0046] It should be noted that a graphics processing unit (GPU) can be a hardware device specifically designed for handling graphics-related calculations. In the 3D visualization interface display process of an intelligent driving system, the GPU can quickly process and render large amounts of graphics data.

[0047] It's also important to note that the vertex buffer is a storage area within the graphics processor specifically used to store vertex data for graphics. In graphics rendering, any shape is composed of individual vertices, each containing information such as position, color, and normals. Taking the rendering of a geometric line drawing of an object as an example, the coordinates of each key point in the geometric data are the vertices, and these vertices are stored in the vertex buffer. When the GPU renders graphics, it reads this vertex data from the vertex buffer and then connects these vertices according to preset rendering rules (such as line connection methods) to form the final geometric line drawing.

[0048] Because this embodiment uploads geometric data to the vertex buffer of the graphics processor, and then draws the geometric line graph based on the geometric data in the vertex buffer, it can process the graphic data quickly and efficiently.

[0049] Step S40: Using the geometric line diagram as a constraint, render the object to be displayed based on the theme rendering parameters to obtain the theme object corresponding to the vehicle interface.

[0050] The theme object can be an object with a specific theme style that is rendered based on theme rendering parameters, constrained by geometric line drawings, and ultimately presented on the in-vehicle interface. For example, after selecting the "Tech Blue" theme, obstacles that were originally represented by simple lines will be rendered into objects with bright blue outlines and technological textures (i.e., theme objects) displayed on the in-vehicle interface according to the theme rendering parameters.

[0051] In practical use, the device can perform visual rendering of the objects to be displayed on the visualization interface based on the loaded theme rendering parameters (such as stylized vehicle models and cartoonish road textures) and geometric line drawings as constraints. The theme resources are mapped and superimposed on the geometric line drawings generated by the objects to be displayed to obtain the theme objects.

[0052] It is important to note that after rendering is complete, the device can generate a 64-bit pixel hash value at the end of the frame and compare it with the pre-stored reference value in the safety island. If they do not match, the frame is immediately discarded and the device switches to alert mode.

[0053] The safety island uses a pre-stored reference value, an officially calibrated hash table representing the pixel fingerprint of the "real world." A mismatch in pixel hashes indicates that the current frame content does not match the officially calibrated fingerprint, suggesting that the GPU may have experienced direct memory access violations or memory bit flips, and that safety-critical information (such as obstacle outlines / sizes) has been tampered with. Immediately discarding the frame prevents the driver from seeing the erroneous image; simultaneously, a fault timestamp is written to the safety island, and a warning is issued.

[0054] Furthermore, in order to obtain the aforementioned theme configuration file, in this embodiment, before the step of receiving the user's theme switching instruction, the following steps are also included: In response to the user's theme editing command, the visual resources corresponding to the theme editing command are associated with the corresponding non-core display elements to obtain a theme configuration file; Perform local signing and cloud authentication on the aforementioned theme configuration file; After the local signature and cloud authentication are successful, the theme configuration file is uploaded to the vehicle's theme database.

[0055] It should be noted that the theme editing command can be a set of commands in the context of intelligent driving vehicle interface, where users want to change the visual style of the vehicle interface, and then click the theme editing option in the settings menu of the vehicle system to perform a series of operations such as selecting colors and patterns.

[0056] It should also be noted that visual resources are resources related to various visual elements prepared for theme editing. For example, different styles of sky background images (such as images of clear blue skies, sunsets, etc.), obstacle display icons of various shapes and colors, and road background maps with different textures (such as asphalt road textures, cobblestone road textures, etc.). These resources are used to construct different theme visual effects.

[0057] Specifically, the device can provide users with a graphical interface, allowing users to visually combine or create new theme resource packages by dragging, uploading, and selecting, and preview the customized effects in real time. Finally, the customized content is packaged into a theme configuration file that conforms to the specifications.

[0058] Understandably, in the intelligent driving vehicle 3D visualization interface, the core display elements are those directly related to driving safety and reflect real-time key data of the actual environment, such as the precise outlines and positions of obstacles. Non-core display elements, on the other hand, do not directly affect driving safety decisions but can enhance the aesthetics and personalization of the interface, such as the sky and environmental background, road textures and base map style, 3D models of the vehicle and surrounding vehicles or pedestrians, and user interface icons and fonts.

[0059] It's important to note that local signing is a security verification operation performed on the theme resource package locally in the vehicle. This signature ensures that the theme resource package has not been tampered with locally, guaranteeing its integrity and authenticity. Cloud authentication, on the other hand, involves sending the relevant information of the theme resource package to a cloud server for verification. Only theme resource packages that pass cloud authentication are considered safe and reliable and can be used in vehicles.

[0060] Specifically, the device can first automatically scan the user's theme resource package (such as checking file format, size, and potential malicious code) to ensure that it does not contain prohibited content and complies with security specifications and visual standards. Then, it performs two-way authentication through local signing by the vehicle manufacturer and cloud authentication. After successful local signing and cloud authentication, the theme configuration file is uploaded to the vehicle's theme database or store. If authentication fails, it will roll back to the default theme within 300ms and report the error log.

[0061] Because this embodiment generates a theme configuration file by associating visual resources with non-core display elements in response to user theme editing commands, it meets users' needs for personalization of the in-vehicle interface. Users can switch between multiple certified themes at any time, enriching the usage scenarios of the in-vehicle interface.

[0062] This application provides a rendering method. First, it receives a user's theme switching command and loads the corresponding theme configuration file to obtain theme rendering parameters. Simultaneously, it acquires vehicle environmental perception data to determine the object to be displayed and generates its geometric line drawing. Then, it renders the object to be displayed using the geometric line drawing as a constraint to obtain the theme object. This embodiment constrains the theme rendering process by combining the geometric line drawing generated from environmental perception data. While enabling theme switching, it avoids visual distortion or obstruction of core safety information, thus improving driving safety. Furthermore, users can change the interface style according to their mood or preferences, or finely customize specific elements, greatly enhancing the emotional connection and interactive enjoyment between the user and the vehicle, effectively alleviating the monotony of driving.

[0063] Based on the first embodiment of this application, in the second embodiment of this application, the content that is the same as or similar to the above embodiment can be referred to the above description, and will not be repeated hereafter. On this basis, a second embodiment of the dialogue method of this application is proposed, please refer to... Figure 2 , Figure 2 This is a flowchart illustrating a second embodiment of the rendering method of this application. To obtain the aforementioned subject object, such as... Figure 2 As shown, in this embodiment, the step of rendering the object to be displayed based on the theme rendering parameters, using the geometric line diagram as a constraint, to obtain the theme object corresponding to the vehicle interface may include: Step S41: Obtain the visual model of the object to be displayed.

[0064] It should be noted that in the intelligent driving in-vehicle interface display scenario, the objects to be displayed are the objects in the vehicle's surrounding environment that need to be presented to the driver, while the visual model is a digital model created to realistically display these objects on the in-vehicle interface.

[0065] It is important to note that this rendering process is performed on a secondary GPU and only allows material replacement for non-core display elements (such as skyboxes, road textures, and models of your own vehicle or other vehicles).

[0066] Furthermore, in order to obtain the above-mentioned visual model, in this embodiment, the step of obtaining the visual model of the object to be displayed includes: Determine the object type of the object to be displayed, and determine whether the object to be displayed is a non-core display element of the vehicle interface based on the object type; When the object to be displayed is a non-core display element, the object to be displayed is queried through a preset mapping table to obtain a model index. The preset mapping table includes the mapping relationship between non-core display elements and corresponding visual models. Based on the model index, obtain the visual model of the object to be displayed.

[0067] The object type is a category identifier for classifying objects to be displayed; different objects have different characteristics and attributes. The preset mapping table is a pre-established table that stores the mapping relationships between non-core display elements and their corresponding visual models. In the preset mapping table, each row records the identifier information of a non-core display element and the information of its corresponding visual model.

[0068] Understandably, the model index is an identifier used in a preset mapping table to quickly locate and retrieve the corresponding visual model. When the device determines that the object to be displayed is a non-core display element, it queries the preset mapping table, finds the corresponding index in the mapping table according to the type of the object to be displayed, and can directly retrieve the corresponding visual model from the storage system based on this index.

[0069] Because this embodiment determines the object type of the object to be displayed and whether it is a non-core display element, it can classify and process different types of display elements, concentrate more computing resources and processing energy on core display elements, and improve the overall operating efficiency of the device.

[0070] Step S42: Using the geometric line diagram as a constraint, superimpose the visual model onto the upper layer of the geometric line diagram to obtain the object to be rendered.

[0071] Step S43: Map the theme rendering parameters to the model to be rendered using the graphics processor.

[0072] Step S44: Load the underlying data corresponding to the object to be displayed in the environmental perception data into the mapped rendering model to obtain the theme object corresponding to the vehicle interface.

[0073] Specifically, the device can use a geometric line graph as a constraint, overlay a visual model on top of the geometric line graph, and scale it proportionally to obtain the object to be rendered. Then, the graphics processor renders the model to be rendered according to the theme rendering parameters. Finally, the underlying data corresponding to the object to be displayed in the environmental perception data is loaded into the rendered model to obtain the theme object corresponding to the in-vehicle interface.

[0074] For example, a realistic truck bounding box can be visually represented using a block truck model provided by the theme resource, but the model's position, size, and orientation strictly follow the truck data transmitted from the underlying layer. Through layered rendering, it is ensured that critical information related to driving safety (such as the position and size of obstacles) is presented accurately, fundamentally eliminating the information misleading and safety risks that may be caused by skinning.

[0075] In conjunction with the foregoing, the technical solution provided in this application embodiment, by obtaining the visual model of the object to be displayed and superimposing it with geometric line diagrams as constraints, can ensure the accurate placement of the visual model on the vehicle interface, making the underlying data of the displayed object consistent with the actual environment, and improving the accuracy of information.

[0076] Based on the first and / or second embodiments of this application, in the third embodiment of this application, the content that is the same as or similar to that in embodiments one and two above can be referred to the above description, and will not be repeated hereafter. Based on this, please refer to... Figure 3 , Figure 3 This is a flowchart illustrating a third embodiment of the rendering method of this application. In order to render the model to be rendered, such as... Figure 3 As shown, in this embodiment, the step of mapping the subject rendering parameters to the model to be rendered using a graphics processor may include: Step S431: Obtain the current resource utilization of the graphics processor.

[0077] It should be noted that current resource utilization refers to the proportion of resources currently being used by the graphics processing unit (GPU) out of its total available resources, reflecting the current workload of the GPU. For example, if the GPU's total computing power is 100%, and it is currently using 85% of its computing power to process graphics tasks, then the current resource utilization is 85%.

[0078] Step S432: When the current resource utilization rate reaches a preset utilization rate threshold, the preset rendering resolution in the graphics processor is reduced.

[0079] Understandably, the preset utilization threshold is a pre-set value used to determine whether the graphics processor's resource utilization is too high. For example, if the preset utilization threshold is set to 85%, then when the current resource utilization of the graphics processor reaches or exceeds 85%, it is considered that the graphics processor's resource utilization is too high.

[0080] It's also understandable that rendering resolution can be a pre-set image resolution before the graphics processor performs rendering operations, determining the sharpness of the final generated subject object. The higher the resolution, the sharper the subject object, but it also increases the computational burden and data volume of the graphics processor.

[0081] Step S433: Based on the reduced rendering resolution, the theme rendering parameters are mapped to the model to be rendered using the graphics processor.

[0082] This embodiment first obtains the current resource utilization rate of the graphics processor. When the current resource utilization rate reaches a preset utilization threshold, the preset rendering resolution is promptly reduced. Based on the reduced rendering resolution, the graphics processor maps the theme rendering parameters to the model to be rendered. Reducing the rendering resolution can effectively reduce the workload of the graphics processor and avoid system lag and other problems caused by excessive resource consumption.

[0083] Furthermore, considering the rendering time, in this embodiment, after the step of mapping the subject rendering parameters to the model to be rendered via the graphics processor based on the reduced rendering resolution, the method further includes: During the mapping process of the model to be rendered, the rendering time of each frame of the graphics processor is collected; If the rendering time is lower than a preset time threshold, the preset rendering frame rate in the graphics processor is enhanced. Based on the enhanced rendering frame rate, return to the step of mapping the theme rendering parameters to the model to be rendered through the graphics processor based on the reduced rendering resolution, until the theme object corresponding to the vehicle interface is obtained.

[0084] Rendering time refers to the time required for a graphics processing unit (GPU) to render one frame of an image (i.e., the subject object). It reflects the workload and efficiency of the GPU in processing the current frame. A longer rendering time means a heavier load on the GPU, while a shorter rendering time indicates that the GPU can complete the rendering task quickly.

[0085] It's important to note that the preset rendering time threshold is a pre-set value used to determine whether the rendering time per frame by the graphics processor is too short. For example, if the goal is for the in-vehicle interface to display smoothly at a frame rate of 60 frames per second, then the rendering time per frame should theoretically not exceed 1 / 60th of a second (approximately 16.67 milliseconds). In this case, the preset rendering time threshold can be set to around 16 milliseconds. When the rendering time per frame by the graphics processor is lower than this preset threshold, it indicates that the graphics processor has sufficient remaining processing power.

[0086] It should also be noted that the rendering frame rate refers to the number of frames per second that the graphics processor renders. A higher frame rate can make the image display smoother, reduce stuttering and flickering, and provide users with a better visual experience.

[0087] Specifically, when GPU resource utilization is detected to be >85% or frame rendering time in the safety domain is detected to be >25ms, the rendering resolution of the entertainment domain can be automatically downgraded (e.g., from 1080p to 720p) or its rendering frame rate reduced (from 60fps to 30fps), while the safety domain remains constant at 60fps / 1080p, ensuring that theme switching does not affect safety-critical displays. This degradation strategy ensures that when the frame time in the safety domain is abnormal, the entertainment domain can instantly relinquish GPU resources, thus ensuring functional safety while maintaining the best visual experience.

[0088] This embodiment collects the rendering time and current resource utilization of the graphics processor for each frame, thereby understanding the rendering efficiency and load of the graphics processor in real time, continuously optimizing the rendering effect of the subject object, achieving a balance between performance and resource consumption, and ensuring the best display effect in different scenarios and conditions.

[0089] It should be noted that the above examples are for understanding this application only and do not constitute a limitation on the rendering method of this application. Any simple modifications based on this technical concept are within the scope of protection of this application. All actions involving the acquisition of signals, information, or data in this application are performed in accordance with the relevant data protection regulations of the country where the application is located and with authorization from the owner of the relevant device.

[0090] This application also provides a rendering device, please refer to... Figure 4 , Figure 4 This is a block diagram of the module structure of the rendering apparatus according to an embodiment of this application; in this embodiment, the rendering apparatus includes: The theme module 401 is used to receive the user's theme switching command, load the theme configuration file corresponding to the theme switching command, and obtain the corresponding theme rendering parameters; Display module 402 is used to acquire environmental perception data of the vehicle and determine the object to be displayed on the vehicle's in-vehicle interface based on the environmental perception data. The object to be displayed represents an obstacle within a preset range of the vehicle. Line drawing module 403 is used to generate a geometric line drawing of the object to be displayed based on the environmental perception data, wherein the geometric line drawing is used to represent the outline of the obstacle; The rendering module 404 is used to render the object to be displayed based on the theme rendering parameters, using the geometric line diagram as a constraint, to obtain the theme object corresponding to the vehicle interface.

[0091] This embodiment first receives the user's theme switching command and loads the corresponding theme configuration file to obtain theme rendering parameters. Simultaneously, it acquires vehicle environmental perception data to determine the object to be displayed and generates its geometric line drawing. Then, it renders the object to be displayed using the geometric line drawing as a constraint to obtain the theme object. This embodiment constrains the theme rendering process by combining the geometric line drawing generated from environmental perception data, thus achieving theme switching while avoiding visual distortion or obstruction of core safety information, thereby improving driving safety.

[0092] In one implementation, the rendering module 404 is further configured to obtain the visual model of the object to be displayed; superimpose the visual model on the upper layer of the geometric line drawing as a constraint to obtain the object to be rendered; map the theme rendering parameters to the model to be rendered through the graphics processor; and load the underlying data corresponding to the object to be displayed in the environmental perception data into the mapped model to be rendered to obtain the theme object corresponding to the vehicle interface.

[0093] In one implementation, the rendering module 404 is further configured to determine the object type of the object to be displayed, and determine whether the object to be displayed is a non-core display element of the vehicle interface based on the object type; if the object to be displayed is a non-core display element, the module queries the object to be displayed through a preset mapping table to obtain a model index, the preset mapping table including the mapping relationship between non-core display elements and corresponding visual models; and obtain the visual model of the object to be displayed based on the model index.

[0094] In one implementation, the rendering module 404 is further configured to obtain the current resource utilization rate of the graphics processor; when the current resource utilization rate reaches a preset utilization rate threshold, reduce the preset rendering resolution in the graphics processor; and based on the reduced rendering resolution, map the theme rendering parameters to the model to be rendered through the graphics processor.

[0095] In one implementation, the rendering module 404 is further configured to collect the rendering duration of each frame of the graphics processor during the mapping process of the model to be rendered; if the rendering duration is lower than a preset duration threshold, the preset rendering frame rate in the graphics processor is enhanced; based on the enhanced rendering frame rate, the operation of mapping the theme rendering parameters to the model to be rendered through the graphics processor based on the reduced rendering resolution is returned to be executed until the theme object corresponding to the vehicle interface is obtained.

[0096] In one implementation, the line drawing module 403 is further configured to extract geometric data corresponding to the object to be displayed from the environmental perception data; upload the geometric data to the vertex buffer of the graphics processor; and draw graphics in the vertex buffer based on the geometric data to obtain the geometric line drawing of the object to be displayed.

[0097] In one implementation, the theme module 401 is further configured to respond to a user's theme editing command by associating the visual resources corresponding to the theme editing command with the corresponding non-core display elements to obtain a theme configuration file; performing local signing and cloud authentication on the theme configuration file; and uploading the theme configuration file to the vehicle's theme database after the local signing and cloud authentication are successful.

[0098] Other embodiments or specific implementations of the rendering apparatus of this application can be found in the above-described method embodiments, and will not be repeated here.

[0099] The rendering apparatus provided in this application, employing the rendering method described in the above embodiments, can solve the technical problem that traditional theme-changing techniques can cause visual distortion of safety information on the intelligent driving interface, thus affecting driving safety. Compared with the prior art, the beneficial effects of the rendering apparatus provided in this application are the same as those of the rendering method provided in the above embodiments, and other technical features in the rendering apparatus are the same as those disclosed in the methods of the above embodiments, and will not be repeated here.

[0100] This application provides a rendering device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, which are executed by the at least one processor to enable the at least one processor to perform the rendering methods in the above embodiments.

[0101] The following is for reference. Figure 5 , Figure 5This is a schematic diagram of the hardware operating environment involved in the rendering device in the embodiments of this application, showing a structural schematic diagram of the rendering device suitable for implementing the embodiments of this application. The rendering device in the embodiments of this application may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (PADs), portable media players (PMPs), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 5 The rendering device shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments of this application.

[0102] like Figure 5 As shown, the rendering device may include a processing unit 1001 (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to a program stored in read-only memory 1002 or a program loaded from storage device 1003 into random access memory 1004. Random access memory 1004 also stores various programs and data required for the operation of the rendering device. The processing unit 1001, read-only memory 1002, and random access memory 1004 are interconnected via bus 1005. Input / output interface 1006 is also connected to the bus. Typically, the following systems can be connected to input / output interface 1006: input devices 1007 including, for example, touch screens, touchpads, keyboards, mice, image sensors, microphones, accelerometers, gyroscopes, etc.; output devices 1008 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 1003 including, for example, magnetic tapes, hard disks, etc.; and communication devices 1009. Communication device 1009 allows the rendering device to communicate wirelessly or wiredly with other devices to exchange data. Although the diagram shows rendering devices with various systems, it should be understood that it is not required to implement or have all of the systems shown. Alternatively, more or fewer systems may be implemented.

[0103] Specifically, according to the embodiments disclosed in this application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments disclosed in this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device, or installed from storage device 1003, or installed from read-only memory 1002. When the computer program is executed by processing device 1001, it performs the functions defined in the methods of the embodiments disclosed in this application.

[0104] The rendering device provided in this application, employing the rendering method described in the above embodiments, can solve the technical problem that traditional theme-changing techniques can cause visual distortion of safety information on the intelligent driving interface, thus affecting driving safety. Compared with the prior art, the beneficial effects of the rendering device provided in this application are the same as those of the rendering method provided in the above embodiments, and other technical features of the rendering device are the same as those disclosed in the previous embodiment method, and will not be repeated here.

[0105] It should be understood that the various parts disclosed in this application can be implemented using hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics can be combined in any suitable manner in one or more embodiments or examples.

[0106] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

[0107] This application provides a computer-readable storage medium having computer-readable program instructions (i.e., a computer program) stored thereon, the computer-readable program instructions being used to execute the rendering method in the above embodiments.

[0108] The computer-readable storage medium provided in this application may be, for example, a USB flash drive, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems or devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, radio frequency (RF), etc., or any suitable combination thereof.

[0109] The aforementioned computer-readable storage medium may be included in the rendering device or may exist independently and not assembled into the rendering device.

[0110] The aforementioned computer-readable storage medium carries one or more programs. When the aforementioned one or more programs are executed by a rendering device, the rendering device causes the following: to receive a user's theme switching instruction and load the theme configuration file corresponding to the theme switching instruction to obtain the corresponding theme rendering parameters; to acquire environmental perception data of the vehicle and determine the object to be displayed on the vehicle's in-vehicle interface based on the environmental perception data, wherein the object to be displayed represents an obstacle within a preset range of the vehicle; to generate a geometric line drawing of the object to be displayed based on the environmental perception data, wherein the geometric line drawing represents the outline of the obstacle; and to render the object to be displayed based on the theme rendering parameters, using the geometric line drawing as a constraint, to obtain the theme object corresponding to the in-vehicle interface.

[0111] Computer program code for performing the operations of this application can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a Local Area Network (LAN) or a Wide Area Network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0112] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation that may be implemented in systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0113] The modules described in the embodiments of this application can be implemented in software or hardware. The names of the modules do not necessarily limit the functionality of the unit itself.

[0114] The readable storage medium provided in this application is a computer-readable storage medium that stores computer-readable program instructions (i.e., a computer program) for executing the above-described rendering method. This solves the technical problem that traditional theme-changing techniques can cause visual distortion of safety information on the intelligent driving interface, thus affecting driving safety. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in this application are the same as those of the rendering method provided in the above embodiments, and will not be repeated here.

[0115] The above description is only a part of the embodiments of this application and does not limit the scope of protection of this application. All equivalent structural transformations made under the technical concept of this application and using the content of this application specification and drawings, or direct / indirect applications in other related technical fields, are included in the scope of protection of this application.

Claims

1. A rendering method, characterized in that, The method includes: Receive the user's theme switching command, load the theme configuration file corresponding to the theme switching command, and obtain the corresponding theme rendering parameters; Acquire environmental perception data of the vehicle, and determine the object to be displayed on the vehicle's in-vehicle interface based on the environmental perception data. The object to be displayed represents an obstacle within a preset range of the vehicle. A geometric line drawing of the object to be displayed is generated based on the environmental perception data, and the geometric line drawing is used to represent the outline of the obstacle. Using the geometric line diagram as a constraint, the object to be displayed is rendered based on the theme rendering parameters to obtain the theme object corresponding to the vehicle interface.

2. The method as described in claim 1, characterized in that, The step of rendering the object to be displayed based on the theme rendering parameters, using the geometric line diagram as a constraint, to obtain the theme object corresponding to the vehicle interface includes: Obtain the visual model of the object to be displayed; Using the geometric line diagram as a constraint, the visual model is superimposed on the upper layer of the geometric line diagram to obtain the object to be rendered; The graphics processor maps the subject rendering parameters to the model to be rendered. The underlying data corresponding to the object to be displayed in the environmental perception data is loaded into the mapped rendering model to obtain the theme object corresponding to the vehicle interface.

3. The method as described in claim 2, characterized in that, The step of obtaining the visual model of the object to be displayed includes: Determine the object type of the object to be displayed, and determine whether the object to be displayed is a non-core display element of the vehicle interface based on the object type; When the object to be displayed is a non-core display element, the object to be displayed is queried through a preset mapping table to obtain a model index. The preset mapping table includes the mapping relationship between non-core display elements and corresponding visual models. Based on the model index, obtain the visual model of the object to be displayed.

4. The method as described in claim 2, characterized in that, The step of mapping the subject rendering parameters to the model to be rendered using a graphics processor includes: Get the current resource utilization of the graphics processor; If the current resource utilization rate reaches a preset utilization threshold, the preset rendering resolution in the graphics processor is reduced. Based on the reduced rendering resolution, the graphics processor maps the subject rendering parameters to the model to be rendered.

5. The method as described in claim 4, characterized in that, After the step of mapping the subject rendering parameters to the model to be rendered via the graphics processor based on the reduced rendering resolution, the method further includes: During the mapping process of the model to be rendered, the rendering time of each frame of the graphics processor is collected; If the rendering time is lower than a preset time threshold, the preset rendering frame rate in the graphics processor is enhanced. Based on the enhanced rendering frame rate, return to the step of mapping the theme rendering parameters to the model to be rendered through the graphics processor based on the reduced rendering resolution, until the theme object corresponding to the vehicle interface is obtained.

6. The method as described in claim 1, characterized in that, The step of generating the geometric line drawing of the object to be displayed based on the environmental perception data includes: Extract the geometric data corresponding to the object to be displayed from the environmental perception data; The geometric data is uploaded to the vertex buffer of the graphics processor; In the vertex buffer, the geometric data is used to draw the graphics, resulting in the geometric line drawing of the object to be displayed.

7. The method according to any one of claims 1 to 6, characterized in that, Before the step of receiving the user's topic switching instruction, the method further includes: In response to the user's theme editing command, the visual resources corresponding to the theme editing command are associated with the corresponding non-core display elements to obtain a theme configuration file; Perform local signing and cloud authentication on the aforementioned theme configuration file; After the local signature and cloud authentication are successful, the theme configuration file is uploaded to the vehicle's theme database.

8. A rendering apparatus, characterized in that, The device includes: The theme module is used to receive the user's theme switching command, load the theme configuration file corresponding to the theme switching command, and obtain the corresponding theme rendering parameters; The display module is used to acquire environmental perception data of the vehicle and determine the object to be displayed on the vehicle's in-vehicle interface based on the environmental perception data. The object to be displayed represents an obstacle within a preset range of the vehicle. The line graph module is used to generate a geometric line graph of the object to be displayed based on the environmental perception data, wherein the geometric line graph is used to represent the outline of the obstacle; The rendering module is used to render the object to be displayed based on the theme rendering parameters, using the geometric line diagram as a constraint, to obtain the theme object corresponding to the vehicle interface.

9. A rendering device, characterized in that, The rendering device includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the rendering method as described in any one of claims 1 to 7.

10. A storage medium, characterized in that, The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, it implements the steps of the rendering method as described in any one of claims 1 to 7.

Images