Image display method and device based on auxiliary rendering, computer equipment and medium
By bypassing the graphics processing module of the Android system in the on-board image display system, directly processing images in the video memory, and customizing the video memory buffer management strategy, the problems of slow cold start, large resource consumption and poor stability of the on-board image display system are solved, and fast image display and efficient resource management are achieved.
Patent Information
- Application Number
- CN202411712956.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-27
- Publication Date
- 2025-03-18
AI Technical Summary
The existing on-board image display system has extended image output time during cold start, high resource consumption, poor system stability, affecting user experience and system performance.
By bypassing the SurfaceFlinger and other graphics processing modules of the Android system, image processing is performed directly in the video memory, and the video memory buffer management strategy is customized, allowing the AVM system to independently complete initialization before the Android core process is started, and the auxiliary rendering strategy is used to achieve rapid image generation and mapping.
It significantly reduces the resource consumption of CPU and GPU, improves the efficiency of video memory usage, reduces cold start time, improves the system response speed and user experience, and enhances the stability of the system.
Smart Images

Figure CN119645335A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of intelligent driving technology, and in particular to an image display method, device, computer equipment and medium based on auxiliary rendering. Background Art
[0002] The existing AVM system uses four cameras to capture the scene around the vehicle body, and seamlessly stitches it into a 360° panoramic view through the controller. At the same time, it receives vehicle dynamic signals to calculate the driving trajectory and displays it on the MMI in the form of video, aiming to provide convenient parking assistance and reduce safety risks. However, the AVM system under the existing technical background has exposed some key problems during implementation. Due to its reliance on the Android system, the slow system startup leads to a longer cold start image output time for the AVM function. The complexity of the Android graphics system components increases the consumption of memory, CPU and GPU resources. In addition, the stability of the system is affected by other applications and is prone to fluctuations. The combined effect of these factors not only affects the user experience, but also reduces the overall performance and reliability of the system. Summary of the invention
[0003] The embodiments of the present application provide an image display method, apparatus, computer device and medium based on auxiliary rendering, aiming to solve the problem of blocking in the existing vehicle-mounted image display loading process.
[0004] In a first aspect, an embodiment of the present application provides an image display method based on auxiliary rendering, which includes constructing a display function area according to video memory status information in an image processing and display system to obtain a video memory rendering buffer and a frame buffer, wherein the video memory buffer includes multiple preset rendering base points; constructing a display algorithm running space according to the video memory rendering buffer and the frame buffer and bundling the video memory rendering buffer and the frame buffer according to the rendering base point; generating a first display image in the video memory rendering buffer according to a pre-stored first image rendering strategy; mapping the first display image to the frame buffer; performing auxiliary rendering on the first display image according to a pre-stored second image rendering strategy to obtain a corresponding second display image; and mapping the second display image to the image real-time display screen of the image processing and display system based on the image video memory address of the second display image.
[0005] In the second aspect, the embodiment of the present application also provides an image display device based on auxiliary rendering, which includes a function area construction unit, which is used to construct a display function area according to the video memory status information in the image processing display system to obtain a video memory rendering buffer and a frame buffer; an operation unit, which is used to build a display algorithm operation space according to the video memory rendering buffer and the frame buffer and bundle the video memory rendering buffer and the frame buffer according to a rendering base point; an image generation unit, which is used to generate a first display image in the video memory rendering buffer according to a pre-stored first image rendering strategy; a mapping unit, which is used to map the first display image to the frame buffer; an auxiliary rendering unit, which is used to perform auxiliary rendering on the first display image according to a pre-stored second image rendering strategy to obtain a corresponding second display image; a display unit, which is used to map the second display image to the image real-time display screen of the image processing display system based on the image video memory address of the second display image.
[0006] In a third aspect, an embodiment of the present application further provides a computer device, which includes a memory and a processor, wherein a computer program is stored in the memory, and the above method is implemented when the processor executes the computer program.
[0007] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium, wherein the storage medium stores a computer program, and the computer program includes program instructions, which can implement the above method when executed by a processor.
[0008] The embodiment of the present application provides an image display method, device, computer equipment and medium based on auxiliary rendering. Among them, the method includes constructing a display function area according to the video memory status information in the image processing display system to obtain a video memory rendering buffer and a frame buffer, and the video memory buffer includes multiple preset rendering base points; constructing a display algorithm running space according to the video memory rendering buffer and the frame buffer and bundling the video memory rendering buffer and the frame buffer according to the rendering base point; generating a first display image in the video memory rendering buffer according to a pre-stored first image rendering strategy; mapping the first display image to the frame buffer; performing auxiliary rendering on the first display image according to a pre-stored second image rendering strategy to obtain a corresponding second display image; mapping the second display image to the image real-time display screen of the image processing display system based on the image video memory address of the second display image. This solution bypasses the SurfaceFlinger and other graphics processing modules of the Android system and directly performs image processing in the video memory, which significantly reduces the resource consumption of the CPU and GPU. The custom video memory buffer management strategy avoids the waste of resources of the graphics components of the Android system and improves the efficiency of video memory use. The solution allows the AVM system to complete initialization independently before the Android core process is started, greatly reducing the cold start time. Through the auxiliary rendering strategy, the rapid generation and mapping of images are achieved, avoiding the blocking phenomenon in the traditional process and further accelerating the image display speed. BRIEF DESCRIPTION OF THE DRAWINGS
[0009] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0010] Figure 1 A schematic diagram of a flow chart of an image display method based on auxiliary rendering provided in an embodiment of the present application;
[0011] Figure 2 A schematic diagram of a sub-process of an image display method based on auxiliary rendering provided in an embodiment of the present application;
[0012] Figure 3 A schematic block diagram of an image display device based on auxiliary rendering provided in an embodiment of the present application;
[0013] Figure 4 A schematic block diagram of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0014] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0015] It should be understood that when used in this specification and the appended claims, the terms "include" and "comprises" indicate the presence of described features, integers, steps, operations, elements and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or combinations thereof.
[0016] It should also be understood that the terms used in this application specification are only for the purpose of describing specific embodiments and are not intended to limit the application. As used in this application specification and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.
[0017] It should be further understood that the term “and / or” used in the specification and appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations.
[0018] Embodiments of the present application provide an image display method, apparatus, computer equipment, and medium based on auxiliary rendering.
[0019] The executor of the image display method based on auxiliary rendering may be the image display device based on auxiliary rendering provided in the embodiment of the present application, or a computer device integrated with the image display device based on auxiliary rendering, wherein the image display device based on auxiliary rendering may be implemented in hardware or software, and the computer device may be an intelligent vehicle machine, which is a terminal device installed in a car for display and control, and the intelligent vehicle machine is configured with an on-board display for displaying real-time images of the driving environment, and the on-board display is configured with an image processing and display system.
[0020] The image display method based on auxiliary rendering is applied to Figure 4 In the computer device 500.
[0021] Figure 1 It is a flowchart of an image display method based on auxiliary rendering provided in an embodiment of the present application, and the method includes the following steps S110-S160.
[0022] S110 , constructing a display function area according to video memory status information in the image processing display system to obtain a video memory rendering buffer and a frame buffer.
[0023] The video memory buffer includes multiple preset rendering base points.
[0024] S120 , constructing a display algorithm running space according to a video memory rendering buffer and a frame buffer, and bundling the video memory rendering buffer and the frame buffer according to a rendering base point.
[0025] S130 . Generate a first display image in a graphics memory rendering buffer according to a pre-stored first image rendering strategy.
[0026] S140: Map the first display image to a frame buffer.
[0027] S150: Perform auxiliary rendering on the first display image according to a pre-stored second image rendering strategy to obtain a corresponding second display image.
[0028] S160: Map the second display image to a real-time image display screen of the image processing and display system based on the image display memory address of the second display image.
[0029] In the existing common related technologies, the existing AVM (Around View Monitor) system captures the scene around the vehicle through four cameras and stitches these images into a 360° panoramic view through a controller. This system provides convenient parking assistance for the driver. This solution implements the AVM function through an application on the Android platform and uses advanced graphics components such as SurfaceView to display the screen. This solution uses Android's lower-level component ANativeWindow to display the graphics screen to implement the AVM function. Due to the slow startup speed of the Android system, the AVM function has a slow output speed during cold startup, which affects the user experience. The Android graphics system has many components, which consumes a lot of memory, CPU and GPU resources, which may cause the system to run less smoothly. The Android graphics system components are easily affected by other applications, resulting in poor system stability. In response to the problem of AVM system startup delay, the AVM system can be initialized before the Android core process is started by eliminating the dependence on core modules such as SurfaceFlinger, HWC (Hardware Composer) and Graphics Allocator in the Android system, thereby significantly reducing the cold start time. The key resources required by the AVM system are preloaded into the memory so that they can be used directly when the system starts without waiting for resources to be loaded. Run AVM as an independent service, independent of other services in the Android system, to avoid delays caused by waiting for other services to start. Communicate with display hardware directly through the hardware abstraction layer (HAL), bypassing SurfaceFlinger and reducing intermediate processing links. Implement custom GraphicBuffer management to avoid using Graphics Allocator and reduce waiting time for resource allocation. Design the initialization process of the AVM system as an asynchronous operation, allowing the system to complete initialization while other tasks are executing. Use non-blocking mode when connecting to SurfaceFlinger, so that even if delays occur, the entire startup process will not be blocked. Through the above optimization measures, it is expected that the waiting time of the AVM system during cold start can be reduced from the original 2 seconds to a few hundred milliseconds or even shorter. Due to the reduction of dependencies and waiting time, the responsiveness of the entire system will be improved, and the user experience will be better. Reduce the dependence on the core modules of the Android system and reduce the potential instability caused by system complexity.
[0030] In a more specific implementation process, a display function area is established according to the video memory status information in the image processing display system to obtain a video memory rendering buffer and a frame buffer. The video memory status is analyzed to divide the video memory buffer for rendering, including multiple preset rendering base points. An operating environment is created for the display algorithm, and the video memory rendering buffer and the frame buffer are bound according to the rendering base point. The video memory rendering buffer and the frame buffer are associated with each other by using the rendering base point to prepare for subsequent image rendering and display. A first display image is generated in the video memory rendering buffer according to the pre-stored image rendering strategy. The first image rendering strategy is executed to generate a preliminary display image by using the video memory rendering buffer. The generated first display image is mapped to the frame buffer to prepare for the final display. The image data in the video memory rendering buffer is transferred to the frame buffer. According to the second image rendering strategy, the first display image is auxiliary rendered to obtain a higher quality display image. Based on the first display image, the auxiliary rendering technology is applied to generate a second display image, and its image video memory address is obtained. The final second display image is mapped to the real-time display screen of the image processing display system. The image video memory address of the second display image is used to display it on the screen. By precisely controlling the allocation of video memory buffers, the efficiency of video memory usage is improved. Through auxiliary rendering strategies, higher quality images can be generated while maintaining high rendering efficiency. By pre-storing rendering strategies and directly operating video memory, the startup delay of image display is reduced. Through independent display algorithm running space, interference from other parts of the system is reduced and stability is improved.
[0031] In summary, by bypassing the SurfaceFlinger and other graphics processing modules of the Android system and performing image processing directly in the video memory, the resource consumption of the CPU and GPU is significantly reduced. The custom video memory buffer management strategy avoids the waste of resources of the Android system graphics components and improves the efficiency of video memory use. The solution allows the AVM system to complete initialization independently before the Android core process is started, which greatly reduces the cold start time. Through the auxiliary rendering strategy, the rapid generation and mapping of images is achieved, avoiding the blocking phenomenon in the traditional process, and further speeding up the image display speed. Reducing the dependence on the core modules of the Android system reduces the complexity of the system, thereby improving the overall stability. An independent running space is provided for the display algorithm, reducing the interaction interference with other system components and enhancing the robustness of the system. Through efficient image processing and display methods, real-time and smooth image display is achieved, which improves the user's interactive experience. The improvement of the system response speed enables faster feedback on user operations and enhances the user experience. By bypassing the Android system for image processing and display, not only image processing and display resources are saved, but also the startup speed is significantly improved, providing users with a faster, more stable and efficient image display experience.
[0032] like Figure 2 As shown, in a more specific embodiment, before executing method S120, it further specifically includes executing steps S121-S122.
[0033] S121 . Obtain length and width information of the frame buffer and generate a plurality of mapping area edge lines.
[0034] S122 , dividing the video memory rendering buffer into a corresponding plurality of live simulation mapping areas according to the mapping area edge lines.
[0035] The frame buffer includes at least one expected mapping area, and the live simulation mapping area faces the expected mapping area according to a preset simulation rendering point.
[0036] Specifically, in order to ensure the correct mapping between the video memory rendering buffer and the frame buffer, it is necessary to first obtain the length and width information of the frame buffer, and generate the edge lines of the mapping area accordingly. Based on these size information, multiple edge lines of the mapping area are generated, and these lines will define the boundaries of the subsequent mapping areas. According to the edge lines of the mapping area, the video memory rendering buffer is divided into multiple live simulation mapping areas to perform more accurate image rendering and mapping. The edge lines generated in step S121 are used to divide the video memory rendering buffer into multiple areas. It is ensured that each live simulation mapping area corresponds to at least one expected mapping area in the frame buffer. According to the preset simulation rendering point, the orientation of the live simulation mapping area is determined to ensure that the rendered image can be correctly mapped to the expected frame buffer position. By obtaining the specific size information of the frame buffer and generating the edge lines of the mapping area, the accurate mapping between the video memory rendering buffer and the frame buffer is ensured. By dividing the video memory rendering buffer into multiple live simulation mapping areas, more refined image processing can be performed according to different rendering requirements to improve the rendering effect. Through the preset simulation rendering point, the display position and orientation of the image in the frame buffer can be more accurately controlled, thereby improving the image quality of the final display. When performing the generation of the edge lines of the mapping area and the division of the video memory rendering buffer, a high degree of accuracy needs to be ensured to avoid misalignment or distortion of the image display. When dividing the live simulation mapping area, it is necessary to ensure synchronization with the expected mapping area of the frame buffer to maintain the consistency of the image display. When dividing the mapping area, the optimization of rendering performance should be considered to avoid performance degradation caused by overly complex area division. Through these supplementary steps, the solution ensures the accuracy of image mapping and optimization of rendering effects while achieving efficient image processing and display.
[0037] In a more specific embodiment, according to a pre-stored first image rendering strategy, a first display image is generated in the video memory rendering buffer, including marking the selected video memory rendering buffer as a first display range, and / or a second display range; according to image properties of the mapping objects in the first display image, the mapping objects in the first display image are distinguished into a first mapping object, a second mapping object and a third mapping object; the first mapping object and the second mapping object are generated in the first display range; and the third mapping object and the first display image corresponding to the third mapping object are generated in the second display range.
[0038] Before generating the first display image in the video memory rendering buffer, the second display range and the first display image based on the third mapping object are selected, and contour extraction processing is performed on the first display image based on the third mapping object.
[0039] The second display range and the first display image based on the third mapping object are selected, and contour extraction processing is performed on the first display image based on the third mapping object, including obtaining the coordinates of the mapping object of the first display image in the coordinate system of the video memory rendering buffer; constructing a simulated dynamic ray, the simulated dynamic ray connects the simulated contour point and the coordinates of the mapping object of the first display image in the coordinate system of the video memory rendering buffer; obtaining the intersection coordinates of the simulated dynamic ray and the video memory rendering buffer of each mapping area and generating a coordinate sequence based on multiple intersection coordinates.
[0040] Specifically, in a video memory rendering buffer, a specific area is marked as a first display range and / or a second display range to distinguish different image processing areas. According to the image attributes of the mapping object in the first display image, it is divided into a first mapping object, a second mapping object and a third mapping object. These classifications may be based on the type, importance or other attributes of the object. The first mapping object and the second mapping object are generated in the first display range. The third mapping object is generated in the second display range. Before generating the first display image, the first display image of the third mapping object is subjected to contour extraction processing so as to better render these objects in the second display range. The second display range is selected, and contour extraction is performed based on the first display image of the third mapping object. The coordinates of the mapping object in the first display image in the coordinate system of the video memory rendering buffer are obtained to provide positioning information for subsequent auxiliary rendering. Simulated dynamic rays are constructed, and these rays connect the simulated contour points (which may be extracted from the third mapping object) with the coordinates of the mapping object of the first display image in the coordinate system of the video memory rendering buffer. The intersection coordinates of the simulated dynamic rays and the video memory rendering buffer of each mapping area are obtained. A coordinate sequence is generated based on these intersection coordinates for the auxiliary rendering process. By distinguishing different mapped objects and rendering them in different display ranges, the image display effect can be controlled more accurately. Contour extraction processing helps to better highlight specific objects in the auxiliary rendering stage and enhance the visual effect of the image. By simulating dynamic rays and generating coordinate sequences, more complex image processing effects such as dynamic shadows, lighting effects, etc. can be achieved in auxiliary rendering. Ensure that the classification of mapped objects is accurate to avoid rendering errors. The contour extraction process needs to be highly accurate to ensure the effect of auxiliary rendering. The calculation process of simulating dynamic rays and generating coordinate sequences can be complex and requires algorithm optimization to maintain good performance.
[0041] Through the implementation of these strategies, the above technical solutions can provide more sophisticated and efficient image processing and display, thereby improving the overall visual experience and system performance.
[0042] Figure 3 1 is a schematic block diagram of an image display device based on auxiliary rendering provided by an embodiment of the present application. As shown in the figure, corresponding to the above-mentioned image display method based on auxiliary rendering, the present application also provides an image display device 100 based on auxiliary rendering. The image display device based on auxiliary rendering includes a unit for executing the above-mentioned image display method based on auxiliary rendering, and the device can be configured in a desktop computer, a tablet computer, a laptop computer, and the like. For details, please refer to Figure 3The image display device 100 based on auxiliary rendering includes a function area construction unit 110, which is used to construct a display function area according to the video memory status information in the image processing display system to obtain a video memory rendering buffer and a frame buffer; an operation unit 120, which is used to construct a display algorithm operation space according to the video memory rendering buffer and the frame buffer and bundle the video memory rendering buffer and the frame buffer according to a rendering base point; an image generation unit 130, which is used to generate a first display image in the video memory rendering buffer according to a pre-stored first image rendering strategy; a mapping unit 140, which is used to map the first display image to the frame buffer; an auxiliary rendering unit 150, which is used to perform auxiliary rendering on the first display image according to a pre-stored second image rendering strategy to obtain a corresponding second display image; and a display unit 160, which is used to map the second display image to the image real-time display screen of the image processing display system based on the image video memory address of the second display image. In addition, the device also includes a function area construction unit, which is used to construct a display function area according to the video memory status information in the image processing display system to obtain a video memory rendering buffer and a frame buffer; an operation unit, which is used to construct a display algorithm operation space according to the video memory rendering buffer and the frame buffer and bundle the video memory rendering buffer and the frame buffer according to a rendering base point; an image generation unit, which is used to generate a first display image in the video memory rendering buffer according to a pre-stored first image rendering strategy; a mapping unit, which is used to map the first display image to the frame buffer; an auxiliary rendering unit, which is used to perform auxiliary rendering on the first display image according to a pre-stored second image rendering strategy to obtain a corresponding second display image; and a display unit, which is used to map the second display image to the image processing display system based on the image video memory address of the second display image. A real-time image display screen of the system; a frame buffer processing unit, used to obtain the length and width information of the frame buffer and generate a plurality of mapping area edge lines; a functional area division unit, used to divide the video memory rendering buffer into a plurality of corresponding live simulation mapping areas according to the mapping area edge lines; a marking unit, used to mark the selected video memory rendering buffer as a first display range and / or a second display range; an image distinguishing unit, used to distinguish the mapping objects in the first display image into a first mapping object, a second mapping object and a third mapping object according to the image attributes of the mapping objects in the first display image; a first generating unit, used to generate the first mapping object and the second mapping object in the first display range; and a second generating unit, used to generate the third mapping object and the first display image corresponding to the third mapping object in the second display range.
[0043] It should be noted that technicians in the relevant field can clearly understand that the specific implementation process of the above-mentioned image display device based on auxiliary rendering and each unit can refer to the corresponding description in the aforementioned method embodiment, and for the convenience and conciseness of the description, it will not be repeated here.
[0044] The above-mentioned image display device based on auxiliary rendering can be implemented in the form of a computer program. The computer program can be used in Figure 4 Runs on the computer device shown.
[0045] See also Figure 4 , which shows a schematic block diagram of a computer device provided in an embodiment of the present application. The computer device 500 may be an intelligent vehicle machine, which is a terminal device installed in a car for display and control. The intelligent vehicle machine is equipped with an on-board display for displaying real-time images of the driving environment, and the on-board display is equipped with an image processing and display system.
[0046] The computer device 500 includes a processor 502 , a memory, and a network interface 505 connected via a system bus 501 , wherein the memory may include a non-volatile storage medium 503 and an internal memory 504 .
[0047] The non-volatile storage medium 503 may store an operating system 5031 and a computer program 5032. The computer program 5032 includes program instructions, and when the program instructions are executed, the processor 502 may execute an image display method based on auxiliary rendering.
[0048] The processor 502 is used to provide computing and control capabilities to support the operation of the entire computer device 500 .
[0049] The internal memory 504 provides an environment for the operation of the computer program 5032 in the non-volatile storage medium 503. When the computer program 5032 is executed by the processor 502, the processor 502 can execute an image display method based on auxiliary rendering.
[0050] The network interface 505 is used to communicate with other devices over the network. Figure 4 The structure shown in the figure is merely a block diagram of a portion of the structure related to the solution of the present application, and does not constitute a limitation on the computer device 500 to which the solution of the present application is applied. The specific computer device 500 may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.
[0051] It should be understood that in the embodiment of the present application, the processor 502 may be a central processing unit (CPU), and the processor 502 may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.
[0052] It can be understood by those skilled in the art that all or part of the processes in the method for implementing the above embodiment can be completed by instructing the relevant hardware through a computer program. The computer program includes program instructions, and the computer program can be stored in a storage medium, which is a computer-readable storage medium. The program instructions are executed by at least one processor in the computer system to implement the process steps of the embodiment of the above method.
[0053] Therefore, the present application also provides a storage medium. The storage medium may be a computer-readable storage medium. The storage medium stores a computer program, wherein the computer program includes program instructions. When the program instructions are executed by a processor, the processor executes the steps of the above method.
[0054] The storage medium may be a USB flash drive, a mobile hard disk, a read-only memory (ROM), a magnetic disk, or an optical disk, etc., which are computer-readable storage media that can store program codes.
[0055] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0056] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of each unit is only a logical function division, and there may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed.
[0057] The steps in the method of the embodiment of the present application can be adjusted in order, combined and deleted according to actual needs. The units in the device of the embodiment of the present application can be combined, divided and deleted according to actual needs. In addition, the functional units in the various embodiments of the present application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.
[0058] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, terminal, or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application.
[0059] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.
Claims
1. An image display method based on auxiliary rendering is applied to a vehicle display for displaying a real-time image of a driving environment, wherein an image processing and display system is configured in the vehicle display, and is characterized in that: The image display method comprises: Constructing a display function area according to the video memory status information in the image processing display system to obtain a video memory rendering buffer and a frame buffer, wherein the video memory buffer includes a plurality of preset rendering base points; Constructing a display algorithm running space according to the video memory rendering buffer and the frame buffer and bundling the video memory rendering buffer and the frame buffer according to the rendering base point; Generating a first display image in the video memory rendering buffer according to a pre-stored first image rendering strategy; mapping the first display image to the frame buffer; According to a pre-stored second image rendering strategy, performing auxiliary rendering on the first display image to obtain a corresponding second display image; The second display image is mapped to the real-time image display screen of the image processing and display system based on the image display memory address of the second display image.
2. The image display method based on auxiliary rendering according to claim 1, characterized in that: Before constructing a display algorithm running space according to the video memory rendering buffer and the frame buffer and bundling the video memory rendering buffer and the frame buffer according to the rendering base point, the method includes: Obtaining the length and width information of the frame buffer and generating a plurality of mapping area edge lines; The video memory rendering buffer is divided into a plurality of corresponding live simulation mapping areas according to the mapping area edge line, the frame buffer includes at least one expected mapping area, and the live simulation mapping area faces the expected mapping area according to a preset simulation rendering point.
3. The image display method based on auxiliary rendering according to claim 2, characterized in that: The step of generating a first display image in the video memory rendering buffer according to a pre-stored first image rendering strategy includes: Mark the selected video memory rendering buffer as a first display range, and / or a second display range; According to image attributes of the mapping objects in the first display image, the mapping objects in the first display image are divided into a first mapping object, a second mapping object, and a third mapping object; generating the first mapping object and the second mapping object in the first display range; The third mapping object and a first display image corresponding to the third mapping object are generated in the second display range.
4. The image display method based on auxiliary rendering according to claim 3, characterized in that: Before generating the first display image in the video memory rendering buffer, the method includes: selecting the second display range and a first display image based on the third mapping object; Performing contour extraction processing on the first display image based on the third mapping object.
5. The image display method based on auxiliary rendering according to claim 4, characterized in that: The performing contour extraction processing on the first display image based on the third mapping object comprises: Obtaining coordinates of a mapping object of the first display image in a coordinate system of a rendering buffer of the video memory; Constructing a simulated dynamic ray, the simulated dynamic ray connecting the simulated contour point and the coordinates of the mapped object of the first display image in the coordinate system of the video memory rendering buffer; The intersection coordinates of the simulated dynamic ray and each of the mapping area video memory rendering buffers are obtained and a coordinate sequence based on the multiple intersection coordinates is generated.
6. An image display device based on auxiliary rendering, applying the image display method based on auxiliary rendering according to any one of claims 1 to 5, characterized in that: include: A function area construction unit, used for constructing a display function area according to the video memory status information in the image processing display system to obtain a video memory rendering buffer and a frame buffer; An operating unit, configured to construct a display algorithm operating space according to the video memory rendering buffer and the frame buffer and to bundle the video memory rendering buffer with the frame buffer according to the rendering base point; An image generation unit, configured to generate a first display image in the video memory rendering buffer according to a pre-stored first image rendering strategy; A mapping unit, configured to map the first display image to the frame buffer; an auxiliary rendering unit, configured to perform auxiliary rendering on the first display image to obtain a corresponding second display image according to a pre-stored second image rendering strategy; The display unit is used to map the second display image to the real-time image display screen of the image processing and display system based on the image display memory address of the second display image.
7. The image display device based on auxiliary rendering according to claim 6, characterized in that: The device also includes: A frame buffer processing unit, used for acquiring the length and width information of the frame buffer and generating a plurality of mapping area edge lines; The functional area division unit is used to divide the video memory rendering buffer into a plurality of corresponding live simulation mapping areas according to the edge lines of the mapping area.
8. The image display device based on auxiliary rendering according to claim 6, characterized in that: The image generation unit also includes: A marking unit, used for marking the selected video memory rendering buffer as a first display range and / or a second display range; an image distinguishing unit, configured to distinguish the mapping objects in the first display image into a first mapping object, a second mapping object and a third mapping object according to image attributes of the mapping objects in the first display image; A first generating unit, configured to generate the first mapping object and the second mapping object in the first display range; The second generating unit is configured to generate the third mapping object and a first display image corresponding to the third mapping object in the second display range.
9. A computer device, characterized in that: The computer device includes a memory and a processor, the memory stores a computer program, and the processor implements the method according to any one of claims 1 to 5 when executing the computer program.
10. A computer-readable storage medium, characterized in that: The storage medium stores a computer program, wherein the computer program includes program instructions, and when the program instructions are executed by a processor, the method according to any one of claims 1 to 5 can be implemented.
Citation Information
Cited By
Image processing method, system and device, medium, equipment and vehicle
CN120612433A