Chassis display implementation method, electronic device and non-volatile readable storage medium
By constructing a panoramic historical frame projection map and fusing image information, the existing transparent chassis technology has been solved and the difficulties and limitations of deployment on low-computing platforms are achieved, efficient and accurate transparent chassis rendering is achieved, and the field of view of the vehicle's surrounding environment is enhanced. .
Patent Information
- Application Number
- CN202411071087.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-06
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2044-08-06
AI Technical Summary
The existing transparent chassis technology has high requirements for hardware computing power and is difficult to deploy on low computing power platforms. It is limited to the vehicle length being smaller than the panoramic circumferential projection range, which cannot fully reflect the environment around the vehicle and under the chassis.
By constructing a panoramic historical frame projection map, integrating image information at different time points, combining vehicle positioning data to determine the ground projection of the chassis area, and fusing it with the current frame panoramic ring view to generate a transparent chassis panoramic map to ensure the accuracy and completeness of rendering , reduce computing power demand.
It realizes efficient display of the environment around the vehicle and under the chassis on a low-computing platform, enhances the accuracy and completeness of transparent chassis rendering and reduces hardware requirements.
Smart Images

Figure CN118587112B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of vehicle technology, and in particular to a chassis display implementation method, an electronic device and a non-volatile readable storage medium. Background Art
[0002] In vehicle safety driving and assisted driving systems, transparent chassis technology can use image processing to display the blind area under the vehicle chassis on the driver's screen in a virtually transparent manner, allowing the driver to clearly see the road conditions under the wheels and avoid collisions and obstacles. However, existing transparent chassis technology has high hardware computing power requirements and is difficult to deploy on low-computing power platforms to achieve the transparent chassis effect. In addition, most of the existing transparent chassis technology is only applicable to vehicles with a length less than the panoramic surround projection range, which has great limitations. Summary of the invention
[0003] The present invention aims to solve at least one of the technical problems existing in the prior art.
[0004] To this end, an object of the present invention is to propose a chassis display implementation method, which can integrate image information at different time points, comprehensively reflect the environment around the vehicle and under the chassis, effectively make up for the shortcomings of real-time images in field of view coverage, and at the same time, ensure the accuracy and completeness of transparent chassis rendering and reduce computing power requirements.
[0005] To this end, a second objective of the present invention is to provide an electronic device.
[0006] To this end, a third object of the present invention is to provide a non-volatile readable storage medium.
[0007] To this end, a fourth objective of the present invention is to provide a chassis display implementation system.
[0008] To this end, a fifth object of the present invention is to provide a vehicle.
[0009] In order to achieve the above-mentioned purpose, an embodiment of the first aspect of the present invention proposes a chassis display implementation method, including: obtaining a panoramic historical frame projection map, wherein the panoramic historical frame projection map is obtained based on vehicle positioning data and multiple frames of continuous historical panoramic surround view; determining a ground projection of a chassis area, wherein the ground projection of the chassis area is determined based on the vehicle positioning data and the panoramic historical frame projection map; obtaining a transparent chassis panoramic image for display, wherein the transparent chassis panoramic image is obtained based on the ground projection of the chassis area and the current frame panoramic surround view.
[0010] According to the chassis display implementation method of the embodiment of the present invention, by constructing a panoramic historical frame projection map based on the vehicle positioning data and multiple frames of continuous historical panoramic surround view, it is possible to integrate image information at different time points, comprehensively reflect the environment around the vehicle and under the chassis, and effectively make up for the shortcomings of real-time images in field of view coverage. At the same time, the ground projection of the chassis area is determined according to the vehicle positioning data and the panoramic historical frame projection map, thereby ensuring the accuracy and completeness of the transparent chassis rendering. Furthermore, after determining the ground projection of the chassis area, it is only necessary to fuse the ground projection of the chassis area with the panoramic surround view of the current frame to generate a transparent chassis panorama, thereby reducing the computing power requirements.
[0011] In addition, the chassis display implementation method according to the embodiment of the present invention may also have the following additional technical features:
[0012] In some examples, the panoramic historical frame projection map is obtained by mapping based on the coordinate information of the chassis fusion area and the historical panoramic surround view of the target scale, and the target scale is positively correlated with the vehicle speed; the coordinate information of the chassis fusion area is determined based on the vehicle positioning data and the historical panoramic surround view.
[0013] In some examples, the historical panoramic surround view is fused based on images captured by a vehicle-mounted camera; the chassis fusion area is the fusion area of the historical panoramic surround view; and the coordinate information of the chassis fusion area includes the vertex coordinates of the chassis fusion area in the ground projection coordinate system.
[0014] In some examples, the historical panoramic surround view is obtained by processing images captured by the vehicle-mounted camera based on an open graphics library.
[0015] In some examples, the vertex coordinates of the chassis fusion area are calculated based on the vehicle positioning data, the vehicle size, and the historical panoramic surround view.
[0016] In some examples, the alpha channel weights of the historical panoramic surround view are modified by region.
[0017] In some examples, the ground projection of the chassis area is obtained based on the vertex coordinates of the chassis area in the ground projection coordinate system and the panoramic historical frame projection map; the vertex coordinates of the chassis area in the ground projection coordinate system are determined based on the vehicle positioning data.
[0018] In some examples, vertex coordinates of the chassis area in the ground projection coordinate system are within the range of the panoramic history frame projection map.
[0019] In some examples, the transparent chassis panorama is obtained by rendering a ground projection of the chassis area and the current frame panoramic surround view.
[0020] In some examples, the rendering includes fusing a ground projection of the chassis area, the current frame panoramic surround view, and a body rendering image from a vehicle digital model.
[0021] In some examples, the transparent chassis panoramic image includes a transparent chassis panoramic image of a transparent vehicle body, and the transparent chassis panoramic image of the transparent vehicle body is displayed in a transparent chassis function on mode.
[0022] In some examples, the transparent chassis panoramic image includes a transparent chassis panoramic image of a physical vehicle body, and the transparent chassis panoramic image of the physical vehicle body is displayed in a transparent chassis function off mode.
[0023] In some examples, the vehicle positioning information is obtained via a wheel speed odometer.
[0024] In order to achieve the above-mentioned purpose, an embodiment of the second aspect of the present invention proposes an electronic device, comprising: at least one processor; a memory communicatively connected to the at least one processor; a computer program executable by the at least one processor is stored in the memory, and when the at least one processor executes the computer program, the chassis display implementation method described in the embodiment of the first aspect of the present invention is implemented.
[0025] The electronic device according to the present invention can integrate image information at different time points by constructing a panoramic historical frame projection map based on vehicle positioning data and multiple frames of continuous historical panoramic surround view images, comprehensively reflecting the environment around the vehicle and under the chassis, and effectively making up for the shortcomings of real-time images in field of view coverage. At the same time, the ground projection of the chassis area is determined according to the vehicle positioning data and the panoramic historical frame projection map, thereby ensuring the accuracy and completeness of the transparent chassis rendering. Furthermore, after determining the ground projection of the chassis area, it is only necessary to fuse the ground projection of the chassis area with the panoramic surround view of the current frame to generate a transparent chassis panorama, thereby reducing the computing power requirements.
[0026] In order to achieve the above-mentioned purpose, an embodiment of the third aspect of the present invention provides a non-volatile readable storage medium on which a computer program is stored. When the computer program is executed, the chassis display implementation method described in the embodiment of the first aspect of the present invention is implemented.
[0027] According to the non-volatile readable storage medium of an embodiment of the present invention, when the chassis display implementation program stored thereon is executed by a processor, by constructing a panoramic historical frame projection map based on the vehicle positioning data and multiple frames of continuous historical panoramic surround view, it is possible to integrate image information at different time points, comprehensively reflect the environment around the vehicle and under the chassis, and effectively make up for the shortcomings of real-time images in field of view coverage. At the same time, the ground projection of the chassis area is determined according to the vehicle positioning data and the panoramic historical frame projection map, thereby ensuring the accuracy and completeness of the transparent chassis rendering. Furthermore, after determining the ground projection of the chassis area, it is only necessary to fuse the ground projection of the chassis area with the panoramic surround view of the current frame to generate a transparent chassis panorama, thereby reducing the computing power requirement.
[0028] The embodiment of the fourth aspect of the present invention also discloses a chassis display implementation system, comprising: a positioning device for obtaining vehicle positioning information; multiple cameras for collecting environmental image information; a display device for displaying a panoramic image of a transparent chassis; a controller, the controller is connected to the positioning device, the multiple cameras and the display device, and is used to execute the chassis display implementation method described in the embodiment of the first aspect of the present invention.
[0029] In some examples, the positioning device includes a wheel speed odometer.
[0030] According to the chassis display implementation system of the embodiment of the present invention, by constructing a panoramic historical frame projection map based on the vehicle positioning data and multiple frames of continuous historical panoramic surround view, it is possible to integrate image information at different time points, comprehensively reflect the environment around the vehicle and under the chassis, and effectively make up for the shortcomings of real-time images in field of view coverage. At the same time, the ground projection of the chassis area is determined according to the vehicle positioning data and the panoramic historical frame projection map, thereby ensuring the accuracy and completeness of the transparent chassis rendering. Furthermore, after determining the ground projection of the chassis area, it is only necessary to fuse the ground projection of the chassis area with the panoramic surround view of the current frame to generate a transparent chassis panorama, thereby reducing the computing power requirements.
[0031] The fifth aspect embodiment of the present invention further discloses a vehicle, the vehicle comprising the electronic device described in the second aspect embodiment of the present invention; or the vehicle comprising the chassis display implementation system described in the fourth aspect embodiment of the present invention.
[0032] According to the vehicle of the embodiment of the present invention, by constructing a panoramic historical frame projection map based on the vehicle positioning data and multiple frames of continuous historical panoramic surround view, it is possible to integrate image information at different time points, comprehensively reflect the environment around the vehicle and under the chassis, and effectively make up for the shortcomings of real-time images in field of view coverage. At the same time, the ground projection of the chassis area is determined according to the vehicle positioning data and the panoramic historical frame projection map, thereby ensuring the accuracy and completeness of the transparent chassis rendering. Furthermore, after determining the ground projection of the chassis area, it is only necessary to fuse the ground projection of the chassis area with the panoramic surround view of the current frame to generate a transparent chassis panorama, thereby reducing the computing power requirement.
[0033] Additional aspects and advantages of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS
[0034] The above and / or additional aspects and advantages of the present invention will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:
[0035] Figure 1 is a flow chart of a method for realizing chassis display according to an embodiment of the present invention;
[0036] Figure 2 is a schematic diagram of a historical panoramic view according to an embodiment of the present invention;
[0037] Figure 3 is a schematic diagram of the rendering principle of a transparent chassis panorama according to an embodiment of the present invention;
[0038] Figure 4 It is a structural schematic diagram of a chassis display implementation system according to an embodiment of the present invention.
[0039] Reference numerals:
[0040] Chassis display implementation system-100; positioning device-110; multiple cameras-120; display device-130; controller-140. DETAILED DESCRIPTION
[0041] In order to be able to understand the features and technical contents of the embodiments of the present invention in more detail, the implementation of the embodiments of the present invention is described in detail below in conjunction with the accompanying drawings. The attached drawings are for reference only and are not used to limit the embodiments of the present invention. In the following technical description, for the convenience of explanation, a full understanding of the disclosed embodiments is provided through multiple details. However, one or more embodiments can still be implemented without these details. In other cases, to simplify the drawings, well-known structures and devices can be simplified for display.
[0042] Reference below Figure 1-Figure 3 A chassis display implementation method according to an embodiment of the present invention is described.
[0043] like Figure 1 As shown, the chassis display implementation method includes the following steps:
[0044] Step S1: Obtain a panoramic historical frame projection map, which is obtained based on vehicle positioning data and multiple frames of continuous historical panoramic surround views.
[0045] Specifically, in the process of chassis display, the vehicle's positioning data can be obtained through the global navigation satellite system, etc., including but not limited to the vehicle's relative position information (such as longitude and latitude, etc.) and direction (yaw angle, etc.), etc. At the same time, as the vehicle is driving, multiple cameras (such as on-board fisheye cameras) set at different positions (front, rear, left, and right) of the vehicle can continuously capture the environmental information around the vehicle to form a multi-frame continuous panoramic surround view, so as to facilitate obtaining a panoramic historical frame projection map based on the vehicle positioning data and the multi-frame continuous historical panoramic surround view. The historical frame can be set according to the actual situation. For example, 1 frame is taken every 1s, and 20 frames are taken when it is set to 20s, and the historical frame is 20 frames.
[0046] Step S2: determining the ground projection of the chassis area, wherein the ground projection of the chassis area is determined based on the vehicle positioning data and the panoramic historical frame projection map.
[0047] Specifically, after obtaining the vehicle positioning data, the position and direction of the vehicle chassis on the ground can be determined based on the current positioning data, and then the coordinate information of the vehicle chassis area can be obtained based on the position and direction of the vehicle chassis on the ground. Further, the obtained coordinate information of the chassis area is mapped to the panoramic historical frame projection map, and the ground projection of the chassis area can be determined, that is, the ground conditions that can be seen under the vehicle chassis at the current position.
[0048] Step S3: Obtain a transparent chassis panorama for display, where the transparent chassis panorama is obtained based on a ground projection of the chassis area and a current frame panoramic ring view.
[0049] Specifically, after obtaining the ground projection of the chassis area, rendering technology can be used to render the ground projection of the chassis area and the current frame panoramic surround view according to a preset rendering order to generate a final transparent chassis panorama and display it on the display, so that the driver can see the ground conditions under the vehicle chassis in real time through the transparent chassis panorama, including potential obstacles, potholes or uneven roads, etc., thereby improving driving safety and comfort.
[0050] Therefore, the above-mentioned chassis display implementation method can integrate image information at different time points by constructing a panoramic historical frame projection map based on vehicle positioning data and multiple frames of continuous historical panoramic surround views, comprehensively reflect the environment around the vehicle and under the chassis, and effectively make up for the shortcomings of real-time images in field of view coverage. At the same time, the ground projection of the chassis area is determined according to the vehicle positioning data and the panoramic historical frame projection map, thereby ensuring the accuracy and completeness of the transparent chassis rendering. Furthermore, after determining the ground projection of the chassis area, it is only necessary to fuse the ground projection of the chassis area with the panoramic surround view of the current frame to generate a transparent chassis panorama, thereby reducing the computing power requirements.
[0051] In one embodiment of the present invention, the panoramic historical frame projection map is obtained by mapping based on the coordinate information of the chassis fusion area and the historical panoramic surround view of the target scale, and the target scale is positively correlated with the vehicle speed; the coordinate information of the chassis fusion area is determined based on the vehicle positioning data and the historical panoramic surround view.
[0052] Specifically, by fusing the vehicle's positioning data with the historical panoramic surround view, the area under and around the vehicle chassis within a certain range can be determined as the fusion area, and the boundary point coordinates of the chassis fusion area can be determined, including but not limited to the vertex coordinates of the chassis fusion area; further, a map can be constructed based on the coordinate information of the chassis fusion area and the panoramic surround view extracted from the historical panoramic surround view according to the target ratio, wherein the target ratio is positively correlated with the vehicle speed. If the vehicle is traveling at a fast speed, the mapping frequency is increased, for example, a panoramic surround view is extracted for mapping every 0.5 seconds to ensure that the mapping is continuous and without faults; if the vehicle is traveling at a slow speed, the mapping frequency is reduced, for example, a panoramic surround view is extracted for mapping every 2 seconds to reduce the computing power consumption of the algorithm.
[0053] In one embodiment of the present invention, the historical panoramic surround view is fused based on images captured by a vehicle-mounted camera; the chassis fusion area is the fusion area of the historical panoramic surround view; and the coordinate information of the chassis fusion area includes the vertex coordinates of the chassis fusion area in the ground projection coordinate system.
[0054] Specifically, the historical panoramic surround view is image data captured by the on-board surround view cameras (usually including front, rear, left, right and possibly bottom cameras), and is rendered on the graphics processor through the rendering pipeline of vertex shaders, fragment shaders and other shaders of the open graphics library in combination with the fusion strategy. The generated panoramic stitching image covers the 360-degree field of view around the vehicle and provides the vehicle with rich environmental information; the chassis fusion area is the fusion area of the historical panoramic surround view, which corresponds to the projection area of the vehicle chassis on the ground; further, the coordinate information of the chassis fusion area includes the vertex coordinates of the chassis fusion area in the ground projection coordinate system, usually including four points, which are used to represent the position and shape of the chassis fusion area on the ground.
[0055] In one embodiment of the present invention, Figure 2 As shown, the historical panoramic surround view is obtained by processing the images collected by the vehicle-mounted camera based on the open graphics library.
[0056] Specifically, after obtaining the images captured by the vehicle-mounted camera, the images captured by the vehicle-mounted camera can be spliced based on the open graphics library to obtain a historical panoramic view, wherein the shaded part is the fusion area between the images captured by the vehicle-mounted camera. Furthermore, to ensure the fusion continuity of the images captured by multiple vehicle-mounted cameras, the weight value of the fusion area can be linearly changed. Furthermore, the captured images can also be processed through the open graphics library, including but not limited to de-distortion and perspective transformation operations, so as to restore the original shape and proportion of the image and improve the visual effect of the captured image.
[0057] In one embodiment of the present invention, the vertex coordinates of the chassis fusion area are calculated based on vehicle positioning data, vehicle size and historical panoramic surround views.
[0058] Specifically, when obtaining the vertex coordinates of the chassis fusion area, the original position of the vehicle when it is powered on can be determined as the origin of the ground projection coordinate system. At the same time, combined with the geometric dimensions of the vehicle, the ground projection coordinate system can be determined. Further, the position and direction of the vehicle chassis on the ground can be determined based on the vehicle positioning data, so that the projection map vertex coordinates of the vehicle chassis in the ground projection coordinate system can be obtained based on the position and direction of the vehicle chassis on the ground. Furthermore, the obtained projection map vertex coordinates are mapped to the panoramic surround view, and the vertex coordinates of the chassis fusion area can be calculated.
[0059] In one embodiment of the present invention, the alpha channel weights of the historical panoramic ring view are modified in different regions.
[0060] Specifically, when building a map based on the coordinate information of the chassis fusion area and the historical panoramic surround view of the target scale, the alpha channel weight can be modified in partitions to achieve a gradual change in image transparency, so that adjacent panoramic surround views can be naturally merged at the joints to avoid obvious seams or sudden changes in transparency. At the same time, by modifying the alpha channel weight in partitions, the fusion of color and brightness can also be affected, so that the color and brightness on both sides of the stitching area gradually transition, reducing color difference and brightness difference, thereby enhancing the realism of the panoramic surround view.
[0061] In one embodiment of the present invention, the ground projection of the chassis area is obtained based on the vertex coordinates of the chassis area in the ground projection coordinate system and the panoramic historical frame projection map; the vertex coordinates of the chassis area in the ground projection coordinate system are determined based on the vehicle positioning data.
[0062] Specifically, after determining the ground projection coordinate system based on the original position of the vehicle when it is powered on and the geometric dimensions of the vehicle, the position and direction of the vehicle chassis on the ground can be determined based on the vehicle positioning data, thereby obtaining the vertex coordinates of the chassis area in the ground projection coordinate system based on the position and direction of the vehicle chassis on the ground. For example, assuming that the vehicle direction (front direction) is at a certain angle to the positive direction of the X-axis (or a specific direction) of the ground projection coordinate system, the chassis area of the vehicle can be mapped to the ground projection coordinate system through coordinate rotation and displacement, and the coordinates of its vertices can be determined; further, after obtaining the vertex coordinates of the chassis area in the ground projection coordinate system, the vertex coordinates of the chassis area can be mapped to the panoramic historical frame projection map, thereby obtaining the ground projection of the chassis area.
[0063] In one embodiment of the present invention, the vertex coordinates of the chassis area in the ground projection coordinate system are within the range of the panoramic historical frame projection map.
[0064] Specifically, after obtaining the vertex coordinates of the chassis area in the ground projection coordinate system, the vertex coordinates of the chassis area in the ground projection coordinate system can be compared with the coordinate range of the panoramic history frame projection map to determine whether the vertex coordinates of the chassis area in the ground projection coordinate system are within the range of the panoramic history frame projection map to ensure that the panoramic history frame projection map can completely fill the current chassis area, that is, the chassis area can be accurately represented in the panoramic history frame projection map.
[0065] In one embodiment of the present invention, the transparent chassis panorama is obtained by rendering the ground projection of the chassis area and the current frame panoramic surround view.
[0066] Specifically, when displaying the chassis, the ground projection of the chassis area can be fused with the current frame panoramic surround view for rendering, including but not limited to using open graphics library technology to use the ground projection of the chassis area as a transparent layer, superimposed on the corresponding position of the current frame panoramic surround view, so that the ground projection of the chassis area and the current frame panoramic surround view are fused to obtain a transparent chassis panorama.
[0067] In one embodiment of the present invention, Figure 3 As shown, the rendering includes fusing the ground projection of the chassis area, the current frame panoramic surround view, and the body rendering image from the vehicle digital model.
[0068] Specifically, when rendering, the open graphics library can be used to fuse the ground projection of the chassis area, the current frame panoramic surround view and the body rendering screen. For example, the ground projection of the chassis area can be superimposed on the current frame panoramic surround view with appropriate transparency to form a transparent chassis effect. Furthermore, the body rendering screen of the vehicle digital model can be fused with the formed transparent chassis effect to obtain a transparent chassis panorama, wherein the body rendering screen of the vehicle digital model includes a transparent body rendering screen and a physical body rendering screen.
[0069] In one embodiment of the present invention, the transparent chassis panoramic image includes a transparent chassis panoramic image of a transparent vehicle body, and the transparent chassis panoramic image of the transparent vehicle body is displayed in a transparent chassis function on mode.
[0070] Specifically, when displaying the chassis, the human-computer interaction system of the vehicle can receive instructions input by the user to turn on or off the transparent chassis function. When the instruction to turn on the transparent chassis function is received, the transparent chassis panoramic image of the transparent body rendered by the transparent body rendering screen can be displayed, so that the body appears visually transparent, that is, the physical information of the body is not displayed, including the body's texture, color, etc., so that the driver can clearly see the environment around the body and the road condition information under the chassis, such as potholes, stones, manhole covers and other obstacles, thereby improving driving safety.
[0071] In one embodiment of the present invention, the transparent chassis panoramic image includes a transparent chassis panoramic image of a physical vehicle body, and the transparent chassis panoramic image of the physical vehicle body is displayed in a transparent chassis function off mode.
[0072] Specifically, when displaying the chassis, the human-computer interaction system of the vehicle can receive instructions input by the user to turn on or off the transparent chassis function. When an instruction to turn off the transparent chassis function is received, the transparent chassis panoramic view of the physical body obtained by rendering the physical body rendering screen can be displayed to make the body visually present a physical effect, that is, to display the physical information of the body, including the body's texture, color, etc., to meet the driver's needs in different scenarios. For example, when driving on a narrow road, the driver needs to see the contact information between the vehicle and objects in the surrounding environment. The driver can enhance the perception of the surroundings of the vehicle through the transparent chassis panoramic view of the physical body to avoid collisions, etc., thereby improving driving safety.
[0073] In one embodiment of the present invention, the vehicle positioning information is obtained through a wheel speed odometer.
[0074] Specifically, the vehicle positioning information can be obtained through a wheel speed odometer, wherein the wheel speed odometer is usually composed of a sensor installed on each wheel, which can be used to monitor the rotation speed of the wheel so as to calculate the distance traveled by the vehicle based on the rotation speed of the wheel, thereby obtaining the vehicle positioning information, including but not limited to the relative position information of the vehicle.
[0075] In summary, according to the chassis display implementation method of an embodiment of the present invention, by constructing a panoramic historical frame projection map based on vehicle positioning data and multiple frames of continuous historical panoramic surround view, it is possible to integrate image information at different time points, comprehensively reflect the environment around the vehicle and under the chassis, and effectively make up for the shortcomings of real-time images in field of view coverage. At the same time, the ground projection of the chassis area is determined according to the vehicle positioning data and the panoramic historical frame projection map, thereby ensuring the accuracy and completeness of the transparent chassis rendering. Furthermore, after determining the ground projection of the chassis area, it is only necessary to fuse the ground projection of the chassis area with the panoramic surround view of the current frame to generate a transparent chassis panorama, thereby reducing the computing power requirements.
[0076] A further embodiment of the present invention proposes an electronic device, comprising: at least one processor; a memory communicatively connected to the at least one processor; a computer program executable by the at least one processor is stored in the memory, and when the at least one processor executes the computer program, the chassis display implementation method of the first aspect of the present invention is implemented.
[0077] The electronic device according to the present invention can integrate image information at different time points by constructing a panoramic historical frame projection map based on vehicle positioning data and multiple frames of continuous historical panoramic surround view images, comprehensively reflecting the environment around the vehicle and under the chassis, and effectively making up for the shortcomings of real-time images in field of view coverage. At the same time, the ground projection of the chassis area is determined according to the vehicle positioning data and the panoramic historical frame projection map, thereby ensuring the accuracy and completeness of the transparent chassis rendering. Furthermore, after determining the ground projection of the chassis area, it is only necessary to fuse the ground projection of the chassis area with the panoramic surround view of the current frame to generate a transparent chassis panorama, thereby reducing the computing power requirements.
[0078] In order to achieve the above-mentioned purpose, an embodiment of the third aspect of the present invention provides a non-volatile readable storage medium on which a computer program is stored. When the computer program is executed, the chassis display implementation method of the embodiment of the first aspect of the present invention is implemented.
[0079] According to the non-volatile readable storage medium of an embodiment of the present invention, when the chassis display implementation program stored thereon is executed by a processor, by constructing a panoramic historical frame projection map based on the vehicle positioning data and multiple frames of continuous historical panoramic surround view, it is possible to integrate image information at different time points, comprehensively reflect the environment around the vehicle and under the chassis, and effectively make up for the shortcomings of real-time images in field of view coverage. At the same time, the ground projection of the chassis area is determined according to the vehicle positioning data and the panoramic historical frame projection map, thereby ensuring the accuracy and completeness of the transparent chassis rendering. Furthermore, after determining the ground projection of the chassis area, it is only necessary to fuse the ground projection of the chassis area with the panoramic surround view of the current frame to generate a transparent chassis panorama, thereby reducing the computing power requirement.
[0080] The fourth aspect of the present invention also discloses a chassis display implementation system 100, such as Figure 4 As shown, the chassis display implementation system 100 includes: a positioning device 110, used to obtain vehicle positioning information; multiple cameras 120, used to collect environmental image information; a display device 130, used to display a panoramic view of the transparent chassis; a controller 140, the controller 140 is connected to the positioning device 110, the multiple cameras 120 and the display device 130, and is used to execute the chassis display implementation method of the first aspect of the present invention.
[0081] In one embodiment of the present invention, the positioning device 110 includes a wheel speed odometer.
[0082] According to the chassis display implementation system 100 of the present invention, by constructing a panoramic historical frame projection map based on vehicle positioning data and multiple frames of continuous historical panoramic surround views, it is possible to integrate image information at different time points, comprehensively reflect the environment around the vehicle and under the chassis, and effectively make up for the shortcomings of real-time images in field of view coverage. At the same time, the ground projection of the chassis area is determined according to the vehicle positioning data and the panoramic historical frame projection map, thereby ensuring the accuracy and completeness of the transparent chassis rendering. Furthermore, after determining the ground projection of the chassis area, it is only necessary to fuse the ground projection of the chassis area with the panoramic surround view of the current frame to generate a transparent chassis panorama, thereby reducing the computing power requirement.
[0083] The fifth aspect embodiment of the present invention further discloses a vehicle, the vehicle comprising the electronic device described in the second aspect embodiment of the present invention; or the vehicle comprising the chassis display implementation system described in the fourth aspect embodiment of the present invention.
[0084] According to the vehicle of the embodiment of the present invention, by constructing a panoramic historical frame projection map based on the vehicle positioning data and multiple frames of continuous historical panoramic surround view, it is possible to integrate image information at different time points, comprehensively reflect the environment around the vehicle and under the chassis, and effectively make up for the shortcomings of real-time images in field of view coverage. At the same time, the ground projection of the chassis area is determined according to the vehicle positioning data and the panoramic historical frame projection map, thereby ensuring the accuracy and completeness of the transparent chassis rendering. Furthermore, after determining the ground projection of the chassis area, it is only necessary to fuse the ground projection of the chassis area with the panoramic surround view of the current frame to generate a transparent chassis panorama, thereby reducing the computing power requirement.
[0085] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "illustrative embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials, or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example.
[0086] Although the embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the claims and their equivalents.
Claims
1. A chassis display implementation method, characterized in that: include: Obtaining a panoramic historical frame projection map, wherein the panoramic historical frame projection map is obtained by mapping according to the coordinate information of the chassis fusion area and a historical panoramic surround view of a target ratio, wherein the target ratio is positively correlated with the vehicle speed, wherein the historical panoramic surround view is fused according to images collected by a vehicle-mounted camera, wherein the coordinate information of the chassis fusion area is determined according to vehicle positioning data and the historical panoramic surround view, wherein the chassis fusion area is a fusion area of the historical panoramic surround view, and wherein the coordinate information of the chassis fusion area includes vertex coordinates of the chassis fusion area in a ground projection coordinate system; Determine a ground projection of a chassis area, wherein the ground projection of the chassis area is obtained according to vertex coordinates of the chassis area in a ground projection coordinate system and the panoramic historical frame projection map, wherein the vertex coordinates of the chassis area in the ground projection coordinate system are determined according to the vehicle positioning data; A transparent chassis panorama is obtained for display, wherein the transparent chassis panorama is obtained based on a ground projection of the chassis area and a current frame panoramic surround view.
2. The chassis display implementation method according to claim 1, characterized in that: The historical panoramic surround view is obtained by processing the image collected by the vehicle-mounted camera based on the open graphics library.
3. The chassis display implementation method according to claim 1, characterized in that: The vertex coordinates of the chassis fusion area are calculated based on the vehicle positioning data, vehicle size and the historical panoramic surround view.
4. The method for realizing chassis display according to any one of claims 1 to 3, characterized in that: The alpha channel weights of the historical panoramic ring view are modified in different regions.
5. The chassis display implementation method according to claim 4, characterized in that: The vertex coordinates of the chassis area in the ground projection coordinate system are within the range of the panoramic historical frame projection map.
6. The chassis display implementation method according to claim 1, characterized in that: The transparent chassis panorama is obtained by rendering the ground projection of the chassis area and the current frame panoramic surround view.
7. The method for realizing chassis display according to claim 6, characterized in that: The rendering includes fusing the ground projection of the chassis area, the current frame panoramic surround view, and the body rendering picture from the vehicle digital model.
8. The chassis display implementation method according to claim 1, characterized in that: The transparent chassis panoramic image includes a transparent chassis panoramic image of a transparent vehicle body, and the transparent chassis panoramic image of the transparent vehicle body is displayed in a transparent chassis function on mode.
9. The chassis display implementation method according to claim 1, characterized in that: The transparent chassis panoramic image includes a transparent chassis panoramic image of a physical vehicle body, and the transparent chassis panoramic image of the physical vehicle body is displayed in a transparent chassis function off mode.
10. The chassis display implementation method according to claim 1, characterized in that: The vehicle positioning data is obtained through a wheel speed odometer.
11. An electronic device, characterized in that: include: at least one processor; a memory communicatively coupled to the at least one processor; The memory stores a computer program executable by the at least one processor, and the at least one processor implements the chassis display implementation method according to any one of claims 1 to 10 when executing the computer program.
12. A non-volatile readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed, the chassis display implementation method according to any one of claims 1 to 10 is implemented.
13. A chassis display implementation system, characterized in that: include: A positioning device, used to obtain vehicle positioning information; Multiple cameras for collecting environmental image information; A display device, used for displaying a panoramic view of the transparent chassis; A controller, wherein the controller is connected to the positioning device, the plurality of cameras and the display device, and is used to execute the chassis display implementation method according to any one of claims 1 to 10.
14. The chassis display realization system according to claim 13, characterized in that: The positioning device includes a wheel speed odometer.
15. A vehicle, characterized in that: The vehicle comprises the electronic device of claim 11; Alternatively, the vehicle includes the chassis display implementation system according to claim 13 or 14.
