An image processing method for vehicle-mounted images, an image processing system, and a vehicle

Abstract

The present application provides an image processing method, an image processing system and a vehicle for on-vehicle images. The on-vehicle images include a control module. The image processing method includes: obtaining the running state of the vehicle; if the vehicle is in a cold start state, controlling the control module to load necessary controls of the control module, where the necessary controls include a view switching button and / or a view operation button; after the necessary controls are loaded, loading non-necessary controls of the control module, where the non-necessary controls include a classical Chinese display frame and / or a prompt display frame. The technical problem solved by the present application is that traditional on-vehicle image systems usually rely on Android or QT software for image processing, stitching and rendering. Since Android or QT software requires a large number of components to be loaded synchronously during operation and occupies a large amount of memory, it is easy to cause the problem of slow image output of the on-vehicle image system when the vehicle is cold-started.

Description

Technical Field

[0001] This application relates to the technical field of automobiles, and more specifically, to an image processing method for in-vehicle images, an image processing system, and a vehicle. Background Art

[0002] With the continuous progress of automotive technology, the functions of in-vehicle infotainment systems and driving assistance systems are becoming increasingly rich, and users' requirements for in-vehicle interfaces are also getting higher and higher. As an important driving assistance technology, the panoramic in-vehicle imaging system can capture the surrounding environment of the vehicle in real time through multiple cameras and synthesize it into a 360-degree view, greatly improving driving safety and convenience.

[0003] However, there are at least the following problems in the related art: Traditional in-vehicle imaging systems usually rely on Android or QT software for image processing, stitching, and rendering. Since Android or QT software requires a large number of components to be loaded synchronously during operation and occupies a large amount of memory, it is easy to cause the problem of slow image output of the in-vehicle imaging system when the vehicle is cold-started. Summary of the Invention

[0004] The technical problem solved by this application is that traditional in-vehicle imaging systems usually rely on Android or QT software for image processing, stitching, and rendering. Since Android or QT software requires a large number of components to be loaded synchronously during operation and occupies a large amount of memory, it is easy to cause the problem of slow image output of the in-vehicle imaging system when the vehicle is cold-started.

[0005] To solve the above problems, this application provides an image processing method for in-vehicle images. The in-vehicle image includes a control module. The image processing method includes: obtaining the running state of the vehicle; if the vehicle is in a cold-start state, controlling the control module to load the necessary controls of the control module, where the necessary controls include view switching buttons and / or view operation buttons; after the necessary controls are loaded, loading the non-necessary controls of the control module, where the non-necessary controls include classical Chinese display frames and / or prompt display frames.

[0006] Compared with the prior art, the technical effects achieved by adopting this technical solution are as follows: In the related art, when the vehicle is cold-started, the in-vehicle imaging system needs to synchronously load a large number of components during startup, occupying a large amount of memory resources, which easily causes the in-vehicle imaging system to start slowly and unable to provide the required images to users in a timely manner. This application adjusts the loading strategy of the control module according to the running state of the vehicle, especially preferentially loading the necessary controls during cold start, providing the required images to users immediately, and then loading the non-necessary controls after the necessary controls are loaded, improving the startup efficiency and resource utilization rate of the system and shortening the image output time of the in-vehicle imaging system.

[0007] In an example of the present application, the vehicle-mounted image further includes an image acquisition module and a rendering module. The control control module loads the necessary controls of the control module, including: merging multiple images captured by the image acquisition module to generate first data; obtaining first image information required by the user in the first data according to the interaction action of the user with the control module; controlling the rendering module to perform rendering processing on the first image information according to the interaction action; wherein, the first data includes the total image obtained by merging and summarizing the images captured by the image acquisition module, and the interaction actions include zooming in, zooming out or selecting a specific area.

[0008] Compared with the prior art, the technical effects achieved by adopting this technical solution are as follows: By merging multiple images captured by the image acquisition module to form first data, it is not necessary to read each of the captured multiple images one by one, reducing the time for IO reading of the vehicle-mounted image system.

[0009] In an example of the present application, controlling the rendering module to perform rendering processing on the first image information according to the interaction action includes: receiving the signal of the interaction action, determining the corresponding position of the first image information in the first data; controlling the rendering module to perform an offset processing on the first image information according to the interaction action.

[0010] Compared with the prior art, the technical effects achieved by adopting this technical solution are as follows: Determining the position of the first image information required by the user according to the signal of the interaction action, and controlling the rendering module to perform rendering on it, improving the pertinence and accuracy of rendering specific image information and ensuring efficient response to user interaction.

[0011] In an example of the present application, the vehicle-mounted image further includes a display module, and the image processing method further includes: when the user interacts with any control in the control module through the display module, calibrating the interaction control as the first control and generating second data; adjusting the display strategy of the first control according to the second data; wherein, the display strategy includes modifying the background transparency of the first control.

[0012] Compared with the prior art, the technical effects achieved by adopting this technical solution are as follows: Setting the background of any control in the control module to a single background, and reflecting the current state of the control by modifying its background transparency. Compared with the original need for multiple backgrounds to represent multiple states of the control, the present application only requires a default background and represents different states by modifying its transparency. Such a setting can greatly reduce the memory occupancy, solve the problem of large memory occupancy caused by the need for multiple backgrounds for traditional controls, improve the resource utilization efficiency of the system, and at the same time improve the recognizability of the interaction.

[0013] In an example of the present application, the rendering module is provided with a first module and a second module; the second module is used to store the configuration information of any control in the control module, and the first module is used to manage the configuration information; the display strategy further includes: storing the configuration information of any control in the control module into the second module; creating a first module bound to the second module; controlling the control module to send a first retrieval instruction to the first module; according to the first retrieval instruction, retrieving the configuration information of the first control from the second module; controlling the rendering module to execute a first strategy on the first control according to the configuration information; the first strategy includes redirecting viewport processing.

[0014] Compared with the prior art, the technical effects achieved by adopting this technical solution are as follows: By setting a single first module to bind to the second module to reduce the data transfer volume between the CPU and the GPU, it is possible to improve the efficient management of the control configuration information in the control module and the rapid retrieval during interaction, further reduce the memory occupancy, improve the rendering efficiency, and reduce the system latency.

[0015] In an example of the present application, the control module further includes a first layer control and a second layer control; controlling the control module to load the necessary controls of the control module further includes: retrieving either the first layer control or the second layer control as the upper fixed layer, and retrieving the other as the lower active layer; controlling the control module to add a model variable offset to the active layer; adding a real-time assignment amount to the model variable offset; according to the real-time assignment amount, controlling the active layer to offset relative to the fixed layer to reflect the real-time loading progress of the control module.

[0016] Compared with the prior art, the technical effects achieved by adopting this technical solution are as follows: The upper fixed layer is used to provide a stable image background, and the lower active layer carries the dynamically changing image content. By adding a real-time assignment amount of the model variable offset to the active layer, the active layer moves relative to the fixed layer to reflect the real-time loading progress of any control in the current control module. Compared with the related art that uses algorithms for calculation, it can further reduce the occupancy of the system memory, more efficiently display the loading state of the control module, and improve the user experience.

[0017] In an example of the present application, the vehicle-mounted image further includes a control management module, and the image processing method further includes: controlling the control management module to hierarchically manage, organize, and classify any control in the control module using a tree structure.

[0018] Compared with the prior art, the technical effects achieved by adopting this technical solution are as follows: Using a tree structure to hierarchically manage the controls in the control module can effectively organize and classify the controls. When there is a control response in the control module, it is possible to quickly locate and find the responding control, improving the control management efficiency.

[0019] In an example of the present application, the image processing method further includes: if the vehicle is in a normal start state, controlling the control module to load all the controls in the control module.

[0020] In an example of the present application, an image processing system for vehicle-mounted images is provided. The image processing system includes: a control module for providing a plurality of operable controls to the user to facilitate the user's operation on the images provided by the display module; a control module for controlling the loading order of any control in the control module; a rendering module for rendering the controls in the control module using OpenGL technology; a display module for displaying the rendering result of the rendering module and each control in the control module; an image acquisition module for acquiring image information around the vehicle; and a control management module for managing the UI styles of any control in the control module.

[0021] In an example of the present application, a vehicle is further provided that can apply any of the above image processing methods for vehicle-mounted images.

[0022] After adopting the technical solution of the present application, the following technical effects can be achieved:

[0023] (1) The present application adjusts the loading strategy of the control module according to the operating state of the vehicle, can provide the user with the required images in the first time, improves the startup efficiency and resource utilization rate of the vehicle-mounted image system, greatly shortens the image output time of the vehicle-mounted image system, and reduces the user waiting time;

[0024] (2) By merging all the images captured by the image acquisition module into a large image to reduce the IO reading time-consuming of the vehicle-mounted image system and improve the image output time of the vehicle-mounted image system;

[0025] (3) By modifying the background transparency of the control, adopting a single first module to bind the second module, and setting fixed layers and active layers, the memory occupation during the startup of the vehicle-mounted image system is reduced, the resource utilization efficiency of the vehicle-mounted image system is improved, and the image output time of the vehicle-mounted image system is shortened. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the drawings to be used in the description of the embodiments. Obviously, the following drawings are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts;

[0027] Figure 1 It is a flowchart of an image processing method for vehicle-mounted images provided by an embodiment of the present application;

[0028] Figure 2Structural diagram provided by an embodiment of the present application;

[0029] Figure 3 Functional class diagram provided by an embodiment of the present application;

[0030] Figure 4 Module connection diagram of the image processing system provided by an embodiment of the present application.

[0031] Explanation of reference numerals:

[0032] 100, image processing system; 10, control module; 20, control module; 30, rendering module; 40, display module; 50, image acquisition module; 60, control management module. Detailed implementation manners

[0033] Hereinafter, embodiments of the present application will be described in detail. Examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary only for explaining the present application and should not be construed as limiting the present application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present application without creative efforts fall within the scope of protection of the present application.

[0034] In the description of the present application, it should be noted that, unless otherwise clearly defined and limited, the terms "installed", "connected" and "connected" should be understood in a broad sense. For example, it may be a fixed connection, a connection, or an integral connection; it may be a mechanical connection or an electrical connection; it may be directly connected or indirectly connected through an intermediate medium, and it may be the internal communication of two elements. For those of ordinary skill in the art, the specific meanings of the above terms in the present application can be understood according to specific situations.

[0035] It should be noted that the diagrams provided in this embodiment only illustrate the basic concept of the present application schematically. Therefore, only the components related to the present application are shown in the diagrams, rather than being drawn according to the number, shape and size of the components in actual implementation. The type, quantity and proportion of each component in actual implementation may be arbitrarily changed, and the component layout type may also be more complex.

[0036] It should be noted that this system breaks away from the mainstream UI frameworks such as Android or QT on the market, adopts the original OpenGL rendering technology, and implements a set of UI frameworks by itself, and has achieved optimization for the panoramic surround view system, that is, the in-vehicle AVM (Automotive View Monitor) system.

[0037] It should be noted that the image processing method of the present application can be applied to the development of in-vehicle imaging systems or other in-vehicle application systems with interface interaction functions for different vehicle models of the same manufacturer or different manufacturers.

[0038] To make the above objects, features, and advantages of the present application more obvious and understandable, the following detailed description of the specific embodiments of the present application will be given in conjunction with the accompanying drawings.

[0039] See Figure 1 , Figure 1 is a flowchart of an image processing method for in-vehicle imaging provided by an embodiment of the present application; specifically, the present application provides an image processing method for in-vehicle imaging, and the vehicle includes a control module 10; the image processing method includes:

[0040] Step S10: Obtain the running state of the vehicle;

[0041] Step S20: If the vehicle is in a cold start state, control the control module to load the necessary controls of the control module, and the necessary controls include view switching buttons and / or view operation buttons;

[0042] Step S21: If the vehicle is in a normal start state, control the control module to load all the controls in the control module;

[0043] Step S30: After the necessary controls are loaded, load the non-necessary controls of the control module, and the non-necessary controls include classical Chinese display frames and / or prompt display frames.

[0044] By preferentially loading the necessary controls, the required images are provided to the user in the first place, and when the necessary controls are loaded, the non-necessary controls are flexibly loaded according to the running state of the vehicle, so as to reduce the control resources that need to be synchronously loaded during the cold start of the in-vehicle image system, improve the startup efficiency and resource utilization rate of the system, and shorten the image output time of the in-vehicle imaging system.

[0045] Furthermore, the sizes of the controls in the control module 10 are set to be of equal width or equal length, and they are merged and processed as a whole for reading, reducing unnecessary waste of storage space and resource consumption of control file IO reading.

[0046] Furthermore, each control has its own OpenGL texture ID and set position. The Id numbers of each control resource in the control module 10 are predefined. When the Draw method is called through the Widget base class, this Id is passed out, and according to the predefined Id of the control resource, the texture of the corresponding control and the offset of the corresponding control are found.

[0047] In combination with the specific usage scenario, when the vehicle is in a cold start state, the control module 20 of the first strategy controls the control module 10 to preferentially load the control resources necessary for interaction and generate OpenGL textures to ensure the normal use of functions after the vehicle-mounted image is rendered. At the same time, an asynchronous thread is started to read the resource I / O of the necessary controls. By controlling the rendering module 30, according to the preset ID number of the necessary controls, the textures and the offsets of the controls preset by their IDs are found, and then they are loaded into the display module 40. After the necessary controls are loaded, the current operating state of the vehicle is obtained again, and the controls in the non-necessary controls in the control module 10 are gradually loaded according to the operating state of the vehicle.

[0048] Furthermore, the vehicle-mounted image further includes an image acquisition module 50 and a rendering module 30. Controlling the control module 10 to load the necessary controls of the control module 10 includes: merging a plurality of images captured by the image acquisition module 50 to generate first data; obtaining first image information required by the user in the first data according to the interaction actions of the user with the control module 10; controlling the rendering module 30 to perform rendering processing on the first image information according to the interaction actions. Among them, the first data includes the total image obtained by merging and summarizing the images captured by the image acquisition module 50, and the interaction actions include zooming in, zooming out, or selecting a specific area.

[0049] Furthermore, controlling the rendering module 30 to perform rendering processing on the first image information according to the interaction actions includes: receiving the signal of the interaction action and determining the corresponding position of the first image information in the first data; controlling the rendering module 30 to perform offset processing on the first image information according to the interaction actions.

[0050] In combination with the specific usage scenario, when the vehicle-mounted image is started or running, multiple image acquisition modules 50 installed around the vehicle continuously acquire the image information around the vehicle and send it to the control module 20. After receiving the images from each image acquisition module 50, the control module 20 performs stitching and merging processing on the images to generate first data, that is, a panoramic image of the surrounding environment of the vehicle. Such a setting can avoid the time-consuming of vehicle-mounted image I / O reading. Through the above setting, the vehicle-mounted image only needs to read the picture once. When the user wants to view the detailed image of a specific area during driving, by interacting with the first data, after the control module 20 receives the signal of the interaction action, it determines the specific position of the image the user wants to view in the panoramic image. The control module 20 performs offset processing on the target object according to the user's interaction actions, such as zooming in on the area or moving it to the center of the screen. Combining with the rendering module 30 to perform rendering processing on the offset target object again and loading it into the display module 40, so that the user can clearly see the required image information.

[0051] Further, the vehicle-mounted image further includes a display module 40, and the image processing method further includes: when the user interacts with any control in the control module 10 through the display module 40, calibrating the control interacting with the user as the first control and generating second data; adjusting the display strategy of the first control according to the second data; wherein, the display strategy includes modifying the background transparency of the first control.

[0052] In a specific example, the vehicle is provided with a display module 40, and the controls in the control module 10 are displayed in the display module 40, such as map zoom buttons, menu buttons, view switching buttons, view operation buttons, and classical Chinese or prompt type frames, etc. These controls usually include three situations: normal display, clickable, and non-clickable; taking the "submit button" as an example, there are usually three states: default state, pressed state, and prohibited state, corresponding to the state when not operated normally, the state when pressed, and the state when not operable respectively; in the related art, in order to implement these three states, originally three different background image resources needed to be prepared, but in this application, each control in the control module 10 is correspondingly set with a background image, using the background of the default state as the regular background, and simulating the pressed state and the prohibited state by modifying the alpha transparency of each control. Such a setting can greatly reduce the memory occupancy. From originally needing three pictures to represent these three states respectively, it becomes now only needing one default state picture, and by modifying the transparency, the display of the three states is achieved. The required memory is 1 / 3 of the original required memory, saving 2 / 3 of the memory.

[0053] For example, when the "submit button" is in the default state, its background is a complete opaque green; when in the pressed state, the transparency of the default state background image is reduced, such as becoming 50% of the default state, to indicate that the button is pressed; while in the prohibited state, the transparency of the default state background image is set to 20% or displayed in a gray tone to indicate that this button is currently inoperable; specifically, introduce the u_alpha variable in the fragment shader, and when the program Draw method is called, judge its own attribute state, such as the default state, pressed state, or prohibited state, and set the value of u_alpha according to the state to achieve the corresponding display effect.

[0054] Further, the rendering module 30 is provided with a first module and a second module; the second module is used to store the configuration information of any control in the control module 10, and the first module is used to manage the configuration information; the display strategy further includes: storing the configuration information of any control in the control module 10 into the second module; creating a first module bound to the second module; controlling the control module 10 to send a first retrieval instruction to the first module; retrieving the configuration information of the first control from the second module according to the first retrieval instruction; controlling the rendering module 30 to execute a first strategy on the first control according to the configuration information; the first strategy includes redirecting viewport processing.

[0055] Preferably, the first module includes a vertex array object, i.e., a VAO (Vertex Array Object) module, and the second module includes a vertex buffer object, i.e., a VBO (Vertex Buffer Object) module.

[0056] Preferably, the configuration information includes vertex data, positions, colors, texture coordinates, etc. of each control in the control module 10.

[0057] Specifically, through the form of combining the OpenGL ViewPort redirection viewport scheme with a single VAO module and a VBO module, the objects in the VBO module are effectively reduced or operations such as rotation, scaling, and translation are reduced; the clipping control display coordinates are defined through the ViewPort, so that each control agrees to be drawn using the Cartesian coordinate system of [-1, 1]. For different positions of the control, only the window display position of the ViewPort needs to be changed. Among them, the configuration information of each control in the control module 10 is defined, such as the shape and position information of a button for switching the viewing angle, and this configuration information is stored in the VBO module. Then, a VAO module bound to this VBO module is created to manage information such as the reading method and attribute configuration of this configuration information, so as to reduce the data transmission volume between the CPU and the GPU; when the user operates the vehicle-mounted imaging system through the control module 10, such as clicking the button for switching the viewing angle, according to the corresponding control, the control module 20 sends a first retrieval instruction to the VAO module, and reads the configuration information of the corresponding control from the VBO module bound to the VAO module according to the first retrieval instruction. Then, the rendering module 30 performs a redirection viewport process on the corresponding control according to the configuration information, that is, adjusts or recalculates the display position or size of the corresponding control in the new viewport to ensure that it can be correctly displayed in the new viewport, so as to improve the rendering efficiency and reduce the data transmission back and forth between the CPU and the GPU.

[0058] Combined with the specific usage situation, when the user clicks the zoom-in button in the control module 10 through the display module 40, the control module 10 transmits the zoom-in instruction and the current viewport parameters to the rendering module 30. After receiving the instruction, the first module of the rendering module 30 retrieves the configuration information related to the zoom-in operation, such as the zoom-in multiple, etc. from the second module; then, the rendering module 30 re-renders the image according to this configuration information and displays the zoomed-in image on the display module 40; at the same time, the control module 10 updates the state of the zoom-in button according to the feedback of the rendering module 30 and displays the current zoom-in multiple.

[0059] Furthermore, the control module 10 further includes a first layer control and a second layer control; controlling the control module 10 to load the necessary controls of the control module 10 further includes: retrieving either the first layer control or the second layer control as the upper fixed layer, and retrieving the other as the lower active layer; controlling the control module 10 to add a model variable offset to the active layer; adding a real-time assignment amount to the model variable offset; and controlling the active layer to offset relative to the fixed layer according to the real-time assignment amount to reflect the real-time loading progress of the control module 10.

[0060] By combining the two methods of overlaying layers and layer offset, only the background of the progress bar needs to be fixed. According to the real-time loading situation, the lower progress bar set under the background is controlled to move relatively to display the current loading progress. For example, the first layer control is the upper fixed layer and is provided with a hollow area, and the second layer control is the lower active layer; when it is necessary to calibrate the loading progress of a certain control, a model variable offset is added in the shader, that is, the offset is reflected by changing the position of the active layer relative to the background layer. As the loading progress advances, this offset changes continuously. For example, when my model.x = 0, the range of [-1, 1] is exactly 100%. When my model.x = 2, my vertex has shifted two positions, and the progress bar value is equal to 0 at this time. Calculate (2 - val / 100.f * 2) = model.x in sequence, which can effectively control the progress value, without the need for complex calculations, can further reduce the memory occupancy of the vehicle-mounted imaging system, and more efficiently display the loading status of the control module.

[0061] Furthermore, the vehicle-mounted imaging further includes a control management module 60, and the image processing method further includes: controlling the control management module 60 to hierarchically manage, organize, and classify any control in the control module 10 using a tree structure.

[0062] Specifically, as Figure 2 shown, the screen of the vehicle-mounted imaging system is usually composed of multiple views. The control management module 60 hierarchically manages, organizes, and classifies the sub-view of the vehicle-mounted imaging system using a tree structure; for example, the vehicle-mounted imaging system is divided into a BEV (Bird's Eye View) view, a 2D view, and a 3D view; among them, the BEV view further includes an exit button, a settings button, a mute button, and front / back / left / right view buttons, etc., the 2D view includes 2D view controls, and the 3D view includes 3D view controls; when a certain control is triggered, the control module 20 efficiently searches for the control and responds to events according to the tree structure divided by the vehicle-mounted imaging system. Using a tree-like hierarchical management, the structure is clear, easy to maintain, and can efficiently search for controls.

[0063] Furthermore, asFigure 3 As shown, Widget is defined as the base class of all controls in the control module 10. It provides some base class abstract methods such as Draw and HandleMessage, and also contains some properties such as Visible, Enable, coordinates, width, etc.; and its functional controls all inherit from Widget. The functional controls include Button and ImageProgressBar; the layout management control is Layout, which contains a property std::map<id,widget> to manage Widget. This Widget can be a functional control or a layout management control, that is, Layout nests Layout to implement the branches of the tree.

[0064] Furthermore, in combination with Figure 2 and Figure 3 , specifically, the AVM_Layout of this application contains multiple levels of views such as Bev view, 2D view, and 3D view; among them, the Bev view contains an exit button, a settings button, a mute button, and front, back, left, and right buttons. In actual projects, there are also some other Layouts, which will not be elaborated here; when a Touch trigger response occurs, AVM_Layout will quickly respond to this event. First, it will find the specific coordinates of the corresponding activated child node, that is, search from the Widgets stored in the Map. AVM_Layout will determine which Widget the coordinates of the child node fall into, and AVM_Layout will call the preset HandleMessage processing method of the child node for processing; combined with the above content, for example, when a Touch event occurs on a certain button (Button), the button will trigger the corresponding state change according to the preset callback function (Callback). If the button is in the lifted state, it will perform corresponding processing according to the preset callback function, restore to the initial state or perform other operations related to the lift, so as to be able to respond to the user's touch operation in a timely and accurate manner; the same is true for layout controls (Layout). When searching for child nodes in it, the same operation is performed.

[0065] Please refer to Figure 4, the present application also provides an image processing system 100 for vehicle-mounted images. The image processing system 100 includes: a control module 10, a control module 20, a rendering module 30, a display module 40, an image acquisition module 50, and a control management module 60. Among them, the control module 10 is used to provide a plurality of operable controls to the user, so as to facilitate the user to operate on the images provided by the display module 40. The rendering module 30 uses OpenGL technology to render the controls in the control module 10. The display module 40 is used to display the rendering results of the rendering module 30 and each control in the control module 10. The image acquisition module 50 is used to acquire image information around the vehicle. The control management module 60 is used to manage the UI styles of any control in the control module 10. The control module 20 is used to control the loading order of any control in the control module 10, obtain the data information of the control module 10, the rendering module 30, the display module 40, the image acquisition module 50, and the control management module 60, and control the loading and reading of the control module 10, the rendering module 30, the display module 40, the image acquisition module 50, and the control management module 60 according to the above image processing method.

[0066] The present application also provides a vehicle that can apply any of the above image processing methods for vehicle-mounted images.

[0067] Although the present application is disclosed as above, the present application is not limited thereto. Any person skilled in the art can make various changes and modifications without departing from the spirit and scope of the present application. Therefore, the protection scope of the present application should be subject to the scope defined by the claims.

Claims

1. An image processing method for vehicle-mounted images, characterized in that, The in-vehicle image includes a control module; the image processing method includes: Obtain the operating state of the vehicle; If the vehicle is in a cold start state, control the control module to load the necessary controls of the control module, and the necessary controls include a view switching button and / or a view operation button; After the necessary controls are loaded, load the non-necessary controls of the control module, and the non-necessary controls include a classical Chinese display frame and / or a prompt display frame; The in-vehicle image further includes an image acquisition module and a rendering module. The control of the control module to load the necessary controls of the control module includes: Perform a merging process on multiple images captured by the image acquisition module to generate first data; Obtain the first image information required by the user in the first data according to the interaction action of the user with the control module; Control the rendering module to perform a rendering process on the first image information according to the interaction action; Wherein, the first data includes a total image obtained by merging and summarizing the images captured by the image acquisition module, and the interaction actions include zooming in, zooming out, or selecting a specific area.

2. The image processing method according to claim 1, wherein The control of the rendering module to perform a rendering process on the first image information according to the interaction action includes: Receive the signal of the interaction action and determine the corresponding position of the first image information in the first data; Control the rendering module to perform an offset process on the first image information according to the interaction action.

3. The image processing method according to claim 1, wherein The in-vehicle image further includes a display module, and the image processing method further includes: When the user interacts with any control in the control module through the display module, calibrate the interaction control as the first control and generate second data; Adjust the display strategy of the first control according to the second data; Wherein, the display strategy includes modifying the background transparency of the first control.

4. The image processing method according to claim 3, characterized in that, The rendering module is provided with a first module and a second module; the second module is used to store the configuration information of any control in the control module, and the first module is used to manage the configuration information; The display strategy further includes: Store the configuration information of any control in the control module into the second module; Create the first module bound to the second module; Control the control module to send a first retrieval instruction to the first module; Retrieve the configuration information of the first control from the second module according to the first retrieval instruction; Control the rendering module to execute a first strategy on the first control according to the configuration information; The first strategy includes a viewport redirection process.

5. The image processing method according to claim 1, wherein The control module further includes a first layer control and a second layer control; The control of the control module to load the necessary controls of the control module further includes: retrieving either the first layer control or the second layer control as the upper fixed layer, and retrieving the other of the two as the lower active layer; Control the control module to add a model variable offset to the active layer; Add a real-time assignment amount to the model variable offset; According to the real-time assignment amount, control the offset of the active layer relative to the fixed layer to reflect the real-time loading progress of the control module.

6. The image processing method according to claim 1, wherein The vehicle-mounted image further includes a control management module, and the image processing method further includes: Control the control management module to hierarchically manage, organize, and classify any control in the control module using a tree structure.

7. The image processing method according to claim 1, wherein The image processing method further includes: If the vehicle is in a normal start state, control the control module to load all the controls in the control module.

8. An image processing system for vehicle-mounted images, characterized in that, The image processing system capable of implementing the image processing method according to any one of claims 1 to 7 includes: A control module for providing a plurality of operable controls to the user to facilitate the user's operation on the image provided by the display module; A control module for controlling the loading order of any one of the controls in the control module; A rendering module for rendering the controls in the control module using OpenGL technology; The display module for displaying the rendering result of the rendering module and each of the controls in the control module; An image acquisition module for acquiring image information around the vehicle; A control management module for managing the UI style of any one of the controls in the control module.

9. A vehicle, characterized in that, The image processing method capable of implementing any one of claims 1 to 7.

Images