Image processing method, computer readable storage medium and electronic equipment

Abstract

The invention provides an image processing method, a computer readable storage medium and electronic equipment, and relates to the technical field of intelligent driving. The image processing method comprises the following steps: a view adjustment process of an application layer sends an original image and a view adjustment parameter to an image processing driving module of a kernel layer; an image processing driving module of the kernel layer executes an image adjustment operation on the original image according to the view adjustment parameter to obtain a target image; when the vehicle is in the target scene, the image processing driving module of the kernel layer feeds back an image adjustment completion message to the view adjustment process of the application layer; the view adjustment process of the application layer responds to the image adjustment completion message to control the push screen display process of the application layer to send a display control message to the display driving module of the kernel layer; and the display driving module of the kernel layer responds to the display control message to execute the display operation of the target image. The image display delay of the electronic rearview mirror can be reduced.

Description

Background Art

[0002] Electronic rearview mirror, also known as CMS (Camera Monitor System), is a digital and intelligent driver assistance system that converts traditional mechanical rearview mirrors. Electronic rearview mirrors use cameras to capture real-time images around the vehicle and display them on the in-car display, providing a wider and clearer field of view than traditional mechanical rearview mirrors.

[0003] In the process of realizing the image display of the electronic rearview mirror, there may be a problem of large data transmission link delay. In this case, the environment around the vehicle cannot be reflected in time, which is easy to cause traffic accidents.

[0004] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention

[0005] The purpose of the present disclosure is to provide an image processing method, a computer-readable storage medium and an electronic device, thereby overcoming the problem of large image display delay of an electronic rearview mirror at least to a certain extent.

[0006] According to a first aspect of the present disclosure, there is provided an image processing method, which is applied to an image display process of an electronic rearview mirror of a vehicle, and the image processing method comprises: a field of view adjustment process of an application layer sends an original image and field of view adjustment parameters to an image processing driver module of a core layer; the image processing driver module of the core layer performs an image adjustment operation on the original image according to the field of view adjustment parameters to obtain a target image; when the vehicle is in a target scene, the image processing driver module of the core layer feeds back an image adjustment completion message to the field of view adjustment process of the application layer; the field of view adjustment process of the application layer controls the push screen display process of the application layer to send a display control message to the display driver module of the core layer in response to the image adjustment completion message; based on the pre-constructed association relationship between the output data address information of the image processing driver module of the core layer and the input data address information of the display driver module of the core layer, the display driver module of the core layer performs a display operation of the target image in response to the display control message.

[0007] Optionally, when the vehicle is in the target scene, the image processing driver module of the core layer performs an image adjustment operation on the original image according to the field of view adjustment parameters to obtain the target image, including: the image processing driver module of the core layer performs an image compression processing operation on the original image to obtain an intermediate image; the image processing driver module of the core layer performs an image adjustment operation on the intermediate image according to the field of view adjustment parameters to obtain the target image.

[0008] Optionally, the image processing method further includes: a field of view adjustment process of the application layer determines a field of view adjustment parameter according to a current driving state of the vehicle and / or a current environment of the vehicle.

[0009] Optionally, the image processing method further includes: screening at least one field of view requirement indicator from the vehicle driving state and / or the environment in which the vehicle is located, and constructing a target scene using the at least one field of view requirement indicator.

[0010] Optionally, the image processing method also includes: when the field of view requirement index corresponds to the driving state of the vehicle, the application layer determines the current driving state of the vehicle, and compares the current driving state of the vehicle with the field of view requirement index, and if the current driving state of the vehicle meets the field of view requirement index, it is determined that the vehicle is in the target scene; and / or when the field of view requirement index corresponds to the environment in which the vehicle is located, the application layer determines the current environment of the vehicle, and compares the current environment of the vehicle with the field of view requirement index, and if the current environment of the vehicle meets the field of view requirement index, it is determined that the vehicle is in the target scene.

[0011] Optionally, the image processing method also includes: when the vehicle is not in the target scene, the image processing driver module of the kernel layer sends the target image to the field of view adjustment process of the application layer; the field of view adjustment process of the application layer sends the target image to the push screen display process of the application layer; the push screen display process of the application layer sends the target image to the display driver module of the kernel layer; the display driver module of the kernel layer executes the display operation of the target image.

[0012] Optionally, the display driver module of the kernel layer performs a display operation of the target image, including: the display driver module of the kernel layer acquires at least one driving assistance image; the display driver module of the kernel layer performs an overlay display operation of the target image and the at least one driving assistance image.

[0013] According to a second aspect of the present disclosure, an image processing method is provided, which is applied to an image display process of a vehicle electronic rearview mirror, and the image processing method comprises: a field of view adjustment process of an application layer sends an original image and field of view adjustment parameters to an image processing driver module of a core layer; the image processing driver module of the core layer performs an image adjustment operation on the original image according to the field of view adjustment parameters to obtain a target image; the image processing driver module of the core layer feeds back an image adjustment completion message to the field of view adjustment process of the application layer; the field of view adjustment process of the application layer controls the push screen display process of the application layer to send a display control message to the display driver module of the core layer in response to the image adjustment completion message; based on the pre-constructed association relationship between the output data address information of the image processing driver module of the core layer and the input data address information of the display driver module of the core layer, the display driver module of the core layer performs a display operation of the target image in response to the display control message.

[0014] Optionally, the image processing driver module of the kernel layer performs an image adjustment operation on the original image according to the field of view adjustment parameters to obtain a target image, including: the image processing driver module of the kernel layer performs an image compression processing operation on the original image to obtain an intermediate image; the image processing driver module of the kernel layer performs an image adjustment operation on the intermediate image according to the field of view adjustment parameters to obtain the target image.

[0015] Optionally, the image processing method further includes: a field of view adjustment process of the application layer determines a field of view adjustment parameter according to a current driving state of the vehicle and / or a current environment of the vehicle.

[0016] Optionally, the display driver module of the kernel layer performs a display operation of the target image, including: the display driver module of the kernel layer acquires at least one driving assistance image; the display driver module of the kernel layer performs an overlay display operation of the target image and the at least one driving assistance image.

[0017] According to a third aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, any one of the above-mentioned image processing methods is implemented.

[0018] According to a fourth aspect of the present disclosure, an electronic device is provided, comprising: a processor; and a memory for storing executable instructions of the processor; the processor is configured to implement any one of the above-mentioned image processing methods by executing the executable instructions.

[0019] Regarding the interaction between the application layer and the kernel layer, compared with some solutions that transmit image data multiple times, the technical solutions provided in some embodiments of the present disclosure can reduce the number of times the image data is copied and replace it with message transmission. Given that the time required for message transmission is much shorter than the time required for image data copying, the disclosed solution can reduce the image display delay of the electronic rearview mirror to a certain extent, allowing the driver to understand the situation around the vehicle in a timely manner, which helps to reduce traffic accidents.

[0020] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The accompanying drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the specification are used to explain the principles of the present disclosure. Obviously, the accompanying drawings described below are only some embodiments of the present disclosure, and for ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without creative work.

[0022] Figure 1A schematic diagram of a vehicle electronic rearview mirror system according to an embodiment of the present disclosure is shown.

[0023] Figure 2 A schematic diagram showing the architecture of an image processing device according to an embodiment of the present disclosure is shown.

[0024] Figure 3 The flowchart of the image processing method according to the embodiment of the present disclosure is schematically shown.

[0025] Figure 4 The flowchart of the image processing process of the embodiment of the present disclosure is schematically shown.

[0026] Figure 5 An interactive schematic diagram of the standard mode processing process of an embodiment of the present disclosure is shown.

[0027] Figure 6 An interactive schematic diagram of the fast mode processing process of an embodiment of the present disclosure is shown.

[0028] Figure 7 The flowchart of the image processing method according to another embodiment of the present disclosure is schematically shown.

[0029] Figure 8 A block diagram of an electronic device according to an exemplary embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION

[0030] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as being limited to the examples set forth herein; on the contrary, these embodiments are provided so that the present disclosure will be more comprehensive and complete, and the concepts of the example embodiments are fully conveyed to those skilled in the art. The described features, structures, or characteristics may be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced while omitting one or more of the specific details, or other methods, components, devices, steps, etc. may be adopted. In other cases, known technical solutions are not shown or described in detail to avoid obscuring various aspects of the present disclosure.

[0031] In addition, the accompanying drawings are only schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and / or processor devices and / or microcontroller devices.

[0032] The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the steps. For example, some steps may be decomposed, while some steps may be combined or partially combined, so the actual execution order may change according to the actual situation.

[0033] Figure 1 A schematic diagram of a vehicle electronic rearview mirror system according to an embodiment of the present disclosure is shown. Figure 1 , the vehicle electronic rearview mirror system 1 may include an image acquisition device 11, an image processing device 12 and an image display device 13. Among them, the image acquisition device 11 may refer to an image acquisition device such as a camera, and the present disclosure does not limit the number of image acquisition devices 11 configured on the vehicle. The image processing device 12 may be an electronic device that executes the image processing method of the embodiment of the present disclosure, which may be integrated with the vehicle central control system, or may be a device independently configured from other devices on the vehicle, and the present disclosure does not limit this. The image display device 13 may refer to a display device such as a display screen. Corresponding to a traditional rearview mirror, the number of the image display devices 13 may be two. However, with the rapid development of intelligent driving assistance technology, the present disclosure does not limit the specific number of image display devices 13.

[0034] The main working process of the vehicle electronic rearview mirror system 1 includes: obtaining the field of view image around the vehicle (such as the side of the vehicle body, the rear of the vehicle, etc.) through the image acquisition device 11, and the image processing device 12 adjusts the field of view image. The image processing device 12 transmits the adjusted image to the image display device 13 for display, providing the driver with real-time field of view of the side of the vehicle body, the rear of the vehicle, etc.

[0035] In addition, the vehicle electronic rearview mirror system 1 can also be combined with a driving assistance image (such as including blind spot monitoring information) provided by an ADAS (Advanced Driving Assistance System). For example, the driving assistance image and the field of view image from the image processing device 12 are superimposed and displayed on the image display device 13.

[0036] When the driver is driving the vehicle, the electronic rearview mirror system 1 usually uses a fixed video stream processing mode to display the driving environment, and currently does not optimize the video stream processing for application requirements in specific scenarios. For example, when the driver is turning or changing lanes, in this scenario, the driver often needs less video delay to ensure driving safety.

[0037] In order to at least reduce the image display delay of the vehicle electronic rearview mirror, the embodiment of the present disclosure provides a new image processing solution, which is applied to the image display process of the vehicle electronic rearview mirror. The image processing solution of the embodiment of the present disclosure can be implemented by the above-mentioned image processing device 2.

[0038] Figure 2 FIG. 1 is a schematic diagram showing the architecture of an image processing device according to an embodiment of the present disclosure. Figure 2 The image processing device 12 may include an image acquisition module 21 , an image processing module 22 and an image display module 23 .

[0039] The image acquisition module 21 can be used to acquire image data acquired by the image acquisition device 11. For example, the image data transmitted by the camera installed on the outer arm can be acquired. The image processing module 22 can be used to adjust the acquired image data. In an embodiment with mode switching, the image processing module 22 can also be used to perform mode switching operations. The image display module 23 can be used to display the image on the image display device 13.

[0040] refer to Figure 2 , the image acquisition module 21 may include an application layer image acquisition process 211 and a kernel layer camera driver module 212. Specifically, the application layer image acquisition process 211 is used to obtain image data from the kernel layer camera driver module 212. The kernel layer camera driver module 212 is used to establish communication with the camera hardware device, initialize the camera device and configure its working mode, including but not limited to parameters such as resolution, frame rate, exposure, white balance, and focus. Then, trigger and collect real-time video image data and pass it to the operating system kernel, waiting for the application layer to obtain image data through the system call interface.

[0041] The image processing module 22 may include an application layer field of view adjustment process 221 and a kernel layer image processing driver module 222. Specifically, the application layer field of view adjustment process 221 is used to determine the field of view adjustment parameters and determine whether the vehicle is in the target scene. The kernel layer image processing driver module 222 is used to trigger the execution of image adjustment operations according to the information sent by the image processing module 221, such as performing regional cropping and scaling operations on image data in different field of view modes, and in addition, it can also fuse information such as icons on the image.

[0042] The image display module 23 may include an application layer push screen display process 231 and a kernel layer display driver module 232. Specifically, the application layer push screen display process 231 may be used to perform display control on the kernel layer display driver module 232. The kernel layer display driver module 232 may be used to manage and control display hardware and provide an interface between the application and the display hardware. Its main tasks include timing control of display hardware, display mode configuration, and implementation of image synthesis, multiple layer overlay, video memory management and other functions.

[0043] Based on the above system architecture, the image processing method of the embodiment of the present disclosure is described below.

[0044] Figure 3 The flowchart of the image processing method according to the exemplary embodiment of the present disclosure is schematically shown. Figure 3 , the image processing method may include the following steps:

[0045] S30. The field of view adjustment process of the application layer sends the original image and the field of view adjustment parameters to the image processing driver module of the kernel layer.

[0046] On the one hand, the field of view adjustment process of the application layer can obtain the image captured by the camera from the camera driver module of the kernel layer. The present disclosure refers to the image fed back by the camera as the original image.

[0047] On the other hand, the field of view adjustment process of the application layer can determine the field of view adjustment parameters according to the current driving state of the vehicle and / or the current environment of the vehicle. The driving state of the vehicle includes but is not limited to driving straight ahead, reversing, changing lanes, whether the turn signal is turned on, whether the steering wheel angle is greater than the angle threshold, and whether the vehicle speed is greater than the vehicle speed threshold. The environment of the vehicle includes but is not limited to the density of vehicles and pedestrians around the vehicle.

[0048] For example, the field of view required for the forward straight driving state is smaller than the field of view required for the reverse state, such as the field of view required for the forward straight driving state is 900×600, while the field of view required for the reverse state is 1280×720. For another example, when the density of vehicles and pedestrians around the vehicle is large, the required field of view is larger. The required field of view is reflected in the field of view adjustment parameters.

[0049] S32. The image processing driving module of the kernel layer performs an image adjustment operation on the original image according to the field of view adjustment parameters to obtain a target image.

[0050] The image processing driving module of the kernel layer can drive the corresponding image processing unit to adjust the original image according to the field of view adjustment parameter, and the adjusted image is recorded as the target image.

[0051] S34. When the vehicle is in the target scene, the image processing driver module of the kernel layer feeds back an image adjustment completion message to the field of view adjustment process of the application layer.

[0052] In an exemplary embodiment of the present disclosure, the target scene may be a scene that requires a larger field of view than a normal straight-line driving of the vehicle at a certain speed. The normal straight-line driving of the vehicle in the embodiment of the present disclosure includes the vehicle moving forward and the speed being less than a speed threshold (e.g., 60 kilometers per hour).

[0053] According to some embodiments of the present disclosure, at least one field of view requirement index may be screened from the driving state of the vehicle and / or the environment in which the vehicle is located, and the target scene may be constructed using these field of view requirement indexes.

[0054] For example, any one of the following events, namely, the vehicle's turn signal is on, the steering wheel angle is greater than an angle threshold, the vehicle speed is greater than a speed threshold, the density of vehicles and / or pedestrians around the vehicle is greater than a density threshold, reversing, and changing lanes, or a combination of multiple events, can be used as a field of view requirement indicator. The target scene can be understood as a collection of these field of view requirement indicators.

[0055] It is understandable that whether the vehicle is in the target scene is determined by the application layer, and the determination result is sent to the image processing driver module of the kernel layer.

[0056] Specifically, in the case where the field of view requirement index corresponds to the driving state of the vehicle, the application layer can determine the current driving state of the vehicle and compare the current driving state of the vehicle with the field of view requirement index. If the current driving state of the vehicle meets the field of view requirement index, it is determined that the vehicle is in the target scene. In addition, in the case where the field of view requirement index corresponds to the environment in which the vehicle is located, the application layer can determine the current environment in which the vehicle is located and compare the current environment in which the vehicle is located with the field of view requirement index. If the current environment in which the vehicle is located meets the field of view requirement index, it is determined that the vehicle is in the target scene.

[0057] When the vehicle is in the target scene, the image processing driver module of the kernel layer can feed back an image adjustment completion message to the field of view adjustment process of the application layer.

[0058] In some other embodiments of the present disclosure, when the application layer determines that the vehicle is in a target scene, in order to further improve the image processing speed of such scenes and reduce the image display delay, the process of generating the target image in step S32 may include: first, the image processing driver module of the kernel layer may perform an image compression processing operation on the original image to obtain an intermediate image. Next, the image processing driver module of the kernel layer may perform an image adjustment operation on the intermediate image according to the field of view adjustment parameter to obtain the target image.

[0059] S36. The field of view adjustment process of the application layer responds to the image adjustment completion message to control the push screen display process of the application layer to send a display control message to the display driver module of the kernel layer.

[0060] S38. Based on the association between the output data address information of the pre-built image processing driver module of the kernel layer and the input data address information of the display driver module of the kernel layer, the display driver module of the kernel layer responds to the display control message to perform a display operation of the target image.

[0061] In an exemplary embodiment of the present disclosure, for the kernel layer, the association relationship between the output data address information of the image processing driver module and the input data address information of the display driver module is pre-constructed. In other words, the display driver module can directly obtain the target image after the above processing. In this case, the display driver module of the kernel layer can respond to the display control message to perform the display operation of the target image, so that the vehicle driver can view the target image on the image display device (such as the in-vehicle display screen).

[0062] According to some embodiments of the present disclosure, the display driver module of the kernel layer may also obtain at least one driving assistance image, such as blind spot monitoring information. In this case, the display driver module of the kernel layer may perform the overlay display operation of the above-mentioned target image and at least one driving assistance image.

[0063] In addition, corresponding to the above step S34, when the vehicle is not in the target scene, the image processing driver module of the kernel layer can send the target image to the field of view adjustment process of the application layer. Next, the field of view adjustment process of the application layer sends the target image to the push screen display process of the application layer. Then, the push screen display process of the application layer can send the target image to the display driver module of the kernel layer, and the display driver module of the kernel layer performs the display operation of the target image. Among them, the display operation can also superimpose other information such as driving assistance images.

[0064] Reference below Figure 4 The image processing process of the embodiment of the present disclosure is described.

[0065] In step S402, the kernel layer camera driver module collects image data and stores it in a buffer.

[0066] Specifically, after the vehicle electronic rearview mirror system of the embodiment of the present disclosure is started, the driver module of the kernel layer, including the camera driver module and the display driver module, can be loaded to complete the initialization configuration of the underlying hardware modules of the system. In this process, the camera driver module of the kernel layer can parse the image data sent back by the camera and store it in a buffer to wait for the application layer to use it.

[0067] In step S404, the application layer image acquisition process captures the image data buffered by the kernel layer.

[0068] Specifically, the application layer image acquisition process obtains image data through the system call interface provided by the kernel layer module. Multiple modules in the electronic rearview mirror system will use the original image data. For example, the codec module will compress the original image data with H265, and the functional safety module will use the original image data for jamming monitoring. Therefore, it is necessary to import the kernel layer image data into the application layer for the smooth implementation of the entire solution.

[0069] In step S406, it is determined whether to switch to the fast mode. The fast mode represents the situation where the vehicle is in the target scene. In this case, the image display speed is fast and the delay is small because the image data transmission process is reduced. The standard mode corresponds to the fast mode. The image data transmission times in the standard mode are relatively large and there may be delays, but the mode is highly compatible with other functions of the vehicle.

[0070] Specifically, the process of determining whether to switch to the fast mode is the same as the above-mentioned process of determining whether the vehicle is in the target scene, which will not be repeated here.

[0071] If it is not necessary to switch to the fast mode, then execute step S408. If it is necessary to switch to the fast mode, then execute step S410.

[0072] In step S408, video stream data processing in the standard mode is performed.

[0073] In step S410, video stream data processing in a fast mode is performed.

[0074] In step S412, the kernel layer display driver module refreshes the image data in the video memory and displays it on the screen.

[0075] Regarding the specific processing of the above steps S408 and S410, the video display clarity is high and the picture detail restoration is high in the standard mode, but due to the multiple image data copies between the application layer and the kernel layer and between the application layer in this mode, the video delay is higher than that in the fast mode, and the system resource occupancy rate is also relatively high. The fast mode simplifies the direction of the video stream and reduces the copy operations between multiple large blocks of memory, thereby reducing the video display delay. At the same time, the original image data is compressed in advance in the video processing, and then the hardware module performs the cropping and scaling operations, which can reduce the time consumption in the image processing, thereby further compressing the video display delay.

[0076] Reference below Figure 5 and Figure 6 The standard mode and the fast mode of the embodiments of the present disclosure are described respectively.

[0077] Figure 5 An interactive schematic diagram of the standard mode processing process of an embodiment of the present disclosure is shown.

[0078] In step S502, the image acquisition process of the application layer acquires raw image data from the camera driver module of the kernel layer.

[0079] In step S504, the field of view adjustment process of the application layer obtains address information of the original image data from the image acquisition process.

[0080] In step S506, the field of view adjustment process of the application layer determines the field of view adjustment parameters according to the current driving state of the vehicle and / or the current environment of the vehicle, and sends the original image data and the field of view adjustment parameters to the image processing driver module of the kernel layer for processing. This process involves a large block of memory data copy process from the application layer to the kernel layer.

[0081] In step S508, the image processing driver module of the kernel layer processes the original image data as required through the chip internal hardware module to obtain the target image data. Then, the target image row data is returned to the field of view adjustment process of the application layer. This process involves a large block memory data copy process from the kernel layer to the application layer.

[0082] In step S510, the field of view adjustment process of the application layer sends the target image data to the push screen display process. This process involves a large block memory data copy process between application layers.

[0083] In step S512, the push screen display process of the application layer sends the target image data to the display driver module of the kernel layer for image display. This process involves a large block memory data copy process from the application layer to the kernel layer.

[0084] It can be seen that the video stream processing process in standard mode involves one large memory copy between the application layer and three data copies between the application layer and the kernel layer. These multiple copies of large amounts of data will increase video latency to a certain extent.

[0085] Figure 6 An interactive schematic diagram of the fast mode processing process of an embodiment of the present disclosure is shown.

[0086] Step S602 and step S604 are the same as the above-mentioned step S502 and step S504, and are not described in detail.

[0087] In step S606, the field of view adjustment process of the application layer can send the original image data and the field of view adjustment parameters to the image processing driver module of the kernel layer for processing. In addition, the field of view adjustment process of the application layer can also send a message that the current fast mode is in progress to the image processing driver module of the kernel layer, so that the image processing driver module of the kernel layer can perform the processing in the fast mode. It can be seen that this process involves a large block of memory data copy process from the application layer to the kernel layer.

[0088] In step S608, the image processing driver module of the kernel layer processes the original image data according to the requirements through the hardware module inside the chip to obtain the target image data. Then, the image processing driver module of the kernel layer feeds back the image adjustment completion message to the field of view adjustment process of the application layer. This process feeds back a message, which does not involve the copy process of large blocks of memory data, but only the transmission of messages.

[0089] In step S610, the field of view adjustment process of the application layer sends an image adjustment completion message to the push screen display process of the application layer. There is no data copy process in this process, only message transmission.

[0090] In step S612, the push screen display process of the application layer responds to the image adjustment completion message and sends a display control message to the display driver module of the kernel layer. There is no data copy process in this process, only message transmission.

[0091] In step S614, based on the association between the output data address information of the image processing driver module of the pre-built kernel layer and the input data address information of the display driver module of the kernel layer, the display driver module of the kernel layer responds to the display control message to perform the display operation of the target image. This process also does not involve large-block data memory copying.

[0092] It can be seen that in fast mode, there is only one large memory copy process from the application layer to the kernel layer, and the rest of the process is message passing, and the time consumption of message passing can be ignored. At the same time, the image processing driver will compress the image processing time in fast mode. Although the image quality is degraded, compared with the video stream processing in standard mode, large memory copies are greatly reduced, which reduces video latency.

[0093] In the above-mentioned embodiments of the present disclosure, a switching operation between the standard mode and the fast mode is performed according to a judgment result of whether the vehicle is in a target scene, so as to realize an image display process of the vehicle electronic rearview mirror.

[0094] In addition, the present disclosure also provides a solution to directly reduce image display delay. Figure 7 Provide explanation.

[0095] Figure 7FIG. 1 schematically shows a flowchart of an image processing method according to another exemplary embodiment of the present disclosure. Figure 7 , the image processing method may include the following steps:

[0096] S70. The field of view adjustment process of the application layer sends the original image and the field of view adjustment parameters to the image processing driver module of the kernel layer;

[0097] S72. The image processing driver module of the kernel layer performs an image adjustment operation on the original image according to the field of view adjustment parameter to obtain a target image;

[0098] S74. The image processing driver module of the kernel layer feeds back the image adjustment completion message to the field of view adjustment process of the application layer;

[0099] S76. The field of view adjustment process of the application layer responds to the image adjustment completion message to control the push screen display process of the application layer to send a display control message to the display driver module of the kernel layer;

[0100] S78. Based on the association between the output data address information of the pre-built image processing driver module of the kernel layer and the input data address information of the display driver module of the kernel layer, the display driver module of the kernel layer responds to the display control message to perform a display operation of the target image.

[0101] Compared with the above steps S30 to S38, the difference between steps S70 to S78 is that in step S74, there is no need to perform the judgment process of whether the vehicle is in the target scene, and the image processing driver module of the kernel layer directly feeds back the image adjustment completion message to the field of view adjustment process of the application layer. The rest of the content is consistent with steps S30 to S38, and the details are described above, which will not be repeated.

[0102] According to an exemplary embodiment of the present disclosure, the image processing driver module of the kernel layer performs an image adjustment operation on the original image according to the field of view adjustment parameters to obtain a target image, including: the image processing driver module of the kernel layer performs an image compression processing operation on the original image to obtain an intermediate image; the image processing driver module of the kernel layer performs an image adjustment operation on the intermediate image according to the field of view adjustment parameters to obtain the target image.

[0103] According to an exemplary embodiment of the present disclosure, the image processing method further includes: a field of view adjustment process of the application layer determines a field of view adjustment parameter according to a current driving state of the vehicle and / or a current environment of the vehicle.

[0104] According to an exemplary embodiment of the present disclosure, the display driver module of the core layer executes the display operation of the target image, including: the display driver module of the core layer acquires at least one driving assistance image; the display driver module of the core layer executes the overlay display operation of the target image and at least one driving assistance image.

[0105] It should be noted that although the steps of the method in the present disclosure are described in a specific order in the drawings, this does not require or imply that the steps must be performed in this specific order, or that all the steps shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps, etc.

[0106] In an exemplary embodiment of the present disclosure, a computer-readable storage medium is also provided, on which a program product capable of implementing the above method of the present specification is stored. In some possible implementations, various aspects of the present disclosure may also be implemented in the form of a program product, which includes a program code, and when the program product is run on a terminal device, the program code is used to enable the terminal device to execute the steps according to various exemplary implementations of the present disclosure described in the above "Exemplary Method" section of the present specification.

[0107] The program product for implementing the above method according to the embodiment of the present disclosure can adopt a portable compact disk read-only memory (CD-ROM) and include program code, and can be run on a terminal device, such as a personal computer. However, the program product of the present disclosure is not limited thereto, and in this document, a readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, an apparatus or a device.

[0108] The program product may use any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical disk, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0109] Computer readable signal media may include data signals propagated in baseband or as part of a carrier wave, in which readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Readable signal media may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0110] The program code embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing.

[0111] Program code for performing the operations of the present disclosure may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., through the Internet using an Internet service provider).

[0112] In an exemplary embodiment of the present disclosure, an electronic device capable of implementing the above method is also provided.

[0113] Those skilled in the art will appreciate that various aspects of the present disclosure may be implemented as systems, methods or program products. Therefore, various aspects of the present disclosure may be specifically implemented in the following forms, namely: complete hardware implementation, complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software, which may be collectively referred to herein as "circuits", "modules" or "systems".

[0114] Refer to the following Figure 8 The electronic device 800 according to this embodiment of the present disclosure is described. Figure 8 The electronic device 800 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure. The image processing device in the above embodiments of the present disclosure can be configured in the form of the electronic device 800 described below.

[0115] like Figure 8 As shown, the electronic device 800 is in the form of a general computing device. The components of the electronic device 800 may include, but are not limited to: the at least one processing unit 810, the at least one storage unit 820, a bus 830 connecting different system components (including the storage unit 820 and the processing unit 810), and a display unit 840.

[0116] The storage unit stores program codes, which can be executed by the processing unit 810, so that the processing unit 810 performs the steps according to various exemplary embodiments of the present disclosure described in the above “Exemplary Method” section of this specification. For example, the processing unit 810 can perform various steps of the image processing method of the embodiment of the present disclosure.

[0117] The storage unit 820 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 8201 and / or a cache memory unit 8202 , and may further include a read-only memory unit (ROM) 8203 .

[0118] The storage unit 820 may also include a program / utility 8204 having a set (at least one) of program modules 8205, such program modules 8205 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.

[0119] Bus 830 may represent one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

[0120] The electronic device 800 may also communicate with one or more external devices 900 (e.g., keyboards, pointing devices, Bluetooth devices, etc.), may also communicate with one or more devices that enable a user to interact with the electronic device 800, and / or communicate with any device that enables the electronic device 800 to communicate with one or more other computing devices (e.g., routers, modems, etc.). Such communication may be performed via an input / output (I / O) interface 850. Furthermore, the electronic device 800 may also communicate with one or more networks (e.g., local area networks (LANs), wide area networks (WANs), and / or public networks, such as the Internet) via a network adapter 860. As shown, the network adapter 860 communicates with other modules of the electronic device 800 via a bus 830. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device 800, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, etc.

[0121] Through the description of the above implementation, it is easy for those skilled in the art to understand that the example implementation described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the implementation of the present disclosure.

[0122] In addition, the above-mentioned figures are only schematic illustrations of the processes included in the method according to the exemplary embodiments of the present disclosure, and are not intended to be limiting. It is easy to understand that the processes shown in the above-mentioned figures do not indicate or limit the time sequence of these processes. In addition, it is also easy to understand that these processes can be performed synchronously or asynchronously, for example, in multiple modules.

[0123] It should be noted that, although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into multiple modules or units to be embodied.

[0124] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing what is disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure. The specification and embodiments are to be considered merely as exemplary, and the true scope and spirit of the present disclosure are indicated by the claims.

[0125] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. An image processing method, It is characterized in that The image display process applied to the vehicle electronic rearview mirror comprises: The field of view adjustment process of the application layer sends the original image and field of view adjustment parameters to the image processing driver module of the kernel layer; The image processing driving module of the kernel layer performs an image adjustment operation on the original image according to the field of view adjustment parameter to obtain a target image; When the vehicle is in the target scene, the image processing driver module of the kernel layer feeds back an image adjustment completion message to the field of view adjustment process of the application layer; The field of view adjustment process of the application layer controls the push screen display process of the application layer to send a display control message to the display driver module of the kernel layer in response to the image adjustment completion message; Based on the pre-constructed association between the output data address information of the image processing driver module of the kernel layer and the input data address information of the display driver module of the kernel layer, the display driver module of the kernel layer responds to the display control message to perform the display operation of the target image.

2. The image processing method according to claim 1, It is characterized in that When the vehicle is in the target scene, the image processing driving module of the kernel layer performs an image adjustment operation on the original image according to the field of view adjustment parameter to obtain a target image, including: The image processing driving module of the kernel layer performs an image compression processing operation on the original image to obtain an intermediate image; The image processing driving module of the kernel layer performs an image adjustment operation on the intermediate image according to the field of view adjustment parameter to obtain the target image.

3. The image processing method according to claim 1, It is characterized in that The image processing method further comprises: The field of view adjustment process of the application layer determines the field of view adjustment parameters according to the current driving state of the vehicle or the current environment of the vehicle.

4. The image processing method according to claim 1, It is characterized in that The image processing method further comprises: At least one field of view requirement indicator is selected from the driving state of the vehicle or the environment in which the vehicle is located, and the target scene is constructed using the at least one field of view requirement indicator.

5. The image processing method according to claim 4, It is characterized in that The image processing method further comprises: In the case where the field of view requirement indicator corresponds to the driving state of the vehicle, the application layer determines the current driving state of the vehicle and compares the current driving state of the vehicle with the field of view requirement indicator, and if the current driving state of the vehicle meets the field of view requirement indicator, it is determined that the vehicle is in the target scene; or In the case where the field of vision requirement index corresponds to the environment in which the vehicle is located, the application layer determines the current environment in which the vehicle is located, and compares the current environment in which the vehicle is located with the field of vision requirement index. If the current environment in which the vehicle is located meets the field of vision requirement index, it is determined that the vehicle is in the target scene.

6. The image processing method according to any one of claims 1 to 5, It is characterized in that The image processing method further comprises: When the vehicle is not in the target scene, the image processing driver module of the kernel layer sends the target image to the field of view adjustment process of the application layer; The field of view adjustment process of the application layer sends the target image to the push screen display process of the application layer; The push screen display process of the application layer sends the target image to the display driver module of the kernel layer; The display driver module of the kernel layer performs a display operation of the target image.

7. The image processing method according to claim 1, It is characterized in that The display driver module of the kernel layer performs the display operation of the target image, including: The display driver module of the core layer acquires at least one driving assistance image; The display driving module of the kernel layer performs an overlay display operation of the target image and the at least one driving assistance image.

8. An image processing method, It is characterized in that The image display process applied to the vehicle electronic rearview mirror comprises: The field of view adjustment process of the application layer sends the original image and field of view adjustment parameters to the image processing driver module of the kernel layer; The image processing driving module of the kernel layer performs an image adjustment operation on the original image according to the field of view adjustment parameter to obtain a target image; The image processing driver module of the kernel layer feeds back an image adjustment completion message to the field of view adjustment process of the application layer; The field of view adjustment process of the application layer controls the push screen display process of the application layer to send a display control message to the display driver module of the kernel layer in response to the image adjustment completion message; Based on the pre-constructed association between the output data address information of the image processing driver module of the kernel layer and the input data address information of the display driver module of the kernel layer, the display driver module of the kernel layer responds to the display control message to perform the display operation of the target image.

9. The image processing method according to claim 8, It is characterized in that The image processing driving module of the kernel layer performs an image adjustment operation on the original image according to the field of view adjustment parameter to obtain a target image, including: The image processing driving module of the kernel layer performs an image compression processing operation on the original image to obtain an intermediate image; The image processing driving module of the kernel layer performs an image adjustment operation on the intermediate image according to the field of view adjustment parameter to obtain the target image.

10. A computer-readable storage medium having a computer program stored thereon, It is characterized in that When the computer program is executed by a processor, the image processing method according to any one of claims 1 to 9 is implemented.

11. An electronic device, It is characterized in that include: processor; as well as A memory, configured to store executable instructions of the processor; The processor is configured to implement the image processing method according to any one of claims 1 to 9 by executing the executable instructions.

Images