Device and method for image processing of a rear view camera
Patent Information
- Application Number
- DE112021006264
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-06-03
- Filing Date
- 2021-11-22
- Publication Date
- 2025-07-17
- Estimated Expiration
- 2041-11-22
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[TECHNICAL FIELD]
[0001] The present disclosure relates to an apparatus and method for image processing of a rear view camera, and more particularly to technology for a system and an image processing method for safely correcting distortion of an image captured by a rear view camera by applying a safety mechanism to a distortion correction function to assist a function of a vehicle safety rear view camera (S-RVC). BACKGROUND
[0002] A rear view camera (RVC) displays an image of the surroundings of a vehicle at the rear of the vehicle to assist the driver in safely reversing or parking the vehicle. Due to its importance, a safety mechanism should be applied, especially to components that process images captured by the rear view camera. The safety mechanism is defined in ISO 26262, an automotive functional safety standard. The safety mechanism should operate normally after a unit test and an integrated test of vehicle software or a hardware test.
[0003] The security mechanism applied to the rear-view camera is also known as data effectiveness confirmation. Additionally, a security mechanism function should be applied to the components that process the image captured by the rear-view camera.
[0004] DE 10 2012 223 373 A1 discloses a device and a method for correcting image distortion of a rear-view camera. The device comprises analyzing, by a processor, a characteristic of an imaging device installed in a rear of a vehicle. Furthermore, setting, by the processor, a plurality of inclination angles for a plurality of recorded areas by a virtual imaging device corresponding to the imaging device at the rear from a characteristic value of the imaging device. The processor generates a correction model by applying the plurality of inclination angles for the plurality of recorded areas by the virtual imaging device. The processor is configured to incline the virtual imaging device based on the correction model.The apparatus further comprises performing, by the processor, a view conversion on an image captured by the rear imaging device in accordance with the plurality of set tilt angles for the plurality of captured areas from the virtual imaging device to generate a corrected image.
[0005] Currently, the rear view camera's security mechanism is applied to an image signal processor (ISP), an equalizer, an S-RVC, and an open low-voltage differential signaling display interface (LDI). However, the security mechanism is not applied to a main bus that transmits and receives an image or signal, and a DRAM (dynamic random access memory) that stores the image captured by the rear view camera.
[0006] To implement the security mechanism, an end-to-end error correction code function is typically added to the main bus. In this case, the security mechanism should be applied to all other direct memory access (DMA) devices or subsystems connected to the main bus. Therefore, one difficulty is that functions for applying the security mechanism should be deployed on a chip that processes the image captured by the rearview camera.
[0007] Furthermore, in the case of DRAM, data effectiveness should be assessed by providing an error correction code (ECC) bit after data reading / writing. However, since it is difficult to apply the security mechanism to the main bus, adding this function only to DRAM cannot achieve a significant impact on data effectiveness assessment.
[0008] Therefore, the effectiveness of the DRAM data used in the rearview camera cannot be guaranteed if a problem occurs in the main bus or any other component. Consequently, a problem arises in which the safety mechanism function is not fulfilled for all signal paths.
[0009] A method for converting image memory to be used by the rearview camera is also being investigated due to such a problem. However, since the capacity of an SRAM should be approximately 12 MB to store an image with a resolution of 2048 x 1440 captured by the rearview camera, a problem arises in that the chip size increases. [REVELATION][TECHNICAL PROBLEM]
[0010] The present disclosure seeks to provide an apparatus and method for image processing of a rearview camera capable of providing a driver with an image captured by a rearview camera via a safety mechanism even when a problem occurs on a main processing path of the image captured by the rearview camera by applying the safety mechanism to a dewarping function. [TECHNICAL SOLUTION]
[0011] To achieve a technical object of the present disclosure, an exemplary embodiment of the present invention provides an apparatus for image processing of a rear view camera, comprising: an image signal processor that generates an original rear view image captured by a rear view camera to generate a rear view image; a first processing unit that corrects a distortion phenomenon of the rear view image to create a distortion-corrected image and produces it as an output image displayable by a display device;and a second processing unit that reduces a resolution of the reversing image to generate a reduced reversing image and temporarily stores the reduced reversing image. Upon receiving an operation control signal, the second processing unit corrects the distortion phenomenon of the temporarily stored reduced reversing image, then restores the resolution to the resolution of the reversing image, and generates an output reversing image. and an image supplement processing unit that supplies the output image generated by the first processing unit to the display device, judges the effectiveness of the output image based on an adjustment signal transmitted from the outside after a first operation, and generates the operation control signal so that the second processing unit operates when the output image is not effective.
[0012] The first processing unit may include a non-safety area rectifier that corrects the distortion phenomenon of the rear view image and creates the distortion-corrected image, a memory for storing the distortion-corrected image, and a display controller that receives the distortion-corrected image stored in the memory and converts the received distortion-corrected image into the output image displayable via the display device.
[0013] The first processing unit may further comprise an open LDI that receives each image, the output image or the output return image, from the image supplement processing unit and supplies the received image to the display device.
[0014] The display controller may transmit the output image to either the image augmentation processing unit or the open LDI based on gear setting information received from the outside.
[0015] The second processing unit may include a first resolution control unit that receives a reversing image and reduces the resolution of the reversing image and generates the reversing image as the reduced reversing image, an internal memory that temporarily stores the reduced reversing image, a safety area equalizer that receives the reduced reversing image temporarily stored in the internal memory and corrects the distortion phenomenon and generates the reduced correction image when receiving the operation control signal, and a second resolution control unit that restores the resolution of the reduced correction image to the resolution of the reversing image and generates the reversing image as the output reversing image.
[0016] The image supplement processing unit may receive the output image and image information from the first processing unit, and compare the adjustment signal and the image information to evaluate the effectiveness of the output image.
[0017] The adjustment signal may include an operation clock and a horizontal synchronization signal and a vertical synchronization signal of an image, and the image information may include horizontal synchronization information and vertical synchronization information of the output image.
[0018] To achieve a technical object of the present disclosure, another exemplary embodiment of the present disclosure provides a rear view camera image processing method for processing an original rear view image acquired by a rear view camera by means of a rear view camera image processing device operated by at least one processor, the method comprising: processing the original rear view image through both a first path and a second path when the rear view camera acquires the original rear view image; supplying an output image acquired through the first path to a display device, and temporarily storing a reduced correction image created through the second path; judging the effectiveness of the output image created through the first path; creating the temporarily stored reduced correction image as a rear view output image when the output image is not effective;and supplying the rear view output image to a display device.;
[0019] The rear view camera image processing method may further comprise, before processing by both the first path and the second path, converting to an operational state when a setting signal is inputted from the outside, and the setting signal may comprise an operation clock, and a horizontal synchronization signal and a vertical synchronization signal of an image.
[0020] The processing by both the first path and the second path may include, via a first path, signal-image processing the original rear view image to create a rear view image, correcting a distortion phenomenon of the rear view image and creating the rear view image as a distortion-corrected image, and storing the distortion-corrected image in a memory, and creating the stored distortion-corrected image as the output image displayable via the display device.
[0021] Processing through both the first path and the second path may include, via the second path, reducing a resolution of the rear view image and creating the reduced rear view image via the second path.
[0022] Creating as the reversing output image may include correcting the distortion phenomenon of the reduced reversing image and creating the reversing image as the reduced correction image when an operation control signal is input, and restoring the resolution of the reduced correction image to the resolution of the reversing image, and creating the reversing image as the reversing output image. [BENEFICIAL EFFECTS]
[0023] According to the exemplary embodiments of the present disclosure, a rear view camera image in a safety area can be processed even if components installed in a non-safety area cause interference, so that image distortion of the rear view camera is safely corrected and provided to a driver.
[0024] Furthermore, a resolution of an image is controlled and provided, so that it is possible to provide the security area with memory for a dewarping function without affecting the overall chip size. [DESCRIPTION OF THE CHARACTERS] Fig. 1 and Fig. 2 are exemplary illustrations of the standard provision of an image captured by a rear view camera. Fig. 3 is a structural diagram of a rear view camera image processing apparatus according to an exemplary embodiment of the present disclosure. Fig. 4 is a flowchart for a rearview camera image processing method according to an exemplary embodiment of the present disclosure. Fig. 5 is an exemplary illustration of a rearview camera image in which distortion has been corrected, provided in accordance with an exemplary embodiment of the present disclosure. [FORM OF THE INVENTION]
[0025] In the following detailed description, only certain exemplary embodiments of the present disclosure are shown and described, by way of illustration only. As one skilled in the art would understand, the described embodiments may be modified in various different ways without departing from the spirit and scope of the present disclosure. Accordingly, the figures and description are to be considered illustrative in nature and not restrictive. Like reference characters refer to like elements throughout the description.
[0026] Throughout this description, the terms “comprise” and variations such as “comprises” or “comprising” are to be understood as including the designated elements, but not as excluding other elements, unless explicitly described to the contrary.
[0027] Below, an apparatus and a method for rear view camera image distortion correction according to exemplary embodiments of the present disclosure will be described with reference to the figures. Before describing an exemplary embodiment of the present disclosure, Fig. 1 and Fig. 2 first describes an example of providing an image captured by a standard rear view camera.
[0028] The Fig. 1 and Fig. 2 are exemplary illustrations of the standard provision of an image captured by a rear view camera.
[0029] In Fig. 1 illustrates a processing path of an image captured by a rearview camera 50 of a vehicle in a standard situation. In this case, an image processing device 10 includes an ISP 21, an equalizer 22, an S-RVC 23, an open LDI 24, and a display controller 31 connected via a bus 25. Additionally, the image processing device 10 is connectable to a DRAM 40 via the main bus 32.
[0030] The ISP 21 performs a function of processing and processing the image captured by the rearview camera 50. That is, the ISP 21 receives images acquired by image sensors (CCD (charge-coupled device) and CIS (compact image sensor)) of the rearview camera 50, basically processes illumination and color, and also additionally performs functions such as focus, inversion, mosaic, CMOS (complementary metal-oxide semiconductor) image sensor, image format, etc. The function of the ISP 21 is already known, and in an exemplary embodiment, a detailed description is omitted.
[0031] The equalizer 22 corrects a distortion phenomenon of the image processed by the ISP 21. Preset values of the distortion correction parameters are necessary for the equalizer 22 to correct the distortion phenomenon of the image, and the preset values can be calculated by the ISP 21. In this case, the equalizer 22 requests the image stored in the DRAM 40 several times to correct the distortion phenomenon. The distortion phenomenon correction function by the equalizer 22 is already known, and in an exemplary embodiment, the detailed description is omitted.
[0032] The S-RVC 23 basically receives an image signal transmitted by a display controller 31 and performs image supplementation processing, such as drawing a parking line on the received image signal or adding a warning message to the image signal. Here, the image signal is an image signal converted by the display controller 31, so that the image whose distortion phenomenon is corrected is received by an open LDI 24 and displayed on a display device 50.
[0033] When an error occurs in the display controller 31, the S-RVC 23 receives the image whose distortion phenomenon is corrected by the equalizer 22, performs image completion processing, and transmits the image to the open LDI 24.
[0034] The open LDI 24, as a universal digital video interface standard for high-speed data transmission, increases bit rate, reduces power consumption, and provides improved noise control performance. The image subjected to image completion processing or the image whose distortion phenomenon is corrected is transmitted to the display device 50 under the control of the open LDI 24. Here, the function of the open LDI 24 is already known, and in an exemplary embodiment, the detailed description is omitted.
[0035] Here, an area including the components is referred to as the security area 20 because the security mechanism is applied to the ISP 21, the equalizer 22, the S-RVC 23, and the open LDI 24. In addition, an area including two components is referred to as the non-security area 30 because the security mechanism is not applied to the display controller 31 and the main bus 32.
[0036] As in Fig. 1, in the general case, the image captured by the rear view camera 50 is stored in the DRAM via the ISP 21, the equalizer 22, and the main bus 32. In this case, if a problem occurs in the display controller 31, the main bus 32, or the DRAM 40 included in the non-security area 30, a path in which the image is transmitted is changed in a different way compared to a path in which the image is transmitted in the general situation as in Fig. 2 shown.
[0037] As shown in the direction of the arrows (⑤, ⑥), image data supplied from the rear view camera 50 is image-processed and converted to a YUV format via the ISP 21. The image data of the converted YUV format is supplied to the equalizer 22, and the distortion of the image data is corrected.
[0038] In this case, the DRAM 40, located outside the image processing device 10, stores all the image data processed by the ISP 21 (5). The equalizer 22 corrects the image distortion using the image data stored in the DRAM 40. The S-RVC 23 performs image completion processing for the distortion-corrected image, and the display device 60 outputs the image via the open LDI 24.
[0039] In this case, if a problem occurs in the DRAM 40 or the main bus 32, the equalizer 22 cannot retrieve the image stored in the DRAM 40, so that the image captured by the rear view camera 50 cannot be displayed via the display device 60.
[0040] Therefore, an exemplary embodiment of the present disclosure proposes technology in which the display device safely displays the image captured by the rear view camera 50 and provides the displayed image to the driver even though the failure occurs in the components arranged in the non-safety area.
[0041] Fig. 3 is a structural diagram of a rear view camera processing apparatus according to an exemplary embodiment of the present disclosure.
[0042] As in Fig. 3, the rear view camera processing device that processes the image captured by the rear view camera 150 is implemented by components divided into a safety mechanism reflection area (hereinafter referred to as a “safety area” or “first processing unit” for better understanding and simplification of description) 110 and a safety mechanism non-reflection area (hereinafter referred to as a “non-safety area” or “second processing unit” for better understanding and simplification of description) 120, and processes collected images of the rear view camera.
[0043] An IPS 111, a security area equalizer 112, a first resolution control unit 113, an internal SRAM 114, a second resolution control unit 115, an image supplement processing unit 116, and an open LDI 118 are arranged in the security area 110. Meanwhile, a non-security area equalizer 119, the main bus 130, and the DRAM 140 are implemented in the non-security area 120.
[0044] The rearview camera image processing device 100 also interfaces with the rearview camera 150 and the display device 160. The rearview camera image processing device 100 is implemented as a chip, and in an exemplary embodiment of the present disclosure, the rearview camera image processing device 100 is not limited to any of the implemented chip forms.
[0045] A rear view image captured by the rear view camera 150 is simultaneously processed by two paths in the rear view camera image processing device 100. However, the image processed in any one of the two paths is displayed via the display device 160.
[0046] Here, two paths can be defined: a normal path (⑦) and an emergency path (⑧). The normal path is a path that processes the reversing image through components located in the non-safety area and some components located in the safety area. The emergency path is a path that processes the reversing image only through components located in the safety area due to malfunctions of components located in the non-safety area.
[0047] First, for better understanding and to simplify the description, we will first describe a component when the image is delivered via the normal path, and then describe the component when the image is delivered via the emergency path. However, the image is actually delivered via both the normal path and the emergency path simultaneously.
[0048] When the ISP 111 receives the original rearview image captured by the image sensors (CCD and CIS) of the rearview camera 150, the ISP 111 performs general image processing functions such as illumination, color, focus, inversion, etc. of the rearview image to generate the rearview images. The operation of the ISP 111 is already known, and in an exemplary embodiment, the detailed description is omitted.
[0049] The rear view image acquired by the ISP 111 is supplied to the non-safety area equalizer 119. The non-safety area equalizer 119 corrects the distortion phenomenon of the rear view image processed by the ISP 111 to generate the distortion-corrected image. Specified values of the distortion-corrected parameters are required for the non-safety area equalizer 119 to correct the distortion phenomenon in the image, and the specified values can be calculated by the ISP 111. Since this is already known technology, detailed description in an exemplary embodiment will be omitted.
[0050] The distortion-corrected image by the non-safety-area equalizer 119 is stored in the DRAM 140 via the main bus 130. In an exemplary embodiment, it is described that the distortion phenomenon is corrected once by the non-safety-area equalizer 119, and the distortion-corrected image is stored in the DRAM 140. However, the distortion-corrected image stored in the DRAM 140 is read out by the non-safety-area equalizer, which can also repeatedly correct the distortion phenomenon.
[0051] The display controller 117 reads the distortion-corrected image stored in the DRAM 140 and converts the distortion-corrected image into a form that can be processed by the open LDI 118, and generates the converted form as an output image. In addition, the display controller 117 generates image information including the output image and vertical / horizontal synchronization information for the output image. A method in which the display controller 117 processes the distortion-corrected image and generates the processed distortion-corrected image as the output image, and a method in which the display controller 117 obtains the vertical and horizontal synchronization information for the output image are already known technology, and in an exemplary embodiment of the present disclosure, a detailed description is omitted.
[0052] The display controller 117 provides the image information to the image supplement processing unit 116 or the open LDI 118 based on vehicle state information transmitted from a main processor (not shown) of the vehicle. Here, the vehicle state information includes information indicating whether the vehicle is currently being driven or state information about a gear the driver is shifting to for parking. Since a method in which the display controller 117 acquires the vehicle state information can be performed in various ways, the method is not limited to any one method in an exemplary embodiment of the present disclosure.
[0053] If the vehicle state information indicates a driving state, the display controller 117 provides the image information to the open LDI 118. However, if the vehicle state information indicates a state in which the gear is changed to attempt a parking, the display controller 117 provides the image information to the image supplement processing unit 116 to provide an auxiliary image such as a parking line or a notification to the output image.
[0054] The open LDI 116 receives the output image from the image supplement processing unit 116 or the display controller 117, and supplies the output image to the display device 160. The open LDI 116, as a universal interface standard for high-speed data transmission, increases a bit rate of the output image, reduces power, and provides improved noise control performance.
[0055] Meanwhile, the first resolution control unit 113 receives the reversing image created by the ISP 111 when describing components according to an order in which the reversing images are delivered through the emergency path, and controls an image resolution, and generates the reversing image as a reduced reversing image. In an exemplary embodiment of the present disclosure, it is described as an example that the resolution of the reversing image is 2048 x 1440, and it is described as an example that the first resolution control unit 113 reduces the resolution of the reversing image to 1 / 4 and generates the reversing image with a resolution of 512 x 360.
[0056] In this case, the first resolution control unit 113 may also control the resolution by receiving the distortion-corrected image whose distortion phenomenon has been corrected by the safety area equalizer 112. In an exemplary embodiment of the present disclosure, for the sake of clarity and simplicity of description, it is described as an example that the ISP 111 controls the resolution without correcting the distortion phenomenon in the rear view image generated by the ISP 111, but the present disclosure is not specifically limited to this.
[0057] The internal SRAM 114 stores the reduced reversing image generated by the first resolution control unit 113. The internal SRAM 114 can also evaluate the effectiveness of the reduced reversing image by storing the ECC (error correcting code) function as the error correction code in addition to a storage function of the reduced reversing image. The ECC function is already known, and in an exemplary embodiment, the detailed description will be omitted. Furthermore, as an example, the internal SRAM 114 will be described as performing the ECC function, but the present disclosure is not specifically limited thereto.
[0058] When the safe-area equalizer 112 receives an operation control signal from the image supplement processing unit 116, the safe-area equalizer 112 reads the reduced reverse image stored in the internal SRAM 114, corrects the distortion phenomenon, and then generates a reduced correction image. As another exemplary embodiment, the safe-area equalizer 112 may correct the distortion phenomenon in the image generated by the ISP 111 and then also supply the corrected reverse image to the first resolution control unit 113.
[0059] The second resolution control unit 115 receives the reduced correction image created by the safety area equalizer 112 and restores the reduced resolution to the resolution of the reverse image to generate the output reverse image. Since a method by which the second resolution control unit 115 restores the resolution of the reduced image is already known, the detailed description will be omitted in an exemplary embodiment of the present disclosure.
[0060] The second resolution control unit 115 may also additionally generate the image information for the output reverse image. The image information may include the output reverse image and the vertical / horizontal synchronization information for the output reverse image.
[0061] When the image supplement processing unit 116 receives the output image from the display controller 117 or receives the output rear view image from the second resolution control unit 115, the image supplement processing unit 116 performs an image processing process to provide additional information, such as adding the parking line to each image or adding the warning message to the image. While a process in which the image supplement processing unit 116 processes the image to provide the additional information to the image can be performed using various methods, the process is not limited to a specific method in an exemplary embodiment of the present disclosure.
[0062] Furthermore, the image completion processing unit 116 confirms the effectiveness of the output image based on the image information included in each output image. To confirm the effectiveness of the output image, the image completion processing unit 116 receives a setting signal from a control device (not shown) that controls electrical devices of the vehicle.
[0063] Here, the adjustment signal includes an operation clock of the image supplement processing unit 116, a horizontal synchronization signal, and a vertical synchronization signal for the image. When the rear view camera image processing device 100 is executed by starting the vehicle, the rear view camera image processing device 100 receives the adjustment signal from the control device. Here, the operation clock, as a reference clock used to judge the effectiveness of the synchronization signal, is a 24 MHz XIN clock in an exemplary embodiment. The image supplement processing unit 116 judges the effectiveness of the output image based on the adjustment signal.
[0064] That is, when the image supplement processing unit 116 receives the output image and image information, the image supplement processing unit 116 judges whether the output image is read in as large as the setting value by comparing the clock included in the image information, the horizontal synchronization information included in the image information, and the vertical synchronization information included in the image information with a previously obtained setting signal. In addition, by confirming whether only a paused image is continuously read in, whether a single-color image is read in, whether different image information is read in from the setting signal, etc., it is confirmed whether the error occurs in the components installed in the non-security area.
[0065] If it is determined that an error has occurred, the image supplement processing unit 116 attempts to switch a path for receiving images from the normal path to the emergency path. In addition, to receive the image whose resolution has been controlled by the second resolution control unit 115, the operation control signal is transmitted to the safety area equalizer 112. This allows the reversing image stored in the internal SRAM 114 to be delivered to the display device 160 even if the error occurs in the DRAM 140, the main bus 130, etc., which are located in the non-safety area.
[0066] With reference to Fig. 4, a method in which the rear view camera image processing apparatus 100 described above processes the image of the rear view camera will be described.
[0067] Fig. 4 is a flowchart for a rear view camera image processing method according to an exemplary embodiment of the present disclosure.
[0068] As in Fig. 4, the rear view camera image processing device 100 is initially driven (S100). In this case, all components constituting the rear view camera processing device 100 are changed to an operational state, and specifically, the image supplement processing unit 116 receives the setting signal from the control device. Furthermore, the image supplement processing unit 116 is initially set to an operational state in which the image is received via the normal path.
[0069] When the rear view camera 150 captures the image (S101), the original rear view images captured from the normal path and the emergency path are transmitted, and the images are processed accordingly (S102). In this case, the rear view camera processing device 100 is set to provide the output image processed via the normal path first.
[0070] Therefore, the image completion processing unit 116 of the rear view camera processing device 100 evaluates the effectiveness of the output image generated via the normal path (S103). The image completion processing unit 116 confirms whether the output image is effective based on the information contained in the output image and the setting signal received from the control device after the initial driving in step S100 (S104).
[0071] When it is confirmed that the output image is effective, the rear view camera image processing device 100 displays the output image processed through the normal path via the display device 160 (S105).
[0072] In contrast, the image supplement processing unit 116 of the rear view camera image processing device 100 generates the control signal to receive the rear view camera image processed via the emergency path when it is confirmed that the output image is ineffective (S106). The second resolution control unit 115 creates the reduced rear view image stored in the internal SRAM 114 as the output rear view image according to the control signal and displays the generated output rear view image via the display device 160 (S107).
[0073] Fig. 5 is an exemplary illustration of a rearview camera image with distortion corrected, provided according to an exemplary embodiment of the present disclosure.
[0074] Fig. 5A shows the original rear view image captured by the rear view camera 150. In addition, Fig. 5B shows the output image processed via the normal path. Fig. Figure 5C shows the output image processed via the emergency path.
[0075] Referring to the output reversing image, which is displayed via the emergency path in Fig. 5C compared to the output reversing image, which was processed via the normal path in Fig.5B, deterioration in image quality may occur according to the resolution reduction / stretching. However, even if the problem occurs in the components installed in the non-safety area of the rearview image processing system 100, the driver will normally confirm the operation of the rearview camera 150.
[0076] While the exemplary embodiments of the present disclosure have been described in detail above, it is to be understood that the scope of the present disclosure is not limited to the disclosed embodiments, and on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.
Claims
[1] A device for image processing of a rear view camera comprising: an image signal processor that generates an original rear view image captured by a rear view camera to generate a rear view image; a first processing unit that corrects a distortion phenomenon of the rear view image to create a distortion-corrected image and produces it as an output image displayable by a display device; and a second processing unit that reduces the resolution of the reversing image, to create a reduced reversing image, and temporarily stores the reduced reversing image, and upon receiving an operation control signal, corrects the distortion phenomenon of the temporarily stored reduced reversing image, and then restores the resolution to the resolution of the reversing image, and creates an output reversing image; and an image supplement processing unit that supplies the output image created by the first processing unit to the display device and judges the effectiveness of the output image based on an adjustment signal transmitted from the outside after an initial operation, and generates the operation control signal, so that the second processing unit works when the output image is not effective. [2] The rear view camera image processing apparatus according to claim 1, wherein: the first processing unit includes: a rectifier in a non-safety area that corrects the distortion phenomenon of the reversing image and creates the distortion-corrected image, a memory to store the distortion-corrected image, and a display controller that receives the distortion-corrected image stored in the memory and converts the received distortion-corrected image into the output image that can be displayed via the display device. [3] The rear view camera image processing apparatus according to claim 2, wherein: the first processing unit comprises an open LDI that receives each image, the output image or the output return image, from the image supplement processing unit and supplies the received image to the display device. [4] The rear view camera image processing apparatus according to claim 3, wherein: the display control the output image is transmitted to the image augmentation processing unit or the open LDI based on gear setting information received from the outside. [5] The rear view camera image processing apparatus according to claim 4, wherein: the second processing unit comprises a first resolution control unit that receives a reversing image and reduces the resolution of the reversing image and generates the reversing image as the reduced reversing image, an internal memory that temporarily stores the reduced reversing image, a safety area equalizer that receives the reduced reversing image temporarily stored in the internal memory and corrects the distortion phenomenon, and creates the reduced correction image when it receives the operation control signal, and a second resolution control unit that restores the resolution of the reduced correction image to the resolution of the reversing image and creates the reversing image as the output reversing image. [6] The rear view camera image processing apparatus according to claim 5, wherein: the image augmentation processing unit receives the output image and image information from the first processing unit, and compares the adjustment signal and the image information to assess the effectiveness of the output image. [7] The rear view camera image processing apparatus according to claim 6, wherein: the setting signal includes an operation clock and a horizontal synchronization signal and a vertical synchronization signal of an image, and the image information includes horizontal synchronization information and vertical synchronization information of the output image. [8] A rear view camera image processing method for processing, by means of a rear view camera image processing device operated by at least one processor, an original rear view image acquired by a rear view camera, the method comprising: processing the original rear view image through both a first path and a second path when the rear view camera captures the original rear view image; supplying an output image created by the first path to a display device, and temporarily storing a reduced correction image created by the second path; Evaluate the effectiveness of the output image created by the first path; Creating the temporarily stored reduced correction image as a reversal output image if the output image is not effective; and Delivering the rear view output image to a display device. [9] The rear view camera image processing method according to claim 8, further comprising: before processing by both the first path and the second path, Convert to an operational state when a setting signal is input from the outside, wherein the adjustment signal comprises an operation clock and a horizontal synchronization signal and a vertical synchronization signal of the image. [10] The rear view camera image processing method according to claim 9, wherein: processing by both the first path and the second path via the first path includes Signal image processing of the original reversing image to create a reversing image, Correcting a distortion phenomenon of the reversing image and creating the reversing image as a distortion-corrected image, and Storing the distortion-corrected image in a memory, and creating the stored distortion-corrected image as the output image displayable via the display device. [11] The rear view camera image processing method according to claim 10, wherein: processing by both the first path and the second path via the second path includes reducing the resolution of the reversing image and creating the reduced reversing image. [12] The rear view camera image processing method according to claim 11, wherein: creating as the reverse output image includes Correcting the distortion phenomenon of the reduced reversing image and creating the reversing image as the reduced correction image when an operation control signal is input, and Restore the resolution of the reduced correction image to the resolution of the reversing image, and create the reversing image as the reversing output image.
Citation Information
Patent Citations
Apparatus and method for correcting image distortion from a rear-view camera
DE102012223373A1