Video Processing Method

Abstract

It is possible to obtain the desired image quality for images used for various purposes. [Solution] The image processing device disclosed herein is an image processing device that can be mounted on a vehicle and includes a first imaging device that captures an image of the outside of the vehicle and generates a first image, a first display device that displays a second image that has been subjected to a first processing on the first image, and a second display device that displays a third image that has been subjected to a second processing on the first image, and includes a first receiving unit that receives the first image from the first imaging device, an image processing unit that performs a second processing on the first image, a first transmitting unit that transmits the first image to the first display device, and a second transmitting unit that transmits the third image to the second display device.

Description

[Technical field]

[0001] This disclosure relates to image processing method Regarding. [Background technology]

[0002] 2. Description of the Related Art There is known technology for capturing images of the outside of a vehicle using a camera or the like attached to the vehicle body and utilizing the captured images for various purposes, such as checking the rear of the vehicle and recording images outside the vehicle.

[0003] When used for rear-view confirmation of a vehicle, the captured image is subjected to predetermined processing in a display unit, for example, and is displayed on an electronic mirror provided in the display unit.

[0004] When used to record images outside the vehicle, the captured images are subjected to predetermined processing in, for example, a drive recorder unit and are displayed on a panel display or the like. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2014-229049 A Summary of the Invention

[0006] One aspect of the present disclosure is a video processing method for obtaining a desired image quality for video used for various purposes. method to provide.

[0007] Image processing according to one aspect of the present disclosure method a first imaging device that captures an image of the outside of the vehicle and generates a first image; a first display device that displays a second image obtained by performing a first process on the first image; and a second display device that displays a third image obtained by performing a second process on the first image, the image processing device being mountable on the vehicle. Image processing method in receiving the first image from the first imaging device; Steps and subjecting the first image to the second processing. Steps and transmitting the first image to the first display device. Steps and transmitting the third image to the second display device. Steps And, include .

[0008] These comprehensive or specific aspects may be realized as a system, a method, an integrated circuit, a computer program, or a recording medium, or may be realized as any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium. Effect of the Invention

[0009] Image Processing According to the Present Disclosure method According to this, it is possible to obtain a desired image quality in images used for various purposes. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a schematic diagram showing an example of a vehicle equipped with a drive recorder unit according to an embodiment. [Diagram 2] FIG. 2 is a block diagram illustrating an example of a configuration of the video processing system according to the embodiment. [Diagram 3] FIG. 3 is a flowchart illustrating an example of a procedure of a process performed by the drive recorder unit according to the embodiment. [Figure 4] FIG. 4 is a schematic diagram showing a schematic configuration of a drive recorder unit and a display unit according to a comparative example. [Diagram 5] FIG. 5 is a schematic diagram showing a schematic configuration of a drive recorder unit and a display unit according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, embodiments of an image processing device and an image processing system according to the present disclosure will be described with reference to the drawings.

[0012] (Vehicle configuration example) 1 is a schematic diagram showing an example of a vehicle 5 including a drive recorder unit 10 according to an embodiment. As shown in FIG. 1, the vehicle 5 of the embodiment includes, for example, the drive recorder unit 10, a front camera 31, a rear camera 32, a display device 25, and a display 45.

[0013] The front camera 31 is provided, for example, on the windshield of the vehicle 5. The front camera 31 captures an image of the area in front of the vehicle 5, and generates a front image as a fourth image. The front camera 31 is an example of a second imaging device.

[0014] The rear camera 32 is provided, for example, on a rear window of the vehicle 5. The rear camera 32 captures an image of the rear of the vehicle 5 and generates a rear image as a first image. The rear camera 32 is an example of a first imaging device.

[0015] The drive recorder unit 10 is housed, for example, in a console box of the vehicle 5. The drive recorder unit 10 performs predetermined processing on a forward image captured by a front camera 31 and a rearward image captured by a rear camera 32. The drive recorder unit 10 is an example of an image processing device.

[0016] The display device 25 is a liquid crystal display or the like that displays the rear of the vehicle, and is, for example, a mirror-type electronic mirror that resembles a mirror for checking the rear of the vehicle. The display device 25 displays a rear image that has been subjected to predetermined processing by, for example, an electronic control unit (ECU) formed integrally with the display device 25. The display device 25 is an example of a first display device. The electronic mirror is an example of a mirror-type display device.

[0017] Although the display device 25 in FIG. 1 is configured as an electronic mirror in the form of a rearview mirror, when the display device 25 is configured as an electronic mirror, it may have the shape of another mirror for checking the rear, such as a door mirror or a fender mirror.

[0018] The display 45 is, for example, a panel-type liquid crystal display or the like that is fitted into an instrument panel or the like. The display 45 displays the front image and the rear image processed by the drive recorder unit 10. The display 45 is an example of a second display device.

[0019] The display 45 may display images from other cameras (not shown) installed on the side or interior of the vehicle 5, or may display an all-directional overhead image synthesized from images from multiple cameras capturing images of the outside of the vehicle, including the front camera 31 and the rear camera 32.

[0020] The drive recorder unit 10, the front camera 31, the rear camera 32, the display device 25, and the display 45 described above are part of a video processing system, which will be described later.

[0021] (Example of a video processing system configuration) Fig. 2 is a block diagram showing an example of the configuration of the image processing system 1 according to the embodiment. As shown in Fig. 2, the image processing system 1 according to the embodiment includes a drive recorder unit 10, a display unit 20, a front camera 31, a rear camera 32, and a display unit 40, and is configured to be mountable on, for example, the vehicle 5 described above.

[0022] The drive recorder unit 10 includes a main microcomputer 11, a sub-microcomputer 12, a serializer 13p, a serializer 13m, a deserializer 14p, and a deserializer 14m.

[0023] The main microcomputer 11 is a computer equipped with a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory). The main microcomputer 11 is configured as a SoC (System on Chip) equipped with an image processor 11p that processes, for example, a front image and a rear image. The main microcomputer 11 is an example of a second control unit. The image processor 11p is an example of an image processing unit.

[0024] The main microcomputer 11 receives a forward image generated by the front camera 31 from the deserializer 14p as a video signal SGvf. The image processor 11p processes the forward image. The main microcomputer 11 also receives a rearward image generated by the rear camera 32 from the deserializer 14m as a video signal SGvr. The image processor 11p processes the rearward image. In the image processing by the image processor 11p, for example, color and contrast adjustments are performed so that the image is suitable for recording the outside of the vehicle image and displaying it on the display 45.

[0025] In addition, the main microcomputer 11 controls the serializer 13p and the deserializer 14p by transmitting a control signal SGc to the serializer 13p and the deserializer 14p.

[0026] For example, when a front image is transmitted from the front camera 31 to the drive recorder unit 10, the main microcomputer 11 causes the deserializer 14p to receive the front image from the front camera 31.

[0027] Also, for example, after processing the front video and the rear video, the main microcomputer 11 causes the serializer 13p to transmit the processed front video and rear video to the display unit 40.

[0028] The front image and the rear image processed by the main microcomputer 11 are also stored in a memory area within the main microcomputer 11 as recorded images.

[0029] In addition, the main microcomputer 11 notifies the sub-microcomputer 12 of various statuses by transmitting a status signal SGs to the sub-microcomputer 12. The various statuses include the status of the main microcomputer 11 itself, as well as information on the occurrence or non-occurrence of a fault in the main control block 2, which will be described later.

[0030] When the deserializer 14p as a conversion unit receives the control signal SGc from the main microcomputer 11, it receives the front video transmitted from the front camera 31. At this time, the deserializer 14p converts the front video transmitted as the serialized video signal SGvf into parallel data. The deserializer 14p also transmits the parallelized front video to the main microcomputer 11 in the form of the video signal SGvf. The deserializer 14p is an example of a second receiving unit.

[0031] When the serializer 13p as a conversion unit receives the control signal SGc from the main microcomputer 11, it transmits the processed front video and rear video received from the main microcomputer 11 to the display unit 40. At this time, the serializer 13p converts the parallelized front video and rear video into serial data and transmits them as video signals SGvf and SGvr, respectively, to the display unit 40. The serializer 13p is an example of a second transmission unit.

[0032] The sub-microcomputer 12 is a computer including a CPU, a ROM, and a RAM, and is configured as, for example, an MCU (Micro Controller Unit). The sub-microcomputer 12 is an example of a first control unit.

[0033] The sub-microcomputer 12 controls the serializer 13m and the deserializer 14m by transmitting a control signal SGc to the serializer 13m and the deserializer 14m.

[0034] For example, when a rearward image is transmitted from the rear camera 32 to the drive recorder unit 10, the sub-microcomputer 12 causes the deserializer 14m to receive the rearward image from the rear camera 32.

[0035] Also, for example, when the deserializer 14m receives a rear video image, the sub-microcomputer 12 causes the serializer 13m to transmit the unprocessed rear video image to the display unit 20.

[0036] In addition, the sub-microcomputer 12 notifies the main microcomputer 11 of various statuses by transmitting a status signal SGs to the main microcomputer 11. The various statuses include the status of the sub-microcomputer 12 itself, as well as information on the occurrence or non-occurrence of a fault in the sub-control block 3, which will be described later.

[0037] When the deserializer 14m as a conversion unit receives the control signal SGc from the sub-microcomputer 12, it receives the rearward video transmitted from the rear camera 32. At this time, the deserializer 14m converts the rearward video transmitted as the serialized video signal SGvr into parallel data. The deserializer 14m also transmits the parallelized rearward video to the main microcomputer 11 and the serializer 13m in the form of the video signal SGvr. The deserializer 14m is an example of a first receiving unit.

[0038] When the serializer 13m serving as a conversion unit receives a control signal SGc from the sub-microcomputer 12, it transmits the unprocessed rear video received from the deserializer 14m to the display unit 20. At this time, the serializer 13m converts the parallel rear video into serial data and transmits it as a video signal SGvr to the display unit 20. The serializer 13m is an example of a first transmission unit.

[0039] The control signal SGc is transmitted from the main microcomputer 11 to the serializer 13p and the deserializer 14p, and from the sub-microcomputer 12 to the serializer 13m and the deserializer 14m in, for example, an I2C (Inter-Integrated Circuit) format.

[0040] Furthermore, transmission and reception of the video signal SGvp between the main microcomputer 11 and the serializer 13p and deserializer 14p, and transmission of the video signal SGvr from the deserializer 14m to the main microcomputer 11 and serializer 13m are performed in, for example, MIPI (Mobile Industry Processor Interface) format.

[0041] In addition, transmission and reception of video signals SGvf and SGvr between the serializer 13p and the serializer 13m, as well as the deserializer 14p and the deserializer 14m and the front camera 31, the rear camera 32, the display unit 20, and the display unit 40 is performed in, for example, FPD-Link III (Flat Panel Display-Link III) format.

[0042] For these video transmissions, for example, a coaxial cable or Wi-Fi (registered trademark) can be used.

[0043] Furthermore, the status signal SGs between the main microcomputer 11 and the sub-microcomputer 12 is transmitted and received in, for example, a UART (Universal Asynchronous Receiver / Transmitter) format.

[0044] The display unit 40 includes, for example, a panel-type display 45, and is configured as, for example, a part of an in-vehicle infotainment (IVI) system.

[0045] The processed front and rear images received by the display unit 40 from the drive recorder unit 10 are passed to the display 45 and displayed on the display 45, and are used for purposes such as displaying the outside situation in parking assistance, displaying parking spaces, and displaying parking routes.

[0046] The display unit 20 includes an ECU 21 and a display device 25 .

[0047] The ECU 21 receives and processes unprocessed rearward images from the drive recorder unit 10. In the image processing by the ECU 21, for example, color and contrast adjustments are performed so that the images are suitable for display on the display device 25.

[0048] The rear image processed by the ECU 21 is transferred to the display device 25 and displayed on the display device 25, and is used, for example, for checking the rear of the vehicle 5.

[0049] The display unit 20 can also receive rearward images directly from the rear camera 32. That is, the function of receiving rearward images from the drive recorder unit 10 can also be used as a function of receiving rearward images from the rear camera 32.

[0050] Here, the main microcomputer 11, the serializer 13p, the deserializer 14p, the front camera 31, and the display unit 40 constitute a main control block 2. In the main control block 2, the serializer 13p, the deserializer 14p, the front camera 31, and the display unit 40 are under the control of the main microcomputer 11. The main microcomputer 11 appropriately notifies the sub-microcomputer 12 of the status, such as whether any faults or the like have occurred in the main control block 2 including the main microcomputer 11. The main control block 2 is an example of a second block.

[0051] Further, the sub-microcomputer 12, the serializer 13m, the deserializer 14m, the rear camera 32, and the display unit 20 constitute a sub-control block 3. In the sub-control block 3, the serializer 13m, the deserializer 14m, the rear camera 32, and the display unit 20 are under the control of the sub-microcomputer 12. The sub-microcomputer 12 appropriately notifies the main microcomputer 11 of the status, such as whether any faults or the like have occurred in the sub-control block 3 including itself. The sub-control block 3 is an example of a first block.

[0052] The main control block 2 and the sub control block 3 can operate independently of each other. Therefore, for example, even if some kind of failure occurs in the main control block 2, the sub control block 3 can continue to operate. By the sub control block 3 continuing to operate, for example, the display device 25 can continue to display a rear image.

[0053] Furthermore, the main microcomputer 11 and the sub-microcomputer 12 can operate independently of each other. Therefore, even if some kind of failure occurs in the main microcomputer 11, the sub-microcomputer 12 continues to operate, and for example, the display device 25 continues to display a rear view image.

[0054] (Example of processing a drive recorder unit) Next, an example of processing by the drive recorder unit 10 of the embodiment will be described with reference to Fig. 3. Fig. 3 is a flow diagram showing an example of a processing procedure by the drive recorder unit 10 according to the embodiment. In the flow diagram of Fig. 3, a processing example in the case where a rear image is acquired from the rear camera 32 will be described.

[0055] As shown in FIG. 3, when a rear image is transmitted from the rear camera 32 to the drive recorder unit 10 (step S101), the sub-microcomputer 12 transmits a command to receive the rear image as a control signal SGc to the deserializer 14m (step S102).

[0056] When the deserializer 14m receives a command from the sub-microcomputer 12, it receives the rearward video from the rear camera 32 as a video signal SGvr, and deserializes the received rearward video to convert it into parallel data (step S103). In addition, the deserializer 14m transmits the parallelized rearward video as a video signal SGvr to the main microcomputer 11 and the serializer 13m.

[0057] The sub-microcomputer 12 transmits a command to transmit the unprocessed rear video image as a control signal SGc to the serializer 13m (step S104).

[0058] Upon receiving the command from the sub-microcomputer 12, the serializer 13m serializes the unprocessed rear image received from the deserializer 14m, and transmits it to the display unit 20 as a video signal SGvr (step S105).

[0059] Here, the subsequent processing branches depending on whether the main control block 2 is operating normally or not (step S106). If the main control block 2 is not operating normally (step S106: No), the following processing is not performed.

[0060] At this time, the sub-microcomputer 12 receives a status indicating that a fault has occurred in the main control block 2 from the main microcomputer 11 as a status signal SGs. However, if a fault has occurred in the main microcomputer 11 itself, the status signal SGs may not be transmitted from the main microcomputer 11. The processes of steps S104 to S105 described above are executed by the sub-microcomputer 12 regardless of whether the main control block 2 including the main microcomputer 11 is in normal operation or not.

[0061] If the main control block 2 is operating normally (step S106: Yes), the main microcomputer 11 acquires the rear image as the video signal SGvr from the deserializer 14m, and the image processor 11p processes the rear image (step S107).

[0062] The main microcomputer 11 transmits the rear image processed by the image processor 11p as a video signal SGvr to the serializer 13p, and transmits a command to transmit the rear image as a control signal SGc (step S108).

[0063] Upon receiving the command from the main microcomputer 11, the serializer 13p serializes the processed rear image received from the main microcomputer 11, and transmits it to the display unit 40 as a video signal SGvr (step S109).

[0064] This completes the process by the drive recorder unit 10 of the embodiment.

[0065] The above-mentioned processes in steps S104 to S105 and steps S106 to S109 may be performed in parallel.

[0066] (Comparative Example) Next, the drive recorder unit 10 of the embodiment will be described in comparison with a comparative example with reference to Figures 4 and 5. Figure 4 is a schematic diagram showing the schematic configuration of a drive recorder unit 10' and a display unit 20' according to the comparative example.

[0067] 4, in the configuration of the comparative example, a rearward image from a rear camera 32' is transmitted to a display unit 20'. The display unit 20' processes the rearward image received from the rear camera 32' so that it is suitable for display on a display device such as an electronic mirror, and then transmits the processed rearward image to the drive recorder unit 10'.

[0068] Therefore, the display unit 20' has a function of transmitting a rear image as well as a function of receiving the rear image.

[0069] On the other hand, the forward image from the front camera 31' is transmitted to the drive recorder unit 10'. The drive recorder unit 10' processes the forward image received from the front camera 31' so that it is suitable for display on a panel type display.

[0070] However, in the configuration of the comparative example, the image quality of the rear image processed by the display unit 20' and the front image processed by the drive recorder unit 10' recorded in the drive recorder unit 10' and displayed on the panel-type display may differ.

[0071] In addition, in the existing display unit 120', for example, the rear image from the rear camera 32' is used exclusively for display on a display device such as an electronic mirror. Therefore, the display unit 120' only has a function for receiving rear images. When such a display unit 120' is to be converted into the display unit 20' of the comparative example, it is necessary to add an image transmission function to the display unit 120'. This leads to an increase in costs and an increase in the space required for mounting components due to the addition of a transmission function.

[0072] Furthermore, a plurality of display units 20', 120' must be prepared depending on whether they are connected to the drive recorder unit 10' or not, which increases the number of parts required to configure the display units.

[0073] FIG. 5 is a schematic diagram showing a schematic configuration of the drive recorder unit 10 and the display unit 20 according to the embodiment.

[0074] 5, according to the embodiment of the drive recorder unit 10, both the front image and the rear image recorded in the drive recorder unit 10 and displayed on the display 45 are processed by the drive recorder unit 10. This allows the image quality of the rear image used for multiple purposes to be the same as that of the front image.

[0075] Furthermore, according to the embodiment of the drive recorder unit 10, the drive recorder unit 10 transmits the rear image received from the rear camera 32 to the display unit 20 without processing it. This allows the display unit 20 to perform its own image processing on the rear image so as to suit the purpose of the display unit 20.

[0076] Moreover, according to the drive recorder unit 10 of the embodiment, the drive recorder unit 10 directly acquires rearward images from the rear camera 32 and transmits the acquired rearward images to the display unit 20. As a result, the display unit 20 does not necessarily need to have a function for transmitting rearward images, and the existing display unit 120 can be used as is. Therefore, it is possible to suppress an increase in cost and an increase in component mounting space due to the addition of a transmission function.

[0077] Furthermore, according to the drive recorder unit 10 of the embodiment, the display unit 20 (120) is compatible whether it is connected to the drive recorder unit 10 or not, so that an increase in the number of parts can be suppressed.

[0078] Moreover, according to the drive recorder unit 10 of the embodiment, the drive recorder unit 10 includes the main microcomputer 11 and the sub-microcomputer 12 that operate independently of each other. As a result, as long as the sub-microcomputer 12 is started, the display of rearward images on the display device 25 can be started without waiting for the main microcomputer 11, which has a high load due to a recording function and the like and takes time to start up. Therefore, the display device 25 can easily comply with the safety standard of United Nations-Regulation 46 (UN-R46).

[0079] Moreover, according to the embodiment of the drive recorder unit 10, the drive recorder unit 10 includes a configuration belonging to the main control block 2 and a configuration belonging to the sub control block 3 which operate independently of each other. As a result, even if a failure occurs in the main control block 2, the sub control block 3 continues to operate, and the display of the rear image by the display device 25 can continue. Therefore, the display device 25 can easily comply with the safety standard of UN-R46.

[0080] In addition, the drive recorder unit 10 of the embodiment is designed to handle forward and rearward images displayed on the display device 25 and the panel-type display 45, etc., but the technology of the drive recorder unit 10 of the embodiment may be applied to images displayed on other displays such as a meter display, a head-up display, etc.

[0081] Furthermore, the drive recorder unit 10 of the embodiment may be integrated with an IVI system and configured to form a part of the IVI system.

[0082] In addition, the drive recorder unit 10 of the embodiment can be used without being combined with the display device 25 such as an electronic mirror. In that case, the drive recorder unit 10 incorporated in the image processing system 1 can be diverted by simply modifying the software. For example, when the drive recorder unit 10 is used in combination with the display device 25, the drive recorder unit 10 has a function of communicating with the display device 25 and monitoring the display device 25, and restarting the display device 25 when an abnormality is detected in the display device 25, and when the drive recorder unit 10 is used without being combined with the display device 25, the function can be deleted by modifying the software. Therefore, since there is no need to add parts to the drive recorder unit 10 when diverting, an increase in the number of parts can be suppressed.

[0083] Although some embodiments of the present disclosure have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope of the invention and its equivalents as well as the scope and spirit of the invention. [Explanation of symbols]

[0084] 1. Video Processing System 2 Main Control Block 3 Secondary control block 5. Vehicles 10 Drive recorder unit 11 Main microcomputer 12 Sub-microcomputer 20 Display unit 25 Display device 31 Front Camera 32 Rear camera 40 Display unit 45 Display

Claims

1. An image processing method in an image processing device that can be mounted on a vehicle, the image processing device including a first imaging device that captures an image of an outside of the vehicle and generates a first image, a first display device that displays a second image obtained by performing a first process on the first image, and a second display device that displays a third image obtained by performing a second process on the first image, the method comprising: receiving the first image from the first imaging device; performing the second processing on the first image; transmitting the first image to the first display device; transmitting the third image to the second display device. Image processing method.

2. the vehicle includes a second imaging device that captures an image of an area outside the vehicle and generates a fourth image; receiving the fourth image from the second imaging device; generating a fifth image by performing the second processing on the fourth image; transmitting the fifth image to the second display device. The video processing method according to claim 1 .

3. the first imaging device images a rear area of ​​the vehicle; The first display device is a mirror-type display device modeled after a mirror for checking the rear of the vehicle. The video processing method according to claim 2 .

4. the second imaging device captures an image of a front of the vehicle; The second display device is a panel type display device. The image processing method according to claim 2 or 3.

Images