Vehicle control device
The vehicle control device addresses the discrepancy in displayed images by aligning and correcting camera views to match the driver's natural perspective, enhancing comfort and reducing costs by using a single camera for rear and surrounding area monitoring.
Patent Information
- Application Number
- JP2023078749
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-11
- Publication Date
- 2024-11-21
AI Technical Summary
The use of wide-angle lenses in peripheral monitoring cameras for vehicles causes a discrepancy between the displayed image on electronic interior mirrors and the actual view, leading to driver discomfort.
A vehicle control device that includes an input unit for rear images from a camera with a wide-angle lens, generating a first image aligned with the vehicle's horizontal line and correcting vertical distortion to match the driver's natural view, and a second image by cutting out a partial area to align with the vehicle's vertical center.
The device displays a natural image for rear monitoring, reducing driver discomfort and allowing cost-effective use of a single camera for both rear and surrounding area monitoring.
Smart Images

Figure 2024162829000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a vehicle control device. [Background technology]
[0002] In recent years, electronic inner mirrors capable of displaying camera images have been developed to replace the rearview mirrors used to check the rear of a vehicle. In addition, there are cases where a vehicle is equipped with multiple cameras for monitoring the surroundings, including the rear of the vehicle. In this case, it is necessary to use both the camera for the electronic inner mirror and the backup camera for monitoring the surroundings, which increases costs.
[0003] For example, there is a technology that switches the angle of view of a single backup camera to perform rear monitoring at close range and rear monitoring at long range (for example, Patent Document 1). By applying such a technology, it is possible to use a single camera for rear monitoring and surrounding monitoring. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Japanese Patent Application Publication No. 8-301010 Summary of the Invention [Problem to be solved by the invention]
[0005] However, cameras for monitoring surroundings, such as rearview cameras, usually use wide-angle lenses, so simply changing the camera's angle of view causes the image displayed on the electronic inner mirror to differ from what is actually seen with the naked eye, which can cause discomfort to the driver.
[0006] An object of the present disclosure is to provide a vehicle control device that can display a natural image while also using a backup camera for periphery monitoring for rear monitoring. [Means for solving the problem]
[0007] The vehicle control device disclosed herein comprises an input unit that receives a rear image of the vehicle from a camera having a wide-angle lens mounted at the rear of the vehicle, and a generation unit that cuts out a partial area from the rear image to generate a first image and a second image to be displayed on a predetermined display device, wherein when generating the first image, the generation unit matches a position in the rear image that is on a line horizontal to a line connecting the front and rear ends of the vehicle at the mounting height of the camera with the vertical cut-out center of the rear image and corrects distortion of the rear image caused by the wide-angle lens, and when generating the second image, cuts out the partial area so that the position in the rear image that is on a line horizontal to a line connecting the front and rear ends of the vehicle at the mounting height of the camera is located above the vertical cut-out center of the rear image. Effect of the Invention
[0008] According to the vehicle control device of the present disclosure, a backup camera for monitoring the surroundings can also be used for rear monitoring, and a natural image can be displayed. [Brief description of the drawings]
[0009] [Figure 1] FIG. 1 is a block diagram showing an example of a configuration of a vehicle including an ECU according to an embodiment. [Diagram 2] FIG. 2 is a block diagram illustrating an example of a functional configuration of the ECU according to the embodiment. [Diagram 3] FIG. 3 is a diagram illustrating a range of the angle of view cut out from the angle of view of the back camera when the ECU according to the embodiment generates an image for rear monitoring. [Figure 4] FIG. 4 is a diagram illustrating how the ECU according to the embodiment generates an image for periphery monitoring and an image for rear monitoring. [Diagram 5] FIG. 5 is a flowchart illustrating an example of a procedure of an image generation process performed by the ECU according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] Hereinafter, an embodiment of a vehicle control device according to the present disclosure will be described with reference to the drawings.
[0011] (Example of ECU configuration) FIG. 1 is a block diagram showing an example of a configuration of a vehicle 10 including an ECU (Electronic Control Unit) 20 according to an embodiment.
[0012] As shown in FIG. 1, a vehicle 10 of the embodiment is equipped with a front camera 11F, side cameras 11R and 11L, a rear camera 11B, an electronic inner mirror 12M, an in-vehicle monitor 12C, a wheel speed sensor 13, a steering angle sensor 14, a shift sensor 15, a turn switch 16, an ignition switch 17, and an ECU 20.
[0013] The ECU 20 is connected to the front camera 11F, the side cameras 11R and 11L, the rear camera 11B, the electronic inner mirror 12M, and the in-vehicle monitor 12C by a display cable such as an HDMI (High-Definition Multimedia Interface) (registered trademark) cable. This allows images captured by the front camera 11F, the side cameras 11R and 11L, and the rear camera 11B to be converted into digital signals and transmitted.
[0014] The ECU 20 is connected to the wheel speed sensor 13, the steering angle sensor 14, the shift sensor 15, the turn switch 16, and the ignition switch 17 via an in-vehicle network such as a Controller Area Network (CAN). This allows the ECU 20 to receive signals from the wheel speed sensor 13, the shift sensor 15, the ignition switch 17, and the like, as described below.
[0015] The front camera 11F is provided at the front of the vehicle 10, for example, at the front bumper, and captures a forward image of the vehicle 10. The side camera 11R is provided at the right side of the vehicle 10, for example, at the right door mirror, as viewed from the driver's seat, and captures a right-side image of the vehicle 10. The side camera 11L is provided at the left side of the vehicle 10, for example, at the left door mirror, as viewed from the driver's seat, and captures a left-side image of the vehicle 10. The back camera 11B is provided at the rear of the vehicle 10, for example, at the rear bumper, and captures a rear image of the vehicle 10.
[0016] The surrounding images captured by the front camera 11F, the side cameras 11R and 11L, and the back camera 11B are used to monitor the surroundings of the vehicle 10, for example, when parking or exiting the vehicle. For this reason, in order to minimize blind spots, a wide-angle lens such as a fisheye lens is used for the front camera 11F, the side cameras 11R and 11L, and the back camera 11B.
[0017] The electronic inner mirror 12M is a room-mirror type liquid crystal display (LCD) or the like, and is provided, for example, near the center of the upper end of the windshield inside the vehicle cabin. The electronic inner mirror 12M is configured to be capable of displaying, for example, a rear image of the vehicle 10 captured by the backup camera 11B.
[0018] The in-vehicle monitor 12C is an LCD or the like, such as a center information display (CID) provided near the center of an instrument panel. The in-vehicle monitor 12C is configured to be capable of displaying, for example, images of the surroundings of the vehicle 10 captured by the front camera 11F, the side cameras 11R and 11L, and the back camera 11B, and displaying an overhead image obtained by synthesizing these images of the surroundings. The in-vehicle monitor 12C may be configured to be capable of displaying a navigation screen by being used in conjunction with a navigation system.
[0019] The electronic inner mirror 12M and the in-vehicle monitor 12C are examples of a predetermined display device.
[0020] The in-vehicle monitor 12C is provided with a function switch 12s that is used for various operations, such as starting the display on the in-vehicle monitor 12C, changing the display content, or specifying the in-vehicle monitor 12C as a display destination in addition to the electronic inner mirror 12M.
[0021] The wheel speed sensor 13 is configured using, for example, a Hall element, and outputs a wheel speed pulse representing the wheel speed as a detection result based on the amount of rotation or the number of rotations per unit time of the wheels of the vehicle 10.
[0022] The steering angle sensor 14 detects the angle of the steering wheel, and outputs a steering angle signal as a detection result.
[0023] The shift sensor 15 includes, for example, a displacement sensor, and detects the position of a lever, arm, button, or the like for performing a gear shift operation of the vehicle 10, and outputs a signal indicating the shift position as the detection result.
[0024] The turn switch 16 is a lever, arm, button, or the like for flashing the turn signal lights when the vehicle 10 changes course, such as turning right or left, and outputs a control signal for turning on the turn signal lights when this is operated.
[0025] The ignition switch 17 is a switch that starts the engine or motor and the electrical system, and is operated by rotating the key cylinder with the engine key, or by pressing a button, etc. When the ignition switch 17 is operated, it outputs a control signal for starting the engine, etc.
[0026] The ECU 20 is configured as a computer equipped with, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory), which are not shown, and generates images that have been subjected to various processing from peripheral images acquired from the front camera 11F, the side cameras 11R and 11L, the rear camera 11B, etc., and outputs the images appropriately to the electronic inner mirror 12M and the in-vehicle monitor 12C. At this time, the ECU 20 starts image processing, etc., based on a signal from the ignition switch 17, for example, and changes the image processing content and output destination based on signals from the wheel speed sensor 13 and the shift sensor 15.
[0027] In this manner, the ECU 20 is configured as a vehicle control device that processes various peripheral images and outputs them to the electronic inner mirror 12M and the in-vehicle monitor 12C.
[0028] The ECU 20 may be composed of multiple ECUs such as a camera ECU and a display ECU. The camera ECU controls, for example, the front camera 11F, the side cameras 11R and 11L, and the back camera 11B, and performs various processing on the surrounding images acquired from these cameras. The display ECU controls the electronic inner mirror 12M and the in-vehicle monitor 12C, and causes these to display various information including the images processed by the camera ECU.
[0029] Furthermore, the ECU 20 may obtain signals from various sensors via other ECUs such as a drive ECU and a brake ECU. The drive ECU controls a drive source such as an engine or a motor to adjust the output of the drive source and also changes the speed of the vehicle 10. The brake ECU obtains the vehicle speed of the vehicle 10, for example, by counting vehicle speed pulses from a wheel speed sensor 13, and applies braking to the wheels including the drive wheels using brakes provided on each wheel.
[0030] Fig. 2 is a block diagram showing an example of a functional configuration of the ECU 20 according to the embodiment. As shown in Fig. 2, the ECU 20 includes, as its functional configuration, an input unit 21, a determination unit 22, a generation unit 23, an output unit 24, and a storage unit 25. These functional units are realized, for example, by a CPU (not shown) included in the ECU 20 expanding a control program stored in a ROM or the like into a RAM and executing the program.
[0031] The input unit 21 acquires surrounding images captured by the front camera 11F, the side cameras 11R, 11L, and the back camera 11B via the above-mentioned display cable, etc. The input unit 21 also acquires the wheel speed detection result, the shift position detection result, and a control signal for starting the engine, etc., from the wheel speed sensor 13, the shift sensor 15, and the ignition switch 17 via the above-mentioned in-vehicle network, etc. The input unit 21 also acquires a control signal indicating that the output destination designation operation has been performed from the function switch 12s via the main body of the in-vehicle monitor 12C when an operation for designating the output destination of an image is performed using the function switch 12s.
[0032] The determination unit 22 determines whether or not the speed of the vehicle 10 at that time is less than a predetermined speed based on the detection result of the wheel speed sensor 13. The predetermined speed of the vehicle 10 used by the determination unit 22 for the determination can be a very low speed, for example, less than 10 km / h to 15 km / h.
[0033] The determination unit 22 also determines whether the shift position of the vehicle 10 is in reverse based on the detection result of the shift sensor 15. The determination unit 22 also determines whether the engine of the vehicle 10 has been started by the ignition switch 17. The determination unit 22 also determines whether an operation to specify the output destination of an image has been performed by the function switch 12s provided on the in-vehicle monitor 12C.
[0034] The generation unit 23 generates an image for monitoring the periphery of the vehicle 10, an image for monitoring the rear, an overhead image, and the like, based on images captured by the front camera 11F, the side cameras 11R and 11L, and the back camera 11B.
[0035] The image for surrounding monitoring as the second image is an image for showing the driver the state of the periphery of the vehicle 10, such as obstacles or pedestrians around the vehicle 10, for example, when parking or starting the vehicle, as described above. The overhead image is a composite image showing 360° around the vehicle 10 with the vehicle icon at the center, and is used for driving assistance, for example, when parking or starting the vehicle. The image for rear monitoring as the first image is an image for showing the state of the rear of the vehicle 10, including following vehicles, for example, when the vehicle 10 is running normally.
[0036] The generation unit 23 determines an image to be generated as appropriate according to various states of the vehicle 10 determined by the determination unit 22.
[0037] More specifically, when the engine of the vehicle 10 starts to start, the generating unit 23 generates, for example, an image for rear monitoring. When the speed of the vehicle 10 is less than a predetermined speed or when the shift position is in reverse, the generating unit 23 generates, for example, an image for periphery monitoring. When parking or exit assistance control is started by the function switch 12s of the in-vehicle monitor 12C, the generating unit 23 may generate an overhead image in addition to the image for periphery monitoring.
[0038] The output unit 24 outputs the periphery monitoring image, rear monitoring image, and overhead image generated by the generation unit 23 to the electronic inner mirror 12M or the in-vehicle monitor 12C as appropriate via the above-mentioned display cable or the like. At this time, the periphery monitoring image and the overhead image are output to, for example, the in-vehicle monitor 12C. Also, the rear monitoring image is output to the electronic inner mirror 12M in principle. However, when an operation to specify the display destination of the image is performed by the function switch 12s or the like of the in-vehicle monitor 12C, the rear monitoring image may be output to the in-vehicle monitor 12C in addition to the electronic inner mirror 12M.
[0039] The various images output from the output unit 24 of the ECU 20 are displayed on the electronic inner mirror 12M or the in-vehicle monitor 12C in accordance with the situation of the vehicle 10 at the time.
[0040] The storage unit 25 stores control parameters and control programs used to realize various functions of the ECU 20. The storage unit 25 may store surrounding images acquired from the front camera 11F, the side cameras 11R and 11L, and the rear camera 11B. The storage unit 25 may also store surrounding monitoring images, rear monitoring images, and overhead images generated by the generation unit 23.
[0041] (Example of ECU functions) Next, a detailed example of the functions of the ECU 20 according to the embodiment will be described with reference to FIG. 3 and FIG.
[0042] 3A and 3B are diagrams for explaining the range of the angle of view cut out from the angle of view of the rear camera 11B when the ECU 20 according to the embodiment generates an image for rear monitoring. More specifically, FIG. 3A shows the cut-out angle of view as seen from above the vehicle 10, and FIG. 3B shows the cut-out angle of view as seen from the side of the vehicle 10.
[0043] 3, the rear camera 11B is attached, for example, to the rear bumper of the vehicle 10 at the center of the left and right ends of the vehicle 10 with the angle of view slightly downward. As described above, the cameras for monitoring the surroundings including the rear camera 11B use, for example, wide-angle lenses. Therefore, the surrounding image including the rear image of the vehicle 10 captured by the rear camera 11B includes a range wider than, for example, the human field of vision.
[0044] As shown in FIG. 3(a), the horizontal angle of view VAh of the rear camera 11B is, for example, about 190°, and the optical axis VX of the rear camera 11B extends horizontally toward the rear of the vehicle 10 on a line perpendicular to a line connecting the left and right ends of the vehicle 10.
[0045] As shown in FIG. 3(b), the vertical angle of view VAv of the rear camera 11B is, for example, about 160°, and the optical axis VX of the rear camera 11B is directed diagonally downward in the vertical direction on a line connecting the front and rear ends of the vehicle 10 at the mounting height of the rear camera 11B.
[0046] On the other hand, when generating an image for rear monitoring, the generating unit 23 of the ECU 20 cuts out a region of a predetermined range from the above-mentioned angle of view, and generates an image that captures an angle of view range similar to the stable gaze field of a human, for example. As a result, when the image for rear monitoring is displayed on the electronic inner mirror 12M, for example, the driver can monitor the rear without feeling uncomfortable, as if he / she were looking through an optical mirror using a normal mirror.
[0047] As shown in FIG. 3(a), when cutting out a specified range from the rear image of the rear camera 11B, the generation unit 23, as an example, sets the horizontal angle of view FAh of the cut-out range to be greater than or equal to 60° and less than or equal to 110°, and aligns the central axis FX of the cut-out range in the horizontal direction with a line perpendicular to the line connecting the left and right ends of the vehicle 10.
[0048] As shown in FIG. 3(b), the generation unit 23 sets the vertical angle of view FAv of the cut-out range to be greater than or equal to 45° and less than or equal to 70°, and aligns the center axis FX of the cut-out range in the vertical direction with a line connecting the front and rear ends of the vehicle 10 at the mounting height position of the rear camera 11B.
[0049] When generating an image for monitoring surroundings from the rear image captured by the backup camera 11B, the generating unit 23 may also clip a region of a predetermined range from within the angle of view of the rear image.
[0050] In this case, the horizontal angle of view and the central axis of the cutout range can be set to be the same as the angle of view and the central axis when generating a rear monitoring image, for example.
[0051] On the other hand, the image can be cropped so that the vertical angle of view of the cropping range is between 45° and 70°, for example, as in the case of generating a rear monitoring image, and the central axis of the periphery monitoring image is located below the line connecting the front and rear ends of the vehicle 10 at the mounting height position of the backup camera 11B. In this case, the central axis of the periphery monitoring image may be aligned with, for example, the optical axis VX of the backup camera 11B.
[0052] In the above case, the position in the rear image on the line connecting the front and rear ends of the vehicle 10 at the mounting height position of the backup camera 11B will be located above the vertical center position of the cut-out range. As an example, the generation unit 23 can arrange the position in the rear image on the line connecting the front and rear ends of the vehicle 10 in an area between 10% and 20% from the upper end of the periphery monitoring image.
[0053] FIG. 4 is a diagram showing how the ECU 20 according to the embodiment generates an image for periphery monitoring and an image for rear monitoring.
[0054] Fig. 4(a) is an example of a rear image of the vehicle 10 captured by the backup camera 11B. In the example of Fig. 4(a), the rear image shows the lane behind the vehicle 10 traveling on the road and a following vehicle. As shown in Fig. 4(a), the unprocessed rear image includes an area wider than the human field of vision, for example, and is distorted by the wide-angle lens.
[0055] FIG. 4(b) to FIG. 4(c) show how an image for monitoring surroundings is generated from the rear image in FIG. 4(a).
[0056] FIG. 4(b) shows a cutout area CAs used for a surroundings monitoring image in a rear image captured by the backup camera 11B.
[0057] 4(b), the generation unit 23 of the ECU 20 cuts out a range narrower than, for example, the entire rear image captured by the backup camera 11B in both the horizontal and vertical directions as the cut-out area CAs to be used for the periphery monitoring image. Also, the generation unit 23 cuts out a lower area in the rear image captured by the backup camera 11B as the cut-out area CAs to be used for the periphery monitoring image so that the position in the rear image on the line connecting the front and rear ends of the vehicle 10 is located in an area of 10% to 20% from the upper end of the periphery monitoring image.
[0058] Fig. 4(c) is an example of a surroundings monitoring image generated from the rear image of the backup camera 11B by the generation unit 23. As shown in Fig. 4(c), the cutout area CAs in Fig. 4(b) is used as it is for the surroundings monitoring image.
[0059] 4(d) to 4(f) show how a rear monitoring image is generated from the rear image in FIG. 4(a).
[0060] FIG. 4(d) shows a cut-out area CAb used for a rear monitoring image in the rear image captured by the backup camera 11B.
[0061] 4(d), the generation unit 23 cuts out a range narrower than, for example, the entire rear image captured by the backup camera 11B in both the horizontal and vertical directions as the cut-out area CAb to be used for the rear monitoring image. Also, the generation unit 23 cuts out an upper area in the rear image captured by the backup camera 11B as the cut-out area CAb to be used for the rear monitoring image so that the position in the rear image on the line connecting the front and rear ends of the vehicle 10 coincides with the vertical center position of the rear monitoring image.
[0062] FIG. 4(e) shows how the generation unit 23 corrects distortion caused by the wide-angle lens in the cutout area CAb used for the rear monitoring image.
[0063] As shown in Fig. 4(e), the generating unit 23 corrects the image distortion in the cutout area CAb by using an image processing technique such as warping. For example, when correcting the image distortion by warping, the generating unit 23 divides the image of the cutout area CAb into a mesh shape and moves a plurality of feature points FP present at each intersection of the mesh to predetermined coordinates. At this time, the moving distance of each feature point FP is appropriately changed, thereby correcting the image distortion in the cutout area CAb.
[0064] Fig. 4(f) is an example of a rear monitoring image generated from the rear image of the backup camera 11B by the generating unit 23. As shown in Fig. 4(f), the rear monitoring image is generated in a state in which the range of the cutout area CAb in Fig. 4(c) is corrected for distortion.
[0065] As described above, for example, when the determination unit 22 determines that the vehicle 10 is traveling at a predetermined speed or faster based on the detection result of the wheel speed sensor 13, the generation unit 23 generates a rear monitoring image as shown in Fig. 4(f) and the output unit 24 outputs the image to the electronic inner mirror 12M for display. However, when an operation to specify the display destination is performed using the function switch 12s of the in-vehicle monitor 12C, for example, the output unit 24 may output the rear monitoring image generated by the generation unit 23 to the in-vehicle monitor 12C for display.
[0066] Furthermore, for example, when the judgment unit 22 judges from the detection result of the wheel speed sensor 13 that the vehicle 10 has decelerated to less than a predetermined speed, or when the judgment unit 22 judges from the detection result of the shift sensor 15 that the shift position of the vehicle 10 has been switched to reverse, the generation unit 23 generates an image for monitoring the surroundings, for example as shown in FIG. 4(c), and the output unit 24 outputs it to the in-vehicle monitor 12C for display.
[0067] (Example of ECU processing) Next, an example of processing by the ECU 20 of the embodiment will be described with reference to Fig. 5. Fig. 5 is a flow chart showing an example of a procedure of image generation processing by the ECU 20 according to the embodiment.
[0068] 5, the input unit 21 of the ECU 20 receives a signal indicating the start of the engine or the like from the ignition switch 17, and the determination unit 22 determines that the ignition is turned on (step S101). This causes the ECU 20 to start an image generation process.
[0069] That is, the input unit 21 starts acquiring surrounding images captured by the front camera 11F, the side cameras 11R and 11L, and the back camera 11B (step S102).
[0070] Furthermore, the determination unit 22 determines whether or not the shift position of the vehicle 10 is in reverse based on the detection result of the shift sensor 15 input to the input unit 21 (step S103). If the shift position of the vehicle 10 is not in reverse (step S103: No), the determination unit 22 determines whether or not the speed of the vehicle 10 is less than a predetermined speed based on the detection result of the wheel speed sensor 13 input to the input unit 21 (step S104).
[0071] If the speed of the vehicle 10 is not less than the predetermined speed (step S104: No), the generating unit 23 generates a rear monitoring image from the rear image captured by the rear camera 11B (step S105). That is, as described above, the generating unit 23 cuts out a cut-out area CAb to be used for the rear monitoring image from the rear image captured by the rear camera 11B, and corrects image distortion in the cut-out area CAb.
[0072] The determination unit 22 determines whether or not a signal indicating an operation to specify a display destination of an image has been input to the input unit 21 from the function switch 12s provided on the in-vehicle monitor 12C (step S106).
[0073] If an instruction to specify a display destination has not been given (step S106: No), the output unit 24 outputs the rear monitoring image generated by the generation unit 23 to the electronic inner mirror 12M (step S107). If an instruction to specify a display destination has been given (step S106: Yes), the output unit 24 outputs the rear monitoring image generated by the generation unit 23 to both the electronic inner mirror 12M and the in-vehicle monitor 12C (step S108).
[0074] On the other hand, if the judgment unit 22 determines that the shift position of the vehicle 10 is in reverse (step S103: Yes), or if the judgment unit 22 determines that the speed of the vehicle 10 is less than a predetermined speed (step S104: Yes), the generation unit 23 generates an image for monitoring the surroundings from the rear image captured by the backup camera 11B (step S109).
[0075] That is, as described above, the generating unit 23 generates the surroundings monitoring image by cutting out the cut-out area CAs to be used for the surroundings monitoring image from the rear image captured by the backup camera 11B.
[0076] The output unit 24 outputs the surroundings monitoring image generated by the generation unit 23 to the in-vehicle monitor 12C (step S110).
[0077] The determination unit 22 determines whether or not a signal indicating the stop of the engine or the like has been input from the ignition switch 17 to the input unit 21 (step S111). While the ignition is kept on (step S111: No), the ECU 20 repeats the process from step S103 until it is determined that the ignition is off (step S111: Yes).
[0078] With the above, the image generation process by the ECU 20 according to the embodiment is completed.
[0079] (Overview) In recent years, a technology has been used that displays an image from a camera attached to the rear of a vehicle on an electronic inner mirror to enable the driver to monitor the rear. In addition, when the vehicle is backing up, the image from the camera attached to the rear of the vehicle may be displayed on an in-vehicle monitor to provide driving assistance such as parking or exiting the vehicle. However, in the above case, it is necessary to install a camera for monitoring the rear and a camera for monitoring the surroundings side by side, which increases costs.
[0080] According to the ECU 20 of the embodiment, a partial area is cut out from the rear image captured by the backup camera 11B, and an image for rear monitoring to be displayed on the electronic inner mirror 12M and an image for periphery monitoring to be displayed on the in-vehicle monitor 12C are generated. In this way, by using the backup camera 11B for periphery monitoring also for rear monitoring, costs can be reduced.
[0081] According to the ECU 20 of the embodiment, when generating a rear monitoring image, a position in the rear image on a line horizontal to a line connecting the front and rear ends of the vehicle 10 at the mounting height of the backup camera 11B is made to coincide with the center of the cropping in the vertical direction of the rear image. In this way, by shifting the optical axis VX of the backup camera 11B and the central axis FX in the rear monitoring image in the vertical direction, rear monitoring can be performed as if looking through an optical mirror such as a room mirror.
[0082] According to the ECU 20 of the embodiment, when a rear monitoring image is generated from a rear image captured by the backup camera 11B, distortion of the rear image caused by the wide-angle lens of the backup camera 11B is corrected. This can further reduce the discomfort felt by the driver with respect to the rear monitoring image.
[0083] According to the ECU 20 of the embodiment, when generating a surroundings monitoring image from a rear image of the backup camera 11B, a partial area of the rear image is cut out so that a position in the rear image on a line horizontal to a line connecting the front and rear ends of the vehicle 10 at the mounting height of the backup camera 11B is located above the center of the cut-out in the vertical direction of the rear image. This makes it easy for the driver to check the rear of the vehicle 10, including the road surface near the rear end of the vehicle 10, for example, when reversing the vehicle 10 to park or exit the vehicle.
[0084] According to the ECU 20 of the embodiment, when generating a rear monitoring image, a partial area of the rear image is cut out so that the angle of view of the rear monitoring image is 45° to 70° in the vertical direction and 60° to 110° in the horizontal direction. In this way, by matching the angle of view of the rear monitoring image with a stable gaze field of a human, the driver can check the rear more comfortably.
[0085] According to the ECU 20 of the embodiment, when generating a periphery monitoring image, a partial area of the rear image is cut out so that a position in the rear image on a line horizontal to a line connecting the front and rear ends of the vehicle 10 at the mounting height of the backup camera 11B is located within an area of 10% to 20% from the upper end of the periphery monitoring image. This makes it possible to more reliably display an image including the road surface near the rear end of the vehicle 10 when the vehicle 10 is backing up, etc.
[0086] According to the ECU 20 of the embodiment, a rear monitoring image is generated while the vehicle 10 is normally traveling at a predetermined speed or above (for example, while traveling forward or backward), and a surroundings monitoring image is generated when it is detected that the shift position of the vehicle 10 has been changed to reverse or that the vehicle 10 has become slower than the predetermined speed. In this way, by switching the generated image between rear monitoring and surroundings monitoring according to the speed or shift position of the vehicle 10, an image suited to the driving situation of the vehicle 10 can be presented to the driver.
[0087] According to the ECU 20 of the embodiment, when the function switch 12s provided on the in-vehicle monitor 12C is operated, the rear monitoring image is output to the in-vehicle monitor 12C in addition to the electronic inner mirror 12M. In this way, by configuring the display destination of the image to be appropriately specified according to the desire of the driver, etc., the driver can drive more comfortably.
[0088] In the above embodiment, the function switch 12s provided on the in-vehicle monitor 12C has a display destination designation function for designating the display destination of the rear monitoring image. However, the switch for designating the display destination of the rear monitoring image may be provided in another position in the vehicle interior that can be operated by the driver, such as another part of the instrument panel or the electronic inner mirror 12M, instead of or in addition to the function switch 12s. [Explanation of symbols]
[0089] 10 Vehicles 11B Rear camera 11L, 11R Side camera 11F Front Camera 12C In-car monitor 12M Electronic inner mirror 12s function switch 13 Wheel speed sensor 15 Shift sensor 17 Ignition switch 20 ECU 21 Input section 22 Judgment section 23 Generation part 24 Output section 25 Memory section
Claims
1. an input unit to which a rear image of the vehicle is input from a camera having a wide-angle lens provided at the rear of the vehicle; a generation unit that generates a first image and a second image to be displayed on a predetermined display device by cutting out a partial area from each of the rear images, The generation unit is When generating the first image, a position in the rear image that is on a line horizontal to a line connecting the front and rear ends of the vehicle at a mounting height of the camera is matched with a center of vertical cropping of the rear image, and distortion of the rear image caused by the wide-angle lens is corrected; When generating the second image, the partial area is cut out so that a position in the rear image on a line horizontal to a line connecting the front and rear ends of the vehicle at a mounting height of the camera is located above a center of the cutout in the vertical direction of the rear image. Vehicle control device.
2. an output unit that outputs the first and second images to the predetermined display device; The input unit includes: A shift position detection result from a shift sensor provided in the vehicle and a wheel speed detection result from a wheel speed sensor are inputted, The output unit is outputting the first image when the vehicle is traveling at a predetermined speed or faster; outputting the second image when it is detected that the shift position of the vehicle has been changed to reverse or that the vehicle is traveling at a speed less than the predetermined speed; The vehicle control device according to claim 1 .
3. The predetermined display device includes an electronic inner mirror and an in-vehicle monitor, A switch for designating a display destination of the predetermined image is further provided, The output unit is outputting the first image to at least the electronic inner mirror, and when the switch is operated, outputting the first image to the in-vehicle monitor in preference to the second image; The vehicle control device according to claim 2 .
Citation Information
Patent Citations
Parking auxiliary device
JP2000280823A
Movable body, imaging system, and imaging apparatus
JP2022168699A
Image pickup system and display system
WO2018207393A1
Vehicle rearward monitoring device
JP1996301010A
Cited By
Rear-view mirror capable of displaying object in various environments and control method thereof
WO2026141997A1
