Vehicle display device

The display device integrates a simulated vehicle image with the photographed image to facilitate intuitive recognition of the vehicle's position relative to obstacles, addressing the challenge of positional ambiguity in vehicle display systems that exclude the vehicle from the camera's view.

JP7584011B2Active Publication Date: 2024-11-15MAZDA MOTOR CORP
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2020185847
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-11-06
Publication Date
2024-11-15
Estimated Expiration
2040-11-06

AI Technical Summary

Technical Problem

Existing vehicle display systems that exclude the vehicle from the camera's field of view make it difficult to understand the positional relationship between obstacles and the vehicle, limiting the recognition of the vehicle's position in the captured image.

Method used

A display device that combines a photographed image with a simulated image of the vehicle on the display screen, ensuring the vehicle's position is intuitively recognizable by positioning the simulated image adjacent to the photographed image, using display control to align and overlay the simulated vehicle image with the actual vehicle image.

Benefits of technology

Enables easy recognition of the vehicle's position relative to obstacles in the captured image, enhancing the understanding of the vehicle's surroundings by clearly displaying the vehicle's position through simulated imagery.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007584011000001
    Figure 0007584011000001
  • Figure 0007584011000002
    Figure 0007584011000002
  • Figure 0007584011000003
    Figure 0007584011000003
Patent Text Reader

Abstract

To allow a user to easily recognize a physical relation between an obstacle and an own vehicle in a photographed image even when a portion of the own vehicle is not imaged in the photographed image.SOLUTION: Imaging ranges of left and right lateral cameras K3, K4 are set such that an own vehicle V (a portion thereof) is not imaged. Photographed images G3, G4 acquired by the cameras K3, K4 are displayed on a display screen 10. Simulation images MGL, MGR simulating a portion of the own vehicle V overlooked from each of the cameras K3, K4 are displayed together on the display screen 10. The left side simulation image MGL is displayed on the right side of the left side photographed image G3. The right side simulation image MGR is displayed on the left side of the right side photographed image G4. A vehicle image VG showing the state of the own vehicle V overlooked from above and extracted portion images TGL, TGR showing extracted portions from the vehicle body of the simulation images MGL, MGR may be displayed between the left and right simulation images MGL, MGR.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a display device for a vehicle that displays an image of the surroundings of the vehicle on a display screen. [Background technology]

[0002] In recent years, many vehicles have been equipped with a display screen that displays images of the surroundings of the vehicle. To capture images of the surroundings of the vehicle, for example, a front camera, a rear camera, left and right side cameras, etc. are mounted.

[0003] As shown in Patent Documents 1 and 2, the imaging range of a camera that captures the surroundings of the vehicle is generally set to include a part of the vehicle (the outer hull of the vehicle body). This allows a captured image that includes a part of the vehicle to be displayed on the display screen, making it possible to easily recognize the positional relationship between the vehicle and obstacles present in the vicinity of the vehicle. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2012-054664 A [Patent Document 2] JP 2000-227999 A Summary of the Invention [Problem to be solved by the invention]

[0005] From various viewpoints, it has been considered to set the imaging range of a camera that captures the surroundings of the vehicle so as not to include (a part of) the vehicle itself. For example, when a camera having the same angle of view is used, it is not necessary to include a part of the vehicle in the imaging range, so that the surroundings of the vehicle can be captured over a wider range, which is preferable in terms of increasing the degree of freedom in the mounting position of the camera.

[0006] However, if a portion of the vehicle is not captured in the captured image, it becomes difficult to grasp (recognize) the positional relationship between the vehicle and an obstacle in the captured image, and some kind of measure is desired to address this issue.

[0007] The present invention has been made in consideration of the above-mentioned circumstances, and its object is to provide a display device for a vehicle that makes it easy to recognize the positional relationship between an obstacle in a captured image and the vehicle itself, even when the image captured by the camera is set so that part of the vehicle is not reflected in the image. [Means for solving the problem]

[0008] In order to achieve the above object, in the present invention, a simulated image of a part of the vehicle is displayed on the display screen in addition to the captured image, so that the positional relationship between the vehicle and an obstacle in the captured image can be easily recognized. Specifically, the present invention employs the following solution. That is, an imaging means mounted on a vehicle for capturing an image of the surroundings of the vehicle without capturing the vehicle itself; A display means mounted on the vehicle and set at a position visible to a driver's seat occupant of the vehicle; A display control means for controlling the display means; Equipped with The display control means controls the display means to display the photographed image photographed by the imaging means and a simulated image simulating a part of the vehicle viewed from above from the imaging means so that the simulated image is adjacent to each other and is located on the vehicle side with respect to the photographed image. R, the display control means controls the display means to display a vehicle image simulating the entire vehicle in a planar view, the vehicle image is displayed such that the simulation image is located between the vehicle image and the captured image, and a portion of the vehicle image corresponding to a portion of the vehicle that the simulation image simulates is displayed such that it faces the simulation image; This is how it is.

[0009] According to the above-described solution, it is possible to use a simulated image to enable a driver to intuitively and easily recognize the positional relationship between an obstacle in a captured image and the driver's own vehicle.

[0010] Also,Using the vehicle image is preferable in allowing the driver to recognize which part of the vehicle the simulated image shows.

[0011] The present invention of A preferred embodiment is as follows: the simulated image is an image of a portion of the front or rear of the vehicle in a vehicle width direction, or an image of a portion of a side of the vehicle in a front-rear direction, The display control means displays the extracted portion image indicating the extracted x portion in a combined state with the vehicle image. In this case, it is preferable to use the extracted portion image to allow the driver to more clearly recognize which portion of the vehicle is being shown in the simulated image.

[0012] The present invention of A preferred embodiment is as follows: The imaging range of the imaging means can be selected by a manual operation, the simulated image is an image of a portion of the front or rear of the vehicle in a vehicle width direction, or an image of a portion of a side of the vehicle in a front-rear direction, The wider the imaging range of the selected imaging means, the longer the length of the portion to be extracted. In this case, the simulated image is preferably used to clearly recognize the shooting range of the captured image displayed on the display screen. Also, it becomes possible for the driver to select the width of the surrounding situation to be displayed on the display screen according to his / her preference.

[0013] The present invention of A preferred embodiment is as follows: The imaging means includes a left imaging means for imaging an area around a portion of the left side of the vehicle in the front-rear direction, and a right imaging means for imaging an area around a portion of the right side of the vehicle in the front-rear direction, the display control means displays a left photographed image taken by the left imaging means on the left side of the vehicle image, and causes the display means to display a right photographed image taken by the right imaging means on the right side of the vehicle image, and displays a left simulated image simulating a part of the vehicle viewed from above from the left imaging means between the vehicle image and the left photographed image, and displays a right simulated image simulating a part of the vehicle viewed from above from the right imaging means between the vehicle image and the right photographed image. In this case, it is preferable to use a pair of left and right simulated images to allow the driver to clearly recognize the situations on the left and right sides at once in relation to the position of the vehicle.

[0014] The present invention of A preferred embodiment is as follows: the left simulation image is an extracted portion of a left side of the vehicle in a front-rear direction, the right simulation image is an extracted portion of a right side of the vehicle in a front-rear direction, the display control means displays a left extracted portion image showing a portion extracted in the left simulation image for the vehicle image and a right extracted portion image showing a portion extracted in the right simulation image for the vehicle image in a combined state with the vehicle image, The left extracted portion image is displayed so as to be positioned between the vehicle image and the left simulation image. As well as the right extracted portion image is displayed so as to be located between the vehicle image and the right simulation image; The imaging range of the imaging means can be selected by a manual operation, The wider the imaging range of the selected imaging means, the longer the length of the portion to be extracted. In this case, it is preferable for the driver to more clearly recognize which part of the vehicle is being shown by the pair of left and right simulated images. Also, it is possible for the driver to select the width of the surrounding situation to be displayed on the display screen according to his / her preference.

[0015] The present invention ofA preferred embodiment is as follows: The simulation image is applied to a contour line showing the outer shape of the vehicle in the captured image and to a portion on the vehicle side of the contour line. multiple In this case, the simulated image can be configured to have a pattern of lines or dots, which is preferable in that the portion representing the vehicle can be more clearly and intuitively recognized than when the simulated image is displayed as a solid color. Effect of the Invention

[0016] According to the present invention, even if part of the vehicle is not reflected in the captured image displayed on the display screen, it is possible to easily recognize the positional relationship between an obstacle in the captured image and the vehicle. [Brief description of the drawings]

[0017] [Figure 1] 1 is a left side view of a vehicle to which the present invention is applied; [Diagram 2] FIG. 2 is a rear view of a vehicle to which the present invention is applied. [Diagram 3] 11 is a diagram showing an example in which photographed images of the left and right sides, a simulated image, a vehicle image, and an extracted portion image are displayed on a display screen. FIG. [Figure 4] FIG. 4 shows another example of displaying captured images of the left and right sides, a simulated image, a vehicle image, and an extracted part image on the display screen, in which the captured images are wider in the forward and backward directions than in FIG. 3 . [Diagram 5] 11 is a diagram showing an example in which a captured image of the front and a simulated image are displayed on a display screen. [Figure 6] FIG. 6 shows another example of displaying a captured image of the front and a simulated image on the display screen, in which the captured image has a wider range in the left-right direction than in FIG. 5 . [Figure 7] 11 is a diagram showing an example of displaying a captured rear image and a simulated image on a display screen. FIG. [Figure 8]FIG. 8 shows another example of displaying a rearward captured image and a simulated image on the display screen, in which the captured image has a wider range in the left-right direction than in the case of FIG. 7. [Figure 9] 11 is a diagram showing an example in which a captured image of the front, a simulated image, a vehicle image, and an extracted portion image are displayed on a display screen. [Figure 10] FIG. 10 shows another example of displaying a photographed image of the front, a simulated image, a vehicle image, and an extracted part image on the display screen, in which the photographed image has a wider range in the left-right direction than in FIG. 9 . [Figure 11] FIG. 2 is a diagram showing an example of a control system of the present invention. [Figure 12] 4 is a flowchart showing a control example of the present invention. [Figure 13] FIG. 4 is a diagram showing the relationship among vehicle speed, shift position, and display mode. [Figure 14] FIG. 6 is a diagram showing a modification of FIG. 5, illustrating an example in which a simulated image is constructed using dots. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] 1 and 2, V is a vehicle. The vehicle V is equipped with a front camera K1 that captures the surroundings in front, a rear camera K2 that captures the surroundings in the rear, a left camera K3 that captures the surroundings on the left side, and a right camera K4 that captures the surroundings on the right side. Each of the cameras K1 to K4 constitutes an imaging means and can be constituted by, for example, a CCD camera.

[0019] The front camera K1 is installed at approximately the center of the front end surface of the vehicle V in the vehicle width direction, and is adapted to capture the surrounding conditions in front of the vehicle V including the area immediately in front of the vehicle V, but does not capture the front end of the vehicle V (the front end of the vehicle V is not reflected in the captured image). The capture range of the front camera K1 as viewed from the side is shown as the area hatched with a dashed line in FIG. 1. The capture range of the front camera K1 is a wide angle of approximately 180 degrees in the left-right direction in a plan view. In a plan view, the front end of the vehicle V is gradually inclined backward at each end in the vehicle width direction (left-right direction), but this inclined portion is not included in the capture range of the front camera K1.

[0020] The rear camera K2 is installed at approximately the center of the rear end surface of the vehicle V in the vehicle width direction, and is adapted to capture the surrounding situation behind the vehicle V including the area immediately behind the vehicle V, but does not capture the rear end of the vehicle V (the rear end of the vehicle V is not reflected in the captured image). The capture range of the rear camera K2 as viewed from the side is shown as the area hatched with dashed lines in FIG. 1. The capture range of the rear camera K2 is a wide angle of approximately 180 degrees in the left-right direction in a plan view. In a plan view, the rear end of the vehicle V is gradually inclined forward at each end in the vehicle width direction (left-right direction), but this inclined portion is not included in the capture range of the rear camera K2.

[0021] The left camera K3 is installed on the left side of the vehicle V, more specifically, on the lower end of the left side mirror 1L. This left camera K3 is adapted to capture the surroundings to the left, including the immediate left side of the vehicle V, but does not capture the left side of the vehicle V (the left side of the vehicle V is not reflected in the captured image). The capture range of the left camera K3 is shown as the range hatched with solid lines in Figures 1 and 2. The capture range of the left camera K3 in the front-rear direction is set to a range that slightly overlaps with the capture ranges of the front camera K1 and the rear camera K2 on the road surface R (see Figure 1).

[0022] The right camera K4 is installed on the right side of the vehicle V, more specifically, on the lower end of the right side mirror 1R. This right camera K4 is configured to capture the surroundings to the right, including the immediate right side of the vehicle V, but does not capture the right side of the vehicle V (the right side of the vehicle V is not reflected in the captured image). The capture range of the right camera K4 is shown as the range hatched with solid lines in FIG. 2. The capture range of the right camera K4 is set to be symmetrical to the capture range of the left camera K3.

[0023] The shooting range of each camera K1 to K4 is a wide-angle range, but when the acquired photographed image is displayed on a display screen described later, it is possible to manually select between two modes (display modes): a normal range (narrow range) and a wider wide range. The display range on the display screen associated with the mode change can be changed by image processing.

[0024] As shown in Fig. 13, possible modes are determined in advance according to the vehicle speed. In the example shown in Fig. 13, when the vehicle speed is equal to or higher than a predetermined vehicle speed (15 km / h in this embodiment), the images captured by the cameras K1 to K4 are not displayed on the display screen. This is because it is assumed that the images captured by the cameras K1 to K4 are displayed on the display screen when the vehicle is traveling at a low speed, such as when parking.

[0025] When the vehicle speed is less than the predetermined vehicle speed and the transmission is in reverse (reverse gear), only the rearward image captured by the rear camera K2 is displayed on the display screen. By manually selecting the mode, the display can be arbitrarily selected between a normal range display and a wide range display.

[0026] When the vehicle speed is less than the predetermined vehicle speed and the shift position of the transmission is not reverse, the display of the front photographed image captured by the front camera K1 and the display of the left and right side photographed images captured by the left and right cameras K3 and K4 can be selected. A normal range and a wide range can be selected for the display of the front photographed image, and a normal range and a wide range can be selected for the display of the left and right side photographed images. In other words, when the vehicle is not in reverse, the front photographed image in the normal range, the front photographed image in the wide range, the left and right side photographed images in the normal range, and the left and right side photographed images in the wide range can be arbitrarily selected.

[0027] Next, with reference to Fig. 3, an example will be described in which photographed images of the left and right sides acquired by the left and right cameras K3 and K4 are displayed on the display screen 10. Fig. 3 shows the display when the photographing range is set to the normal range.

[0028] The display screen 10 is, for example, a liquid crystal panel type, and is installed, for example, in approximately the center of the instrument panel in the vehicle width direction, and is set at a position that is easily visible to a driver's seat occupant of the vehicle V. The display screen 10 shown in Fig. 3 is long in the landscape direction.

[0029] At the bottom end of the display screen 10, touch panel switches M1, M2, M3, and M4 for mode selection are set (displayed) spaced apart in the left-right direction. Switch M1 is for selecting whether to display captured images of the left and right sides in a normal range. Switch M2 is for selecting whether to display captured images of the left and right sides in a wide range. Switch M3 is for selecting whether to display captured images of the front in a normal range. Switch M4 is for selecting whether to display captured images of the front in a wide range.

[0030] Each switch M1 to M4 is displayed by combining an illustrated display showing the front half of the vehicle V with an illustrated display showing the shooting direction from the camera position and the width of the shooting range, allowing the switches M1 to M4 to be intuitively distinguished from one another.

[0031] Each switch M1 to M4 is displayed on the display screen 10 only when the vehicle speed is less than a predetermined vehicle speed and the shift position is other than reverse. Then, for example, only the switch that is touched is lit (other switches are darkened), so that the driver can easily visually confirm which switch (mode) is selected. In FIG. 3, since the display of the captured images of the left and right sides in the normal range has been selected, only switch M1 is lit brightly. In FIG. 3, the lit state is indicated by blackening the portion of switch M1 that illustrates the capture range, etc.

[0032] The display screen 10 is divided into a total of five regions in the left-right direction to provide display areas corresponding to various images described later. These five regions are, from left to right, a left region LK, a left middle region LG, a central region C, a right middle region RG, and a right region RK. The left regions LK and LG are set to be symmetrical with the right regions RK and RG with the central region C in between.

[0033] A left photographed image G3 showing the situation on the left side captured by the left camera K3 is displayed in the left area LK of the display screen 10. A right photographed image G4 showing the situation on the right side captured by the right camera K4 is displayed in the right area RK of the display screen 10. In the example of FIG. 3, the left photographed image G3 includes a left-side dividing line 20L showing the division of the lane in which the vehicle V is traveling. Also, the right photographed image G4 includes a right-side dividing line 20R showing the division of the lane in which the vehicle V is traveling.

[0034] The left middle area LG displays a simulated image MGL that is a simulated display of a part of the left side of the vehicle V as viewed from the left camera K3. Similarly, the right middle area RG displays a simulated image MGR that is a simulated display of a part of the right side of the vehicle V as viewed from the right camera K4.

[0035] Each of the simulated images MGL and MGR is composed of a contour line 31 showing the outline of the side of the vehicle body, which is displayed along the captured image G3 or G4, and a pattern 32 consisting of double hatching with many intersecting lines on the part closer to the vehicle body than the contour line 31. By constructing the simulated images MGL and MGR as described above, the driver can intuitively (extremely easily) recognize that it is the side of the vehicle body.

[0036] That is, on the left side, when an obstacle is reflected in the left photographed image G3, the distance to the obstacle can be easily recognized from the positional relationship with the left simulated image MGL, based on the positional relationship between the left photographed image G3 and the left simulated image MGL. Similarly, on the right side, when an obstacle is reflected in the right photographed image G4, the distance to the obstacle can be easily recognized from the positional relationship with the right simulated image MGR, based on the positional relationship between the right photographed image G4 and the right simulated image MGR. It is also possible to display the area from the position corresponding to the contour line 31 to the vehicle body side as the simulated image MGL or MGR in a single color, but in this case, the area showing the vehicle body is displayed as a monotonous solid color, which makes it difficult to recognize it as a vehicle body compared to the display using the pattern 32.

[0037] A planar view image HG is displayed in the central region C. This planar view image HG has, broadly speaking, a vehicle image VG consisting of an illustrated display that is a schematic overall view of the vehicle V viewed from above, and a pair of left and right extracted portion images TGL, TGR extending from the vehicle image VG. Note that the vehicle image VG may be an image that is actually captured from above the vehicle V.

[0038] The vehicle image VG is displayed so that the upper side is the front of the vehicle V. That is, the left side of the vehicle image VG faces the left photographed image G3, and it is intuitively recognized that the photographed image G3 shows the surroundings on the left side. Similarly, the right side of the vehicle image VG faces the right photographed image G4, and it is intuitively recognized that the photographed image G4 shows the surroundings on the right side.

[0039] The simulated images MGL and MGR correspond to an extracted portion of the front-rear direction of the side of the vehicle V, and the extracted portion images TGL and TGR are designed to intuitively display the extracted portion in the simulated images MGL and MGR, respectively. That is, the extracted portion images TGL and TGR are displayed so as to spread leftward or rightward from the portion extracted when the simulated images TGL and TGR are created, so that the driver can intuitively recognize which portion of the side of the vehicle V the simulated images TGL and TGR correspond to. In FIG. 3, the length of the extracted portion in the left extracted portion image TGL (extracted length in the front-rear direction) is indicated by an arrow Y1, and the front-rear direction length of the left simulated image TGL corresponding to the length indicated by the arrow Y1 is indicated by an arrow Y2.

[0040] When the normal range mode is selected, the range of the extracted portion images TGL and TGR in the front-to-back direction is short. In contrast, when the wide range mode is selected, the range of the extracted portion images TGL and TGR in the front-to-back direction is long (see also FIG. 4 described later). Due to the difference in the length in the front-to-back direction between the extracted portion images TGL and TGR, it is possible to intuitively recognize whether the display is in the normal range mode or the wide range mode.

[0041] Fig. 4 shows a display example in which images captured by the left and right cameras K3 and K4 are displayed on the display screen 10 in wide-range mode by operating (selecting) switch M2. Of the switches M1 to M4, only the switch M2 that is selected is displayed brightly. Also, to indicate that the extracted portion images TGL and TGR are in the wide-range display mode, they are displayed longer toward the rear than in the case of Fig. 3.

[0042] Fig. 5 shows an example of a case where an image captured by the front camera K1 is displayed on the display screen 10. Fig. 5 shows a case where the switch M3 is operated to select the normal range mode, and only the switch M3 is lit. The captured image G1 showing the surrounding conditions ahead is displayed in a horizontally long rectangular area. In addition, a simulated image MGF showing a part of the vehicle V as viewed from the front camera K1 is displayed directly below the area displaying the captured image G1.

[0043] The simulated image MGF is composed of a contour line 31 showing a part of the front end of the vehicle V (mainly the central part in the vehicle width direction), and a pattern 32 made up of many intersecting lines below the contour line 31 (rear of the vehicle V). Note that in the example shown in Fig. 5, the vehicle image and the extracted portion image are not displayed.

[0044] 6 shows a display example in which a captured image G1 captured by a front camera K1 is displayed in a wide range mode on the display screen 10 by operating (selecting) the switch M4. Of the switches M1 to M4, only the selected switch M4 is displayed brightly.

[0045] In the wide-range mode, the lower end of the area showing the captured image G1 is curved so as to be convex downwardly corresponding to the rear of the vehicle (the effect of wide-angle photography). In addition, in the simulated image MGF, the contour line 31 is composed of a central line 31C, a left side line 31L that extends short from the left end of the central line 31C toward the lower left, and a right side line 31R that extends short from the right end of the central line 31C toward the lower right.

[0046] The center line portion 31C corresponds to the center portion in the vehicle width direction of the front end of the vehicle V, and extends long in the left-right direction along the downwardly convex portion of the area in which the photographed image G1 is displayed. The left side line 31L corresponds to the portion of the front end of the vehicle where the left end in the vehicle width direction is inclined toward the rear. The right side line 31R corresponds to the portion of the front end of the vehicle where the right end in the vehicle width direction is inclined toward the rear.

[0047] Fig. 7 shows an example in which a captured image G2 showing the surrounding conditions behind the vehicle captured by the rear camera K2 is displayed on the display screen 10. The shift position is reverse, and two touch-type switches M11 and M12 are displayed at the bottom end of the display screen 10. Switch M11 is for selecting a normal range mode. Switch M12 is for selecting a wide range mode. Fig. 7 shows an example of a display in the normal range mode when switch M11 is operated (selected).

[0048] The captured image G2 showing the surrounding situation behind the vehicle is displayed in a horizontally long rectangular area, and a simulated image MGRR showing a simulated part of the vehicle V as viewed from the rear camera K2 is displayed directly below the area displaying the captured image G2.

[0049] The simulated image MGRR is composed of a contour line 31 showing a part of the rear end of the vehicle V (mainly the central part in the vehicle width direction), and a pattern 32 of many intersecting lines below the contour line 31 (rear of the vehicle V). Note that in the example shown in Fig. 7, the vehicle image and the extracted portion image are not displayed. The display example shown in Fig. 7 corresponds to the display example in Fig. 5 described above.

[0050] 8 shows a display example in which an image G2 captured by the rear camera K2 is displayed in a wide range mode on the display screen 10 by operating (selecting) the switch M12. Only the selected switch M12 is displayed brightly.

[0051] In the wide-range mode, the lower end of the area showing the captured image G2 is curved so as to be convex downwardly corresponding to the rear of the vehicle (the effect of wide-angle shooting). In addition, in the simulated image MGRR, the contour line 31 is composed of a central line 31C, a right side line 31R that extends short from the left end of the central line 31C toward the lower left, and a left side line 31L that extends short from the right end of the central line 31C toward the lower left. Note that since FIG. 8 shows the surrounding situation behind, the left and right relationships are reversed compared to the case of FIG. 6 that shows the surrounding situation in front (the left side in FIG. 8 corresponds to the right side of the vehicle V).

[0052] The center line portion 31C corresponds to the center portion in the vehicle width direction of the rear end portion of the vehicle V, and extends long in the left-right direction along a portion that is convex downward in the area displaying the photographed image G2. The left side line 31L corresponds to a portion of the rear front end portion of the vehicle where the left end portion in the vehicle width direction is inclined forward. The right side line 31R corresponds to a portion of the rear end portion of the vehicle where the right end portion in the vehicle width direction is inclined forward.

[0053] Fig. 9 is a modified example of Fig. 5, and shows an example in which a planar image HG consisting of a vehicle image VG and an extracted part image TGF is displayed on the display screen 10 in addition to the photographed image G1 captured by the front camera K1. Note that the display screen 10 is longer in the vertical direction than the case shown in Fig. 5.

[0054] The planar image HG is displayed directly below the simulated image MGF. Specifically, the vehicle image VG is displayed so that the left-right center position of the captured image G1 (the area displaying it) coincides with the left-right center line of the vehicle image VG. The vehicle image VG is also displayed so that the top of the figure is the front of the vehicle V.

[0055] The extracted part image TGF is displayed fanning out from the front end of the vehicle image VG toward the top (corresponding to the front of the vehicle V). Since Fig. 9 shows the display in the normal range mode, the left-right spread of the extracted part image TGF is relatively small.

[0056] FIG. 10 shows a case where switch M4 is operated to display in a wide-range mode when a planar image HG consisting of a vehicle image VG and an extracted part image TGF is displayed on the display screen 10 in addition to the captured image G1 acquired by the forward camera K1.

[0057] In Fig. 10, the display of the photographed image G1 and the simulated image MGF is the same as in Fig. 6. Also, in Fig. 10, the extracted portion image TGF is in a wide range mode, so the left-right spread is larger than in Fig. 9.

[0058] A planar image (vehicle image + extracted part image) can also be displayed when the photographed image captured by the rear camera K4 is displayed on the display screen 10. A display example in this case is omitted, but it corresponds to the display in Fig. 9 and Fig. 10 (however, the vehicle image VG is displayed so that the rear side faces upward on the display screen 10).

[0059] 11 shows an example of a control system for controlling the display of captured images and the like on the display screen 10. In the figure, U is a display control unit configured using a microcomputer, and corresponds to a display control means. The display on the display screen 10 (display) 10 is controlled by this display control unit U. For this control, in addition to the captured images (video signals) from the cameras K1 to K4, a vehicle speed signal from a vehicle speed sensor 11, a shift position signal from a shift position sensor 12, and a command signal from a switch 13 are input to the display control unit U.

[0060] The switch 13 is an ON / OFF switch for selecting whether or not to display the captured image on the display screen 10, and is provided at a position where it is easy for the driver to operate. The switch 13 can also be provided with a function for setting an initial screen when the captured image is displayed. That is, the mode for displaying the captured image acquired by the rear camera K2 initially when the reverse is selected as the shift position can be set to either a normal range or a wide range. Also, the mode for displaying the captured image initially when a position other than the reverse is selected as the shift position can be set to either a normal range or a wide range for the image captured by the front camera K1, or a normal range or a wide range for the images captured by the left and right side cameras K3 and K4. When an image captured by any of the cameras is displayed on the display screen 10, the mode is selected by the above-mentioned switches M1 to M4, or M11 and M12 displayed on the display screen 10. Also, when a new captured image is displayed on the display screen 10, it can be displayed in the previous display mode.

[0061] Fig. 12 is a flowchart showing an example of control by the display control unit U. This control example in Fig. 12 controls the display on the display screen 10 so that the display contents correspond to each of the above-mentioned modes. Note that the simulation image, vehicle image, and extracted portion image are created and stored in advance corresponding to each mode (for example, stored as a database in the ROM of the display control unit U). In the following explanation, S indicates a step.

[0062] First, in S1, switch operation information, vehicle speed, and shift position are acquired. Next, in S2, the mode selection status is acquired on the condition that the vehicle speed is less than a predetermined vehicle speed. In S3, the captured image is acquired from the camera according to the selected mode.

[0063] In S4, the photographed image acquired in S3 is corrected and trimmed depending on whether the mode acquired in S2 is a normal range mode or a wide range mode.

[0064] In S5, a simulated image and a planar image (a vehicle image and an extracted part image) corresponding to the selected mode are selected from the database, superimposed on the captured image processed in S4, and the superimposed display content is displayed on the display screen 10. After the superimposed display content is displayed on the display screen 10 in S5, the simulated image and the planar image remain displayed in the same manner (unchanged) unless the mode is changed.

[0065] Fig. 13 shows a modified example of the simulated image and corresponds to Fig. 5. The simulated image MGF shown in Fig. 13 has a pattern 33 made up of many dots instead of the pattern 32 made up of intersecting lines shown in Fig. 5. Each dot constituting the dot pattern 33 can be any suitable shape (for example, a circle, a star, etc.).

[0066] Although the embodiment has been described above, the present invention is not limited to the embodiment, and can be appropriately modified within the scope of the claims, including the following cases. The cameras whose shooting range is set so that a part of the vehicle is not reflected can be appropriately set to only the front camera K1, only the rear camera K2, or only the left and right side cameras K3 and K4. For example, the shooting range of the left and right side cameras K3 and K4 can be set so that a part of the vehicle is not reflected, while the front camera K1 and the rear camera AK2 can be set so that a part of the vehicle is reflected. Although two types of modes, normal range and wide range, can be set for each camera K1 to K4, only one type of mode, or three or more types of modes can be set. It is also possible to display the vehicle image while not displaying the extracted part image. Of course, the object of the present invention is not limited to what is clearly stated, and also implicitly includes providing what is substantially preferable or expressed as an advantage. [Industrial Applicability]

[0067] The present invention is preferably applied to a vehicle that displays, on a display screen, a captured image showing the surrounding conditions of the vehicle. [Explanation of symbols]

[0068] V: Vehicle R: Road surface K1: Front camera K2: Rear camera: K3: Left camera K4: Right camera MGF: Simulated image (for front camera) MGRR: Simulated image (for rear camera) MGL: Simulated image (for left camera) MGR: Simulated image (for right camera) HG: Planar image VG: Vehicle image TGF: Extracted part image (for front camera) TGL: Extracted part image (for left camera) TGR: Extracted part image (for right camera) 1L:1R:Side mirror 10:Display screen 11: Vehicle speed sensor 12: Shift position sensor 13: Switch

Claims

1. an imaging means mounted on a vehicle for capturing an image of the surroundings of the vehicle without capturing the vehicle itself; A display means mounted on the vehicle and set at a position visible to a driver's seat occupant of the vehicle; A display control means for controlling the display means; Equipped with the display control means controls the display means to display the captured image captured by the imaging means and a simulated image simulating a part of the vehicle viewed from the imaging means so as to be adjacent to each other and so as to position the simulated image on the vehicle side relative to the captured image, the display control means controls the display means to display a vehicle image simulating the entire vehicle in a planar view, the vehicle image is displayed such that the simulation image is located between the vehicle image and the captured image, and a portion of the vehicle image corresponding to a portion of the vehicle that the simulation image simulates is displayed such that it faces the simulation image; A display device for a vehicle.

2. In claim 1, the simulated image is an image of a portion of the front or rear of the vehicle in a vehicle width direction, or an image of a portion of a side of the vehicle in a front-rear direction, the display control means displays an extracted portion image indicating the extracted portion in a state where the extracted portion image is combined with the vehicle image. A display device for a vehicle.

3. In claim 1 or claim 2, The imaging range of the imaging means can be selected by a manual operation, the simulated image is an image of a portion of the front or rear of the vehicle in a vehicle width direction, or an image of a portion of a side of the vehicle in a front-rear direction, The wider the imaging range of the selected imaging means, the longer the length of the portion to be extracted. A display device for a vehicle.

4. In any one of claims 1 to 3, The imaging means includes a left imaging means for imaging an area around a portion of the left side of the vehicle in the front-rear direction, and a right imaging means for imaging an area around a portion of the right side of the vehicle in the front-rear direction, the display control means displays a left photographed image taken by the left imaging means on the left side of the vehicle image, and causes the display means to display a right photographed image taken by the right imaging means on the right side of the vehicle image, and displays a left simulated image simulating a part of the vehicle viewed from above from the left imaging means between the vehicle image and the left photographed image, and displays a right simulated image simulating a part of the vehicle viewed from above from the right imaging means between the vehicle image and the right photographed image. A display device for a vehicle.

5. In claim 4, the left simulation image is an extracted portion of a left side of the vehicle in a front-rear direction, the right simulation image is an extracted portion of a right side of the vehicle in a front-rear direction, the display control means displays a left extracted portion image showing a portion extracted in the left simulation image for the vehicle image and a right extracted portion image showing a portion extracted in the right simulation image for the vehicle image in a combined state with the vehicle image, the left extracted portion image is displayed so as to be positioned between the vehicle image and the left simulation image, and the right extracted portion image is displayed so as to be positioned between the vehicle image and the right simulation image, The imaging range of the imaging means can be selected by a manual operation, The wider the imaging range of the selected imaging means, the longer the length of the portion to be extracted. A display device for a vehicle.

6. In any one of claims 1 to 5, A display device for a vehicle, characterized in that the simulated image is composed of a contour line indicating the outer shape of the vehicle facing the captured image, and a pattern consisting of a plurality of lines or dots applied to an area on the vehicle side of the contour line.

Citation Information

Patent Citations

  • Looking-around composite graph overlapping region dividing method and looking-around composite graph representing method

    CN103377372A

  • Driving support device

    JP2000227999A

  • Vehicle periphery visual recognition apparatus

    JP2005086754A

  • Image processing device, image display system, and image display method

    JP2012054664A

  • Vehicle support apparatus for reverse parking, and program for the apparatus

    JP2012066700A