Rear object confirmation device and rear object confirmation system

The rear object confirmation device adjusts warning lines to match road markers, enabling accurate visual and auditory warnings for safe reversing by objectively determining object danger, addressing the limitations of existing rearview systems.

JP7611282B2Active Publication Date: 2025-01-09KEIYO ENGKK
View PDF 16 Cites 0 Cited by

Patent Information

Application Number
JP2023038839
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-03-13
Publication Date
2025-01-09
Estimated Expiration
2043-03-13

AI Technical Summary

Technical Problem

Existing rearview camera systems struggle to accurately display a safety range behind vehicles during reversing, making it difficult for drivers to visually confirm objects and determine their danger levels without error.

Method used

A rear object confirmation device that adjusts warning lines on a display to match predetermined markers on the road, allowing for objective determination of object danger based on positional relationships, and changes display colors and sounds alarms accordingly.

Benefits of technology

Enhances driver safety by providing accurate visual and auditory warnings of potential collisions, ensuring safe vehicle reversing by objectively determining object danger and adjusting display settings for various vehicle conditions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007611282000001
    Figure 0007611282000001
  • Figure 0007611282000002
    Figure 0007611282000002
  • Figure 0007611282000003
    Figure 0007611282000003
Patent Text Reader

Abstract

To provide a rear object confirmation device for objectively determining the risk of an object approaching a rear side of a vehicle when the vehicle moves backward.SOLUTION: A rear object confirmation system 1 includes: a camera 2 for photographing a rear side of a vehicle; a monitor 3 for displaying the image of the camera; and a rear object confirmation device 7. The rear object confirmation device 7 performs: pre-adjusting warning lines WL2, WL1 indicating a distance from a rear end of the vehicle and a vehicle width (Fig.6-10); allowing the monitor to display the warning lines when moving backward; determining the risk of the object according to a positional relation between an existence area A of an approaching object and the warning lines; and issuing a warning by a buzzer 4 (Fig.11, 12). The warning lines WL2, WL1 are adjusted on the monitor so as to meet sign lines SL1, 2 arranged on a road (Fig.4, 5).SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a rear object confirmation device or system that can confirm objects behind a vehicle when the vehicle is reversing and output an alarm if necessary, and in particular to a rear object confirmation device or system that can arbitrarily set the detection range for objects behind the vehicle. [Background technology]

[0002] On June 9, 2021, the Ministry of Land, Infrastructure, Transport and Tourism announced that, in light of the fact that the "Agreement Regulations on Vehicle Rear-End Check Devices When Reversing (No. 158)" was newly adopted by the World Forum for Harmonization of Vehicle Regulations (WP29) of the United Nations Economic Commission for Europe, Japan will also introduce these regulations and revise safety standards to reflect other revised regulations in the safety standards. On June 10, 2021, the "Standards on Vehicle Rear-End Check Devices When Reversing" came into effect. As a result, it has become mandatory for new vehicles such as trucks to be equipped with a vehicle rear-end check device such as a backup camera when reversing. According to the above standards, a backup camera is required to be able to check an area from 0.3 to 3.5 meters behind the vehicle body, and to be able to check objects up to 0.8 meters high, such as poles and children. Summary of the Invention [Problem to be solved by the invention]

[0003] Back monitors, which are equipped with a camera at the rear of a vehicle and display an image of the rear of the vehicle on a monitor in the driver's seat, are already in widespread use, allowing drivers to visually check people, objects, etc. behind the vehicle and confirm safety when backing up the vehicle into a garage, etc. However, in the recent legal amendments that have made it mandatory to install a vehicle rearward check device when backing up, it is required to specify a specific distance behind the vehicle, and in reality it is not necessarily easy for the driver to accurately check the safety of a specific range behind the vehicle body simply by visually estimating the area on the back monitor with the driver's naked eye.

[0004] The present invention has been made in consideration of the above-described conventional technology and its problems, and aims to provide a rear object confirmation device or system for checking objects present behind a vehicle when the vehicle is reversing, which can arbitrarily adjust a warning line indicating the distance from the rear end of the vehicle and display it on a rear monitor, and can objectively determine the danger level of an object depending on the positional relationship between the object displayed on the monitor and the adjusted warning line when the vehicle is reversing. [Means for solving the problem]

[0005] The rear object confirmation device according to claim 1 comprises: A rear object confirmation device that confirms an object behind a vehicle and judges a degree of danger, In a display device mounted on a vehicle, warning lines including a vehicle width warning line defining the vehicle width and a distance warning line perpendicular to the vehicle width warning line and indicating a distance from the rear end of the vehicle in a direction in which the vehicle is moving backward, The vehicle is set on the road behind the vehicle, and the vehicle width marking line is a line perpendicular to the vehicle width marking line, and the distance marking line is a line indicating the distance from the rear end of the vehicle in the direction in which the vehicle is reversing. The distance warning line is translated in a direction perpendicular to the vehicle width direction to match the distance marker line, and both ends of the distance warning line are translated in the vehicle width direction to match both ends of the distance marker line, a warning line display / adjustment unit for adjusting and displaying the warning line so that the warning line indicates the same range as the marker line in the display device; an obstacle determination unit that detects an object presence area displayed on the display device when the vehicle is backing up, and determines a degree of danger of the object according to a positional relationship between the adjusted warning line displayed on the display device and the object presence area; Equipped with death, The existence area is a display surrounding the periphery of the object, and when the warning area surrounded by the warning line and the existence area overlap even partially, the display color of the existence area is changed according to the position. It is characterized by the following.

[0006] The rear object confirmation system according to claim 2 comprises: An image capturing device provided at a rear end of the vehicle for capturing an image of the rear of the vehicle; a display device mounted on the vehicle and displaying an image of the rear of the vehicle captured by the imaging device; a rear object confirmation device that arbitrarily adjusts a warning line indicating the distance from the rear end of the vehicle and the vehicle width and displays it on the display device, and determines the degree of danger of an object according to the positional relationship between the object displayed on the display device and the adjusted warning line; A rear object confirmation system for confirming an object behind a vehicle, comprising: The rear object confirmation device is In the display device, warning lines including a vehicle width warning line defining the vehicle width and a distance warning line perpendicular to the vehicle width warning line and indicating a distance from the rear end of the vehicle in a direction in which the vehicle is moving backward, The vehicle is set on the road behind the vehicle, and the vehicle width marking line is a line perpendicular to the vehicle width marking line, and the distance marking line is a line indicating the distance from the rear end of the vehicle in the direction in which the vehicle is reversing. The distance warning line is translated in a direction perpendicular to the vehicle width direction to match the distance marker line, and both ends of the distance warning line are translated in the vehicle width direction to match both ends of the distance marker line, a warning line display and adjustment unit for adjusting and displaying the warning line so that the warning line indicates the same range as the marker line; an obstacle determination unit that detects an object presence area displayed on the display device when the vehicle is backing up, and determines a degree of danger of the object according to a positional relationship between the adjusted warning line displayed on the display device and the object presence area; Have death, The existence area is a display surrounding the periphery of the object, and when the warning area surrounded by the warning line and the existence area overlap even partially, the display color of the existence area is changed according to the position. It is characterized by the following.

[0007] The rear object confirmation system according to claim 3 is the rear object confirmation system according to claim 2, The vehicle is characterized by comprising a warning output device for outputting a necessary warning based on the result of the determination made by the rear object confirmation device. Effect of the Invention

[0011] According to the rear object confirmation device described in claim 1 and the rear object confirmation system described in claim 2, an image of the rear of the vehicle and a warning line indicating the distance from the rear end of the vehicle and the vehicle width are superimposed on the display device. Also, depending on the positional relationship between an object that has entered the display screen of the display device and the warning line, the risk of the object colliding with the vehicle is judged. When backing up the vehicle, the driver can use the warning line as a guide to check the risk of an object behind the vehicle on the display screen of the display device, allowing for safe driving. In addition, in the adjustment work before use, a warning line indicating the distance from the rear end of the vehicle is displayed on the display device by using the warning line display / adjustment unit of the rear object confirmation device, and further, the position of the warning line on the display screen of the display device can be adjusted so that a sign line previously provided on the road behind the vehicle matches the warning line on the display device. Then, after the adjustment work, when the vehicle is reversed, the obstacle determination unit of the rear object confirmation device detects the presence area of ​​the object displayed on the display screen of the display device and can determine the danger of the object according to the positional relationship between the warning line and the presence area on the display screen of the display device, so that the driver can drive safely based on the determination so as not to come into contact with the object and the vehicle. In addition, during adjustment work before use, the vehicle width warning line and distance warning line displayed on the display screen of the display device can be matched with the vehicle width sign line and distance sign line on the road displayed on the display screen of the display device, respectively, so that the range indicated by the warning lines on the display screen of the display device can be set to the desired vehicle width and distance from the vehicle. Furthermore, when reversing the vehicle, if the object presence area displayed on the display screen of the display device overlaps even partially with a warning area surrounded by a warning line displayed on the display screen of the display device, the display color of the object presence area is changed depending on the position, so that the driver can intuitively know the degree of danger of the object from the displayed color.

[0012] Claim 3 According to the rear object confirmation system described in ,rearBased on the results of the judgment made by the photographing device, the warning output device can output the necessary warning, which has the effect of improving safety compared to a case where the degree of danger of objects behind the vehicle is confirmed only by visually checking the display screen of the display device. [Brief description of the drawings]

[0016] [Figure 1] 1 is a schematic structural diagram showing an overall configuration of a rear object checking device according to an embodiment; [Diagram 2] 1 is a control block diagram showing an overall configuration of a rear object checking device according to an embodiment; [Diagram 3] 2 is a diagram showing an example of a display screen of a monitor of the rear object checking device according to the embodiment; FIG. [Figure 4] FIG. 1 is a diagram showing a vehicle equipped with a rear object confirmation device according to an embodiment, in which FIG. 1A is a side view showing the mounting position of the camera, and FIG. 1B is a plan view showing an example of a marker line set on the road behind the vehicle as a landmark during adjustment. [Diagram 5] 1 is a perspective view showing an operation of setting a marker line, which serves as a mark for adjusting a warning line, on a road behind a vehicle in the rear object checking device according to an embodiment; FIG. [Figure 6] FIG. 13 is a diagram showing an example of a display screen on a monitor of a rear object confirmation device according to an embodiment, in which an image of a sign line set on a road behind a vehicle is displayed superimposed on an unadjusted warning line. [Figure 7] FIG. 13 is a diagram showing warning lines displayed on a monitor of the rear object confirmation device of the embodiment, and is a work instruction diagram showing the order of adjustment by moving the vehicle width warning line and the distance warning line. [Figure 8] FIG. 4 is a diagram showing an adjustment display screen for warning lines on a monitor of the rear object confirmation device according to the embodiment, illustrating a state in which four distance warning lines are aligned with four corresponding distance sign lines. [Figure 9]FIG. 13 is a diagram showing an adjustment display screen for warning lines on a monitor of the rear object confirmation device according to the embodiment, illustrating a state in which one vehicle width warning line (left side) is aligned with a corresponding one vehicle width sign line (left side). [Figure 10] FIG. 11 is a diagram showing an adjustment display screen of the warning line on the monitor of the rear object confirmation device of the embodiment, showing a state in which the remaining vehicle width warning line (right side) is aligned with the corresponding remaining vehicle width sign line (right side). [Figure 11] 4 is a diagram of a display screen that shows a schematic diagram of the positional relationship between an object presence area and a warning line on the monitor of the rear object checking device according to the embodiment; FIG. [Figure 12] 2 is a diagram showing an example of a display screen of a monitor of the rear object checking device according to the embodiment; FIG. [Figure 13] FIG. 4A is a plan view showing a second example shape of a marking line to be set on the road behind a vehicle, and FIG. 4B is a diagram of a display screen showing a warning line adjusted using the marking line shown in FIG. 4A. [Figure 14] FIG. 4A is a plan view showing a third example shape of a marking line to be set on the road behind a vehicle, and FIG. 4B is a diagram of a display screen showing a warning line adjusted using the marking line shown in FIG. 4A. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] The configuration of a rear object confirmation system 1 according to the embodiment will be described with reference to FIGS. 1 to 3. FIG. The rear object confirmation system 1 of the embodiment described below conforms to the above-mentioned "Standards for Devices for Confirming Immediately Behind a Vehicle When Backing Up" and has the ability to confirm on a monitor a predetermined warning range defined by a distance of, for example, 0.3 m to 3.5 m behind the vehicle and the vehicle width of the vehicle. However, when photographing with a camera, the warning range displayed on the display screen 30 of the monitor differs depending on the vehicle width of the vehicle on which the camera is mounted, the position (particularly the height) at which the camera is attached, and other factors.

[0018] Therefore, in this embodiment, a predetermined warning range is actually created by sticking tape on the road behind the vehicle, and the position of the warning line as a control display can be adjusted to match the warning range of the tape on the monitor display screen 30. As a result, regardless of the type of vehicle with different conditions such as vehicle width, camera specifications, and installation height, and regardless of the dimensions of the target predetermined warning range, the position and size of the warning line displayed on the monitor can be arbitrarily adjusted to match the required warning range.

[0019] The rear object confirmation system 1 of this embodiment shown in the schematic configuration diagram of Figure 1 is a system that is mounted on a vehicle and used by the driver to check the rear of the vehicle, and is equipped with a camera 2 as an imaging device that captures images of the area behind the vehicle, a monitor 3 as a display device that displays the images captured by the camera 2, a buzzer 4 as an alarm output device, a GPS (Global Positioning System) antenna 5 as information acquisition means, a manual recording switch 6 that also serves as a microphone, and a rear object confirmation device 7 to which these components are connected.

[0020] The camera 2 and monitor 3 in the configuration example shown in Fig. 1 are used in a conventional single-function rear confirmation device that captures and displays the rear of the vehicle, and are connected to the rear object confirmation device 7 of this embodiment for reuse. Therefore, the camera 2 and monitor 3 are connected to an on-board power supply by a power cable (not shown), but power may be supplied from the rear object confirmation device 7 connected to the on-board power supply. The GPS antenna 5 acquires position information and provides it to the rear object confirmation device 7. Also, by operating the manual recording switch 6, the image displayed on the monitor 3 can be recorded and stored in a storage unit 12 (see Fig. 2) described later together with position information and time information.

[0021] As shown in the control block diagram of Fig. 2, the rear object confirmation device 7 includes a control unit 8 which is the core of the functions of integrating various controls for rear object confirmation. That is, the control unit 8 transmits and receives video signals and control signals between the camera 2 and the monitor 3, and as shown in Fig. 3, has the functions of integrating controls such as causing the monitor 3 to display an image of the rear of the vehicle and various control images superimposed thereon, detecting an object displayed on the display screen 30, determining the type of object, and controlling the buzzer 4 to generate an alarm as necessary in cooperation with other functional parts.

[0022] 3 is a diagram showing an example of a display screen 30 on the monitor 3 of the rear object confirmation device 7. As shown in this figure, images displayed on the display screen 30 of the monitor 3 include an actual image behind the vehicle (in FIG. 3, white lines W dividing the parking lot, other cars C, pylons P, etc. are displayed), warning lines WL (vehicle width warning line WL1 and distance warning line WL2 (WL21, WL22, WL23, WL24) which are control images indicating the predetermined warning range, a frame-shaped presence area A indicating that an object has been detected, vehicle position coordinates 20, a time stamp 21, a vehicle movement direction 22, a recording state 23, a microphone state 24, a GPS reception state 25, and a state 26 of a memory card which is an external storage medium.

[0023] 2, the rear object confirmation device 7 has a warning line display and adjustment unit 9. The warning line display and adjustment unit 9 is connected to the control unit 8, and has a function of displaying a warning line WL, which is a control image indicating the distance from the rear end of the vehicle and the vehicle width, on the display screen 30 of the monitor 3 by cooperating with the control unit 8, and also of moving the warning line on the display screen 30 to adjust its position.

[0024] As shown in Fig. 2, the rear object confirmation device 7 has an obstacle determination unit 10. The obstacle determination unit 10 is connected to the control unit 8, and by working together with the control unit 8, has the functions of detecting a presence area A (see Fig. 3) of an object displayed on the camera 2 when the vehicle is backing up, comparing this presence area A with an adjusted warning line WL displayed on the monitor 3, and determining the danger level of the object according to their positional relationship.

[0025] As shown in FIG. 2, the rear object confirmation device 7 has an input unit 11. The input unit 11 is connected to the control unit 8, and can input instructions and data required to operate the rear object confirmation device 7, as well as to operate the rear object confirmation device 7 on and off. Specifically, the driver can operate the input unit 11 to cause the warning line display / adjustment unit 9 to function to display the warning line WL on the monitor 3, and can input instructions to move the displayed warning line WL for adjustment, and can also input instructions required to operate the obstacle determination unit 10. The input unit 11 includes push-button type function switches, a numeric keypad, directional buttons such as an up button, a down button, a right button, and a left button for moving display elements on the monitor 3 in each direction, and a confirmation button for confirming switch or button operations, and these switches or buttons may be displayed on the monitor 3.

[0026] 2, the rear object confirmation device 7 has a storage unit 12. The storage unit 12 is connected to the control unit 8, and stores data necessary for the operation of the rear object confirmation device 7 and software for operating each unit of the rear object confirmation device 7. The data includes, for example, original line data of the warning line WL displayed on the display screen 30 of the monitor 3, line adjustment data which is data of the warning line WL after adjustment, and recorded data of the image displayed by the monitor 3, and the software includes, for example, various software for operating each unit of the rear object confirmation device 7 as described above.

[0027] The rear object confirmation device 7 has an internal memory as well as a memory card, which is an external storage medium, as the storage unit 12. The memory card is removable and can be attached to and used in another rear object confirmation device 7, or the data can be copied onto multiple memory cards and attached to and used in object confirmation devices installed in multiple other automobiles with the same conditions.

[0028] A method for adjusting the rear object confirmation system 1 according to the embodiment before use will be described with reference to FIGS. 4 and 5, a predetermined warning range is actually formed using adhesive tape or the like on the road behind a vehicle 50 equipped with the rear object confirmation system 1. As shown in Figures 4(a) and (b), the camera 2 attached to the rear end of the vehicle 50 is 3.5 m high and is attached at a position corresponding to the center of the vehicle width of 2.5 m.

[0029] As shown in Fig. 4, the predetermined warning range is constituted by marker lines SL formed by sticking tape on the road. The marker lines SL are in a generally ladder-like shape constituted by vehicle width marker lines SL1 and distance marker lines SL2. The vehicle width marker lines SL1 are a pair of lines parallel to the direction in which the vehicle 50 travels straight and backwards, spaced apart by the vehicle width, and define the vehicle width of the vehicle 50. The distance marker lines SL2 are lines parallel to the vehicle width direction and perpendicular to the vehicle width marker lines SL1, and indicate the distance from the rear end of the vehicle 50 in the direction in which the vehicle 50 travels straight and backwards.

[0030] As shown in FIG. 4, the two vehicle width sign lines SL1 are 3.5 m or longer and correspond to the vehicle width warning lines WL1 (blue) (see FIG. 11) displayed on the display screen 30 of the monitor 3, which will be described later.

[0031] As shown in FIG. 4, there are four distance marker lines SL2, and the first distance marker line SL21 is located at a distance of 3.5 m farthest from the vehicle 50, and corresponds to the first distance warning line WL21 (green) (see FIG. 11) displayed on the display screen 30 of the monitor 3, which will be described later. The second distance marker line SL22 is located at a distance of 2.0 m next farthest from the vehicle 50, and corresponds to the second distance warning line WL22 (yellow) (see FIG. 11) displayed on the display screen 30 of the monitor 3, which will be described later. The third distance marker line SL23 is located at a distance of 1.0 m next farthest from the vehicle 50, and corresponds to the third distance warning line WL23 (red) (see FIG. 11) displayed on the display screen 30 of the monitor 3, which will be described later. The line in the vehicle width direction located on the road corresponding to the rear end of the vehicle 50 is the sign end line SL24, and corresponds to the warning end line WL24 (blue) (see FIG. 11) displayed on the display screen 30 of the monitor 3.

[0032] 6 is a diagram showing an example of a display on the display screen 30 of the monitor 3 of the rear object confirmation system 1, showing a state in which an image of a sign line SL set on the road behind the vehicle 50 and a warning line WL before adjustment are misaligned and overlapped. Hereinafter, an adjustment operation for aligning the warning line WL with the sign line SL on the monitor 3 will be described.

[0033] When the input unit 11 of the rear object confirmation device 7 is operated to turn the power of the rear object confirmation device 7 ON and the gear of the vehicle 50 is set to reverse, the camera 2 captures an image of the sign line SL on the road and displays it on the display screen 30 of the monitor 3, as shown in Fig. 6, through the function of the control unit 8. Note that the rear object confirmation device 7 may be automatically turned ON by a signal from the vehicle 50 when the engine of the vehicle 50 is started and the gear is set to reverse.

[0034] Further, by operating the input unit 11, the warning line display / adjustment unit 9 and the control unit 8 are put into operation, and the display / adjustment mode for the warning line WL is started. The original line data for the warning line WL stored in the memory unit 12 is read out, and the default warning line WL is displayed superimposed on the marker line SL on the display screen 30 of the monitor 3. In this state, the warning line WL does not coincide with the marker line SL.

[0035] FIG. 7 is a diagram showing the warning lines WL displayed on the display screen 30 of the monitor 3. The numbers in half brackets shown in the white squares in the diagram indicate the targets of the adjustment work to move the vehicle width warning line WL1 and the distance warning line WL2, and the order in which the work is to be performed. On the display screen 30 of the monitor 3 in the display / adjustment mode, first, the third to first distance warning lines WL23, WL22, WL21 and the warning end line WL24 are translated in a direction perpendicular to the vehicle width direction (up-down direction) in the order of 1) to 4) in Fig. 7. The operation order may be automatically selected by the control unit 8 and instructed to the operator by displaying on the monitor 3 (actively displaying the operation target, etc.), or may be selected by the operator. The third to first warning lines WL23, WL22, WL21 and the warning end line WL24 can be moved downward on the display screen 30 (in the direction approaching the vehicle 50 below, not shown) by using the up button provided on the input unit 11, and can be moved upward on the display screen 30 (in the direction moving away from the vehicle 50 below, not shown) by using the down button, so that by this operation, the third to first warning lines WL23, WL22, WL21 and the warning end line WL24 are aligned with the third to first distance marker lines SL23, SL22, SL21 and the marker end line SL24 as shown in Fig. 8, and then the confirmation button is pressed and held to confirm. This results in the state shown in Fig. 8.

[0036] Next, each end of the vehicle width warning line WL1 is moved in the vehicle width direction (left and right direction) in the order of 5) to 8) in Fig. 7. The operation order may be automatically selected by the control unit 8 and instructed to the operator by displaying on the monitor 3 (such as by actively displaying the operation target), or the operator may select it. Each end of the vehicle width warning line WL1 can be moved to the right of the display screen 30 by pressing the right button provided on the input unit 11, and moved to the left of the display screen 30 by pressing the left button. By this operation, each end of the vehicle width warning line WL1 is matched with each end of the vehicle width sign line SL1 as shown in Figs. 9 and 10, and then the OK button is pressed and held to confirm. This results in the state shown in Fig. 10.

[0037] By making the above adjustments, as shown in Figure 10, the vehicle width warning line WL1 and distance warning line WL2 displayed on the display screen 30 of the monitor 3 will indicate the same range as the specified warning range actually formed with tape on the road behind the vehicle 50.

[0038] A method of using the rear object confirmation system 1 according to the embodiment after adjustment will be described with reference to FIGS.

[0039] Fig. 11 is a diagram of the display screen 30 of the monitor 3, which diagrammatically shows the positional relationship between an object presence area A and a warning line WL, which will be described later, and Fig. 12 is a diagram diagrammatically showing an example of the display screen 30 of the monitor 3. However, both diagrams do not show the same situation in terms of the positions, number, types, etc. of objects behind the vehicle 50.

[0040] When the adjusted rear object confirmation system 1 is manually started and then the vehicle 50 is put into reverse, a warning line WL is displayed on the display screen 30 of the monitor 3 as shown in Figures 11 and 12, and the driver can drive without coming into contact with surrounding objects by using this warning line WL as a guide. Alternatively, when the engine of the vehicle 50 is started and the vehicle 50 is put into reverse, the rear object confirmation system 1 may be automatically started by a signal from the vehicle 50, and the warning line WL may be displayed on the display screen 30 of the monitor 3. In either case, when backing up the vehicle 50, the driver can drive without coming into contact with surrounding objects by using this warning line WL on the monitor 3 as a guide.

[0041] As shown in FIG. 11 and FIG. 12, when an object appears behind the vehicle 50 and enters the shooting range of the camera 2, the camera 2 captures it, and the monitor 3 displays the object on the display screen 30. The control unit 8 and the obstacle determination unit 10 of the rear object confirmation device 7 recognize the object on the display screen 30 of the monitor 3. According to the control unit 8 and the obstacle determination unit 10 of the embodiment, as an example, if the object is a moving object, it can be recognized if it is 80 cm or more in height and 30 cm or more in diameter, and if the object is a fixed object, it can be recognized if it is 50 cm or more in height and 30 cm or more in diameter. In either case, the control unit 8 and the obstacle determination unit 10 can estimate the type of the object with a high degree of accuracy by referring to the AI ​​data stored in the memory unit 12 from the shape, size, surface condition, color, movement mode, movement speed, etc. of the object. The control unit 8 and the obstacle determination unit 10 display on the display screen 30 an existence area A surrounding the object with lines of a color according to the type of the recognized object. That is, the existence area A is a control graphic display showing the outline of the shape and size, type and position of the object recognized by the control unit 8 and the obstacle determination unit 10, and is shown by a dashed line in Fig. 11 but by a solid line in Fig. 12. Note that the display color of the lines of the existence area A may be differentiated from the viewpoint of attracting the driver's attention, for example, by using a warning color red for moving objects including people and bicycles and blue for fixed objects. Also, the type of the determined object may be displayed in text near the displayed existence area A.

[0042] As shown in Fig. 11, on the display screen 30 of the monitor 3, the area other than the warning area surrounded by the warning line WL is the preliminary detection area for the preliminary object. In Fig. 11, as shown in (1), when an object is present in the preliminary detection area and the presence area A is displayed, the control unit 8 and the obstacle determination unit 10 display the presence area A(1) in blue, which is an image color that indicates safety.

[0043] As shown by (2) to (5) in FIG. 11, when the warning range surrounded by the warning line WL overlaps even partially with the object existence area A on the display screen 30 of the monitor 3, the control unit 8 and the obstacle determination unit 10 change the display color of the existence area A in stages depending on the position.

[0044] 11, when the existence area A intersects with the first distance warning line WL21 (green), the distance between the vehicle 50 and the object is approximately 3.5 m, so the control unit 8 and the obstacle determination unit 10 determine that the danger level is low and display the existence area A in the same green color as the first distance warning line WL21 to attract the driver's attention. The buzzer 4 does not sound.

[0045] As shown by (3) in Figure 11, when the existence area A intersects with the second distance warning line WL22 (yellow), the distance between the vehicle 50 and the object is approximately 2.0 m, so the control unit 8 and obstacle determination unit 10 determine that the level of danger is medium, display the existence area A in the same yellow color as the second distance warning line WL22, and sound the buzzer 4 intermittently to alert the driver.

[0046] As shown by (4) in Figure 11, when the existence area A intersects with the third distance warning line WL23 (red), the distance between the vehicle 50 and the object is only approximately 1.0 m, so the control unit 8 and obstacle determination unit 10 determine that the danger is high, display the existence area A in the same red color as the third distance warning line WL23, and sound the buzzer 4 continuously to maximize the driver's attention.

[0047] 11, when the presence area A does not intersect with the third distance warning line WL23 (red) but intersects with one of the vehicle width warning lines WL1 and part of the presence area A enters the area between the third distance warning line WL23 and the warning end line WL24, it is determined that the distance between the vehicle 50 and the object is approximately 1.0 m, similar to the case of (4). That is, the control unit 8 and the obstacle determination unit 10 determine that this is also a high-risk state, so they display the presence area A in the same color red as the third distance warning line WL23 and continuously sound the buzzer 4 to maximize the driver's attention.

[0048] FIG. 12 is a diagram showing an example of the display screen 30 displayed on the monitor 3 when the vehicle 50 is reversed or when the vehicle 50 is ready to reverse in the rear object confirmation device 7 with the warning line WL adjusted as described above. When the gear of the vehicle 50 is set to reverse after the power of the rear object confirmation device 7 is manually turned on, or when the gear of the vehicle 50 is set to reverse after the engine of the vehicle 50 is started and the rear object confirmation device 7 is automatically turned on, as shown in FIG. 12, the rear object confirmation device 7 enters a warning mode indicating that the vehicle 50 is reversed, and the scenery behind the vehicle 50 is displayed on the monitor 3, the line adjustment data is called from the storage unit 12, and the warning range partitioned by the warning line WL is displayed superimposed on the background behind. By looking at this monitor, the driver can grasp the situation behind using the warning line, which is an accurate measure of distance, as a guide. Here, when an object appears on the display screen 30, the type of the object is identified and the presence area A is displayed. When the existence region A enters the warning range, as described above, the danger level of the object according to the distance from the vehicle 50 is judged, and a necessary display or warning is issued by the buzzer 4. This alerts the driver, making it possible to prevent accidents when the vehicle 50 is backing up.

[0049] If the rear object confirmation device 7 has a removable memory card as the storage unit 12 and the line adjustment data is stored in the memory card, it can be copied to another memory card and inserted into the rear object confirmation device 7 mounted on another vehicle having the same vehicle width, camera 2 specifications, installation conditions, etc., and used. In other words, once the warning line WL (warning range) is adjusted once, it is only necessary to insert the memory card having the line adjustment data into the rear object confirmation device 7 of another vehicle having the same vehicle model, camera specifications, and installation position, and there is no need to repeat the work on the road to adjust the warning line. Therefore, for transportation companies and the like that operate by owning many trucks of the same model, it is convenient because the warning line (warning range) adjustment work is completed only once.

[0050] In the above-described embodiment, the marker lines SL formed on the road are arranged in a rectangular (ladder-shaped) pattern, as shown in Fig. 4(a), with a pair of vehicle width marker lines SL1 parallel to the direction in which the vehicle 50 moves forward and backward, with the same interval as the vehicle width, and four distance warning lines SL21-23 and a marker end line SL24 parallel to the vehicle width direction and of the same length. When this is photographed by the camera 2, it is displayed on the monitor 3 as a pattern that becomes narrower as it goes deeper into the screen (as it gets farther away from the vehicle) as shown in Fig. 10 (the above is referred to as a first pattern). However, in the rear object confirmation device 7 of the embodiment, the pattern of the marker lines and warning lines does not necessarily have to be the first pattern.

[0051] As shown in Fig. 13(a), the sign lines SL provided on the road may be arranged in an isosceles trapezoid pattern with the longer base in the distance, consisting of a pair of vehicle width sign lines SL1 that spread outward (i.e., incline toward both sides) in the direction in which the vehicle 50 moves straight backward, a sign end line SL24, and three distance sign lines SL21-23 that are parallel to the vehicle width direction and get longer the farther away from the vehicle. When this is photographed by the camera 2, it is displayed on the monitor 3 as a rectangular pattern with four right-angled corners as shown in Fig. 13(b) (the above is referred to as the second pattern). In the second pattern, the monitoring area behind the vehicle 50 spreads out on both the left and right sides as it goes rearward, and the monitoring range is wider than that of the first pattern.

[0052] As shown in Fig. 14(a), the marker lines SL provided on the road may be arranged in a right-angled trapezoid pattern with the longer base in the distance, including a right-side vehicle width marker line SL1 parallel to the direction in which the vehicle 50 moves forward and backward, a left-side vehicle width marker line SL1 that spreads outward to the left (i.e., inclines to the left) toward the direction in which the vehicle 50 moves forward and backward, a marker end line SL24, and three distance marker lines SL21-23 that are parallel to the vehicle width direction and get longer as they move away from the vehicle. When this is photographed by the camera 2, it is displayed on the monitor 3 as a pattern that is roughly the right-angled trapezoid in Fig. 14(a) rotated 180 degrees, as shown in Fig. 14(b) (the above is referred to as the third pattern). In the third pattern, the monitoring area behind the vehicle 50 widens toward the rear on the left side, and the left side of the monitoring range is wider than in the first pattern.

[0053] The pattern of the monitoring range set behind the vehicle may be any pattern that is suitable for the situation and environment when driving the vehicle in which the rear object confirmation device is installed, and that complies with laws and regulations, and is not necessarily limited to only the first to third patterns, and patterns other than these may also be used. [Explanation of symbols]

[0054] 1. Rear object detection system 2. Camera as a photographic device 3. Monitor as a display device 4. Buzzer as an alarm output device 7... Rear object confirmation device 9. Warning line display and adjustment section 10...Obstacle detection section 30…Display screen 50…Vehicle A: Area where objects exist WL…Warning line WL1…Vehicle width warning line WL2…Distance warning line WL21…First distance warning line WL22: Second distance warning line WL23…Third distance warning line WL24…Warning End Line SL: Sign line SL1…Vehicle width marking line SL2: Distance marking line SL21: First distance marker line SL22: Second distance marker line SL23: 3rd distance marker line SL24…Sign End Line

Claims

1. A rear object confirmation device that confirms an object behind a vehicle and judges a degree of danger, In a display device mounted on a vehicle, warning lines including a vehicle width warning line defining the vehicle width and a distance warning line perpendicular to the vehicle width warning line and indicating a distance from the rear end of the vehicle in a direction in which the vehicle is moving backward, The vehicle width marking line is set on the road behind the vehicle, and the marking line includes a vehicle width marking line that defines the vehicle width, and a distance marking line that is perpendicular to the vehicle width marking line and indicates the distance from the rear end of the vehicle in the direction in which the vehicle is reversing. The distance warning line is translated in a direction perpendicular to the vehicle width direction to match the distance marker line, and both ends of the distance warning line are translated in the vehicle width direction to match both ends of the distance marker line, a warning line display and adjustment unit for adjusting and displaying the warning line so that the warning line indicates the same range as the marker line in the display device; an obstacle determination unit that detects an object presence area displayed on the display device when the vehicle is backing up, and determines a degree of danger of the object according to a positional relationship between the adjusted warning line displayed on the display device and the object presence area; Equipped with The presence area is a display that surrounds the periphery of the object, and when the warning area surrounded by the warning line and the presence area overlap even partially, the display color of the presence area is changed depending on the position.

2. An image capturing device provided at a rear end of the vehicle for capturing an image of the rear of the vehicle; a display device mounted on the vehicle and displaying an image of the rear of the vehicle captured by the imaging device; a rear object confirmation device that arbitrarily adjusts a warning line indicating a distance from a rear end of a vehicle and a vehicle width and displays the line on the display device, and determines a degree of danger of an object according to a positional relationship between the object displayed on the display device and the adjusted warning line; A rear object confirmation system for confirming an object behind a vehicle, comprising: The rear object confirmation device is In the display device, warning lines including a vehicle width warning line defining the vehicle width and a distance warning line perpendicular to the vehicle width warning line and indicating a distance from the rear end of the vehicle in a direction in which the vehicle is moving backward, The vehicle width marking line is set on the road behind the vehicle, and the marking line includes a vehicle width marking line that defines the vehicle width, and a distance marking line that is perpendicular to the vehicle width marking line and indicates the distance from the rear end of the vehicle in the direction in which the vehicle is reversing. The distance warning line is translated in a direction perpendicular to the vehicle width direction to match the distance marker line, and both ends of the distance warning line are translated in the vehicle width direction to match both ends of the distance marker line, a warning line display and adjustment unit that adjusts and displays the warning line so that the warning line indicates the same range as the marker line; an obstacle determination unit that detects an object presence area displayed on the display device when the vehicle is backing up, and determines a degree of danger of the object according to a positional relationship between the adjusted warning line displayed on the display device and the object presence area; having The rear object confirmation system is characterized in that the presence area is a display that surrounds the periphery of the object, and when the warning area surrounded by the warning line and the presence area overlap even partially, the display color of the presence area is changed depending on the position.

3. 3. The rear object confirmation system according to claim 2, further comprising an alarm output device that outputs a necessary alarm based on the result of the determination made by said rear object confirmation device.

Citation Information

Patent Citations

  • Backing vehicle up assisting device and vehicle

    JP2000177513A

  • Method and apparatus for calibrating in-vehicle camera

    JP2005077107A

  • Image display system, and image display method

    JP2006160060A

  • Target bar display device for adjusting back guide monitor

    JP2006219037A

  • Vehicle surrounding monitoring device

    JP2007049219A