Display control device and display control method

The display control device adjusts detection and display ranges based on steering angle to maintain accurate object detection and display during vehicle turns, addressing oversight issues in conventional systems and enhancing safety.

JP7851799B2Active Publication Date: 2026-04-27FAURECIA CLARION ELECTRONICS CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
FAURECIA CLARION ELECTRONICS CO LTD
Filing Date
2022-06-27
Publication Date
2026-04-27

AI Technical Summary

Technical Problem

Conventional display systems in vehicles fail to accurately maintain detection and display of important objects in the vehicle's surroundings when the direction of travel changes, such as during sharp turns, leading to potential oversight of objects that could be involved in collisions.

Method used

A display control device that adjusts the detection and display range based on the vehicle's steering angle, expanding the range during turns to include approaching objects and reducing it when straight driving resumes, using cameras and image processing to detect objects and control the display range.

Benefits of technology

Ensures accurate and timely display of surrounding objects even during significant changes in vehicle direction, reducing the risk of missing critical objects and minimizing driver annoyance from unnecessary display expansions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007851799000001
    Figure 0007851799000001
  • Figure 0007851799000002
    Figure 0007851799000002
  • Figure 0007851799000003
    Figure 0007851799000003
Patent Text Reader

Abstract

To accurately provide information around a vehicle even when a traveling direction of the vehicle changes.SOLUTION: A display control device that controls display of an image captured around a vehicle, a display unit that displays an image taken of a rear side of the vehicle, an object detection unit that detects an object present on the rear side of the vehicle, a steering angle detection unit that detects a steering angle of the vehicle, a display range changing unit that changes a display range of an image taken of the rear side of the vehicle from a first range to a second range when the object detection unit detects an object within a detection range, and the detection range of the object detection unit changes depending on the steering angle.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a display control device and a display control method.

Background Art

[0002] Conventionally, an electronic mirror system is known that provides functions corresponding to door mirrors and fender mirrors by imaging the surroundings of a vehicle with a camera and displaying the obtained image as an image on a display inside the vehicle. For example, Patent Document 1 states, "Provided is a rear side image display device for a vehicle that can easily confirm the approach of a following vehicle during travel and can surely grasp the presence or absence and degree of approach of pedestrians, bicycles, etc. around the vehicle during right or left turns, etc."; "The rear side image display device 1 for a vehicle includes a left camera 10L and a right camera 10R that image the rear side of the vehicle, a left image generation unit 30L and a right image generation unit 30R that generate a first rear side image composed of an image corresponding to a first imaging range including a part of the vehicle, a second rear side image obtained by compressing an image corresponding to a second imaging range including a part of the vehicle, and a left image generation unit 32L and a right image generation unit 32R that generate a peripheral image composed of an image corresponding to a third imaging range continuous with the second imaging range in a direction away from the vehicle, a switching timing determination unit 40 that switches between the first rear side image and either the second rear side image or the peripheral image as a display target at a predetermined timing, and a left display unit 60L and a right display unit 60R."

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the conventional technology, the display range as an image can be changed based on the detection result of an obstacle, the operating state of a direction indicator, and the state of a steering angle. However, in situations where the vehicle's direction of travel changes significantly, such as when turning left or right, obstacles that should be detected may move out of the detection range due to the vehicle's change of direction. This problem will be explained using a left turn as an example. When turning left, an object approaching from the left rear of the vehicle is an important object to detect as it may be involved in a collision. By setting the detection range to the left rear of the vehicle, the vehicle can detect objects that could be involved in a collision before the vehicle begins to turn left. After that, once the vehicle begins to turn left, the direction from which the object that could be involved in a collision is approaching moves out of the detection range to the left rear of the vehicle.

[0005] Thus, the detection range based on the vehicle changes relative to the road as the direction of travel changes, potentially causing important objects to be overlooked. This problem is particularly noticeable when passing through sharp intersections.

[0006] Therefore, the present invention aims to accurately provide information about the vehicle's surroundings even when the vehicle's direction of travel changes. [Means for solving the problem]

[0007] To achieve the above objective, one representative display control device of the present invention is a display control device that controls the display of an image taken of the area around a vehicle, comprising: a display unit that displays an image taken of the rear side of the vehicle; an object detection unit that detects an object present in the rear side of the vehicle; a steering angle detection unit that detects the steering angle of the vehicle; and a display range changing unit that, when the object detection unit detects an object within its detection range, changes the display range of the image taken of the rear side of the vehicle from a first range to a second range, wherein the detection range of the object detection unit changes according to the steering angle. [Effects of the Invention]

[0008] According to the present invention, information about the vehicle's surroundings can be accurately provided even when the vehicle's direction of travel changes. Other problems, configurations, and effects will be clarified by the following description of the embodiments. [Brief explanation of the drawing]

[0009] [Figure 1] Diagram illustrating the display control device of Example 1. [Figure 2] A diagram showing the configuration of the display control device. [Figure 3] A flowchart illustrating the processing procedure for the display range adjustment function. [Figure 4] An explanatory diagram (part 1) illustrating a specific example of how the display range adjustment function works. [Figure 5] An explanatory diagram (part 2) illustrating a specific example of how the display range adjustment function works. [Figure 6] A diagram illustrating the relationship between changes in steering angle and changes in the detection range. [Figure 7] An explanatory diagram on moving the display range. [Modes for carrying out the invention]

[0010] The following examples will be described with reference to the drawings. [Examples]

[0011] Figure 1 is an explanatory diagram of the display control device of Embodiment 1. The vehicle 10 is equipped with cameras at positions corresponding to the left and right door mirrors, and is capable of capturing images of the left rear side and the right rear side. The display control device 20 mounted on the vehicle 10 provides the function of an electronic mirror equivalent to a door mirror by displaying the images captured by the cameras on display units inside and outside the vehicle.

[0012] In Figure 1, vehicle 10 captures an image within the imaging range G0 on the right rear side. The display control device 20 extracts an image within the display range G1 from the image within the imaging range G0 and displays it as the image corresponding to the right door mirror.

[0013] Furthermore, the display control device 20 can detect objects to the rear and sides and change the display range according to the detection result. Any method can be used for object detection, but in this embodiment 1, an example is described in which a detection range is set in the imaging range G0 and an object is detected by performing image processing on the image of the detection range.

[0014] If the control device 20 detects a predetermined object within the detection range, it changes the display range so that the object is displayed. Specifically, the display range G2 is set to be larger than the display range G1 and to include both the display range G1 and the image of the predetermined object. The predetermined object is, for example, a motorcycle, a bicycle, a pedestrian, etc. The display control device 20 registers these objects as predetermined objects to be detected and performs the detection by image processing.

[0015] In this way, by setting the enlarged display range G2 that includes the display range G1 and the predetermined object, the display control device 20 can provide information about the predetermined object while maintaining the function as a door mirror.

[0016] Here, the display control device 20 changes the detection range according to the state of the vehicle 10. Specifically, when the vehicle 10 is going straight, the detection range Dr1 during straight travel is set. When the vehicle 10 turns right, the detection range Dr2 is set, in which the detection range on the right rear side is made larger than that during straight travel. Similarly, when the vehicle 10 turns left, the detection range is set in which the detection range on the left rear side is made larger than that during straight travel. The determination of right and left turns is made, for example, based on the steering angle.

[0017] If the detection range is enlarged during right and left turns in this way, even when the vehicle 10 starts to turn, the direction of the object to be detected, particularly the direction in which the object involved in the right and left turns approaches, can be included in the detection range more widely.

[0018] When completing a right or left turn and returning to straight driving, the display control device 20 returns the detection range to its original state. This is because if a detection range that is excessively large during straight driving is set and the display includes the detection results, unnecessary information will be provided. That is, the display control device 20 performs object detection within a detection range Dr2 that is expanded compared to when driving straight during a right or left turn, and expands the display range to display the objects detected within that range. On the other hand, when driving straight, object detection is performed within a detection range Dr1 that is narrower than during a right or left turn, and the display range is expanded to display the objects detected within that range. In this way, when the display control device 20 does not detect an object within the detection range, it does not expand the display range, thereby reducing the likelihood that the driver will feel annoyed due to the display range being expanded even though there are no objects such as pedestrians within the detection range that require attention.

[0019] Figure 2 is a configuration diagram showing the configuration of the display control device 20. The display control device 20 is connected to the camera 11L, camera 11R, drive control unit 13, etc. The drive control unit 13 is a group of units that perform vehicle acceleration / deceleration control, steering control, direction indicator control, etc.

[0020] The display control device 20 includes a display 21, an input reception unit 22, a vehicle state detection unit 23, and a control unit 24. The control unit 24 is, for example, a CPU (Central Processing Unit), and realizes functions as an object detection unit 31 and a display range change unit 32.

[0021] The camera 11R captures an image of the right rear of the vehicle 10. The camera 11L captures an image of the left rear of the vehicle 10. The display 21 includes a display 21R and a display 21L. For example, the display 21R and the display 21L may be separate bodies, or may display the right rear image and the left rear image on one display. The display 21R is a display unit that displays the right rear image. The display 21R is arranged, for example, on the right front pillar. Display 21L is a display unit that shows an image of the left rear. Display 21L is positioned, for example, on the left front pillar.

[0022] The input receiving unit 22 receives input for operations to adjust the images displayed on the displays 21R and 21L. The input receiving unit 22 is positioned in a location where it can be operated by a user seated in the driver's seat. For example, it is preferable that the input receiving unit 22 be a touch panel positioned in conjunction with the display 21R.

[0023] The vehicle state detection unit 23 detects the state of the vehicle 10. The vehicle state detection unit 23 includes a speed detection unit 41, a steering angle detection unit 42, a turn signal state detection unit 43, and the like. The speed detection unit 41 detects the driving speed of the vehicle 10. For example, it can obtain the value from the speedometer. The steering angle detection unit 42 detects the steering angle of the vehicle 10. The steering angle can be obtained, for example, from the steering control unit. For example, the steering angle detection unit 42 obtains the steering angle ST0 at time T0 and stores it in a storage unit (not shown), and obtains the steering angle ST1 at time T1 (later than time T0) and stores it in a storage unit (not shown), overwriting the already stored steering angle ST0. For example, it stores information about how much the steering angle has rotated compared to the so-called zero position (not rotated), associated with the time. The steering angle detection unit 42 may also obtain the steering angle of the tires. In this case, it stores information about how much the tires have been tilted compared to the so-called zero position, associated with the time. In other words, the steering angle detection unit 42 may detect the actual steering angle, which indicates the angle at which the vehicle 10 is moving relative to the straight-ahead direction, or it may detect the operated steering angle, which indicates how much the steering wheel has been rotated. Here, the operated steering angle will be described as the steering angle. The turn signal state detection unit 43 detects the state of the turn signal (indicator lamp).

[0024] The object detection unit 31 detects objects located to the rear and side of the vehicle 10. Specifically, the object detection unit 31 sets a detection range for an image taken of the rear and side of the vehicle 10 and detects objects by image recognition targeting the detection range.

[0025] The detection range of the object detection unit 31 is determined according to the steering angle. For example, when the steering angle of the vehicle 10 is greater than or equal to a predetermined angle, the object detection unit 31 makes the detection range on the inner wheel side larger than the detection range on the outer wheel side. For example, the object detection unit 31 calculates the change in steering angle by subtracting the steering angle ST0 at time T0 from the steering angle ST1 at time T1, and when the absolute value of the calculated change in steering angle is greater than or equal to a predetermined value, it makes the detection range on the inner wheel side larger than the detection range on the outer wheel side. For example, if the value obtained by subtracting time T0 from time T1 is positive, it can be determined that the steering has rotated to the left compared to time T0. Conversely, if this value is negative, it can be determined that the steering has rotated to the right compared to time T0. The object detection unit 31 may perform the same processing using the steering angle of the tires instead of the steering angle. In this way, by setting different detection ranges for each steering angle according to the steering angle of the vehicle 10, it is possible to detect objects that require attention over a wide area when the vehicle begins to turn, and to not detect objects that do not require attention when the vehicle is finishing its turn and passing through the intersection.

[0026] The display range changing unit 32 changes the display mode of the image taken of the rear side of the vehicle 10 when the object detection unit 31 detects an object within its detection range. For example, it changes the display range of the image taken of the rear side of the vehicle 10 from the first range to the second range. For convenience, the first range is referred to as display range G1 and the second range as display range G2. In this way, the display changing unit 32 does not change the display range from the first range to the second range when it does not detect an object within the detection ranges Dr1 and Dr2, thereby reducing the inconvenience to the driver caused by the display range being expanded even when there are no objects requiring attention, such as pedestrians, within the detection range.

[0027] Display range G1 and display range G2 are parts of the image captured by camera 11. Display range G2 is larger than display range G1 and includes display range G1 and the image of the object detected by object detection unit 31.

[0028] In this way, the control unit 24 implements a display range adjustment function that changes the detection range of the object detection unit 31 and makes objects located within that detection range available for display. This display range adjustment function is designed to handle situations where the direction of travel of the vehicle 10 changes significantly, such as when turning left or right. Therefore, the display range adjustment function is started when the vehicle's speed falls within a specified range that is sufficiently low.

[0029] Furthermore, since it is difficult to determine in advance how much the direction of travel will change, the detection range may be maximized (for example, the entire imaging range) when the steering angle exceeds a predetermined angle. On the other hand, when the steering angle returns to its original position after a change of direction, the detection range should be gradually reduced according to the amount of change in the direction in which the steering angle returns.

[0030] Furthermore, the objects assumed by the display range adjustment function are those that pose no danger when driving straight, but pose a risk of being caught in the vehicle when the direction of travel is changed. Therefore, the display range G2 may be set not only when an object is detected, but also when the driver indicates an intention to change direction, such as by activating the turn signal lamp or turning the steering wheel.

[0031] The end of the display range adjustment function can be determined by conditions such as the turn signal lights turning off or the steering angle returning to its original position.

[0032] Figure 3 is a flowchart showing the processing procedure for the display range adjustment function. First, the object detection unit 31 determines whether the vehicle 10 is traveling at a specified speed (step S102) if the vehicle 10 is in motion (step S101). The specified speed is set so that, for example, a state in which the vehicle has slowed down in preparation for turning right or left can be detected. If the vehicle 10 is not traveling at the specified speed (step S102; No), the process returns to step S101.

[0033] If the vehicle 10 is traveling at a specified speed (step S102; Yes), the object detection unit 31 starts the display range adjustment function (step S103) and changes the detection range according to the steering angle (step S104).

[0034] When the object detection unit 31 detects an object from the image within the detection range (step S105), the display range changing unit 32 determines whether the turn signal is on in the left or right direction relative to the vehicle's direction of travel, on the side where the object has been detected by the object detection unit 31 (step S106). If the turn signal is not on (step S106; No), the display range changing unit 32 determines whether the steering wheel has been turned in the left or right direction relative to the vehicle's direction of travel, on the side where the object has been detected by the object detection unit 31 (step S107). Whether or not the steering wheel has been turned can be determined, for example, using the detection result of the steering angle detection unit 42. If the steering wheel has not been turned (step S107; No), the process returns to step S101.

[0035] If the turn signal is on (step S106; Yes) or if steering is being performed (step S107; Yes), the display range modification unit 32 expands the display area to include the detected object (step S108).

[0036] After step S108, the object detection unit 31 determines whether the termination condition for the display range adjustment function has been met. The termination condition can include the turn signal lamp being turned off, or the steering angle being less than a predetermined angle. If the termination condition is not met (step S109; No), the process returns to step S104. If the termination condition is met (step S109; Yes), the process ends.

[0037] Figures 4 and 5 illustrate a specific example of the operation of the display range adjustment function, using a left turn as an example. To understand the display range adjustment function when turning right, simply reverse the left and right sides of Figures 4 and 5. In the state shown in Figure 4(1), vehicle 10 is moving straight. At this time, the steering wheel H1 is approximately zero, and the angle of the direction of travel relative to the straight-ahead direction of vehicle 10 (actual steering angle) is also approximately zero. In addition, vehicle 10 captures images of the left and right rear sides within the imaging range G0 and displays the images within the display range G1. Furthermore, vehicle 10 performs object detection within the detection range Dr1 used when moving straight. Furthermore, Figure 6 shows the changes in steering angle and detection range size in time series, as shown in Figures 4 and 5. The steering change 51 shown in Figure 6 plots the steering angle acquired by the steering angle detection unit 42 on the vertical axis and time on the horizontal axis, schematically showing how the steering angle changes over time. The detection range change 52 shown in Figure 6 plots the size of the detection range set by the object detection unit 31 in accordance with the change in steering angle on the vertical axis and time on the horizontal axis, schematically showing how the size of the detection range changes over time. In the state shown in Figure 4(1), the steering angle is approximately zero, and therefore, the size of the detection range has not changed from the detection range for straight-line driving, as can be seen from the steering change 51 and the detection range change 52.

[0038] Subsequently, the system transitions to the state shown in Figure 4(2). In this state, the steering wheel H1 is turned to the left. As a result, a steering angle is created in the vehicle 10, and the display control device 20 sets the detection range on the left side to a detection range Dr2, which is wider than the detection range Dr1 when driving straight. In this case, the detection range Dr2 may be the entire imaging range G0. Note that even if the detection range Dr1 is expanded to the detection range Dr2 in the state shown in Figure 4(2), the display range remains the display range G1 when no object is detected within the detection range, and the display range is expanded to the display range G2 when an object is detected within the detection range. In the steering change 51 in Figure 6, the steering angle increased in the positive direction during the period shown in Figure 4(2), indicating that the steering wheel rotated to the left. At this time, as also described in the detection range change 52, the object detection unit 31 determines that the vehicle 10 has started to turn left and sets the detection range to detection range Dr2, which is larger than detection range Dr1. Subsequently, in the state shown in Figure 4(3), the steering angle of the steering wheel H1 is maintained, and the vehicle 10 is turning to the left. At this time, the detection range on the left side remains expanded. If the detection range in the state shown in Figure 4(3) were the same as when driving straight, the direction from which the object to be involved in the left turn approaches would be outside the detection range. However, because the detection range has been expanded, the direction from which the object to be involved in the left turn approaches is now included within the detection range.

[0039] Subsequently, the system transitions to the state shown in Figure 5(4). In this state, the steering angle of the steering wheel H1 is maintained, and the vehicle 10 is turning to the left. At this time, the detection range on the left side remains expanded. However, as the left turn of the vehicle 10 continues, the direction from which the object to be involved in the left turn approaches begins to move outside the expanded detection range. Even if the steering wheel H1 is rotated further to the left in the situations shown in Figures 4(3) and 5(4), causing the steering angle to change further to the left, the detection range remains at detection range Dr2. In the steering change 51 in Figure 6, it can be seen that the steering angle did not change during the periods shown in Figures 4(3) and 5(4), and that the size of the detection range was maintained at detection range Dr2 during the detection range change 52.

[0040] Subsequently, the system transitions to the state shown in Figure 5(5). In this state, the steering wheel H1 is rotated to the right, opposite to the left turn. The display control device 20 gradually reduces the detection range in accordance with the amount of change in steering angle caused by the rotation of the steering wheel H1 to the right, opposite to the left turn. For example, the detection range may be reduced linearly in proportion to the change in steering angle to the right, or it may be reduced exponentially. Furthermore, instead of immediately starting to reduce the detection range when rotation in the direction that returns the steering angle to its original position is detected, a waiting period of several hundred milliseconds may be provided, after which the detection range may be gradually reduced. In the steering change 51 in Figure 6, the steering angle changed in the negative direction and decreased during the period shown in Figure 5(5), indicating that the steering wheel rotated to the right. At this time, for example, when the steering angle changes in the negative direction and decreases as in the detection range change 52, the detection range is reduced from detection range Dr2 in accordance with the decrease in the steering angle. Alternatively, when the steering angle does not change, the reduction of the detection range may be stopped and the detection range at that time may be maintained. In the state shown in Figure 5(5), vehicle 10 has almost completed its left turn and is beginning to move away from the intersection, so the need to detect pedestrians on the inner wheel side is relatively lower than when the left turn began. Therefore, the detection range is gradually narrowed in proportion to the amount the vehicle's steering wheel H1 is rotated to the right, opposite to the direction when turning left.

[0041] Subsequently, the system transitions to the state shown in Figure 5(6). In this state, vehicle 10 has completed its left turn and is now moving straight. At this time, the steering angle of the steering wheel H1 is approximately zero, and the steering angle of vehicle 10 is also approximately zero. Vehicle 10 also captures images of the left and right rear sides within the imaging range G0 and displays the images within the display range G1. Furthermore, vehicle 10 performs object detection within the detection range used for straight-ahead movement. In the steering change 51 shown in Figure 6, the steering angle of the vehicle 10 is approximately zero during the period shown in Figure 5(6), so the change is 0. Therefore, the size of the detection range is set to detection range Dr1.

[0042] The explanation so far has described an example where the display range is expanded when an object is detected, but it is also possible to move the display range while maintaining its size.

[0043] Figure 7 illustrates the movement of the display range, using a right turn as an example. To understand the example of moving the display range when turning left, simply reverse the left and right sides of Figure 7. In Figure 7, vehicle 10 is capturing images of the right rear side, with the imaging range G0 being the image. The display control device 20 extracts the image of the display range G1 from the image of the imaging range G0 and displays it as the image corresponding to the right door mirror.

[0044] The display control device 20 changes the display range so that a predetermined object is displayed when it detects such an object within its detection range. Specifically, it sets a display range G2 centered on the detected object. Display range G2 is the same size as display range G1. While the positional relationship of display range G1 is defined relative to the vehicle 10, the positional relationship of display range G2 is defined relative to the detected object.

[0045] In this way, by moving the display range, objects can be displayed at a sufficient size. Also, by maintaining the size of the display range, the positional relationship with the object can be understood with the same sense of distance as the display range G1. On the other hand, the function as a door mirror is reduced, so a separate door mirror or a display equivalent to a door mirror may be provided. The detection range is changed according to the state of the vehicle 10, as in Figure 1.

[0046] As described above, the disclosed display control device 20 is a display control device that controls the display of an image taken of the area around the vehicle 10, and comprises a display 21 as a display unit that displays an image taken of the rear side of the vehicle 10, an object detection unit 31 that detects an object present in the rear side of the vehicle, a steering angle detection unit 42 that detects the steering angle of the vehicle, and a display range changing unit 32 that changes the display range of the image taken of the rear side of the vehicle from a first range to a second range when the object detection unit detects an object within its detection range, wherein the detection range of the object detection unit changes according to the steering angle. Therefore, even if the direction of travel of the vehicle changes, accurate information about the area around the vehicle can be provided.

[0047] Furthermore, in the disclosed display control device 20, when the steering angle of the vehicle is greater than or equal to a predetermined angle, the object detection unit 31 makes the detection range on the inner wheel side larger than the detection range on the outer wheel side. Therefore, accidents involving vehicles being caught in the blind spot during right or left turns can be avoided.

[0048] Furthermore, the object detection unit 31 sets the detection range for an image taken of the rear side of the vehicle, detects the object by image recognition targeting the detection range, and the display range changing unit sets a portion of the image taken of the rear side of the vehicle as the display range. Therefore, captured images can be efficiently used for detection and display.

[0049] As an example, the second range is larger than the first range and includes the first range and the image of the object detected by the object detection unit. In this way, it is possible to provide information about detected objects while maintaining the function of a door mirror.

[0050] As an example, the first range may be defined in relation to the vehicle, and the second range may be defined in relation to the object detected by the object detection unit. This approach allows for focused information provision regarding detected objects.

[0051] Furthermore, the disclosed display control device 20 is characterized in that, when the steering angle decreases, it reduces the detection range in accordance with the amount of change in the steering angle. Therefore, the detection range can be reduced according to the situation.

[0052] It should be noted that the present invention is not limited to the embodiments described above, and various modifications are included. For example, the embodiments described above are explained in detail to make the present invention easier to understand, and are not necessarily limited to those having all the configurations described. Furthermore, it is possible not only to delete configurations, but also to replace or add them.

[0053] For example, the embodiment shows a case where the detection range is set independently of the imaging range and display range, but the detection range may also be made to correspond to the imaging range and display range. For example, when driving straight, the display range G1 and the detection range may be made to coincide, and when turning left or right, the imaging range and the detection range may be made to coincide.

[0054] Furthermore, while the embodiment illustrates the detection of objects using image processing, sensors such as radar or sonar may also be used. Furthermore, when detecting objects using image processing, any method can be used, such as recognizing the type of object by pattern matching or recognizing the speed and distance of an object by comparing time-series images. In addition, the detection targets may be changed depending on the situation, such as detecting other vehicles and motorcycles when moving straight at high speed, and detecting motorcycles, bicycles, and pedestrians when turning left or right. Furthermore, if multiple objects are detected, the display range G2 may be set to display all of them, or it may be set to display only one object selected based on distance or velocity.

[0055] Furthermore, although the embodiment was described using an in-vehicle display control device 20 as an example, it may also be applied to a terminal for remote control of the vehicle 10.

[0056] Furthermore, in the embodiment, an example was described in which the display range changing unit 32 expands the display range when the object detection unit 31 detects an object within the detection range. However, instead of expanding the display range, or in addition to this, when an object is detected within the detection range, the object contained in the image displayed on the display unit 22 may be highlighted. For example, an example of highlighting is a mark that surrounds the object contained in the image. Even in this case, the detection range is expanded or contracted according to the steering angle, as shown in Figure 6. For example, it is also possible to always set the display range to G1 or G2, expand or contract the detection range according to the steering angle, and highlight the object when it is detected within the detection range. This reduces the likelihood of drivers being bothered by objects being highlighted when they don't require their attention, and allows for the detection of objects over a wider area when drivers do need to pay attention. [Explanation of symbols]

[0057] 10: Vehicle, 11: Camera, 13: Drive control unit, 20: Display control device, 21: Display, 22: Input reception unit, 23: Vehicle state detection unit, 24: Control unit, 31: Object detection unit, 32: Display range change unit, 41: Speed ​​detection unit, 42: Steering angle detection unit, 43: Turn signal state detection unit

Claims

1. A display control device that controls the display of images captured around a vehicle, A display unit that displays an image taken of the rear side of the vehicle, An object detection unit that detects an object located to the rear and side of the vehicle, A steering angle detection unit for detecting the steering angle of the aforementioned vehicle, When the object detection unit detects an object within its detection range, the display range of the image taken of the rear side of the vehicle is changed from a first range to a second range. Equipped with, The detection range of the object detection unit changes to expand in accordance with the increase in the steering angle. When the steering angle of the vehicle is greater than or equal to a predetermined angle, the object detection unit makes the detection range on the inner wheel side larger than the detection range on the outer wheel side. A display control device characterized by the following:

2. The object detection unit sets the detection range for an image taken of the rear side of the vehicle, and detects the object by image recognition targeting the detection range. The display control device according to claim 1, characterized in that the display range changing unit sets a portion of the image captured of the rear side of the vehicle as the display range.

3. The display control device according to claim 1, characterized in that the second range is larger than the first range and includes the first range and the image of the object detected by the object detection unit.

4. The first range is defined in relation to the vehicle, The display control device according to claim 1, characterized in that the second range is defined in relation to the object detected by the object detection unit.

5. The display control device according to claim 1, characterized in that when the steering angle decreases, the detection range is reduced in accordance with the amount of change in the steering angle.

6. The display control device, The steps include acquiring an image of the rear side of the vehicle, The steps include: displaying a first range of an image taken from the rear side of the vehicle as the display range on the display unit; The steps include detecting the steering angle of the vehicle, The steps include detecting an object located to the rear side of the vehicle within a detection range that changes to expand in accordance with the increase in the steering angle, When an object located to the rear side of the vehicle is detected, the display range of the image taken to the rear side of the vehicle is changed from a first range to a second range. Includes, When the steering angle of the vehicle is greater than or equal to a predetermined angle, the detection range for the inner wheel is made larger than the detection range for the outer wheel. A display control method characterized by the following:

Citation Information

Patent Citations

  • Driving support device

    JP2008015759A

  • Safety drive support device for large-sized vehicle

    JP2010244128A

  • Vehicular visible device

    JP2019116220A

  • JP2019‐121913A

  • Display system and method thereof

    US20140277940A1