Display control method, information display system, and display control device

The display control method addresses the challenge of notifying following vehicle occupants of intersection changes by displaying surrounding images from leading vehicles based on turn completion, ensuring accurate and timely information.

JP2025124265APending Publication Date: 2025-08-26NISSAN MOTOR CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024020195
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-02-14
Publication Date
2025-08-26

AI Technical Summary

Technical Problem

Existing methods do not effectively notify occupants of a following vehicle of appropriate information from a leading vehicle, particularly at intersections where the leading vehicle's direction changes.

Method used

A display control method that receives and displays surrounding images from a leading vehicle based on predetermined display conditions, such as the completion of a right or left turn at an intersection, using vehicle-to-vehicle communication and image processing to determine the appropriate display positions on the host vehicle's display.

Benefits of technology

Enables occupants of the following vehicle to accurately grasp the situation of the road ahead by displaying stable images after the leading vehicle has completed a turn, providing intuitive and timely information.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025124265000001_ABST
    Figure 2025124265000001_ABST
Patent Text Reader

Abstract

To inform an occupant of a vehicle traveling behind a preceding vehicle of appropriate information.SOLUTION: A display control method includes the steps of: receiving, from a preceding vehicle 2, a surrounding image obtained by photographing a scene around the preceding vehicle 2; determining whether or not display conditions are provided for displaying the surrounding image on a display 12; and displaying the surrounding image on the display 12 when the display conditions are provided. The display conditions are that a traveling state of the preceding vehicle 2 at an intersection 105 has reached a predetermined state determined according to an imaging direction of the surrounding image.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to a display control method, an information display system, and a display control device. [Background technology]

[0002] Patent Document 1 discloses an in-vehicle information processing device that enables occupants of a following vehicle to more accurately grasp information about a traffic accident. The in-vehicle information processing device includes a control unit, a communication unit that communicates with other vehicles, and a driving environment information acquisition unit that acquires information about the driving environment of the vehicle. When the vehicle reaches the point where the traffic accident occurred, the control unit transmits information about the driving environment at the point acquired by the driving environment information acquisition unit to the following vehicle via the communication unit. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2020-140237 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the method disclosed in Patent Document 1 does not disclose how a following vehicle (own vehicle) notifies its occupants of information transmitted from another vehicle. In a situation where a leading vehicle is traveling through an intersection, it may not be possible to notify appropriate information to occupants of a vehicle traveling behind the leading vehicle.

[0005] The present invention has been made in consideration of the above-mentioned problems, and its purpose is to provide a display control method, an information display system, and a display control device that can provide appropriate information to occupants of a vehicle traveling behind a leading vehicle. [Means for solving the problem]

[0006] A display control method according to one aspect of the present invention receives, from a leading vehicle, a surrounding image of a scene around the leading vehicle, and displays the surrounding image on a display when a display condition for displaying the surrounding image on the display is satisfied. The display condition is that the progress of the leading vehicle at an intersection has reached a predetermined state determined according to the direction in which the surrounding image was captured. [Effects of the Invention]

[0007] According to the present invention, it is possible to notify appropriate information to the occupants of a vehicle traveling behind a leading vehicle. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an information display system according to this embodiment. [Figure 2] FIG. 2 is a block diagram showing the configuration of the host vehicle. [Figure 3] FIG. 3 is a flowchart illustrating a display control method in the information display system. [Figure 4] FIG. 4 is a flowchart illustrating a display control method in the information display system. [Figure 5] FIG. 5 is a diagram illustrating the traveling conditions of the host vehicle and a preceding vehicle at an intersection. [Figure 6] FIG. 6 is an explanatory diagram showing the concept of the image display process. [Figure 7] FIG. 7 is an explanatory diagram showing the concept of an image displayed on a display. DETAILED DESCRIPTION OF THE INVENTION

[0009] The embodiments will be described with reference to the drawings. In the description of the drawings, the same parts are designated by the same reference numerals and the description thereof will be omitted.

[0010] An information display system, a display control device, and a display control method according to this embodiment will be described using an example of a T-junction 105 where a first road 101 and a second road intersect, as shown in Fig. 1. The information display system according to this embodiment includes a host vehicle 1 and a leading vehicle 2 traveling ahead of the host vehicle 1. In the information display system, the host vehicle 1 receives surrounding images, which are images of the scenery around the leading vehicle 2, from the leading vehicle 2, and displays the received surrounding images to an occupant of the host vehicle 1.

[0011] A leading vehicle 2 enters the intersection 105 from a first road 101 that connects to the intersection 105, and makes a right or left turn at the intersection 105. The host vehicle 1 travels behind the leading vehicle 2 on the first road 101, and enters the intersection 105 following the leading vehicle 2. In other words, the host vehicle 1 is also a following vehicle that follows the leading vehicle 2. Although one leading vehicle 2 is depicted in FIG. 1, the information display system may include multiple leading vehicles 2.

[0012] The host vehicle 1 and the preceding vehicle 2 may be vehicles with or without an automatic driving function. The host vehicle 1 and the preceding vehicle 2 may also be vehicles that can switch between automatic driving and manual driving.

[0013] The host vehicle 1 and the preceding vehicle 2 can communicate wirelessly with each other. The communication between the host vehicle 1 and the preceding vehicle 2 is direct communication, i.e., vehicle-to-vehicle communication, in which the host vehicle 1 and the preceding vehicle 2 communicate directly with each other. However, the communication between the host vehicle 1 and the preceding vehicle 2 may also be indirect communication, in which communication is performed via a base station and a network (such as a mobile phone network).

[0014] The configuration of the vehicle 1 will be described with reference to Fig. 2. The vehicle 1 includes a front camera 10, a rear camera 11, a display 12, an operation unit 13, a communication device 14, a sensor 15, and a controller 20.

[0015] The front camera 10 is mounted on the host vehicle 1. The imaging direction of the front camera 10 is directed forward of the host vehicle 1. The front camera 10 captures an image of the scenery ahead of the host vehicle 1 and outputs the captured forward image to the controller 20. The imaging range of the front camera 10 needs to include at least the scenery ahead of the host vehicle 1, and may also include scenery on the left and right sides of the host vehicle 1. The front camera 10 is, for example, a wide-angle camera.

[0016] The rear camera 11 is mounted on the host vehicle 1. The imaging direction of the rear camera 11 is directed rearward from the host vehicle 1. The rear camera 11 captures an image of the scenery behind the host vehicle 1 and outputs the captured rear image to the controller 20. The rear camera 11 needs to capture at least the scenery behind the host vehicle 1, and may also capture scenery on the left and right sides of the host vehicle 1. The rear camera 11 may be, for example, a telephoto camera, and may be configured with a narrower angle of view than the front camera 10.

[0017] The front camera 10 and the rear camera 11 are equipped with solid-state imaging devices such as CCD (Charge Coupled Device) and CMOS (Complementary Metal Oxide Semiconductor). The images output by the front camera 10 and the rear camera 11 are, for example, color images. The front camera 10 and the rear camera 11 output images at a predetermined frame rate.

[0018] The display 12 is disposed in a position visible to an occupant, such as an instrument panel. The occupant may be, for example, a driver seated in the driver's seat. The display 12 is controlled by a controller 20 and displays predetermined information. The display 12 is configured, for example, with a liquid crystal panel.

[0019] The operation unit 13 is operated by the driver, and outputs an operation signal corresponding to the driver's operation to the controller 20. The operation unit 13 is realized by, for example, a touch panel function that the display 12 has.

[0020] The communication device 14 has a function of performing wireless data communication. The communication device 14 is composed of, for example, one or more antennas, a modem, an application processor, a memory, etc. The communication device 14 can perform wireless communication with another vehicle (a preceding vehicle 2) by direct communication or indirect communication.

[0021] The sensor 15 is a sensor for detecting the position and traveling direction of the host vehicle 1. The sensor 15 includes a GPS (Global Positioning System) receiver, an inertial navigation system, sensors provided on the brake pedal and accelerator pedal, sensors for acquiring the behavior of the host vehicle 1 such as a wheel speed sensor and a yaw rate sensor, a laser radar, a camera, etc. From the detection results of the sensor 15, the position (absolute position in global coordinates) and traveling direction of the host vehicle 1 can be measured using position estimation techniques such as GPS and odometry. The traveling direction of the host vehicle 1 corresponds to the attitude of the host vehicle 1 and is defined by the angle it forms with a predetermined reference direction.

[0022] The controller 20 performs various processes required to realize the information display system. The controller 20 is a general-purpose microcomputer equipped with a CPU (Central Processing Unit), memory, and input / output units. A computer program is installed in the microcomputer. By executing the computer program, the microcomputer functions as multiple information processing circuits equipped in the controller 20.

[0023] In this embodiment, an example is shown in which the multiple information processing circuits provided in the controller 20 are realized by software. Of course, it is also possible to configure the multiple information processing circuits for executing the information processing described below using dedicated hardware. Furthermore, the multiple information processing circuits may be configured using individual hardware.

[0024] The controller 20 has a condition determination unit 21, a moving body detection unit 22, a traveling direction identification unit 23, a vehicle position identification unit 24, and a processing unit 25 as a plurality of information processing circuits.

[0025] The condition determination unit 21 determines whether or not a display condition is met for displaying the surrounding image captured by the leading vehicle 2 on the display 12. In this embodiment, the surrounding image of the leading vehicle 2 corresponds to a forward image captured by the leading vehicle 2 (leading vehicle forward image) and a rearward image captured by the leading vehicle 2 (leading vehicle rearward image). In this case, the display condition is that the leading vehicle 2 has completed a right turn or a left turn at the intersection 105.

[0026] The moving body detection unit 22 detects a moving body approaching the leading vehicle 2. For example, the moving body detection unit 22 performs image processing on an image in front of the leading vehicle and an image behind the leading vehicle to detect the moving body.

[0027] The traveling direction identifying unit 23 identifies the traveling direction of the host vehicle 1 based on the information detected by the sensor 15 .

[0028] The vehicle position identification unit 24 identifies the position of the vehicle 1 based on the information detected by the sensor 15 .

[0029] The processing unit 25 performs various processes required to implement a display control method, which will be described later.

[0030] The preceding vehicle 2 has a similar configuration to the host vehicle 1, and therefore a description of the preceding vehicle 2 will be omitted.

[0031] In the information display system according to this embodiment, the host vehicle 1 can be a preceding vehicle in terms of a vehicle traveling behind the host vehicle 1, and the preceding vehicle 2 can be the host vehicle 1 (following vehicle) in terms of a vehicle traveling ahead of the preceding vehicle 2. Therefore, in this embodiment, the host vehicle 1 and the preceding vehicle 2 have the same configuration. However, the host vehicle 1 and the preceding vehicle 2 only need to be selectively equipped with the functions necessary to realize the information display system.

[0032] An overview of the information display system will be described below. The controller 20 of the leading vehicle 2 acquires a front image of the leading vehicle and a rear image of the leading vehicle from the front camera 10 and the rear camera 11. The controller 20 of the leading vehicle 2 identifies the traveling direction and position of the leading vehicle 2. The controller 20 of the leading vehicle 2 then transmits the front image of the leading vehicle and the rear image of the leading vehicle, as well as the traveling direction and position of the leading vehicle 2, to the host vehicle 1 via the communication device 14. The controller 20 of the leading vehicle 2 performs the above process at a predetermined cycle. The front image of the leading vehicle transmitted from the leading vehicle 2 is linked to information indicating that this image is a front image, and the rear image of the leading vehicle is linked to information indicating that this image is a front image. Note that it is sufficient for the leading vehicle 2 to be equipped with at least one of the front camera 10 and the rear camera 11, and it is sufficient for the image transmitted from the leading vehicle 2 to be at least one of the front image of the leading vehicle and the rear image of the leading vehicle.

[0033] The controller 20 of the host vehicle 1 functions as a display control device that displays information on the display 12 of the host vehicle 1. The controller 20 of the host vehicle 1 receives the image in front of the leading vehicle 2 and the image behind the leading vehicle 2, as well as the traveling direction and position of the leading vehicle 2, from the leading vehicle 2 via the communication device 14. The controller 20 of the host vehicle 1 then determines whether or not display conditions for displaying the image in front of the leading vehicle 2 and the image behind the leading vehicle 2 on the display 12 are met. If the display conditions are met, the controller 20 of the host vehicle 1 displays the image in front of the leading vehicle 2 and the image behind the leading vehicle 2 on the display 12.

[0034] Next, a display control method in the information display system will be described with reference to Figures 3 and 4. This display control method is executed by the controller 20 of the host vehicle 1. As shown in Figure 5, the display control method will be described using as an example a situation in which the host vehicle 1 is traveling at a T-junction 105 where a first road 101 and a second road 102 intersect. In Figure 5, two leading vehicles 2 are shown ahead of the host vehicle 1.

[0035] This display control method is started when the occupant operates the operation unit 13 to display an image of the leading vehicle 2. When the display control method is started, the controller 20 first displays a forward image (host vehicle forward image) output from the front camera 10 of the host vehicle 1 on the display 12. The host vehicle forward image displayed on the display 12 is updated with the latest host vehicle forward image every time a new host vehicle forward image is output from the front camera 10.

[0036] In step S10, the controller 20 determines whether or not an image has been transmitted from the leading vehicle 2. If no image has been transmitted from the leading vehicle 2 (S10: NO), the process proceeds to step S30, which will be described later. If an image has been transmitted from the leading vehicle 2 (S10: YES), the controller 20 determines whether or not there are multiple leading vehicles 2 transmitting images (S11). If an image has been transmitted from one leading vehicle 2 (S11: NO), the process proceeds to step S13.

[0037] If images have been transmitted from multiple leading vehicles 2 (S11: YES), the controller 20 prompts the occupant to select a leading vehicle 2 from the multiple leading vehicles 2 for which an image will be displayed (S13). Specifically, the controller 20 temporarily suspends the display of the image ahead of the host vehicle. Then, the controller 20 displays the host vehicle 1 and the multiple leading vehicles 2 on the display 12 in association with the position of the host vehicle 1 and the positions of the multiple leading vehicles 2. The driver can identify the multiple leading vehicles 2 and their positions based on the position of the host vehicle 1 displayed on the display 12. The driver can then select one of the multiple leading vehicles 2 for which an image will be displayed by performing a selection operation (e.g., a touch operation) on the leading vehicle 2 from the multiple leading vehicles 2 displayed on the display 12. When the selection of the leading vehicle 2 is completed, the controller 20 resumes displaying the image ahead of the host vehicle.

[0038] In step S13, the controller 20 determines a traveling direction difference θ, which is the angle between the traveling direction θ1 of the host vehicle 1 and the traveling direction θ2 of the preceding vehicle 2. When the preceding vehicle 2 is traveling on the first road 101, the traveling direction difference θ is zero. When the preceding vehicle 2 turns left at the intersection 105, the traveling direction difference θ is a positive value, and when the preceding vehicle 2 turns right at the intersection 105, the traveling direction difference θ is a negative value.

[0039] In step S14, the controller 20 determines whether or not there is an image ahead of the leading vehicle in the images transmitted from the leading vehicle 2. If there is no image ahead of the leading vehicle (S14: NO), the process proceeds to step S21. If there is an image ahead of the leading vehicle (S14: YES), the process proceeds to step S15.

[0040] In step S15, the controller 20 determines whether or not a moving object approaching the leading vehicle 2 has been detected. For example, the controller 20 detects the moving object by performing image processing on the image ahead of the leading vehicle. If a moving object has not been detected (S15: NO), the controller 20 sets a predetermined front reference value θf1 as a front determination threshold θf for determining whether to display an image ahead of the leading vehicle (S16). On the other hand, if a moving object has been detected (S15: YES), the controller 20 sets a value obtained by subtracting a predetermined value Δθ from the front reference value θf1 as the front determination threshold θf (S17). In this way, when there is a moving object approaching the leading vehicle 2, the front determination threshold θf is set to a smaller value than when there is no moving object approaching the leading vehicle 2.

[0041] In step S18, the controller 20 determines whether the absolute value of the traveling direction difference θ is equal to or greater than the front determination threshold θf. In step S18, the controller 20 compares the absolute value of the traveling direction difference θ with the front determination threshold θf to determine whether the leading vehicle 2 has completed a right or left turn at the intersection 105.

[0042] If the absolute value of the traveling direction difference θ is equal to or greater than the forward determination threshold θf (S18: YES), the controller 20 performs image display processing to superimpose the image of the vehicle ahead on the image of the subject vehicle (S19). As shown in Fig. 6, the display position of the image of the vehicle ahead on the display 12 is uniquely determined according to four combinations: whether the vehicle ahead 2 has turned left or right, and whether the image to be displayed is the image of the vehicle ahead or the image of the vehicle behind.

[0043] As shown in FIG. 7, an image ahead of the host vehicle is displayed in the main display area 120 of the display 12. The controller 20 displays an image ahead of the leading vehicle in the left display area 121 or the right display area 122 of the display 12 according to the combination shown in FIG. 6. The left display area 121 is located to the left of the center of the display 12, and the right display area 122 is located to the left of the center of the display 12. When the leading vehicle 2 completes a left turn at the intersection 105, the image ahead of the leading vehicle includes a view in the left turn direction of the intersection as seen from the host vehicle 1. Therefore, the controller 20 displays the image ahead of the leading vehicle in the left display area 121. Conversely, when the leading vehicle 2 completes a right turn at the intersection 105, the image ahead of the leading vehicle includes a view in the right turn direction of the intersection as seen from the host vehicle 1. Therefore, the controller 20 displays the image ahead of the leading vehicle in the right display area 122.

[0044] If the absolute value of the traveling direction difference θ is smaller than the forward determination threshold θf (S18: NO), the controller 20 performs an image non-display process (S20). If the image of the vehicle ahead of the preceding vehicle is superimposed on the image of the vehicle ahead, the image non-display process erases the image of the vehicle ahead from the image of the vehicle ahead. On the other hand, if the image of the vehicle ahead is not displayed on the image of the vehicle ahead, the image of the vehicle ahead continues to be hidden.

[0045] In step S21, the controller 20 determines whether or not there is an image of the rear of the leading vehicle 2 in the images transmitted from the leading vehicle 2. If there is no image of the rear of the leading vehicle (step S21: NO), the process proceeds to step S29. If there is an image of the rear of the leading vehicle (step S21: YES), the process proceeds to step S22.

[0046] In step S22, the controller 20 determines whether or not a moving object approaching the leading vehicle 2 has been detected. For example, the controller 20 detects the moving object by performing image processing on the image behind the leading vehicle. If a moving object has not been detected (S22: NO), the controller 20 sets a predetermined rear reference value θb1 as the rear determination threshold θb for determining whether to display the image behind the leading vehicle (S23). The rear reference value θb1 is set to a value greater than the front reference value θf1. On the other hand, if a moving object has been detected (S22: YES), the controller 20 sets a value obtained by subtracting a predetermined value Δθ from the rear reference value θb1 as the rear determination threshold θb (S24). In this way, when there is a moving object approaching the leading vehicle 2, the rear determination threshold θb is set to a smaller value than when there is no moving object approaching the leading vehicle 2.

[0047] In step S25, the controller 20 determines whether the absolute value of the traveling direction difference θ is equal to or greater than the rear determination threshold θb. In step S25, the absolute value of the traveling direction difference θ is compared with the rear determination threshold θb to determine whether the leading vehicle 2 has completed a right or left turn at the intersection 105. The rear determination threshold θb is set to a value greater than the front determination threshold θf.

[0048] If the absolute value of the traveling direction difference θ is equal to or greater than the rear determination threshold θb (S25: YES), the controller 20 performs image display processing to superimpose the rear image of the leading vehicle on the front image of the host vehicle (S26). As shown in Fig. 6, the display position of the rear image of the leading vehicle is uniquely determined according to four combinations: whether the leading vehicle 2 has turned left or right, and whether the image to be displayed is the rear image of the leading vehicle or the rear image of the leading vehicle.

[0049] The controller 20 displays the rear image of the leading vehicle in the left display area 121 or the right display area 122 of the display 12 according to the combinations shown in Fig. 6. Specifically, when the leading vehicle 2 completes a left turn at the intersection 105, the rear image of the leading vehicle includes a view in the right turn direction of the intersection as seen from the host vehicle 1. Therefore, the controller 20 displays the rear image of the leading vehicle in the right display area 122. Conversely, when the leading vehicle 2 completes a right turn at the intersection 105, the rear image of the leading vehicle includes a view in the left turn direction of the intersection as seen from the host vehicle 1. Therefore, the controller 20 displays the rear image of the leading vehicle in the left display area 121.

[0050] If the absolute value of the traveling direction difference θ is smaller than the rear determination threshold θb (S18: NO), the controller 20 performs an image non-display process (S20). If the image behind the leading vehicle is superimposed on the image ahead of the host vehicle, this image non-display process erases the image behind the leading vehicle from the image ahead of the host vehicle. On the other hand, if the image behind the leading vehicle is not displayed on the image ahead of the host vehicle, the image behind the leading vehicle continues to be hidden.

[0051] In step S28, the controller 20 determines whether or not a new image has been transmitted from the same leading vehicle 2. If a new image has been transmitted (S28: YES), the controller 20 performs the processes from step S13 onward. On the other hand, if a new image has not been transmitted (S28: NO), the controller 20 erases the image in front of the leading vehicle and the image behind the leading vehicle currently being displayed on the display 12 (S29).

[0052] In step S30, the controller 20 determines whether or not to end the image display. End of image display is instructed, for example, by the occupant performing a predetermined end operation on the operation unit 13. If the end operation is performed on the operation unit 13, the controller 20 determines to end the image display (S30) and ends this processing. On the other hand, if the end operation is not performed on the operation unit 13, the controller 20 determines not to end the image display (S30) and performs processing from step S10 onwards.

[0053] As described above, according to this embodiment, when the leading vehicle 2 has completed a right or left turn at an intersection, a leading vehicle first image capturing either the scenery ahead or the scenery behind the leading vehicle 2 is displayed on the display 12 of the host vehicle 1. Immediately after the leading vehicle 2 enters the intersection, the leading vehicle first image does not include the scenery in the direction of the right or left turn. Therefore, the leading vehicle first image captured immediately after the leading vehicle 2 enters the intersection 105 does not allow the situation of the second road 102 leading to the intersection 105 to be grasped. Furthermore, when the leading vehicle 2 is in the middle of turning right or left at the intersection 105, the leading vehicle first image is an image captured while the leading vehicle 2 is turning. Therefore, the scenery changes rapidly in the image captured while the leading vehicle 2 is turning, making it difficult to grasp the situation of the second road 102 leading to the intersection 105. On the other hand, when the leading vehicle 2 has completed a right or left turn at the intersection 105, the movement of the leading vehicle 2 in the turning direction becomes small. Therefore, when the leading vehicle 2 has completed a right or left turn, the leading vehicle first image stably shows the situation of the second road 102 leading to the intersection 105. This allows the occupant to accurately grasp the situation of the second road 102 leading to the intersection 105. Therefore, appropriate information can be provided to the occupant of the host vehicle 1 traveling behind the leading vehicle 2.

[0054] According to this embodiment, the display condition is that the absolute value of the angle between the traveling direction θ2 of the preceding vehicle 2 and the traveling direction θ1 of the host vehicle 1, i.e., the traveling direction difference θ, is equal to or greater than the determination threshold values ​​θf and θb. This allows the controller 20 of the host vehicle 1 to appropriately determine that the preceding vehicle 2 has completed a right or left turn at the intersection 105.

[0055] According to this embodiment, if the leading vehicle first image when the leading vehicle 2 completes a right or left turn at the intersection 105 includes a view in the right turn direction of the intersection 105 as seen from the host vehicle 1, the leading vehicle first image is displayed on the right side of the host vehicle forward image. Similarly, if the leading vehicle first image when the leading vehicle 2 completes a right or left turn at the intersection 105 includes a view in the left turn direction of the intersection 105 as seen from the host vehicle 1, the leading vehicle first image is displayed on the left side of the host vehicle forward image. This allows the occupant to intuitively know whether the view included in the leading vehicle first image is a view to the left or right as seen from the occupant. Therefore, it is possible to provide appropriate information to the occupant of the host vehicle 1.

[0056] According to this embodiment, the leading vehicle second image, which captures the other of the scenery ahead and the scenery behind the leading vehicle 2, is displayed on the left-right opposite side of the leading vehicle first image on the image ahead of the host vehicle. This allows the occupant to intuitively understand whether the scenery included in the leading vehicle second image is a view to the left or right from the occupant's perspective. Therefore, it is possible to provide the occupant of the host vehicle 1 with appropriate information.

[0057] According to this embodiment, the rear determination threshold θb (i.e., the rear reference value θb1) is set to a value greater than the front determination threshold θf (i.e., the front reference value θf1). When the leading vehicle 2 enters the intersection 105, the front side of the leading vehicle 2 enters the intersection 105 first, and the rear side of the leading vehicle 2 enters the intersection 105 later. For this reason, the leading vehicle rear image, which is a photograph of the scenery behind the leading vehicle 2, reflects the situation of the second road 102 later than the leading vehicle front image, which is a photograph of the scenery in front of the leading vehicle 2. Therefore, as described above, by differentiating the display conditions of the leading vehicle rear image from the display conditions of the leading vehicle front image, the leading vehicle rear image can be displayed on the display 12 at the timing when the situation of the second road 102 is reflected in the leading vehicle rear image. This allows the occupant to accurately grasp the situation of the second road 102 leading to the intersection 105. Therefore, according to this embodiment, it is possible to notify the occupant of the host vehicle 1 traveling behind the leading vehicle 2 of appropriate information.

[0058] According to this embodiment, when there is a moving object approaching the leading vehicle 2, the judgment thresholds θf and θb are set to smaller values ​​than when there is no moving object approaching the leading vehicle 2. When there is a moving object approaching the leading vehicle 2, the leading vehicle first image is displayed earlier than when there is no moving object approaching the leading vehicle 2. This allows the occupants of the host vehicle 1 to grasp the status of the moving object earlier. Therefore, according to this embodiment, it is possible to notify the occupants of the host vehicle 1 of appropriate information.

[0059] According to this embodiment, the occupant can select the preceding vehicle 2 for which the image is to be displayed from among a plurality of preceding vehicles 2. This allows the occupant of the host vehicle 1 to select the information they need.

[0060] In the above-described embodiment, the determination thresholds θf, θb (i.e., the reference values ​​θf1, θb1) are fixed regardless of the angle of the second road 102, i.e., the road after the preceding vehicle 2 has turned right or left at the intersection 105. However, the controller 20 of the host vehicle 1 may include a step of referring to map data including road information and identifying the angle θr (see FIG. 5) of the second road 102. In this case, the controller 20 may adjust the determination thresholds θf, θb according to the angle θr of the second road 102. The traveling direction difference θ when the preceding vehicle 2 has completed a right or left turn differs depending on the angle θr of the second road 102. Therefore, by adjusting the determination thresholds θf, θb according to the angle θr, it is possible to appropriately determine that the preceding vehicle 2 has completed a right or left turn at the intersection 105.

[0061] In the above-described embodiment, the controller 20 of the host vehicle 1 determines whether the leading vehicle 2 has completed a right or left turn at the intersection 105 based on the traveling direction difference θ. However, the controller 20 of the host vehicle 1 may also refer to map data including road information to identify the angle θr of the second road 102 (see FIG. 5 ). When the leading vehicle 2 completes a right or left turn at the intersection 105, the angle between the angle θr of the second road and the traveling direction θ2 of the leading vehicle 2 becomes smaller. Therefore, the controller 20 may determine that the leading vehicle 2 has completed a right or left turn at the intersection 105 on the condition that the angle between the angle θr of the second road and the traveling direction θ2 of the leading vehicle 2 is equal to or smaller than a determination threshold. This makes it possible to appropriately determine that the leading vehicle 2 has completed a right or left turn at the intersection 105.

[0062] In the embodiment described above, the leading vehicle 2 is equipped with a front camera 10 that captures the scenery ahead of the leading vehicle 2 and a rear camera 11 that captures the scenery behind the leading vehicle 2. However, the leading vehicle 2 to which the information display system of this embodiment is applied may also be equipped with a left camera at the front end of the leading vehicle 2 that captures the scenery on the left side of the leading vehicle 2 and a rear camera that captures the scenery on the right side of the leading vehicle 2. The imaging direction of the left camera is directed toward the left side of the host vehicle 1, and the imaging direction of the right camera is directed toward the right side of the host vehicle 1. The left and right images captured by the left and right cameras also correspond to surrounding images that capture the scenery around the leading vehicle 2.

[0063] In a situation where only the front end of the leading vehicle 2 has entered the intersection 105, the influence of turning right or left is small. Therefore, the left and right images immediately after the leading vehicle 2 has entered the intersection 105 will stably show the situation of the second road 102 leading to the intersection 105. On the other hand, if the leading vehicle 2 continues to travel within the intersection 105, the influence of turning right or left will become greater. Images taken while the leading vehicle 2 is turning show rapid changes in the scenery, making it difficult for the occupants of the host vehicle 1 to grasp the situation of the second road 102 leading to the intersection 105. Therefore, in the case of a leading vehicle 2 equipped with left and right cameras, the controller 20 of the host vehicle 1 may display the left and right images on the display 12 on the condition that the traveling direction difference θ is equal to or less than a predetermined determination threshold.

[0064] As described above, in this embodiment, the display condition for displaying the surrounding image on the display 12 may be determined when the progress of the leading vehicle 2 at the intersection 105 reaches a predetermined state determined according to the capturing direction of the surrounding image. This allows the occupant to accurately grasp the state of the second road 102 leading to the intersection 105. Therefore, according to this embodiment, appropriate information can be provided to the occupant of the host vehicle 1 traveling behind the leading vehicle 2.

[0065] 3 and 4 may be executed by the controller 20 of the preceding vehicle 2. In this case, the controller 20 of the host vehicle 1 may receive the determination result executed by the controller 20 of the preceding vehicle 2 from the preceding vehicle 2 without executing the processes from steps S15 to S18 and steps S22 to S25. Then, the controller 20 of the host vehicle 1 may perform an image display process or an image non-display process based on the received determination result.

[0066] Although the embodiments of the present invention have been described above, the descriptions and drawings that form part of this disclosure should not be understood to limit the present invention. Various alternative embodiments, examples, and operating techniques will become apparent to those skilled in the art from this disclosure. [Explanation of symbols]

[0067] 1. Vehicle (following vehicle) 2 Leading vehicle 10 Front camera 11 Rear camera 12 Display 13 Control section 14. Communications equipment 15 sensors 20 Controller 21 Condition judgment section 22 Moving object detection unit 23 Traveling direction identification part 24 Vehicle location identification unit 25 Processing section 101 First Road 102 Second Road 105 Intersection θ Traveling direction difference θb Rear judgment threshold θb1 rear reference value θf forward judgment threshold θf1 forward reference value

Claims

1. A display control method executed by a display control device that displays information on a display of a vehicle, comprising: receiving, from a leading vehicle traveling ahead of the host vehicle, a surrounding image of a scene around the leading vehicle captured from the leading vehicle; determining whether a display condition for displaying the surrounding image on the display is met; When the display condition is satisfied, displaying the surrounding image on the display; the display condition is that the progress of the leading vehicle at the intersection has reached a predetermined state determined depending on the photographing direction of the surrounding image; Display control method.

2. the surrounding image is a first image of a leading vehicle captured by capturing one of a view ahead of the leading vehicle and a view behind the leading vehicle, the display condition is that the leading vehicle has completed a right turn or a left turn at the intersection; The display control method according to claim 1.

3. receiving a traveling direction of the preceding vehicle from the preceding vehicle; detecting a traveling direction of the host vehicle; The display condition is that an absolute value of an angle between the traveling direction of the host vehicle and the traveling direction of the leading vehicle is equal to or greater than a determination threshold value. The display control method according to claim 2.

4. acquiring a front image of the vehicle, the front image being a photograph of a scene ahead of the vehicle, from a camera mounted on the vehicle; and displaying the image of the front of the host vehicle on the display. When the surrounding image is displayed on the display, the first image of the leading vehicle is displayed superimposed on the image ahead of the host vehicle, and When the first image of the leading vehicle when the leading vehicle has completed a right turn or a left turn at the intersection includes a view in the right turn direction of the intersection as seen from the host vehicle, the first image of the leading vehicle is displayed on the right side of the image ahead of the host vehicle; When the first image of the leading vehicle when the leading vehicle has completed a right turn or a left turn at the intersection includes a view in the left turn direction of the intersection as seen from the host vehicle, the first image of the leading vehicle is displayed on the left side of the image ahead of the host vehicle. The display control method according to claim 3.

5. the surrounding image further includes, in addition to the leading vehicle first image, a leading vehicle second image capturing the other of a scene ahead of the leading vehicle and a scene behind the leading vehicle; When the surrounding image is displayed on the display, the first image of the leading vehicle and the second image of the leading vehicle are displayed superimposed on the image ahead of the host vehicle, and the second image of the leading vehicle is displayed on the left-right side of the image ahead of the host vehicle, opposite to the first image of the leading vehicle. The display control method according to claim 4.

6. receiving a traveling direction of the preceding vehicle from the preceding vehicle; detecting a traveling direction of the host vehicle; the surrounding image includes a leading vehicle front image obtained by capturing a scene ahead of the leading vehicle and a leading vehicle rear image obtained by capturing a scene behind the leading vehicle, the display condition for the image of the leading vehicle is that an absolute value of an angle between the traveling direction of the host vehicle and the traveling direction of the leading vehicle is equal to or greater than a forward determination threshold; the display condition for the rear image of the leading vehicle is that an absolute value of an angle between the traveling direction of the host vehicle and the traveling direction of the leading vehicle is equal to or greater than a rear determination threshold value; The rear determination threshold is set to a value greater than the front determination threshold. The display control method according to claim 2.

7. determining whether or not there is a moving object approaching the preceding vehicle; When there is a moving object approaching the preceding vehicle, the determination threshold is set to a smaller value than when there is no moving object approaching the preceding vehicle. The display control method according to claim 3.

8. When there are multiple preceding vehicles transmitting the surrounding images, displaying the positions of the plurality of leading vehicles; and further including having an occupant select the preceding vehicle for which the surrounding image is to be displayed from among the plurality of preceding vehicles. The display control method according to claim 1.

9. Identifying an angle of a road after the preceding vehicle turns right or left at the intersection; adjusting the determination threshold in accordance with an angle of the road. The display control method according to claim 3.

10. receiving a traveling direction of the preceding vehicle from the preceding vehicle; determining an angle of a road after the preceding vehicle turns right or left at the intersection; The display condition is that the angle between the road and the traveling direction of the preceding vehicle is equal to or smaller than a determination threshold. The display control method according to claim 3.

11. a leading vehicle and a following vehicle traveling behind the leading vehicle, The preceding vehicle: a communication device that transmits a surrounding image, which is a photograph of the scenery around the preceding vehicle, to the preceding vehicle; The following vehicle: a communication device that receives the surrounding image from the preceding vehicle; a display visible to the occupants of the following vehicle; a controller for controlling the display; The controller determining whether a display condition for displaying the surrounding image on the display is met; When the display condition is satisfied, displaying the surrounding image on the display; the display condition is that the progress of the leading vehicle at the intersection has reached a predetermined state determined depending on the photographing direction of the surrounding image; Information display system.

12. A controller is provided for displaying information on a display of the vehicle; The controller acquiring a surrounding image obtained by capturing a scene around the leading vehicle from a leading vehicle traveling in front of the host vehicle; determining whether a display condition for displaying the surrounding image on the display is met; When the display condition is satisfied, displaying the surrounding image on the display; the display condition is that the progress of the leading vehicle at the intersection has reached a predetermined state determined depending on the photographing direction of the surrounding image; Display control device.

Citation Information

Patent Citations

  • On-vehicle information processing device, inter-vehicle information processing system, and information processing system

    JP2020140237A