Route guiding device, route guiding method, storage medium, program, and saddle-riding type vehicle

The route guidance device addresses the visual clutter issue by displaying side-by-side direction and rear images, improving driver safety during course changes by reducing the need for the driver to look away from the road.

WO2024242003A1PCT designated stage expired Publication Date: 2024-11-28HONDA MOTOR CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2024/018054
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-23
Filing Date
2024-05-15
Publication Date
2024-11-28

AI Technical Summary

Technical Problem

Current route guidance systems clutter the driver's visual field by requiring them to check the rear visually during course changes, increasing the number of places to look and potentially impairing safety.

Method used

A route guidance device that acquires images of the vehicle's surroundings, including the rear, and displays a side-by-side arrangement of direction instruction images and rear images on a display, allowing the driver to check the rear without moving their line of sight.

Benefits of technology

Enhances driver safety by allowing intuitive and simultaneous checking of the direction for course changes and the rear situation, reducing visual clutter and improving situational awareness.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2024018054_28112024_PF_FP_ABST
    Figure JP2024018054_28112024_PF_FP_ABST
Patent Text Reader

Abstract

The present invention includes: an image acquisition means for acquiring a peripheral image of a vehicle, the image including at least the area to the rear of the vehicle; and a display control means for, in a case where guidance is performed for a vehicle course change, displaying the peripheral image and a direction instruction image for the course change, side-by-side on a display.
Need to check novelty before this filing date? Find Prior Art

Description

Route guidance device, route guidance method, storage medium, program, and saddle-type vehicle

[0001] The present invention relates to a vehicle route guidance technology.

[0002] There is a vehicle that has a portable information terminal mounted in the position of the meter panel and displays engine speed and map information using the display device of the portable information terminal (Patent Document 1).

[0003] JP 2013-184547 A

[0004] Route guidance is one form of information presentation using map information. In route guidance, when a vehicle approaches a point where a right or left turn or lane change is required, information is displayed to guide the driver in the direction in which the vehicle should change course. Normally, when changing course, the driver needs to check behind them using the rearview mirror or by looking at the road ahead. However, when route guidance information is presented using a display device such as that disclosed in Patent Document 1, the number of places the driver needs to look at increases during the limited time before the course change, which can give the driver an impression of cumbersomeness.

[0005] An object of the present invention is to assist a driver in checking behind him / her when changing lanes, thereby contributing to improved safety when driving a vehicle.

[0006] According to the present invention, there is provided a route guidance device comprising: an image acquisition means for acquiring an image of the surroundings of the vehicle, including at least the area behind the vehicle; and a display control means for, when guiding the vehicle to change course, displaying a direction indication image for the course change and the surrounding image side by side on a display.

[0007] According to the present invention, it is possible to assist a driver in checking behind him / her when changing lanes, thereby contributing to improved safety when driving a vehicle.

[0008] Other features and advantages of the present invention will become apparent from the following description taken in conjunction with the accompanying drawings, in which the same or similar elements are designated by the same reference numerals.

[0009] The accompanying drawings are incorporated into and constitute a part of the specification, illustrate embodiments of the present invention, and together with the description are used to explain the principles of the present invention.

[0023] FIG. 1 is a schematic diagram of a route guidance system 1.

[0024] FIG. 2 is a block diagram illustrating the configuration of a mobile communication terminal 3.

[0025] FIG. 3 is a block diagram illustrating the configuration of a route planning server 5.

[0026] FIG. 4 is a block diagram illustrating the configuration of an in-vehicle device 40 according to a first embodiment.

[0027] FIG. 5 is a block diagram illustrating the configuration of an in-vehicle device 40 according to a third embodiment.

[0028] FIG. 6 is a diagram illustrating a guidance screen for guiding a lane change to the left.

[0029] FIG. 7 is a diagram illustrating a guidance screen for guiding a lane change to the right.

[0029] FIG. 8 is a diagram illustrating an image captured by an in-vehicle camera 44.

[0029] FIG. 9 is a diagram illustrating a rear image extracted when a lane change to the left is notified.

[0030] FIG. 10 is a diagram illustrating a rear image extracted when a lane change to the right is notified.

[0031] FIG. 11 is a diagram illustrating a guidance screen for guiding a lane change to the left when the distance to the lane change point is below a threshold.

[0032] FIG. 12 is a diagram illustrating a guidance screen for guiding a lane change to the right when the distance to the lane change point is below a threshold.

[0033] FIG. 13 is a flowchart illustrating a display control process executed by the mobile communication terminal 3 according to the first embodiment. A diagram illustrating an example of receiving an image captured directly from a roadside camera 7 according to Modification 3. A diagram illustrating an example of receiving an image captured by a roadside camera 7 from an external device 8 according to Modification 3. A diagram illustrating an example of a guidance screen that provides guidance, accompanied by a warning, on changing course to the right when the distance to the lane change point exceeds a threshold according to Modification 1. A diagram illustrating an example of a guidance screen that provides guidance, accompanied by a warning, on changing course to the right when the distance to the lane change point is below a threshold according to Modification 1.

[0010] [Embodiment 1] Hereinafter, an embodiment will be described in detail with reference to the accompanying drawings. Note that the following embodiment does not limit the invention according to the claims, and not all combinations of features described in the embodiment are necessarily essential to the invention. Two or more of the features described in the embodiment may be combined arbitrarily. Furthermore, the same reference numerals are used for the same or similar configurations, and redundant explanations will be omitted.

[0011] In the embodiment described below, the present invention is applied to a mobile communication terminal that is mounted on a saddle-type vehicle in which a driver rides and that displays information related to route guidance to a destination, as an example of a route guidance device. However, the present invention can be applied to any device that can display information related to route guidance.

[0012] <System Overview> Figure 1 is a schematic diagram of a route guidance system 1. The route guidance system 1 is a system that provides a route guidance service in which a mobile communication terminal 3 provides route guidance to a driver 2 driving a saddle-type vehicle 4, according to information on a route to a destination planned by a route planning server 5 (hereinafter referred to as route guidance information). The route planning server 5 is communicably connected to the mobile communication terminals 3 via a communication network 6, and is a server that generates route guidance information regarding a route from a departure point to a destination that is input into each mobile communication terminal 3.

[0013] In the example of FIG. 1 , each driver 2 is a driver of a saddle-riding type vehicle 4. The mobile communication terminal 3 is a mobile terminal such as a smartphone used by the driver 2. The mobile communication terminal 3 is equipped with a display device, a wireless communication device, and an input device, and functions as a client capable of sending and receiving information to and from the route planning server 5, etc. Each saddle-riding type vehicle 4 is equipped with an in-vehicle device 40 that controls the overall operation of the vehicle. The in-vehicle device 40 is equipped with a wireless communication device that can communicate with the mobile communication terminal 3, an ECU that controls the drive system of the saddle-riding type vehicle 4, etc. In this embodiment, when a route guidance service is used on the mobile communication terminal 3, the mobile communication terminal 3 and the in-vehicle device 40 are communicatively connected.

[0014] An application for providing route guidance services is installed on the mobile communication terminal 3, and the mobile communication terminal 3 can function as a route guidance device that provides route guidance from the departure point to the destination according to route guidance information provided by the route planning server 5.

[0015] In this embodiment, the vehicle driven by the driver 2 is described as a saddle-ride type vehicle (motorcycle). However, the present invention is not limited to driving a saddle-ride type vehicle, and can be used when driving any moving vehicle operated by the driver 2 other than a saddle-ride type vehicle, such as a passenger car or a freight truck.

[0016] <<Configuration Example of Portable Communication Terminal 3>> Figure 2A is a block diagram of the portable communication terminal 3. The portable communication terminal 3 includes a control unit 31, a storage unit 32, a communication unit 33, a display unit 34, a GNSS (Global Navigation Satellite System) sensor 35, and an input unit 36. The control unit 31 is a processor typified by a CPU, and executes programs stored in the storage unit 32. The storage unit 32 is a storage device such as RAM or ROM. The programs stored in the storage unit 32 also include an application program (hereinafter sometimes referred to as a route guidance application) for using the route guidance service of this embodiment. The application program may be downloaded from a server such as the route planning server 5 or an application distribution server, or may be distributed on a storage medium such as a CD-ROM.

[0017] The communication unit 33 is a wireless communication device capable of communicating with the route planning server 5 via the communication network 6. The communication unit 33 also includes a wireless communication device capable of directly communicating with the in-vehicle device 40. The display unit 34 is an electronic image display device (display) equipped with an input function, such as a touch panel display. The GNSS sensor 35 is a sensor that detects the current position of the mobile communication terminal 3. The input unit 36 ​​is various user interfaces that accept operational inputs of the mobile communication terminal 3. The various user interfaces include operating members such as switches provided on the mobile communication terminal 3, and sensors for detecting touch inputs to the display unit 34.

[0018] <<Configuration Example of In-Vehicle Device 40>> FIG. 3A is a block diagram of the in-vehicle device 40 according to this embodiment. The in-vehicle device 40 includes a control unit 41, a storage unit 42, a communication unit 43, and an in-vehicle camera 44. The control unit 41 is a processor, such as a CPU, and executes programs stored in the storage unit 42. The storage unit 42 is a storage device, such as a RAM or ROM. The programs stored in the storage unit 42 include a program for communicating information with the mobile communication terminal 3. The communication unit 43 is a wireless communication device capable of directly communicating with the mobile communication terminal 3. The in-vehicle camera 44 is a camera equipped with an optical system, such as a lens, and an imaging sensor, and is capable of capturing images. The in-vehicle camera 44 may be configured to be built into the saddle-riding type vehicle 4 in advance, or may be attached to the outside of the saddle-riding type vehicle 4 afterward. In this embodiment, the in-vehicle camera 44 is installed to capture images behind the saddle-riding type vehicle 4.

[0019] <<Configuration Example of Route Planning Server 5>> Fig. 2B is a block diagram of the route planning server 5. The route planning server 5 includes a control unit 51, a storage unit 52, and a communication unit 53. The control unit 51 is a processor typified by a CPU, and executes programs stored in the storage unit 52. The storage unit 52 is a storage device such as RAM, ROM, or a hard disk. The communication unit 53 is a wired or wireless communication device capable of communicating with the mobile communication terminal 3 via the communication network 6.

[0020] The storage unit 52 stores various types of data in addition to the programs executed by the control unit 51. In the example of Fig. 2B, a database (DB) 521 is illustrated as an example of data stored in the storage unit 52. The DB 521 is a DB (hereinafter referred to as a road DB) in which information about roads that the saddle riding type vehicle 4 can travel is registered. The information (road information) stored in the road DB 521 includes information such as the location, address, gradient, and surrounding landmarks of each road, as well as information about traffic rules that must be observed for each road and traffic conditions (traffic congestion and accident occurrence status) obtained in real time.

[0021] When the control unit 51 receives at least information on the departure point and the destination along with a route guidance request from the mobile communication terminal 3, it plans a route from the departure point to the destination based on road information managed in the road DB 521, generates route guidance information, and returns it to the mobile communication terminal 3. Here, the information on the departure point and the destination is respectively input by the driver 2 into the mobile communication terminal 3. Alternatively, for example, if the driver 2 deviates from the planned route or if a request is made to start guidance from the current location, the information on the current location of the mobile communication terminal 3 acquired by the GNSS sensor 35 can be used as the information on the departure point without input by the driver 2. When the control unit 31 of the mobile communication terminal 3 receives route guidance information from the route planning server 5 while the route guidance application is running, it provides route guidance to the driver 2 using the route guidance information. Route guidance is provided using information displayed on the display unit 34. The route guidance display includes a display in which information about the route specified by the route guidance information, the current location of the saddle riding vehicle 4, and the direction in which the saddle riding vehicle 4 is facing are superimposed on map information about the area around the current location of the mobile communication terminal 3 (saddle riding vehicle 4). The route guidance display also includes a route change guidance display that is presented when the saddle riding vehicle 4 is at an intersection where a right or left turn is required or a point where it is necessary to stay in a specific lane. Hereinafter, such points where route change guidance is required will be referred to as "route change points."

[0022] <Lane Change Guidance Display> The lane change guidance display will be described in detail below with reference to the drawings.

[0023] The control unit 31 determines that route change guidance should be provided when the saddle riding type vehicle 4 approaches a route change point defined in the route guidance information. Approaching a route change point may be provided, for example, when the distance between the saddle riding type vehicle 4 and the route change point falls below a predetermined distance threshold. Route change guidance is provided in multiple stages, such as by notifying the driver that a route change is necessary and urging the driver to prepare for the route change, or by notifying the driver of the timing when a route change is actually required.

[0024] As described above, when changing lanes, the driver 2 needs to check behind him / her, but it is time-consuming for the driver 2 to visually check behind him / her each time, especially in a situation where notifications are given at multiple stages. For this reason, the route guidance application of this embodiment displays, at the timing when guiding a lane change, a screen on which a direction indication image indicating the direction of the lane change and an image (rear image) showing the situation behind the saddle riding type vehicle 4 captured by the on-board camera 44 are arranged side by side. Here, the direction indication image may be an image presented in a so-called turn-by-turn display.

[0025] The screen displayed on the display unit 34 can be configured as shown in, for example, Figures 4A and 4B. Figure 4A illustrates a screen displayed when guiding a leftward lane change, and Figure 4B illustrates a screen displayed when guiding a rightward lane change. As shown in the figures, in the route guidance application of this embodiment, the screen presented when guiding a lane change (hereinafter referred to as the guidance screen) is configured so that a direction indication image 401 and a rearward image 402 are arranged horizontally side by side, allowing the driver 2 to view both at the same time. Therefore, when guiding a lane change, the control unit 31 transmits a request for images captured by the on-board camera 44 to the saddle-riding type vehicle 4 via the communication unit 33, and acquires the images.

[0026] As shown in the figure, the arrangement of the direction indicator image 401 and the rear image 402 on the guidance screen varies depending on the direction of the lane change. More specifically, the rear image 402 is arranged on the guidance screen on the side of the destination of the lane change, i.e., on the side where the saddle riding type vehicle 4 is traveling as viewed from the driver 2. Therefore, on the guidance screen of Fig. 4A that provides guidance for a leftward lane change, the rear image 402 is arranged on the left and the direction indicator image 401 is arranged on the right. On the other hand, on the guidance screen of Fig. 4B that provides guidance for a rightward lane change, the rear image 402 is arranged on the right and the direction indicator image 401 is arranged on the left. This allows the driver to intuitively and easily check, via the guidance screen, whether there is a vehicle traveling behind the destination lane, the distance between the vehicles, etc.

[0027] <Extraction of Rear Image> Here, the rear image 402 displayed on the guidance screen is generated by extracting an image of a partial area from the image captured by the on-board camera 44. In a configuration in which one on-board camera 44 is mounted on the saddle-riding vehicle 4 as shown in this embodiment, the image captured of the rear captures an area directly behind the saddle-riding vehicle 4 at the center of the angle of view, as shown in FIG. 5A . Therefore, the image captured by the on-board camera 44 captures both objects to the left and right rear of the saddle-riding vehicle 4 within the angle of view, and therefore includes information that is unnecessary for checking either the left rear or the right rear. In other words, when changing course to the left, the driver 2 is primarily concerned with vehicles located to the left rear of the saddle-riding vehicle 4, so there is little need to present information about objects to the right rear. From another perspective, presenting information about objects to the right rear as the rear image 402 is not preferable because presenting such information could cause the driver 2 to misjudge the rearward situation.

[0028] Therefore, the rear image 402 is generated by extracting an image of an area corresponding to the direction of the lane change from the image captured by the on-board camera. More specifically, when guiding a lane change to the left, the control unit 31 generates the rear image 402 by extracting an area capturing an object to the left rear, including an area directly behind the saddle riding type vehicle 4, from the image captured by the on-board camera 44, as shown in Fig. 5B. When guiding a lane change to the right, the control unit 31 generates the rear image 402 by extracting an area capturing an object to the right rear, including an area directly behind the saddle riding type vehicle 4, from the image captured by the on-board camera 44, as shown in Fig. 5C.

[0029] The rearward position at which the driver 2 should check the situation varies depending on the distance to the lane change point where the lane change is to be completed. That is, when a lane change advance notice is given, it is preferable that there is sufficient distance to the lane change point and that the driver 2 can check a wide area behind the lane change destination, where vehicles that may require caution when making the subsequent lane change are located. For example, because a following vehicle directly behind the driver 2 may change lanes toward the lane change destination, it is preferable that the driver 2 can check the situation not only behind the lane change destination but also directly behind the vehicle 4. On the other hand, when the driver 2 is not far from the lane change point and is notified of the timing at which the driver 2 should actually make the lane change, it is preferable that the driver 2 can particularly check an area closer to the saddle riding type vehicle 4, where vehicles that are likely to enter the lane change destination are located. That is, at the timing when the lane change is actually to be made, there is a low possibility of contact with a vehicle traveling far behind the saddle riding type vehicle 4, and therefore there is little need to notify the driver 2. For example, when changing lanes to the left, there is a possibility that a vehicle traveling nearby in the left lane may be hit, so it is very convenient for the driver 2 to be able to check the situation in the rear image 402 before moving his / her gaze to the side mirror.

[0030] Therefore, when generating the rear image 402, the area extracted from the image captured by the on-board camera 44 is varied depending on the distance to the lane change point. More specifically, in the mode in which the image captured by the on-board camera 44 is as shown in FIG. 5A , for example, if the distance to the lane change point exceeds a predetermined threshold, the rear image 402 is generated by extracting the entire area toward the lane change destination as shown in FIGS. 5B and 5C . On the other hand, for example, if the distance to the lane change point is below the threshold, the rear image 402 is generated by extracting an area near the saddle riding vehicle 4 from the area near the lane change destination as shown in FIG. 6 . Here, the area near the saddle riding vehicle 4 is an area in which a subject located at a predetermined distance or less from the saddle riding vehicle 4, such as to the side of the saddle riding vehicle 4, is captured. FIG. 6A illustrates an example of a guidance screen displayed when a lane change should be made to the left, and FIG. 6B illustrates an example of a guidance screen displayed when a lane change should be made to the right. As can be seen by comparing Figures 4A and 4B with Figures 6A and 6B, the rear image 402 on the guidance screen that is displayed when the distance to the lane change point is below a threshold is configured to present the driver 2 with a more limited view of the rear situation than when the distance exceeds the threshold.

[0031] In this embodiment, the area extracted from the rear image 402 is controlled to vary depending on whether the distance to the lane change point exceeds a threshold. More specifically, if the distance to the lane change point exceeds the threshold, an image in which the entire area closer to the destination of the lane change is extracted is used as the rear image 402, and if the distance is equal to or less than the threshold, an image in which a smaller area closer to the saddle riding type vehicle 4 is extracted is used as the rear image 402. However, the present invention is not limited to this example. For example, the extracted area may be controlled to be smaller as the distance to the lane change point becomes shorter, so as to focus on subjects closer to the saddle riding type vehicle 4.

[0032] <<Display Control Processing>> Specific processing of the display control processing performed for route guidance in the route guidance application in the mobile communication terminal 3 of this embodiment will be described below with reference to the flowchart in Fig. 7. The processing corresponding to the flowchart can be realized by the control unit 31 reading out a corresponding processing program recorded in, for example, the ROM, expanding it into the RAM, and executing it.

[0033] In S701, the control unit 31 determines whether or not to provide lane change guidance. Specifically, the control unit 31 determines whether the saddle riding type vehicle 4 has approached the next lane change point while traveling along the route specified in the route guidance information, and whether the distance to that point has fallen below a predetermined distance threshold. That is, the control unit 31 obtains information about the current location of the saddle riding type vehicle 4 (mobile communication terminal 3), derives the distance to the next lane change point, and makes the determination in this step by comparing that distance with the distance threshold. The distance threshold used in the determination in this step is set to a distance that allows some leeway to the lane change point, such as 600 m. If the control unit 31 determines that lane change guidance should be provided, the process proceeds to S702. If the control unit 31 determines that lane change guidance should not be provided, the process proceeds to S705.

[0034] In S702, the control unit 31 determines whether the distance to the lane change point is below a threshold value indicating the distance at which the lane change should actually be performed. The threshold value used for the determination in this step is set to the distance at which the lane change operation should actually be initiated, such as 20 m. If the control unit 31 determines that the distance to the lane change point is below the threshold value, it proceeds to S703, and if it determines that the distance is equal to or greater than the threshold value, it proceeds to S704.

[0035] In S703, the control unit 31 generates a guidance screen and displays it on the display unit 34. More specifically, the control unit 31 generates a rear image by extracting an image of the immediate area near the lane change destination from the image captured by the onboard camera 44 received from the saddle riding type vehicle 4. The control unit 31 then generates a guidance screen in which the rear image and a direction indication image are arranged horizontally, and displays this on the display unit 34. For example, when turning left, the control unit 31 extracts as the rear image an image of an area capturing subjects near the saddle riding type vehicle 4 to the left rear, as shown in FIG.

[0036] On the other hand, if it is determined in S702 that the distance to the lane change point is equal to or greater than the threshold, the control unit 31 generates a guidance screen in S704 and displays it on the display unit 34. More specifically, the control unit 31 extracts an image of the immediate area near the lane change destination from the image captured by the on-board camera 44 received from the saddle riding type vehicle 4 to generate a rear image. The control unit 31 then generates a guidance screen in which the rear image and a direction indication image are arranged horizontally, and displays it on the display unit 34. For example, when turning left, the control unit 31 extracts an image of the area including the left rear and directly behind the saddle riding type vehicle 4 as the rear image, as shown in FIG. 4A .

[0037] If it is determined in S701 that route change guidance is not to be provided, the control unit 31 displays normal route guidance in S705. The display may be, for example, a display of route and current location information superimposed on map information, or a display of an image captured by the in-vehicle camera 44 that is not extracted.

[0038] In this way, the route guidance device of this embodiment can assist the driver in checking behind the vehicle when changing lanes, thereby contributing to improved safety during vehicle operation. More specifically, by checking the display when receiving guidance on a lane change, the driver can grasp the direction of the lane change and the situation behind the vehicle without moving their line of sight. Furthermore, the area extracted from the image captured by the on-board camera 44 changes depending on the direction of the lane change, and the image of that area is displayed positioned on the lane change destination side, allowing the driver to intuitively grasp the situation behind the lane change destination side. Furthermore, because the extracted area changes depending on the distance to the lane change point, it is possible to appropriately notify the driver of subjects that require attention at each stage from when the driver is made aware of the lane change to when the lane change is actually made.

[0039] [Variation 1] In the above-described embodiment, when providing lane change guidance, a guidance screen including a direction indicator image and a rear image is displayed on the display unit 34. However, the driver's perception of the distance to the vehicle traveling behind may differ depending on whether the driver is checking the rear by looking at the rear image on the guidance screen or visually checking the rear. For this reason, the distance from the saddle-riding vehicle 4 to each object, such as a vehicle or a person, captured within the field of view may be calculated based on the captured image, and a warning to that effect may be displayed on the guidance screen if an object is approaching within a predetermined distance. The warning on the guidance screen may be performed, for example, by superimposing a warning display 901 or 902 on a position corresponding to the object in the rear image, as shown in FIGS. 9A and 9B . As shown in the figures, such a warning regarding approaching objects may be configured to be issued regardless of the distance to the lane change point. The predetermined distance used as a criterion for determining whether to issue a warning may be set to a fixed value, such as 20 m, or may be set to a value that varies depending on the vehicle speed of the saddle-riding vehicle 4 (i.e., a longer value if the vehicle speed is faster and a shorter value if the vehicle speed is slower).

[0040] [Embodiment 2] In the above-described embodiment, the route planning server 5 generates route guidance information based on information about the departure point and the destination, and the mobile communication terminal 3 receives the route guidance information and provides route guidance. However, the present invention is not limited to this. The generation of route guidance information for getting from the departure point to the destination may be performed by the control unit 31 of the mobile communication terminal 3 using road information stored in advance in the storage unit 32. In other words, the present invention can also be realized by the mobile communication terminal 3 acquiring images captured by the on-board camera 44 without communicating with the route planning server 5.

[0041] [Embodiment 3] In the above-described embodiment, the mobile communication terminal 3 connected to the in-vehicle device 40 of the saddle-riding type vehicle 4 performs the display control process, but the present invention is not limited to this. The present invention may also be realized by executing the display control process in the in-vehicle device 40 of the saddle-riding type vehicle 4 and displaying a guidance screen using a display device (display) such as an instrument panel or a route guidance display provided on the saddle-riding type vehicle 4.

[0042] 3B is a block diagram of the on-vehicle device 40 according to this embodiment. In addition to the control unit 41, storage unit 42, communication unit 43, and on-vehicle camera 44 described in the first embodiment, the on-vehicle device 40 includes a display unit 45 and a GNSS sensor 46 used for various displays, including guidance on route changes. The display unit 45 is an electronic image display device (display) with an input function, such as a touch panel display. The GNSS sensor 46 is a sensor that detects the current position of the saddle-ride type vehicle 4. In this embodiment, the communication unit 43 is a wireless communication device capable of communicating with the route planning server 5.

[0043] In a configuration in which the in-vehicle device 40 is configured in this manner, the control unit 41 may perform the display control processing shown in the first embodiment and control the display of a guidance screen on the display unit 45. That is, prior to the display control processing, the control unit 41 transmits information on the departure point and destination to the route planning server 5 to obtain route guidance information, and provides route guidance based on the route guidance information and the current location of the saddle riding type vehicle 4. The control unit 41 displays a guidance screen on the display unit 45 when a lane change is required, and displays route guidance in normal times or an image captured by the in-vehicle camera 44.

[0044] In the present embodiment, the in-vehicle device 40 of the saddle-ride type vehicle 4 receives route guidance information generated by the route planning server 5 and provides route guidance, but similar to the second embodiment, the route guidance information may be generated by the in-vehicle device 40. Alternatively, the route guidance information may be received from the mobile communication terminal 3.

[0045] [Variation 2] In the above-described embodiment, the direction indicator image and the rear image are arranged horizontally on the guidance screen displayed to guide the driver 2 to change routes, but the present invention is not limited to this. From the viewpoint of assisting the driver 2 in checking behind the vehicle when providing route guidance, it is sufficient to present the direction indicator image and the rear image on the same screen, and the arrangement of these images on the guidance screen can also be other forms, such as vertically arranged.

[0046] [Variation 3] In the above embodiment, the image used for the rear image is described as being captured by the onboard camera 44 provided on the saddle riding type vehicle 4. However, the present invention is not limited to this. The rear image may be captured by a camera other than the onboard camera 44, as long as it shows at least the situation behind the saddle riding type vehicle 4. Such cameras include roadside cameras installed at traffic lights, footbridges, etc. For example, the mobile communication terminal 3 or the onboard device 40 of the saddle riding type vehicle 4 can receive an image captured by a roadside camera located in the area where the saddle riding type vehicle 4 is located, upon approaching a lane change point, for example, and use the image in the display control process. The image is an image of an area including the rear of the saddle riding type vehicle 4. In the display control process, an image of the relevant area is extracted from the surrounding image and displayed as a rear image on the guidance screen, thereby presenting the rear situation at the time of the lane change to the driver 2. The images captured by the roadside camera 7 may be received by a direct communication connection between the roadside camera and the mobile communication terminal 3 or the saddle-type vehicle 4, as shown in Figure 8A, or may be received indirectly by a communication connection with an external device 8 that sequentially records the images captured by the roadside camera, as shown in Figure 8B.

[0047] [Embodiment 4] In the above-described embodiment and modified examples, the display control process is described as being executed by the mobile communication terminal 3 or the in-vehicle device 40. However, the display control process may be executed by any information communication terminal configured to receive, for example, a route change guidance execution as a trigger and receive a direction indication image and a surrounding image corresponding to the route change. In this case, a CPU (not shown) built into the information communication terminal loads a display control process program recorded in a storage device such as an HDD into RAM or the like, thereby executing the selection process. Here, the selection process program executed by the CPU may be installed in the storage device of the information communication terminal via a storage medium such as a CD-ROM.

[0048] Although the present invention has been described above by dividing it into a plurality of embodiments and modifications, the configurations of these embodiments and modifications may be applied in combination.

[0049] Summary of the Embodiments The above-described embodiments disclose at least the following route guidance device, route guidance method, storage medium, program, and saddle-type vehicle.

[0050] 1. The route guidance device (3, 40) of the above embodiment includes: an image acquisition means (33, 43) that acquires an image of the surroundings of the vehicle, including at least the area behind the vehicle; and a display control means (31, 41) that, when providing guidance on a lane change for the vehicle, displays a direction indication image (401) for the lane change and the surrounding image side by side on a display (34, 45). According to this embodiment, when providing guidance on a lane change, the driver can grasp the situation behind the vehicle only by viewing the image on the display, without moving their line of sight.

[0051] 2. In the route guidance device of the above embodiment, the display control means changes the arrangement of the direction indication image and the surrounding image in accordance with the direction of the lane change. According to this embodiment, the direction of the lane change can be instantly grasped.

[0052] 3. In the route guidance device of the above embodiment, the display control means displays the direction indication image and the surrounding image side by side in a horizontal direction on the display, and the direction indication image is displayed on the display so as to be positioned on the lane change destination side. According to this embodiment, the driver can intuitively grasp the situation behind the lane change destination side.

[0053] 4. In the route guidance device of the above embodiment, the display control means extracts an area where objects are distributed on the lane change destination side from the surrounding image and displays the area on the display. According to this embodiment, it is possible to limit and present objects that the driver should pay attention to.

[0054] 5. In the route guidance device of the above embodiment, the lane change guidance is started before the vehicle reaches the lane change point, and the display control means varies the area extracted from the surrounding image depending on the distance between the lane change point and the vehicle. According to this embodiment, it is possible to notify the driver of objects that should be paid attention to in stages from the time the driver is made aware of the lane change until the lane change is actually made.

[0055] 6. In the route guidance device of the above embodiment, the display control means narrows the area extracted from the surrounding image when the distance between the lane change point and the vehicle is shorter than a threshold. According to this embodiment, information that requires confirmation can be effectively conveyed to the driver.

[0056] 7. In the route guidance device of the above embodiment, when the distance between the lane change point and the vehicle is shorter than a threshold, the display control means extracts an area close to the vehicle from the surrounding image and displays the area on the display. According to this embodiment, information that requires confirmation can be effectively conveyed to the driver.

[0057] 8. The route guidance device of the above embodiment further includes information acquisition means for acquiring route guidance information, and the display control means determines whether or not to provide route change guidance based on the route guidance information. According to this embodiment, route change guidance can be provided at an appropriate timing during route guidance.

[0058] 9. The route guidance device of the above embodiment further includes communication means (33, 43) for communicating with an external device, and the information acquisition means acquires the route guidance information received in response to the communication means transmitting at least the departure point and destination of the vehicle to the external device. According to this embodiment, it is possible to present information that allows efficient rearward visibility when changing course by utilizing the route guidance information planned by the external device.

[0059] 10. The route guidance device of the above embodiment further includes a generation means (31, 41) that determines a route for the vehicle based on at least a departure point and a destination of the vehicle and generates the route guidance information, and the information acquisition means acquires the route guidance information generated by the generation means. According to this embodiment, it is possible to present information that allows efficient rearward visibility when changing course based on the determined route plan.

[0060] 11. In the route guidance device of the above embodiment, the surrounding image is an image captured by an on-board camera (44) mounted on the vehicle. According to this embodiment, the driver can be appropriately notified of the situation behind the vehicle.

[0061] 12. The route guidance device of the above embodiment further includes a communication means for communicating with an external device, wherein the surrounding image is an image captured by a roadside camera (7), and the image acquisition means acquires an image received by the communication means from the roadside camera located in the area where the vehicle is located. According to this embodiment, the driver can be appropriately notified in a bird's-eye view of the area behind the vehicle.

[0062] 13. The route guidance method of the above embodiment includes an image acquisition step in which a route guidance device acquires an image of the surroundings of the vehicle, including at least the area behind the vehicle, and a display control step (S703, S704) in which, when guiding the vehicle to change its course, a direction indication image for the course change and the surrounding image are displayed side by side on a display. According to this embodiment, when guiding the vehicle to change its course, the driver can grasp the situation behind the vehicle only by viewing the image on the display, without moving their line of sight.

[0063] 14. The computer-readable storage medium of the above embodiment stores a program that causes a computer to execute: an image acquisition process that acquires an image of the surroundings of the vehicle, including at least the area behind the vehicle; and a display control process that, when providing guidance on a lane change for the vehicle, displays a direction indication image for the lane change and the surrounding image side by side on a display. According to this embodiment, when providing guidance on a lane change, the driver can grasp the situation behind the vehicle simply by viewing the display without moving their line of sight.

[0064] 15. The program of the above embodiment causes a computer to execute: an image acquisition process for acquiring an image of the surroundings of the vehicle, including at least the area behind the vehicle; and a display control process for, when providing guidance on a lane change for the vehicle, displaying a direction indication image for the lane change and the surrounding image side by side on a display. According to this embodiment, when providing guidance on a lane change, the driver can grasp the situation behind the vehicle simply by viewing the image on the display, without moving their line of sight.

[0065] 16. The saddle-riding vehicle (4) of the above embodiment is a saddle-riding vehicle equipped with a display (45), a camera (44), and a control device (41), wherein the control device is equipped with: image acquisition means for acquiring an image of the surroundings of the saddle-riding vehicle captured by the camera, including at least the area behind the saddle-riding vehicle; and display control means for displaying a direction indication image (401) for the saddle-riding vehicle and the surrounding image side by side on the display when guiding the saddle-riding vehicle to change course. According to this embodiment, when guiding the saddle-riding vehicle to change course, the driver can grasp the situation behind the vehicle without moving their line of sight, simply by viewing the display. The invention is not limited to the above embodiment, and various modifications and variations are possible within the spirit and scope of the invention.

[0066] This application claims priority based on Japanese Patent Application No. 2023-084682, filed on May 23, 2023, the entire contents of which are incorporated herein by reference.

Claims

1. A route guidance device comprising: an image acquisition means for acquiring an image of the surroundings of the vehicle, including at least the area behind the vehicle; and a display control means for displaying a direction indication image for a route change and the surrounding image side by side on a display when guiding the vehicle to change route.

2. A route guidance device according to claim 1, characterized in that the display control means changes the arrangement of the direction indication image and the surrounding image according to the direction of the lane change.

3. A route guidance device as described in claim 2, characterized in that the display control means displays the direction indication image and the surrounding image side by side in the horizontal direction on the display, and the direction indication image is positioned and displayed on the display on the side of the route change destination.

4. A route guidance device according to claim 1, characterized in that the display control means extracts an area in which subjects are distributed on the side of the course change destination from the surrounding image and displays it on the display.

5. A route guidance device as described in claim 4, wherein the route change guidance is initiated prior to the vehicle reaching the route change point, and the display control means varies the area extracted from the surrounding image depending on the distance between the route change point and the vehicle.

6. A route guidance device as described in claim 5, characterized in that the display control means narrows the area extracted from the surrounding image when the distance between the lane change point and the vehicle is shorter than a threshold value.

7. A route guidance device as described in claim 5, characterized in that the display control means extracts an area close to the vehicle from the surrounding image and displays it on the display when the distance between the lane change point and the vehicle is shorter than a threshold value.

8. A route guidance device as claimed in claim 1, further comprising an information acquisition means for acquiring route guidance information, and wherein said display control means determines whether or not to provide guidance on the route change based on said route guidance information.

9. A route guidance device as described in claim 8, further comprising a communication means for communicating with an external device, wherein the information acquisition means acquires the route guidance information received in response to the communication means transmitting at least the departure point and destination of the vehicle to the external device.

10. A route guidance device as described in claim 8, further comprising a generation means for determining a route for the vehicle based on at least a departure point and a destination of the vehicle and generating the route guidance information, and the information acquisition means acquires the route guidance information generated by the generation means.

11. A route guidance device according to any one of claims 1 to 10, characterized in that the surrounding image is an image captured by an on-board camera mounted on the vehicle.

12. A route guidance device as described in claim 1, further comprising a communication means for communicating with an external device, wherein the surrounding image is an image taken by a roadside camera, and the image acquisition means acquires an image received by the communication means from the roadside camera arranged in the area where the vehicle is located.

13. A route guidance method comprising: an image acquisition process for acquiring an image of the surroundings of the vehicle, including at least the area behind the vehicle; and a display control process for, when guiding the vehicle to change course, displaying a direction indication image for the course change and the surrounding image side by side on a display.

14. A computer-readable storage medium storing a program for causing a computer to execute the following: an image acquisition process for acquiring an image of the surroundings of the vehicle, including at least the area behind the vehicle; and a display control process for displaying a direction indication image for a lane change and the surrounding image side by side on a display when guiding the vehicle to change lane.

15. A program that causes a computer to execute an image acquisition process that acquires an image of the surroundings of the vehicle, including at least the area behind the vehicle, and a display control process that, when guiding the vehicle to change course, displays a direction indication image for the course change and the surrounding image side by side on a display.

16. A saddle-type vehicle equipped with a display, a camera, and a control device, wherein the control device comprises: an image acquisition means for acquiring an image of the surroundings of the saddle-type vehicle including at least the area behind the saddle-type vehicle photographed by the camera; and a display control means for, when guiding the saddle-type vehicle to change course, displaying a direction indication image for the course change and the surrounding image side by side on the display.

Citation Information

Patent Citations

  • Traveling support device

    JP2003016595A

  • Display system, moving body, display method, display program and storage medium thereof

    JP2007223338A

  • Display control device and display control program

    JP2021006805A

  • Advanced Driver Assistance Apparatus, Display Apparatus For Vehicle And Vehicle

    US20170003134A1