Information processing device, information processing method and program for information processing

Abstract

To provide an information processing device or the like which enables an occupant of a vehicle mounted with an on-vehicle camera to intuitively recognize the existence of a subsequent vehicle in a relation to a dead angle and can achieve both the improvement of safety in the relation to the subsequent vehicle and the improvement of a degree of freedom of movement.SOLUTION: An information processing device includes a processing part 1 for respectively acquiring image data of images photographed by a front camera CF and a rear camera CR provided in a vehicle and acquiring road data R being information on a travel road on which the vehicle currently travels, and a display control part 3 for causing an information display part IND to notify a user of the height of a possibility in a plurality of different modes corresponding to the height of the possibility in the case of determining the existence of the possibility that the subsequent vehicle exists in a dead angle area which is not included in respective photographing ranges of the front camera CF and the rear camera CR on the basis of the acquired image data and road data R.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] This application belongs to the technical field of information processing apparatuses, information processing methods, and information processing programs. More specifically, it belongs to the technical field of an information processing apparatus and an information processing method for performing information notification processing for passengers of a moving object such as a moving vehicle, and a program for the information processing apparatus.

Background Art

[0002] In recent years, technologies have been developed to photograph the inside or outside of a vehicle using an in-vehicle camera and provide various information to passengers (i.e., the driver or passengers of the vehicle) based on the results of the photographing. As a document showing prior art corresponding to such a current situation, for example, the following Patent Document 1 can be cited.

[0003] The prior art disclosed in this Patent Document 1 aims to "display support information that can determine in advance the risk associated with a lane change for a following vehicle." Under this objective, the prior art "evaluates the risk associated with the host vehicle changing lanes into the adjacent lane in relation to a following vehicle traveling in the adjacent lane behind the host vehicle, and based on the evaluation result, superimposes and displays an image of support information representing the risk associated with the lane change and associated with a road section based on the position where the following vehicle exists on the image of the in-vehicle camera."

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in the prior art disclosed in the above Patent Document 1, a following vehicle that has entered the blind spot of the in-vehicle camera does not always continue to move in the adjacent lane (i.e., the vehicle equipped with the in-vehicle camera is not overtaken). More specifically, for example, the following vehicle may also exit the road from a branch point within the blind spot. And in such a case, the following vehicle that was captured by the in-vehicle camera becomes not dangerous to the vehicle equipped with the in-vehicle camera. However, in the above prior art, although there is no following vehicle that becomes an obstacle to lane change or the like of the vehicle equipped with the in-vehicle camera, unnecessary image display (warning display) continues, causing problems such as giving the above passengers an unnecessary sense of crisis or annoyance.

[0006] Therefore, the present application is made in view of the above problems, and an example of its problem is to enable a passenger of a vehicle equipped with an in-vehicle camera to intuitively recognize the presence of a following vehicle in relation to the blind spot, and to provide an information processing apparatus, an information processing method, and a program for the information processing apparatus that can achieve both an improvement in safety and an improvement in the degree of freedom of movement in relation to the following vehicle.

Means for Solving the Problem

[0007] In order to solve the above problems, the invention according to claim 1 includes: an image information acquisition means for acquiring image information of images respectively captured by a plurality of imaging means provided in a moving body; a moving path information acquisition means for acquiring moving path information which is information about a moving path during movement of the moving body; and a notification control means for, when it is determined based on the acquired image information and moving path information that there may be another moving body in an area not included in any of the imaging ranges of the respective imaging means, causing the notification means to notify the degree of such possibility in a plurality of different notification modes corresponding to the degree of such possibility.

[0008] In order to solve the above problems, the invention according to claim 11 is an information processing method executed in an information processing apparatus including an image information acquisition unit, a movement path information acquisition unit, and a notification control unit. The method includes: an image information acquisition step of acquiring, by the image information acquisition unit, image information of images captured by a plurality of imaging units provided in a moving body; a movement path information acquisition step of acquiring, by the movement path information acquisition unit, movement path information which is information on a movement path while the moving body is moving; and a notification control step of, based on the acquired image information and movement path information, when it is determined that there may be another moving body in an area not included in the imaging range of each of the imaging units, causing the notification control unit to notify a notification means of the degree of possibility in a plurality of different notification modes according to the degree of possibility.

[0009] In order to solve the above problems, the invention according to claim 12 causes a computer to function as an image information acquisition unit that acquires image information of images captured by a plurality of imaging units provided in a moving body, a movement path information acquisition unit that acquires movement path information which is information on a movement path while the moving body is moving, and a notification control unit that, based on the acquired image information and movement path information, when it is determined that there may be another moving body in an area not included in the imaging range of each of the imaging units, causes a notification means to notify the degree of possibility in a plurality of different notification modes according to the degree of possibility.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Mode for Carrying Out the Invention

[0011] Next, a mode for carrying out the present application will be described with reference to FIG. 1. Note that FIG. 1 is a block diagram showing the schematic configuration of the information processing apparatus of the embodiment.

[0012] As shown in FIG. 1, the information processing apparatus S of the embodiment includes an image information acquisition unit 1 connected to a plurality of imaging units C provided in the moving body, a moving path information acquisition unit 2, and a notification control unit 3 connected to a notification unit IND.

[0013] In this configuration, the image information acquisition unit 1 acquires the image information of the images captured by the imaging units C respectively. On the other hand, the moving path information acquisition unit 2 acquires moving path information, which is information about the moving path of the moving body during movement.

[0014] Based on this, when it is determined that there may be another moving body in an area not included in the imaging range of each of the imaging units C based on the image information acquired by the image information acquisition unit 1 and the moving path information acquired by the moving path information acquisition unit 2, the notification control unit 3 causes the notification unit IND to notify the possibility level in a plurality of different notification modes according to the level of the possibility.

[0015] As described above, according to the operation of the information processing apparatus S of the embodiment, based on the movement path information and the image information from each imaging means C, the possibility that another moving object exists in an area not included in any of the imaging ranges of each imaging means C is notified in a plurality of different notification modes according to the degree of the possibility. Therefore, the existence of another moving object in relation to an area not included in any of the imaging ranges of each imaging means C (that is, a dead angle area) can be intuitively recognized by the passenger of the moving object, and both the improvement of safety in relation to other moving objects and the improvement of the degree of freedom of the movement mode of the moving object can be achieved simultaneously.

Example

[0016] Next, specific examples corresponding to the above-described embodiment will be described with reference to FIGS. 2 to 6. The examples described below are examples in the case where the embodiment is applied to an in-vehicle device mounted on a vehicle and having a function of displaying information for assisting the movement of the vehicle. In the following description, the vehicle equipped with the in-vehicle device of the example is simply referred to as the "equipped vehicle".

[0017] Further, FIG. 2 is a block diagram showing the schematic configuration of the in-vehicle device of the example, and FIG. 3 is a flowchart showing the display control process of the example. Furthermore, FIGS. 4 to 6 are diagrams each showing a display example in the display control process of the example. At this time, in FIG. 2, for each component of the example corresponding to each component in the information processing apparatus S of the embodiment shown in FIG. 1, the same component numbers as those of the components in the information processing apparatus S are used.

[0018] (1) Regarding the configuration and operation of the in-vehicle device of the embodiment Next, the configuration and operation of the in-vehicle device of the example will be described with reference to FIG. 2.

[0019] As shown in Fig. 2(a), an in-vehicle device T of an embodiment mounted on a vehicle to be mounted includes a processing unit 1 composed of a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), etc., a non-volatile recording unit 10 composed of an HDD (Hard Disc Drive) or an SSD (Solid State Drive), etc., a front camera CF and a rear camera CR each composed of a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) element, etc., an operation unit 11 composed of an operation button or a touch panel, etc., a microphone 12, a sensor unit 13 including a GNSS (Global Navigation Satellite System) sensor, etc., a display 14 composed of a liquid crystal display, etc., a speaker 15, an interface 16, and an information marking unit IND provided along the display unit of the display 14. At this time, as exemplified by the front external view in Fig. 2(b), the display 14 is a display mounted on the front surface of, for example, a rearview mirror (rearview mirror) in the vehicle to be mounted. And the information marking unit IND is composed of, for example, a plurality of LEDs (Light Emitting Diodes) arranged in one row or a plurality of rows along three sides excluding the upper side of the display 14. In the above configuration, the front camera CF and the rear camera CR correspond to an example of the photographing means C of the embodiment, and the information marking unit IND corresponds to an example of the notification means IND of the embodiment.

[0020] The processing unit 1 also includes a display control unit 3. At this time, the display control unit 3 may be realized by a hardware logic circuit such as the CPU that constitutes the processing unit 1, or may be realized software-wise by the CPU reading out from the recording unit 10 and executing a program corresponding to the flowchart showing the display control process of the embodiment (see FIG. 3). Furthermore, the processing unit 1 corresponds to an example of the image information acquisition means 1 and an example of the movement path information acquisition means 2 of the embodiment, and the display control unit 3 corresponds to an example of the notification control means 3 of the embodiment. Furthermore, as shown by the dashed line in FIG. 2(a), the processing unit 1 and the display control unit 3 constitute an example of the information processing apparatus S of the embodiment.

[0021] In the above configuration, road data R including information on the road on which the vehicle is traveling is pre-recorded in the recording unit 10 in a non-volatile manner. This road data R includes information for so-called navigation processing such as the position, road width, lanes and the number thereof, and the position of the branch point outside the road for each road. These road data R are read out by the processing unit 1 as necessary and used for the display control process of the embodiment.

[0022] On the other hand, the front camera CF has a preset angle centered on the front (traveling direction) of the vehicle as its shooting range. In contrast, the rear camera CR has a preset angle centered on the rear (opposite direction to the traveling direction) of the vehicle as its shooting range. Then, the front camera CF and the rear camera CR generate image data corresponding to the images of their respective shooting ranges and output them to the processing unit 1. At this time, since the above angles in the shooting range of the front camera CF and the above angles in the shooting range of the rear camera CR are each less than 180 degrees, there is a region that is not included in any of the above shooting ranges of the front camera CF and the rear camera CR on both sides of the vehicle with respect to the traveling direction of the vehicle, which exists as a so-called blind spot region.

[0023] On the other hand, the sensor unit 13 identifies the current position of the in-vehicle device T (in other words, the current position of the vehicle on which it is mounted) using, for example, GNSS or self-standing sensors including the above GNSS sensor, generates current position data indicating the current position, and outputs the data to the processing unit 1. On the other hand, under the control of the processing unit 1, the interface 16 acquires data necessary for guidance processing or the like performed using the in-vehicle device T from an external server device (not shown) via a network (not shown).

[0024] Then, based on the current position data, the road data R, and the image data from the front camera CF and the rear camera CR respectively, the processing unit 1 and the display control unit 3 perform, as the display control processing of the embodiment, warning display and the like of the embodiment in the information marking unit IND, and display an image captured by the rear camera CR on the display 14. The display mode of the warning display and the like and the display mode on the display 14 will be described in detail later.

[0025] Furthermore, the microphone 12 collects, for example, the sound inside the vehicle on which it is mounted under the control of the processing unit 1, and outputs the collection result as a sound signal to the processing unit 1. Also, the speaker 15 emits necessary voices or the like inside the vehicle on which it is mounted under the control of the processing unit 1. Then, in addition to the display control processing of the embodiment, the processing unit 1 executes guidance processing or the like for guiding the movement of the vehicle on which it is mounted based on the image data from the front camera CF and the rear camera CR respectively, the current position data, the road data R, and the sound signal or the like. At this time, information to be presented (notified) to the passengers of the vehicle on which it is mounted as the guidance processing or the like is presented to the passengers by display using the display 14 and the information marking unit IND or by sound emission using the speaker 15. Furthermore, when an operation necessary for causing the in-vehicle device T to perform an operation including the display control processing of the embodiment is executed at the operation unit 11, the operation unit 11 generates an operation signal corresponding to the operation and outputs the signal to the processing unit 1. Thereby, the processing unit 1 comprehensively controls the above operation of the in-vehicle device T including the display control processing of the embodiment based on the operation signal.

[0026] (2) Regarding the display control process of the embodiment Next, the display control process of the embodiment executed centering on the processing unit 1 and the display control unit 3 of the in-vehicle device T having the configuration described above will be described with reference to FIGS. 3 to 6.

[0027] The display control process of the embodiment is started, for example, at preset time intervals when the vehicle on which the device is mounted is moving and the in-vehicle device T is operating. Then, as shown in FIG. 3, when the display control process of the embodiment is started, the processing unit 1 first monitors whether a following vehicle following the vehicle on which the device is mounted is being photographed by the rear camera CR (in other words, whether the following vehicle has entered the shooting range of the rear camera CR) based on the above image data from the rear camera CR (step S1). In the monitoring of step S1, when the following vehicle is not photographed by the rear camera CR (step S1: NO), the processing unit 1 returns to other processing as the in-vehicle device T (for example, the above guidance processing, etc.) and continues the other processing. Here, the following vehicle is, for example, another vehicle that moves faster than the vehicle on which the device is mounted in a lane adjacent to the lane in which the vehicle on which the device is mounted is moving and tries to overtake the vehicle on which the device is mounted while the vehicle on which the device is mounted is moving on a multi-lane road.

[0028] On the other hand, in the monitoring of step S1, when the following vehicle is photographed by the rear camera CR (step S1: YES), next, the processing unit 1 determines whether the following vehicle has approached within a preset threshold distance (for example, a threshold distance preset so as to be longer as the speed of the vehicle on which the device is mounted is higher) as the distance from the vehicle on which the device is mounted behind the vehicle on which the device is mounted (step S2). In the determination of step S2, when the distance between the vehicle on which the device is mounted and the following vehicle is farther than the above threshold distance (step S2: NO), the processing unit 1 returns to the above other processing and continues the other processing. On the other hand, in the determination of step S2, when the following vehicle is approaching so that the distance between the vehicle on which the device is mounted and the following vehicle is within the above threshold distance (step S2: YES), the display control unit 3 of the processing unit 1 executes a warning display of the embodiment corresponding to the lane in which the following vehicle is moving (step S3).

[0029] Here, the display control process of the warning display in step S3 will be described in more detail with reference to FIG. 4(a). That is, when the warning display in step S3 is performed, the vehicle CA on which the device is mounted and the following vehicle CAF are in the positional relationship illustrated in FIG. 4(a). At this time, the road RD on which the vehicle CA on which the device is mounted moves has the lane LL in which the vehicle CA on which the device is mounted is moving and the lane LR in which the following vehicle CAF is moving to overtake the vehicle CA on which the device is mounted. And since the following vehicle CAF is moving within the imaging range PR of the rear camera CR, as the display corresponding to the image data from the rear camera CR on the display 14, an image in which the following vehicle CAF is shown is displayed as shown in the lower part of FIG. 4(a). At this time, the display control unit 3 warns the passengers of the vehicle CA on which the device is mounted about the following vehicle CAF by, for example, lighting up the portion of the information marking unit IND corresponding to the position of the lane LR in which the following vehicle CAF moves in red as the warning display W1. In addition to this, the display control unit 3 may superimpose and display, for example, a rectangular vehicle mark MK indicating the following vehicle CAF at the position of the following vehicle CAF in the display on the display 14.

[0030] Next, while the warning display W1 is lit, the processing unit 1 determines whether the front part of the following vehicle CAF has entered the dead angle area between the shooting range PF of the front camera CF and the shooting range PR of the rear camera CR of the host vehicle CA due to further movement of the host vehicle CA and the following vehicle CAF. For example, it makes this determination based on the image data from the rear camera CR, etc. (step S4). In the determination of step S4, if the front part of the following vehicle CAF has not yet entered the dead angle area (step S4: NO), the processing unit 1 and the display control unit 3 return to step S3 and continue to display the warning display W1 illustrated in FIG. 4(a) below. On the other hand, in the determination of step S4, if the front part of the following vehicle CAF has entered the dead angle area (step S4: YES), the positional relationship between the host vehicle CA and the following vehicle CAF becomes a positional relationship as illustrated in FIG. 4(b) above. Therefore, instead of the warning display W1, the display control unit 3 warns that the following vehicle CAF is entering the dead angle area on the right side of the host vehicle CA (i.e., disappearing from the display on the display 14). As illustrated in FIG. 4(b) below, it lights up, as the warning display W2, for example, in red (i.e., the same color as the warning display W1), a corner of the information marking part IND on the lane LR side where the following vehicle CAF is moving, and a part of each of the two sides adjacent to the corner. (step S5). At this time, when comparing the warning display W1 illustrated in FIG. 4(a) below and the warning display W2 illustrated in FIG. 4(b) below, in response to the movement of the following vehicle CAF, the warning display W1 approaches the corner on the lane LR side (lower right corner) of the display 14, and then, as illustrated in FIG. 4(b) below, the right end of the lower side and the lower end of the right side of the information marking part IND (i.e., the side of the information marking part IND on the lane LR side where the following vehicle CAF is moving) are lit as the warning display W2.

[0031] Next, in a state where the warning display W2 is lit in response to the movement of the following vehicle CAF, the processing unit 1 determines whether the entire following vehicle CAF has disappeared from the shooting range PR of the rear camera CR of the host vehicle CA due to further movement of the host vehicle CA and the following vehicle CAF, for example, based on image data from the rear camera CR (step S6). In the determination of step S6, if a part of the following vehicle CAF (for example, the rear end) is still within the shooting range PR (step S6: NO), the processing unit 1 and the display control unit 3 return to step S5 above and continue to display the warning display W2 illustrated below in FIG. 4(b). At this time, if the following vehicle CAF moves further, the display control unit 3 controls the information display unit IND so that the lit portion at the lower right end of the information display unit IND gradually becomes smaller as the warning display W2, and instead, the lit portion at the lower right end of the right side of the information display unit IND gradually becomes larger. On the other hand, in the determination of step S6, if the entire following vehicle CAF has disappeared from the shooting range PR (step S6: YES), it means that the following vehicle CAF has entered the above dead zone (in the case illustrated in FIG. 4, the dead zone on the right side of the host vehicle CA). Therefore, next, the processing unit 1 determines whether the host vehicle CA is moving near a branch point where the following vehicle CAF can exit the road RD from the lane LR in which the following vehicle CAF was moving, for example, using the above current position data and the above road data R, etc. (step S7).

[0032] In the determination of step S7, when the vehicle CA being mounted is moving at a position not near the branch point (step S7: NO), as illustrated in FIG. 5(a), it is predicted that the following vehicle CAF, which is currently in the blind spot area, will move straight forward and emerge in front of the vehicle CA being mounted. In this case, it is extremely dangerous for the vehicle CA being mounted to change lanes toward the lane LR in which the following vehicle CAF is moving. Therefore, in this case, instead of the warning display W2, the display control unit 3 lights up, as a warning display W3, for example, in red (i.e., the same color as the warning display W1 and the warning display W2), the side of the information display unit IND on the lane LR side where the following vehicle CAF is moving (the right side in the example illustrated in FIG. 5(a)) to warn that the following vehicle CAF is moving in the blind spot area on the right side of the vehicle CA being mounted, as illustrated in the lower part of FIG. 5(a) (step S8). At this time, when comparing the warning display W2 illustrated in the lower part of FIG. 4(b) with the warning display W3 illustrated in the lower part of FIG. 5(a), the warning display W2 moves from the corner on the lane LR side (lower right corner) of the display 14 to the right side of the information display unit IND illustrated in FIG. 5(a) (i.e., the side on the lane LR side where the following vehicle CAF is moving) in response to the movement of the following vehicle CAF, and is lit up as the warning display W3. Thereafter, the processing unit 1 proceeds to step S10, which will be described later.

[0033] On the other hand, in the determination of step S7, when the vehicle CA on board is moving in the vicinity of the above branch point (step S7: YES), as illustrated in FIG. 5(b), there is a possibility that the subsequent vehicle CAF that has entered the dead angle area has exited the road RD through the side road SR extending from the branch point. At this time, compared with the case where the vehicle CA on board is moving at a position not near the branch point, it can be said that there is little need to warn the passengers of the vehicle CA on board to change lanes toward the lane LR in which the subsequent vehicle CAF was moving. Therefore, in such a case, the display control unit 3, instead of the above warning display W3, as illustrated in the lower part of FIG. 5(b), in order to alert the fact that the subsequent vehicle CAF is moving in the dead angle area on the right side of the vehicle CA on board, lights up, for example, in yellow (that is, a color indicating a lower warning level compared with the above warning display W1 and the above warning display W2) the side (the right side in the case illustrated in FIG. 5(b)) of the information display unit IND on the lane LR side where the subsequent vehicle CAF moves as the attention display CS1 (step S9). At this time, when comparing the warning display W2 illustrated in the lower part of FIG. 4(b) and the attention display CS1 illustrated in the lower part of FIG. 5(b), in response to the movement of the subsequent vehicle CAF, it is changed from the warning display W2 to the attention display CS1 and lit up.

[0034] Next, when the warning display W3 (see step S8) or the attention display CS1 (see step S9) is being performed, the processing unit 1 monitors, based on the above image data from the front camera CF, whether the subsequent vehicle CAF that has disappeared from the shooting range PR of the rear camera CR earlier (see step S6: YES) is being photographed by the front camera CF (in other words, whether the subsequent vehicle CAF has entered the shooting range PF) (step S10). In the monitoring of step S10, when the subsequent vehicle CAF is not photographed by the front camera CF (step S10: NO), the processing unit 1 and the display control unit 3 return to step S7 above and repeat the processing of steps S7 to S9 described above.

[0035] In the monitoring of one step S10, when a following vehicle CAF is photographed by the front camera CF (step S10: YES), next, the display control unit 3 stops the display of the warning display W3 (see step S8) or the caution display CS1 (see step S9) (step S11). In this case, regarding the positional relationship between the host vehicle CA and the following vehicle CAF, as illustrated in FIG. 6, at least a part of the following vehicle CAF that has moved into the lane LR is moving within the shooting range PF of the front camera CF of the host vehicle CA, and thus the passengers of the host vehicle CA can directly visually recognize the following vehicle CAF. Therefore, as illustrated in the lower part of FIG. 6, the display control unit 3 stops the display of the warning display W3 or the caution display CS1. Thereafter, the processing unit 1 returns to the above-described other processing and continues with the other processing.

[0036] As described above, according to the display control process in the in-vehicle device T of the embodiment, based on the image data from each of the front camera CF and the rear camera CF and the road data R, the possibility that a following vehicle CAF exists in a blind spot area not included in either the shooting range PF of the front camera CF or the shooting range PR of the rear camera CF is displayed using a warning display W3 or a caution display CS1 according to the degree of the possibility (see FIG. 5). Therefore, the passengers of the host vehicle CA can intuitively recognize the existence of the following vehicle CAF in relation to the blind spot area not included in either the shooting range PF or the shooting range PR, and it is possible to achieve both an improvement in safety in relation to the following vehicle CAF and an improvement in the degree of freedom of the movement mode of the host vehicle CA.

[0037] Also, since the possibility of the existence of the following vehicle CAF when the host vehicle CA is passing through a branch point is reported to be relatively lower than that when moving on a road RD other than the branch point (see FIG. 5), it is possible to accurately display the degree of the possibility of the existence of the following vehicle CAF according to the state of the road RD.

[0038] Furthermore, since a warning display W1 indicating the likelihood of the presence of the following vehicle CAF is displayed at the position of the information display section IND indicating the position of the lane LR in which the following vehicle CAF is moving (see Fig. 4(a)), it is possible to accurately display the likelihood of the presence of the following vehicle CAF in accordance with the lane LL of the host vehicle CA.

[0039] Moreover, when the likelihood of the presence of the following vehicle CAF in the blind spot area is relatively high, the high likelihood is displayed by a red warning display W3, and when the likelihood is relatively low, the high likelihood is displayed by a yellow caution display CS1, so that the high likelihood can be displayed in a recognizable manner.

[0040] In addition, since the host vehicle CA is a vehicle equipped with a front camera CF and a rear camera CR, and a blind spot area (see Figs. 4 to 6) that is not included in either the shooting range PF of the front camera CF or the shooting range PR of the rear camera CR is on the side with respect to the moving direction of the host vehicle CA, it is possible to display the likelihood of the presence of the following vehicle CAF attempting to pass by the side of the host vehicle CA in a recognizable manner.

[0041] Furthermore, when the following vehicle CAF after overtaking the host vehicle CA is moving within the shooting range PF of the front camera CF, the display of the likelihood of the presence of the following vehicle CAF in the blind spot area that is not included in either the shooting range PF or the shooting range PR is stopped (see step S11 in Fig. 3), so that the passengers of the host vehicle CA can easily recognize that they have been overtaken by the following vehicle CAF (see Fig. 6).

[0042] Moreover, since the lane LR in which the following vehicle CAF existing within the shooting range PR of the rear camera CR is moving is displayed together with the following vehicle CAF (see Fig. 4(a)), it is possible to accurately display the presence of the following vehicle CAF in accordance with the lanes LR and LL of the road RD.

[0043] In addition, since a vehicle mark MK indicating a following vehicle CAF existing within the shooting range PR of the rear camera CR is displayed together with an image of the following vehicle CAF (see Fig. 4(a)), the presence of the following vehicle CAF can be displayed more accurately.

[0044] [Modification Example] Next, a modification example corresponding to the embodiment will be described with reference to Fig. 7. Fig. 7 is a diagram showing display examples in the display control process of the modification example. In the description of each of the following modification examples, the same members as those in the components of the embodiment are given the same member numbers and detailed descriptions thereof are omitted.

[0045] (1) First modification example First, a first modification example corresponding to the embodiment will be described with reference to Fig. 7(a). In the above-described embodiment, the caution display CS1 was displayed when there was a branch point in the lane LR where the following vehicle CAF that entered the blind spot area moved (see Fig. 5(a)). However, in addition to this, when the host vehicle CA is moving in the lane LL of a road RDD (without a branch point) having three lanes LL, lane LR, and lane LC illustrated in Fig. 7(a), and the following vehicle CAF moves in the lane LC and enters the blind spot area of the host vehicle CA, the following vehicle CAF may change lanes to the right lane LR as it moves. Therefore, in such a case, due to the presence of the lane LR to the right of the lane LC where the following vehicle CAF moves, the possibility that the following vehicle CAF continues to move in the lane LC within the blind spot area of the host vehicle CA is relatively lower compared to the two-lane road RD in the embodiment. Therefore, in the case illustrated in Fig. 7(a), even if there is no branch point on the road RDD, a caution display CS2 (the display mode thereof is the same as the caution display CS1 in the embodiment) can be configured to be displayed on the right side of the information display section IND of the host vehicle CA. Also with the configuration of this first modification example, the high possibility of the presence of the following vehicle CAF within the blind spot area of the host vehicle CA can be accurately displayed.

[0046] (2) Second modification example Next, a second modification corresponding to the embodiment will be described with reference to FIG. 7(b). For example, as illustrated in FIG. 7(b), the on-vehicle CA moves in the lane LC of the road RDD having three lanes LL (having a branch point to the side road SR), lane LR, and lane LC. Assume that the following vehicle CAF1 moves in the left lane LL and the following vehicle CAF2 moves in the right lane LR so as to sandwich the on-vehicle CA, and enter the blind spot areas on both sides of the on-vehicle CA. In such a case, while the possibility that the following vehicle CAF2 moving in the lane LR changes lanes from the lane LR is low, the following vehicle CAF1 moving in the lane LL may move from the lane LL to the side road SR. In such a case, as illustrated in the lower part of FIG. 7(b), a warning display W3 similar to that in the embodiment is displayed on the right side of the information display unit IND of the on-vehicle CA (see step S8 in FIG. 3 and FIG. 5(a)), and a caution display CS1 similar to that in the embodiment is displayed on the left side of the information display unit IND of the on-vehicle CA (see step S9 in FIG. 3 and FIG. 5(b)). According to the configuration of this second modification, it is possible to accurately display the high possibility that the following vehicles CAF1 and CAF2 exist in the blind spot areas on both sides of the on-vehicle CA.

[0047] (3) Third modification example Next, a third modification corresponding to the embodiment will be described with reference to FIGS. 7(c) and 7(d). In the above-described embodiment, the caution display CS1 and the warning display W3 of the embodiment are configured to be displayed in a bar shape using the information display unit IND. However, in addition to this, for example, as illustrated in FIG. 7(c), in combination with or instead of the caution display CS1, the warning display W3, etc., a vehicle icon WM representing a vehicle may be used to display the possibility of the existence of the following vehicle CAF moving in the blind spot area. In this case, the vehicle icon WM whose display color corresponds to the caution display CS1, the warning display W3, etc. may be displayed at a position in the display 14 corresponding to the position where there is such a possibility.

[0048] Also, when the vehicle CA equipped with the road RD having a branch point moves, as illustrated in FIG. 7(d), in combination with the caution display CS1 of the embodiment or in place of the caution display CS1, a division point icon IM representing the branch point in the same display color as the caution display CS1 etc. (see FIG. 5) can be configured to be displayed on the display 14. In this case, the division point icon IM whose display color corresponds to the caution display CS1 may be configured to be displayed at a position within the display 14 corresponding to the position where such a possibility of existence exists. According to the configuration of this third modification example, the high possibility of the existence of a following vehicle CAF etc. within the blind spot area of the vehicle CA can be displayed in a more easily recognizable manner.

[0049] (4) Fourth modification example Next, a fourth modification example corresponding to the embodiment will be described. In the above-described embodiment, the caution display CS1 and the warning display W3 of the embodiment are configured to be displayed in a bar shape using the information marking portion IND provided at the outer peripheral portion of the display 14. However, in addition to this, without using the information marking portion IND of the embodiment, using the peripheral portion of the display area itself of the display 14, a bar-shaped display similar to the warning display W1 to the warning display W3 or the caution display CS1 of the embodiment may be configured to be displayed at the same position, at the same timing, and in the same display color as the warning display W1 to the warning display W3 or the caution display CS1. Also by the configuration of this fourth modification example, the high possibility of the existence of a following vehicle CAF within the blind spot area of the vehicle CA can be accurately displayed.

[0050] (5) Fifth modification example Next, as a fifth modification corresponding to the embodiment, in the above-described embodiment, the warning displays W1 to W3 (red) and the caution display CS1 (yellow) are configured to be distinguished by color differences. However, in addition to this, while keeping the display modes of the warning displays W1 to W3 (red) as they are, instead of the caution display CS1, a caution display that blinks in the same red color may be configured to be displayed at the position where the caution display CS1 should be displayed on the information marking unit IND. Also in this configuration, due to the difference between continuous display and blinking display, it is possible to display the high possibility of the presence of the following vehicle CAF in a recognizable manner.

[0051] (6) Other modification examples Finally, as another modification corresponding to the embodiment, the display control process of the embodiment is configured to be executed only by the in-vehicle device T. However, in addition to this, centering on a fixed installation server device connected via a network such as the Internet to an in-vehicle device mounted on the vehicle and having a display and an information marking unit similar to the display 14 and the information marking unit IND of the embodiment, the display control process of the embodiment can also be configured to be executed. In this case, current position data indicating the current position of the vehicle is acquired from the in-vehicle device, and the display control process may be executed using the road data R recorded in the server device.

[0052] Also, in the display control process of the embodiment, the possibility of the presence of a following vehicle CAF or the like in the blind spot area is displayed using the display 14 and the information marking unit IND. However, in addition to this, it may be configured to specifically notify the possibility level using sound or voice.

[0053] Furthermore, in the display control process of the embodiment, the case where road information such as branch points and the number of lanes used in the display control process is pre-recorded as road data R has been described. However, in addition to this, for example, by an image recognition process using image data from a front camera CF or a rear camera CR of the vehicle CA, the road information may be configured to be acquired each time the display control process is executed.

[0054] Furthermore, a program corresponding to the flowchart shown in FIG. 3 is recorded on a recording medium such as an optical disk or a hard disk, or acquired via a network such as the Internet, and read and executed by a general-purpose microcomputer or the like, whereby the microcomputer or the like can be made to function as the processing unit 1 or the display control unit 3 of the embodiment.

Description of Signs

[0055] 1 Image information acquisition means (processing unit) 2 Travel route information acquisition means 3 Notification control means (display control unit) C Imaging means IND Notification means (information marking unit) S Information processing apparatus T Vehicle-mounted device CF Front camera CR Rear camera PF, PR Shooting range CA Mounted vehicle CAF, CAF1, CAF2 Following vehicle

Claims

1. Image information acquisition means for acquiring the image information of images respectively captured by a plurality of imaging means provided in a moving body; Moving path information acquisition means for acquiring moving path information which is information regarding a moving path during the movement of the moving body; Based on the acquired image information and moving path information, when it is determined that there may be another moving body in an area not included in the imaging range of each of the imaging means, a notification control means for causing a notification means to notify the height of the possibility in a plurality of different notification modes according to the height of the possibility; An information processing apparatus characterized by comprising the same.

2. In the information processing apparatus according to Claim 1, When the boarding moving body, which is the moving body on which a passenger who receives the notification of the height of the possibility boards, passes through a branch point of the moving path, the notification control means controls the notification mode so that the possibility at this time is notified to be relatively lower than the possibility when the boarding moving body moves on the moving path other than the branch point. An information processing apparatus characterized by this.

3. In the information processing apparatus according to Claim 1, Each of the moving bodies is a vehicle, The moving path has a plurality of lanes, The notification control means controls the notification mode so as to display a possibility index indicating the height of the possibility at the position of the notification means indicating the position of the lane in which the other moving body is moving. An information processing apparatus characterized by this.

4. In the information processing apparatus according to Claim 1, The notification control means notifies the height of the possibility by displaying a possibility index indicating the height of the possibility, As the notification mode, when the possibility is relatively high, the notification control means notifies the height of the possibility by the red possibility index, and when the possibility is relatively low, the notification control means notifies the height of the possibility by the yellow possibility index. An information processing apparatus characterized by this.

5. In the information processing apparatus according to Claim 1, The notification control means notifies the possibility by displaying a possibility index indicating the height of the possibility, The notification control means notifies the height of the possibility by continuously displaying the possibility index when the possibility is relatively high, and notifies the height of the possibility by blinking the possibility index when the possibility is relatively low. An information processing apparatus characterized by this.

6. In the information processing apparatus according to Claim 1, The information processing apparatus is characterized in that the notification control means causes the possibility height to be notified by displaying together a possibility index indicating the height of the possibility and an image representing the other moving body.

7. In the information processing apparatus according to claim 1, the boarding moving body, which is the moving body on which a passenger who receives the notification of the height of the possibility boards, is a vehicle provided with the two photographing means, one of the photographing means is a front photographing means having the front of the vehicle as the photographing range, and the other photographing means is a rear photographing means having the rear of the vehicle as the photographing range, the information processing apparatus is characterized in that the area is on the side of the moving body with respect to the moving direction of the boarding moving body.

8. In the information processing apparatus according to claim 7, the other moving body is the vehicle that overtakes the moving body, the information processing apparatus is characterized in that the notification control means stops the notification of the height of the possibility when the other moving body exists within the photographing range of the front photographing means.

9. In the information processing apparatus according to claim 1, each of the moving bodies is a vehicle, the moving path has a plurality of lanes, the information processing apparatus is characterized in that the notification control means causes the notification means to notify, together with the other moving body, the lane in which the other moving body existing within the photographing range is moving.

10. In the information processing apparatus according to claim 9, the information processing apparatus is characterized in that the notification control means causes the notification means to display, together with the image of the other moving body, a visibility facilitation index that facilitates the visibility of the other moving body existing within the shadow range.

11. An information processing method executed in an information processing apparatus including an image information acquisition means, a moving path information acquisition means, and a notification control means, an image information acquisition step of acquiring, by the image information acquisition means, image information of images photographed by a plurality of photographing means provided in a moving body; a moving path information acquisition step of acquiring, by the moving path information acquisition means, moving path information that is information regarding a moving path while the moving body is moving; a notification control step of causing the notification control means to notify the notification means of the height of the possibility in a plurality of different notification modes according to the height of the possibility when it is determined that there may be another moving body in an area not included in any of the photographing ranges of each of the photographing means based on the acquired image information and moving path information; An information processing method characterized by including the above.

12. A computer, an image information acquisition means for acquiring image information of images respectively captured by a plurality of imaging means provided in a moving body, a travel path information acquisition means for acquiring travel path information which is information about a travel path while the moving body is moving, and a notification control means for causing a notification means to notify the height of the possibility that another moving body may exist in an area not included in the imaging range of each of the imaging means when it is determined based on the acquired image information and travel path information that there is a possibility that another moving body exists in an area not included in the imaging range of each of the imaging means, in a plurality of different notification modes according to the height of the possibility; An information processing program characterized by causing the computer to function as such.

Images