Information processor, information processing method, and information processing method

Abstract

To provide an information processor or the like that enables passengers of a vehicle equipped with an in-vehicle camera to intuitively recognize changes in a positional relation with a following vehicle and also to improve both safety in relation to the following vehicle and freedom of movement.SOLUTION: An information processor includes: a processing unit 1 for acquiring a rearward image captured by a rearward camera CR whose shooting range is behind a vehicle and detecting a positional relation between a following vehicle and the vehicle reflected in the rearward image; and a display control unit 3 for moving a display positions of warning indications, etc. indicating positions of other moving vehicles that are displayed along two consecutive sides constituting an outer edge of a rectangle of a display area of a display 14 on which the rearward image is displayed, in accordance with changes in the positional relation with the following vehicle.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] This application belongs to the technical field of information processing apparatuses, information processing methods, and information processing programs. More specifically, it belongs to the technical field of information processing apparatuses and information processing methods for performing information notification processing for passengers of moving objects such as moving vehicles, and programs for such information processing apparatuses.

Background Art

[0002] In recent years, technologies have been developed that use in-vehicle cameras to photograph the inside or outside of a vehicle and provide various information to the passengers of the vehicle (i.e., the driver or passengers of the vehicle) based on the results of the photographing. As a document showing prior art corresponding to such a current situation, for example, the following Patent Document 1 can be cited.

[0003] The prior art disclosed in this Patent Document 1 aims to "display support information that can determine in advance the risk associated with a lane change for a following vehicle." Under this objective, the prior art "evaluates the degree of risk associated with the host vehicle changing lanes into the adjacent lane in relation to a following vehicle traveling in the adjacent lane behind the host vehicle, and based on the evaluation result, superimposes and displays an image of support information representing the degree of risk associated with the lane change and associated with a road section based on the position where the following vehicle exists, on the image of the in-vehicle camera."

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in the prior art disclosed in Patent Document 1, since the image of the support information is displayed so as to overlap with the lane in which the following vehicle in the rear image captured by the in-vehicle camera travels, there is a problem that the visibility of the rear image is impaired.

[0006] Therefore, the present application has been made in view of the above problems, and an example of the problem is to provide an information processing apparatus, an information processing method, and a program for the information processing apparatus that enable a passenger of a vehicle equipped with an in-vehicle camera to intuitively recognize a change in the positional relationship with a following vehicle without impairing the visibility of the image of the in-vehicle camera.

Means for Solving the Problems

[0007] In order to solve the above problems, the invention according to claim 1 includes an image acquisition unit that acquires a rear image captured by a photographing unit whose photographing range is the rear of the moving body, a detection unit that detects the positional relationship between the moving body and another moving body reflected in the rear image, and a presentation position control unit that moves the presentation position of a position indicator indicating the position of the other moving body, which is presented along two consecutive sides constituting the outer edge of a rectangle of a display area where the rear image is displayed, according to a change in the positional relationship.

[0008] In order to solve the above problems, the invention according to claim 7 is an information processing method executed in an information processing apparatus including an image acquisition unit, a detection unit, and a presentation position control unit, the method including an image acquisition step of acquiring, by the image acquisition unit, a rear image captured by a photographing unit whose photographing range is the rear of the moving body, a detection step of detecting, by the detection unit, the positional relationship between the moving body and another moving body reflected in the rear image, and a presentation position control step of moving, by the presentation position control unit, the presentation position of a position indicator indicating the position of the other moving body, which is presented along two consecutive sides constituting the outer edge of a rectangle of a display area where the rear image is displayed, according to a change in the positional relationship.

[0009] In order to solve the above problems, the invention according to claim 8 causes a computer to function as an image acquisition unit that acquires a rear image captured by a photographing unit whose photographing range is the rear of a moving body, a detection unit that detects the positional relationship between the moving body and another moving body reflected in the rear image, and a presentation position control unit that moves the presentation position of a position indicator indicating the position of the other moving body, which is presented along two consecutive sides constituting the outer edge of a rectangle of a display area where the rear image is displayed, in accordance with a change in the positional relationship. BRIEF DESCRIPTION OF THE DRAWINGS

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

[0011] Next, a mode for implementing the present application will be described with reference to FIG. 1. Note that FIG. 1 is a block diagram showing the schematic configuration of the information processing apparatus according to the embodiment.

[0012] As shown in FIG. 1, the information processing apparatus S according to the embodiment includes an image information acquisition unit 1 connected to a photographing unit C whose photographing range is the rear of the moving body, a detection unit 2, and a presentation position control unit 3.

[0013] In this configuration, the image information acquisition unit 1 acquires the rear image photographed by the photographing unit C. The detection unit 2 detects the positional relationship between the other moving body and the moving body reflected in the rear image.

[0014] Based on these, the presentation position control unit 3 moves the presentation position of the position indicator indicating the position of the other moving body, which is presented along two consecutive sides forming the outer edge of the rectangle of the display area where the rear image is displayed, according to the change in the positional relationship detected by the detection unit 2.

[0015] As described above, according to the operation of the information processing apparatus S of the embodiment, the presentation position of the position indicator indicating the position of the other moving body reflected in the rear image, which is presented along two consecutive sides forming the outer edge of the rectangle of the display area where the rear image photographed with the rear of the moving body as the photographing range is displayed, is moved according to the change in the positional relationship between the moving body and the other moving body. Therefore, it is possible to achieve both not impairing the visibility of the rear image and enabling the change in the positional relationship with the other moving body to be intuitively recognized by, for example, the passenger of the moving body.

Example

[0016] Next, specific examples corresponding to the above-described embodiment will be described with reference to FIGS. 2 to 6. Note that the examples described below are examples when the embodiment is applied to an in-vehicle device mounted on a vehicle and having a function of displaying information for assisting the movement of the vehicle. In the following description, the vehicle equipped with the in-vehicle device of the example is simply referred to as the "equipped vehicle".

[0017] Further, FIG. 2 is a block diagram showing the schematic configuration of the in-vehicle device of the embodiment, and FIG. 3 is a flowchart showing the display control process of the embodiment. Further, FIGS. 4 to 6 are diagrams each showing a display example in the display control process of the embodiment. At this time, in FIG. 2, for each constituent member of the embodiment corresponding to each constituent member in the information processing apparatus S of the embodiment shown in FIG. 1, the same member numbers as those of the constituent members in the information processing apparatus S are used.

[0018] (1) Regarding the configuration and operation of the in-vehicle device of the embodiment Next, the configuration and operation of the in-vehicle device of the embodiment will be described with reference to FIG. 2.

[0019] As shown in FIG. 2(a), the in-vehicle device T of the embodiment mounted on the vehicle to be mounted includes a processing unit 1 composed of a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), etc., and a non-volatile recording unit 10 composed of an HDD (Hard Disc Drive) or an SSD (Solid State Drive), etc., a front camera CF and a rear camera CR each composed of a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) element, etc., an operation unit 11 composed of an operation button or a touch panel, etc., a microphone 12, a sensor unit 13 including a GNSS (Global Navigation Satellite System) sensor, etc., a display 14 composed of a liquid crystal display, etc., a speaker 15, an interface 16, and an information marking unit IND provided along the display unit of the display 14. At this time, as illustrated in the front external view in FIG. 2(b), the display 14 is a display mounted on the front of, for example, a rearview mirror (rearview mirror) in the vehicle to be mounted. And the information marking unit IND is composed of, for example, a plurality of LEDs (Light Emitting Diodes) arranged in one row or a plurality of rows along three sides excluding the upper side of the display 14. At this time, the rear camera CR corresponds to an example of the photographing means C of the embodiment.

[0020] Further, the processing unit 1 includes a display control unit 3. At this time, the display control unit 3 may be realized by a hardware logic circuit such as the CPU that constitutes the processing unit 1, or may be realized software-wise by the CPU reading out from the recording unit 10 and executing a program corresponding to the flowchart showing the display control process of the embodiment (see FIG. 3). Further, the processing unit 1 corresponds to an example of the image information acquisition means 1 of the embodiment and an example of the detection means 2 respectively, and the display control unit 3 corresponds to an example of the presentation position control means 3 of the embodiment. Further, as shown by the dashed line in FIG. 2(a), the processing unit 1 and the presentation position control unit 3 constitute an example of the information processing apparatus S of the embodiment.

[0021] In the above configuration, road data R including information on the road on which the vehicle is moving is pre-recorded in the recording unit 10 in a non-volatile manner. This road data R includes so-called navigation processing information such as the position, road width, lanes and their numbers, and the positions of branch points outside the road for each road. These road data R are read out by the processing unit 1 as necessary and used for the display control process of the embodiment.

[0022] On the other hand, the front camera CF has a preset angle centered on the front (traveling direction) of the vehicle as its shooting range. In contrast, the rear camera CR has a preset angle centered on the rear (the direction opposite to the traveling direction) of the vehicle as its shooting range. Then, the front camera CF and the rear camera CR generate image data corresponding to the images taken in their respective shooting ranges and output them to the processing unit 1. At this time, since the above angles in the shooting range of the front camera CF and the above angles in the shooting range of the rear camera CR are each less than 180 degrees, there are regions on both sides of the vehicle with respect to the traveling direction of the vehicle that are not included in any of the above shooting ranges of the front camera CF and the rear camera CR, which exist as so-called blind spots.

[0023] On the other hand, the sensor unit 13 identifies the current position of the in-vehicle device T (in other words, the current position of the vehicle on which it is mounted) using, for example, GNSS or self-standing sensors including the above GNSS sensor, generates current position data indicating the current position, and outputs the data to the processing unit 1. On the other hand, the interface 16 acquires, under the control of the processing unit 1, data necessary for guidance processing and the like performed using the in-vehicle device T from an external server device (not shown) via a network (not shown).

[0024] Then, based on the current position data, the road data R, and the image data from the front camera CF and the rear camera CR respectively, the processing unit 1 and the display control unit 3 perform, as the display control process of the embodiment, warning display and the like of the embodiment in the information marking unit IND, and display an image captured by the rear camera CR on the display 14. The display modes of the warning display and the like and the display mode on the display 14 will be described in detail later.

[0025] Furthermore, the microphone 12 collects, under the control of the processing unit 1, the sound inside the vehicle on which the device is mounted, for example, and outputs the collected result to the processing unit 1 as a sound signal. The speaker 15 emits necessary sounds and the like inside the vehicle on which the device is mounted under the control of the processing unit 1. In addition to the display control process of the embodiment, the processing unit 1 executes guidance processing and the like for guiding the movement of the vehicle on which the device is mounted based on the image data from the front camera CF and the rear camera CR respectively, the current position data, the road data R, and the sound signal and the like. At this time, information to be presented (notified) to the passengers of the vehicle on which the device is mounted as the guidance processing and the like is presented to the passengers by display using the display 14 and the information marking unit IND or by sound emission using the speaker 15. Further, when an operation necessary to cause the in-vehicle device T to perform an operation including the display control process of the embodiment is executed at the operation unit 11, the operation unit 11 generates an operation signal corresponding to the operation and outputs the signal to the processing unit 1. Thereby, the processing unit 1 comprehensively controls the above operation of the in-vehicle device T including the display control process of the embodiment based on the operation signal.

[0026] (2) Regarding the display control process of the embodiment Next, the display control process of the embodiment executed centering on the processing unit 1 and the display control unit 3 of the in-vehicle device T having the configuration described above will be described with reference to FIGS. 3 to 6.

[0027] The display control process of the embodiment is started, for example, at preset time intervals when the vehicle on which the in-vehicle device T is mounted is moving and the in-vehicle device T is operating. Then, as shown in FIG. 3, when the display control process of the embodiment is started, the processing unit 1 first monitors whether a following vehicle following the vehicle on which the in-vehicle device T is mounted is being photographed by the rear camera CR (in other words, whether the following vehicle has entered the shooting range of the rear camera CR) based on the above image data from the rear camera CR (step S1). In the monitoring of step S1, when the following vehicle is not photographed by the rear camera CR (step S1: NO), the processing unit 1 returns to other processes as the in-vehicle device T (for example, the above guidance process, etc.) and continues the other processes. Here, the following vehicle is, for example, another vehicle that moves faster than the vehicle on which the in-vehicle device T is mounted and tries to overtake the vehicle on which the in-vehicle device T is mounted in a lane adjacent to the lane in which the vehicle on which the in-vehicle device T is mounted is moving while the vehicle on which the in-vehicle device T is mounted is moving on a multi-lane road.

[0028] On the other hand, in the monitoring of step S1, when the following vehicle is photographed by the rear camera CR (step S1: YES), next, the processing unit 1 determines whether the following vehicle has approached within a preset threshold distance (for example, a threshold distance preset so that the faster the speed of the vehicle on which the in-vehicle device T is mounted, the longer the distance) as the distance from the vehicle on which the in-vehicle device T is mounted behind the vehicle on which the in-vehicle device T is mounted (step S2). In the determination of step S2, when the distance between the vehicle on which the in-vehicle device T is mounted and the following vehicle is farther than the above threshold distance (step S2: NO), the processing unit 1 returns to the above other processes and continues the other processes. On the other hand, in the determination of step S2, when the following vehicle is approaching so that the distance between the vehicle on which the in-vehicle device T is mounted and the following vehicle is within the above threshold distance (step S2: YES), the display control unit 3 of the processing unit 1 executes a warning display of the embodiment corresponding to the lane in which the following vehicle is moving (step S3).

[0029] Here, the display control process of the warning display in step S3 will be described in more detail with reference to FIG. 4(a). That is, when the warning display in step S3 is performed, the vehicle CA on which the device is mounted and the following vehicle CAF are in the positional relationship illustrated in FIG. 4(a). At this time, the road RD on which the vehicle CA on which the device is mounted moves has the lane LL in which the vehicle CA on which the device is mounted is moving and the lane LR in which the following vehicle CAF is moving to overtake the vehicle CA on which the device is mounted. Since the following vehicle CAF is moving within the imaging range PR of the rear camera CR, as the display corresponding to the image data from the rear camera CR on the display 14, an image in which the following vehicle CAF is reflected is displayed as shown in the lower part of FIG. 4(a). At this time, the display control unit 3 warns the passengers of the vehicle CA on which the device is mounted about the following vehicle CAF by lighting, for example, in red, the portion of the information marking unit IND corresponding to the position of the lane LR in which the following vehicle CAF is moving as the warning display W1. In addition to this, the display control unit 3 may superimpose and display, for example, a rectangular vehicle mark MK indicating the following vehicle CAF at the position of the following vehicle CAF in the display on the display 14.

[0030] Next, while the warning display W1 is lit, the processing unit 1 determines, based on, for example, image data from the rear camera CR, whether the front part of the following vehicle CAF has entered the dead angle area between the shooting range PF of the front camera CF and the shooting range PR of the rear camera CR of the host vehicle CA due to further movement of the host vehicle CA and the following vehicle CAF (step S4). In the determination of step S4, if the front part of the following vehicle CAF has not yet entered the dead angle area (step S4: NO), the processing unit 1 and the display control unit 3 return to step S3 and continue to display the warning display W1 illustrated in FIG. 4(a) below. On the other hand, in the determination of step S4, if the front part of the following vehicle CAF has entered the dead angle area (step S4: YES), the positional relationship between the host vehicle CA and the following vehicle CAF becomes, for example, the positional relationship illustrated in FIG. 4(b) above. Therefore, instead of the warning display W1, the display control unit 3 warns that the following vehicle CAF is entering the dead angle area on the right side of the host vehicle CA (i.e., disappearing from the display on the display 14). As illustrated in FIG. 4(b) below, a corner of the information marking part IND on the lane LR side where the following vehicle CAF moves, and a part of each of the two sides adjacent to the corner are lit in red (i.e., the same color as the warning display W1) as the warning display W2 (step S5). At this time, when comparing the warning display W1 illustrated in FIG. 4(a) below with the warning display W2 illustrated in FIG. 4(b) below, the warning display W1 approaches the corner on the lane LR side (lower right corner) of the display 14 in response to the movement of the following vehicle CAF, and then, as illustrated in FIG. 4(b) below, the right end of the lower side and the lower end of the right side of the information marking part IND (i.e., the side of the information marking part IND on the lane LR side where the following vehicle CAF moves) are lit as the warning display W2.

[0031] Next, in a state where the warning display W2 is lit in response to the movement of the following vehicle CAF, the processing unit 1 determines whether or not the entire following vehicle CAF has disappeared from the shooting range PR of the rear camera CR of the host vehicle CA due to further movement of the host vehicle CA and the following vehicle CAF, for example, based on image data from the rear camera CR (step S6). In the determination of step S6, if a part of the following vehicle CAF (for example, the rear end) is still within the shooting range PR (step S6: NO), the processing unit 1 and the display control unit 3 return to step S5 above and continue to display the warning display W2 illustrated below in FIG. 4(b). At this time, if the following vehicle CAF moves further, the display control unit 3 controls the information display unit IND such that, as the warning display W2, the lit portion at the lower right end of the information display unit IND gradually becomes smaller, and instead, the lit portion at the lower right side of the information display unit IND gradually becomes larger. On the other hand, in the determination of step S6, if the entire following vehicle CAF has disappeared from the shooting range PR (step S6: YES), it means that the following vehicle CAF has entered the above blind spot area (in the case illustrated in FIG. 4, the blind spot area on the right side of the host vehicle CA). Therefore, next, the processing unit 1 determines whether or not the host vehicle CA is moving near a branch point where the following vehicle CAF can exit the road RD from the lane LR in which the following vehicle CAF was moving, for example, using the above current position data and the above road data R, etc. (step S7).

[0032] In the determination of step S7, when the mounted vehicle CA is moving at a position not near the branch point (step S7: NO), as illustrated in FIG. 5(a), it is predicted that the following vehicle CAF, which is currently in the dead angle area, will move straight forward and emerge in front of the mounted vehicle CA. In this case, it is extremely dangerous for the mounted vehicle CA to change lanes toward the lane LR in which the following vehicle CAF is moving. Therefore, in this case, instead of the warning display W2, the display control unit 3 lights up, as illustrated in the lower part of FIG. 5(a), the side of the information display unit IND on the lane LR side where the following vehicle CAF is moving (the right side in the case illustrated in FIG. 5(a)) in, for example, red (i.e., the same color as the warning display W1 and the warning display W2) as the warning display W3 to warn that the following vehicle CAF is moving in the dead angle area on the right side of the mounted vehicle CA (step S8). At this time, when comparing the warning display W2 illustrated in the lower part of FIG. 4(b) with the warning display W3 illustrated in the lower part of FIG. 5(a), the warning display W2 moves from the corner on the lane LR side (the lower right corner) of the display 14 to the right side of the information display unit IND illustrated in FIG. 5(a) (i.e., the side on the lane LR side where the following vehicle CAF is moving) in response to the movement of the following vehicle CAF and is lit up as the warning display W3. Then, the processing unit 1 proceeds to step S10, which will be described later.

[0033] On the other hand, in the determination of step S7, when the vehicle CA equipped with the above is moving near the above branch point (step S7: YES), as illustrated in FIG. 5(b), it is possible that the following vehicle CAF that has entered the above dead angle area has exited the road RD through the side road SR extending from the branch point. At this time, compared with the case where the vehicle CA equipped with the above is moving at a position not near the branch point, it can be said that the necessity of warning the passenger of the vehicle CA equipped with the above to change lanes toward the lane LR on which the following vehicle CAF was moving is low. Therefore, in such a case, the display control unit 3, instead of the above warning display W3, should alert the driver about the movement of the following vehicle CAF in the dead angle area on the right side of the vehicle CA equipped with the above. As illustrated in the lower part of FIG. 5(b), the side (the right side in the case illustrated in FIG. 5(b)) of the information display unit IND on the lane LR side where the following vehicle CAF moves is lit as the caution display CS1, for example, in yellow (that is, a color indicating a lower warning level compared with the above warning display W1 and the above warning display W2) (step S9). At this time, when comparing the warning display W2 illustrated in the lower part of FIG. 4(b) and the caution display CS1 illustrated in the lower part of FIG. 5(b), in response to the movement of the following vehicle CAF, the warning display W2 is changed to the caution display CS1 and lit up.

[0034] Next, when the warning display W3 (see step S8) or the caution display CS1 (see step S9) is being performed, the processing unit 1 monitors, based on the above image data from the front camera CF, whether the following vehicle CAF that has disappeared from the shooting range PR of the rear camera CR earlier (see step S6: YES) is being photographed by the front camera CF (in other words, whether the following vehicle CAF has entered the shooting range PF) (step S10). In the monitoring of step S10, when the following vehicle CAF is not photographed by the front camera CF (step S10: NO), the processing unit 1 and the display control unit 3 return to step S7 above and repeat the processing of steps S7 to S9 described above.

[0035] In the monitoring of one step S10, when a following vehicle CAF is photographed by the front camera CF (step S10: YES), next, the display control unit 3 stops the display of the warning display W3 (see step S8) or the caution display CS1 (see step S9) (step S11). In this case, regarding the positional relationship between the host vehicle CA and the following vehicle CAF, as illustrated in FIG. 6, at least a part of the following vehicle CAF that has moved into the lane LR is moving within the shooting range PF of the front camera CF of the host vehicle CA, and thus the passengers of the host vehicle CA can directly visually recognize the following vehicle CAF. Therefore, as illustrated in the lower part of FIG. 6, the display control unit 3 stops the display of the warning display W3 or the caution display CS1. Thereafter, the processing unit 1 returns to the above-mentioned other processing and continues with the other processing.

[0036] As described above, according to the display control process in the in-vehicle device T of the embodiment, based on the image data from each of the front camera CF and the rear camera CF and the road data R, the possibility that a following vehicle CAF exists in a blind spot area not included in either the shooting range PF of the front camera CF or the shooting range PR of the rear camera CF is displayed using a warning display W3 or a caution display CS1 according to the degree of the possibility (see FIG. 5). Therefore, the passengers of the host vehicle CA can intuitively recognize the existence of the following vehicle CAF in relation to the blind spot area not included in either the shooting range PF or the shooting range PR, and it is possible to achieve both an improvement in safety in relation to the following vehicle CAF and an improvement in the degree of freedom of the movement mode of the host vehicle CA.

[0037] Also, since the possibility of the existence of the following vehicle CAF when the host vehicle CA is passing through a branch point is reported to be relatively lower than that when moving on a road RD other than the branch point (see FIG. 5), it is possible to accurately display the degree of the possibility of the existence of the following vehicle CAF according to the aspect of the road RD.

[0038] Furthermore, since a warning display W1 indicating the high likelihood of the presence of the following vehicle CAF is displayed at the position of the information display section IND indicating the position of the lane LR in which the following vehicle CAF is moving (see Fig. 4(a)), it is possible to accurately display the likelihood of the presence of the following vehicle CAF in accordance with the lane LL of the host vehicle CA.

[0039] Moreover, when the likelihood of the presence of the following vehicle CAF in the blind spot area is relatively high, the high likelihood is displayed by a red warning display W3, and when the likelihood is relatively low, the high likelihood is displayed by a yellow caution display CS1. Therefore, the high likelihood can be displayed in a manner that is easy to recognize.

[0040] Also, since the host vehicle CA is a vehicle equipped with a front camera CF and a rear camera CR, and the blind spot area (see Figs. 4 to 6) that is not included in either the shooting range PF of the front camera CF or the shooting range PR of the rear camera CR is on the side with respect to the moving direction of the host vehicle CA, it is possible to display the high likelihood of the presence of the following vehicle CAF attempting to pass by the side of the host vehicle CA in a manner that is easy to recognize.

[0041] Furthermore, when the following vehicle CAF after overtaking the host vehicle CA is moving within the shooting range PF of the front camera CF, the display of the high likelihood of the presence of the following vehicle CAF in the blind spot area that is not included in either the shooting range PF or the shooting range PR is stopped (see step S11 in Fig. 3). Therefore, the passengers in the host vehicle CA can be easily made aware that they have been overtaken by the following vehicle CAF (see Fig. 6).

[0042] Moreover, since the lane LR in which the following vehicle CAF existing within the shooting range PR of the rear camera CR is moving is displayed together with the following vehicle CAF (see Fig. 4(a)), it is possible to accurately display the presence of the following vehicle CAF in accordance with the lanes LR and LL of the road RD.

[0043] In addition, since a vehicle mark MK indicating a following vehicle CAF existing within the photographing range PR of the rear camera CR is displayed together with an image of the following vehicle CAF (see Fig. 4(a)), the presence of the following vehicle CAF can be displayed more accurately.

[0044] Furthermore, the display positions of warning displays W1 to W3 indicating the positions of the following vehicle CAF shown in the image, which are displayed along two consecutive sides constituting the outer edge of the rectangle of the display area of the display 14 on which an image photographed with the rear of the host vehicle CA as the photographing range PR is displayed, are moved according to changes in the positional relationship between the host vehicle CA and the following vehicle CAF (see Figs. 4 and 5). Therefore, for example, a passenger in the host vehicle CA can intuitively recognize changes in the positional relationship with the following vehicle CAF, and it is possible to achieve both an improvement in safety in relation to the following vehicle CAF and an improvement in the degree of freedom of the movement mode of the host vehicle CA.

[0045] Moreover, since the information display section IND arranged along two consecutive sides constituting the outer edge of the rectangle of the display area of the display 14 displays the warning displays W1 to W3, the passenger in the host vehicle CA can intuitively recognize changes in the positional relationship with the following vehicle without impairing the visibility of the image photographed by the rear camera CR. [Modification Example]

[0046] Next, a modification example corresponding to the embodiment will be described with reference to Fig. 7. Fig. 7 is a diagram showing display examples in the display control process of the modification example. In the description of each of the following modification examples, the same members as those in the components of the embodiment are given the same member numbers, and detailed descriptions thereof are omitted.

[0047] (1) First Modification Example First, a first modification corresponding to the embodiment will be described with reference to Fig. 7(a). In the above-described embodiment, the caution display CS1 was displayed when there was a branch point in the lane LR in which the subsequent vehicle CAF that entered the blind spot area moved (see Fig. 5(a)). However, in addition to this, when the host vehicle CA is moving in the lane LL of the road RDD (without a branch point) having the three lanes LL, lane LR, and lane LC illustrated in Fig. 7(a), and the subsequent vehicle CAF moves in the lane LC and enters the blind spot area of the host vehicle CA, the subsequent vehicle CAF may change lanes to the right lane LR as it moves. Therefore, in such a case, since there is a lane LR to the right of the lane LC in which the subsequent vehicle CAF moves, the possibility that the subsequent vehicle CAF continues to move in the lane LC within the blind spot area of the host vehicle CA is relatively lower compared to the two-lane road RD in the embodiment. Therefore, in the case illustrated in Fig. 7(a), even if there is no branch point on the road RDD, it is possible to configure the caution display CS2 (the display mode thereof is the same as the caution display CS1 in the embodiment) to be displayed on the right side of the information display unit IND of the host vehicle CA. Also with the configuration of this first modification, it is possible to accurately display the high possibility that the subsequent vehicle CAF exists within the blind spot area of the host vehicle CA.

[0048] (2) Second Modification Example Next, a second modification corresponding to the embodiment will be described with reference to FIG. 7(b). For example, the on-vehicle CA moves in the lane LC of the road RDD having three lanes LL (having a branch point to the side road SR), lane LR, and lane LC illustrated in FIG. 7(b), and the following vehicle CAF1 moves in the left lane LL and the following vehicle CAF2 moves in the right lane LR so as to sandwich the on-vehicle CA, and they enter the blind spot areas on both sides of the on-vehicle CA. In such a case, while the possibility that the following vehicle CAF2 moving in the lane LR changes lanes from the lane LR is low, the following vehicle CAF1 moving in the lane LL may move from the lane LL to the side road SR. In such a case, as illustrated in the lower part of FIG. 7(b), a warning display W3 similar to that in the embodiment is displayed on the right side of the information display unit IND of the on-vehicle CA (see step S8 in FIG. 3 and FIG. 5(a)), and a caution display CS1 similar to that in the embodiment is displayed on the left side of the information display unit IND of the on-vehicle CA (see step S9 in FIG. 3 and FIG. 5(b)). According to the configuration of this second modification, it is possible to accurately display the high possibility that the following vehicles CAF1 and CAF2 exist in the blind spot areas on both sides of the on-vehicle CA.

[0049] (3) Third Modification Example Next, a third modification corresponding to the embodiment will be described with reference to FIGS. 7(c) and 7(d). In the above-described embodiment, the caution display CS1 and the warning display W3 of the embodiment are configured to be displayed in a bar shape using the information display unit IND. However, in addition to this, for example, as illustrated in FIG. 7(c), in combination with or instead of the caution display CS1, the warning display W3, etc., a vehicle icon WM representing a vehicle may be used to display the possibility of the existence of the following vehicle CAF moving in the blind spot area. In this case, the vehicle icon WM whose display color corresponds to the caution display CS1, the warning display W3, etc. may be displayed at a position in the display 14 corresponding to the position where there is such a possibility.

[0050] Also, when the vehicle CA equipped with the road RD having a branch point moves, as illustrated in FIG. 7(d), in combination with the caution display CS1 of the embodiment or instead of the caution display CS1, a divided area point icon IM representing the branch point in the same display color as the caution display CS1 etc. (see FIG. 5) can be configured to be displayed on the display 14. In this case, the divided area point icon IM whose display color corresponds to the caution display CS1 may be configured to be displayed at a position within the display 14 corresponding to the position where there is a possibility of its existence. According to the configuration of this third modification example, the high possibility of the presence of a following vehicle CAF etc. within the blind spot area of the vehicle CA can be displayed in a more easily recognizable manner.

[0051] (4) Fourth Modification Example Next, a fourth modification example corresponding to the embodiment will be described. In the above-described embodiment, the caution display CS1 and the warning display W3 of the embodiment are configured to be displayed in a bar shape using the information marking portion IND provided at the outer peripheral portion of the display 14. However, in addition to this, without using the information marking portion IND of the embodiment, using the peripheral portion of the display area of the display 14 itself, a bar-shaped display similar to the warning display W1 to the warning display W3 or the caution display CS1 of the embodiment may be configured to be displayed at the same position, at the same timing, and in the same display color as the warning display W1 to the warning display W3 or the caution display CS1. Also by the configuration of this fourth modification example, the high possibility of the presence of a following vehicle CAF within the blind spot area of the vehicle CA can be accurately displayed.

[0052] (5) Fifth Modification Example Next, as a fifth modification corresponding to the embodiment, in the above-described embodiment, the warning displays W1 to W3 (red) and the caution display CS1 (yellow) were configured to be distinguished by color differences. However, in addition to this, while keeping the display modes of the warning displays W1 to W3 (red) as they are, instead of the caution display CS1, a caution display that blinks in the same red color may be displayed at the position where the caution display CS1 on the information display unit IND should be displayed. Also in this configuration, due to the difference between continuous display and blinking display, it is possible to display the high possibility of the presence of the following vehicle CAF in an easily recognizable manner.

[0053] (6) Other Modification Examples Finally, as another modification corresponding to the embodiment, the display control process of the embodiment was configured to be executed only by the in-vehicle device T. However, in addition to this, with a fixed installation server device connected via a network such as the Internet to an in-vehicle device mounted on the vehicle and having a display and an information display unit similar to the display 14 and the information display unit IND of the embodiment as the center, the display control process of the embodiment can also be configured to be executed. In this case, current position data indicating the current position of the vehicle may be acquired from the in-vehicle device, and the display control process may be executed using the road data R recorded in the server device.

[0054] Also, in the display control process of the embodiment, the possibility of the presence of a following vehicle CAF or the like in the blind spot area was displayed using the display 14 and the information display unit IND. However, in addition to this, it may be configured to specifically notify the possibility level using sound or voice.

[0055] Furthermore, in the display control process of the embodiment, the case where road information such as branch points and the number of lanes used in the display control process is pre-recorded as road data R was described. However, in addition to this, for example, by an image recognition process using image data from a front camera CF or a rear camera CR of the vehicle CA, the road information may be acquired each time the display control process is executed.

[0056] Furthermore, a program corresponding to the flowchart shown in FIG. 3 is recorded on a recording medium such as an optical disk or a hard disk, or obtained via a network such as the Internet, and read and executed by a general-purpose microcomputer or the like, so that the microcomputer or the like can function as the processing unit 1 or the display control unit 3 of the embodiment.

Explanation of Reference Numerals

[0057] 1 Image information acquisition means (processing unit) 2 Detection means 3 Presentation control means (display control unit) C Imaging means IND Notification means (information marking unit) S Information processing device T Vehicle-mounted device CF Front camera CR Rear camera PF, PR Shooting range CA Mounted vehicle CAF, CAF1, CAF2 Following vehicle

Claims

1. An image acquisition means for acquiring a rear image captured by a photographing means having a rear of the moving body as a photographing range; A detection means for detecting a positional relationship between another moving body and the moving body reflected in the rear image; A presentation position control means for moving a presentation position of a position indicator indicating a position of the other moving body, which is presented along two consecutive sides constituting an outer edge of a rectangle of a display area where the rear image is displayed, in accordance with a change in the positional relationship; An information processing apparatus comprising the same.

2. The information processing apparatus according to claim 1, wherein the display area is a display area of a display means provided in the moving body toward the rear of the moving body and for displaying the rear image.

3. The information processing apparatus according to claim 2, wherein each of the moving bodies is a vehicle moving on a moving path having lanes, and the presentation position control means causes the position indicator to be presented at a position within the two sides corresponding to a position of the lane in which the other moving body is moving.

4. The information processing apparatus according to claim 2, further comprising an image display control means for displaying an image of the other moving body at a position within the display area corresponding to the presentation position of the position indicator.

5. The information processing apparatus according to claim 2, further comprising an index display control means for displaying a visibility facilitation index for facilitating visibility of the other moving body reflected in the rear image within the display area for displaying the rear image including an image of the other moving body.

6. In the information processing apparatus according to any one of claims 1 to 5, the presentation position control means causes the position indicator to be presented at a corner of the two sides and a part of each of the two sides adjacent to the corner when a front part of the other moving body enters a blind spot of the photographing means.

7. An information processing method executed in an information processing apparatus comprising an image acquisition means, a detection means, and a presentation position control means, the method comprising: an image acquisition step of acquiring, by the image acquisition means, a rear image captured by a photographing means having a rear of a moving body as a photographing range; a detection step of detecting, by the detection means, a positional relationship between another moving body and the moving body reflected in the rear image; A presentation position control step of moving, by the presentation position control means, the presentation position of a position indicator indicating the position of the other moving body, which is presented along two consecutive sides constituting the outer edge of a rectangular display area where the rear image is displayed, in accordance with a change in the positional relationship; An information processing method characterized by including this.

8. A computer, An image acquisition means for acquiring a rear image photographed by a photographing means having a rear of a moving body as a photographing range, A detection means for detecting a positional relationship between the moving body and another moving body shown in the rear image, and A presentation position control means for moving the presentation position of a position indicator indicating the position of the other moving body, which is presented along two consecutive sides constituting the outer edge of a rectangular display area where the rear image is displayed, in accordance with a change in the positional relationship; An information processing program characterized by causing the computer to function as the above.

Images