Display control device, display control method, and program

Abstract

To provide a display control device, a display control method, and a program capable of identifying a positional relationship of different image information obtained by imaging surroundings of a vehicle.SOLUTION: A display control device 1 comprises an image information acquisition unit 3, a first image information generation unit 41, and a second image information generation unit 42. The image information acquisition unit 3 acquires imaging information obtained by capturing images of surroundings of a vehicle. The first image information generation unit 41 generates first image information to be displayed on a display device 30 by corresponding to a first area which is a part of an image information area. The second image information generation unit 42 generates second image information to be displayed on the display device 30 by corresponding to a second area which is a part of the image information area and is different from the first area. The display control device 1 further comprises an identification information generation unit 43. The identification information generation unit 43 generates identification information for identifying a positional relationship between the first image information and the second image information, and displays the identification information on the display device 30.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to a display control device, a display control method, and a program.

Background Art

[0002] The following Patent Document 1 discloses a technique related to a driving support device, a driving support method, and a driving support program. In this technique, a "reference image" is generated by synthesizing three images captured using a rear camera, a left side camera, and a right side camera of the host vehicle, respectively. During normal driving of the host vehicle, a display image representing the rear view directly behind the host vehicle captured by the rear camera is cut out from the "reference image", and this display image is displayed on the display unit. The display unit is a display of a navigation system arranged on the instrument panel. On the other hand, during abnormal driving of the host vehicle, a display image representing the rear side view of the host vehicle captured by the side camera and a display image representing the rear view directly behind the host vehicle captured by the rear camera are cut out from the "reference image", and this display image is displayed on the display unit.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, in the above technique, when switching from normal driving to abnormal driving on the display unit, the positional relationship of the display image added during abnormal driving with respect to the display image during normal driving is difficult for the driver to grasp. For this reason, there is room for improvement. This is an example of the problems to be solved by the invention.

[0005] The present invention provides a display control device, a display control method, and a program for executing this display control method, which can identify the positional relationship of different image information obtained by imaging the surroundings of a vehicle.

Means for Solving the Problems

[0006] The invention according to claim 1 is a display control device, comprising: an acquisition unit that acquires image information obtained by imaging the surroundings of the vehicle; a determination unit that determines the presence or absence of an obstacle with respect to the vehicle; a display control unit that, when the determination unit determines that there is no obstacle, causes a display device to display first image information corresponding to a first region that is a part of the region of the image information, and when the determination unit determines that there is an obstacle, causes the display device to display second image information corresponding to a second region that is a part of the region of the image information and includes the obstacle, in a manner capable of identifying the positional relationship between the first image information and the second image information; and a line-of-sight detection unit that detects the line-of-sight direction of the driver of the vehicle. The display control unit is characterized in that, while an image including the second image information is being displayed on the display device, when it is determined based on the line-of-sight direction of the driver that the driver has confirmed the display device, the display device is caused to display an image that does not include the second image information and includes the first image information.

[0007] The invention according to claim 5 is a display control method executed by a display control device, comprising: an acquisition step of acquiring image information obtained by imaging the surroundings of a vehicle; a determination step of determining the presence or absence of an obstacle with respect to the vehicle; when it is determined in the determination step that there is no obstacle, causing a display device to display first image information corresponding to a first region that is a part of the region of the image information, and when it is determined in the determination step that there is an obstacle, causing the display device to display second image information corresponding to a second region that is a part of the region of the image information and includes the obstacle, in a manner that enables identification of the positional relationship between the first image information and the second image information; and a line-of-sight detection step of detecting the line-of-sight direction of the driver of the vehicle. The display control step causes the display device to display an image that does not include the second image information and includes the first image information when it is determined, based on the line-of-sight direction of the driver, that the driver has confirmed the display device while an image including the second image information is being displayed on the display device.

[0008] The invention according to claim 6 is a program executed by a computer of a display control device, causing the computer to function as: an acquisition unit that acquires image information obtained by imaging the surroundings of a vehicle; a determination unit that determines the presence or absence of an obstacle with respect to the vehicle; a display control unit that, when it is determined by the determination unit that there is no obstacle, causes a display device to display first image information corresponding to a first region that is a part of the region of the image information, and when it is determined by the determination unit that there is an obstacle, causes the display device to display second image information corresponding to a second region that is a part of the region of the image information and includes the obstacle, in a manner that enables identification of the positional relationship between the first image information and the second image information; and a line-of-sight detection unit that detects the line-of-sight direction of the driver of the vehicle. The display control unit causes the display device to display an image that does not include the second image information and includes the first image information when it is determined, based on the line-of-sight direction of the driver, that the driver has confirmed the display device while an image including the second image information is being displayed on the display device.

[0009] According to the invention of claim 7, in a display control device, an acquisition unit that acquires image information obtained by imaging the surroundings of a vehicle, a first image information generation unit that generates first image information corresponding to a first region that is a part of the region of the image information, a determination unit that determines the presence or absence of an obstacle approaching the vehicle, and when the determination unit determines that the obstacle is present, a second image information generation unit that generates second image information corresponding to a second region that is a part of the region of the image information and that is an extension of the first region until the obstacle is included; a display switching unit that causes the first image information to be displayed on a display device when the determination unit determines that the obstacle is absent, and causes the second image information to be displayed on the display device when the determination unit determines that the obstacle is present; an identification information generation unit that generates identification information for identifying the positional relationship between the first image information and the second image information and causes the identification information to be displayed on the display device; and a line-of-sight detection unit that detects the line-of-sight direction of the driver of the vehicle. The display switching unit is characterized in that while an image including the second image information is being displayed on the display device, when it is determined that the driver has confirmed the display device based on the line-of-sight direction of the driver, an image that does not include the second image information and includes the first image information is displayed on the display device.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Embodiments for Carrying Out the Invention

[0011] The display control device according to the first embodiment of the present invention includes an acquisition unit that acquires image information obtained by imaging the surroundings of a vehicle, a first image information generation unit that corresponds to a first region that is part of the region of the image information and generates first image information to be displayed on a display device, a second image information generation unit that corresponds to a second region that is part of the region of the image information and is different from the first region and generates second image information to be displayed on the display device, and an identification information generation unit that generates identification information for identifying the positional relationship between the first image information and the second image information and causes the identification information to be displayed on the display device.

[0012] The display control device according to the first embodiment includes an acquisition unit, a first image information generation unit, and a second image information generation unit. The acquisition unit acquires imaging information obtained by imaging the surroundings of the vehicle. The first image information generation unit generates first image information corresponding to a first region that is a part of the region of the image information and is to be displayed on the display device. The second image information generation unit generates second image information corresponding to a second region that is a part of the region of the image information and is different from the first region and is to be displayed on the display device.

[0013] Here, the display control device further includes an identification information generation unit. The identification information generation unit generates identification information for identifying the positional relationship between the first image information and the second image information and causes the display device to display it. Therefore, the positional relationship between the first image information and the second image information, which are different from each other and obtained by imaging the surroundings of the vehicle, can be identified on the display device.

[0014] In the display control device according to the second embodiment of the present invention, in the display control device according to the first embodiment, the second region includes at least a part of the first region.

[0015] According to the display control device according to the second embodiment, since the second region includes at least a part of the first region, second image information including at least a part of the first image information can be generated. For example, with respect to the first image information displayed on the display device, second image information obtained by expanding the field of view of the surroundings of the vehicle further in the left - right direction of the first image information can be caused to be displayed on the display device. Also, the first image information displayed on the display device and enlarged image information obtained by enlarging a part of the first image information can be caused to be displayed on the display device as the second image information. Furthermore, in the display control device, since it is a switch from the first image information to the second image information, the display can be instantaneously switched on the display device.

[0016] In the display control device according to the third embodiment of the present invention, in the display control device according to the first embodiment, the second region does not include the first region.

[0017] According to the display control device according to the third embodiment, since the second region does not include the first region, the second image information is generated without including the first image information, and the second image information can be generated independently of the generation of the first image information. For example, the display device can display the first image information obtained by imaging the rear of the vehicle surroundings and the second image information obtained by imaging the rear side of the vehicle surroundings independent of the first image information.

[0018] The display control device according to the fourth embodiment of the present invention is a display control device according to the first embodiment or the second embodiment, and further includes an intermediate image generation unit that generates intermediate image information to be displayed on the display device between the display of the first image information and the display of the second image information when switching between the display of the first image information and the display of the second image information. The intermediate image information includes third image information corresponding to a third region located between the first region and the second region among the regions of the image information.

[0019] The display control device according to the fourth embodiment further includes an intermediate image generation unit. The intermediate image generation unit generates intermediate image information to be displayed on the display device between the display of the first image information and the display of the second image information when switching between the display of the first image information and the display of the second image information. The intermediate image information includes third image information corresponding to a third region located between the first region and the second region among the regions of the image information. Therefore, on the display device, since the second image information is displayed via the display of the intermediate image information from the display of the first image information, the display switching is performed gradually or step by step. In addition, since the intermediate image information includes the third image information corresponding to the third region located between the first region and the second region among the regions of the image information, it is possible to easily grasp the switching direction from the first image information to the second image information.

[0020] The display control device according to the fifth embodiment of the present invention is a display control device according to any one of the first to fourth embodiments, and further includes display switching means for switching from the display of the second image information to the display of the first image information.

[0021] The display control device according to the fifth embodiment further includes display switching means. The display switching means can be switched from the display of the second image information to the display of the first image information on the display device. Therefore, the driver can switch the display of the display device to the first image information after checking the second image information displayed on the display device.

[0022] In the display control device according to the sixth embodiment of the present invention, in the display control device according to the first embodiment or the third embodiment, the second image information is displayed on the display device in accordance with the arrangement direction of the second area with respect to the first area for the first image information.

[0023] According to the display control device according to the sixth embodiment, it is possible to match the positional relationship between the first area and the second area obtained by imaging the surroundings of the vehicle and the positional relationship between the first image information and the second image information displayed on the display device.

[0024] In the display control device according to the seventh embodiment of the present invention, in the display control device according to any one of the first to sixth embodiments, the identification information is information of a mark that emphasizes an area corresponding to the first image information displayed on the display device, or a mark that represents the positional relationship between the first image information and the second image information.

[0025] According to the display control device according to the seventh embodiment, the identification information is information of a mark. The mark emphasizes an area corresponding to the first image information displayed on the display device, or represents the positional relationship between the first image information and the second image information. Therefore, the driver can clearly identify the positional relationship between the second image information and the first image information by looking at the identification information of the mark displayed on the display device.

[0026] In the display control device according to the eighth embodiment of the present invention, in the display control device according to any one of the first to seventh embodiments, it further includes a storage unit that stores the image information, the first image information, the second image information, and the identification information.

[0027] The display control device according to the eighth embodiment further includes a storage unit. The storage unit stores image information, first image information, second image information, and identification information. Therefore, in the storage unit, in addition to the image information obtained by imaging the surroundings of the vehicle, the first image information, the second image information, and the identification information to be displayed on the display device can be stored.

[0028] In the display control device according to the ninth embodiment of the present invention, in the display control device according to any one of the first to seventh embodiments, it further includes a storage unit that stores at least image information, and in the image information stored in the storage unit, the first image information and the second image information are each made identifiable.

[0029] The display control device according to the ninth embodiment further includes a storage unit. The storage unit stores at least image information. In the image information stored in the storage unit, the first image information and the second image information are each made identifiable. For example, when each of the first image information and the second image information is generated, an identifier is attached to each of the first area and the second area of the image information, and the image information is stored in the storage unit. Therefore, the first image information and the second image information can each be retrieved from the image information stored in the storage unit.

[0030] The display control device according to the tenth embodiment of the present invention is the display control device according to any one of the first to seventh embodiments, and further includes a storage unit that stores the first image information and the second image information to be displayed on the display device.

[0031] The display control device according to the tenth embodiment further includes a storage unit. The storage unit stores the first image information and the second image information to be displayed on the display device. Therefore, the first image information and the second image information to be displayed on the display device can be retrieved from the storage unit.

[0032] The display control device according to the 11th embodiment of the present invention is the display control device according to the 1st to 10th embodiments. Image information is generated in a plurality at a predetermined frame rate. Each of the first image information and the second image information is generated corresponding to each of the first area and the second area in the same frame or different frames of the image information.

[0033] In the display control device according to the 11th embodiment, image information is generated in a plurality at a predetermined frame. And each of the first image information and the second image information is generated corresponding to each of the first area and the second area in the same frame of the image information. For this reason, since each of the first image information and the second image information is generated from the image information in one frame, the usage efficiency of the image information can be improved, and further, each of the first image information and the second image information can be generated at the same timing without a time difference. Also, each of the first image information and the second image information can be generated corresponding to each of the first area and the second area in different frames of the image information.

[0034] The display control device according to the 12th embodiment of the present invention includes an acquisition unit that acquires each of the first image information in which a part of the periphery of the vehicle is imaged and the second image information that is different from the first image information in which a part of the periphery of the vehicle is imaged, and generates identification information for identifying the positional relationship between the first image information and the second image information, and an identification information generation unit that causes the display device on which the first image information is displayed to display the identification information when the second image information is displayed on the display device.

[0035] The display control device according to the 12th embodiment includes an acquisition unit. The acquisition unit acquires each of the first image information in which a part of the periphery of the vehicle is imaged and the second image information that is different from the first image information in which a part of the periphery of the vehicle is imaged.

[0036] Here, the display control device further includes an identification information generation unit. The identification information generation unit generates identification information for identifying the positional relationship between the first image information and the second image information. Then, when the second image information is to be displayed on the display device on which the first image information is displayed, the identification information generation unit causes the display device to display the identification information. Therefore, the positional relationship between the first image information and the second image information, which are different from each other and are images of the surroundings of the vehicle, can be identified on the display device.

[0037] The display control method according to the 13th embodiment of the present invention includes a step of acquiring image information obtained by imaging the surroundings of a vehicle, a step of generating first image information corresponding to a first region that is a part of the region of the image information and to be displayed on a display device, a step of generating second image information corresponding to a second region that is a part of the region of the image information and is different from the first region and to be displayed on the display device, and a step of generating identification information for identifying the positional relationship between the first image information and the second image information and causing the display device to display the identification information.

[0038] In the display control method according to the 13th embodiment, first, image information obtained by imaging the surroundings of the vehicle is acquired. First image information corresponding to a first region that is a part of the region of this image information and to be displayed on the display device is generated. On the other hand, second image information corresponding to a second region that is a part of the image information and is different from the first region and to be displayed on the display device is generated.

[0039] Here, the display control method further generates identification information for identifying the positional relationship between the first image information and the second image information and causes the display device to display the identification information. Therefore, the positional relationship between the first image information and the second image information, which are different from each other and are images of the surroundings of the vehicle, can be identified on the display device.

[0040] The program according to the 14th embodiment of the present invention is a program for causing a computer to execute a display control method of a display control device including an acquisition unit, a first image information generation unit, a second image information generation unit, and an identification information generation unit, wherein the acquisition unit acquires image information obtained by imaging the surroundings of the vehicle; the first image information generation unit generates first image information corresponding to a first area that is a part of the area of the image information and is to be displayed on the display device; the second image information generation unit generates second image information corresponding to a second area that is a part of the area of the image information and is different from the first area and is to be displayed on the display device; and the identification information generation unit generates identification information for identifying the positional relationship between the first image information and the second image information and causes the display device to display the identification information.

[0041] The program according to the 14th embodiment causes a computer to execute a display control method of a display control device including an acquisition unit, a first image information generation unit, a second image information generation unit, and an identification information generation unit. In this program, the acquisition unit acquires image information obtained by imaging the surroundings of the vehicle. The first image information generation unit generates first image information corresponding to a first area that is a part of the area of the image information and is to be displayed on the display device. The second image information generation unit generates second image information corresponding to a second area that is a part of the area of the image information and is different from the first area and is to be displayed on the display device.

[0042] Here, in the program, the identification information generation unit further generates identification information for identifying the positional relationship between the first image information and the second image information and causes the display device to display the identification information. Therefore, the positional relationship between the first image information and the second image information, which are different from each other and obtained by imaging the surroundings of the vehicle, can be identified on the display device.

Example

[0043] [First Example] Hereinafter, with reference to FIGS. 1 to 5, a display control device, a display control method, and a program for causing a computer to execute the method according to the first example will be described. In the drawings, the arrow FR shown as an example indicates the front direction of a vehicle targeted at a normal passenger car, and the arrow RR indicates the rear direction of the vehicle. Also, the arrow WL indicates the left side in the vehicle width direction, the arrow WR indicates the right side in the vehicle width direction, and the arrow UP indicates the upward direction on the vehicle. These directions are for convenience in explaining the embodiments and do not limit the directions in the present invention.

[0044] (Configuration of the display control device 1 and the display control system 100) As shown in FIG. 2, the display control system 100 according to the first embodiment is constructed to include a display control device 1. In the display control system 100, when the vehicle Vm (see FIG. 1) as the host vehicle is stopped or running, the surrounding situation outside the vehicle compartment of the vehicle Vm is imaged, and the image information obtained by this imaging is configured to be stored (recorded). Further, the display control system 100 is configured to generate the first image information and the second image information corresponding to specific regions of the image information, and display them on the display device 30 as appropriate. In this embodiment, an example applied to a normal passenger car as the vehicle is described, but the vehicle includes at least a bus, a truck, a two-wheeler, and a bicycle. The vehicle may further include a railway, a ship, and an aircraft.

[0045] More specifically, the display control system 100 is constructed to include a display control device 1, an imaging device 10, an image recognition unit 15, a proximity sensor 16, a line-of-sight sensor 17, and a display device 30. Hereinafter, each component of the display control system 100 will be described.

[0046] (Configuration of the imaging device 10) As shown in FIGS. 1 and 2, the imaging device 10 includes a front camera 11, a rear camera (back camera) 12, a right side camera 13, and a left side camera 14 as cameras for outside the vehicle compartment.

[0047] As shown in FIG. 1, the front camera 11 is mounted facing the front of the vehicle at a position close to, for example, the front window glass in the vehicle interior of the vehicle Vm. The front camera 11 images the area around the vehicle Vm in front of the vehicle and acquires the image information PF of the front of the vehicle. The rear camera 12 is mounted facing the rear of the vehicle at a position close to, for example, the rear window glass in the vehicle interior of the vehicle Vm. The rear camera 12 images the area around the vehicle Vm behind the vehicle and acquires the image information PR of the rear of the vehicle.

[0048] The right side camera 13 is mounted facing the rear right side of the vehicle at a position on, near, or at a position where the right side mirror (here, the right door mirror) of the vehicle Vm is located outside the vehicle. The right side camera 13 images the area around the vehicle Vm on the rear right side of the vehicle and acquires the image information PWR of the rear right side of the vehicle. The left side camera 14 is mounted facing the rear left side of the vehicle at a position on, near, or at a position where the left side mirror (here, the left door mirror) of the vehicle Vm is located outside the vehicle. The left side camera 14 images the area around the vehicle Vm on the rear left side of the vehicle and acquires the image information PWL of the rear left side of the vehicle.

[0049] Each of the front camera 11, the rear camera 12, the right side camera 13, and the left side camera 14 is configured with, for example, a two-dimensional image sensor as the main imaging device. As the two-dimensional image sensor, for example, a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor can be practically used. In particular, each of the front camera 11 and the rear camera 12 is a wide-angle camera, and in the wide-angle camera, the viewing angle is set to a wide angle of, for example, 120 degrees to 170 degrees. That is, each of the front camera 11 and the rear camera 12 can acquire the wide-angle image information PF and the image information PR, respectively. Here, four cameras (front camera 11 to left side camera 14) are arranged as the imaging device 10. In this embodiment, at least the front camera 11 and the rear camera 12 may be mounted. Further, in addition to the four cameras, the display control system 100 may be equipped with an in-vehicle camera for imaging the interior of the vehicle, and may acquire image information not only of the surroundings of the vehicle Vm but also of the interior of the vehicle.

[0050] (Configuration of the image recognition unit 15) As shown in FIG. 1, in this embodiment, the image recognition unit 15 is mounted in the vicinity of the front camera 11 and in the vicinity of the front window glass in the vehicle interior, facing forward of the vehicle. Further, the image recognition unit 15 is also mounted in the vicinity of the rear camera 12 and in the vicinity of the rear window glass in the vehicle interior, facing rearward of the vehicle. In the image recognition unit 15, other vehicles, people, obstacles, etc. (hereinafter simply referred to as "other vehicles, etc.") that are stopped or running around the vehicle Vm are imaged by the camera. Here, the captured image information is analyzed by image recognition processing, and other vehicles, etc. are recognized. This recognized recognition information is transmitted to the display control device 1. Note that the image recognition unit 15 is configured here as an external component of the display control device 1, but it may also be included in the display control device 1. Further, it is not necessary to arrange the image recognition unit 15 for each camera of the imaging device 10. For example, it is sufficient if only the image recognition unit 15 mounted facing the front side of the vehicle where the necessity is the highest is mounted on the vehicle Vm.

[0051] (Configuration of the proximity sensor 16) As shown in FIG. 1, in this embodiment, the proximity sensor 16 is mounted in the vicinity of the front camera 11 and in the vicinity of the front window glass in the vehicle interior, facing forward of the vehicle. Further, the proximity sensor 16 is also mounted in the vicinity of the rear camera 12 and in the vicinity of the rear window glass in the vehicle interior, facing rearward of the vehicle. As the proximity sensor 16, for example, sensors such as a laser radar sensor, a microwave radar sensor, an infrared sensor, and an ultrasonic sensor can be practically used. The proximity sensor 16 can detect other vehicles around the vehicle Vm. The detected proximity detection information is transmitted to the display control device 1. Similar to the image recognition unit 15, the proximity sensor 16 may be included in the display control device 1, and the number of arrangements of the proximity sensor 16 is not limited.

[0052] (Configuration of the line-of-sight sensor 17) As shown in FIG. 1, in this embodiment, the line-of-sight sensor 17 is in the vicinity of the front camera 11 and on the rear side of the vehicle with respect to the front camera 11, and is mounted in the vehicle interior toward the lower part around the display device 30 as shown in FIG. 3(A). The line-of-sight sensor 17 is configured to detect the line-of-sight direction of the driver sitting in the driver's seat of the vehicle Vm. Here, when the driver's line of sight changes from the front of the vehicle to the display device 30, that is, in the case of a right-hand drive vehicle, when the driver's line of sight switches from the front to the upper left obliquely, the line-of-sight sensor 17 detects this change in the line-of-sight direction. The detected line-of-sight detection information is transmitted to the display control device 1, and the display control device 1 switches the image information displayed on the display device 30. In this embodiment, the line-of-sight sensor 17 constructs a display switching unit (display switching means) 18 that switches the second image information displayed on the display device 30 to the display of the first image information. The first image information and the second image information displayed on the display device 30 will be described in detail later. Similar to the image recognition unit 15, the line-of-sight sensor 17 may be included in the display control device 1.

[0053] (Configuration of the display device 30) As shown in FIG. 1, the display device 30 is in the vicinity of the front camera 11 and is mounted in the vehicle interior toward the rear side of the vehicle with respect to the front camera 11. The display device 30 is mounted at the mounting position of this rearview mirror instead of a rearview mirror (or a back mirror) for visually recognizing the rear side of the vehicle. As shown in Fig. 3(A), the display device 30 includes a housing 32 and a display unit 31. The housing 32 is formed in a rectangular cubic shape with the vehicle width direction as the longitudinal direction, the vehicle vertical direction as the short side direction, and the vehicle front-rear direction as the thickness direction. The housing 32 is, for example, a resin molded product. The display unit 31 is disposed on substantially the entire rear side of the housing 32 in the vehicle. A liquid crystal display is used for the display unit 31. Circuit parts such as the drive circuit of the display unit 31 (not shown) are arranged inside the housing 32 on the front side of the display unit 31 in the vehicle. Note that an organic electroluminescence display can be used instead of the liquid crystal display as the display unit 31.

[0054] (Configuration of the display control device 1) As shown in Fig. 2, the display control device 1 includes an interface (IF) 2, an interface (IF) 9, an image information acquisition unit 3, an image information generation unit 4, a determination unit 5, a central processing unit (CPU) 6, a first storage unit 7, and a second storage unit 8. These interface 2 etc. are interconnected via a common bus 20.

[0055] (1) Configuration of the interface 2 The interface 2 is arranged as an input-side interface. The front camera 11, rear camera 12, right side camera 13, and left side camera 14 of the imaging device 10 are respectively connected to the interface 2, and further, the image recognition unit 15, proximity sensor 16, and gaze sensor 17 are respectively connected to the interface 2. On the other hand, the interface 2 is connected to the common bus 20. The interface 2 takes in various information including the image information output from the imaging device 10, the recognition information output from the image recognition unit 15, the proximity detection information output from the proximity sensor 16, and the gaze detection information output from the gaze sensor 17 into the display control device 1. Then, in the interface 2, the captured image information is transmitted to the image information acquisition unit 3 etc. via the common bus 20, and the captured various information is transmitted to the determination unit 5 etc. via the common bus 20.

[0056] (2) Configuration of the Image Information Acquisition Unit 3 In the image information acquisition unit 3, image information PF of the surroundings (front of the vehicle) of the vehicle Vm captured by the front camera 11 of the imaging device 10 is acquired via the interface 2. Similarly, in the image information acquisition unit 3, image information PR of the surroundings (rear of the vehicle) of the vehicle Vm captured by the rear camera 12 is acquired via the interface 2. Further, in the image information acquisition unit 3, image information PWR captured by the right side camera 13 and image information PWL captured by the left side camera 14 are each acquired.

[0057] Note that in this embodiment, an example of displaying a specific area of the image information PR captured by the rear camera 12 on the display device 30 will be mainly described. Examples of displaying a specific area of the image information PF captured by the front camera 11 other than this are the same as the example of displaying a specific area of the image information PR, so the description here is omitted.

[0058] As shown in FIG. 4(A), for example, in the rear camera 12, at a predetermined frame rate, as time elapses, each of a plurality of pieces of image information PR(1), image information PR(2),..., image information PR(n - 1), and image information PR(n) is sequentially captured. Here, in the description of the embodiment, n is a natural number excluding zero, that is, 1, 2, 3,.... As the predetermined frame rate, for example, 30 FPS (Frames Per Second) or 27.5 FPS is used, and an increase in the storage capacity is suppressed. One frame of image information PR such as image information PR(1) is generated corresponding to the pixels of the rear camera 12 arranged in a matrix shape vertically and horizontally, as shown in FIG. 4(B). Here, for easy understanding, it is assumed that image information PR is generated corresponding to 12 pixels in the vertical direction, 20 pixels in the horizontal direction, and a total of 240 pixels, and the image information PR will be briefly described.

[0059] (3) Configuration of the Image Information Generation Unit 4 As shown in FIG. 2, the image information generation unit 4 includes a first image information generation unit 41, a second image information generation unit 42, and further includes an identification information generation unit 43.

[0060] As shown in FIGS. 1, 4(A), and 4(B), the first image information generation unit 41 corresponds to a first area that is a part of the area of the image information PR captured by the rear camera 12, and generates first image information PR1 to be displayed on the display device 30. The first image information PR1 is generated by cutting out, as the first area, an area corresponding to a total of 40 pixels, 4 in the vertical direction and 10 in the horizontal direction, in the central part of the image information PR shown in FIG. 4(B). The first image information PR1 is generated as an image to be constantly displayed on the display device 30 during normal running (here, normal parking) of the vehicle Vm, as shown in FIG. 3(A). Note that the first image information PR1 is generated as a still image in one frame of the image information PR, but is generated as a moving image because it is generated from a plurality of image information PRs at a predetermined frame rate.

[0061] As shown in FIGS. 1, 4(A), and 4(B), the second image information generation unit 42 corresponds to a second area that is a part of the area of the image information PR and is different from the first area, and generates second image information PR2 to be displayed on the display device 30. The second image information PR2 is generated by cutting out, as the second area, an area that includes all of the first area and overlaps with the first area, corresponding to a total of 96 pixels, 6 in the vertical direction and 16 in the horizontal direction, in the image information PR shown in FIG. 4(B). The second image information PR2 is generated as an image to be displayed on the display device 30 by switching from the display of the first image information PR1 during non - normal running (here, non - normal parking) of the vehicle Vm, as shown in FIG. 3(B).

[0062] Here, the non-normal parking refers to the case where, for example, a "person H" is recognized on the left side behind the vehicle Vm by the image recognition unit 15 shown in FIGS. 1 and 2, and it is used in the sense of improving safety compared to normal parking. When, for example, a "person H" is detected by the proximity sensor 16, it is also a non-normal parking time. The second image information PR2 is generated by being extended to the area where the "person H" is displayed and is displayed on the display device 30 as shown in FIG. 3(B). Here, each of the image information PR captured by the rear camera 12, the first image information PR1, and the second image information PR2 is generally displayed on the display device 30 with the left and right reversed. Note that although the second image information PR2 shown in FIG. 3(B) is generated including all of the first image information PR1, the second image information PR2 may be generated including a part of the first image information PR1.

[0063] Here, as described above, each of the first image information PR1 and the second image information PR2 is generated from the image information PR, and this image information PR includes the first image information PR1 and the second image information PR2. Therefore, in the image information acquisition unit 3 shown in FIG. 2, the image information PR is acquired, and at least each of the first image information PR1 and the second image information PR2 is acquired.

[0064] The identification information generation unit 43 generates identification information IM for identifying the positional relationship between the first image information PR1 and the second image information PR2 as shown in FIG. 3(B), and causes the display device 30 to display this identification information IM. The identification information IM is displayed superimposed on the second image information PR2 displayed on the display device 30. The identification information IM is information of a mark that surrounds the contour corresponding to the first image information PR1 and emphasizes the area corresponding to the first image information PR1. The identification information IM is set in a rectangular frame shape with the vehicle width direction as the longitudinal direction corresponding to the contour shape of the first image information PR1. Note that when the second image information PR2 is displayed on the display device 30, in addition to the display of the identification information IM, a message or symbol for calling attention such as "Attention", "Please be careful", "Please check behind" may be displayed.

[0065] (4) Configuration of the determination unit 5 and the display switching unit 18 In the determination unit 5 shown in FIG. 2, recognition information of other vehicles or the like recognized by the image recognition unit 15 is acquired, and based on this recognition information, it is determined whether or not other vehicles or the like are approaching the vehicle (own vehicle) Vm. Further, in the determination unit 5, proximity detection information output from the proximity sensor 16 is acquired, and based on this proximity detection information, it is determined whether or not other vehicles or the like are approaching the vehicle Vm. When the approaching distance of other vehicles or the like to the vehicle Vm exceeds a certain threshold value, the determination unit 5 causes the second image information generation unit 42 to generate the second image information PR2. When the second image information PR2 is generated, the display device 30 switches the first image information PR1 and displays the second image information PR2.

[0066] Furthermore, the determination unit 5 and the line-of-sight sensor 17 constitute a display switching unit (display switching means) 18. In the determination unit 5, based on the line-of-sight detection information detected by the line-of-sight sensor 17, it is determined whether or not the driver has changed the line-of-sight direction. Here, it is determined whether or not the driver has changed the line-of-sight direction from the front direction to the direction of the display device 30. In other words, in the determination unit 5, it is determined whether or not the driver has confirmed the second image information PR2 displayed on the display device 30. When the determination unit 5 determines that the driver has changed the line-of-sight direction, the display device 30 switches from the display of the second image information PF2 to the display of the first image information PF1. That is, the display switching unit 18 is configured to return the display of the display device 30 to the original first image information PF1 at the time of normal stop.

[0067] (5) Configuration of the central processing unit 6, the first storage unit 7, and the second storage unit 8 As shown in FIG. 2, the central processing unit 6 constructs a computer and controls the operations of each component such as the image information acquisition unit 3, the image information generation unit 4, and the determination unit 5 of the display control device 1 via the common bus 20.

[0068] The first storage unit 7 is configured to include, for example, a read-only memory circuit (e.g., ROM: Read Only Memory) and a read-write memory circuit (e.g., RAM: Random Access Memory). The first storage unit 7 is connected to the common bus 20. Programs necessary for the operation control of the display control device 1 are stored in the first storage unit 7, and information being executed in the central processing unit 6 is temporarily stored therein.

[0069] The second storage unit 8 is arranged as a storage device having a large storage capacity such as a non-volatile memory device, a hard disk, etc. The second storage unit 8 is connected to the common bus 20. The image information PR acquired by the image information acquisition unit 3 is stored in the second storage unit 8. Further, the first image information PR1 generated by the first image information generation unit 41, the second image information PR2 generated by the second image information generation unit 42, and the identification information IM generated by the identification information generation unit 43 are stored in the second storage unit 8. Also, since the display control device 1 according to the present embodiment includes a shock sensor (acceleration sensor) (not shown) and includes a function as a drive recorder, the image information PR before and after receiving a shock is automatically stored as separate files in the second storage unit 8.

[0070] Of course, as shown in FIG. 1, the image information PF captured by the front camera 11 is stored in the second storage unit 8. At the same time, the first image information PF1 generated by the first image information generation unit 41, the second image information PF2 generated by the second image information generation unit 42, and the identification information IM (see FIG. 3(B)) generated by the identification information generation unit 43 are stored in the second storage unit 8. Furthermore, the image information PWR captured by the right side camera 13 and the image information PWL captured by the left side camera 14 are stored in the second storage unit 8.

[0071] Further, the second storage unit 8 is configured to store at least the image information PR, and may be configured such that the first image information PR1 and the second image information PR2 can be respectively specified in the image information PR stored in the second storage unit 8. For example, when storing the image information PR in the second storage unit 8, an identifier for identifying the first image information PR1 is added to the first image information PR1 corresponding to the first area of the image information PR, and an identifier for identifying the second image information PR2 is added to the second image information PR2 corresponding to the second area. Since each of the first image information PR1 and the second image information PR2 is time-series information when stored in the second storage unit 8, an identifier is added, for example, to the front stage of this information. Each of the first image information PR1 and the second image information PR2 to which the identifier is added can be appropriately retrieved from the second storage unit 8 as necessary.

[0072] Furthermore, the second storage unit 8 may have two or more storage areas or may be configured by two or more storage devices. Image information PR is stored in one storage area or storage device of the second storage unit 8, and the first image information PR1 and the second image information PR2 to be displayed on the display device 30 are respectively stored in another storage area or storage device.

[0073] (6) Configuration of the interface 9 The interface 9 is arranged as an output-side interface. The interface 9 is connected to the common bus 20, and the display device 30 is connected to this interface 9. The interface 9 outputs the first image information PR1 generated by the first image information generation unit 41, the second image information PR2 generated by the second image information generation unit 42, and the identification information IM generated by the identification information generation unit 43 to the display device 30 respectively.

[0074] (Display control method and program for executing the method) While referring to FIGS. 1 to 4, a display control method using the display control device 1 and the display control system 100 will be described with reference to FIG. 5, and a program for executing the display control method will also be described. As described above, a method of causing a display device 30 to display specific regions (a first region and a second region) of image information PR captured by the rear camera 12 will be mainly described. However, an example of causing a display device to display a specific region of image information PF captured by the front camera 11 will also be described. Note that the specific region of the image information PF is displayed on a display device (not shown) mounted inside the vehicle interior of the vehicle Vm. As this display device, for example, a display device of a navigation system, a display device of a drive recorder, or the like is used.

[0075] As shown in FIG. 5, when the display control method is started and the program is executed, first, it is determined whether or not the accessory power supply (ACC) of the vehicle Vm is ON (step S1). If it is determined that the accessory power supply is OFF, the display control method ends and the execution of the program is stopped.

[0076] If it is determined that the accessory power supply is ON, the display control device 1 and the display control system 100 are activated (step S2). When the display control system 100 is activated, each of the imaging devices 10 such as the front camera 11 and the rear camera 12 of the imaging device 10, the image recognition unit 15, the proximity sensor 16, the gaze sensor 17, and the display device 30 is activated. Further, when the display control device 1 is activated, each of the interface 2, the image information acquisition unit 3, the image information generation unit 4, the determination unit 5, the central processing unit 6, the first storage unit 7, the second storage unit 8, and the interface 9 is activated.

[0077] Subsequently, it is determined whether the vehicle Vm is traveling forward or backward (step S3). Here, if it is determined that the vehicle is not traveling forward, it is determined whether or not the vehicle is traveling backward (step S14). Here, for the determination of whether it is forward travel or reverse travel, for example, a shift device (not shown) of the vehicle Vm is used. Specifically, when the shift lever of the shift device is in a forward travel position such as the drive range, it is determined that the vehicle is in forward travel. Conversely, when the shift lever is in a reverse travel position of the reverse range, it is determined that the vehicle is in reverse travel. In this case, since the forward or reverse travel is determined based on the position of the shift lever, whether the vehicle Vm is actually traveling or not is not relevant to the determination.

[0078] In step S14, if it is determined that the vehicle is not in reverse travel, it is determined whether to continue the activation of the display control device 1 (step S12). If it is determined to continue, the process returns to step S3. If it is determined not to continue, it is determined whether to turn off the accessory power supply (step S13). If it is determined not to turn off the accessory power supply, the process returns to step S3. If it is determined to turn off the accessory power supply, the display control method according to this embodiment ends and the execution of the program ends.

[0079] On the other hand, in step S14, if it is determined that the vehicle Vm is in reverse travel, as shown in FIG. 1, image information PR of the rear of the vehicle Vm captured by the rear camera 12 of the imaging device 10 is acquired by the image information acquisition unit 3 of the display control device 1 (step S15). The image information PR is acquired by the image information acquisition unit 3 from the rear camera 12 via the interface 2 and the common bus 20, respectively. Further, as shown in FIGS. 4(A) and 4(B), the image information PR is acquired as wide-angle image information at a predetermined frame rate. The image information PR acquired by the image information acquisition unit 3 is stored in the second storage unit 8 shown in FIG. 2 (step S16).

[0080] Based on the image information PR acquired by the image information acquisition unit 3, as shown in FIG. 2, the first image information generation unit 41 generates first image information PR1 corresponding to a first region that is a part of the region of the image information PR, as shown in FIG. 4(B). This first image information PR1 is transmitted to the display device 30 via the common bus 20 and the interface 9, respectively, and is displayed on the display device 30 as a video capturing the rear of the vehicle around the vehicle Vm, as shown in FIG. 3(A) (step S17).

[0081] In addition, in the display control method and program according to this embodiment, regardless of the determination of whether or not it is reverse traveling in steps S3 and S14, when the display control device 1 and the display control system 100 are activated, the image information PR is always acquired by the image information acquisition unit 3. Then, the image information PR is always stored in the second storage unit 8, and further, the first image information PR1 is always generated by the first image information generation unit 41 and displayed on the display device 30. That is, instead of the rearview mirror, a display device 30 corresponding to the rearview mirror is incorporated in the display control system 100, so that the first image information PR1 is always displayed on the display device 30.

[0082] Subsequently, it is determined whether or not an obstacle such as another vehicle is approaching (step S18). The approach of the obstacle is determined by the determination unit 5 based on the recognition information from the image recognition unit 15 shown in FIG. 2 or the detection information from the proximity sensor 16. In this embodiment, two types of methods, the image recognition unit 15 and the proximity sensor 16, are used to improve the determination accuracy for the approach of the obstacle, but basically, the determination can be performed by either one of the methods. If it is determined that no obstacle is approaching, the process proceeds to step S12.

[0083] On the other hand, in step S18, when it is determined that an obstacle is approaching, based on the image information PR, as shown in FIG. 2, the second image information generation unit 42 generates second image information PR2 corresponding to a second region that is a part of the region of the image information PR, as shown in FIG. 4(B). This second image information PR2 is transmitted to the display device 30 via the common bus 20 and the interface 9, respectively, and is displayed on the display device 30 as an image obtained by imaging and expanding the rear of the vehicle around the vehicle Vm in the left - right direction, as shown in FIG. 3(B) (step S19). Here, in step S18, it is determined that an obstacle, namely "person H", is approaching on the rear - left side of the vehicle Vm. Therefore, the second image information PR2 expanded to the range where the obstacle is to be displayed is generated by the second image information generation unit 42 and displayed on the display device 30.

[0084] Furthermore, simultaneously with or before and after the generation of the second image information PR2, in the identification information generation unit 43 shown in FIG. 2, identification information IM for identifying the positional relationship of the second image information PR2 with respect to the first image information PR1 is generated. The identification information IM is transmitted to the display device 30 via the common bus 20 and the interface 9, respectively, and is displayed on the display device 30, as shown in FIG. 3(B) (step S20). As shown in FIGS. 3(B) and 4(B), the identification information IM is displayed as information of a mark that surrounds the contour of the first region of the image information PR, that is, the first image information PR1, and visually emphasizes the region corresponding to the first image information PR1.

[0085] Subsequently, it is determined whether or not to cancel the display of the second image information PR2 on the display device 30, that is, whether or not to switch from the display of the second image information PR2 to the display of the original first image information PR1 (step S21). For this determination, the display switching unit 18 shown in FIG. 2 is used. In the display switching unit 18, the line - of - sight direction of the driver sitting in the driver's seat of the vehicle Vm is detected by the line - of - sight sensor 17, and based on this detection information, it is determined by the determination unit 5 whether or not the driver has confirmed the second image information PR2 displayed on the display device 30. In step S21, when it is determined that the driver has confirmed the second image information PR2 displayed on the display device 30, the display of the second image information PR2 is cancelled (step S22), and the first image information PR1 is displayed on the display device 30. That is, the display is switched from the second image information PR2 to the original first image information PR1. After that, the process proceeds to step S12.

[0086] In step S21, when it is determined that the display of the second image information PR2 is not cancelled, the process proceeds to step S12. At this time, after a certain period of time set to be longer than the cancellation of the display in step S22 has elapsed, the display is switched from the second image information PR2 to the original first image information PR1. As the certain period of time, for example, several seconds to a dozen or so seconds is appropriate. In addition, when there is no longer an approach of other vehicles or the like to the vehicle Vm, the display may be switched from the second image information PR2 to the original first image information PR1.

[0087] Also, in step S3, when it is determined that the vehicle Vm is moving forward, the image information PF obtained by imaging the front of the vehicle Vm's surroundings with the front camera 11 of the imaging device 10 shown in FIG. 1 is acquired by the image information acquisition unit 3 of the display control device 1 (step S4). The image information PF is acquired by the image information acquisition unit 3 from the front camera 11 via the interface 2 and the common bus 20, respectively. Also, the image information PF is acquired as wide-angle image information at a predetermined frame rate in the same manner as the image information PR (see FIGS. 4(A) and 4(B)). The image information PF acquired by the image information acquisition unit 3 is stored in the second storage unit 8 shown in FIG. 2 (step S5).

[0088] Based on the image information PF acquired by the image information acquisition unit 3, the first image information generation unit 41 shown in FIG. 2 generates first image information PF1 corresponding to a first region that is a part of the region of the image information PF, similar to the first image information PR1 (see FIGS. 1 and 4(B)). The first image information PF1 is transmitted to a display device (not shown) via the common bus 20 and the interface 9 respectively, and is displayed on the display device as a video capturing the front of the vehicle in the vicinity of the vehicle Vm (step S6. See FIG. 3(A)).

[0089] Here, in the display control method and program according to this embodiment, similar to the display of the first image information PR1 on the display device 30, regardless of the determination of whether the vehicle is moving forward, the image information PF is always acquired and stored, and the first image information PF1 is generated and displayed on the display device.

[0090] Subsequently, it is determined whether an obstacle is approaching (step S7). The approach of the obstacle is determined by the determination unit 5 based on the recognition information from the image recognition unit 15 shown in FIG. 2 or the detection information from the proximity sensor 16. If it is determined that no obstacle is approaching, the process returns to step S3.

[0091] On the other hand, if it is determined in step S7 that an obstacle is approaching, based on the image information PF, the second image information generation unit 42 shown in FIG. 2 generates second image information PF2 corresponding to a second region that is a part of the region of the image information PF (see FIG. 4(B)). This second image information PF2 is transmitted to a display device (not shown) via the common bus 20 and the interface 9 respectively, and is displayed on the display device as a video capturing the front of the vehicle in the vicinity of the vehicle Vm with an expansion in the left - right direction (step S8. See FIG. 3(B)).

[0092] Furthermore, simultaneously with or before or after the generation of the second image information PF2, the identification information generation unit 43 shown in FIG. 2 generates identification information (see the identification information IM shown in FIG. 3(B)) (not shown) for identifying the positional relationship of the second image information PF2 with respect to the first image information PF1. The identification information is transmitted to the display device via the common bus 20 and the interface 9 respectively, and is displayed on the display device (step S9). The identification information is displayed as information of a mark that surrounds the first region of the image information PF, that is, the contour of the first image information PF1, and visually emphasizes the region corresponding to the first image information PF1, similar to the identification information IM shown in FIG. 3(B).

[0093] Subsequently, it is determined whether or not to cancel the display of the second image information PF2 on the display device, that is, whether or not to switch from the display of the second image information PF2 to the display of the original first image information PF1 (step S10). For this determination, the display switching unit 18 shown in FIG. 2 is used. In step S10, when it is determined that the driver has confirmed the second image information PF2 displayed on the display device, the display of the second image information PF2 is canceled (step S11), and the original first image information PF1 is displayed on the display device. Thereafter, the process proceeds to step S12.

[0094] In step S10, when it is determined that the display of the second image information PF2 is not canceled, after a certain period of time has elapsed, the display of the second image information PF2 is canceled, and the process proceeds to step S12. Note that when there is no approach of other vehicles or the like to the vehicle Vm, the switching from the second image information PR2 to the original first image information PR1 may be performed.

[0095] Here, the display control method and program for a specific region of the image information PF captured by the front camera 11 and a specific region of the image information PR captured by the rear camera 12 are described. Since the display control method and program for a specific region of the image information PWR captured by the right side camera 13 shown in FIG. 1 and a specific region of the image information PWL captured by the left side camera 14 are the same, the description here is omitted.

[0096] (Function and Effect) As described above, as shown in FIG. 2, the display control device 1 according to the present embodiment includes an image information acquisition unit (acquisition unit) 3, a first image information generation unit 41, and a second image information generation unit 42. The image information acquisition unit 3 acquires image information PR of the surroundings of the vehicle Vm shown in FIG. 1, here particularly the rear of the vehicle. The first image information generation unit 41 generates first image information PR1 corresponding to a first region that is a part of the region of the image information PR and is to be displayed on the display device 30. The second image information generation unit 42 generates second image information PR2 corresponding to a second region that is a part of the region of the image information PR and is different from the first region and is to be displayed on the display device 30.

[0097] Here, as shown in FIG. 2, the display control device 1 further includes an identification information generation unit 43. The identification information generation unit 43 generates identification information IM for identifying the positional relationship between the first image information PR1 and the second image information PR2, and as shown in FIG. 3(B), causes it to be displayed on the display device 30. For this reason, the positional relationship between the mutually different first image information PR1 and second image information PR2 obtained by imaging the surroundings of the vehicle Vm can be identified on the display device 30. That is, the positional relationship of the second image information PR2 in the case of non-normal parking with respect to the first image information PR1 in the case of normal parking, which is displayed on the display device 30, can be made easily understandable for the driver.

[0098] Further, in the display control device 1, as shown in FIG. 4(B), since the second region includes at least a part of the first region, as shown in FIG. 3(B), second image information PR2 including at least a part of the first image information PR1 can be generated. Here, with respect to the first image information PR1 displayed on the display device 30 (see FIG. 3(A)), second image information PR2 that expands the field of view of the rear of the vehicle around the vehicle Vm further in the left-right direction of the first image information PR1 can be displayed on the display device 30. And in the display control device 1, as shown in FIGS. 3(A) and 3(B), since the switching is from the first image information PR1 to the second image information PR2, the display device 30 can instantaneously switch the display. Thus, if an obstacle approaches, the information can be instantaneously displayed on the display device 30, so that the obstacle can be immediately avoided.

[0099] Also, in the display control device 1, as shown in FIGS. 3(B) and 4(B), here the second image information PR2 displayed on the display device 30 is generated as one screen including the first image information PR1. For this reason, since the second image information PR2 is displayed in a large screen over the entire display unit 31 of the display device 30, the visibility of the second image information PR2 for the driver can be improved.

[0100] Furthermore, as shown in FIG. 2, the display control device 1 includes a display switching unit (display switching means) 18. The display switching unit 18 includes a line-of-sight sensor 17 that detects the line-of-sight direction of the driver, and a determination unit 5 that determines a change in the line-of-sight direction based on the detection information of the line-of-sight sensor 17 and switches the display on the display device 30 from the second image information PR2 to the first image information PR1. Therefore, for the driver, after confirming the second image information PR2 displayed on the display device 30, the display on the display device 30 can be automatically switched to the first image information PR1.

[0101] Also, in the display control device 1, as shown in FIG. 3(B), the identification information IM is information of a mark. The mark emphasizes the area corresponding to the first image information PR1 displayed on the display device 30. For this reason, for the driver, by looking at the identification information IM of the mark displayed on the display device 30, the positional relationship between the second image information PR2 and the first image information PR1 can be clearly identified at a glance.

[0102] Furthermore, as shown in FIG. 2, the display control device 1 includes a second storage unit (storage unit) 8. The second storage unit 8 stores image information PR, first image information PR1, second image information PR2, and identification information IM. Therefore, in the second storage unit 8, in addition to the image information PR obtained by imaging the rear of the vehicle around the vehicle Vm, the first image information PR1, the second image information PR2, and the identification information IM displayed on the display device 30 can be stored. For example, after being stored in the second storage unit 8, the first image information PR1, the second image information PR2, and the identification information IM displayed on the display device 30 can be retrieved. The retrieved image information PR, etc. can be used for driver management and as evidence in traffic accidents. To explain in detail. For example, by making it possible to retrieve the image information PR stored in the second storage unit 8 after a traffic accident, based on the image information PR that includes the image information displayed on the display device 30 and captures a wide area around the vehicle Vm, the situation at the time of the traffic accident can be confirmed. Also, by making it possible to retrieve the first image information PR1, the second image information PR2, and the identification information IM stored in the second storage unit 8, the image information displayed on the display device 30 at the time of the traffic accident can be confirmed.

[0103] Also, the display control device 1 may include at least a second storage unit 8 that stores the image information PR. In the image information PR stored in the second storage unit 8, each of the first image information PR1 and the second image information PR2 can be specified. For example, at the time of generating each of the first image information PR1 and the second image information PR2, identifiers are attached to the first area and the second area of the image information PR, respectively, and the image information PR is stored in the second storage unit 8. Therefore, each of the first image information PR1 and the second image information PR2 can be retrieved from the image information PR stored in the second storage unit 8.

[0104] Furthermore, the display control device 1 may include a second storage unit 8 that stores the first image information PR1 and the second image information PR2 displayed on the display device 30 shown in FIG. 2. The first image information PR1 and the second image information PR2 are stored in a storage area or a storage device different from the storage area or the storage device in which the image information PR is stored. Therefore, the first image information PR1 and the second image information PR2 displayed on the display device 30 can be easily retrieved from the second storage unit 8.

[0105] Also, in the display control device 1, as shown in FIG. 4(A), a plurality of pieces of image information PR are generated in a predetermined frame. Then, each of the first image information PR1 and the second image information PR2 is generated corresponding to each of the first area and the second area in the same frame of the image information PR. Therefore, since each of the first image information PR1 and the second image information PR2 is generated from the image information PR in one frame, the utilization efficiency of the image information PR can be improved, and furthermore, each of the first image information PR1 and the second image information PR2 can be generated at the same timing without a time difference. If the display control device 1 or the display control system 100 according to this embodiment constructs a drive recorder, wide-angle image information PR is constantly acquired and stored in the second storage unit. In addition, a part of the image information PR is effectively utilized, and each of the first image information PR1 and the second image information PR2 behind the vehicle around the vehicle Vm, which is required by the driver, can be displayed on the display device 30.

[0106] Furthermore, as shown in FIG. 2, the display control device 1 according to this embodiment includes an image information acquisition unit 3. The image information acquisition unit 3 acquires each of the first image information PR1 in which a part of the rear of the vehicle around the vehicle Vm shown in FIG. 1 is imaged, and the second image information PR2 different from the first image information PR1 in which a part of the rear of the vehicle around the vehicle Vm is imaged.

[0107] Here, the display control device 1 further includes an identification information generation unit 43. As shown in FIG. 3(B), the identification information generation unit 43 generates identification information IM for identifying the positional relationship between the first image information PR1 and the second image information PR2. Then, when the second image information PR2 is to be displayed on the display device 30 on which the first image information PR1 is displayed, the identification information generation unit 43 causes the display device 30 to display the identification information IM. Therefore, the positional relationship between the first image information PR1 and the second image information PR2, which are different from each other and are images of the rear of the vehicles around the vehicle Vm, can be identified on the display device 30.

[0108] Also, in the display control method according to the present embodiment, as shown in FIG. 5, first, image information PR of the rear of the vehicles around the vehicle Vm is acquired (see FIG. 4(A)). First image information PR1 to be displayed on the display device 30 is generated corresponding to a first region that is a part of the region of the image information PR (see FIG. 4(B)). On the other hand, second image information PR2 to be displayed on the display device 30 is generated corresponding to a second region that is a part of the image information PR and is different from the first region (see FIG. 4(B)).

[0109] Here, the display control method further generates identification information IM for identifying the positional relationship between the first image information PR1 and the second image information PR2, and causes the display device 30 to display the identification information IM as shown in FIG. 3(B). Therefore, the positional relationship between the first image information PR1 and the second image information PR2, which are different from each other and are images of the rear of the vehicles around the vehicle Vm, can be identified on the display device 30.

[0110] Furthermore, the program according to the present embodiment causes a computer to execute the display control method of the display control device 1 including the image information acquisition unit (acquisition unit) 3, the first image information generation unit 41, the second image information generation unit 42, and the identification information generation unit 43 shown in FIG. 2. In this program, as shown in FIG. 5, the image information acquisition unit 3 acquires image information PR obtained by imaging the rear of the vehicles around the vehicle Vm shown in FIG. 1. The first image information generation unit 41 generates first image information PR1 corresponding to a first region that is a part of the region of the image information PR and is to be displayed on the display device 30 (see FIG. 4(B)). The second image information generation unit 42 generates second image information PR2 corresponding to a second region that is a part of the region of the image information PR and is different from the first region and is to be displayed on the display device 30 (see FIG. 4(B)).

[0111] Here, in the program, the identification information generation unit 43 further generates identification information IM for identifying the positional relationship between the first image information PR1 and the second image information PR2, and causes the display device 30 to display the identification information IM (see FIG. 3(B)). Therefore, the display device 30 can identify the positional relationship between the different first image information PR1 and second image information PR2 obtained by imaging the rear of the vehicles around the vehicle Vm.

[0112] Note that the above-described operation and effect are obtained when a specific region of the image information PR captured by the rear camera 12 is displayed in the display control device 1 and the display control system 100 shown in FIG. 2. In this embodiment, the same operation and effect are also obtained when a specific region of the image information PF captured by the front camera 11 is displayed. Further, the same operation and effect are obtained when a specific region of the image information PWR captured by the right side camera 13 is displayed and when a specific region of the image information PWL captured by the left side camera 14 is displayed, respectively.

[0113] (First Modification Example) The display control device 1, the display control system 100, the display control method, and the program according to the first modification example of the first embodiment will be described with reference to FIG. 6. In the description of each modification example after the first modification example and each embodiment after the second embodiment, the same components or substantially the same components as those described in the first embodiment are denoted by the same reference numerals, and redundant descriptions are omitted.

[0114] In the display control device 1 (see FIG. 2) according to the first modification example, the second image information PR2 generated by the second image information generation unit 42 in the first embodiment is different from the second image information PR2 in the first embodiment. Here, in the first modification example, subsequent modification examples, and the second embodiment and subsequent embodiments, a display method based on the image information PR obtained by imaging the rear of the vehicle Vm around the imaging device 10 by the rear camera 12 of the imaging device 10 will be mainly described. The display methods based on the image information PF captured by the front camera 11, the image information PWR captured by the right side camera 13, and the image information PWL captured by the left side camera 14 are the same as the display method based on the image information PR, and thus the description thereof will be omitted.

[0115] Specifically, as shown in FIG. 6(A), the first image information PR1 generated by the first image information generation unit 41 of the display control device 1 is displayed on the display device 30. The first image information PR1 is generated corresponding to a first region that is a part of the region of the image information PR obtained by imaging the rear of the vehicle Vm around the vehicle during normal driving, as shown in FIG. 6(C). During non-normal driving, as shown in FIG. 6(B), the second image information PR2 generated by the second image information generation unit 42 is displayed on the display device 30. The second image information PR2 is generated corresponding to a second region that is a part of the region of the image information PR, as shown in FIG. 6(C). The second image information PR2 is image information obtained by enlarging the main part of the first region. The second image information PR2 is displayed on the display device 30 side by side with the first image information PR1 on the left side of the first image information PR1 with a reduced display area.

[0116] Since the second image information PR2 is generated based on the main part of the first image information PR1, it is generated including the first image information PR1. Further, the main part of the first image information PR1 is specified using the image recognition unit 15 or the proximity sensor 16 shown in FIG. 2 and the determination unit 5. Here, since another vehicle approaching from behind in the same lane or an adjacent lane as the lane on which the vehicle (own vehicle) Vm is traveling is detected by the image recognition unit 15 or the proximity sensor 16, the second image information PR2 is displayed side by side with the first image information PR1.

[0117] Then, as shown in FIG. 6(B), identification information IM for identifying the positional relationship between the first image information PR1 and the second image information PR2 is generated by an identification information generation unit 43 (see FIG. 2) and is displayed on the display device 30. The identification information IM is generated as information on a rectangular frame-shaped mark surrounding the main part of the first image information PR1, and is displayed on the display device 30 so as to overlap with the first image information PR1.

[0118] In the first modification, only the display method of the second image information PR2 is different, and the respective components of the display control device 1, the display control system 100, the display control method, and the program are substantially the same as those in the first embodiment, so the description thereof is omitted here.

[0119] As described above, in each of the display control device 1, the display control system 100, the display control method, and the program according to the first modification, the same operational effects as those obtained by each of the display control device 1, the display control system 100, the display control method, and the program according to the first embodiment can be obtained.

[0120] Also, in each of the display control device 1, the display control system 100, the display control method, and the program according to the first modification, as shown in FIG. 6(B), the second image information PR2 is enlarged and arranged beside the first image information PR1 and is displayed on the display device 30 with respect to the main part of the first image information PR1. Therefore, the visibility of other vehicles and the like by the driver can be improved. For example, as shown in FIG. 6(B), during non-normal driving in which other vehicles approach the vehicle Vm, safety can be improved.

[0121] (Second Modification) The display control device 1, the display control system 100, the display control method, and the program according to the second modification of the first embodiment will be described with reference to FIG. 7. In the display control device 1 (see FIG. 2) according to the second modification, the second image information PR2 generated in the second image information generation unit 42 is different from the second image information PR2 in each of the first embodiment and the first modification.

[0122] Specifically, similar to the first image information PR1 in the first modification example, as shown in FIG. 7(A), the first image information PR1 generated by the first image information generation unit 41 of the display control device 1 is displayed on the display device 30. As shown in FIG. 7(C), the first image information PR1 is generated corresponding to a first region that is a part of the region of the image information PR that captures the rear of the vehicle around the vehicle Vm during normal driving. During non-normal driving, as shown in FIG. 7(B), the second image information PR2 generated by the second image information generation unit 42 is displayed on the display device 30. As shown in FIG. 7(C), the second image information PR2 is generated corresponding to a second region that is a part of the region of the image information PR. The second image information PR2 is the image information on the left side (the left side of the vehicle Vm) of the first region. As shown in FIG. 7(B), the first image information PR1 is reduced, and the second image information PR2 is displayed on the display device 30 side by side with the first image information PR1 on the left side of the first image information PR1.

[0123] As shown in FIG. 7(C), since the second image information PR2 is generated based on the second region that does not overlap with the first region of the image information PR, it is generated without including the first image information PR1. Also, the second region of the second image information PR2 is specified from the image information PR using the image recognition unit 15 or the proximity sensor 16 shown in FIG. 2 and the determination unit 5. Here, since another vehicle approaching (existing) in the lane to the left of the lane of the vehicle Vm is detected by the image recognition unit 15 or the proximity sensor 16, the second image information PR2 is displayed side by side to the left of the first image information PR1.

[0124] Then, as shown in FIG. 7(B), the identification information IM for identifying the positional relationship between the first image information PR1 and the second image information PR2 is generated by the identification information generation unit 43 (see FIG. 2) and displayed on the display device 30. The identification information IM is generated as information of a rectangular frame-shaped mark surrounding the periphery of the first image information PR1 and is displayed on the display device 30.

[0125] In the second modification example, only the display method of the second image information PR2 is different, and the respective components of the display control device 1, the display control system 100, the display control method, and the program are the same as those in the first embodiment, so the description here is omitted.

[0126] As described above, in each of the display control device 1, the display control system 100, the display control method, and the program according to the second modification example, the same operational effects as those obtained by each of the display control device 1, the display control system 100, the display control method, and the program according to the first embodiment can be obtained.

[0127] Also, in each of the display control device 1, the display control system 100, the display control method, and the program according to the second modification example, as shown in FIG. 7(C), the second region in the image information PR does not include the first region. Therefore, since the second image information PR2 is generated without including the first image information PR1, the second image information PR2 can be independently generated with respect to the generation of the first image information PR1. For example, as shown in FIGS. 1 and 7(B), the first image information PR1 obtained by imaging the rear of the vehicle Vm and the second image information PR2 obtained by imaging the rear side of the vehicle Vm independent of the first image information PR1 can be displayed on the display device 30. Furthermore, in the display control device 1 and the like, since the switching is from the first image information PR1 to the first image information PR1 and the second image information PR2, the switching of the display can be instantaneously performed on the display device 30.

[0128] Furthermore, in the display control device 1 and the like, as shown in FIGS. 7(B) and 7(C), the second image information PR2 is displayed on the display device 30 in accordance with the arrangement direction of the second region with respect to the first region of the image information PR. For this reason, it is possible to match the positional relationship between the first region and the second region that image the surroundings of the vehicle Vm (see FIG. 1) and the positional relationship between the first image information PR1 and the second image information PR2 displayed on the display device 30. Specifically described, in accordance with the positional relationship and the approaching direction between the vehicle Vm and another vehicle approaching from the left side, as shown in FIG. 7(B), the first image information PR1 is displayed on the right side of the display device 30, and the second image information PR2 including the image of the other vehicle is displayed on the left side. That is, it is possible to match the positional relationship of the landscape corresponding to the second region with respect to the landscape corresponding to the first region around the vehicle Vm that the driver actually visually observes and the positional relationship of the second image information PR2 with respect to the first image information PR1 displayed on the display device 30. Therefore, the positional relationship of the second image information PR2 with respect to the first image information PR1 becomes even easier to identify on the display device 30.

[0129] [Second Embodiment] The display control device 1, the display control system 100, the display control method, and the program according to the second embodiment of the present invention will be described with reference to FIGS. 8 to 10.

[0130] (Configuration of Display Control Device 1 and Display Control System 100) As shown in FIG. 8, the display control device 1 according to the present embodiment includes an intermediate image information generation unit 44 as a component in the image information generation unit 4. Each component other than the intermediate image information generation unit 44 is the same as each component of the display control device 1 according to the first embodiment. When switching between the display of the first image information PR1 and the second image information PR2, the intermediate image information generation unit 44 generates intermediate image information PRM to be displayed on the display device 30 between the display of the first image information PR1 and the display of the second image information PR2. The same image information as the second image information PR2 in the second modification of the first embodiment is used for the second image information PR2. Of course, the identification information IM (not shown) is displayed on the display device 30. As shown in FIG. 10, the intermediate image information PRM includes third image information corresponding to a third region located between the first region and the second region in the region of the image information PR.

[0131] (Display control method and program for executing the method) The display control method and the program for executing the method according to the present embodiment are basically the same as the display control method and the program for executing the method according to the first embodiment (see FIG. 5). The difference is that, as shown in FIG. 9, in reverse running, between step S18 and step S19, the intermediate image information generation unit 44 generates intermediate image information PRM, and the intermediate image information PRM is displayed on the display device 30 (step S25). That is, on the display device 30, the intermediate image information PRM is displayed by switching from the displayed first image information PR1, and then the second image information PR2 is displayed by switching to the intermediate image information PRM.

[0132] Similarly, in forward running, between step S7 and step S8, the intermediate image information generation unit 44 generates intermediate image information PFM, and the intermediate image information PFM is displayed on the display device 30. Except for the generation and display of the intermediate image information PRM and the intermediate image information PFM respectively, the same steps as the display control method and the program according to the first embodiment shown in FIG. 5 are provided, so duplicate explanations are omitted.

[0133] (Function and effect) As described above, in each of the display control device 1, the display control system 100, the display control method, and the program according to the second embodiment, the same operational effects as those obtained by each of the display control device 1, the display control system 100, the display control method, and the program according to the second modification of the first embodiment can be obtained.

[0134] Further, as shown in FIG. 8, the display control device 1 according to the present embodiment further includes an intermediate image information generation unit 44. The intermediate image information generation unit 44 generates intermediate image information PRM to be displayed on the display device 30 between the display of the first image information PR1 and the display of the second image information PR2 when switching between the display of the first image information PR1 and the display of the second image information PR2. The intermediate image information PRM includes third image information corresponding to a third region located between the first region and the second region in the region of the image information PR. Therefore, on the display device 30, the second image information PR2 is displayed via the display of the intermediate image information PRM from the display of the first image information PR1, so that the display switching is performed gradually or stepwise.

[0135] Further, since the intermediate image information PRM includes third image information corresponding to the third region located between the first region and the second region in the region of the image information PR, it is possible to make it easier to grasp the switching direction from the first image information PR1 to the second image information PR2. For example, in the switching from the first image information PR1 obtained by imaging the rear of the vehicle around the vehicle Vm shown in FIG. 1 to the second image information PR2 obtained by imaging the rear left side around the vehicle Vm, the intermediate image information PRM including the third image information obtained by imaging between the rear and the rear left side is displayed. In this case, the driver can recognize the flow of the switching of the display of each of the first image information PR1, the intermediate image information PRM, and the second image information PR2 from the rear of the vehicle to the rear left side on the display device 30.

[0136] (First Modification Example) Using FIG. 11, the display control device 1, the display control system 100, the display control method, and the program according to the first modification example of the second embodiment will be described. In this first modification example, the second modification example, and the third modification example to be described later, modification examples of the display method of the intermediate image information PRM will be described.

[0137] In the display control device 1 and the display control system 100 according to the first modification example, as shown in FIG. 11, the intermediate image information generation unit 44 generates a plurality of intermediate image information including the intermediate image information PRM, a first intermediate image information PRM1 different from the intermediate image information PRM, and a second intermediate image information PRM2. Similar to the intermediate image information PRM generated by the intermediate image information generation unit 44 according to the second embodiment, the intermediate image information PRM is generated including third image information corresponding to a third region located between the first region and the second region of the image information PR. The first intermediate image information PRM1 is generated including a part of the first image information PR1 corresponding to the first region, and here it is generated corresponding to the left half of the first region of the image information PR and the right half of the third region. The second intermediate image information PRM2 is generated including a part of the second image information PR2 corresponding to the second region, and here it is generated corresponding to the left half of the third region and the right half of the second region. In the display device 30, when switching from the display of the first image information PR1 to the display of the second image information PR2, it is displayed in the order of the first intermediate image information PRM1, the intermediate image information PRM, and the second intermediate image information PRM2. Here, the intermediate image information generation unit 44 generates one intermediate image information PRM, the first intermediate image information PRM1, and the second intermediate image information PRM2, respectively, but at least one of them may be generated in two or more.

[0138] In the first modification example, only the generation method and the display method of the intermediate image information PRM, the first intermediate image information, and the second intermediate image information are different, and the respective components of the display control device 1, the display control system 100, the display control method, and the program are the same as those in the second embodiment. Therefore, the description of the display control device 1 and the like here is omitted.

[0139] As described above, in each of the display control device 1, the display control system 100, the display control method, and the program according to the first modification example, the same operational effects as those obtained by each of the display control device 1, the display control system 100, the display control method, and the program according to the second embodiment can be obtained.

[0140] Also, in each of the display control device 1, the display control system 100, the display control method, and the program according to the first modification example, as shown in FIG. 11, a plurality of intermediate image information PRM, first intermediate image information PRM1, and second intermediate image information PRM2 are generated by the intermediate image information generation unit 44 and displayed on the display device 30. Therefore, when switching from the first image information PR1 to the second image information PR2, the image information is displayed so as to flow in the switching direction including the plurality of intermediate image information PRM, the first intermediate image information PRM1, and the second intermediate image information PRM2, so that the switching direction can be made even easier to grasp.

[0141] (Second Modification Example) The display control device 1, the display control system 100, the display control method, and the program according to the second modification example of the second embodiment will be described with reference to FIG. 12.

[0142] In the display control device 1 and the display control system 100 according to the second modification example, as shown in FIG. 12, the intermediate image information generation unit 44 generates third intermediate image information PRM3 to be displayed on the display device 30. The third intermediate image information PRM3 is generated including first image information PR1 corresponding to a first region, second image information PR2 corresponding to a second region, and third image information corresponding to a third region among the regions of the image information PR. That is, the third intermediate image information PRM3 is generated as image information captured in a wide range including the first image information PR1, the intermediate image information PRM, and the second image information PR2. Further, since the third intermediate image information PRM3 includes each of the first image information PR1 and the second image information PR2, it has an information amount larger than the information amount of the first image information PR1 or the second image information PR2.

[0143] In the second modification example, only the generation method and the display method of the third intermediate image information PRM3 are different, and the respective components of the display control device 1, the display control system 100, the display control method, and the program are the same as those in the second embodiment. Therefore, the description of the display control device 1 and the like here is omitted.

[0144] As described above, in each of the display control device 1, the display control system 100, the display control method, and the program according to the second modification example, the same operational effects as those obtained by each of the display control device 1, the display control system 100, the display control method, and the program according to the second embodiment can be obtained.

[0145] Also, in each of the display control device 1, the display control system 100, the display control method, and the program according to the second modification example, as shown in FIG. 12, the third intermediate image information PRM3 is generated by the intermediate image information generation unit 44, and this third intermediate image information PRM3 is displayed on the display device 30. Therefore, when switching from the first image information PR1 to the second image information PR2, the third intermediate image information PRM3 captured in a wide range including the first image information PR1, the second image information PR2, and the intermediate image information PRM is displayed on the display device 30, so that the switching direction can be made even easier to grasp.

[0146] (Third Modification Example) The display control device 1, the display control system 100, the display control method, and the program according to the third modification example of the second embodiment will be described with reference to FIG. 13.

[0147] In the display control device 1 and the display control system 100 according to the third modification example, as shown in FIG. 13, the intermediate image information generation unit 44 generates the third intermediate image information PRM3, the fourth intermediate image information PRM4, and the fifth intermediate image information PRM5. When switching from the first image information PR1 to the second image information PR2, the intermediate image information generation unit 44 sequentially displays the fourth intermediate image information PRM4, the third intermediate image information PRM3, and the fifth intermediate image information PRM5 on the display device 30.

[0148] The third intermediate image information PRM3 is the same as the third intermediate image information PRM3 according to the second modification example shown in FIG. 12 described above. The fourth intermediate image information PRM4 is formed by a plurality of intermediate image information PRM41 to PRM4n that are generated by gradually including a part of the third image information in the third region in the first image information PR1 and further gradually including a part of the second image information PR2 up to one step before the third intermediate image information PRM3. That is, the fourth intermediate image information PRM4 is generated as intermediate image information that is gradually expanded step by step from the first image information PR1 to the third intermediate image information PRM3. Conversely, the fifth intermediate image information PRM5 is formed by a plurality of intermediate image information PRM51 to PRM5n that are generated by gradually removing a part of the first image information and a part of the third image information from the third intermediate image information PRM3 up to one step before the second image information PR2. That is, the fifth intermediate image information PRM5 is generated as intermediate image information that is gradually reduced step by step from the third intermediate image information PRM3 to the second image information PR2.

[0149] In the third modification example, only the display method of the intermediate image information PRM is different, and the respective components of the display control device 1, the display control system 100, the display control method, and the program are the same as those in the second embodiment, so the description here is omitted.

[0150] As described above, in each of the display control device 1, the display control system 100, the display control method, and the program according to the third modification example, the same effects as those obtained by each of the display control device 1, the display control system 100, the display control method, and the program according to the second embodiment can be obtained.

[0151] Also, in each of the display control device 1, the display control system 100, the display control method, and the program according to the third modification example, as shown in FIG. 13, the intermediate image information generation unit 44 generates each of a plurality of third intermediate image information PRM3, fourth intermediate image information PRM4, and fifth intermediate image information PRM5. The third intermediate image information PRM3 to the fifth intermediate image information PRM5 are displayed on the display device 30 by the intermediate image information generation unit 44. In addition, the fourth intermediate image information PRM4 is gradually enlarged from the first image information PR1 to the third intermediate image information PRM3, and then gradually reduced until it converges from the third intermediate image information PRM3 to the second image information PR2. Therefore, when switching from the first image information PR1 to the second image information PR2, the fourth intermediate image information PRM4, the third intermediate image information PRM3, and the fifth intermediate image information PRM5 are displayed so as to flow in the switching direction, and the third intermediate image information PRM3 with an impact due to enlargement and reduction is obtained, so that it is possible to make it easier to grasp the switching direction.

[0152] [Third Embodiment] The display control device 1, the display control system 100, the display control method, and the program according to the third embodiment of the present invention will be described with reference to FIG. 14. In the identification information generation unit 43 (see FIGS. 2 and 8) of the display control device 1 according to the present embodiment, as shown in FIG. 14(A), identification information IM(1) is generated, and the identification information IM(1) is displayed on the display device 30. The identification information IM(1) is information on a mark representing the positional relationship of the second image information PR2 with respect to the first image information PR1. In the present embodiment, the identification information IM(1) is formed by combining a "vehicle shape" representing the rear of the vehicle around the vehicle (own vehicle) Vm and a "figure indicating direction" representing the positional relationship of the second image information PR2 with respect to the first image information PR1 vertically. The identification information IM(1) is displayed overlapping the first image information PR1 when the first image information PR1 during normal driving is displayed on the display device 30.

[0153] In the display of the second image information PR2 shown in FIG. 7(B) above, as shown in FIG. 14(B), the identification information IM(2) in which the "figure indicating the direction" is deformed to the left is generated by the identification information generation unit 43, and the identification information IM(2) is displayed overlapping the first image information PR1. Note that the identification information IM(2) does not necessarily have to be displayed overlapping the first image information PR1, and it may be displayed overlapping the second image information PR2. Also, when another vehicle or the like approaches from the rear right side around the vehicle Vm, as shown in FIG. 14(C), the identification information IM(3) in which the "figure indicating the direction" is deformed to the right is generated by the identification information generation unit 43. Although illustration is omitted, the identification information IM(3) is displayed overlapping the first image information PR1. Furthermore, in the display of the second image information PR2 shown in FIG. 3(B) above, as shown in FIG. 14(D), the identification information IM(4) in which the bottom side of the "figure indicating the direction" is enlarged and deformed is generated by the identification information generation unit 43. Although illustration is omitted, the identification information IM(4) is displayed overlapping the first image information PR1.

[0154] In the third embodiment, only the forms of the identification information IM(1) to IM(4) are different, and the respective components of the display control device 1, the display control system 100, the display control method, and the program are the same as those in the first embodiment or the second embodiment, so the description here is omitted.

[0155] As described above, in each of the display control device 1, the display control system 100, the display control method, and the program according to the third embodiment, the same operational effects as those obtained by each of the display control device 1, the display control system 100, the display control method, and the program according to the first embodiment or the second embodiment can be obtained.

[0156] [Fourth Embodiment] With reference to FIG. 15, each of the display control device 1, the display control system 100, the display control method, and the program according to the fourth embodiment of the present invention will be described. As shown in FIG. 15, in the display control device 1 and the display control system 100 according to the fourth embodiment, image information PR is generated by each of a plurality of frames of image information PR(1), PR(2),..., PR(n-1), PR(n) generated at a predetermined frame rate. Then, first image information PR1 is generated corresponding to a first region that is a part of the image information of different frames of the image information PR, here, the image information PR(1) and PR(2). Further, second image information PR2 is generated corresponding to a second region that is a part of each region of the image information PR(3) to PR(n).

[0157] In the fourth embodiment, only the point that the image information PR generated by a plurality of frames is used is different, and each component of the display control device 1, the display control system 100, the display control method, and the program is the same as that in the first embodiment or the second embodiment. Therefore, the description here is omitted.

[0158] In the display control device 1 according to the present embodiment, the image information PR is generated by the image information PR(1) to PR(n) of a plurality of frames, and all of this image information PR is stored in the second storage unit 8 (see FIG. 2). Suppose that first image information PR1 is generated from each of the image information PR(1) and PR(2), and second image information PR2 is generated from each of the image information PR(3) to PR(n). Even in such a case, even if the generation of the first image information PR1 and the second image information PR2 straddles different frames of the image information PR, it does not affect the usage efficiency of the image information PR. Further, even if there is a time difference in the generation of each of the first image information PR1 and the second image information PR2, when the predetermined frame rate is set to 30 FPS, for example, it is difficult for the driver to recognize the frame difference. Therefore, it can be regarded that each of the first image information PR1 and the second image information PR2 is generated at substantially the same frame of the image information PR.

[0159] [Other Embodiments] The present invention is not limited to the above embodiments, and various modifications can be made without departing from the gist thereof. For example, in the above embodiment, the display control system includes a line-of-sight sensor and a determination unit to form a display switching unit. The display control device and the display control system may be configured to display an "undo button" on the display device by overlapping it with the second image information. In this case, the display unit of the display device is configured by a touch panel, and if the driver touches the "undo button" displayed on the display unit, the display on the display device can be switched from the second image information to the first image information. Also, in the above embodiment, the imaging device is configured to include four cameras. The display control system may be configured to include a rear camera, or a front camera and a rear camera, to form the imaging device, and generate the first image information and the second image information respectively based on the image information transmitted from the imaging device. Furthermore, in the above embodiment, the imaging device is configured by a wide-angle camera. This wide-angle camera includes a panoramic camera that can capture images in a 360-degree range.

Explanation of Signs

[0160] 1 Display control device 2, 9 Interface 3 Image information acquisition unit (acquisition unit) 4 Image information generation unit 41 First image information generation unit 42 Second image information generation unit 43 Identification information generation unit 44 Intermediate image information generation unit 5 Determination unit 6 Central processing unit 7 First storage unit 8 Second storage unit 10 Imaging device 15 Image recognition unit 16 Proximity sensor 17 Line-of-sight sensor 18 Display switching unit (display switching means) 30 Display device 100 Display control system Vm Vehicle PF, PR, PWR, PWL Image information PF1, PR1 First image information PF2, PR2 Second image information IM, IM(1) - IM(4) Identification information PRM, PRM1 - PRM5 Intermediate image information

Claims

1. An acquisition unit that acquires image information obtained by imaging the surroundings of a vehicle; A determination unit that determines the presence or absence of an obstacle with respect to the vehicle; When the determination unit determines that there is no obstacle, the first image information corresponding to a first region that is a part of the region of the image information is displayed on a display device, and when the determination unit determines that there is an obstacle, the second image information corresponding to a second region that is a part of the region of the image information and includes the obstacle is displayed on the display device in a manner that enables identification of the positional relationship between the first image information and the second image information; a display control unit; A gaze detection unit that detects the gaze direction of the driver of the vehicle; and comprising: The display control unit, while displaying an image including the second image information on the display device, based on the gaze direction of the driver, when it is determined that the driver has confirmed the display device, causes the display device to display an image that does not include the second image information and includes the first image information. A display control device.

2. The display control unit, when the determination unit determines that there is an obstacle, causes the display device to display the second image information corresponding to the second region obtained by expanding the first region until the obstacle is included. The display control device according to claim 1.

3. The display control unit, when the determination unit determines that there is an obstacle, causes the display device to display the second image information and identification information for identifying the positional relationship between the first image information and the second image information. The display control device according to claim 1 or 2.

4. The display control unit, when the determination unit determines that there is an obstacle, causes the display device to display the reduced first image information and the second image information corresponding to a second region that is a part of the region of the image information, includes the obstacle, and does not include the first region, in a manner that matches the arrangement direction of the second region with respect to the first region. The display control device according to claim 1.

5. A display control method executed by a display control device, comprising: An acquisition step of acquiring image information obtained by imaging the surroundings of a vehicle; A determination step of determining the presence or absence of an obstacle with respect to the vehicle; When it is determined in the determination step that there is no obstacle, the display device is caused to display first image information corresponding to a first area that is a part of the area of the image information, and when it is determined in the determination step that there is an obstacle, second image information corresponding to a second area that is a part of the area of the image information and includes the obstacle is caused to be displayed on the display device in a manner that enables the positional relationship between the first image information and the second image information to be identified; a display control step a line-of-sight detection step of detecting the line-of-sight direction of the driver of the vehicle comprising The display control step is a display control method in which, while an image including the second image information is being displayed on the display device, if it is determined based on the driver's line-of-sight direction that the driver has confirmed the display device, an image that does not include the second image information and includes the first image information is caused to be displayed on the display device

6. A program executed by a computer of a display control device, the computer being an acquisition unit that acquires image information obtained by imaging the surroundings of a vehicle; a determination unit that determines whether there is an obstacle to the vehicle; when the determination unit determines that there is no obstacle, the display device is caused to display first image information corresponding to a first area that is a part of the area of the image information, and when the determination unit determines that there is an obstacle, second image information corresponding to a second area that is a part of the area of the image information and includes the obstacle is caused to be displayed on the display device in a manner that enables the positional relationship between the first image information and the second image information to be identified; a display control unit a line-of-sight detection unit that detects the line-of-sight direction of the driver of the vehicle; functioning so that while an image including the second image information is being displayed on the display device, the display control unit, if it is determined based on the driver's line-of-sight direction that the driver has confirmed the display device, causes an image that does not include the second image information and includes the first image information to be displayed on the display device. A program

7. an acquisition unit that acquires image information obtained by imaging the surroundings of a vehicle; a first image information generation unit that generates first image information corresponding to a first area that is a part of the area of the image information; a determination unit that determines whether there is an obstacle approaching the vehicle; a second image information generation unit that, when the determination unit determines that there is an obstacle, generates second image information corresponding to a second area that is a part of the area of the image information and is an expansion of the first area until the obstacle is included A display switching unit that causes the display device to display the first image information when the determination unit determines that there is no obstacle, and causes the display device to display the second image information when the determination unit determines that there is an obstacle; An identification information generation unit that generates identification information for identifying the positional relationship between the first image information and the second image information and causes the display device to display the identification information; A line-of-sight detection unit that detects the line-of-sight direction of the driver of the vehicle; comprising The display switching unit is a display control device that, while an image including the second image information is being displayed on the display device, causes the display device to display an image that does not include the second image information and includes the first image information when it is determined based on the line-of-sight direction of the driver that the driver has confirmed the display device.

Images