Display control device, imaging apparatus, and mobile device

Abstract

To provide a display control device that enables a user to recognize which range of an image the user watches against a vehicle.SOLUTION: A display control device for controlling a display part that displays information related to a peripheral region of a vehicle, includes: a selection part that selects a one part region from a photographing region of an imaging part for photographing the peripheral region; an image generation part that cuts out a cutting image corresponded to the one part region from an image photographed by the imaging part; and a display control part that makes the display part display the cut-out image and a first range indicating a position of the one part region corresponded to the vehicle.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a display control device, an imaging device, and a moving device. [Background technology]

[0002] 2. Description of the Related Art Conventionally, a configuration has been proposed in which an image of the surroundings of a vehicle captured by an on-board camera is displayed on a display device (see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-88606 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the above configuration, when a wide-angle lens is mounted on the vehicle-mounted camera, a wide range of images can be acquired, but the amount of information increases, which reduces the user's (driver's) recognition, so it is necessary to cut out and display a part of the image. However, when the angle of view is changed, the user cannot recognize what range of the image is being viewed with respect to the vehicle. Patent Document 1 describes displaying an icon on a display device indicating that the camera's shooting area has changed depending on the mode, but does not disclose a configuration for allowing the user to recognize what range of the image in the shooting area is being viewed.

[0005] An object of the present invention is to provide a display control device capable of allowing a user to recognize what range of images the user is viewing relative to the host vehicle. [Means for solving the problem]

[0006] A display control device as one aspect of the present invention is a display control device for controlling a display unit that displays information regarding the surrounding area of ​​the host vehicle, and is characterized in having a selection unit that selects a partial area from the shooting area of ​​an imaging unit that captures the surrounding area, an image generation unit that cuts out a cut-out image corresponding to the partial area from an image captured by the imaging unit, and a display control unit that displays the cut-out image and a first range indicating the position of the partial area relative to the host vehicle on the display unit. Effect of the Invention

[0007] According to the present invention, it is possible to provide a display control device that allows a user to recognize what range of images the user is viewing with respect to the host vehicle. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing an automobile as an example of a moving object according to an embodiment of the present invention. [Diagram 2] FIG. 1 is a diagram showing a configuration of an automobile, which is an example of a moving body according to an embodiment of the present invention. [Diagram 3] FIG. 2 is an explanatory diagram of an imaging optical system provided in the vehicle-mounted camera. [Figure 4] FIG. 2 is an explanatory diagram of the operation of the display control device according to the first embodiment. [Diagram 5] FIG. 2 is a diagram showing an example of content displayed on a display screen of the display device according to the first embodiment. [Figure 6] FIG. 4 is a diagram showing examples of icons displayed on a display screen of the display device according to the first embodiment. [Figure 7] FIG. 4 is a diagram showing examples of icons displayed on a display screen of the display device according to the first embodiment. [Figure 8] 4 is a flowchart showing the operation of the display control device according to the first embodiment. [Figure 9] FIG. 11 is an explanatory diagram of the operation of the display control device according to the second embodiment. [Figure 10] FIG. 11 is a diagram showing an example of the contents displayed on the display screen of the display device according to the second embodiment. [Figure 11] FIG. 11 is an explanatory diagram of the operation of the display control device according to the third embodiment. [Figure 12] FIG. 13 is a diagram showing an example of the contents displayed on the display screen of the display device according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the drawings, the same reference numerals are used to refer to the same components, and duplicated descriptions will be omitted. [Example 1] Fig. 1 is a diagram showing an automobile (hereinafter, host vehicle) which is an example of a moving body (mobile device) equipped with an imaging unit of this embodiment. As shown in Fig. 1, host vehicle 100 is equipped with on-board cameras (imaging units) 20 and 21 which are side cameras that capture images of the surroundings of host vehicle 100. In this embodiment, on-board camera (first imaging unit) 20 captures images of the surrounding area on the right side of host vehicle 100, and on-board camera 21 (second imaging unit) captures images of the surrounding area on the left side of host vehicle 100. On-board cameras 20 and 21 have the same configuration, and the imaging area (full angle of view) will be described using on-board camera 20 as an example.

[0010] In this embodiment, the vehicle-mounted camera 20 has an imaging range with a field angle of about 180 degrees. The imaging range of the vehicle-mounted camera 20 is divided into imaging ranges 30a and 30b, and the imaging range 30b in particular shows an area where an image can be acquired with high resolution due to the characteristics of the optical system of the vehicle-mounted camera 20. As shown in the figure, the vehicle-mounted camera 20, which is a side camera, can acquire a peripheral area of ​​the field angle away from the optical axis at the center of the field angle represented by the imaging range 30b with higher resolution than the imaging range 30a. Therefore, it is possible to capture the left and right rear of the vehicle 100, which can be confirmed using the door mirror, with high resolution. The captured image (captured image) is displayed on a display device 40 provided on the vehicle 100, and the driver of the vehicle 100 can check the left and right and the left and right rear by checking the displayed image.

[0011] In this embodiment, the on-vehicle cameras 20 and 21 are provided to capture images of the surrounding areas on the left and right sides of the vehicle 100, but the present invention is not limited to this. The on-vehicle cameras 20 and 21 may be provided to capture images of the surrounding areas in front of or behind the vehicle 100, for example.

[0012] 2 is a diagram showing the configuration of the vehicle 100. The vehicle 100 has a display control device 10, vehicle-mounted cameras 20 and 21, a moving object detection sensor (detection unit) 30, and a display device (display unit) 40. In this embodiment, the display control device 10 and the display device 40 are configured separately, but they may be configured integrally. Furthermore, the display control device 10 may be mounted on the vehicle-mounted cameras 20 and 21.

[0013] The vehicle-mounted cameras 20 and 21 each include an imaging optical system and an imaging element that captures an image formed by the imaging optical system, and move together with the vehicle 100 to capture an image of the surrounding area of ​​the vehicle 100. The vehicle-mounted cameras 20 and 21 transmit the captured images to the display control device 10. In this embodiment, a wide-angle lens is used as the imaging optical system. The wide-angle lens will be described later.

[0014] The moving object detection sensor 30 is configured to be able to detect moving objects such as automobiles, motorcycles, etc. The moving object detection sensor 30 transmits the detection result to the display control device 10.

[0015] The display device 40 is a display for displaying information about the surrounding area of ​​the vehicle 100. The display device 40 is, for example, a liquid crystal display or an organic EL display. The information about the surrounding area of ​​the vehicle 100 is, for example, images captured by the on-board cameras 20 and 21, or information about a moving object detected by the moving object detection sensor 30. In this embodiment, the display device 40 includes a display device (first display unit) that displays information about the surrounding area on the right side of the vehicle 100, and a display device (second display unit) that displays information about the surrounding area on the left side of the vehicle 100. Note that, in this embodiment, the display device 40 displays information about the surrounding areas on the left and right sides of the vehicle 100, but the present invention is not limited thereto. The display device 40 may display information about the surrounding areas on the front and rear sides of the vehicle 100, for example.

[0016] The display control device 10 is composed of a computer (for example, an ECU: Electronic Control Unit) including at least one processor, memory, etc. The display control device 10 includes a selection unit 10a, an image generation unit 10b, and a display control unit 10c, and controls a display device 40. The selection unit 10a selects a selection area, which is a partial area (angle of view) from the shooting area of ​​the vehicle-mounted cameras 20, 21. The image generation unit 10b cuts out a cut-out image corresponding to the selection area selected by the selection unit 10a from the image captured by the vehicle-mounted cameras 20, 21. The display control unit 10c displays the cut-out image and a cut-out range (first range) indicating the position of the selection area relative to the vehicle 100 on the display device 40. When a wide-angle lens is used as the imaging optical system, a wide range of images can be acquired, but the wide range of images contains a large amount of information, which reduces the user's recognition. In addition, when the angle of view is changed, the user cannot recognize which range of images is being viewed relative to the vehicle 100. Therefore, in this embodiment, the image generating unit 10b displays, on the display device 40, a cut-out image cut out from an image captured by the vehicle-mounted cameras 20 and 21, thereby improving the user's recognition. In addition, by displaying, on the display device 40, a cut-out range indicating the position of the selected area relative to the vehicle 100, the user can recognize which range of the image of the vehicle 100 he or she is viewing.

[0017] In addition, in this embodiment, when the moving body detection sensor 30 detects a moving body (first moving body) approaching the vehicle 100 in an area outside the selection area, the display control unit 10c causes the display device 40 to display information indicating the approach of the moving body. For example, the display control unit 10c changes the display (part of the clipping range or an area near the clipping range) on the side of the direction in which the moving body 202 in the clipping range approaches the vehicle 100. This allows the user to recognize the approaching moving body from outside the angle of view.

[0018] The imaging optical system provided in the vehicle-mounted cameras 20 and 21 will be described below with reference to Fig. 3. The characteristics of the imaging optical systems provided in the vehicle-mounted cameras 20 and 21 do not necessarily have to be the same, but in this embodiment, the imaging optical systems provided in the vehicle-mounted cameras 20 and 21 have approximately the same characteristics, and the imaging optical system provided in the vehicle-mounted camera 20 will be described as an example.

[0019] 3(a) is a diagram for explaining the optical characteristics of the imaging optical system of the vehicle-mounted camera 20, and shows the projection characteristic y(θ) that indicates the relationship between the imaging height (image height) y on the imaging surface (image plane) of the imaging element of the vehicle-mounted camera 20 and the half angle of view (angle between the optical axis and the incident light) θ. In FIG. 3(a), the horizontal axis shows the half angle of view θ, and the vertical axis shows the image height y.

[0020] As shown in Fig. 3(a), the imaging optical system of the vehicle-mounted camera 20 has a resolution that is the increase in image height y per unit amount of half angle of view θ, which differs depending on the region. The local resolution is expressed as the differential value dy(θ) / dθ of the projection characteristic y(θ) at the half angle of view θ. In other words, the greater the slope of the projection characteristic y(θ) in Fig. 3(a), the higher the resolution.

[0021] In this embodiment, the vehicle-mounted cameras 20 and 21 are equipped with an imaging optical system having a projection characteristic y(θ) that satisfies the following conditional expression (1). In this imaging optical system, the area close to the center corresponds to the imaging range 30a, and the area close to the outside, where the half angle of view θ is equal to or larger than a predetermined half angle of view θa, corresponds to the imaging range 30b. Such an imaging optical system may be called an inverse different angle of view lens.

[0022] 0.20<2×f×tan(θmax / 2) / y(θmax)<0.95 (1) Here, f is the focal length of the imaging optical system, and θmax is the maximum half angle of view of the imaging optical system.

[0023] Moreover, it is preferable that the vehicle-mounted cameras 20 and 21 satisfy the following conditional expressions (2) and (3) with respect to the peripheral area of ​​the imaging surface of the imaging element.

[0024] 0.35Lh≦Lb≦0.5Lh (2) 0.35Lh≦Lf≦0.5Lh (3) Here, Lb is the distance between the image position on the imaging surface of the subject behind the vehicle 100 and the center of the imaging surface. Lf is the distance between the image position on the imaging surface of the subject in front of the vehicle 100 and the center of the imaging surface. Lh is the length of the side extending in the direction in which the above two image positions are separated on the imaging surface.

[0025] As shown in FIG. 3(b), conditional expressions (2) and (3) indicate conditions for effectively using the most peripheral region R3 of the imaging surface 11a. If conditional expressions (2) and (3) are not satisfied, it is not possible to capture an image in the most peripheral region R3 with high resolution, and it is difficult to obtain detailed information from the captured image, which is not preferable. In other words, by satisfying conditional expressions (2) and (3), it is possible to capture an image in high resolution in the most peripheral region R3. Then, by cutting out a high-resolution partial image obtained in the most peripheral region R3 and outputting and displaying it on the display device 40, the driver can obtain detailed information about the front and rear. However, if a low-resolution partial image that is not in the most peripheral region R3 is cut out and outputted to the display device 40 and displayed, the driver can at least grasp whether or not a subject exists in the optical axis direction.

[0026] In this embodiment, the vehicle-mounted cameras 20 and 21 have the above-mentioned configuration and are installed on the vehicle 100 so that the outermost peripheral region R3 can capture images in front of and behind the vehicle 100. For example, the vehicle-mounted cameras 20 and 21 are installed so that the optical axes of the vehicle-mounted cameras 20 and 21 are substantially parallel to the ground (horizontal plane) on the sides of the vehicle 100 and at an angle such that the outermost peripheral region R3 can capture images in front of and behind the vehicle 100.

[0027] The operation of the display control device 10 will be described below. FIG. 4 is an explanatory diagram of the operation of the display control device 10. In this embodiment, the selection unit 10a selects a selection area from the shooting area based on the detection result of the moving body detection sensor 30. Specifically, the selection unit 10a acquires information on the moving body closest to the host vehicle 100 among the moving bodies approaching the host vehicle 100 from the moving body detection sensor 30. Next, the selection unit 10a selects a selection area so that the moving body closest to the host vehicle 100 among the moving bodies approaching the host vehicle 100 is included in the cut-out image. Note that, in this embodiment, a case where there are two lanes (two lanes on each side) will be described, but the present invention can be applied even when there is one lane or three or more lanes.

[0028] FIG. 4(a) shows a situation where moving bodies 201 and 202 are approaching the host vehicle 100 that is traveling. In FIG. 4(a), the moving body 201 is closest to the host vehicle 100, and the moving body 202 is the next closest to the host vehicle 100 after the moving body 201. In the situation of FIG. 4(a), the selection unit 10a acquires a detection result from the moving body detection sensor 30. For example, the detection result is that the moving bodies 201 and 202 are approaching the host vehicle 100 that is traveling, that the moving body 201 is closest to the host vehicle 100, and that the moving body 202 is the next closest to the host vehicle 100 after the moving body 201. The selection unit 10a selects a selection area 301 from the shooting area of ​​the vehicle-mounted camera 20 so that the moving body 201 that is closest to the host vehicle 100 is included in the cut-out image. The image generation unit 10b cuts out a cut-out image that corresponds to the selection area 301 and includes the moving body 201 from the image taken by the vehicle-mounted camera 20. 5(a), the display control unit 10c causes the display device 40 to display a cut-out image 41a cut out by the image generation unit 10b. In addition, the display control unit 10c causes the display device 40 to display an icon 42a indicating the host vehicle 100 and an icon 42 including a cut-out range 42b indicating the position of the selection region 301 relative to the host vehicle 100.

[0029] In addition, the display control unit 10c changes the display of the side of the cutout range 42b in the direction in which the moving body 202 approaches the vehicle 100 in order to allow the user to recognize the moving body 202 approaching from outside the angle of view. In this embodiment, the display control unit 10c changes the color of a part 42c on the side of the cutout range 42b in the direction in which the moving body 202 approaches the vehicle 100 as shown in FIG. 5(a). Note that the display method is not limited to this as long as it is possible to allow the user to recognize the moving body 202 approaching from outside the angle of view. For example, the display of the side of the cutout range 42b in the direction in which the moving body 202 approaches the vehicle 100 in the cutout range 42b may be blinked, or the frame line of the side of the cutout range 42b in the direction in which the moving body 202 approaches the vehicle 100 may be thickened.

[0030] The display control unit 10c may also change the display of the side of the cutout range 42b in the direction in which the moving body 202 approaches the host vehicle 100 according to the distance between the host vehicle 100 and the moving body 202. For example, the display control unit 10c may add information on the distance between the host vehicle 100 and the moving body 202 to the icon 42b as shown in FIG. 6(a). The display control unit 10c may also thicken a part 42c of the cutout range 42b in the direction in which the moving body 202 approaches the host vehicle 100 as the distance between the host vehicle 100 and the moving body 202 decreases as shown in FIG. 6(b). Furthermore, the display control unit 10c may shorten the blinking interval of the display of the side of the cutout range 42b in the direction in which the moving body 202 approaches the host vehicle 100 as the distance between the host vehicle 100 and the moving body 202 decreases as shown in FIG. 6(c).

[0031] 7, the display control unit 10c may include, in the icon 42, a shooting range (second range) 42e indicating the position of the shooting area relative to the host vehicle 100. The display control unit 10c may change the display of the side of the shooting range 42e in the direction in which the moving object 202 approaches the host vehicle 100. In FIG. 7, the color of a part 42f of the shooting range 42e on the side in the direction in which the moving object 202 approaches the host vehicle 100 is changed.

[0032] FIG. 4(b) shows a situation in which the moving body 201 has overtaken the host vehicle 100 from the situation in FIG. 4(a), has moved away from the host vehicle 100, and the moving body 202 has approached the host vehicle 100. In FIG. 4(b), it is assumed that the moving body 201 is closest to the host vehicle 100, and the moving body 202 is the next closest to the host vehicle 100 after the moving body 201. In the situation in FIG. 4(b), the selection unit 10a acquires a detection result from the moving body detection sensor 30. The detection result is, for example, that the moving body 201 has moved away from the host vehicle 100 and the moving body 202 has approached the host vehicle 100, or that the moving body 201 is closest to the host vehicle 100 and the moving body 202 is the next closest to the host vehicle 100 after the moving body 201. The selection unit 10a selects a selection area 302 from the shooting area of ​​the vehicle-mounted camera 20 so that the moving object 202 closest to the vehicle 100 among the moving objects approaching the vehicle 100 is included in the cut-out image. The image generation unit 10b cuts out a cut-out image corresponding to the selection area 302 from the image captured by the vehicle-mounted camera 20 and including the moving object 202. The display control unit 10c causes the display device 40 to display the cut-out image 41b cut out by the image generation unit 10b, as shown in FIG. 5(b). At this time, the display control unit 10c causes the display device 40 to display an icon 42a indicating the vehicle 100 and an icon 42 including a cut-out range 42d indicating the position of the selection area 302 relative to the vehicle. In the situation of FIG. 4(b), since there is no moving object approaching from outside the angle of view, the display control unit 10c does not cause the display device 40 to display information indicating the moving object approaching the vehicle 100.

[0033] The flow of operations of the display control device 10 described above will be described below. Fig. 8 is a flowchart showing the operations of the display control device 10 of this embodiment. This flow is started when power is supplied to the display control device 10. Note that in this embodiment, power is supplied to the display control device 10 when, for example, the ignition switch (start switch) of the host vehicle 100 is turned on or the shift lever of the host vehicle 100 is changed to a position other than parking.

[0034] In step S101, the display control unit 10c displays on the display device 40 a cut-out image corresponding to a pre-selected selection area (a selection area set in the initial state) and an icon including a cut-out range indicating the position of the selection area relative to the vehicle 100.

[0035] In step S102, the display control unit 10c uses the detection result of the moving object detection sensor 30 to determine whether or not a moving object is approaching the host vehicle 100 from behind (the rear side) of the host vehicle 100. If the display control unit 10c determines that a moving object is approaching the host vehicle 100 from behind, the process of step S103 is executed. If the display control unit 10c determines that a moving object is not approaching the host vehicle 100 from behind, the process of step S101 is executed.

[0036] In step S103, the selection unit 10a selects a selection area from the shooting area of ​​the in-vehicle camera 20 so that the moving object closest to the host vehicle 100 among the moving objects approaching the host vehicle 100 from behind the host vehicle 100 is included in the cut-out image. In addition, the image generation unit 10b cuts out a cut-out image corresponding to the selection area from the image shot by the in-vehicle camera 20.

[0037] In step S104, the display control unit 10c acquires the orientation of the second or subsequent closest moving object to the host vehicle 100 among the moving objects approaching the host vehicle 100 from behind the host vehicle 100, using the detection result of the moving object detection sensor 30. The acquired information is used to allow the user to recognize the moving object approaching from outside the angle of view.

[0038] In step S105, the display control unit 10c causes the display device 40 to display the cut-out image cut out by the image generating unit 10b and an icon including the cut-out range indicating the position of the selected area relative to the host vehicle 100.

[0039] In step S106, the display control device 10 determines whether to end this flow. The display control device 10 determines to end this flow when the supply of power ends or when an instruction to end is given by a user operation. If the display control device 10 determines to end this flow, it ends this flow. On the other hand, if the display control device 10 determines not to end this flow, the process of step S102 is executed.

[0040] As described above, according to the configuration of this embodiment, it is possible for the user to recognize which range of images is being viewed with respect to the vehicle. Furthermore, by displaying, by using icons or the like, the presence of moving objects even in the range not being displayed, the user can understand that moving objects exist outside the display range. [Example 2] In the first embodiment, a case where there are two lanes on each side has been described, but in this embodiment, a case where there are three lanes on each side will be described. An automobile (hereinafter, the host vehicle) 100, which is an example of a moving body in this embodiment, has a similar configuration to the host vehicle 100 described in the first embodiment. In this embodiment, only the configuration different from the first embodiment will be described, and a description of the common configuration will be omitted.

[0041] In this embodiment, the selection unit 10a selects the selection area so that the moving object closest to the host vehicle 100 among the moving objects approaching the host vehicle 100 and within a predetermined distance from the host vehicle 100 is included in the cutout image. The distance from the host vehicle 100 may be the distance from the center position of the host vehicle 100 or the distance from the moving object detection sensor 30. For example, when the moving object detection sensor 30 provided on the right side of the host vehicle 100 is used as a reference, the distance from the direction toward the right side of the host vehicle 100 (the direction perpendicular to the traveling direction of the host vehicle 100 and the direction of gravity) may be set to within 2 m, which is shorter than the width of the lane (3.5 m). By setting in this manner, it is possible to suppress the selection area from being selected so that a moving object traveling in a lane away from the lane in which the host vehicle 100 is traveling is included in the cutout image.

[0042] Here, a case will be described in which a first moving body traveling in a lane adjacent to the first lane in which the vehicle 100 is traveling and a second moving body traveling in a lane away from the first lane exist, and the second moving body is closer to the vehicle 100 than the first moving body. It is assumed that both the first moving body and the second moving body are approaching the vehicle 100. In such a case, the user wants to recognize the first moving body traveling in a lane adjacent to the first lane, not the second moving body closer to the vehicle 100. However, in the configuration of the first embodiment, the selection area is selected so that the second moving body closest to the vehicle 100 is included in the cutout image. On the other hand, in the configuration of the present embodiment, since the moving body needs to satisfy the condition that the distance from the vehicle 100 is within a predetermined range, the selection area is selected so that the first moving body is included in the cutout image, not the second moving body closest to the vehicle 100. That is, when the moving body closest to the vehicle 100 is a moving body traveling in a lane away from the vehicle 100, it is possible to suppress the selection area from being selected so that the moving body is included in the cutout image. This enables the display control device 10 to display, among the moving objects around the vehicle 100, the moving object that the user is most interested in (about which he / she wants to know more).

[0043] FIG. 9 is an explanatory diagram of the operation of the display control device 10. In FIG. 9, the vehicle 100 and the moving bodies 203 and 204 are traveling on lanes 500, 501 and 502, respectively. Also, the moving body 204 is closest to the vehicle 100, and the moving body 203 is next closest to the vehicle 100 after the moving body 204. In the situation of FIG. 9(a), the selection unit 10a selects the selection area 303 so that the moving body 203, which is closest to the vehicle 100 among the moving bodies approaching the vehicle 100 and whose distance from the vehicle 100 is within a predetermined range, is included in the cut-out image. The predetermined range is set to 2 m in the direction toward the right side of the vehicle 100, 0 m in the direction toward the front side of the vehicle 100, and 20 m in the direction toward the rear side of the vehicle 100, based on the moving body detection sensor 30 provided on the right side of the vehicle 100. The image generation unit 10b cuts out a cut-out image that corresponds to the selected area 303 and includes the moving object 203 from the image captured by the in-vehicle camera 20. The display control unit 10c causes the display device 40 to display the cut-out image 41c cut out by the image generation unit 10b, as shown in Fig. 10. At this time, the display control unit 10c causes the display device 40 to display an icon 43 including an icon 43a indicating the host vehicle 100, a cut-out range 43b indicating the position of the selected area 303 relative to the host vehicle 100, and an icon 43c indicating the above-mentioned predetermined range.

[0044] Furthermore, in order to allow the user to recognize the moving object 204 approaching from outside the angle of view, the display control unit 10c may change the display of the side of the cut-out range 43b in the direction in which the moving object 204 approaches the host vehicle 100. In this embodiment, the display control unit 10c changes the color of a part 43d of the cut-out range 43b on the side in the direction in which the moving object 204 approaches the host vehicle 100, as shown in FIG. [Example 3] In the first and second embodiments, a case where a cutout image and a cutout range corresponding to one selected area are displayed on one display device for one side of the vehicle is described. In this embodiment, a case where a cutout image and a cutout range corresponding to each of a plurality of selected areas are displayed on a plurality of display devices for one side of the vehicle is described. That is, in this embodiment, the display device 40 has a plurality of display devices (first display units) that display information related to the surrounding area on the right side of the vehicle 100. In addition, in this embodiment, the display device 40 has a plurality of display devices (second display units) that display information related to the surrounding area on the left side of the vehicle 100. Note that the display device 40 may have a plurality of first display units and a plurality of second display units. An automobile (hereinafter, the vehicle) 100, which is an example of a moving body in this embodiment, has a configuration similar to that of the vehicle 100 described in the first embodiment. In this embodiment, only configurations different from the first and second embodiments are described, and a description of common configurations is omitted.

[0045] FIG. 11 is an explanatory diagram of the operation of the display control device 10. In FIG. 11, a moving body 205 travels in front of the vehicle 100 on the right side, and a moving body 206 travels in the rear of the vehicle 100 on the right side. In FIG. 11, the moving body 205 is closest to the vehicle 100, and the moving body 206 is next closest to the vehicle 100 after the moving body 205. In the situation of FIG. 11, the selection unit 10a selects a selection area 304 so that the moving body 205 is included in the cut-out image, and selects a selection area 305 so that the moving body 206 is included in the cut-out image. The image generation unit 10b cuts out a cut-out image corresponding to the selection area 304 and including the moving body 205, and a cut-out image corresponding to the selection area 305 and including the moving body 206, from the image captured by the vehicle-mounted camera 20. The display control unit 10c causes the cut-out image 41d cut out by the image generation unit 10b to be displayed on one of the display devices 40, as shown in FIG. 12(a). At this time, the display control unit 10c causes the display device 40 to display an icon 44a indicating the host vehicle 100 and an icon 44 including a cut-out range 44b indicating the position of the selection region 304 relative to the host vehicle 100. Also, as shown in Fig. 12(b), the display control unit 10c causes the cut-out image 41e cut out by the image generation unit 10b to be displayed on the display device that is not displaying the cut-out image 41d. At this time, the display control unit 10c causes the display device 40 to display an icon 45a indicating the host vehicle 100 and an icon 45 including a cut-out range 45b indicating the position of the selection region 305 relative to the host vehicle 100.

[0046] All the cut-out images and the cut-out ranges may be displayed on one display device. In this case, there may be only one display device 40. In this case, for example, the images in Fig. 12(a) and Fig. 12(b) are displayed on one display device. [Other Examples] The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-mentioned embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0047] In the above embodiments, the vehicle-mounted cameras 20 and 21 are not necessarily equipped with wide-angle lenses. For example, three imaging devices may be used to capture images of the front, sides, and rear of the vehicle 100.

[0048] The disclosure of this embodiment includes the following configurations and methods.

[0049] (Configuration 1) A display control device for controlling a display unit that displays information about a surrounding area of ​​a host vehicle, a selection unit that selects a part of an area from an imaging area of ​​an imaging unit that captures the surrounding area; an image generating unit that cuts out a cut-out image corresponding to the partial area from the image captured by the imaging unit; and a display control unit that causes the display unit to display the cut-out image and a first range indicating a position of the partial area relative to the vehicle. (Configuration 2) 2. The display control device according to configuration 1, wherein the selection unit selects the partial area based on a detection result of a detection unit capable of detecting a moving object. (Configuration 3) The display control device according to configuration 2, wherein the selection unit selects the partial area so that a moving object closest to the host vehicle among moving objects approaching the host vehicle is included in the cut-out image. (Configuration 4) The display control device according to configuration 2 or 3, characterized in that the selection unit selects the partial area so that a moving object that is closest to the host vehicle among moving objects that are approaching the host vehicle and are within a predetermined range of distance from the host vehicle is included in the cut-out image. (Configuration 5) The selection unit selects a plurality of partial areas from the photographing area, the image generation unit generates a plurality of cut-out images corresponding to each of the plurality of partial regions from the image; The display control device according to any one of configurations 1 to 4, characterized in that the display control unit displays the multiple cut-out images and multiple first ranges indicating the positions of each of the multiple partial areas relative to the vehicle on the display unit. (Configuration 6) A display control device described in any one of configurations 1 to 5, characterized in that when a detection unit capable of detecting moving objects detects a first moving object approaching the vehicle in an area outside the partial area, the display control unit displays information indicating the approach of the first moving object on the display unit. (Configuration 7) 7. The display control device according to configuration 6, wherein the display control unit changes the display on a side of the first range in a direction in which the first moving object approaches the host vehicle. (Configuration 8) 8. The display control device according to configuration 7, wherein the display control unit changes the display depending on the distance between the host vehicle and the first moving object. (Configuration 9) The display control device according to configuration 6, characterized in that the display control unit changes the display on the side of a second range indicating the position of the shooting area relative to the vehicle in the direction in which the first moving body approaches the vehicle. (Configuration 10) A display control device according to any one of configurations 1 to 9; and an imaging element. (Configuration 11) A display control device according to any one of configurations 1 to 9; An imaging unit that captures an image of a surrounding area of ​​the vehicle; A detection unit capable of detecting a moving object; The mobile device further comprises a display unit that displays information about the surrounding area. (Configuration 12) The mobile device described in configuration 11, wherein the imaging unit includes a first imaging unit that captures a first surrounding area and a second imaging unit that captures a second surrounding area different from the first surrounding area. (Configuration 13) The mobile device according to configuration 11 or 12, characterized in that the display unit includes a first display unit that displays information about a first surrounding area, and a second display unit that displays information about a second surrounding area different from the first surrounding area. (Method 1) A display control method for controlling a display unit that displays information about a surrounding area of ​​a host vehicle, comprising: selecting a part of the image capturing area of ​​an image capturing unit that captures the surrounding area; cutting out a cut-out image corresponding to the partial area from the image captured by the imaging unit; and displaying, on the display unit, the cut-out image and a first range indicating a position of the partial area relative to the vehicle. (Configuration 14) A program for causing a computer to execute the display control method according to method 1.

[0050] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. [Explanation of symbols]

[0051] 100 Automobile (own vehicle) 10 Display control device 10a Selection section 10b Image generation section 10c Display control unit 20 Vehicle-mounted camera (imaging unit) 40 Display device (display section)

Claims

1. A display control device for controlling a display unit that displays information about a surrounding area of ​​a host vehicle, a selection unit that selects a part of an area from an imaging area of ​​an imaging unit that captures the surrounding area; an image generating unit that cuts out a cut-out image corresponding to the partial area from the image captured by the imaging unit; and a display control unit that causes the display unit to display the cut-out image and a first range indicating a position of the partial area relative to the vehicle.

2. The display control device according to claim 1 , wherein the selection unit selects the partial area based on a detection result of a detection unit capable of detecting a moving object.

3. The display control device according to claim 2 , wherein the selection unit selects the partial area such that, of the moving objects approaching the host vehicle, the moving object closest to the host vehicle is included in the cut-out image.

4. The display control device according to claim 2, characterized in that the selection unit selects the portion of the area so that the moving body closest to the vehicle among the moving bodies approaching the vehicle and within a predetermined range of distance from the vehicle is included in the cut-out image.

5. The selection unit selects a plurality of partial areas from the photographing area, the image generation unit generates a plurality of cut-out images corresponding to each of the plurality of partial regions from the image; The display control device according to claim 1 or 2, characterized in that the display control unit causes the display unit to display the multiple cut-out images and multiple first ranges indicating positions of each of the multiple partial areas relative to the vehicle.

6. The display control device described in claim 1 or 2, characterized in that when a detection unit capable of detecting moving objects detects a first moving object approaching the vehicle in an area outside the partial area, the display control unit displays information indicating the approach of the first moving object on the display unit.

7. The display control device according to claim 6 , wherein the display control unit changes the display on a side of the first range in a direction in which the first moving object approaches the host vehicle.

8. The display control device according to claim 7 , wherein the display control unit changes the display depending on a distance between the host vehicle and the first moving object.

9. The display control device according to claim 6, characterized in that the display control unit changes the display on the side of a second range indicating the position of the shooting area relative to the vehicle in a direction in which the first moving body approaches the vehicle.

10. A display control device according to claim 1 or 2; and an imaging element.

11. A display control device according to claim 1 or 2; An imaging unit that captures an image of a surrounding area of ​​the vehicle; A detection unit capable of detecting a moving object; The mobile device further comprises a display unit that displays information about the surrounding area.

12. The mobile device according to claim 11 , wherein the imaging unit includes a first imaging unit that captures an image of a first surrounding area, and a second imaging unit that captures an image of a second surrounding area different from the first surrounding area.

13. The mobile device according to claim 11, characterized in that the display unit includes a first display unit that displays information about a first surrounding area, and a second display unit that displays information about a second surrounding area different from the first surrounding area.

14. A display control method for controlling a display unit that displays information about a surrounding area of ​​a host vehicle, comprising: selecting a part of the image capturing area of ​​an image capturing unit that captures the surrounding area; cutting out a cut-out image corresponding to the partial area from the image captured by the imaging unit; and displaying, on the display unit, the cut-out image and a first range indicating a position of the partial area relative to the vehicle.

15. A program causing a computer to execute the display control method according to claim 14.

Images