Display control device, imaging device, and moving device

Abstract

To provide a display control device that enables a user to recognize which range of an image the user watches against a vehicle.SOLUTION: A display control device for controlling a display part that displays information related to a peripheral region of a vehicle, includes: a selection part that selects a one part region from a photographing region of an imaging part for photographing the peripheral region; an image generation part that cuts out a cutting image corresponded to the one part region from an image photographed by the imaging part; and a display control part that makes the display part display the cut-out image and a first range indicating a position of the one part region corresponded to the vehicle.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a display control device, an imaging device, and a mobile device.

Background Art

[0002] Conventionally, a configuration has been proposed in which an image of the surroundings of a host vehicle captured by an in-vehicle camera is displayed on a display device (see Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the above configuration, when a wide-angle lens is mounted on the in-vehicle camera, a wide range of images can be acquired, but the amount of information increases, which reduces the recognition ability of the user (driver). Therefore, it is necessary to cut out and display a part of the image. However, when the angle of view is changed, the user cannot recognize which range of the image of the host vehicle they are viewing. Although Patent Document 1 describes displaying an icon indicating that the shooting area of the camera has been changed on the display device according to the mode, it does not disclose a configuration for allowing the user to recognize which range of the shooting area they are viewing.

[0005] An object of the present invention is to provide a display control device capable of allowing a user to recognize which range of the image of the host vehicle they are viewing.

Means for Solving the Problems

[0006] A display control device according to one aspect of the present invention is ,carA display control device that controls a display unit that displays information about both surrounding areas, wherein a portion of the captured image acquired from an imaging means that captures the surrounding area corresponds to a portion of the shooting range of the imaging means. photograph Represents range icon A display control means that causes the following to be displayed in the display unit, Detection means for detecting moving objects other than vehicles to have Furthermore, if the display control means detects the first moving object outside a portion of the area displayed on the display unit by the detection means, it performs display control to show information representing the position of the first moving object on an icon. It is characterized by the following: [Effects of the Invention]

[0007] According to the present invention, it is possible to provide a display control device that allows the user to recognize the range of images they are viewing on their vehicle. [Brief explanation of the drawing]

[0008] [Figure 1] This figure shows an automobile, which is an example of a mobile body according to an embodiment of the present invention. [Figure 2] This figure shows the configuration of an automobile, which is an example of a mobile body according to an embodiment of the present invention. [Figure 3] This is an explanatory diagram of the imaging optical system installed in an in-vehicle camera. [Figure 4] This is an explanatory diagram of the operation of the display control device in Example 1. [Figure 5] This figure shows an example of the content displayed on the display surface of the display device in Example 1. [Figure 6] This figure shows an example of an icon displayed on the display surface of the display device in Example 1. [Figure 7] This figure shows an example of an icon displayed on the display surface of the display device in Example 1. [Figure 8] This is a flowchart showing the operation of the display control device in Example 1. [Figure 9] This is an explanatory diagram of the operation of the display control device in Example 2. [Figure 10] This figure shows an example of the content displayed on the display surface of the display device in Example 2. [Figure 11] This is an explanatory diagram of the operation of the display control device in Example 3. [Figure 12]This figure shows an example of the content displayed on the display surface of the display device in Example 3. [Modes for carrying out the invention]

[0009] The embodiments of the present invention will be described in detail below with reference to the drawings. In each figure, the same reference numeral is used for identical components, and redundant explanations are omitted. [Example 1] Figure 1 shows an example of a mobile device (mobile body) equipped with an imaging unit according to this embodiment, which is an automobile (hereinafter referred to as "the vehicle"). As shown in Figure 1, the vehicle 100 is equipped with on-board cameras (imaging units) 20 and 21, which are side cameras that photograph the area around the vehicle 100. In this embodiment, the on-board camera (first imaging unit) 20 photographs the area to the right of the vehicle 100, and the on-board camera 21 (second imaging unit) photographs the area to the left of the vehicle 100. The on-board cameras 20 and 21 have similar configurations, and the imaging area (full field of view) will be explained using the on-board camera 20 as an example.

[0010] In this embodiment, the in-vehicle camera 20 has an imaging range of approximately 180 degrees. The imaging range of the in-vehicle camera 20 is divided into imaging ranges 30a and 30b, with imaging range 30b schematically representing the region where images can be acquired with high resolution due to the optical system characteristics of the in-vehicle camera 20. As shown in the figure, the in-vehicle camera 20, which is a side camera, can acquire images with higher resolution in the peripheral region of the imaging range 30b, which is away from the optical axis at the center of the field of view, than in imaging range 30a. Therefore, it is possible to capture images of the left and right rear of the vehicle 100, which can be checked using the door mirrors, with high resolution. The captured images are displayed on a display device 40 provided on the vehicle 100, and the driver of the vehicle 100 can check the left and right and left and right rear by checking the displayed images.

[0011] In this embodiment, the in-vehicle cameras 20 and 21 are configured to capture the left and right peripheral areas of the vehicle 100, but the present invention is not limited to this. For example, the in-vehicle cameras 20 and 21 may be configured to capture the front or rear peripheral areas of the vehicle 100.

[0012] FIG. 2 is a diagram showing the configuration of the host vehicle 100. The host vehicle 100 includes a display control device 10, in-vehicle cameras 20 and 21, a moving body detection sensor (detection unit) 30, and a display device (display unit) 40. In this embodiment, the display control device 10 and the display device 40 are separately configured, but they may be integrally configured. Further, the display control device 10 may be mounted on the in-vehicle cameras 20 and 21.

[0013] The in-vehicle cameras 20 and 21 include an imaging optical system and an image sensor that captures an image formed by the imaging optical system, and move together with the host vehicle 100 to capture the peripheral area of the host vehicle 100. The in-vehicle cameras 20 and 21 transmit the captured images to the display control device 10. In this embodiment, a wide-angle lens is used as the imaging optical system. The wide-angle lens will be described later

[0014] The moving body detection sensor 30 is configured to be able to detect moving bodies such as automobiles and motorcycles. The moving body detection sensor 30 transmits the detection result to the display control device 10.

[0015] The display device 40 is a display for displaying information regarding the peripheral area of the host vehicle 100. The display device 40 is, for example, a liquid crystal display or an organic EL display. Information regarding the peripheral area of the host vehicle 100 is, for example, an image captured by the in-vehicle cameras 20 and 21 or information regarding a moving body detected by the moving body detection sensor 30. In this embodiment, the display device 40 includes a display device (first display unit) that displays information regarding the peripheral area on the right side of the host vehicle 100 and a display device (second display unit) that displays information regarding the peripheral area on the left side of the host vehicle 100. Note that, in this embodiment, the display device 40 displays information regarding the peripheral areas on the left and right sides of the host vehicle 100, but the present invention is not limited to this. The display device 40 may display information regarding the peripheral areas in front of or behind the host vehicle 100, for example.

[0016] The display control device 10 is composed of a computer (e.g., an ECU: Electronic Control Unit) including at least one processor and memory. The display control device 10 comprises a selection unit 10a, an image generation unit 10b, and a display control unit 10c, and controls the display device 40. The selection unit 10a selects a selection area, which is a portion of the area (angle of view) from the shooting area of ​​the in-vehicle cameras 20 and 21. The image generation unit 10b extracts a cropped image from the image captured by the in-vehicle cameras 20 and 21 that corresponds to the selection area selected by the selection unit 10a. The display control unit 10c displays the cropped image and the cropped range (first range) indicating the position of the selection area relative to the vehicle 100 on the display device 40. When a wide-angle lens is used as the imaging optical system, it is possible to acquire a wide-area image, but a wide-area image contains a large amount of information, which reduces user recognition. Also, if the angle of view is changed, the user will not be able to recognize which range of the image they are viewing relative to the vehicle 100. Therefore, in this embodiment, the image generation unit 10b displays the cropped image extracted from the images captured by the in-vehicle cameras 20 and 21 on the display device 40, thereby improving user recognition. Furthermore, by displaying the cropped area, which indicates the position of the selected region relative to the vehicle 100, on the display device 40, the user can recognize which range of the image they are viewing relative to the vehicle 100.

[0017] In this embodiment, if the moving object detection sensor 30 detects a moving object (first moving object) approaching the vehicle 100 in an area outside the selected area, the display control unit 10c displays information indicating the approach of the moving object on the display device 40. For example, the display control unit 10c changes the display on the side in which the moving object 202 in the cropped area is approaching the vehicle 100 (a part of the cropped area or an area near the cropped area). This allows the user to recognize a moving object approaching from outside the field of view.

[0018] The imaging optical systems of the in-vehicle cameras 20 and 21 will be described below with reference to Figure 3. While the characteristics of the imaging optical systems of the in-vehicle cameras 20 and 21 do not necessarily have to be the same, in this embodiment, the imaging optical systems of the in-vehicle cameras 20 and 21 are assumed to have substantially the same characteristics, and the imaging optical system of the in-vehicle camera 20 will be described exemplarily.

[0019] Figure 3(a) is a diagram illustrating the optical characteristics of the imaging optical system of the in-vehicle camera 20. It shows the projection characteristic y(θ) which represents the relationship between the image height y and the half-angle of view (angle between the optical axis and the incident light ray) θ on the imaging surface (image plane) of the image sensor of the in-vehicle camera 20. In Figure 3(a), the half-angle of view θ is shown on the horizontal axis and the image height y is shown on the vertical axis.

[0020] As shown in Figure 3(a), the imaging optical system of the in-vehicle camera 20 has a resolution that varies depending on the region, which is the increase in image height y per unit quantity of half-angle of view θ. The local resolution is expressed as the derivative of the projection characteristic y(θ) with respect to the half-angle of view θ, dy(θ) / dθ. In other words, the steeper the slope of the projection characteristic y(θ) in Figure 3(a), the higher the resolution.

[0021] In this embodiment, the in-vehicle cameras 20 and 21 are equipped with an imaging optical system having projection characteristics y(θ) that satisfy the following condition (1). In this imaging optical system, the area closer to the center corresponds to the imaging range 30a, and the area further out where the half-angle of view θ is greater than or equal to a predetermined half-angle of view θa corresponds to the imaging range 30b. Such an imaging optical system is sometimes called an inverse angle of view lens.

[0022] 0.20<2×f×tan(θmax / 2) / y(θmax)<0.95 (1) Here, f is the focal length of the imaging optical system, and θmax is the maximum half-angle of view of the imaging optical system.

[0023] Furthermore, it is preferable that the in-vehicle cameras 20 and 21 satisfy the following conditions (2) and (3) with respect to the peripheral region of the imaging surface of the image sensor.

[0024] 0.35 Lh ≤ Lb ≤ 0.5 Lh (2) 0.35Lh ≤ Lf ≤ 0.5Lh (3) Here, Lb is the distance between the image position of the subject behind the vehicle 100 and the center of the imaging plane. Lf is the distance between the image position of the subject in front of the vehicle 100 and the center of the imaging plane. Lh is the length of the side extending in the direction away from the two image positions on the imaging plane.

[0025] Conditional equations (2) and (3), as shown in Figure 3(b), indicate the conditions for effectively using the outermost region R3 of the imaging surface 11a. Failure to satisfy conditions (2) and (3) is undesirable because it is not possible to image in the high-resolution outermost region R3, making it difficult to obtain detailed information from the captured image. In other words, satisfying conditions (2) and (3) enables high-resolution imaging in the outermost region R3. Then, by extracting a high-resolution partial image obtained in the outermost region R3 and outputting it to the display device 40 for display, the driver can obtain detailed information about the front and rear. However, if a low-resolution partial image other than the outermost region R3 is extracted and output to the display device 40 for display, the driver can at least determine whether or not there is an object in the optical axis direction.

[0026] In this embodiment, the in-vehicle cameras 20 and 21 have the configuration described above and are installed on the vehicle 100 so that the outermost region R3 can capture images of the area in front of and behind the vehicle 100. For example, the optical axes of the in-vehicle cameras 20 and 21 are positioned to the side of the vehicle 100, approximately parallel to the ground (horizontal plane), and the camera is installed at an angle that allows the outermost region R3 to capture images of the area in front of and behind the vehicle 100.

[0027] The operation of the display control device 10 will be described below. Figure 4 is an explanatory diagram of the operation of the display control device 10. In this embodiment, the selection unit 10a selects a selection area from the shooting area based on the detection result of the moving object detection sensor 30. Specifically, the selection unit 10a obtains information from the moving object detection sensor 30 about the moving object that is closest to the vehicle 100 among the moving objects approaching the vehicle 100. Next, the selection unit 10a selects a selection area so that the moving object that is closest to the vehicle 100 among the moving objects approaching the vehicle 100 is included in the cropped image. In this embodiment, the case where there are 2 lanes (two lanes on each side) is described, but the present invention can also be applied when there are 1 or 3 or more lanes.

[0028] Figure 4(a) shows a situation where moving objects 201 and 202 are approaching the moving vehicle 100. In Figure 4(a), moving object 201 is closest to the vehicle 100, and moving object 202 is the next closest to the vehicle 100. In the situation shown in Figure 4(a), the selection unit 10a acquires detection results from the moving object detection sensor 30. The detection results, for example, indicate that moving objects 201 and 202 are approaching the moving vehicle 100, that moving object 201 is closest to the vehicle 100, and that moving object 202 is the next closest to the vehicle 100. The selection unit 10a selects a selection area 301 from the shooting area of ​​the on-board camera 20 so that the moving object 201, which is closest to the vehicle 100, is included in the cropped image. The image generation unit 10b crops an image corresponding to the selection area 301 and including the moving object 201 from the image captured by the on-board camera 20. As shown in Figure 5(a), the display control unit 10c causes the cropped image 41a extracted by the image generation unit 10b to be displayed on the display device 40. The display control unit 10c also causes the display device 40 to display an icon 42a representing the vehicle 100 and an icon 42b including the cropping range 42b indicating the position of the selected area 301 relative to the vehicle 100.

[0029] Furthermore, the display control unit 10c changes the display on the side of the cropped area 42b in the direction in which the moving object 202 is approaching the vehicle 100, in order to allow the user to recognize the moving object 202 approaching from outside the field of view. In this embodiment, as shown in Figure 5(a), the display control unit 10c changes the color of a part 42c on the side of the cropped area 42b in the direction in which the moving object 202 is approaching the vehicle 100. However, the display method is not limited to this, as long as it is possible to allow the user to recognize the moving object 202 approaching from outside the field of view. For example, the display on the side of the cropped area 42b in the direction in which the moving object 202 is approaching the vehicle 100 may be made to blink, or the border on the side of the cropped area 42b in the direction in which the moving object 202 is approaching the vehicle 100 may be made thicker.

[0030] Furthermore, the display control unit 10c may change the display on the side of the cutout range 42b in the direction in which the moving object 202 approaches the vehicle 100, depending on the distance between the vehicle 100 and the moving object 202. For example, as shown in Figure 6(a), the display control unit 10c may add information regarding the distance between the vehicle 100 and the moving object 202 to the icon 42b. Also, as shown in Figure 6(b), the display control unit 10c may thicken a portion 42c on the side of the cutout range 42b in the direction in which the moving object 202 approaches the vehicle 100 as the distance between the vehicle 100 and the moving object 202 decreases. Moreover, as shown in Figure 6(c), the display control unit 10c may shorten the blinking interval of the display on the side of the cutout range 42b in the direction in which the moving object 202 approaches the vehicle 100 as the distance between the vehicle 100 and the moving object 202 decreases.

[0031] Furthermore, the display control unit 10c may include in the icon 42 a shooting range (second range) 42e that indicates the position of the shooting area relative to the vehicle 100, as shown in Figure 7. The display control unit 10c may also change the display on the side in which the moving object 202 of the shooting range 42e is approaching the vehicle 100. In Figure 7, the color of a part 42f on the side in which the moving object 202 of the shooting range 42e is approaching the vehicle 100 is changed.

[0032] Figure 4(b) shows a situation in which, compared to the situation in Figure 4(a), the moving object 201 has overtaken the vehicle 100 and is moving away from the vehicle 100, while the moving object 202 is approaching the vehicle 100. In Figure 4(b), it is assumed that the moving object 201 is closest to the vehicle 100, and the moving object 202 is the next closest to the vehicle 100. In the situation in Figure 4(b), the selection unit 10a acquires detection results from the moving object detection sensor 30. The detection results may include, for example, that the moving object 201 is moving away from the vehicle 100, and the moving object 202 is approaching the vehicle 100, or that the moving object 201 is closest to the vehicle 100, and the moving object 202 is the next closest to the vehicle 100. The selection unit 10a selects a selection area 302 from the shooting area of ​​the on-board camera 20 so that the moving object 202 closest to the vehicle 100 among the moving objects approaching the vehicle 100 is included in the cropped image. The image generation unit 10b extracts a cropped image from the image captured by the on-board camera 20 that corresponds to the selection area 302 and includes the moving object 202. The display control unit 10c displays the cropped image 41b extracted by the image generation unit 10b on the display device 40, as shown in Figure 5(b). At this time, the display control unit 10c displays an icon 42a indicating the vehicle 100 and an icon 42 including the cropping range 42d indicating the position of the selection area 302 relative to the vehicle on the display device 40. Note that in the situation shown in Figure 4(b), there are no moving objects approaching from outside the field of view, so the display control unit 10c does not display information indicating moving objects approaching the vehicle 100 on the display device 40.

[0033] The following describes the operation flow of the display control device 10 as described above. Figure 8 is a flowchart of the operation of the display control device 10 in this embodiment. This flow starts when power is supplied to the display control device 10. In this embodiment, power is supplied to the display control device 10 when, for example, the ignition switch (start switch) of the vehicle 100 is turned ON, or when the shift lever of the vehicle 100 is changed to a position other than parking.

[0034] In step S101, the display control unit 10c displays on the display device 40 a cropped image corresponding to a pre-selected selection area (a selection area set in the initial state), and an icon that includes a cropping range indicating the position of the selection area relative to the vehicle 100.

[0035] In step S102, the display control unit 10c uses the detection result of the moving object detection sensor 30 to determine whether a moving object is approaching the vehicle 100 from behind (rear side). If the display control unit 10c determines that a moving object is approaching the vehicle 100 from behind, the process in step S103 is executed. If the display control unit 10c determines that no moving object is approaching the vehicle 100 from behind, the process in step S101 is executed.

[0036] In step S103, the selection unit 10a selects a selection area from the shooting area of ​​the on-board camera 20 so that the moving object closest to the on-board camera 20 among the moving objects approaching the on-board camera 100 from behind the on-board camera 20 is included in the cropped image. The image generation unit 10b then crops an image corresponding to the selection area from the image captured by the on-board camera 20.

[0037] In step S104, the display control unit 10c uses the detection result of the moving object detection sensor 30 to obtain the orientation of the second and subsequent moving objects that are approaching the vehicle 100 from behind the vehicle 100. The acquired information is used to allow the user to recognize moving objects approaching from outside the field of view.

[0038] In step S105, the display control unit 10c displays on the display device 40 the cropped image extracted by the image generation unit 10b, and an icon that includes the cropping range indicating the position of the selected area relative to the vehicle 100.

[0039] In step S106, the display control device 10 determines whether to terminate this flow. The display control device 10 determines that this flow will terminate if the power supply is cut off or if the user instructs it to terminate. If the display control device 10 determines that this flow will terminate, it terminates this flow. If the display control device 10 determines that this flow will not terminate, the process in step S102 is executed.

[0040] As explained above, the configuration of this embodiment makes it possible for the user to recognize which range of the image they are viewing relative to their vehicle. Furthermore, by displaying icons or the like to indicate that there are moving objects in areas that are not displayed, the user can understand that moving objects exist even outside the displayed range. [Example 2] While Example 1 described the case where there are two lanes on each side, this example describes the case where there are three lanes on each side. The automobile (hereinafter referred to as "the vehicle") 100, which is an example of a mobile body in this example, has the same configuration as the vehicle described in Example 1. In this example, only the configurations that differ from Example 1 will be described, and the common configurations will not be described.

[0041] In this embodiment, the selection unit 10a selects a selection area such that the closest moving object to the vehicle 100 is included in the cropped image, among moving objects that are approaching the vehicle 100 and are within a predetermined distance from the vehicle 100. The distance from the vehicle 100 may be the distance from the center position of the vehicle 100, or the distance from the moving object detection sensor 30. For example, if the moving object detection sensor 30 located on the right side of the vehicle 100 is used as the reference, the distance from the direction toward the right of the vehicle 100 (the direction perpendicular to the direction of travel and gravity of the vehicle 100) should be set to within 2m, which is shorter than the width of the lane (3.5m). By setting it in this way, it is possible to suppress the selection area from being selected in such a way that the cropped image includes a moving object traveling in a lane away from the lane in which the vehicle 100 is traveling.

[0042] Here, we will describe a case where there is a first moving object traveling in a lane adjacent to the first lane in which the vehicle 100 is traveling, and a second moving object traveling in a lane away from the first lane, and the second moving object is closer to the vehicle 100 than the first moving object. Assume that both the first and second moving objects are approaching the vehicle 100. In such a case, the user would like to recognize the first moving object traveling in the lane adjacent to the first lane, rather than the second moving object that is closer to the vehicle 100. However, in the configuration of Embodiment 1, the selection area is selected so that the second moving object, which is closest to the vehicle 100, is included in the cropped image. On the other hand, in the configuration of this embodiment, the moving object must satisfy the condition that its distance from the vehicle 100 is within a predetermined range, so the selection area is selected so that the first moving object, rather than the second moving object, which is closest to the vehicle 100, is included in the cropped image. In other words, it is possible to suppress the selection area from being selected so that the moving object is included in the cropped image when the moving object closest to the vehicle 100 is a moving object traveling in a lane away from the vehicle 100. This makes it possible for the display control device 10 to display the moving object that the user is most interested in (wants to know about) among the moving objects in the vicinity of its own vehicle 100.

[0043] Figure 9 is an explanatory diagram of the operation of the display control device 10. In Figure 9, the vehicle 100 and the moving objects 203 and 204 are traveling in lanes 500, 501, and 502, respectively. It is also assumed that moving object 204 is closest to the vehicle 100, and moving object 203 is the next closest to the vehicle 100. In the situation shown in Figure 9(a), the selection unit 10a selects the selection area 303 so that the moving object 203, which is closest to the vehicle 100 among the moving objects approaching the vehicle 100 and within a predetermined distance from the vehicle 100, is included in the cropped image. The predetermined range is set to 2m in the direction toward the right of the vehicle 100, 0m in the direction toward the front of the vehicle 100, and 20m in the direction toward the rear of the vehicle 100, based on the moving object detection sensor 30 located on the right side of the vehicle 100. The image generation unit 10b extracts a cropped image from the image captured by the in-vehicle camera 20 that corresponds to the selected region 303 and includes the moving object 203. The display control unit 10c displays the cropped image 41c extracted by the image generation unit 10b on the display device 40, as shown in Figure 10. At this time, the display control unit 10c displays an icon 43 on the display device 40 that includes an icon 43a representing the vehicle 100, a cropped range 43b indicating the position of the selected region 303 relative to the vehicle 100, and an icon 43c indicating the predetermined range described above.

[0044] Furthermore, the display control unit 10c may change the display on the side of the cropped area 43b in the direction in which the moving object 204 is approaching the vehicle 100, in order to allow the user to recognize the moving object 204 approaching from outside the field of view. In this embodiment, as shown in Figure 10, the display control unit 10c changes the color of a part 43d on the side of the cropped area 43b in the direction in which the moving object 204 is approaching the vehicle 100. [Example 3] Examples 1 and 2 described a case where, for one side of a vehicle, a cropped image and cropping range corresponding to one selected area are displayed on a single display device. This example describes a case where, for one side of a vehicle, corresponding cropped images and cropping ranges for multiple selected areas are displayed on multiple display devices. Specifically, in this example, the display device 40 has multiple display devices (first display units) that display information about the surrounding area to the right of the vehicle 100. In addition, the display device 40 also has multiple display devices (second display units) that display information about the surrounding area to the left of the vehicle 100. Note that the display device 40 may have multiple first display units and multiple second display units. The automobile (hereinafter referred to as the vehicle) 100, which is an example of a mobile body in this example, has the same configuration as the vehicle 100 described in Example 1. In this example, only the configurations that differ from Examples 1 and 2 will be described, and the common configurations will not be described.

[0045] Figure 11 is an explanatory diagram of the operation of the display control device 10. In Figure 11, a moving object 205 is traveling to the right front of the vehicle 100, and a moving object 206 is traveling to the right rear. In Figure 11, the moving object 205 is closest to the vehicle 100, and the moving object 206 is the next closest to the vehicle 100. In the situation in Figure 11, the selection unit 10a selects a selection area 304 so that the moving object 205 is included in the cropped image, and also selects a selection area 305 so that the moving object 206 is included in the cropped image. The image generation unit 10b extracts a cropped image corresponding to the selection area 304 and including the moving object 205, and a cropped image corresponding to the selection area 305 and including the moving object 206, from the image captured by the onboard camera 20. The display control unit 10c displays the cropped image 41d extracted by the image generation unit 10b on one of the display devices 40, as shown in Figure 12(a). At this time, the display control unit 10c causes the display device 40 to display an icon 44a that represents the vehicle 100 and an icon 44 that includes a cropping range 44b that indicates the position of the selected area 304 relative to the vehicle 100. Also, as shown in Figure 12(b), the display control unit 10c causes the cropped image 41e cropped by the image generation unit 10b to be displayed on the display device that is not displaying the cropped image 41d. At this time, the display control unit 10c causes the display device 40 to display an icon 45a that represents the vehicle 100 and an icon 45 that includes a cropping range 45b that indicates the position of the selected area 305 relative to the vehicle 100.

[0046] Alternatively, all cropped images and cropping areas may be displayed on a single display device. In this case, there may be only one display device 40. In this case, for example, the images in Figure 12(a) and Figure 12(b) will be displayed on a single display device. [Other examples] The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0047] In the above embodiments, wide-angle lenses were used for the in-vehicle cameras 20 and 21, but they do not necessarily have to be wide-angle lenses. For example, three imaging devices may be used to photograph the front, side, and rear of the vehicle 100, respectively.

[0048] This embodiment includes the following configurations and methods.

[0049] (Composition 1) A display control device for controlling a display unit that displays information about the area surrounding the vehicle, A selection unit that selects a portion of the area from the imaging area of ​​the imaging unit that captures the aforementioned peripheral area, An image generation unit extracts a cropped image corresponding to a portion of the image captured by the imaging unit, A display control device characterized by having the aforementioned cropped image and a display control unit that causes the display unit to display a first range indicating the position of the aforementioned partial area relative to the vehicle. (Configuration 2) The display control device according to configuration 1, characterized in that the selection unit selects a portion of the region based on the detection result of a detection unit capable of detecting a moving object. (Composition 3) The display control device according to configuration 2, characterized in that the selection unit selects a portion of the region such that the moving object closest to the vehicle among the moving objects approaching the vehicle is included in the cropped image. (Composition 4) The display control device according to configuration 2 or 3, characterized in that the selection unit selects a portion of the region such that the moving object closest to the vehicle among moving objects that are approaching the vehicle and are within a predetermined distance from the vehicle is included in the cropped image. (Composition 5) The selection unit selects a subset of areas from the imaging area, The image generation unit generates a plurality of cropped images corresponding to each of the plurality of partial regions from the image, The display control device according to any one of configurations 1 to 4, characterized in that the display control unit causes the display unit to display the plurality of cropped images and a plurality of first ranges indicating the position of each of the plurality of partial regions with respect to the vehicle. (Composition 6) A display control device according to any one of configurations 1 to 5, characterized in that when a detection unit capable of detecting a moving object detects a first moving object approaching the vehicle in an area outside the area described above, the display control unit causes the display unit to display information indicating the approach of the first moving object. (Composition 7) The display control device according to configuration 6, characterized in that the display control unit changes the display on the side in which the first moving body in the first range approaches the vehicle. (Composition 8) The display control device according to configuration 7, characterized in that the display control unit causes the display to differ according to the distance between the vehicle and the first moving object. (Composition 9) The display control device according to configuration 6, characterized in that the display control unit changes the display on the side in which the first moving body approaches the vehicle in the second range indicating the position of the shooting area relative to the vehicle. (Composition 10) A display control device described in any one of configurations 1 to 9, An imaging device characterized by having an image sensor. (Composition 11) A display control device described in any one of configurations 1 to 9, An imaging unit that photographs the area surrounding the vehicle, A detection unit capable of detecting moving objects, A mobile device characterized by having a display unit that displays information about the surrounding area. (Composition 12) The moving device according to configuration 11, characterized in that the imaging unit comprises a first imaging unit for imaging a first peripheral region and a second imaging unit for imaging a second peripheral region different from the first peripheral region. (Composition 13) The mobile device according to configuration 11 or 12, characterized in that the display unit comprises a first display unit that displays information relating to a first peripheral region and a second display unit that displays information relating to a second peripheral region different from the first peripheral region. (Method 1) A display control method for controlling a display unit that displays information about the area surrounding the vehicle, The steps include selecting a portion of the area from the imaging area of ​​the imaging unit that captures the aforementioned peripheral area, The steps include extracting a cropped image corresponding to a portion of the image from the image captured by the imaging unit, A display control method characterized by having the step of displaying the cropped image and a first range indicating the position of a part of the area with respect to the vehicle on the display unit. (Composition 14) A program characterized by causing a computer to execute the display control method described in Method 1.

[0050] Although preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of its gist. [Explanation of Symbols]

[0051] 100 Automobile (own vehicle) 10 Display control device 10a Selection section 10b Image generation section 10c Display Control Unit 20. In-vehicle camera (imaging unit) 40 Display device (display unit)

Claims

1. A display control device for controlling a display unit that displays information relating to the area surrounding a vehicle, A display control means that causes the display unit to display a portion of the captured image acquired from the imaging means that captures the surrounding area, and an icon representing the shooting range of the imaging means that corresponds to the portion of the area, It has detection means for detecting a moving object different from the aforementioned vehicle, The display control device is characterized in that, when the display control means detects a first moving object outside the area displayed on the display unit by the detection means, it performs display control to display information representing the position of the first moving object on the icon.

2. The display control device according to claim 1, further comprising a selection means for selecting a partial region based on the detection result of the detection means.

3. The display control device according to claim 2, characterized in that the selection means selects the partial region such that the moving body closest to the vehicle among the moving bodies approaching the vehicle is included in the partial region.

4. The display control device according to claim 2, wherein the selection means selects the partial region such that the moving body closest to the vehicle among moving bodies that approach the vehicle and are within a predetermined distance from the vehicle is included in the partial region.

5. The selection means selects a plurality of partial regions from the captured image, The display control device according to claim 2, characterized in that the display control means causes each of the plurality of partial areas to be displayed on the display unit together with an icon representing the range corresponding to the partial area for the vehicle.

6. The display control device according to claim 1, characterized in that the display control means changes the portion of the icon that corresponds to the range in which the first moving body approaches the vehicle.

7. The display control device according to claim 6, characterized in that the display control means causes the display to differ according to the distance between the vehicle and the first moving body.

8. A display control method for controlling a display unit that displays information relating to the area surrounding a vehicle, A display control step that causes the display unit to display a portion of the captured image acquired from the imaging means that captures the surrounding area, and an icon representing the shooting range of the imaging means that corresponds to the portion of the area; The system includes a detection step for detecting a moving object different from the aforementioned vehicle, The display control method is characterized in that, in the display control step, if the first moving object is detected outside the part of the area displayed on the display unit by the detection step, the display control is performed so that information representing the position of the first moving object is shown on the icon.

9. A program characterized by causing a computer to execute the display control method described in claim 8.

Images